White Papers

9 DELL EMC HPC Solution for Life Sciences v1.1 | Document ID | version (optional)
- 4GB/8GB/16GB/32GB DDR4 up to 2400MT/s
• Up to 2 x 1.8” SATA SSD boot drives
• Optional 96-lane PCIe 3.0 switch for certain accelerator configurations
• iDRAC8, Dell OpenManage Essentials
• 4 x K80 GPUs
2.2 Network Configuration
The Dell HPC Solutions for Genomics is available in Intel OPA and two IB variants. There is also a Force10
S3048-ON GbE switch which is used in both configurations whose purpose is described here. In one of the IB
variants, the Dell PowerEdge FC430 sleds have 2:1 blocking FDR connectivity to the top of rack FDR switch.
The other IB variant is 1:1 non-blocking EDR network for C6320.
2.2.1 Management Network
Management traffic typically communicates with the Baseboard Management Controller (BMC) on the
compute nodes using IPMI. The management network is used to push images or packages to the compute
nodes from the master nodes and for reporting data from client to the master node. Dell Networking S3048-
ON and PowerConnect 2848 Switch are considered for management network
Dell Network S3048-ON
High density, 1U 48-port 1000BASE-T + with four 10GbE uplinks, non-blocking rate-line performance,
featuring the Open Networking Install Environment (ONIE).
The port assignment of the Dell Networking S3048-ON switch for the Intel® OPA or IB versions of the solution
is as follows.
• Ports 01-04 and 27–52 are assigned to the cluster’s private management network to be used by Bright
Cluster Manager® connecting master, login, CIFS gateway and compute nodes. The PowerEdge C6320
server’s ethernet and iDRAC constitute a majority of these ports.
• Ports 06–09 are used for the private network associated with NSS7.0-HA.
• The rest of the port 05 and ports 12–26 are allocated to the Lustre solution for its private management
network
• Port 10 and 11 are used for the PDUs.
Note: It is required to install four SFP+ to RJ45 transceivers in Dell Networking S3048-ON switch ports 49-52.
Figure 1 Dell Networking S3048-ON switch