White Papers

18 DELL EMC HPC Solution for Life Sciences v1.1 | Document ID | version (optional)
3.2.1 Solution summary
The FC30 solution with IB FDR interconnect is nearly identical to the 10 GbE version except for a couple of
changes in the switching infrastructure and network adapters and have 2:1 blocking FDR connectivity to the
top of rack FDR switch.
• The port assignment of the Dell Networking S3048-ON switch for the Intel® OPA or IB versions of the
solution is as follows.
• Ports 01-04 and 27–52 are assigned to the cluster’s private management network to be used by
Bright Cluster Manager® connecting master, login, CIFS gateway and compute nodes. The
PowerEdge C6320 server’s ethernet and iDRAC constitute a majority of these ports.
• Ports 06–09 are used for the private network associated with NSS7.0-HA.
• The rest of the port 05 and ports 12–26 are allocated to the Lustre solution for its private
management network
• Port 10 and 11 are used for the PDUs.
For the 10GbE configuration, the deployment and management of the cluster is done over the 10 Gigabit
Ethernet network by using the Dell Networking S4820T switch. So, the first virtual LAN on the S3048-ON,
from ports 0–16, is not used. The other two virtual LANs are still used for the same purpose as in the IB FDR
configuration.
Table 4 Hardware summary
Rack
1x 48U 750mm wide x 1200mm Deep
Master nodes
2x PowerEdge R430
Login nodes
2x PowerEdge R430
CIFS gateway
1x PowerEdge R430
Compute nodes
40x PowerEdge FC430 on 5x PowerEdge FX2 chassis
High speed interconnect switch
3x MLNX SX6036
Management switch
1x Dell Networking S3048-ON
Primary File System
Dell EMC NSS7.0-HA configuration (240TB)
Parallel File System
Dell EMC HPC Lustre Storage Solution (480TB raw space)
3.2.2 Cabling information
Table 5 Required cables
Cable types
Length
Quantity
High speed
interconnect cables
Fiber optic cables
3 M
40
Copper cables
2M
8
Management cables
1GbE RJ-45 CAT6
10 ft
15
5 ft
10
1ft
5