White Papers

19 DELL EMC HPC System for Life Sciences v1.2 | Document ID | version (optional)
3.2.1 Solution summary
The FC30 solution with IB FDR interconnect is nearly identical to the 10 GbE version, except for a few
changes in the switching infrastructure, and network adapters and have 2:1 blocking FDR connectivity to the
top of rack FDR switch.
The port assignment of the Dell EMC Networking S3048-ON switch for the Intel® OPA or IB versions
of the solution is as follows.
Ports 01-04 and 2752 are assigned to the cluster’s private management network to be used by
Bright Cluster Manager® connecting master, login, CIFS gateway and compute nodes. The
PowerEdge C6320 server’s Ethernet and iDRAC constitute a majority of these ports.
Ports 0609 are used for the private network associated with NSS7.0-HA.
The rest of the port 05 and ports 1226 are allocated to the Dell EMC Ready Bundle for HPC Lustre
Storage for its private management network
Port 10 and 11 are used for the PDUs.
For the 10GbE configuration, the deployment and management of the cluster is done over the 10 Gigabit
Ethernet network by using the Dell EMC Networking S4820T switch. So, the first virtual LAN on the S3048-
ON, from ports 016, is not used. The other two virtual LANs are still used for the same purpose as in the IB
FDR configuration.
Table 4 Hardware summary
Rack
1x 48U 750mm wide x 1200mm Deep
Master nodes
2x PowerEdge R430
Login nodes
2x PowerEdge R430
CIFS gateway
1x PowerEdge R430
Compute nodes
40x PowerEdge FC430 on 5x PowerEdge FX2 chassis
High speed interconnect switch
3x MLNX SX6036
Management switch
1x Dell EMC Networking S3048-ON
Primary File System
Dell EMC NSS7.0-HA configuration (240TB)
Parallel File System
Dell EMC Ready Bundle for HPC Lustre Storage (480TB raw space)
3.2.2 Cabling information
Table 5 Required cables
Cable types
Length
Quantity
High speed
interconnect cables
Fiber optic cables
3 M
40
Copper cables
2 M
8
Management cables
1GbE RJ-45 CAT6
10 ft
15
5 ft
10
1ft
5