Deployment Guide

Table of contents
3 VMware vSphere Bitfusion on Dell EMC PowerEdge servers | Deployment guide
Table of contents
Revisions............................................................................................................................................................................. 2
Acknowledgements ............................................................................................................................................................. 2
Table of contents ................................................................................................................................................................ 3
Executive summary ............................................................................................................................................................. 5
1 Audience and scope ..................................................................................................................................................... 6
2 Overview ....................................................................................................................................................................... 7
3 Component overview .................................................................................................................................................... 9
3.1 DELL EMC PowerEdge R740xd server ............................................................................................................. 9
3.2 DELL EMC PowerEdge C4140 server ............................................................................................................... 9
3.3 Dell EMC vSAN Ready Node R740xd .............................................................................................................. 10
3.4 Dell EMC Networking S5248F-ON Switch ....................................................................................................... 11
3.5 NVIDIA T4 Datacenter GPU ............................................................................................................................. 11
3.6 NVIDIA V100 for NVLINK and PCIe, Datacenter GPU .................................................................................... 11
3.7 Mellanox ConnextX-5 Dual Port 10/25GbE Adapter ........................................................................................ 12
4 Pre-deployment requirements .................................................................................................................................... 13
4.1 GPU hosts ........................................................................................................................................................ 13
4.2 Client cluster ..................................................................................................................................................... 13
4.3 Bitfusion server and client software .................................................................................................................. 14
4.4 vCenter ............................................................................................................................................................. 14
4.5 Client virtual machine ....................................................................................................................................... 14
4.6 Connectivity ...................................................................................................................................................... 14
4.7 Network services .............................................................................................................................................. 15
5 Solution overview ....................................................................................................................................................... 16
5.1 Architecture ....................................................................................................................................................... 16
5.2 Component information .................................................................................................................................... 16
5.3 VLANs and IP subnet information. ................................................................................................................... 17
6 Deployment and configuration.................................................................................................................................... 18
6.1 Verify the GPU host hardware configuration .................................................................................................... 18
6.2 Add the GPU hosts and client cluster to the vCenter inventory ....................................................................... 18
6.3 Prepare and configure the GPU hosts and client cluster for PVRDMA ............................................................ 18
6.3.1 Tag a VMkernel adapter for PVRDMA ............................................................................................................. 19
6.3.2 Add and manage hosts on the Bitfusion distributed switch .............................................................................. 20
6.4 Deploy the Open Virtual Appliance (OVA) to create the bitfusion-server-1 virtual machine ............................ 21
6.5 Edit the bitfusion-server-1 hardware settings ................................................................................................... 25