Dell EMC Networking - Deploying VMware vSAN with OS10 Enterprise Edition Deployment Guide Dell EMC Networking Infrastructure Solutions May 2018 A Dell EMC Deployment Guide
Revisions Date Description May 2018 Initial release 1.0 Authors Ed Blazek, Colin King The information in this publication is provided “as is.” Dell Inc. makes no representations or warranties of any kind with respect to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a particular purpose. Use, copying, and distribution of any software described in this publication requires an applicable software license. Copyright © 2018 Dell Inc.
Table of contents Revisions............................................................................................................................................................................. 2 1 Introduction ................................................................................................................................................................... 4 1.1 Dell EMC Networking S4100-ON switch series ...............................................................................
1 Introduction The Dell EMC OS10 Enterprise Edition operating system is a native Linux-based network operating system that has a wholly disaggregated software architecture. OS10 decouples the base software from the layer 2 and layer 3 protocol stack and services and brings forth the ability for open programmability and portability. This document outlines the use of OS10 Enterprise Edition running on Dell EMC Networking S4100-ON series switches. 1.
1.2 Dell EMC PowerEdge R740xd server The Dell EMC PowerEdge R740xd server is a dual socket 2RU platform that brings scalable storage performance and data set processing to adapt to a variety of applications. The R740xd server features Intel Xeon processors, with up to 3 terabytes of expandable memory and network interface technologies to cover a variety of high performance NIC and rNDC network interface options.
2 Objective This deployment guide contains information for configuring physical and virtual networking settings for the deployment of VMware vSAN. Administrators can use this guide to deploy a basic vSAN cluster on an established network. Note: The example used in this guide is limited to vSAN subject matter and does not include a full data center networking configuration.
3 Leaf-Spine overview The connections between leaf and spine switches can be layer 2 (switched) or layer 3 (routed). The terms “layer 3 topology” and “layer 2 topology” in this guide refer to these connections. In both topologies, downstream connections to servers, storage and other endpoint devices within the racks are layer 2 and connections to external networks are layer 3.
vSAN cluster using four server nodes connected to a leaf pair of switches 3.2 vSAN networking recommendations This section lists the networking recommendations used in the deployment example for vSAN clusters. These recommendations can be found in the VMware Validated Design for SDDC documentation at VMware Validated Design Documentation.
4 Switch configuration This section provides steps to configure Dell EMC Networking S4148-ON switches running Dell Networking OS 10.4.0E (R3). The process requires basic familiarity with OS10 configuration and network switches. 4.1 Check switch firmware version Use the following command to verify that the firmware version on the switch is 10.4.0E (R3) or later. If not, visit Dell.com/support to download the latest firmware version for the switch.
4.4 Global switch settings 1. Power-on the switch and connect laptop's serial cable to the Dell EMC S4148-ON console port. 2. Configure the hostname and management port IP address: Switch-1 (S4148-ON) Switch-2 (S4148-ON) hostname Switch-1 hostname Switch-2 interface mgmt 1/1/1 no shutdown no ip address ip address 100.67.171.35/24 ipv6 address autoconfig interface mgmt1/1/1 no shutdown no ip address ip address 100.67.171.34/24 ipv6 address autoconfig management route 100.67.0.0/16 100.67.171.
1. Configure the VLTi port channel for dual-switch topologies on Switch-1 using the commands in the first column of Table 2 (recommended port values shown). 2. Configure Switch-2 using the commands in column 2 provided in Table 2. VLTi configuration 4.6 Switch-1 (S4148-ON) Switch-2 (S4148-ON) interface ethernet1/1/29-1/1/30 description VLTi no shutdown no switchport interface ethernet1/1/29-1/1/30 description VLTi no shutdown no switchport vlt-domain 127 backup destination 100.67.171.
4.7 Node-facing configuration Configure the vSAN node-facing interfaces with the following steps.
4.8 Leaf switch pair uplinks The purpose of this document is to show the deployment of a vSAN cluster using two VLT peer switches. Administrators can use this leaf pair in a layer 3 or layer 2 leaf-spine network topology. For large deployments that require scale, the layer 3 leaf-spine architecture is commonly used. For detailed information on the layer 3 design for leaf-spine using Dell EMC Networking OS10, see Dell EMC Networking L3 Design for Leaf-Spine with OS10EE.
5 VMware vSAN deployment This section contains information on deploying a vSAN cluster to the network. The focus is on vSAN configuration as it pertains to the leaf pair switch configuration in section 4. High level information on server preparation, ESXi, and vCenter will be provided with references for additional support. 5.1 VMware ESXi and vCenter Server prerequisites This section contains the initial setup of the hosts and virtual networking configuration to prepare for vSAN deployment. 5.1.
The following table contains example IP address information. The addresses below will be used throughout the virtual networking configuration steps. VLAN and IP addresses used in example configurations Purpose VLAN Host1 Host2 Host3 Host4 Gateway ESXi management 2030 172.20.30.101 /24 172.20.30.102 /24 172.20.30.103 172.20.30.104 172.20.30.253 /24 /24 vMotion 2031 172.20.31.101 /24 172.20.31.102 /24 172.20.31.103 172.20.31.104 172.20.31.253 /24 /24 vSAN 2032 172.20.32.101 /24 172.20.32.
A cluster represents a collection of compute and memory resources for a group of physical servers. vSAN aggregates storage devices of the host cluster and creates the storage pool that is shared across all hosts in the vSAN cluster. The following steps are used to create a cluster: 1. On the web client Home screen, select Hosts and Clusters. 2. In the Navigator pane, right click the datacenter object and select New Cluster. 3. Provide a Name (example: atx01-w01-vSAN) and click OK. Create cluster 5.1.2.
Add hosts to cluster 5.1.3 Create a vSphere Distributed Switch (VDS) This section provides the steps necessary to configure a vSphere Distributed Switch (VDS). A VDS is a virtual switch that allows each host associated with it to have a consistent network configuration for both the host and virtual machines running on them. Each VDS can be assigned multiple distributed port groups, which includes the VLAN ID for the specified traffic.
Note: The terms vSphere Distributed Switch, VDS, and distributed switch are used interchangeably in this document. 5.1.3.1 Add distributed port groups This section provides steps to add the management, vMotion, and vSAN distributed port groups. Example values used are listed in Table 5.
5.1.3.2 Configure teaming and failover on uplinks This section provides steps on assigning the behavior of load balancing, network failure detection, switch notification, failback, and uplink failover order. For this example, all port groups will be assigned the same behavior. The recommended setting for load balancing for vSAN, vMotion, and management traffic is route based on physical NIC load. The following steps can be used to set the teaming and failover behavior: 1.
5.1.3.3 Add and manage hosts This section provides steps to add hosts to the VDS. During this process both physical adapters and VMkernel adapters will be managed. Managing physical adapters includes adding the adapters to the VDS and assigning then to uplinks. Managing VMkernel adapters includes adding the adapters to the VDS and configuring adapter settings. When the management VMkernel adapter is assigned to the VDS, it is migrated from the standard vSwitch to the VDS.
9. On the Manage VMkernel network adapters page, each host is listed with its VMkernel adapters beneath it. Only the default ESXi management VMkernel will be present. a. Select the ESXi management VMkernel adapter, vmk0, on the first host and click b. Choose the management port group (example: Management-vds01-vSAN). Click OK. c. Repeat steps 9.a. - 9.b. for each of the remaining hosts in the vSAN cluster. Manage VMkernel network adapters, step 7a-b d. Click on the first host, then click on i.
v. Repeat step 9.e for each of the remaining hosts in the vSAN cluster. f. Click Next. g. On the Analyze impact page, the Overall impact status should indicate No impact. h. Click Next then Finish. Note: Deployment examples in this guide only provide instructions for a single leaf switch pair. If deploying onto a routed leaf-spine, administrators may require separate gateways for vMotion or vSAN traffic. A vSAN stretched cluster deployment uses static routes to provide separate gateways.
5.1.3.4 Enable Jumbo frames This section provides steps to enable jumbo frames on the VDS and individual VMkernel adapters on each host. Jumbo frames are recommended for vSAN and vMotion traffic and must be configured at the physical switch, the VMkernel adapter, and the VDS. The following steps can be used to enable jumbo frames: To enable jumbo frames at the VDS: 1. 2. 3. 4. 5. On the web client Home screen, select Networking.
c. On the Claim disks page, set Group by to Host and expand the hosts to view available disks. d. For the first disk on the first host, Cache tier is selected. Capacity tier is selected for the next seven disks as shown in Figure 15. Leave the remaining disks set to Do not claim. Note: The recommended flash cache to consumed capacity ratio is at least 10 percent. The VMware vSAN maximum limit is 7 capacity devices per diskgroup. Claim disks - Setting Cache and Capacity tiers e.
4. Select a host followed by the Create a new disk group icon 5. In the Create Disk Group window: a. Select a single disk for the cache tier from the upper list. b. Select seven disks for the capacity tier from the lower list. Click OK. 6. Repeat steps 4 and 5 as necessary. The vSAN datastore can be seen by navigating to Home > Storage. The vSAN datastore is given a default name of vsanDatastore and can be renamed by right clicking on it and choosing Rename.
A Validated components Component table example Component Description Version Server PowerEdge R740xd 14G Monolithic 0.0.1 OS ESXi, 6.5.0 update 02 Build 8294253 vCenter Server Appliance 6.5.0.1000 Build 5973321 vSAN 6.6.1 BIOS 1.2.11 iDRAC 3.15.15.15 Processor 2 x Intel ® Xeon ® Gold 6130 CPU @ 2.10GHz Memory DDR-4 Dual Rank 2666 MHz (total 64 GB) Internal Disks Solid State Disk 372.61 GB (24 drives) Network Devices Intel ® 2P X710/2P I350 rNDC S4148-ON 10.4.
B Accessing the RS-232 console port Note: Before starting, verify that the PC has a 9-pin serial port and that a terminal emulation program is already installed and running on the PC. If your PC does not have a DB-9 serial port connection, use a USB-to-Serial adapter. Dell EMC Networking S4148-ON RS-232 console ports 1. Install the RJ-45 connector side of the provided cable into the S4148-ON console port. 2.
C Product Manuals and technical guides Dell.com/support is focused on meeting customer needs with proven services and support. Dell TechCenter is an online technical community where IT professionals have access to numerous resources for Dell EMC software, hardware and services. Storage Solutions Technical Documents on Dell TechCenter provide expertise that helps to ensure customer success on Dell EMC Storage platforms. OS10 Enterprise User Guide release 10.4.
D Support and feedback Contacting Technical Support Support Contact Information Web: http://support.dell.com/ Telephone: USA: 1-800-945-3355 Feedback for this document We encourage readers to provide feedback on the quality and usefulness of this publication by sending an email to Dell_Networking_Solutions@Dell.com. 29 Dell EMC Networking - Deploying VMware vSAN with OS10 Enterprise Edition | version 1.
