Optimizing-QoS-vSphere_final
Dependent Hardware iSCSI Adapters
Dependent hardware iSCSI adapters
depend on VMware networking and iSCSI
congurationandmanagementinterfaces
provided by VMware. This type of adapter
can be a card that presents a standard
networkadapterandiSCSIofoad
functionality for the same port. The iSCSI
ofoadfunctionalitydependsonthe
host’snetworkcongurationtoobtainthe
IP,MAC,andotherparametersusedfor
iSCSI sessions. An example of a dependent
adapter is the iSCSI-licensed Broadcom
5709NIC.HardwareiSCSIadaptersmight
need to be licensed to appear in the
vSphere Client or vSphere command-line
interface. A hardware iSCSI adapter is a
third-partyadapterthatofoadsiSCSIand
network processing from the host.
Dependent Hardware iSCSI
Adapter Limitations
The following limitations relate to the use
of dependent hardware iSCSI adapters:
•IPv6configurationcannotbe
used with dependent hardware iSCSI
adapters.
•No DHCP:DHCPcannotbeusedwith
dependent hardware iSCSI adapters.
• Routing is not available for
dependent hardware iSCSI adapters.
• The iSCSI
traffic resource pool shares do not apply
to iSCSI traffic on a dependent hardware
iSCSI adapter.
• A traffic-shaping
policy is defined by three characteristics:
average bandwidth, peak bandwidth,
and burst size. Traffic-shaping policies do
not apply to iSCSI traffic on a dependent
hardware iSCSI adapter.
• When a
dependent hardware iSCSI adapter is
used, performance reporting for a NIC
associated with the adapter might show
little or no activity, even when iSCSI
traffic is heavy. This behavior occurs
because the iSCSI traffic bypasses the
regular networking stack.
• If any security
vulnerabilities exist in the iSCSI device
software, data can be at risk through no
fault of ESX. To lower this risk, network
administrators should install all security
patches that the storage equipment
manufacturer provides and limit the
devices connected to the iSCSI network.
Dependent Hardware iSCSI Considerations
from VMware Regarding Dependent
Hardware iSCSI Adapters
When dependent hardware iSCSI adapters
are used with ESX, certain considerations
apply:
•WhenanydependenthardwareiSCSI
adapter is used, performance reporting
for a NIC associated with the adapter
might show little or no activity, even
when iSCSI traffic is heavy. This behavior
occurs because the iSCSI traffic bypasses
the regular networking stack.
•SomedependenthardwareiSCSI
adapters perform data reassembly
in hardware, which has a limited
buffer space.
•WhenadependenthardwareiSCSI
adapter is used in a congested network
or under load, network administrators
should enable flow control to avoid
performance degradation. Flow control
manages the rate of data transmission
between two nodes to prevent a fast
sender from overrunning a slow receiver.
For best results, enable flow control at
theendpointsoftheI/Opath,atthe
hosts and iSCSI storage systems.
•SomedependenthardwareiSCSIadapters
donotsupportIPv6andJumboFrames.
Check VMware’s documentation for
specific adapter limitations.
Note that other feature incompatibilities
mayexistwhenusingofoadengines.
For example, vCenter Server Heartbeat*
isincompatiblewithTCPOfoadEngine
(TOE), a common feature of some non-
Intel 10GbE cards. Because vCenter
Server Heartbeat is intended to manage
thepassingorlteringofselectedIP
addresses, the following TOE features
must be disabled on all network adapters
prior to installing vCenter Server Heartbeat:
•OffloadIPSecurity
•OffloadTCPSegmentation
•OffloadTCP/IPChecksum
Using VMware NetQueue with Intel VMDq,
VMXNET3,PCIeGen2x8connections,
andLBTwillprovidethehighestlevels
of performance so the next step of
monitoringbandwidthandtrafcwill
provide the best data on which to make
control decisions.
The key to understanding the needs
for QoS controls is to test the network
congurationwithbenchmarkingand
load-generation tools to determine
maximum throughput and typical or “real-
world” workloads. The basic rule here is
to understand the bottlenecks and assess
their impact.
Deploying the vSphere Management
Assistant (vMA) allows you to run
resxtop
11
(remote esxtop) from the
command line and remotely connect
toESX/ESXihostsdirectlyorthrough
vCenter* Server to monitor various
aspects of performance. The Network
panel in resxtop displays server-wide
network utilization statistics.
Statistics are arranged by port for each
virtualnetworkdevicecongured.For
physical network adapter statistics, see
the row in Table 1 that corresponds to
the port to which the physical network
adapter is connected. For statistics on a
virtualnetworkadapterconguredina
particular VM, see the row corresponding
to the port to which the virtual network
adapter is connected.
8