Optimizing-QoS-vSphere_final
QoS Best Practice 5: Determine
Performance of Native versus
Testing in Intel’s performance labs shows
some native software initiators out-
performhardware-ofoadedfunctions.
For example, hardware-based initiators
thatarefoundoniSCSIofoadsorHost
Bus Adapters (HBAs) might not have
equivalentorsimilarperformancebenets
on the most current server platforms
as compared to those they had on older
platforms.Insomecases,CPUutilization
mightbelowerusinghardwareofoads,
buttheoverallnumberofI/Ooperations
persecondisalsosignicantlylower.
With the power and speed of today’s
server platforms and 10GbE network
connections,ofoadprocessorscan
easily become overwhelmed, requiring
owcontrolstobeputinplacetoreduce
the amount of data submitted to the
ofoadprocessor.Suchowcontrolscan
reducethebenetsofofoadprocessors
signicantly.
VMwarehasmadesignicantperformance
improvements for iSCSI storage, including
iSCSI boot support on Intel® Ethernet
adapters. Using software initiators instead
ofanofoadallowsITorganizations
to take advantage of a combination of
new in-guest virtualization-optimized
iSCSI drivers and VMkernel-level storage
stack optimizations. These factors can
dramaticallyimproveperformanceforI/O-
intensive applications such as databases
and messaging.
Several features in vSphere 4.1 also
provide prioritization for network and
storageI/Othatcannotbeusedifthe
trafcisofoadedtoanHBA.The
tradeoffs associated with not using
software-controlled initiators may be
prohibitive on newer platforms. Having
to use a separate management and
monitoringtooltocongurethehardware
canalsoaddsignicantcomplexityand
cost to the solution.
Todeterminewhetheranofoadis
needed, run workloads that correspond
to both maximum throughput and
real-worldscenariosusingtheofoad
enabled, and compare the performance
results to similar cases when the the
OS-native software initiators are used
insteadofofoadingthefunction.It
is also necessary to check VMware’s
documentation to determine the
compatibility of individual vSphere 4.1
functionsandfeatureswithofoad.See
the ESXCongurationGuide
9
and the ESXi
CongurationGuide.
10
ESX can use different types of adapters to
provide iSCSI connections. Two examples
arenativesoftware-basediSCSIadapter/
initiators and dependent hardware
iSCSI adapters, as shown in Figure 7 and
described below.
Adapter/Initiators
A software iSCSI adapter is a VMware
code built into the VMkernel. It allows
a host to connect to the iSCSI storage
device through standard network
adapters. The software iSCSI adapter
handles iSCSI processing while
communicating with the network adapter.
The software iSCSI adapter allows the use
of iSCSI technology without the need to
purchase specialized hardware. The host
needs only a standard network adapter
for network connectivity. iSCSI and
network processing is done primarily by a
hostCPUbutcanbeassistedbystateless
ofoadsintheadapter/controller.
Native software-based iSCSI
adapter/initiatorsanddependenthardware
iSCSI adapters are examples of adapters ESX
uses to provide iSCSI connections.
ESX/ESXi
virtual
machine
virtual disk
virtual disk
hardware
iSCSI
initiator
(HBA)
VMFS
LUN1 LUN2 LUN5
VMware virtualization layer
software iSCSI initiator
SCSI
controller
virtual
machine
SCSI
controller
ethernet
NIC
LAN
LAN
.vmdk RDM
Load-basedteamingcanhelpbalancethetrafficloadbetweenphysicalserveradapters.
Unbalanced Traffic
vNetwork
Distributed
Switch
VM1 40% VM2 10%
VM3 40%
VM1 40%
VM3 40%
VM2 10%
VM3 40%
Load-based Teaming (LBT)
APP
OS
APP
OS
APP
OS
0%
0%
VM140%
VM2
VM2
10
10
vNetwork
Distributed
Switch
APP
OS
APP
OS
APP
OS
0%
0
0
%
%
7