Maximizing File Transfer Performance Using 10Gb Ethernet and Virtualization
3
Hardware
Intel® Xeon® processor X5560 series @ 2.8 GHz (8 cores, 16 threads); SMT, NUMA,
VT-x, VT-d, EIST, Turbo Enabled (default in BIOS); 24 GB Memory; Intel 10GbE
CX4 Server Adapter with VMDq
Test Methodology
RAM disk used, not disk drives. We are focused on network I/O, not disk I/O
What is being
transferred?
Directory structure, part of Linux repository: ~8 G total, ~5000 les, variable le
size, average le size ~1.6 MB
Data Collection
Tools Used
Linux * utility “sar”: Capture receive throughput and CPU utilization
Application
Tools used
Netperf (common network micro-benchmark); OpenSSH, OpenSSL (standard
Linux layers); HPN-SSH (optimized version of OpenSSH); scp, rsync (standard
Linux le transfer utilities); bbcp (“BitTorrent-like” le transfer utility)
SOURCE SERVER
NETPERF
SCP RSYNC
SSH HPNSSH
RHEL 5.3 64-bit
DESTINATION SERVER
NETPERF
SCP RSYNC
SSH HPNSSH
RHEL 5.3 64-bit
File Transfer
Direction
Directly connected
back-to-back
Figure 3.
FedEx and Intel delved deeper into the
featured Red Hat Enterprise Linux (RHEL)
equipped with Intel 10 Gigabit AF DA Dual
Port Server Adapters supporting direct
cable connections and the VMDq feature
Native Test Configuration
Figure 3 details the components of
systems were connected back-to-back
over 10G to eliminate variables that
could be caused by the network switches
best-case scenario because any switches
real-world scenarios, possibly degrading
A RAM disk, rather than physical disk
drives, was used in all testing to focus on
the network I/O performance rather than
The default bulk encryption used in
OpenSSH and HPN-SSH is Advanced
The application test tools included the
netperf: This commonly used
network-oriented, low-level synthetic,
micro-benchmark does very little
It is effective for evaluating the capabilities
OpenSSH, OpenSSL: These standard
Linux layers perform encryption for
HPN-SSH: This optimized version
of OpenSSH was developed by the
For more details, visit www.psc.edu/
networking/projects/hpn-ssh/
scp: The standard Linux secure copy utility
rsync: The standard Linux directory
synchronization utility
bbcp: A peer-to-peer file copy utility
the Stanford Linear Accelerator Center
www.slac.stanford.edu/~abh/bbcp/
3