Intel Microarchitecture and 10 gigabit Ethernet Transforming the Data Center

The Benefits of 10GbE
The benefit of transitioning the data center to 10GbE connectivity is
apparent in Figure 2(a). Compared to the multiple GbE NICs in Figure
1(b), 10GbE connectivity provides greater bandwidth while reducing
the number of server adapters and switch ports and the amount of
cabling required for LAN connectivity as shown in Figure 2(a). The
reduction in equipment and cabling provided by 10GbE simplifies
the network and can significantly reduce TCO as compared to GbE
connectivity. Also, in addition to providing the higher bandwidth
demanded by many applications today, 10GbE is the foundation for
the next evolutionary stage in networking, in which Ethernet will
extend its reach in the data center.
Increased deployment of virtualized servers also drives the need for
greater connectivity to the SAN. With many VMs inhabiting a server,
it is not practical for each VM to boot from a local hard drive. Instead,
operating system and application data is contained in networked
storage devices, typically Network Attached Storage (NAS) servers
or a Fibre Channel or Internet Small Computer System Interface
(iSCSI) SAN disk array. Remote storage is also critical for VM migration
between physical servers and disaster recovery, where a VM needs to
be brought up on a new physical server.
(b) Further Simplification with Unified Networking
LAN SAN
Data Center
Switch
Director
Switch
FCoE Switch
VMM
Dual Fibre Channel Connection
Dual 10 Gigabit Ethernet Connection
VM
1
VM
2
VM
3
VM
4
(a) Simplified Connectivity with 10GbE
LAN SAN
Data Center
Switch
Director
Switch
Edge Switch
VMM
FC Switch
FC
VM
1
VM
2
VM
3
VM
4
Virtual
Switch
Virtual
Switch
Figure 2. Migrating to 10GbE (a) eliminates the clutter of GbE connectivity, and (b) further simplification is possible by converging LAN and SAN traffic
onto a single 10GbE fabric using Fibre Channel over Ethernet.
Figure 2(b) shows an example of unified networking or multiple
traffic types on Ethernet. In Figure 2(b), a Fibre Channel over Ethernet
(FCoE) capable 10GbE server adapter and an FCoE switch are used to
combine LAN and SAN traffic onto a single 10GbE network fabric. The
result is a further reduction in network infrastructure equipment and
an easier-to-manage network with ample bandwidth for both storage
traffic and network traffic to and from the virtualized server.
In the past, the cost of migrating to 10GbE was a legitimate concern,
but that is no longer the case. While a 10GbE server adapter does cost
more than a GbE server adapter, the total bandwidth cost is lower,
and as volume ramps, the cost of 10GbE ports is projected to drop at
a greater than 30 percent rate over five years. Also, a single 10GbE
server adapter uses only one PCI Express slot versus the multiple
slots consumed by multiple GbE adapters. Adapters based on the Intel
82599 10 Gigabit Ethernet Controller include support for existing
Ethernet storage applications, such as iSCSI and NAS, as well as the
emerging FCoE standard, eliminating the need for separate, dedicated
storage adapters.
The price of 10GbE adapters and switches is also decreasing; new
standards for copper-based 10GbE networks will result in even lower
infrastructure costs. These standards include:
•
SFP+ Direct Attach. Uses a twin-ax cable assembly for a low-
power, low-latency, and low-cost connection of up to 7 meters.
•
10GBASE-T. Allows 10GbE connectivity to 55 meters over Category
6 unshielded twisted pair or to 100 meters over Augmented
Category 6 cabling.
5
White Paper: Intel® Microarchitecture and 10 Gigabit Ethernet Transforming the Data Center