Installation guide

It is even more important to properly congure the private network. The private network is used as an interconnect between each
cluster node. This network consists of Ethernet cables and one or more network switches. The major role of the private interconnect
is to implement Oracle’s “cache fusion” technology. This is not a simple heartbeat mechanism, as in other types of clusters. Instead,
Oracle creates a “virtual” image of all of the memory across the cluster by sharing informaon across the interconnects. Mulple
interconnects per server are desired for high availability, as well as for increased performance.
For performance reasons, all private interconnect components should be capable of supporng Gigabit Ethernet (Gig-E) speeds. At
least one Gig-E switch is required, but two switches are preferred for a high availability soluon. A switch is required even for a two
node RAC system. It is not recommended to use a cross-over cable between two servers in lieu of a switch. This is because a failover
event could cause NIC cards connected to a cross-over cable to “freeze”. This problem is avoided when at least one switch is placed
between servers.
Dell oers a variety of PowerConnect network switches that can be ulized for the private interconnect network for Oracle RAC serv-
ers. Gig-E capable switches include the PowerConnect 2000, 5000, and 6000 series. They oer from eight to 24 usable ports.
A minimal conguraon of the private interconnect network consists of the following components:
1. One gig-e NIC per server
2. One gig-e switch
3. Cat5e or cat 6 cables from NICs to switch
The preferred conguraon of the private network includes the following components:
1. Two gig-e NICs per server
2. Soware NIC teaming interface on each server
3. Cat 5e or cat 6 cables from NICs to switch
4. Two or more cat 5e or cat 6 cables between switches (crossover or patch)
The preferred conguraon oers high availability and increased performance. To complete the high availability conguraon, it is
necessary to congure some version of NIC teaming. A teaming interface substutes a virtual device (the “team”) for the individual
NIC interfaces. The teamed interface will stay available, even if one of the member NICs or Ethernet cables fails.
The Dell PowerEdge 6850 server oers two NIC ports built into the motherboard. These may be used for the public LAN and/or the
private interconnect. Many customers choose to team the on-board ports for the private interconnect. In addion, Broadcom and
Intel add-on NIC cards are available in both PCI-Express and PCI-X versions. Be careful that the slots you choose for add-on NICs are
using the same version of PCI and run at the same bus speed. The inside top cover of the 6850 contains a diagram of the available
slots and conguraons.
To congure Broadcom NIC teaming, rst install the Management Apps Control Suite. Alternavely, you may use a silent install to
create the team. Set up the IP address for the team as if it were an actual NIC.