Switching From the OFED InfiniBand Software Stack to the Voltaire Software Stack

# stopsys

2. Reimage all nodes:

# setnode --resync --all

3. Clear out the configuration and management database (CMDB):

# reset_db

4. Clear out the golden image directory:

# rm -fr /var/lib/systemimager/images/base_image

5. Uninstall the OFED software packages:

# /usr/voltaire/uninstall.sh

NOTE: If the /usr/voltaire/uninstall.sh script generates errors, and the

/usr/sbin/ofed_uninstall.sh script still exists, run the

/usr/sbin/ofed_uninstall.sh script to complete the removal of the OFED software.

6. Mount the Version 3.2 HP XC System Software DVD on /mnt/cdrom:

# mount /dev/cdrom /mnt/cdrom

7. Change to the following directory:

# cd /mnt/cdrom/HPC/extras/RPMS

8. Install the Voltaire ibhost-biz RPM:

# rpm -ivh ibhost-biz-3.5.5_25-1hptc.k2.6.9_42.9hp.XCsmp.x86_64.rpm

9. Reboot the head node so that the head node comes up with the Voltaire stack:

# reboot

10. Verify that the Voltaire software stack is running properly:

# /usr/bin/vstat

1 HCA found:

hca_id=InfiniHost_III_Lx0

pci_location={BUS=0x44,DEV/FUNC=0x00}

vendor_id=0x02C9

vendor_part_id=0x6274

hw_ver=0x20

fw_ver=1.2.0

PSID=HP_0010000001

num_phys_ports=1

port=1

port_state=PORT_ACTIVE

sm_lid=0x0001

port_lid=0x0003

port_lmc=0x00

max_mtu=2048

Successful command completion shows that no errors are reported, an HCA is found, and

at least one PORT_ACTIVE is reported.

11. Reconfigure the system. Follow the instructions in Chapter 3 in the HP XC System Software

Installation Guide to run the cluster_prep, discover, cluster_config, and startstys

commands and any other configuration tasks that are required.

5 Verifying Success

To verify the successful operation of the HP XC system, perform the system verification procedures

described in Chapter 4 of the HP XC System Software Installation Guide, which includes running

the operation verification program (OVP) and other system health tests.