Symmetrix Fibre Channel with Qlogic Host Bus Adapters in the SCO UnixWare 7 Environment November 2000
Copyright © 2000 EMC Corporation. All rights reserved. No part of this publication may be reproduced or distributed in any form or by any means, or stored in a database or retrieval system, without the prior written consent of EMC Corporation. The information contained in this document is subject to change without notice. EMC Corporation assumes no responsibility for any errors that may appear.
Introduction Introduction This document describes the procedures for installing a Qlogic QLA2200F-EMC host bus adapter (HBA) into an SCO® UnixWare 7 ™ host and configuring the host for connection to EMC® Symmetrix® over Fibre Channel arbitrated loop or fabric. Check the EMC Host Support Matrix for the latest information on approved HBAs and drivers.
Arbitrated Loop Configurations Arbitrated Loop Configurations UnixWare 7 FC-AL Environment This section lists some general Symmetrix Fibre Channel support information specific to arbitrated loop in a UnixWare 7 host environment. Host Operating System Software Patches Boot Device Support Hub Support Addressing 4 For the latest information, refer to the chapter on SCO UnixWare 7 Host on Arbitrated Loop in the Symmetrix Fibre Channel Product Guide (200-999-642), rev D, or contact your EMC representative.
Arbitrated Loop Configurations Setup Checklist The following is a step-by-step checklist of the procedures used to integrate a SCO UnixWare 7 host with the Symmetrix using the Qlogic QLA2200F-EMC HBA in an FC-AL environment. Each step includes references to the specific procedures. Follow these steps in order, to ensure proper HBA setup. This installation should be performed only by personnel having a basic knowledge of SCO UnixWare 7 system administration. Step 1. 2.
Arbitrated Loop Configurations Step 4. Use the scan utility function of the HBA firmware utility to verify that the HBA "sees" the Symmetrix. (Refer to Scanning for the Symmetrix on an HBA BIOS Level on page 10.) 5. Obtain the latest EMC-approved disk image driver for the QLA2200F-EMC HBA; then create a driver installation diskette and install the driver into the host: 6. 7. 8. 6 Done? a. To obtain the latest driver, refer to Obtaining the Latest Driver on page 11. b.
Arbitrated Loop Configurations Verifying and Updating HBA BIOS-Level Configurations Setup Checklist step 3 After installing all QLA2200F-EMC HBAs into the host, follow these steps for each QLA2200F-EMC. Verifying the Correct HBA BIOS Version Setup Checklist step 3a HBA BIOS version 1.59 is required. You can determine the HBA BIOS version at boot time from the QLA2200 banner or from the QLA2200 Fast!Util Options menu.
Arbitrated Loop Configurations Setting the Firmware Variables Setup Checklist step 3b This procedure assumes that you are already in Fast!Util. If you are not, boot the host, and as soon as the QLA2200F banner (see Figure 1 on page 7) appears, press ALT-Q to display the Fast!Util Options menu. 1. From the Fast!Util Options menu, select Configuration Settings. 2. On the Configuration Settings menu, select Restore Default Values. 3. On the Configuration Settings menu, select Advanced Adapter Settings. 4.
Arbitrated Loop Configurations c. Scroll to the bottom of the Qlogic Drivers License Agreement and click Use Qlogic Drivers/Software. d. Click EMC Approved Drivers. e. Click EMC Approved QLA22xx Drivers. f. Click Link to ROM BIOS in the ROM BIOS v1.59 section. g. Save the file as c:\22emc03bios159.zip. 2. The file is a self-extracting ZIP file that must be extracted to a bootable diskette drive, as follows: a. Open any DOS window. b. At the DOS prompt, type cd \ ENTER, to go to the root directory. c.
Arbitrated Loop Configurations Scanning for the Symmetrix on an HBA BIOS Level Setup Checklist step 4 Before running SCO UnixWare 7, it is prudent to verify that Symmetrix devices are seen on an HBA BIOS level. The QLA2200 has a built in utility to verify connection to the Symmetrix port, and also to verify an individual Symmetrix device. To verify that the HBA can "see" the Symmetrix, use the Fibre Disk utility to scan and verify disk media. 1. Under the Fast!UTIL Options menu, select FIBRE DISK UTILITY.
Arbitrated Loop Configurations 7. After media verification has completed: • If the message Media Verification Complete appears, press ESC repeatedly to exit Fast!Util and reboot the host, then continue with Installing the HBA Driver later on this page. • If the media verification fails, verify: > that the Hard Loop IDs are unique between the host bus adapter and the Symmetrix. > that the cables and connectors are not damaged. > that the host has been rebooted since the BIOS settings were changed.
Arbitrated Loop Configurations 5. Click SCO UnixWare 7.1.1 Driver. 6. Copy the EMC-approved UnixWare 7.1.1 driver to the /tmp directory your UnixWare 7 host. and save the driver as qlc2200.Z. Creating the Driver Diskette Setup Checklist step 5b 1. Type cd /tmp ENTER. 2. Type uncompress qlc2200.Z ENTER. 3. The driver is in a disk image format and should be copied onto a diskette to be installed. Insert a blank diskette into the UnixWare 7 host. 4.
Arbitrated Loop Configurations Configuring the HBA Driver Setup Checklist step 6 Configuring the Driver Configuration File Setup Checklist step 6a The proper configuration of the /etc/conf/pack.d/qlc2200/space.c file is crucial for Symmetrix host integration and driver behavior. The driver configuration file contains important information about how the driver should behave. The file is created automatically when the HBA driver is installed. You can find the QLA2200F driver configuration file space.
Arbitrated Loop Configurations Understanding Disk Device File Names Setup Checklist step 7b To better understand setting up a Symmetrix device, review the SCSI disk naming conventions. Raw disk device filenames take two forms: • • /dev/rdsk/cCbBtTdDsS /dev/rdsk/cCbBtTdDpP where: • • • • • • C is the occurrence of the host adapter board. B is the port designation for the specific HBA. (For a single-port HBA, this value is 0.) T is the SCSI target ID.
Arbitrated Loop Configurations Example: Channel controller number Bus number Target number LUN number 2:0,7,0: HBA 0,0,0: DISK 0,0,1: DISK 0,0,2: DISK 0,0,3: DISK 0,0,4: DISK 0,0,5: DISK . . .
Arbitrated Loop Configurations Troubleshooting Setup Checklist step 8 This section describes some potential problems and the suggested solutions. Problem: I am having trouble with target 0 disk 0 of the Symmetrix. SCO calculates the cylinder count for the first disk added to the system improperly. SCO’s calculations for the cylinder counts must be used. When using the disksetup command in a script, use the cylinder count displayed in the fdisk.
Fabric Configurations Fabric Configurations UnixWare 7 Fabric Environment Host Operating System Software Patches Boot Device Support This section lists some general Symmetrix Fibre Channel support information specific to fabric in a UnixWare 7 host environment. For the latest information, refer to the chapter on SCO UnixWare 7 Host on Fabric in the Symmetrix Fibre Channel Product Guide (200-999-642), rev D, or contact your EMC representative.
Fabric Configurations Setup Checklist The following is a step-by-step checklist of the procedures used to integrate an UnixWare 7 host with the Symmetrix using the Qlogic QLA2200F-EMC HBA in an FC-SW environment. Each step includes references to the specific procedures. Follow these steps in order, to ensure proper HBA setup. This installation should be performed only by personnel having a basic knowledge of UnixWare 7 system administration. Step 1. 2.
Fabric Configurations Step Done? 5. Use the scan utility function of the HBA firmware utility to verify that the HBA "sees" the Symmetrix. (Refer to Scanning for the Symmetrix on an HBA BIOS Level on page 27.) 6. Obtain the latest EMC-approved disk image driver for the QLA2200F-EMC n/a HBA; then create a driver installation diskette and install the driver into the host: a. To obtain the latest driver, refer to Obtaining the Latest HBA Driver on page 28. b.
Fabric Configurations Step 11. 12. Done? Modify the Qlogic file space.c with binding information obtained from osmlog, enable persistent binding, flag and verify all other driver variables. Then rebuild the kernel and reboot. a. Refer to Configuring and Enabling Persistent Binding on page 38. b. Refer to Other Driver Variables on page 39. c. Refer to Rebuilding the Kernel on page 39.
Fabric Configurations Verifying Symmetrix Configuration Setup Checklist step 3 Symmetrix configuration is performed by an EMC Customer Engineer (CE) through the Symmetrix service processor.
Fabric Configurations Example Assume a Volume Logix configuration for a fabric zone that contains two QLA2200-EMC HBAs and one Symmetrix port, with 70 LUNs: Bad Configuration Assume a LUN range of 0–70 as follows: HBA Number of Devices LUN Range Devices Seen by Host 1 50 0–49 c1b0t0d (0–31) c1b0t1d (0–17) 2 20 50–70 c2b0t2d (0–5) The host will recognize LUNs 0–31 as target 0, 32–49 as target 1, and 64–70 as target 2.
Fabric Configurations Verifying and Updating HBA BIOS-Level Configurations Setup Checklist step 4 After installing all QLA2200F-EMC HBAs into the host, verify that each HBA has the correct BIOS version, and upgrade the BIOS if necessary. Verifying the Correct HBA BIOS Version Setup Checklist step 4a HBA BIOS version 1.59 is required. You can determine the HBA BIOS version at boot time from the QLA2200 banner or from the QLA2200 Fast!Util Options menu.
Fabric Configurations Setting the HBA BIOS Variables Setup Checklist step 4b This procedure assumes that you are already in Fast!Util. If you are not, boot the host, and as soon as the QLA2200F banner (see Figure 2) appears, press ALT-Q to display the Fast!Util Options menu. 1. From the Fast!Util Options menu, select Configuration Settings. 2. On the Configuration Settings menu, select Restore Default Values. 3. On the Configuration Settings menu, select Advanced Adapter Settings. 4.
Fabric Configurations Upgrading HBA BIOS Setup Checklist step 4c This section contains information specific to creating HBA BIOS installation disks and upgrading the BIOS to a host bus adapter. This procedure is necessary only if you need to upgrade the QLA2200F-EMC BIOS version. (Refer to Verifying the Correct HBA BIOS Version on page 23.) Create an Installation Diskette: To create a QLA2200 BIOS installation diskette, follow these steps: 1.
Fabric Configurations Upgrade the BIOS: After the QLA2200-EMC HBA is installed in an EMC-qualified host, complete the following steps to upgrade the HBA BIOS: 1. Insert the BIOS upgrade installation diskette into the diskette drive. 2. Reboot the host. 3. After the host has rebooted, a DOS prompt appears. Type Ql2xutil /L /F ENTER. The HBA BIOS upgrade might take a few minutes. 4. After the upgrade is complete, remove the diskette and reboot the host.
Fabric Configurations Scanning for the Symmetrix on an HBA BIOS Level Setup Checklist step 5 Before running SCO UnixWare 7, it is prudent to verify that Symmetrix devices are seen on an HBA BIOS level. The QLA2200 has a built in utility to verify connection to the Symmetrix port, and also to verify an individual Symmetrix device. To verify that the HBA can "see" the Symmetrix, use the Fibre Disk utility to scan and verify disk media. 1. Under the Fast!UTIL Options menu, select FIBRE DISK UTILITY.
Fabric Configurations 7. After media verification has completed: • If the message Media Verification Complete appears, press ESC repeatedly to exit Fast!Util and reboot the host, then continue with Installing the HBA Driver on page 11. • If the media verification fails, verify: ✦ that the cables and connectors are not damaged. ✦ that the host has been rebooted since the last HBA BIOS change.
Fabric Configurations 6. Copy the EMC-approved UnixWare 7.1.1 driver to the /tmp directory your UnixWare 7 host as qlc2200.Z. Creating the Driver Diskette Setup Checklist step 6b 1. Type cd /tmp ENTER. 2. Type uncompress qlc2200.Z ENTER. 3. The driver is in a disk image format and should be copied onto a diskette to be installed. Insert a blank diskette into the UnixWare 7 host. 4. Type format /dev/rdsk/f0q18dt ENTER, to format the diskette. 5.
Fabric Configurations Changing System Configuration File Settings Setup Checklist step 7 SCO Unixware 7.1.1 defaults to reserve devices for specific HBAs. This poses a problem when sharing such Symmetrix devices as VCM databases with more than one HBA. To ensure proper host performance, modify the variable sd01_do_reserve in /etc/conf/pack.d/sd01/space.
Fabric Configurations • Never write data to disk 0. P is the fdisk partition number. P can range from 0 through 4. The p0 node corresponds to the whole disk, and the p1 to p4 nodes correspond to partitions displayed by the fdisk command. Either during boot time, in the var/adm/log/osmlog, or if the command /sbin/sdiconfig -l is issued, disks under UnixWare 7 are represented as shown in the following example.
Fabric Configurations The EMC-approved driver supports multiple HBA instances. The operating system assigns each QLA2200 HBA instance a controller number (0 through 7) based on the PCI slot that contains the HBA. The QLA2200 driver supports 8 busses per HBA, 32 targets per HBA and 32 LUNs per target. Understanding Persistent Binding and Configuration Steps Setup Checklist step 8b A requisite knowledge of persistent binding concepts is needed to configure the qla2200 driver in an FC-SW environnent.
Fabric Configurations Understanding SCSI Target Nomenclature Setup Checklist step 8c SCO has a limitation of 32 LUNs per target. In the HBA BIOS under advanced settings there is a Luns per Target setting that determines how many targets are reserved for the HBA. If the Luns per Target setting is changed, the target numbers of all devices on that HBA will change. Luns per Target must be set to 256.
Fabric Configurations Output of Qlogic-related information in osmlog. Controller channel number Bus number Target number LUN number HBA controller channel 2 HBA controller channel 3 (qlc2200,2) QLogic QLA2200 0,0,0: DISK : EMC SYMMETRIX 5265 0,0,1: DISK : EMC SYMMETRIX 5265 . . .
Fabric Configurations Obtaining Information Needed to Configure Persistent Binding To obtain all information necessary to configure persistent binding, the system osmlog must be configured to accept the output of the qla2200 driver. The driver must then be configured to output information to the osmlog. Increasing osmlog Buffer Size Setup Checklist step 9a The osmlog is a file containing all messages displayed at boot time. The osm file size is limited by the buffer space available at boot time.
Fabric Configurations Configuring the Driver to Output Persistent Binding Information Setup Checklist step 9b To obtain the persistant binding information needed from the osmlog, edit driver configuration file /etc/conf/pack.d/qlc2200/space.c as follows: 1. Modify these two lines as shown: char qlc2200_enable_binding = 0; char qlc2200_enable_output_binding = 1; 2. Save the changes to space.c; then rebuild the kernel as follows a. Type cd /etc/conf/bin ENTER. b. Type ./idbuild -B ENTER. c. Type .
Fabric Configurations Beware of Ghost Names Setup Checklist step 10 If a disk device is moved from one controller to another, the disk obtains a new address. The old address is retained as a ghost name, and a mapping is created between the old address and the new address. The original device node names do not change.
Fabric Configurations Configuring and Enabling Persistent Binding Setup Checklist step 11 After a reboot with a larger buffer size for the osmlog and the variable qlc2200_enable_output_binding set to 1, all information needed to configure persistent binding will be in /var/adm/osmlog.
Fabric Configurations The kernel must be rebooted for any changes in the /etc/conf/pack.d/qlc2200/space.c file to take effect. Verify that all other variable in space.c are set in accordance with Other Driver Variables on page 39, then rebuild the kernel and reboot. Other Driver Variables Setup Checklist step 11b Verify that the other variables in /etc/conf/pack.d/qlc2200/space.c are set correctly. After changes are made to the space.c, the kernel must be rebuild and host rebooted.
Fabric Configurations Troubleshooting Setup Checklist step 13 This section describes some potential problems and the suggested solutions. Problem: I am having trouble with target 0 disk 0 of the Symmetrix. SCO calculates the cylinder count for the first disk added to the system improperly. SCO’s calculations for the cylinder counts must be used. When using the disksetup command in a script, use the cylinder count displayed in the fdisk.