StorageWorks Secure Path v2.0 for Sun Solaris Installation and Reference Guide First Edition (December, 1999) Part Number AA-RKYDA-TE Compaq Computer Corporation Compaq Confidential – Need to Know Required Writer: Cyndi Vaccaro Project: StorageWorks Secure Path v2.0 for Sun Solaris Comments: Part Number: AA-RKYDA-TE File Name: a-frnt.
Notice The information in this publication is subject to change without notice. COMPAQ COMPUTER CORPORATION SHALL NOT BE LIABLE FOR TECHNICAL OR EDITORIAL ERRORS OR OMISSIONS CONTAINED HEREIN, NOR FOR INCIDENTAL OR CONSEQUENTIAL DAMAGES RESULTING FROM THE FURNISHING, PERFORMANCE, OR USE OF THIS MATERIAL.
Contents About This Guide Text Conventions ................................................................................................. vii Symbols in Text ................................................................................................... vii Symbols on Equipment ........................................................................................ viii Rack Stability........................................................................................................
iv StorageWorks Secure Path v2.0 for Sun Solaris Chapter 4 Installing Secure Path Software Secure Path Pre-Installation Checklist.................................................................. 4-1 The Secure Path Configuration Tool .................................................................... 4-2 Installing Secure Path Software............................................................................ 4-2 Adding and Deleting Units to the RAID System...............................................
Contents v Index List of Figures Figure 1-1. Figure 2-1. Figure 2-2. Figure 2-4. Basic Secure Path Configuration ....................................................... 1-2 Software Components Comprising the Paths to Storage ..................... 2-2 StorageWorks Secure Path V2.0 Driver Model .................................. 2-3 After Path Failover ........................................................................... 2-5 List of Tables Table 3-1 Secure Path (FC Installation) Prerequisites .......
About This Guide This guide is designed to be used as step-by-step instructions for installation and as a reference for operation, troubleshooting, and future upgrades. Text Conventions This document uses the following conventions to distinguish elements of text: user input User input appears in a bold typeface and in lowercase. Menu Options, Command Names, Dialog Box Names These elements appear in initial capital letters.
viii StorageWorks Secure Path v2.0 for Sun Solaris CAUTION: Text set off in this manner indicates that failure to follow directions could result in damage to equipment or loss of information. IMPORTANT: Text set off in this manner presents clarifying information or specific instructions. NOTE: Text set off in this manner presents commentary, sidelights, or interesting points of information. Symbols on Equipment These icons may be located on equipment in areas where hazardous conditions may exist.
About This Guide ix Power Supplies or Systems marked with these symbols indicate the equipment is supplied by multiple sources of power. WARNING: To reduce the risk of injury from electrical shock, remove all power cords to completely disconnect power from the system. Rack Stability WARNING: To reduce the risk of personal injury or damage to the equipment, be sure that: ■ The leveling jacks are extended to the floor. ■ The full weight of the rack rests on the leveling jacks.
x StorageWorks Secure Path v2.0 for Sun Solaris listed on the Compaq website. Access the Compaq website by logging on to the Internet at http://www.compaq.
Chapter 1 Theory of Operation Overview StorageWorks Secure Path is a high availability software product providing continuous data access for Fibre Channel RAID Array 8000 / Enterprise Storage Array 12000 storage systems configured on Sun Sparc platforms running Solaris 2.6 or Solaris 7 (32-bit mode only). Redundant hardware, advanced RAID technology and automated failover capability are used to enhance fault tolerance and availability.
1-2 StorageWorks Secure Path Version 2.0 for Sun Solaris Fibre Channel Host Bus Adapters 0 1 Solaris Server HSG80 Controllers Controller 0 Controller 1 RAID Storage Subsystem SHR-1600 Figure 1-1. Basic Secure Path Configuration Secure Path version 2.0 has the following features. Allows a StorageWorks dual-controller RAID system to be cabled on two independent Fibre Channel Arbitrated Loop paths using two host bus adapters (HBA) in each server.
Theory of Operation 1-3 Multiple-bus mode allows each controller to process I/O independently of the other controller under normal operation. During runtime, storage units may be moved between paths at any time using the Secure Path management utility. The Secure Path software detects the failure of I/O operations on a failed path and automatically re-routes traffic to the other path. Path failover is completed seamlessly, without process disruption or data loss.
Chapter 2 Technical Description Overview Secure Path is server-based software that enhances the StorageWorks RAID storage system by providing automatic recovery from server-to-storage system connection failures. Secure Path supports two I/O paths between a Solaris host and a RAID storage system, improving overall data availability.
2-2 StorageWorks Secure Path Version 2.0 for Sun Solaris Solaris Disk Services Secure Path Devices Solaris Server Host Bus Adapters ldLite Devices sda Devices sd0 sd1 sd2 ldLite0 ldLite1 ldLite2 mda0 mda1 mda2 mda3 mda4 fcaw0 fcaw1 Hub 0 Hub 1 mda5 HSG80 Controllers LUN 0 Controller 0 Port 1 Port 2 LUN 1 Controller 1 Port 1 Port 2 LUN 2 RAID Storage Subsystem SHR-1599 Figure 2-1.
Technical Description 2-3 Secure Path Drivers Secure Path consists of three drivers that together create and manage paths to a storage device while providing a single device target to applications. Figure 22 illustrates the driver model structure. sd ldLite Path mda Fibre Channel driver SHR-1607 Figure 2-2. StorageWorks Secure Path V2.0 Driver Model ■ mda The mda driver is a SCSI-disk target driver specific to the Compaq HSG80 fibre attached RAID storage system controller.
2-4 StorageWorks Secure Path Version 2.0 for Sun Solaris bus adapter, RAID controller, FC hub, or any connection hardware causes a path to fail, Secure Path stops sending I/O to the HBA driver, marks the path as failed, and assigns the standby path as the online path. After this reconfiguration, I/O is sent along the new online path. This failure-recovery process is transparent to applications.
Technical Description 2-5 Solaris Disk Services Secure Path Devices Solaris Server ldLite Devices sda Devices sd0 sd1 sd2 ldLite0 ldLite1 ldLite2 mda0 Host Bus Adapters mda1 mda2 mda3 mda4 fcaw0 fcaw1 Hub 0 Hub 1 mda5 HSG80 Controllers LUN 0 Controller 0 Port 1 Port 2 LUN 1 Controller 1 Port 1 Port 2 LUN 2 RAID Storage Subsystem Key On-line Path Failed Path SHR-1602 Figure 2-4.
2-6 StorageWorks Secure Path Version 2.0 for Sun Solaris Secure Path Path State The device path is the physical I/O path through which current I/O is moved between the host system and the LUN on the storage system. A Secure Path device path consists of a single FC host bus adapter, a FC hub, a single port on a RAID controller, and the associated cabling between the HBA and the FC hub and between the FC hub and the controller port.
Chapter 3 Fibre Channel Secure Path Installation To install a new Secure Path fibre channel configuration, or to build Secure Path onto an existing fibre channel configuration, it is recommended that you first refer to the RA8000/ESA12000 High Availability Application Notes for Sun Solaris found on the Compaq web site (see site address below). This will help you become familiar with the high availability connection layout (FC devices and cabling) of the configuration you want to install or add.
3-2 StorageWorks Secure Path Version 2.0 for Sun Solaris Components Required for RA8000/ESA12000 (FC) Secure Path Installation Verify that you have received the Secure Path software kit and the FC hardware ordered for your installation. If you are missing any component, please contact your account representative or call the COMPAQ Customer Services Hotline at (800) 354-9000. The basic requirements for Secure Path operation are listed in Table 3-1.
Secure Path (Fibre Channel) Installation 3-3 Installing and Configuring the RAID System for Secure Path This section provides the steps for installing and configuring your RAID system(s) and Sun server(s) for Secure Path operation. IMPORTANT: If this is an installation of Secure Path on an existing RAID storage system, all I/O to the RAID system must be stopped and steps 1 and 2 below, skipped. 1. Unpack your RAID system and install the PCMCIA cards in the controllers. NOTE: Secure Path V2.
3-4 StorageWorks Secure Path Version 2.0 for Sun Solaris Controller: 1. HSG80 ZG90305234 Software V85F-0, Hardware E05 NODE_ID = 5000-1FE1-0000- 8920 2. 3. ALLOCATION_CLASS = 0 4. SCSI_VERSION 5. = SCSI-2 Configured for dual-redundancy with ZG90811309 In dual-redundant configuration Device Port SCSI address 6 6. 7. 8. Time: NOT SET 9. Command Console LUN is disabled 10. Host PORT_1: 11. Reported PORT_ID = 5000-1FE1-0000- 8921 12. PORT_1_TOPOLOGY = LOOP_HARD (standby) 13.
Secure Path (Fibre Channel) Installation 3-5 a. If the controllers are in Transparent Failover Mode (see line 6 of example controller output) then they must be reconfigured for multiple-bus failover. Configure the RAID system controllers for multiple-bus failover mode, using the commands below. HSG80> set nofailover HSG80 > set multibus_failover copy = this_controller The controllers will restart in multiple-bus mode.
3-6 StorageWorks Secure Path Version 2.0 for Sun Solaris As shown in this example, the state of the path is on-line to this_controller and no preferred path has been assigned.
Secure Path (Fibre Channel) Installation 3-7 6. Power on the server. 7. Boot the system using the reconfiguration switch as follows: For Solaris 2.6: ok> boot –r NOTE: Secure Path v2.0 for Sun Solaris is only supported in 32-bit kernel mode. For Solaris 2.7: ok> boot kernel/unix -r NOTE: Secure Path installation requires that at least one disk device with two paths is configured on the RA8000/ESA12000 system. 8. Install or reinstall the RA8000/ESA12000 Solution Software V8.
Chapter 4 Installing Secure Path Software Secure Path Pre-Installation Checklist This section provides the procedures to install and configure Secure Path software. To proceed, the following requirements must be met: ■ Sun server has StorageWorks Solution Software v8.5 for Sun Solaris installed ■ RAID storage system(s) have StorageWorks ACS V8.
4-2 StorageWorks Secure Path Version 2.0 for Sun Solaris The Secure Path Configuration Tool During the installation of the Secure Path software, the installation utility, spconfig is called to configure the Secure Path software for the target host system. The spconfig utility is designed as a first-time, non-reentrant configuration utility for the files mda.conf, ldLite.conf and sd.conf, all located in /kernel/drv. It requires at least one LUN with two visible paths on the server.
Installing Secure Path Software 4-3 b. Check that the volume manager has automatically mounted the CDROM, by entering: # mount NOTE: The system command may take a few seconds to mount the CD-ROM. If the mount command does not indicate that the CD-ROM has been mounted, wait a short interval and then repeat the command. The volcheck command may be used to force vold to check for mounted media. c. Change to the Solaris directory. Enter: # cd /cdrom/sp_v20_sun/solaris d. Continue with step 3.
4-4 StorageWorks Secure Path Version 2.0 for Sun Solaris Example: # /opt/ CPQswsp/bin/spmt display Device: c2t0d0 Status: Operational Storage System: 5000-1fe1-0000-8920 LUN: 6000-1fe1-0000-8920-0009-9030-5234-005a ========================================================== Controller Unit State HBA Path ========================================================== ZG90811309 D0 standby fcaw0 /sbus@3,0/fcaw@0,0 ZG90305234 D0 online fcaw1 /sbus@b,0/fcaw@0,0 The initial installation for Secure Path v2.
Installing Secure Path Software 4-5 Example: LUN ID: 6000-1FE1-0000-8920-0009-9030-5234-006E 4. On the server, in the /kernel/drv directory, edit the following three files as described: a. mda.conf – add two new path entries to the host Target. (Chapter 6 explains the path entries). Example: name="mda" parent= "/sbus@3,0/fcaw@0,0" target=64 lun=18; name="mda" parent= "/sbus@b,0/fcaw@0,0" target=64 lun=18; b. ldLite.conf – add the new LUN ID, recorded in Step 3.
4-6 StorageWorks Secure Path Version 2.0 for Sun Solaris Deleting a Unit 1. On the RAID system, using the CLI or the SWCC display, identify the UNIT to be removed using the following command: HSG80> show units full The LUN ID assigned to that UNIT is displayed in the hex format: nnnnnnnn-nnnn-nnnn-nnnn-nnnn-nnnn-nnnn. Record this value. Example: LUN ID: 6000-1FE1-0000-8920-0009-9030-5234-006E 2. Delete the UNIT using the CLI or SWCC interface. Example: HSG80> delete D18 3.
Chapter 5 Managing StorageWorks Secure Path Managing a Secure Path Environment Secure Path provides two utilities to manage a Secure Path environment. These two utilities are spmt and spinit. The spmt manages paths, displays status and permits CLI access to the controller. The spinit manages the spdeamon that detects path events and sends email notification to a specified mail address. Compaq Confidential – Need to Know Required Writer: Cyndi Vaccaro Project: StorageWorks Secure Path Version 2.
5-2 StorageWorks Secure Path Version 2.0 for Sun Solaris Secure Path Management Tool (spmt) Table 5-1 lists the command options for spmt. Each option is described on the following pages. Table 5-1 spmt Command Options Commands Action(s) display Displays status and information about Secure Path devices. cli Invokes a command line interpreter (CLI) session to the RAID controller. toggle Switches the I/O to the standby path. restart Sends a CLI RESTART command to a specified controller.
Managing StorageWorks Secure Path 5-3 Example: # spmt display –t 9 Device: c3t9d0 Status: Operational Storage System: 5000-1fe1-0001-ed20 LUN: 6000-1fe1-0001-ed20-0009-9281-0158-0005 ========================================================== Controller Unit State HBA Path ========================================================== ZG92810158 D110 online fcaw0 /sbus@49,0/fcaw@1,0 ZG92810434 D110 standby fcaw1 /sbus@50,0/fcaw@1,0 Each field in the output is described in Table 5-2 Table 5-2 Fields Displaye
5-4 StorageWorks Secure Path Version 2.0 for Sun Solaris spmt cli The spmt cli command invokes a CLI session with a RAID controller. spmt opens a session with the RAID controller on the active path of the specified Secure Path device.
Managing StorageWorks Secure Path 5-5 Example: # spmt toggle – t 2 spmt restart/spmt shutdown The spmt restart and spmt shutdown commands cause I/O to be redirected to the other controller. The spmt restart command will function if multiple hosts are actively accessing LUNs. Therefore, if Secure Path is active on those hosts, I/O will be properly transferred to alternate paths.
5-6 StorageWorks Secure Path Version 2.0 for Sun Solaris (for example, fcaw0). You can obtain this value from the HBA field in the table generated by spmt display. Example: # spmt remove -a fcaw1 spmt reconfig The spmt reconfig command restores the host bus adapter path that was removed from the Secure Path configuration by the spmt remove command. The spmt reconfig does not restore path usage to PREFERRED_PATH. You must use the spmt restore command to re-establish PREFERRED_PATH usage.
Chapter 6 Troubleshooting This chapter lists the configuration files, file entries, and specific formats for entries, required for proper Secure Path operation. Configuration Files Table 6-1 lists the files modified as part of the Secure Path V2.0 installation. Table 6-1 Modified Configuration Files Files Description /etc/driver_classes Registers the ldLite driver /etc/devlink.tab Defines devlinks entry for the ldLite /kernel/drv/sd.
6-2 StorageWorks Secure Path Version 2.0 for Sun Solaris Table 6-2 lists the files added as part of the Secure Path V2.0 installation: Table 6-2 Files Added by Secure Path V2.0 Files Description /kernel/drv/mda.conf Configuration file for the mda driver /kernel/drv/ldlite.conf Configuration file for ldLite driver /etc/driver_classes In order for the ldLite driver to be properly associated with a driver class the following entry has been added to the driver_classes file: ldLite scsi /etc/devlink.
Troubleshooting 6-3 /kernel/drv/ldLite.conf Secure Path device files are configured by the ldLite driver utilizing the ldLite.conf file. The entries designate the specific units identified by the World Wide LUN Id as assigned by the RAID system. For every LUN assignment in mda.conf there is matching targn-devName (/dev/rdsk/cXtYdZ) in ldLite.conf. Additionally the first entry assigns a driver (ldLite) with a pseudo hardware path for a SCSI class.
Appendix A Glossary StorageWorks Secure Path Terminology Controller The hardware device that facilitates communication between a host and one or more LUNs organized as an array. Secure Path supports the HSG80 array controller. Each controller in a HSG80 RAID system is identified by a unique World Wide ID. HBA The I/O device (Host Bus Adapter) which serves as the interface connecting a host system to the SAN (Storage Area Network).
A-2 StorageWorks Secure Path Version 2.0 for Sun Solaris Status Target ■ standby - a path that is neither online nor failed. It is available to receive I/O if an alternate path fails. ■ quiesced - the path has been disabled by the user. Attributes that describe the current operational condition of a device. A device may exist in the following state(s): ■ operational - the Secure Path device can be accessed on at least one path. ■ dead - all paths used by this Secure Path device have failed.
Appendix B Removing StorageWorks Secure Path Software This appendix describes how to remove StorageWorks Secure Path software from your server. Removing the Secure Path software will restore the server to a single path, RAID storage environment. Under a single path configuration, the controllers must be set in a (Transparent) Failover mode. The steps to accomplish the removal of the software and the transition of the HSG80 controllers to (Transparent) Failover mode are described below.
B-2 StorageWorks Secure Path Version 2.0 for Sun Solaris 2. When the Secure Path package has been removed, visit the area /opt/steam/bin (the default area), or the area selected during the installation of the HSG80 package, and invoke the following: # ./config.sh During the installation of the Secure Path software, target entries are removed from the /kernel/drv/sd.conf file and moved to the mda.conf and ldLite.conf files. The following steps regenerate the sd.
Removing StorageWorks Secure Path Software B-3 Then, delete all connections, using: HSG80> delete connection_name for each connection. NOTE: The connections will be generated later. 3. If there are units (Dn) on the storage system, they must be deleted. This is due to the inconsistencies incorporated in the volumes’ WWID in different failover modes. Delete the units using the following commands: HSG80> show units HSG80> delete Dn Repeat this step for each Dn on the storage system.
B-4 StorageWorks Secure Path Version 2.0 for Sun Solaris 7. Restart both controllers so that connections may be reacquired. HSG80> restart other_controller HSG80> restart this_controller NOTE: An alternative method to re-establish the connections is to reboot the server. At this point, the server and RAID storage system are available for use with the single path, fibre channel applications. Compaq Confidential – Need to Know Required Writer: Cyndi Vaccaro Project: StorageWorks Secure Path Version 2.
Appendix C Valid ALPA Settings About ALPA Settings Table C-1 lists the Arbitrated Loop Physical Address settings and corresponding SCSI target numbers for hard addressing the fibre channel arbitrated loop using the CPQfca-pci or CPQfcaw drivers. Use this table when setting the PORT_1_AL_PA and PORT_2_AL_PA addresses on the HSG80 controller. The default setting for port 1 is AL_PA=71 and port 2 is AL_PA=72.
C-2 StorageWorks Secure Path Version 2.
Valid ALPA Settings C-3 Table C-1 ALPA Settings continued 33 32 31 2E 2D 2C 2B 2A 29 27 26 25 23 1F 1E 1D 1B 18 17 10 0F 08 04 02 01 Host Server ALPAs Controller Port ALPAs (Lowest to Highest Priority) (Lowest to Highest Priority) 65 66 67 68 69 6A 6B 6C 6D 6E 6F 70 71 72 73 74 75 76 77 78 79 7A 7B 7C 7D 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 Reserved for Host Server FL_PORT: 00 7E 126 AD AC AB AA A9 A7 A6 A5 A3 9F 9E 9D 9B 98 97 90 8F
