Sun StorageTek™ 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide For HBA Model SG-XPCIE20FC-NEM-Z Sun Microsystems, Inc. www.sun.com Part No. 819-7929-12 February 2008, Revision A Submit comments about this document at: http://www.sun.
Copyright 2008 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved. Sun Microsystems, Inc. has intellectual property rights relating to technology that is described in this document. In particular, and without limitation, these intellectual property rights may include one or more of the U.S. patents listed at http://www.sun.com/patents and one or more additional patents or pending patent applications in the U.S. and in other countries.
Contents Preface 1. xi Network Express Module Overview NEM Features and Specifications ID Chip Feature 1 3 Operating System Requirements System Interoperability 4 4 Host Platform Support 5 Storage System Support 5 Fibre Channel Switch Support 2.
Using the ILOM Web Interface Using the ILOM CLI ▼ 3. 17 To Verify NEM Status Replacing a NEM 16 17 19 ▼ To Install the ID Chip Patch ▼ To Remove a NEM ▼ To Replace the ID Chip 19 19 HBA Software Installation 20 23 Driver Software for the Solaris OS Solaris Diagnostic Support 23 Driver Software for Linux OSs 24 Red Hat Enterprise Linux 23 24 Novell SUSE Linux Enterprise Server ▼ ▼ To Update the Driver ▼ To Install SLES9-SP3 to FC Disk 24 To Build the Linux 2.
Declaration of Conformity 33 Safety Agency Compliance Statement Regulatory Compliance Statements Index 35 47 51 Contents v
vi Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • February 2008
Figures FIGURE 2-1 NEM Ejector Levers 9 FIGURE 2-2 Inserting the NEM Into the Chassis FIGURE 2-3 Connecting the Optical Cables FIGURE 2-4 Port Level LEDs 13 FIGURE 2-5 LEDs, Attention and Locator Buttons FIGURE 2-6 Location of ID Chip FIGURE 2-7 Installing the ID Chip 21 10 12 18 20 vii
viii Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • February 2008
Tables TABLE 1-1 NEM Features and Specifications 2 TABLE 1-2 Supported Operating System Versions TABLE 1-3 Platform and Operating System Support TABLE 2-1 Optical Cable Specifications TABLE 2-2 Port LED Indicator Status Definitions TABLE 2-3 NEM LED Status 4 5 11 13 18 ix
x Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • February 2008
Preface This guide describes how to install and remove the Sun StorageTek™ 4 Gb Fibre Channel (FC) Network Express Module (NEM) Host Bus Adapter (HBA), 20-port pass-through RoHS 5 compliant module. This document is written for technicians, system administrators, application service providers (ASPs), and users who have advanced experience troubleshooting and replacing hardware.
Using UNIX Commands This document might not contain information about basic UNIX® commands and procedures such as shutting down the system, booting the system, and configuring devices. Refer to the following for this information: ■ Software documentation that you received with your system ■ Solaris™ Operating System documentation, which is at: http://docs.sun.
Typographic Conventions Typeface* Meaning Examples AaBbCc123 The names of commands, files, and directories; on-screen computer output Edit your.login file. Use ls -a to list all files. % You have mail. AaBbCc123 What you type, when contrasted with on-screen computer output % su Password: AaBbCc123 Book titles, new words or terms, words to be emphasized. Replace command-line variables with real names or values. Read Chapter 6 in the User’s Guide. These are called class options.
Documentation, Support, and Training Sun Function URL Documentation http://www.sun.com/documentation/ Support http://www.sun.com/support/ Training http://www.sun.com/training/ Third-Party Web Sites Sun is not responsible for the availability of third-party web sites mentioned in this document. Sun does not endorse and is not responsible or liable for any content, advertising, products, or other materials that are available on or through such sites or resources.
Service Contact Information If you need help installing or using this product, call 1-800-USA-4SUN, or go to: http://www.sun.
xvi Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • February 2008
CHAPTER 1 Network Express Module Overview This chapter provides a basic overview of the Sun StorageTek™ 4 Gb Fibre Channel (FC) Network Express Module (NEM) Host Bus Adapter (HBA). This chapter also describes the various operating systems, host platforms, storage, and infrastructure configurations that support the NEM.
Twenty SFP fiber-optic transceivers are included with each NEM.
TABLE 1-1 NEM Features and Specifications (Continued) Feature Description LED indicators A blue (Ready to Remove), yellow (Service Action Required) and green (Power, Attention, and Connected) LED on the front panel. Two LEDs per channel (green and yellow) on the front panel used to indicate port status. Buttons Attention button to support hot-swap functionality. Locator button to assist in locating the module. (See FIGURE 2-5 for button locations.
■ Windows: wwwdl.emulex.com/support/windows/storport/130a9/manual.pdf If you replace the failed NEM (regardless of firmware version) and do not swap the ID chip, new WWNs are assigned to each of the ten HBAs and 20 FC ports; thus, requiring you to update SAN components with the new WWN values. For more information about replacing a failed NEM, see “Replacing a NEM” on page 19. Operating System Requirements The NEM requires the operating system (OS) levels listed in TABLE 1-2.
■ “Fibre Channel Switch Support” on page 6 Host Platform Support The NEM is supported by the platforms and operating systems (OSs) listed in TABLE 1-3. TABLE 1-3 Platform and Operating System Support Platform Supported OSs Sun Blade™ 8000 Modular System Sun Solaris, Linux, and Windows Sun Blade 8000 P Modular System Sun Solaris, Linux, and Windows You can install the NEM in an available NEM slot of the Sun Blade 8000 Chassis or Sun Blade 8000 P chassis.
■ Sun StorEdge L5500, L8500 tape libraries Fibre Channel Switch Support The NEM is supported with the following FC switches: 6 ■ 2 Gb QLogic SANbox 5200 switch ■ 4 Gb QLogic SANbox 5600 and 5602 Stackable FC switches ■ 2 Gb Brocade SilkWorm 3200 and 3800 switches ■ 2 Gb Brocade SilkWorm 3250 and 3850 switches ■ 2 Gb Brocade SilkWorm 3900 switch ■ 2 Gb Brocade SilkWorm 12000 and 24000 directors ■ 4 Gb Brocade SilkWorm 4100 switch ■ 4 Gb Brocade SilkWorm 4900 switch ■ 4 Gb Brocade SilkWor
CHAPTER 2 Hardware Installation and Removal This chapter describes the tasks required to install and remove the NEM when the Sun Blade 8000 Modular System is in a powered-on state. Note – If you are powering on the Sun Blade 8000 Modular System or Sun Blade 8000 P Modular System for the first time, follow the installation instructions in the Sun Blade 8000 Series Installation Guide.
Observing ESD and Handling Precautions Caution – Damage to the NEM can occur as the result of careless handling or electrostatic discharge (ESD). Always handle the NEM with care to avoid damage to electrostatic sensitive components. To minimize the possibility of ESD-related damage, Sun strongly recommends using both a workstation antistatic mat and an ESD wrist strap. You can get an ESD wrist strap from any reputable electronics store or from Sun as part number #250-1007.
▼ To Install the NEM 1. Attach an antistatic strap (refer to “Observing ESD and Handling Precautions” on page 8). 2. Refer to your system installation or service manual to determine an appropriate slot in which to install the NEM. 3. Unpack the NEM and remove it from the antistatic bag. 4. Locate a vacant NEM slot in the back of the chassis. Ensure the label on top of the NEM is facing up. 5. Align the NEM with the vacant slot.
FIGURE 2-1 NEM Ejector Levers 6. Align the NEM with the chassis guidance system and slide the NEM into its slot (see FIGURE 2-2). Ensure that the NEM engages with the system chassis guidance system. Failure to align the NEM correctly can result in damage with the internal connection to the chassis midplane.
FIGURE 2-2 Inserting the NEM Into the Chassis 7. Push the ejector levers toward each other and close the levers to secure the NEM in its slot. After you physically install the NEM in its slot, the Chassis Monitoring Module (CMM) will automatically detect the presence of the NEM. The OK LED goes to Standby blink (see TABLE 2-3 for LED status). 8. Press the Attention button to notify the blades (host operating systems) of the presence of the NEM. 9. Verify that the NEM is working properly.
▼ To Connect the Optical Cables Note – The NEM does not allow normal data transmission on an optical link unless it is connected to another similar or compatible Fibre Channel (FC) product (that is, multimode to multimode). Use multimode fiber-optic cable, intended for short-wave lasers, that adheres to the specifications in TABLE 2-1. TABLE 2-1 Optical Cable Specifications Fiber-Optic Cable Maximum Length Minimum Length Connector 62.5/125 µm (multimode) 300 meters at 1.0625 Gbps 150 meters at 2.
FIGURE 2-3 Connecting the Optical Cables 2. Connect the other end of each cable to a FC device. After the optical cables are connected to the NEM, proceed to “Configuring the NEM For Hot-Plug Operation” on page 14. 3. Observe the light-emitting diodes (LEDs) status for the power-on self test (POST). Each port has a corresponding set of LEDs that provide a visual indication of the operating state. See FIGURE 2-4 to determine the location of the port LEDs.
FIGURE 2-4 Port Level LEDs TABLE 2-2 summarizes port LED indicator combinations.
Configuring the NEM For Hot-Plug Operation To insert a NEM into the chassis while the system is running, you need to: 1. Physically install the module. 2. Prepare the NEM for hot-insertion by using the CMM integrated lights-out management (ILOM) web interface or command-line-interface (CLI) and verify the NEM has returned the expected feedback. See “To Verify NEM Status” on page 17. 3. Verify in one of the ILOM interfaces that the module’s Ready to Remove status is Not Ready.
4. Verify that the selected NEM has returned the expected feedback. See “To Verify NEM Status” on page 17. Using the ILOM Command-Line Interface 1. Log in to the ILOM CLI of the active Chassis Monitoring Module. 2. For a list of components in your system, type: show /CH 3. If you installed a new NEM, go to Step 4. When you were preparing a NEM for a hot-remove, if you corrected the problem without removing the NEM or you decided not to remove the NEM, complete the following steps: a.
c. If all blades that you expect to be connected show a Connected link status, go to Step 4. Otherwise, if a blade that you expect to be connected has a link status of Not connected, perform Step a - Step b again until its link status is Connected. 4. To verify that the NEM Ready to Remove status has changed to Not Ready, type: show /CH/component prepare_to_remove_status The system returns: prepare_to_remove_status = Not Ready 5. Verify that the selected NEM has returned the expected feedback.
4. Verify that the selected NEM has returned the expected feedback. See “To Verify NEM Status” on page 17. Using the ILOM CLI 1. Log in to the ILOM CLI of the active Chassis Monitoring Module. 2. For a list of components in your system, type: show /CH 3. To verify that the NEM Ready to Remove status has changed to Not Ready, type: show /CH/component prepare_to_remove_status The system returns: prepare_to_remove_status = Not Ready 4. Verify that the selected NEM has returned the expected feedback.
■ Ready to Remove status shows Not Ready in the ILOM interfaces.
Replacing a NEM If a NEM fails or if you choose to change the I/O configuration, you will need to replace it. You can remove and replace a NEM from a powered-on system using a hot-plug operation, as well as from a powered-off system. When you remove a NEM, you must replace the module within two minutes to prevent adjacent modules from overheating.
b. Press the latch on both ejector levers inward at the same time. c. Swing out the ejector levers to their fully open position. d. Slide the NEM out of its slot. Support the weight of the NEM with one hand at the bottom of the NEM. ▼ To Replace the ID Chip 1. After you have removed the failed NEM from the chassis, locate the ID chip at the back of the board (see FIGURE 2-6). FIGURE 2-6 Location of ID Chip 2. Grasp the edges of the ID chip and pull straight up to remove it from the board. 3.
a. Position the notched side of the ID chip to the left. b. Place the ID chip directly over the connector. c. Press down easily to seat the ID chip to the connector. FIGURE 2-7 Installing the ID Chip 5. Install the replacement NEM into the chassis and reconnect the cables.
CHAPTER 3 HBA Software Installation After you have completed the hardware installation, follow the instructions listed in this chapter for your operating system to install the HBA driver and any other utilities required for your installation.
■ Self-test ■ Loopback tests ■ External ■ Internal, single-bit ■ Internal, 10-bit ■ Mailbox Driver Software for Linux OSs The Sun StorageTek 4 Gb FC NEM 20-Port HBA is supported by Red Hat Enterprise Linux (RHEL) 4 U3 and U4 and Novell SUSE Linux Enterprise Server 9 Service Pack 3 (SLES9-SP3). Red Hat Enterprise Linux The HBA driver distributed with Red Hat Enterprise Linux (RHEL) 4 U3 and U4 supports the NEM. No additional driver updates are required.
2. Run YaST online. You will be notified that the 8.0.16.27 is being installed. Note – If you are running on a 2.6.5-7.244 kernel, you must install the Emulex 8.0.16.27 driver manually instead of updating using YaST. The driver RPM is contained on the resource CD. ▼ To Install SLES9-SP3 to FC Disk Before starting this procedure, you will need to create a driver update disk using the ISO image for driver vesion 8.0.16.27 provided on the Sun Blade 8000 Series Modular Systems resource CD.
3. Follow the instructions in the README file to build and install the 8.0.16.27 driver. Driver Software for Windows 2003 OS The HBA driver for Windows 2003 OS is available for download at the Emulex support site for Sun Microsystems. http://www.emulex.com/sun/support/nem-e11000.jsp ▼ To Install Windows OS Driver and Application Kits Follow these steps to download the driver and AutoPilot installer: 1. Go to the Emulex support site for Sun Microsystems at: http://www.emulex.com/sun/support/nem-e11000.
■ Enable or disable the system BIOS ■ Run diagnostic tests on HBAs ■ Manage out-of-band HBAs ■ Manage local and in-band remote HBAs See the Linux or Windows OS Emulex user manual for more information about using the HBAnywhere and lputil utilities.
28 Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • February 2008
CHAPTER 4 Release Notes This chapter contains the latest supplementary information for the preceding chapters in this guide. It contains the following topics: ■ Using the NEM With Sun StorEdge 3510 and 3511 Arrays ■ Solaris OS-Specific Issues ■ SUSE Linux Enterprise-Specific Issues ■ Windows Server 2003 OS-Specific Issues For additional information related to the Sun StorageTek 4 Gb FC NEM 20-Port HBA, see the Sun Blade 8000 Module System documentation set.
Solaris OS-Specific Issues The following known issues are related to installing, configuring, or operating the NEM with the Solaris 10 OS. Out of Option ROM Memory Error in System BIOS Problem: A fully populated Sun Blade 8000 chassis with at least one NEM installed, could cause the Out of Option ROM Memory Space error to occur during BIOS POST. Workaround: Disable some of the slots in the Basic Input/Output System (BIOS) using the BIOS Setup utility.
APPENDIX A Declaration of Conformity, Regulatory Compliance, and Safety Statements This appendix contains the following information that applies to the Sun StorageTek 4 Gb FC NEM 20-Port HBA: ■ “Declaration of Conformity” on page 33 ■ “Safety Agency Compliance Statement” on page 35 ■ “Regulatory Compliance Statements” on page 47 31
32 Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • February 2008
<< Declaration of Conformity Compliance Model Number: 375-3385-XX Product Family Name: Sun StorageTek 4 Gb FC NEM HBA EMC USA - FCC Class A This equipment complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions: 1) This equipment may not cause harmful interference. 2) This equipment must accept any interference that may cause undesired operation.
34 Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • February 2008
Safety Agency Compliance Statement Read this section before beginning any procedure. The following text provides safety precautions to follow when installing a Sun Microsystems product. Depending on the type of power switch your device has, one of the following symbols may be used: On – Applies AC power to the system. Off – Removes AC power from the system.
Power Cord Connection Caution – Sun products are designed to work with power systems having a grounded neutral (grounded return for DC-powered products). To reduce the risk of electric shock, do not plug Sun products into any other type of power system. Contact your facilities manager or a qualified electrician if you are not sure what type of power is supplied to your building. Caution – Not all power cords have the same current ratings.
Rack System Warning CD and DVD Devices The following warnings apply to Racks and Rack Mounted systems. The following caution applies to CD, DVD, and other optical devices. Caution – For safety, equipment should always be loaded from the bottom up. That is, install the equipment that will be mounted in the lowest part of the rack first, then the next higher systems, etc. Caution – To prevent the rack from tipping during equipment installation, the anti-tilt bar on the rack must be deployed.
Symboles Vous trouverez ci-dessous la signification des différents symboles utilisés: Attention – Vous risquez d'endommager le matériel ou de vous blesser. Veuillez suivre les instructions. Positionnement d’un produit Sun Attention – Evitez d'obstruer ou de recouvrir les orifices de votre produit Sun. N'installez jamais un produit Sun près d'un radiateur ou d'une source de chaleur. Si vous ne respectez pas ces consignes, votre produit Sun risque de surchauffer et son fonctionnement en sera altéré.
Attention – Tous les cordons d'alimentation ne présentent pas les mêmes caractéristiques électriques. Les cordons d'alimentation à usage domestique ne sont pas protégés contre les surtensions et ne sont pas conçus pour être utilisés avec des ordinateurs. N'utilisez jamais de cordon d'alimentation à usage domestique avec les produits Sun.
Attention – Afin d'éviter que le rack ne penche pendant l'installation du matériel, tirez la barre anti-basculement du rack. Attention – Pour éviter des températures de fonctionnement extrêmes dans le rack, assurez-vous que la température maximale ne dépasse pas la fourchette de températures ambiantes du produit déterminée par le fabricant.
Je nach Netzschaltertyp an Ihrem Gerät kann eines der folgenden Symbole verwendet werden: Lautstärke Angegebene Geräuschentwicklung im Einklang mit ISO 9296, A-bewertet, in Betrieb und im Ruhezustand: Ein – Versorgt das System mit Wechselstrom. Messwert und Umgebung Aus– Unterbricht die Wechselstromzufuhr zum Gerät. Wartezustand – Der Ein-/Standby-Netzschalter befindet sich in der Standby-Position. LwAd (1B = 10 dB) bei oder unter 25ºC 8.0 B bei max. Umgebung 8.
Die folgende Warnung gilt nur für Geräte mit StandbyNetzschalter: Achtung – Beim Netzschalter dieses Geräts handelt es sich nur um einen Ein/StandbySchalter. Zum völligen Abtrennen des Systems von der Stromversorgung dient hauptsächlich das Netzkabel. Stellen Sie sicher, dass das Netzkabel an eine frei zugängliche geerdete Steckdose in der Nähe des Systems angeschlossen ist. Schließen Sie das Stromkabel nicht an, wenn die Stromversorgung vom Systemchassis entfernt wurde.
Hinweis zur Laser-Konformität Sun-Produkte, die die Laser-Technologie verwenden, entsprechen den Laser-Anforderungen der Klasse 1. Class 1 Laser Product Luokan 1 Laserlaite Klasse 1 Laser Apparat Laser Klasse 1 Precaución – Existe el riesgo de que se produzcan lesiones personales y daños en el equipo. Siga las instrucciones. Precaución – Superficie caliente. Evite todo contacto. Las superficies están calientes y pueden causar lesiones personales si se tocan. Precaución – Voltaje peligroso.
Nivel de ruido Emisiones acústicas declaradas de acuerdo con la norma ISO 9296 (decibelios A), en funcionamiento y reposo: Precaución – El interruptor de alimentación Medición y condiciones ambientales LwAd (1B = 10 dB) a 25ºC o menos: máxima temp. ambiente: 8.0 B 8.4 B LpAm (posición de observación) a 25ºC o menos: máxima temp. ambiente: 66 dB de este producto funciona solamente como un dispositivo de espera.
Cubierta de la unidad del sistema Debe extraer la cubierta de la unidad del sistema informático Sun para instalar tarjetas, memoria o dispositivos de almacenamiento internos. Vuelva a colocar la cubierta antes de encender el sistema informático. Aviso de cumplimiento de la normativa para la utilización de láser Los productos Sun que utilizan tecnología láser cumplen los requisitos establecidos para los productos láser de clase 1.
Danmark Advarsel! – Litiumbatteri — Eksplosionsfare ved fejlagtig håndtering. Udskiftning må kun ske med batteri af samme fabrikat og type. Levér det brugte batteri tilbage til leverandøren. Suomi Varoitus – Paristo voi räjähtää, jos se on virheellisesti asennettu. Vaihda paristo ainoastaan laitevalmistajan suosittelemaan tyyppiin. Hävitä käytetty paristo valmistajan ohjeiden mukaisesti.
Regulatory Compliance Statements Your Sun product is marked to indicate its compliance class: • Federal Communications Commission (FCC) — USA • Industry Canada Equipment Standard for Digital Equipment (ICES-003) — Canada • Bureau of Standards Metrology and Inspection (BSMI) — Taiwan Please read the appropriate section that corresponds to the marking on your Sun product before attempting to install the product. FCC Class A Notice This device complies with Part 15 of the FCC Rules.
BSMI Class A Notice The following statement is applicable to products shipped to Taiwan and marked as Class A on the product compliance label.
CCC Class A Notice The following statement is applicable to products shipped to China and marked with “Class A” on the product’s compliance label.
50 Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • February 2008
Index A F Attention button, 17, 18 FC switches, 6 Fibre Channel topology, 2 firmware CMM, 5 service processor, 5 update, 26 B BIOS POST, 30 C cable length, maximum, 2 channel LEDs, 13 chassis monitoring module (CMM) firmware, 5 using ILOM, 14 compliance statements regulatory, 47 safety agency, 35 connecting links to blades status status NEM LED, 18 connectors external FC, 2 NEM port, 9 H HBA drivers known issues, 30 HBAnywhere Remote Management Utility, 26 hot-plug operation configuring, 14 verifying
links connected to blades status, 18 Linux driver, known issues, 30 supported versions, 4 Locator LED and button, 18 LUNs, discover, 26 M memory, 2 N NEM activating, 17 configuring for hot-plug, 14 installing, 9 interface, 2 LED status, 18 part number, 2 restrictions, 29 status, verifying, 17 NEM port numbering, 11 O operating systems supported, 5 operating systems, supported versions, 4 optical cable specifications, 11 Out of Option ROM Memory Space error, 30 out-of-band HBAs, 27 S safety precautions,