Sun StorageTek™ 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide For HBA Model SG-XPCIE20FC-NEM-Z Sun Microsystems, Inc. www.sun.com Part No. 819-7929-11 May 2007, Revision A Submit comments about this document at: http://www.sun.
Copyright 2007 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved. Sun Microsystems, Inc. has intellectual property rights relating to technology that is described in this document. In particular, and without limitation, these intellectual property rights may include one or more of the U.S. patents listed at http://www.sun.com/patents and one or more additional patents or pending patent applications in the U.S. and in other countries.
Contents Preface 1. vii Network Express Module Overview NEM Features and Specifications ID Chip Feature 1 3 Operating System Requirements System Interoperability 4 4 Host Platform Support 5 Storage System Support 5 Fibre Channel Switch Support 2.
Using the ILOM Web Interface Using the ILOM CLI ▼ 3. 16 To Verify NEM Status Replacing a NEM 16 16 18 ▼ To Install the ID Chip Patch ▼ To Remove a NEM ▼ To Replace the ID Chip 18 18 HBA Software Installation 19 21 Driver Software for the Solaris OS Solaris Diagnostic Support 21 Driver Software for Linux OSs 22 Red Hat Enterprise Linux 21 22 Novell SUSE Linux Enterprise Server ▼ ▼ To Update the Driver ▼ To Install SLES9-SP3 to FC Disk 22 To Build the Linux 2.
Declaration of Conformity 33 Safety Agency Compliance Statement Regulatory Compliance Statements Index 35 47 51 Contents v
vi Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • May 2007
Preface This guide describes how to install and remove the Sun StorageTek™ 4 Gb Fibre Channel (FC) Network Express Module (NEM) Host Bus Adapter (HBA), 20-port pass-through RoHS 5 compliant module. This document is written for technicians, system administrators, application service providers (ASPs), and users who have advanced experience troubleshooting and replacing hardware.
Using UNIX Commands This document might not contain information about basic UNIX® commands and procedures such as shutting down the system, booting the system, and configuring devices. Refer to the following for this information: ■ Software documentation that you received with your system ■ Solaris™ Operating System documentation, which is at: http://docs.sun.
Typographic Conventions Typeface* Meaning Examples AaBbCc123 The names of commands, files, and directories; on-screen computer output Edit your.login file. Use ls -a to list all files. % You have mail. AaBbCc123 What you type, when contrasted with on-screen computer output % su Password: AaBbCc123 Book titles, new words or terms, words to be emphasized. Replace command-line variables with real names or values. Read Chapter 6 in the User’s Guide. These are called class options.
Documentation, Support, and Training Sun Function URL Documentation http://www.sun.com/documentation/ Support http://www.sun.com/support/ Training http://www.sun.com/training/ Third-Party Web Sites Sun is not responsible for the availability of third-party web sites mentioned in this document. Sun does not endorse and is not responsible or liable for any content, advertising, products, or other materials that are available on or through such sites or resources.
Service Contact Information If you need help installing or using this product, call 1-800-USA-4SUN, or go to: http://www.sun.
xii Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • May 2007
CHAPTER 1 Network Express Module Overview This chapter provides a basic overview of the Sun StorageTek™ 4 Gb Fibre Channel (FC) Network Express Module (NEM) Host Bus Adapter (HBA). This chapter also describes the various operating systems, host platforms, storage, and infrastructure configurations that support the NEM.
Twenty SFP fiber-optic transceivers are included with each NEM.
TABLE 1-1 NEM Features and Specifications (Continued) Feature Description LED indicators A blue (Ready to Remove), yellow (Service Action Required) and green (Power, Attention, and Connected) LED on the front panel. Two LEDs per channel (green and yellow) on the front panel used to indicate port status. Buttons Attention button to support hot-swap functionality. Locator button to assist in locating the module. (See FIGURE 2-5 for button locations.
See “Replacing a NEM” on page 18 for more information. Operating System Requirements The NEM requires the operating system (OS) levels listed in TABLE 1-2.
Host Platform Support The NEM is supported by the platforms and operating systems (OSs) listed in TABLE 1-3. TABLE 1-3 Platform and Operating System Support Platform Supported OSs Sun Blade™ 8000 Modular System Sun Solaris, Linux, and Windows Sun Blade 8000 P Modular System Sun Solaris, Linux, and Windows You can install the NEM in an available NEM slot of the Sun Blade 8000 Chassis or Sun Blade 8000 P chassis.
Fibre Channel Switch Support The NEM is supported with the following FC switches: 6 ■ 2 Gb QLogic SANbox 5200 switch ■ 4 Gb QLogic SANbox 5600 and 5602 Stackable FC switches ■ 2 Gb Brocade SilkWorm 3200 and 3800 switches ■ 2 Gb Brocade SilkWorm 3250 and 3850 switches ■ 2 Gb Brocade SilkWorm 3900 switch ■ 2 Gb Brocade SilkWorm 12000 and 24000 directors ■ 4 Gb Brocade SilkWorm 4100 switch ■ 4 Gb Brocade SilkWorm 4900 switch ■ 4 Gb Brocade SilkWorm 48000 and 200E ■ 2 Gb McDATA Sphereon 430
CHAPTER 2 Hardware Installation and Removal This chapter describes the tasks required to install and remove the NEM when the Sun Blade 8000 Modular System is in a powered-on state. Note – If you are powering on the Sun Blade 8000 Modular System or Sun Blade 8000 P Modular System for the first time, follow the installation instructions in the Sun Blade 8000 Series Installation Guide.
Observing ESD and Handling Precautions Caution – Damage to the NEM can occur as the result of careless handling or electrostatic discharge (ESD). Always handle the NEM with care to avoid damage to electrostatic sensitive components. To minimize the possibility of ESD-related damage, Sun strongly recommends using both a workstation antistatic mat and an ESD wrist strap. You can get an ESD wrist strap from any reputable electronics store or from Sun as part number #250-1007.
▼ To Install the NEM 1. Attach an antistatic strap (refer to “Observing ESD and Handling Precautions” on page 8). 2. Refer to your system installation or service manual to determine an appropriate slot in which to install the NEM. 3. Unpack the NEM and remove it from the antistatic bag. 4. Locate a vacant NEM slot in the back of the chassis. Ensure the label on top of the NEM is facing up. 5. Align the NEM with the vacant slot.
6. Align the NEM with the chassis guidance system and slide the NEM into its slot (see FIGURE 2-2). Ensure that the NEM engages with the system chassis guidance system. Failure to align the NEM correctly can result in damage with the internal connection to the chassis midplane. FIGURE 2-2 Inserting the NEM Into the Chassis 7. Push the ejector levers toward each other and close the levers to secure the NEM in its slot.
9. Verify that the NEM is working properly. See “To Verify NEM Status” on page 16. ▼ To Connect the Optical Cables Note – The NEM does not allow normal data transmission on an optical link unless it is connected to another similar or compatible Fibre Channel (FC) product (that is, multimode to multimode). Use multimode fiber-optic cable, intended for short-wave lasers, that adheres to the specifications in TABLE 2-1.
FIGURE 2-3 Connecting the Optical Cables 2. Connect the other end of each cable to a FC device. After the optical cables are connected to the NEM, proceed to “Configuring the NEM For Hot-Plug Operation” on page 14. 3. Observe the light-emitting diodes (LEDs) status for the power-on self test (POST). Each port has a corresponding set of LEDs that provide a visual indication of the operating state. See FIGURE 2-4 to determine the location of the port LEDs.
Port 0.0 Green LED Port 0.0 Yellow LED Port 0.1 Green LED FIGURE 2-4 Port 0.1 Yellow LED Port Level LEDs TABLE 2-2 summarizes port LED indicator combinations.
Configuring the NEM For Hot-Plug Operation To insert a NEM into the chassis while the system is running, you need to: 1. Physically install the module. 2. Prepare the NEM for hot-insertion by using the CMM integrated lights-out management (ILOM) web interface or command-line-interface (CLI) and verify the NEM has returned the expected feedback. See “To Verify NEM Status” on page 16. 3. Verify in one of the ILOM interfaces that the module’s Ready to Remove status is Not Ready.
4. Verify that the selected NEM has returned the expected feedback. See “To Verify NEM Status” on page 16. Using the ILOM Command-Line Interface 1. Log in to the ILOM CLI of the active Chassis Monitoring Module. 2. For a list of components in your system, type: show /CH 3. If you installed a new NEM, go to Step 4.
You can use the ILOM web interface or ILOM CLI to verify Using the ILOM Web Interface 1. Log in to the ILOM web interface using the IP address of the active Chassis Monitoring Module. The first page of the ILOM web interface is displayed. 2. In the left navigation pane, select CMM (Chassis Monitoring Module). The ILOM Version Information page is displayed. 3. Select the System Information tab, and then the Components tab. The Component Management page is displayed. 4.
■ Green OK LED goes to Standby. 2. Activate the NEM by pressing the Attention button, and the green OK LED goes to Slow blink. ■ When all links to active blades have been made, the green OK LED goes to Solid On. ■ Ready to Remove status shows Not Ready in the ILOM interfaces.
The Locator button, when pressed momentarily, flashes a white light to assist in locating the module. You can also activate the Locator LED remotely by executing a command on the CMM. Replacing a NEM If a NEM fails or if you choose to change the I/O configuration, you will need to replace it. You can remove and replace a NEM from a powered-on system using a hot-plug operation, as well as from a powered-off system.
3. When the blue Ready-to-Remove LED is lit on the NEM, physically remove the NEM. a. Remove all cables from the NEM. b. Press the latch on both ejector levers inward at the same time. c. Swing out the ejector levers to their fully open position. d. Slide the NEM out of its slot. Support the weight of the NEM with one hand at the bottom of the NEM. ▼ To Replace the ID Chip 1. After you have removed the failed NEM from the chassis, locate the ID chip at the back of the board (see FIGURE 2-6).
4. Install the ID chip onto the new board (see FIGURE 2-7). a. Position the notched side of the ID chip to the left. b. Place the ID chip directly over the connector. c. Press down easily to seat the ID chip to the connector. FIGURE 2-7 Installing the ID Chip 5. Install the replacement NEM into the chassis and reconnect the cables.
CHAPTER 3 HBA Software Installation After you have completed the hardware installation, follow the instructions listed in this chapter for your operating system to install the HBA driver and any other utilities required for your installation.
■ Self-test ■ Loopback tests ■ External ■ Internal, single-bit ■ Internal, 10-bit ■ Mailbox Driver Software for Linux OSs The Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter is supported by Red Hat Enterprise Linux (RHEL) 4 U3 and U4 and Novell SUSE Linux Enterprise Server 9 Service Pack 3 (SLES9-SP3). Red Hat Enterprise Linux The HBA driver distributed with Red Hat Enterprise Linux (RHEL) 4 U3 and U4 supports the NEM. No additional driver updates are required.
Note – If you are running on a 2.6.5-7.244 kernel, you must install the Emulex 8.0.16.27 driver manually instead of updating using YaST. The driver RPM is contained on the resource CD. ▼ To Install SLES9-SP3 to FC Disk Before starting this procedure, you will need to create a driver update disk using the ISO image for driver vesion 8.0.16.27 provided on the Sun Blade 8000 Series Modular Systems resource CD. You can also download the Emulex driver update disk from the Emulex or Novell support web site.
Driver Software for Windows 2003 OS The HBA driver for Windows 2003 OS is available for download at the Emulex support site for Sun Microsystems. http://www.emulex.com/sun/support/nem-e11000.jsp ▼ To Install Windows OS Driver and Application Kits Follow these steps to download the driver and AutoPilot installer: 1. Go to the Emulex support site for Sun Microsystems at: http://www.emulex.com/sun/support/nem-e11000.jsp 2. Locate the driver section for Windows. 3.
■ Manage out-of-band HBAs ■ Manage local and in-band remote HBAs See the Linux or Windows OS Emulex user manual for more information about using the HBAnywhere and lputil utilities.
26 Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • May 2007
CHAPTER 4 Release Notes This chapter contains the latest supplementary information for the preceding chapters in this guide. It contains the following topics: ■ Using the NEM With Sun StorEdge 3510 and 3511 Arrays ■ Solaris OS-Specific Issues ■ SUSE Linux Enterprise-Specific Issues ■ Windows Server 2003 OS-Specific Issues For additional information related to the Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter, see the Sun Blade 8000 Module System documentation set.
Solaris OS-Specific Issues The following known issues are related to installing, configuring, or operating the NEM with the Solaris 10 OS. Out of Option ROM Memory Error in System BIOS Problem: A fully populated Sun Blade 8000 chassis with at least one NEM installed, could cause the Out of Option ROM Memory Space error to occur during BIOS POST. Workaround: Disable some of the slots in the Basic Input/Output System (BIOS) using the BIOS Setup utility.
Chapter 4 Release Notes 29
30 Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • May 2007
APPENDIX A Declaration of Conformity, Regulatory Compliance, and Safety Statements This appendix contains the following information that applies to the Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter: ■ “Declaration of Conformity” on page 33 ■ “Safety Agency Compliance Statement” on page 35 ■ “Regulatory Compliance Statements” on page 47 31
32 Sun StorageTek 4 Gb FC NEM Host Bus Adapter User’s Guide • May 2007
<< Declaration of Conformity Compliance Model Number: 375-3385-XX Product Family Name: Sun StorageTek 4 Gb FC NEM HBA EMC USA - FCC Class A This equipment complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions: 1) This equipment may not cause harmful interference. 2) This equipment must accept any interference that may cause undesired operation.
34 Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • May 2007
Safety Agency Compliance Statement Read this section before beginning any procedure. The following text provides safety precautions to follow when installing a Sun Microsystems product. Depending on the type of power switch your device has, one of the following symbols may be used: On – Applies AC power to the system. Off – Removes AC power from the system.
Power Cord Connection Caution – Sun products are designed to work with power systems having a grounded neutral (grounded return for DC-powered products). To reduce the risk of electric shock, do not plug Sun products into any other type of power system. Contact your facilities manager or a qualified electrician if you are not sure what type of power is supplied to your building. Caution – Not all power cords have the same current ratings.
Rack System Warning CD and DVD Devices The following warnings apply to Racks and Rack Mounted systems. The following caution applies to CD, DVD, and other optical devices. Caution – For safety, equipment should always be loaded from the bottom up. That is, install the equipment that will be mounted in the lowest part of the rack first, then the next higher systems, etc. Caution – To prevent the rack from tipping during equipment installation, the anti-tilt bar on the rack must be deployed.
Symboles Vous trouverez ci-dessous la signification des différents symboles utilisés: Attention – Vous risquez d'endommager le matériel ou de vous blesser. Veuillez suivre les instructions. Attention – Surfaces brûlantes. Evitez tout contact. Les surfaces sont brûlantes. Vous risquez de vous blesser si vous les touchez. Positionnement d’un produit Sun Attention – Evitez d'obstruer ou de recouvrir les orifices de votre produit Sun.
Attention – Tous les cordons d'alimentation ne présentent pas les mêmes caractéristiques électriques. Les cordons d'alimentation à usage domestique ne sont pas protégés contre les surtensions et ne sont pas conçus pour être utilisés avec des ordinateurs. N'utilisez jamais de cordon d'alimentation à usage domestique avec les produits Sun.
Attention – Afin d'éviter que le rack ne penche pendant l'installation du matériel, tirez la barre anti-basculement du rack. Attention – Pour éviter des températures de fonctionnement extrêmes dans le rack, assurez-vous que la température maximale ne dépasse pas la fourchette de températures ambiantes du produit déterminée par le fabricant.
Je nach Netzschaltertyp an Ihrem Gerät kann eines der folgenden Symbole verwendet werden: Lautstärke Angegebene Geräuschentwicklung im Einklang mit ISO 9296, A-bewertet, in Betrieb und im Ruhezustand: Ein – Versorgt das System mit Wechselstrom. Messwert und Umgebung Aus– Unterbricht die Wechselstromzufuhr zum Gerät. Wartezustand – Der Ein-/Standby-Netzschalter befindet sich in der Standby-Position. LwAd (1B = 10 dB) bei oder unter 25ºC 8.0 B bei max. Umgebung 8.
Die folgende Warnung gilt nur für Geräte mit StandbyNetzschalter: Achtung – Beim Netzschalter dieses Geräts handelt es sich nur um einen Ein/StandbySchalter. Zum völligen Abtrennen des Systems von der Stromversorgung dient hauptsächlich das Netzkabel. Stellen Sie sicher, dass das Netzkabel an eine frei zugängliche geerdete Steckdose in der Nähe des Systems angeschlossen ist. Schließen Sie das Stromkabel nicht an, wenn die Stromversorgung vom Systemchassis entfernt wurde.
Hinweis zur Laser-Konformität Sun-Produkte, die die Laser-Technologie verwenden, entsprechen den Laser-Anforderungen der Klasse 1. Class 1 Laser Product Luokan 1 Laserlaite Klasse 1 Laser Apparat Laser Klasse 1 Precaución – Existe el riesgo de que se produzcan lesiones personales y daños en el equipo. Siga las instrucciones. Precaución – Superficie caliente. Evite todo contacto. Las superficies están calientes y pueden causar lesiones personales si se tocan. Precaución – Voltaje peligroso.
Nivel de ruido Emisiones acústicas declaradas de acuerdo con la norma ISO 9296 (decibelios A), en funcionamiento y reposo: Medición y condiciones ambientales LwAd (1B = 10 dB) a 25ºC o menos: máxima temp. ambiente: 8.0 B 8.4 B LpAm (posición de observación) a 25ºC o menos: máxima temp. ambiente: 66 dB Precaución – El interruptor de alimentación de este producto funciona solamente como un dispositivo de espera. El cable de alimentación hace las veces de dispositivo de desconexión principal del sistema.
Cubierta de la unidad del sistema Debe extraer la cubierta de la unidad del sistema informático Sun para instalar tarjetas, memoria o dispositivos de almacenamiento internos. Vuelva a colocar la cubierta antes de encender el sistema informático. Aviso de cumplimiento de la normativa para la utilización de láser Los productos Sun que utilizan tecnología láser cumplen los requisitos establecidos para los productos láser de clase 1.
Danmark Advarsel! – Litiumbatteri — Eksplosionsfare ved fejlagtig håndtering. Udskiftning må kun ske med batteri af samme fabrikat og type. Levér det brugte batteri tilbage til leverandøren. Suomi Varoitus – Paristo voi räjähtää, jos se on virheellisesti asennettu. Vaihda paristo ainoastaan laitevalmistajan suosittelemaan tyyppiin. Hävitä käytetty paristo valmistajan ohjeiden mukaisesti.
Regulatory Compliance Statements Your Sun product is marked to indicate its compliance class: • • • Federal Communications Commission (FCC) — USA Industry Canada Equipment Standard for Digital Equipment (ICES-003) — Canada Bureau of Standards Metrology and Inspection (BSMI) — Taiwan Please read the appropriate section that corresponds to the marking on your Sun product before attempting to install the product. FCC Class A Notice This device complies with Part 15 of the FCC Rules.
BSMI Class A Notice The following statement is applicable to products shipped to Taiwan and marked as Class A on the product compliance label.
CCC Class A Notice The following statement is applicable to products shipped to China and marked with “Class A” on the product’s compliance label.
50 Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • May 2007
Index A F Attention button, 17 FC switches, 6 Fibre Channel topology, 2 firmware CMM, 5 service processor, 5 update, 24 B BIOS POST, 28 C cable length, maximum, 2 channel LEDs, 13 chassis monitoring module (CMM) firmware, 5 using ILOM, 14 compliance statements regulatory, 47 safety agency, 35 connecting links to blades status status NEM LED, 17 connectors external FC, 2 NEM port, 9 H HBA drivers known issues, 28 HBAnywhere Remote Management Utility, 24 hot-plug operation configuring, 14 verifying, 15
links connected to blades status, 17 Linux driver, known issues, 28 supported versions, 4 Locator LED and button, 17 LUNs, discover, 24 M memory, 2 N NEM activating, 17 configuring for hot-plug, 14 installing, 9 interface, 2 LED status, 17 part number, 2 restrictions, 27 status, verifying, 16 NEM port numbering, 11 O operating systems supported, 5 operating systems, supported versions, 4 optical cable specifications, 11 Out of Option ROM Memory Space error, 28 out-of-band HBAs, 25 S safety precautions,