Q Simplify SilverStorm 9000 Hardware Installation Guide D000024-000 Rev.
SilverStorm 9000 Hardware Installation Guide Page ii Q D000024-000 Rev.
Q SilverStorm 9000 Hardware Installation Guide Information furnished in this manual is believed to be accurate and reliable. However, QLogic Corporation assumes no responsibility for its use, nor for any infringements of patents or other rights of third parties which may result from its use. QLogic Corporation reserves the right to change product specifications at any time without notice. Applications described in this document for any of these products are for illustrative purposes only.
SilverStorm 9000 Hardware Installation Guide Q © 2007 QLogic Corporation. All rights reserved worldwide. First Published: March, 2007 Printed in U.S.A. QLogic Corporation, 26650 Aliso Viejo Parkway, Aliso Viejo, CA 92656, (800) 662-4471 or (949) 389-6000 Page iv D000024-000 Rev.
Q SilverStorm 9000 Hardware Section 1 Introduction 1.1 1.2 1.3 1.3.1 1.3.2 Intended Audience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . License Agreements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Technical Support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Availability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Contact Information .
SilverStorm 9000 Hardware Installation Guide B.2 Page vi Q Regulatory Compliance Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . B-5 D000024-000 Rev.
Section 1 Introduction This manual describes the hardware installation and initial configuration tasks for the SilverStorm™ 9000 series that includes: ❥ The SilverStorm 9024 24-port InfiniBand switch ❥ The SilverStorm Multi-Protocol Fabric Director (MPFD) series: ❑ SilverStorm 9020 ❑ SilverStorm 9040 ❑ SilverStorm 9080 ❑ SilverStorm 9120 ❑ SilverStorm 9240 This manual is organized as follows: Section 1 describes the intended audience and technical support.
1 – Introduction Technical Support Q 1.3 Technical Support Customers should contact their authorized maintenance provider for technical support of their QLogic switch products. QLogic-direct customers may contact QLogic Technical Support; others will be redirected to their authorized maintenance provider. Visit the QLogic support Web site listed in Contact Information for the latest firmware and software updates. 1.3.
Q 1 – Introduction 1.3.2 Contact Information Support Headquarters QLogic Corporation 12984 Valley View Road Eden Prairie, MN 55344-3657 USA QLogic Web Site www.qlogic.com Technical Support Web Site support.qlogic.com Technical Support Email support@qlogic.com Technical Training Email tech.training@qlogic.com North American Region Email support@qlogic.com Phone +1-952-932-4040 Fax +1 952-974-4910 All other regions of the world QLogic Web Site D000024-000 Rev. A www.qlogic.
1 – Introduction Technical Support 1-4 Q D000024-000 Rev.
Section 2 Installation This section describes how to install and configure for first-time use: ❥ The SilverStorm 9000 switches in a network environment. 2.1 Planning the Installation The 9000 is designed to be installed in an existing 19-inch equipment rack or server rack. NOTE: These chassis are designed for a four-post server cabinet. They should not be mounted in a two-post telco cabinet. Racks should conform to conventional standards.
Q 2 – Installation Planning the Installation 2.1.1 Cable Requirements 2.1.1.1 Cable Distances When planning the location of the switches, consider the distance limitations for signaling, EMI, and connector compatibility. It is recommended that the user does not exceed specified transmission rate and distance limits. NOTE: Building and electrical codes vary depending on the location. Comply with all code specifications when planning the site and installing cable.
Q 2 – Installation ❥ Add the VA from each piece of equipment together to find the total VA requirement. Then add 30% to determine the minimum amperage requirements for the UPS. ❥ Transition time (the time necessary for the UPS to transfer from utility power to full-load battery power). ❥ The longest potential time period the UPS might be required to supply backup power. ❥ Whether or not the UPS unit also provides online protection. 2.
Q 2 – Installation Installation Tasks ❥ The IB cables can be accessed easily. ❥ Water or moisture cannot enter the switch. ❥ The ambient temperature stays between 50° - 113°F (5° - 45° C). ❥ Cabinet doors do not interfere with front-to-back air flow. The cabinet should have its own switchable power distribution. If the switch has two power supplies, it is suggested that a cabinet with dual power distribution units is used. It is recommended that cabinet anti-tip devices are used.
Q 2 – Installation ❥ Kit Mounting Hardware 3/8” Square Hole containing: ❥ 10/32” x 0.375” pan-head Phillips screws ❥ Caged nut adapters for square-holed racks 2.3.1.2 9024-CU, 9020 and 9040 ❥ ❥ Kit Mounting Rails containing: ❥ One pair of bottom support rail assemblies ❥ One pair of hat rail assemblies Kit Mounting Hardware 3/8” Square Hole containing: ❥ 10/32” x 0.375” pan-head Phillips screws ❥ Caged nut adapters for square-holed racks 2.3.1.
Q 2 – Installation Installation Tasks 2.3.3 Install the Rack Mounting Brackets: 9024-FC 1. Install the appropriate mounting bracket to each side of the switch, using three (3) #6-32 flat head screws per bracket 2.3.4 Install the Rack Rails (9024-CU, 9020, 9040, 9080, 9120, 9240) 1. Install the caged nuts into the 2 back holes (chassis leaf module side) and the top and bottom holes (chassis fan side) in the front of the rack.
Q 2 – Installation Install the second rail on the other side of the rack by repeating steps 1 through 3. 2.3.5 Install the Rail Hat Sections (9024, 9020 and 9040) The 9024, 9020 and 9040 have hat rails that are attached to the sides of the switch and slide into the rack rails. 2.3.5.1 Install the Hat Rails: 9024-CU NOTE: Make certain to install the hat rails to the correct side of the switch.
Q 2 – Installation Installation Tasks 2.3.5.3 Install the Hat Rails: 9040 The hat rails on the 9040 can be used on either side of the switch and are attached with 4 screws. The hat rail has 8 holes: 4 correspond to the left side of the chassis and 4 correspond to the right. When installing the hat rails, make certain that the top of the rail is installed the same on both sides (rail is marked with "TOP") as shown in figure 2-4. Figure 2-4.
Q 2 – Installation 2.3.6 Rack-Mount the Switch To install the switch into the rack, perform the following steps: 1. Clear the area of any unnecessary materials. 2. Attach the clip of the ESD wristband (strap) to bare metal on the cabinet. Put the wristband around one wrist with the metal button against the skin. 3. Lift the switch and from the front of the cabinet, slide it onto the rails. The fans and power supplies are on the front of the chassis; leaf/VIC modules are to the rear.
Q 2 – Installation Installation Tasks 5. (9240 Only)Attach the top support rails to the chassis rear side as shown in Figure 2-6: Figure 2-6. Top Rail Assembly Install 1 screw into each hole in the chassis sheet metal Connect the top rail to rack with 1 screw and caged nut into each hole Install the heyclip here a. When complete, the top rail assembly should look like Figure 2-7: Figure 2-7. Completed Top Rail Assembly 2-10 D000024-000 Rev.
Q 2 – Installation 6. Using two screws, install the lower mounting bracket to the rail assembly and chassis as shown in Figure 2-8. Figure 2-8. Install the Lower Mounting Bracket and Heyclip Install the heyclip here Install the lower rear mounting bracket to the rail assembly and chassis 7. Install the heyclip to the rail assembly. 8. If applicable, reinstall the chassis fascia(s). 9. Tighten all screws. 2.3.7 Installing the Switch Fascia To install the switch fascia(s): 1.
Q 2 – Installation Installation Tasks 2. When placing the spine modules and leaf modules/VICs into chassis slots, the following recommendations apply: a. Spine Modules — It is recommended that the spine module(s) be installed into: ❑ 9120 and 9240 Lower Hemisphere: Slot 1 for managed. For redundant management, populate slots 1 and 2 with management-capable spines. Use slot 3 for unmanaged. ❑ 9240 Upper Hemisphere: Slot 5 for managed.
Q 2 – Installation NOTE:Make sure all cables latch securely into the corresponding port connectors. If the IB cable connector is not properly oriented to fit onto the port receptacle (i.e., while attempting to insert the cable in the port), do not twist the connector to achieve the correct orientation. Instead, reach back a few feet on the cable, and twist the bulk cable to allow the connector to rotate to the proper orientation.
Q 2 – Installation Installation Tasks a. The system powers up. b. The fans start. c. The system performs a power-on self test (POST). 5. The switch, power supply, and fan LEDs light up. 2.3.7.4 Bringing Up the System For the First Time 2.3.7.4.1 Start-up Procedures 1. Power up the switch. 2. From its flash image on the spine module CMU, the switch begins its boot process.
Q 2 – Installation ❥ 1 stop bit ❥ 57.6K baud ❥ Use VT100 emulation. ❥ Flow control = XON/XOFF NOTE: If using the RS-232 port, skip to Step 5. Steps 2 through 4 are for those users accessing the switch via Telnet or SSH. 2. If using Telnet or SSH, access the switch with the following command: open 192.168.100.9 3. The system prompts for a user name. In order to change the IP address and default gateway, the user must be logged in as the administrator. At the prompt enter: adm in 4.
Q 2 – Installation Installation Tasks 9012 and 9240 Lower Hemisphere ❥ Chassis: 192.168.100.9 ❥ Spine 1: 192.168.100.11 ❥ Spine 2: 192.168.100.12 9240 Upper Hemisphere ❥ Chassis: 192.168.100.10 ❥ Spine 5: 192.168.100.13 ❥ Spine 6: 192.168.100.14 It is necessary for each managed spine to have a unique IP address for the following reasons: ❥ Unique IP addresses are used when sending syslog messages from a managed spine to a syslog server.
Q 2 – Installation 5. At the [boot]: prompt enter reboot, and press Enter. Upon reboot the managed spine will display information similar to the following: U nified BootM anager For The T3 Platform . Im age D ate: Jan 19 2006,15:03:31 Checking L2 functionality... BCM 1125 L2 caches initialized and invalidated CPU 0 caches initialized Initialized SM BU S Channels SPD Checksum ok.
Q 2 – Installation Installation Tasks U nified BootM anager [1]im age1 [2]im age2 CPU :Broadcom BCM 1125 VxW orks Version:5.4 bootdevice :icspkg0 processor num ber :0 hostnam e :hom e file nam e :/im age1 ineton ethernet(e): ineton backplane (b): hostinet(h) :192.168.100.1 gateway inet(g) : user (u) :ftp ftp password (pw)(blank = use rsh):ftp flags (f) :0x0 targetnam e (tn) : startup script(s) : other (o) :sbe Loading package from flash device /im age1 ...
Q 2 – Installation Starting at0x80010000... sysI REG S BO O T Initializing H yperTransportbus H yperTransportinitialization com pleted Found IntelStrata Flash 128 M Bit(0x8918). M ounted raw file system on device /im age1.(size=6291456 bytes) M ounted raw file system on device /im age2.(size=6291456 bytes) M ounted raw file system on device /dum p0.(size=1048576 bytes) M ounted flash file system on device /rfa1.(size=2097152 bytes) N etwork configuration requested.
Q 2 – Installation Installation Tasks Using this command to enable external ports is detailed in the following section. NOTE:Using any of these commands without a 1 or 0 displays the current values for the port(s). 2.3.7.5.1 Enabling External Ports Enabling 12X ports is achieved by combining three, 4X ports into a group. With the CLI command ismPortSet12x, the user enables each port (one at a time) of a group to create the 12X port.
Q 2 – Installation 5. Following the reboot, bring up Chassis Viewer. The 12X ports will be displayed as shown in Figure 2-10 where the initial port for the group (port 16) has its LED on. The other ports of the group have their LEDs turned off. Figure 2-10. 12X Ports Enabled 6. From the 9024 main page, click on the menu buttons Port Stats/IB Port Stats to displays the IB Port Statistics screen. The 12X port (for combined ports 16 through 18) is displayed as shown in Figure 2-11: Figure 2-11.
Q 2 – Installation Installation Tasks ❥ Any leaf module Attention LED is on, or it has been determined that a leaf is not functioning (even if it is unable to light the LED). The chassis status LED is Red when the system can no longer function properly and indicates one of the following conditions: ❥ The system ambient temperature exceeded 60 degrees C. ❥ No functional fan trays are present. ❥ No functional spines are present. ❥ No functional leaves are present.
Q 2 – Installation ❥ The fan speed has fallen below the minimum allowed RPM for a fan. Each power supply has two LEDs: DC OK and AC OK. Following are the status definitions for each. DC OK ❥ Green indicates that DC power is normal. ❥ Off indicates a DC power failure or no DC power is present. AC OK ❥ ❥ Green indicates that AC power is normal. Off indicates a AC power failure or no AC power is present. 2.3.7.7 Module LEDs (9020, 9040, 9080, 9120 and 9240) 2.3.7.7.
Q 2 – Installation Installation Tasks ❥ ❥ DC voltages on the board are slightly out of tolerance (12V Bulk, 5V, 3.3V, 1.8V, VBIO are all monitored). ❥ The module can no longer function properly. The system will take the appropriate actions to ensure that no damage is done to its components. Blinking Amber (once every four seconds) - LED test state.
Q 2 – Installation ■ That the Ethernet port has successfully established a link. The LED is off when a link is down. 2.3.7.13 Activity (TX/RX) The Activity LED is a Green LED indicating: ■ There is link activity on an Ethernet port. The LED is off when there is no link activity. 2.3.7.13.1 Spine/Management Module Management LEDs Each spine module has three management LEDs: ❥ Capable: ❥ ❥ ❥ ❥ ❥ Green indicates that the spine slot supports management.
Q 2 – Installation Installation Tasks NOTE:For systems with redundant management, the user must add the License Key and start the Fabric Manager for each managed spine in the chassis (each managed spine will have a separate license key). The first spine in each hemisphere to be activated will be the master Fabric Manager, the second will be the slave Fabric Manager. 2.3.7.14 Shut Down Procedures In order to shut down the switch: 1.
Q 2 – Installation 3. Pull the handles out to extend them. Slide the module into the appropriate slot of the chassis until it makes contact with the backplane. As the module seats in the chassis, the handles will begin to close. 4. Push the handles in to fully close. 2.3.8.2 Hot Swapping the Fan Unit 1. Loosen the captive panel screw. 2. Pull the panel screw down to partially disengage the unit. 3. Slowly pull the unit. The unit will disengage from the connector. 4.
2 – Installation Installation Tasks 2-28 Q D000024-000 Rev.
Appendix A SilverStorm 9000 Product Specifications A.1 Physical Specifications All products within the 9024 and 9000 Multi-protocol Fabric Director series are designed to be installed in industry-standard 19-inch four-post server racks. Racks should conform to conventional standards. Use the American National Standards Institute (ANSI)/Electronic Industries Association (EIA) standard ANSI/EIA-310-D-92 and International Electrotechnical Commission (IEC) 297.
Q Cooling and Thermal management: 9024-CU A.3 Cooling and Thermal management: 9024-CU Table A-2. 9024 Product Configurations Model # ❥ 9024 Maximum InfiniBand Ports 24 Fan Trays 2 Power Supplies 2 Cooling: Air cooled with a hot plug fan tray Four fans per tray, 40mm, 12VDC Front-to-back airflow Active thermal performance monitoring switch board via IBML links ❥ Power Supply: Two redundant, hot plug supplies 90/264 VAC operation 65W max power per supply Input: 90–264V AC, 47–63Hz, 1 Phase, 2.
Q Table A-3.
Q Power Specifications A.5 Power Specifications All products within the 9000 MPFD series use a common switching power supply. System power attributes are shown in the table below. Power supplies are hot pluggable and N+1 redundant. Table A-4.
Q hemisphere supplies AC power to half of the power supplies in a hemisphere, the same as with the 9020 through 9120 systems. Figure A-1. SilverStorm 9240 Hemispheres Upper Hemisphere Spine 6 (Managed) Spine 5 (Managed) Spine 4 (Unmanaged) Spine 3 (Unmanaged) Spine 2 (Managed) Spine 1 (Managed) Lower Hemisphere A.6 Configuration Restrictions The 9000 MPFD series systems are highly configurable. Maximum configurations are shown in Table A-3.
Q Configuration Restrictions The number of power supplies required to support continuous operation depends upon the system configuration and whether DC and AC redundancy is desired. While DC redundancy is supported for all valid configurations, AC redundancy is limited. The maximum AC redundancy configurations for the 9120 and 9240 are displayed in Table A-6: Table A-6.
Appendix B Safety and Regulatory Compliance Information This section provides regulatory compliance, safety and electromagnetic compatibility (EMC) information for the 9024 and 9000 MPFD series products. B.1 Safety Information B.1.1 Statement 1: Disconnect Device - This unit may have more than one power cord. To reduce the risk of electrical shock, disconnect all power cords before servicing unit. B.1.1.1 Anweisung 1: Gerät trennen - Diese Komponente verfügt möglicherweise über mehrere Netzkabel.
Safety Information Q B.1.2.1 Anweisung 2: Anheben des Gehäuses - Lassen Sie Sicherheit beim Anheben des Gehäuses walten. Verwenden Sie nur die am Gehäuse befindlichen Griffe beim Anheben, um Schaden am Gehäuse und den Komponenten zu vermeiden. ANMERKUNG: Setzen Sie jeweils dem Gewicht jedes angegebenen Produkts und den Richtlinien entsprechend genügend Leute ein. Verwenden Sie, wenn möglich, einen mechanischen Aufzug. B.1.
Q B.1.5 Statement 5: No User Serviceable parts - Hazardous energy levels may be present inside power supplies and circuit card modules. Do not remove covers. B.1.5.1 Anweisung 5: Wartung nur durch Fachmann möglich - Gefährlich hohe Stromstärken sind in Netzteilen und in den Modulen der Busleiterplatte vorhanden. Entfernen Sie die Abdeckungen nicht. B.1.6 Statement 6: Equipment Installation - Only qualified personnel should be allowed to install, remove or replace chassis or modules. B.1.6.
Safety Information Q B.1.7.1 Anweisung 7: Hinzufügen oder Austauschen von Modulen - Diese Module sind für die Installation in MPFD-Grundeinheiten der SilverStorm 9000 Serie vorgesehen. Installieren Sie stets leere Module, wenn Sie ein aktives Modul entfernen. Diese verhindern, dass Stromgefahr im Innern der Einheit entsteht, enthalten Störstrahlung und sorgen für den Kühlungsausgleich im Gehäuse. B-4 D000024-000 Rev.
Q B.2 Regulatory Compliance Information Country or region Regulatory Compliance Statements US - FCC FCC Part 15 Class A This device complies with part 15 of the FCC rules. Operation is subject to the following two conditions: (1) This device may not cause harmful interference, and (2) this device must accept any interference received, including interference that may cause undesired operation.
Regulatory Compliance Information B-6 Q D000024-000 Rev.
