y ar in SANbox-8 Fibre Channel Switch im Installer’s/User’s Manual Pr el Publication No. 59008-03 Rev.
y ar in QLogic Corporation 6321 Bury Drive Eden Prairie, MN 55346 (952) 932-4000 Release Number 03, Revision A (August, 2000) im The following paragraph does not apply to the United Kingdom or any country where such provisions are inconsistent with local law: THIS PUBLICATION is printed “AS IS” WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE.
y Table of Contents ar Preface 1 el im in How to Use This Manual 1 Intended Audience 1 Related Materials 2 Safety Notices 3 Sicherheitshinweise 3 Notes informatives relatives à la sécurité 3 Communications Statements 4 Federal Communications Commission (FCC) Class A Statement 4 Canadian Department of Communications Class A Compliance Statement 4 Avis de conformité aux normes du ministère des Communications du Canada 4 CE Statement 5 VCCI Class A Statement 6 Laser Safety Information 7 Labeling Requir
Installation y ar im 2 in Power Switch 1-19 Test Mode Switch 1-19 Front Panel LEDs 1-20 Heartbeat LED (Yellow) 1-20 Switch Logic Power Good LED (Green) 1-20 Fan Fail LED (RED) 1-20 Over Temperature LED (Red) 1-20 Logged-In LED (Green) 1-21 Traffic LED (Yellow) 1-21 AC Input Power Connector and Fuses 1-22 Switch Management Connector 1-22 Ethernet LEDs 1-22 LINK Status 1-22 Activity 1-22 Pr el Introduction 2-1 Unpack 2-1 Place or Mount the Equipment 2-2 Shelf Mount 2-2 Rack Mount 2-2 Apply the IEC Clas
Introduction 3-1 Power Supply Troubleshooting 3-1 Power-On-Self-Test (POST) 3-2 Overview 3-2 Heartbeat LED Blink Patterns 3-4 Test/Failure Descriptions 3-4 Cable Continuity Tests 3-8 Removal/Replacement Procedures im 4 ar Diagnostics/Troubleshooting in 3 y TL_Ports 2-18 T_Ports 2-18 Tuning Ports for Multi-Frame Sequences 2-19 Zoning 2-20 Rack and Shelf Administration 2-21 Operating the Switch 2-21 5 el Introduction 4-1 Input Fuse 4-2 Removal 4-2 Replacement 4-3 GBIC 4-4 Removal 4-4 Replacement 4
A y ar im in Mesh Zoning 5-17 MKII Compatibility 5-17 Multistage Topology 5-18 T_Port Rules for SANbox IO/T Chassis 5-18 T_Port Rules for SANbox Cross-Connect (CC) Chassis 5-18 Multistage Fabric Size 5-18 Multistage Latency 5-18 Multistage Bandwidth 5-19 Multistage Physical Distance Between Chassis 5-19 Multistage Zoning 5-19 MKII Compatibility 5-19 Multistage Examples 5-20 Cabling 5-23 Fiber Optic T_Port Connections 5-23 Copper T_Port Connections 5-23 T_Port Cable Length 5-23 Device Connections 5-23 Ch
el im in ar SANbox-8 Fibre Channel Switch 1-1 Segmented Loop Topology Example 1-4 SCSI Example 1-6 TCP/IP Example 1-7 Chassis Front 1-17 Typical GBIC 1-18 Test Mode Switch 1-19 Cabinet Mounting Bracket 2-3 IEC Class 1 Laser Information Label 2-3 Extending Buffer Credits by Chaining Ports 2-10 Cabling 2-12 Variety of Public Connections 2-13 Private Segmented Loop Connections 2-14 Private Translated Loop Connections 2-15 Test Mode Switch 3-2 Removing the Input Fuse 4-2 Removing GBICs that have individuall
Notes List of Figures 59008-03 Rev.
y Preface ar How to Use This Manual This manual has five sections, two appendixes and an index: Section 1 is an overview of the Switch. It describes indicator lights and all user controls and connections. • Section 2 explains how to install the Switch. • Section 3 contains troubleshooting procedures and explains the Power On Self Test (POST). • Section 4 contains removal/replacement procedures for all field replaceable units (FRUs).
Related Materials y The following manuals and materials are referenced in the text and/or provide additional information. Switch Management Installer’s/User’s Manual, Publication Number 59010. Available from QLogic Corporation. • Fibre Channel-Arbitrated Loop (FC-AL-2) Rev. 6.8 • Fibre Channel-Private Loop SCSI Direct Attach (FC-PLDA) NCITS TR-19:1998 • Fibre Channel-10-bit Interface Rev. 2.
Safety Notices y A Danger notice indicates the presence of a hazard that has the potential of causing death or serious personal injury. Danger notices appear on the following pages: ar 2-4, 2-5, 4-1 A Warning notice indicates the presence of a hazard that has the potential of causing moderate or minor personal injury. 4-6 Sicherheitshinweise in A Caution notice indicates the presence of a hazard that has the potential of causing damage to the equipment.
Communications Statements y The following statements apply to this product. The statements for other products intended for use with this product appear in their accompanying manuals. in ar Federal Communications Commission (FCC) Class A Statement This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules.
CE Statement y The CE symbol on the equipment indicates that this system complies with the EMC (Electromagnetic Compatibility) directive of the European Community (89/ 336/EEC) and to the Low Voltage (Safety) Directive (73/23/EEC). Such marking indicates that this system meets or exceeds the following technical standards: EN60950/A11:1997 “Safety of Information Technology Equipment, Including Electrical Business Equipment”. • EN60825-1:1997 “Safety of Laser Products, Part 1.
ar y VCCI Class A Statement Translation: Pr el im in This is a Class A product based on the standard of the Voluntary Control Council For Interference by Information Technology Equipment (VCCI). If this equipment is used in a domestic environment, radio disturbance may arise. When such trouble occurs, the user may be required to take corrective actions. 6 Preface 59008-03 Rev.
Laser Safety Information ar y This product may use Class 1 lasers to communicate over the fiber optic conductors. The U.S. Department of Health and Human Services (DHHS) does not consider Class 1 lasers to be hazardous. The International Electrotechnical Commission (IEC) requires labeling information that states that the lasers are Class 1.
Accessible Parts fuses associated with the AC input power • interfaces to the interconnection media called GBICs • two chassis fans, • the Power Supply, and • the Battery. ar • y Field Replaceable Units (FRU) in the SANbox-8 Fibre Channel Switch are: Pièces Accessibles in Refer to Section 4 Removal/Replacement Procedures for more information.
QLogic Customer Support Fax: (952) 932-4018 Attn: Customer Support E-Mail: support@QLogic.com ar Web: www.QLogic.com y Phone:(952) 932-4040 Pr el im in Please refer to Appendix B QLogic Customer Support for an explanation of QLogic Customer Support. SANbox-8 Fibre Channel Switch Installer’s/User’s Manual 59008-03 Rev.
Notes Preface 59008-03 Rev.
Section 1 y General Description ar Introduction Pr el im in The SANbox™-8 Fibre Channel Switch is the Fabric component of a Fibre Channel (FC) compliant network. Figure 1-1 is an illustration of the Switch. This manual describes the Switch as a full-featured fabric Switch unless otherwise specified. The SANbox-8 consists of two models; Model A has the airflow front-toback and Model B has the airflow back-to-front. In all other respects they are the same.
Major Fibre Channel Port Features Major Fibre Channel Port Features Major Fibre Channel port features include: Each Switch chassis has 8 Fibre Channel ports. Each port operates at 1062.5 megabaud. • Any or all eight ports may be: ar y • Fabric ports connect to fibre channel public devices and device loops. A fabric port is self configuring as an F_Port for a public device or as an FL_Port for a loop of public devices. Refer to “Fabric Port Overview” on page 1-3.
Major Fibre Channel Port Features You may populate 2 to 8 ports with GBICs. The choice of ports and GBICs is yours. • The Switch has been validated with GBICs that support a variety of interconnection media. Refer to “Fibre Channel Ports” on page 1-17 for more information. y • in ar Fabric Port Overview All ports on the SANbox-8 chassis are “Loop-aware” fabric ports.
Hub SL_Port Switch SL_Port ST2 AA A Private Loop Segment Private Loop Segment AA A ST3 ST1 Server 3 im Server 2 Hub in Hub SL_Port ar Private Loop Segment y Major Fibre Channel Port Features Figure 1-2 Segmented Loop Topology Example Segmented Loop Features Switch management allows you to designate any or all ports on a SANbox-8 chassis as SL_Ports. • SL_Ports connect to devices that conform to the Fibre Channel-Private Loop SCSI Direct Attach (FC-PLDA) standard.
Major Fibre Channel Port Features Each loop segment may have a Fibre Channel Frame in process. • You may have as many loop segments as you have SL_Ports. That is, if none of them are zoned together, each SL_Port would contain one set of AL_PA and each AL_PA within that loop must be unique. • The Switch supports all SCSI/FCP and TCP/IP frames. • SL_Ports support Class 2 and 3 Fibre Channel Service. ar y • SL_Port Management in Refer to the Switch Management manual for more information.
Major Fibre Channel Port Features TL_Port loops. This connectivity is achieved by having a translation function at each TL_Port which translates Private frames to Public frames and vice versa. y Figure 1-3 shows possible Fabric topologies with both public and Private SCSI devices. In this figure, the TL_Ports are ports with Translation Mode functions.
Major Fibre Channel Port Features A AA AA F_Port TL_Port im Hub TL_Port AA AA AA Server 4 Server 3 el Private Loop 2 Private Loop 1 Hub in Fabric Server 2 y AAA AA ar Server 1 Figure 1-4 TCP/IP Example Translated Loop Features Each TL_Port maintains up to 125 AL_PA addresses on the Private Loop. When one of these AL_PA addresses communicates with an “off-loop” device, the TL_Port acts as a proxy for the off-loop device on the Private Loop.
Major Fibre Channel Port Features y those targets. An Auto Learning feature automatically adds these initiators to the ports’ translation entries list. Use Zoning to limit the number of initiators to 31 or less. You may disable Auto Learning for any TL_Port via Switch management. The default for each TL_Port is Auto Learning enabled.
Major Fibre Channel Port Features The user may disable the Auto Learning feature for any TL_Port. The default for each TL_Port is Auto Learning enabled. • The user may manage the translation entries list for any TL_Port connected to Private initiators. That is, the user may identify all off-loop targets for the initiators on the particular TL_Port. Auto Learning should be disabled for these TL_Ports. • SANsurfer provides a map of all AL_PAs on a Translated Loop.
Major Switch Chassis Features Major Switch Chassis Features The following is an overview of the major features of the Switch chassis: A chassis can be defined as one of three stage types: Input-Output/Transfer (IO/T), Cross Connect (CC), or SL Private Loop. An IO/T chassis supports all port types (F, FL, SL, TL, and T). A CC chassis supports only T_Ports as it serves as a bridge between many IO/T chassis. An SL Private Loop chassis supports SL_Ports and T_Ports.
Major Switch Management Features Major Switch Management Features Switch management allows you to: Manage multiple fabrics • Select a fabric and set up the connection to the Ethernet port on the Switch chassis through-which the selected fabric is managed • Configure the Switch Management interface with its IP network configuration parameters and SNMP configuration parameters • For fabrics which contain multiple Switch chassis, you may view the topology of the selected fabric including the T_Port conn
Major Switch Management Features Perform Trace operations to follow selected operations through the selected chassis • Read and write memory locations on the selected chassis • Update the Flash memory on the selected chassis • Divide the ports or devices into zones for more efficient and secure communication among functionally grouped nodes.
Major Switch Management Features y Name Server zones of which it is a member. If hard zones are enabled, Name Server zones do not cross the defined hard zone boundaries. Name Server zones may overlap each other. T_Ports are not affected by Name Server zones. Segmented Loop Zones Configure the Mode of each port on the selected chassis.
Major Switch Management Features Configure the translation entries list for TL_Ports and control the TL_Port Auto Learning feature • Archive all configurable chassis parameters for all the chassis in a fabric • Restore all configurable chassis parameters for all chassis in a fabric by using the archived configuration Pr el im in ar y • 1-14 General Description 59008-03 Rev.
Switch Management Tools Switch Management Tools The SANsurfer Switch management application • Telnet • A Trivial File Transfer Protocol (TFTP) • A built-in SNMP Agent ar • y The Switch supports switch management primarily through the following tools. Refer to the Switch Management Manual for information about these tools.
• Set or read the IP network configuration • Read the SNMP configuration information • Online testing • Load switch firmware • Modify configuration parameters ar Trivial File Transfer Protocol (TFTP) The following functions are available in TFTP: y Switch Management Tools Pr el im in Simple Network Management Protocol (SNMP) SNMP enables you to read management information from the switch. 1-16 General Description 59008-03 Rev.
Fibre Channel Ports Fibre Channel Ports Switch Logic Power Good LED (Green) in Fan Fail LED (Red) ar y Figure 1-5 identifies the parts of the chassis front. Port numbers are marked on the front of the chassis. Notice that the order of transmit (TX) and receive (RX) connectors on the bottom row of ports is reverse of that on the top row. Also notice that the relative position of the Traffic and Logged-In LEDs is reversed between the bottom and top rows of ports.
Fibre Channel Ports GigaBit Interface Converters (GBICs) Currently, the following GBICs are certified for use: Short-wavelength fiber optic GBICs 100-M5-SN-I or 100-M6-SN-I without OFC to support connection to non-OFC Fibre Channel components. • Long-wavelength fiber optic GBICs 100-SM-LC-L. • Copper Inter-Enclosure GBIC (Active) 100-TW-EL-S or 100-TP-EL-S with either DB-9 or HSSDC connectors. • Copper Inter-Enclosure GBIC (Passive) 100-TW-EL-S or 100-TP-EL-S with either DB-9 or HSSDC connectors.
Front Panel Controls Front Panel Controls Power Switch ar y Figure 1-5 shows the location of the Power Switch. The Power switch is a rocker switch (press the Right side (labeled 1) to turn it ON, press the Left side (labeled 0) to turn it OFF). When you press the Power switch and turn it ON, there is a two-second delay before the fans start and the Power Good LED on the front of the chassis lights. The Power Good light indicates that the Switch logic is receiving power within the proper voltage range.
Front Panel LEDs Front Panel LEDs ar y Refer to Figure 1-5. LEDs visible through lenses in the front of the chassis indicate chassis and port status. During a Reset operation (for about two seconds at the beginning of power-up) all LEDs are forced ON. The following definitions are valid following the Power-On-Self-Test (POST) when the POST finds no errors.
Front Panel LEDs y Logged-In LED (Green) Each port has its own Logged-In LED. The Logged-In LED indicates the logged-in or initialization status of the connected device or loop of devices. A T_Port Logged-In LED will blink to indicate that the switch has been disabled due to a chassis number conflict. ar Normal Operation in Initially (immediately after the Switch successfully completes the POST), the Switch holds all Logged-In LEDs OFF (no light).
AC Input Power Connector and Fuses AC Input Power Connector and Fuses y Refer to Figure 1-5. A standard 3-wire computer-type AC power cable (supplied with the Switch) connects between the AC Input Power Connector and an AC outlet. Refer to “Switch Electrical” on page A-4 for the AC Power Requirements. See also Section 2 Installation for installation procedures. in Switch Management Connector ar An Input Fuse Holder is incorporated into the AC Input Power Connector assembly. It holds two input fuses.
Section 2 Introduction ar y Installation There are nine basic steps required to install the Switch. 2. Place or Mount the Equipment 3. Apply the IEC Laser Safety Label (If the installation contains fiber optic GBICs and is in Europe) 4. Install the GBICs 5. Connect the Switch to AC power 6. Check the Power-On-Self-Test (POST) results 7. Cable Fibre Channel Devices to the Switch 8. Configure the chassis 9. Configure the ports im in Unpack el Unpack 1. 1.
Place or Mount the Equipment Place or Mount the Equipment ar y NOTE: If this chassis is part of a multi-chassis fabric please read Section 5 Multi-Chassis Fabrics. It may affect the way you place or mount this chassis. The Switch may be placed on a flat surface and stacked, or mounted in a 19” EIA rack. The Switch comes with rubber feet on the bottom for placing it on a flat surface. in Air flow may be front-to-back or back-to-front depending on the Switch model.
im in ar y Apply the IEC Class 1 Laser Information Label (If the installation is in Europe) Figure 2-1 Cabinet Mounting Bracket el Apply the IEC Class 1 Laser Information Label (If the installation is in Europe) Pr Refer to Figure 2-2. When a Switch using fiber optic GBICs is installed at a site in Europe, IEC regulations require that you install a Class 1 laser information label placed where it is clearly visible whenever access to the optical ports is possible.
Install GBICs Install GBICs y You may populate your Switch with 2 to 8 GBICs. The choice of ports and GBICs is yours. The Switch has been validated with GBICs that support a variety of interconnection media. ar If this chassis is part of a multi-chassis fabric please read Section 5 MultiChassis Fabrics. It may effect the way you install the GBICs in this chassis.
Connect to AC Power DANGER: in ar y This product is supplied with a 3-wire power cable and plug for the user’s safety. Use this power cable in conjunction with a properly grounded outlet to avoid electrical shock. You may require a different power cable in some countries because the plug on the cable supplied with the equipment will not fit your electrical outlet. In this case you must supply your own power cable.
Switch Logic Power Good LED Appendix A. Press the Power Switch to the ON position. Refer to Figure 1-5 for its location. y The 3-wire grounded power circuit and the 3-wire power cable provide adequate grounding for the Switch. ar Switch Logic Power Good LED The Switch Logic Power Good LED on the front of the chassis will light when the Power Switch has been in the ON position for two or more seconds and the power supply is supplying DC power within its normal operating limits.
Cable Fibre Channel Devices to the Switch Cable Fibre Channel Devices to the Switch • ar y NOTE: • If this chassis is part of a multi-chassis fabric, please read Section 5 MultiChassis Fabrics and follow the cabling instructions in that section before cabling the Fibre Channel Devices to the Switch. If this chassis is an SL Private Loop chassis, refer to “SL Private Loop Stage Type” on page 1-5. in There are two types of Fibre Channel devices, Public and Private.
Cable Fibre Channel Devices to the Switch y Private Devices Private devices do not have full Fibre Channel addressing capability. They only have the Arbitrated Loop Physical Address (ALPA) portion of the Fibre Channel Physical Address. These devices only exist on loops and unless the Switch offers extra support, these devices cannot communicate outside their own loop. ar Private devices connect to Segmented Loop Ports (SL_Ports) or Translated Loop Ports (TL_Ports).
Cable Fibre Channel Devices to the Switch Distance ar y The maximum distance between each adapter and the Switch depends on the type of GBICs and the type of cable installed. Refer to Appendix A Reference Information for this information. Also, the speed and Fibre Channel Revision Level of each adapter must be compatible with the Switch and the type of I/O media of each adapter must be compatible with the particular GBIC on the Switch. in Port Buffer Credits Each port has eight buffer credits.
Cable Fibre Channel Devices to the Switch y Figure 2-3 shows a server connected to a switch that is cabled for 24 credits through port 1. Rx 2 F_Ext24 Tx Tx Rx 3 Rx Donor Tx Rx Tx 6 5 Tx Rx 7 Tx Tx im Rx Rx 4 Donor in 1 Tx ar Internal Connections el AA AA AA AA AA Pr Figure 2-3 Extending Buffer Credits by Chaining Ports Hot-Pluggable All GBICs and cables are “hot-pluggable”.
Cable Fibre Channel Devices to the Switch y On the Switch end of the connection, on the top row of ports, the transmit connector is the right-hand connector of each pair. On the bottom row of ports, the transmit connector is the left-hand connector of each pair. On the device end, you will have to consult the appropriate adapter or device manual to determine the connector orientation. in ar In some cases you may need to connect a loop of devices to the Switch without the use of a Hub.
Cable Fibre Channel Devices to the Switch Public Loop Storage Devices Connected to Public Servers ar y Figure 2-4 shows Public Loop storage devices connected to FL_Ports. The servers may be able to attach to either F or FL_Ports. If this is the case, we can use Switch Management to force the FL_Ports to function as F_Ports. If the servers will only attach to F_Ports, the ports will “self discover and function as F_Ports. Refer to “Configure the Ports” on page 2-17.
Cable Fibre Channel Devices to the Switch Variety of Public Device Connections y Figure 2-5 shows a variety of Public device connections.
Cable Fibre Channel Devices to the Switch Private Segmented Loop Connections ar y Figure 2-6 shows the connection of Private Loop servers and Private Loop storage units. Each SL_Port is one segment of a segmented loop. Each segmented loop may be divided into a maximum of 33 segments. Use Switch management to configure the appropriate ports to SL mode and to link SL_Ports (segments) into segmented loops.
Cable Fibre Channel Devices to the Switch Private Translated Loop Connections y Figure 2-7 is an example of Translated Loop ports (TL_Ports) used in conjunction with each other and with F and FL_Ports. Use Switch management to configure the appropriate TL_Ports and to identify the “off loop” initiators and targets for devices on each TL_Port. in ar Note in Figure 2-7 that Public Server 1 (a Public device) is an initiator for RAID 1 on Private Loop 1.
Configure the Chassis Configure the Chassis y If this chassis is part of a multi-chassis fabric, follow the instructions in “Chassis Configuration” on page 5-24. 1. ar If this is a single chassis switch, the only configuration necessary is the Ethernet port. To configure the chassis, do the following. Physically connect a management station to the ethernet port of the chassis through which the fabric will be managed. 2.
Configure the Ports Configure the Ports Use Switch Management for all port configuration. y Fabric Ports ar The default mode of each Switch port is FL. That is, each port can automatically discover that it must operate as an F_Port if it is connected to an N_Port device adapter or operate as an FL_Port if it is connected to an NL_Port device adapter. Some device adapters are N_Port only, other device adapters are NL_Port only, and the F_Port has no problem discovering its proper mode.
Configure the Ports TL_Ports y The set of off-loop devices proxied by a TL_Port is contained in its translation entries list. ar The translation entries list for a TL_Port connected to Private initiators will contain the targets (both Public and Private) that you want the Private initiator to communicate with. Auto Learning is not able to enter these targets into the translation entry list. Switch management allows you to manage the translation entries list for these TL_Ports.
Configure the Ports el im in ar y Tuning Ports for Multi-Frame Sequences In most circumstances tuning of an individual port is not desirable and the default setting (Normal) should be left unchanged. However, certain Host-Bus-Adapters (HBA) perform better with tuning. To support optimum performance with these HBAs, the Switch allows individual ports to be tuned based on the characteristics of a particular HBA.
Zoning Zoning • Hard zones • Name Server zones • Segmented loop zones • Broadcast zones ar y SANbox switches use the following types of zoning to restrict or extend access to devices in the fabric: in Refer to Section 5 Multi-Chassis Fabrics for information about zoning and multichassis fabrics. Refer to the Switch Management manual for information about creating zones. Hard Zones Name Server Zones im Hard zones provide security by allowing access only among hard zone member devices.
Rack and Shelf Administration Broadcast Zones y Broadcast zones focus the distribution of broadcast messages to only those devices that need to receive them. This reduces traffic on the fabric and eliminates unnecessary message processing. Broadcast zones are defined by port and can overlap. ar Rack and Shelf Administration Operating the Switch in Switch management uses racks and shelves to organize the fabric topology display for easier monitoring. A rack consists of one or more shelves.
Operating the Switch Notes Installation 59008-03 Rev.
Section 3 y Diagnostics/Troubleshooting ar Introduction Section 3 contains information to help you diagnose and troubleshoot problems with your Switch. Power Supply Troubleshooting helps you solve AC power and Power Supply problems. • Power-On-Self-Test (POST) checks the condition of the Switch with the exception of the GBICs. • Fiber Continuity tests for open fibers in the cable network.
Power-On-Self-Test (POST) Power-On-Self-Test (POST) Overview 6 in 8 ar y The Switch checks the state of the Test Mode switch as part of its power-up procedure. Refer to Figure 3-8 for the location of the Test Mode switch. Dot on the switch Test Mode Switch im 7 Dot on the faceplate Figure 3-8 Test Mode Switch el The normal setting of this switch (note the location of the dot on the switch relative to the dot on the faceplate) instructs the Switch to run the diagnostics one time at startup.
Power-On-Self-Test (POST) For example: A PROM checksum failure is an example of a fatal error. This indicates that the PROM firmware is corrupt and the switch will not operate. • A failure associated with a Fibre Channel port is an example of a non-fatal error. The Switch can isolate the bad port while the other ports continue to operate.
Power-On-Self-Test (POST) The POST diagnostic program performs the following basic tests: checksum tests on the Boot firmware located in a PROM and the main Switch firmware located in FLASH memory • functional hardware tests on internal Switch memory • various read/write register and loopback data-path tests on the Switch logic • Frame Bus and Auto Route logic tests • Switch Management port logic • Arbitrated Loop tests Normal (all pass) ar in Heartbeat LED Blink Patterns y • im If all PO
Power-On-Self-Test (POST) PROM Checksum Failure (1 Blink) The Switch is not operable. y This is a checksum test of the PROM designed to verify the integrity of the PROM data. A failure indicates the PROM data is corrupted and blinks the Heartbeat LED once between three-second pauses. No port Loggedin LEDs blink. ar RAM Failure (2 Blinks) The Switch is not operable. This is a test designed to verify the data and address busses to the SRAM as well as the SRAM integrity.
Power-On-Self-Test (POST) Switch ASIC Test Failure (6 Blinks) The Switch is not operable. GBIC Bypass Port Loopback Test Failure (7 Blinks) The Switch is operable. The GBIC ar y The Switch ASIC Test verifies the base functionality of each Switch ASIC. This includes the control port interface and all functions that can be performed within the confines of an individual ASIC. A failure indicates a faulty Switch ASIC and blinks the Heartbeat LED six times between three-second pauses.
Power-On-Self-Test (POST) After a few seconds of testing, if the Heartbeat LED is blinking the normal “heartbeat” (about once per second), the GBIC passes the test. If the Heartbeat LED blinks the 8-blink error code, the GBIC failed. y 5. Repeat steps 2 through 5 to test all GBICs one at a time. When all tests are complete, place the Test Mode Switch back in the “Normal Run” position (small dot on the end of the shaft pointing straight up). 7. Cycle the chassis power to cause a reset.
Cable Continuity Tests Switch Management Port Failure (14 Blinks) The Switch is operable. The Switch Management Port test verifies the integrity of the ar y Ethernet data bus functionality. A failure indicates that communication over the Ethernet port will most likely be adversely affected when this failure is indicated. The Heartbeat LED will blink fourteen times between three-second pauses. No port Logged-in LEDs blink. The remainder of the Switch and all ports have passed the tests and are operable.
Section 4 y Removal/Replacement Procedures ar Introduction DANGER: in Input Fuses and GBICs and are easily replaceable at the user’s site. The Fans, Power Supply, and the Battery are also replaceable, but these require the removal of the chassis top. GEFAHR: im QLogic recommends that any FRUs that require removal of the chassis top (to access the FRUs inside) be done at a repair depot.
Input Fuse Input Fuse Removal Press the Power Switch to the OFF (0) position. 2. Unplug the AC Power Cable from the front of the Switch chassis. 3. Refer to Figure 4-1. Insert a thin-blade screwdriver into the slot behind the tab and twist it to pull the Fuse Holder out the front of the AC Power Plug Assembly. 4. Lift the latch on the Fuse Holder until you can withdraw the Fuse Board. 5. Pull the Fuse(s) from the Fuse Board. in ar y 1.
Input Fuse Replacement Insert the Fuse(s) into the Fuse Board. Refer to Appendix A Reference Information for fuse-type information. 2. Insert the Fuse Board into the Fuse holder and press it in until it clicks past the Latch. 3. Insert the Fuse Holder into the AC Power Plug Assembly and press it in until it is flush with the front surface of the assembly. 4. Plug the AC Power Cable into the AC Power Plug Assembly. 5. Press the Power Switch to the ON (1) position. Pr el im in ar y 1.
GBIC GBIC y GBICs may be removed and replaced with the Switch power on without disrupting traffic on other ports. Removal Disconnect the cable (if one is connected) from the GBIC you are removing. 2. Remove GBICs. Some GBICs have individual latches; others are operated by a built-in bail. To remove GBICs that have individually operated latches, as shown in Figure 4-2, do the following: ar 1.
GBIC y To remove GBICs that have bail-operated latches, as shown in Figure 4-3, use your finger-tip to rotate the bail outward, then pull on the bail to remove the GBIC. ar Connector in Keyway Latch im Bail Figure 4-3 Removing GBICs that have bail-operated latches Replacement GBICs may be removed and replaced with the Switch power on without disrupting traffic on other ports. Orient the GBIC as shown in Figure 4-4.
Battery (Repair Depot Only) Slide the GBIC into the port opening (the spring-loaded door will open as you push the GBIC in). If you can only slide the GBIC in about an inch (2.5 cm) before it stops, you have the Keyway in the wrong position; flip the GBIC over and try it again. 3. Push the GBIC in until the GBIC Latches snap into place. If you have a GBIC that has bail-operated latches, make sure that the bail is rotated to the latched position. This allows the latches to latch (refer to Figure 4-3). 4.
Section 5 y Multi-Chassis Fabrics ar Introduction in You may use SANbox Switch chassis as building blocks to build a multiple-chassis fabric that will expand the number of user ports beyond the number in any one chassis. Also, the cables used for interconnecting chassis in this multiple-chassis fabric allow you to distribute the network in a campus environment, placing the user ports near to where you need them. The actual cable length is given in Appendix A Reference Information. .
Introduction y Three Multi-Chassis Topologies There are three basic multi-chassis topologies for SANbox Switches: Cascade, Mesh, and Multistage™. ar NOTE: Use your SANbox Switch chassis in any of these topologies but do not mix the topologies in the same fabric. That is, use your chassis in a Cascade, or Mesh, or Multistage but do not use a combination of topologies in the same fabric. im in The term “cascade” indicates that chassis are connected in a row “one-to-thenext”.
Introduction Choosing a Topology The topology you choose depends on the following major fabric requirements: The size of the fabric (number of user ports required), • The amount of latency the users can tolerate (number of chassis hops and interconnection media delay between the source port and the destination port), • The bandwidth between chassis (the number of T_Port paths between interconnected chassis), • The physical distances required between users in a “campus” distributed fabric verses a cen
Introduction Bandwidth Between Chassis ar y Each T_Port link between directly connected chassis contributes 100 megabytes of bandwidth between those chassis. Devoting half of the chassis ports to T_Ports may provide as much bandwidth between directly connected chassis as there is to user ports on the chassis (no bottleneck between chassis). One T_Port interconnection between chassis is the minimum. Fabric topology also affects bandwidth between chassis.
Cascade Topology Cascade Topology im 2 in 1 ar y The term “cascade” indicates that chassis are connected in a line “one-to-thenext”. You may optionally have chassis interconnections from the last chassis back to the first chassis (Loop). The loop provides better latency because any chassis can route traffic in the shortest direction to any another chassis in the loop. The loop also provides failover when only one chassis interconnection is used.
Cascade Topology ar y Cascade Fabric Size SANbox-8 chassis connected in Cascade topology expand from two chassis to a maximum of eight chassis. If you use Cascade-with-a-loop topology and cable four T_Ports on each chassis for chassis interconnection (two to each adjacent chassis), this results in a maximum of 32 user ports. If you cable two T_Ports on each chassis for chassis interconnection (one to each adjacent chassis), this results in a maximum of 48 user ports.
Cascade Topology ar y Cascade Bandwidth A chassis in a Cascaded topology divides its chassis interconnection bandwidth between adjacent chassis. That is, half of the T_Ports connect one direction around the loop and the other half connect the other direction around the loop. Even if you cable half of the chassis ports to T_Ports, you will only have one quarter of the chassis bandwidth connected in the direction of the least number of chassis hops to the destination chassis.
Cascade Topology y Cascade Zoning Sanbox Switch chassis support fabric-wide zones for all zone types. Broadcast zones and Name Server zones require no special consideration in a cascade fabric. That is, you may assign these zones on a user-port-by-user-port basis and T_Ports are not zoned. in ar Hard Zones, however, require zoned T_Port interconnections between chassis which contain ports in the same Hard Zone.
Mesh Topology Mesh Topology y The term “mesh” indicates that each chassis has at least one T_Port directly connected to each other chassis. im in ar In fabrics containing two or three chassis, Cascade-with-a-loop topology and Mesh topology are exactly the same. Note in Figure 5-2 that you could take any three chassis and their interconnections and draw them in a row with a loop back from the last chassis to the first chassis (the same as Cascade-with-a-loop).
Mesh Topology ar y Mesh Bandwidth A chassis in a Mesh topology divides its chassis interconnection bandwidth among the other chassis in the fabric. That is, each chassis has at least one T_Port connection to each other chassis in the fabric. In small fabrics of two or three chassis, you could have two connections to each other chassis. In fabrics of four or five chassis you should connect only one T_Port to each other chassis. Otherwise you will use more than half of your ports as T_Ports.
Mesh Topology Mesh Zoning y Sanbox Switch chassis support fabric-wide zones for all zone types. Broadcast zones and Name Server zones require no special consideration in a mesh fabric. That is, you may assign these zones by port or by device. T_Ports are not zoned. in ar Hard Zones, however, require zoned T_Port interconnections between chassis which contain ports in the same Hard Zone.
Multistage Topology Multistage Topology ar y A Multistage Switch consists of chassis configured in two different Stage Types, an Input-Output/Transfer (IO/T) stage type, and a Cross-Connect (CC) Stage Type. Two or more chassis with the IO/T Stage Type supply user ports to connect to the users, and T_Ports that connect to one or more chassis with the CC Stage Type. The chassis with the CC Stage Type supply interconnections for the T_Ports.
Multistage Topology ar y Multistage Bandwidth Multistage topology has the best bandwidth. All T_Ports from each IO/T chassis connect to all other IO/T chassis in the same number of chassis hops (three) no matter how large the fabric is. Thus the useful interconnection bandwidth from each IO/T chassis to any other IO/T chassis increases by 100MBs per T_Port.
Multistage Topology Pr el im in ar y Multistage Examples Figures 5-3 through 5-5 are examples of Multistage topology using SANbox-8 Switch chassis. Figure 5-3 SANbox-8 Multistage with one T_Port link from each IO/T chassis Figure 5-3 shows a Multistage Switch built from SANbox-8 chassis. Each of the eight IO/T chassis has one T_Port connection (the minimum) to the CC chassis. This provides 100 MBytes of bandwidth between each IO/T chassis and no failover in case a T_Port fails.
y Multistage Topology ar 2 2 2 in 2 Figure 5-4 SANbox-8 Multistage with two T_Port links from each IO/T chassis im Figure 5-4 shows a Multistage Switch built from SANbox-8 chassis. Each of the four IO/T chassis has two T_Port connections to the CC chassis. This provides 200 MBytes of bandwidth between each IO/T chassis and failover in case a T_Port fails. Each IO/T chassis distributes the available T_Port access among its user ports.
el im in ar y Multistage Topology Figure 5-5 SANbox-8 Multistage with Four CC Chassis Pr Figure 5-5 shows a Multistage Switch built from SANbox-8 chassis. Each of the eight IO/T chassis has one T_Port connection (the minimum) to each of the four CC chassis. This provides 400 MBytes of bandwidth between each IO/T chassis and failover in case T_Ports or CC chassis fail. Each IO/T chassis distributes the available T_Port access among its user ports. In this case there is a T_Port for each user port.
Cabling Cabling ar y Any port on an IO/T chassis may be a T_Port. If you are using 2, 3, or 4 T_Ports on each chassis, it is best to distribute these T_Ports as evenly as possible between the ASIC port groups on each IO/T chassis. That is, don’t bunch the T_Ports up in one ASIC port group. See “Tuning” on page 2-8 for more information about ASIC port groups. Using a port as a T_Port does not affect any other port on the chassis.
Chassis Configuration Chassis Configuration y There are two parameters that control the role that each chassis plays in a multichassis fabric: Stage Type and Chassis Number. ar Assign the Stage Type and Chassis Number for the selected chassis using the SANsurfer Switch management application. Refer to “Chassis Configuration Process” on page 5-25 for an explanation of this process.
Chassis Configuration Process Chassis Configuration Process Physically Connect a Management Station directly to the Ethernet port of the chassis through which the fabric will be managed. y 1. 2. in ar Follow the Ethernet Cabling instructions in the Switch Management manual to install the Switch (any Switch chassis in the fabric) temporarily on an isolated Ethernet network with the subnet address 10.x.x.x (By default, the Switch’s IP address is 10.0.0.1.).
Chassis Configuration Process The Fabric Topology window will display all the Switch chassis in the fabric and show the T_Port interconnections. Initially, all chassis will be IO/T chassis. Double click a chassis that you want to configure. The application will jump to the Switch Faceplate display for the selected Switch chassis. d. Just below the faceplate is the Chassis Parameters/Switch Statistics area.
Appendix A y Reference Information ar This appendix contains the specifications for the SANbox-8 Switch. Refer to “Fibre Channel Ports” on page 1-17 for the location of all connections, switches, and components. QLogic Customer Support in Phone: ................................................(952) 932-4040 Fax:.....................................................(952) 932-4018 Attn: Customer Support E mail:................................................support@QLogic.com Web: .....................
SANbox-8 Switch Specifications SANbox-8 Switch Specifications Switch ar y Fibre Channel Protocols:....................FC-PH Rev. 4.3 FC-PH-2 (selected features) FC-PH-3 (selected features) FC-GS-2 (selected features) FC-AL-2 Compliant) FC-FLA (compliant) FC-SW (in development) FC-GS-2 (selected features) in Fibre Channel Classes of Service: .....Class 3, Class 2 System Architecture:..........................Connectionless Fibre Channel fabric Modes of Operation: .........................
SANbox-8 Switch Specifications Fabric Port Speed: ..............................1.0625 Gb/second y Media Transmission Ranges: .............See GBIC specifications on pages A-5 through A-7. Fabric Latency (best case):.................Class 2 or Class 3 frame: <0.6 µsec. ar Fabric Point-to-Point Bandwidth:.......Class 2 or Class 3: 101.8 MB/s Fabric Aggregate Bandwidth: ............(Single Stage only) Class 2 or Class 3: Up to 8 Gb/s Maximum Frame Sizes: .....................
SANbox-8 Switch Specifications Switch Mechanical Chassis Dimensions: ..........................Refer to Figure A-1. ar y Enclosure Types: ................................The chassis is shipped with four rubber feet on the bottom for secure stacking. Cabinet Mounting Brackets are also shipped with the chassis. You may mount these brackets for mounting the chassis in a Standard 19-inch EIA rack with either the chassis back or front facing the front of the equipment rack. in Chassis Support: ...........
SANbox-8 Switch Specifications Non Operating Vibration:...................(In any axis): 0.5G from 10 to 300 Hz Non Operating Shock:........................(In any axis): 8.0G for 15 m seconds y Switch Regulatory Standards Certified to: ar Safety Standards: ...............................UL1950 CSA 22.2 No. 950 EN60950 in Emissions Standards: .........................FCC Part 15B Class A VCCI Class A ITE CISPR 22, Class A EN 55022, Class A Voltage Fluctuations: .........................
SANbox-8 Switch Specifications y Distance: ............................................500 meters maximum using 50 micron fiber 300 meters maximum using 62.5 micron fiber Safety: ................................................DHHS 21 CFR(J), IEC 825-1, CENELEC EN 60825-1, VDE ar Longwave Laser GBIC (single-mode) Connector:..........................................Duplex SC Color coding: .....................................Blue exposed connector surfaces in Cable: ...................................
SANbox-8 Switch Specifications y Copper Intra-Enclosure GBIC (passive) Connector:..........................................Style 1 (9 pin D-subminiature, DB-9) Style 2 (HSSDC, looks like wide phone jack or RJ45) ar Cable: .................................................Fibre Channel 100-TW-EL-S (shielded dual parallel pair cable) Fibre Channel 100-TP-EL-S (shielded dual twisted pair cable) Differential Impedance: .....................150 ohms +/- 10 ohms in Transmitted Signal: .......................
in ar y SANbox-8 Switch Specifications Pr el im 340 (13.6”) 20 (.80") Rx Tx 2 6 4 8 43.0 (1.720") 1 3 Tx 7 5 Rx 434.9 (17.396") Figure A-1 SANbox-8 Switch Dimensions in Millimeters (Inches) A-8 Reference Information 59008-03 Rev.
Appendix B y QLogic Customer Support ar This appendix describes the basic warranty and customer support. Customers who purchased directly from QLogic may contact Customer Support as described in this appendix. We encourage other customers to contact their reseller or authorized maintenance provider. Description: Consists of: in Help Desk Assistance related to questions about QLogic products. • Diagnostic assistance. • Providing information about available fixes and workarounds.
Software Support Software Support y QLogic actively supports the current software/firmware release and the prior release for 6 months following the general availability date for the current release. You are encouraged to keep your software/firmware levels current. ar For supported software: • QLogic will attempt to isolate and verify the reported problem. • If applicable, QLogic will give you a software/firmware fix or work around along with descriptive documentation.
y Index bandwidth between chassis 5-10 cascade 5-13 mesh 5-16 multistage 5-19 broadcast zone 1-12, 2-21 buffer credits 1-2, 2-9, A-2 C im B Pr el cable continuity tests 3-8 length 5-10, 5-23, A-2 cabling F_Ports 2-7 FL_Ports 2-7 incorrect 2-10 multi-chassis 5-23 private devices 2-8 public devices 2-7 cascade bandwidth 5-13 definition 5-8 distance between chassis 5-13 example 5-11 fabric size 5-12 latency 5-12 MKII compatibility 5-14 topology 5-11 with-a-Loop 5-11 zoning 5-14 caution notice 1-3 CC - S
Index multistage 5-19 E im in ar y emissions standards A-5 enclosure types A-4 environmental specifications A-4 error codes Arbitrated Loop Test Failure (13 Blinks) 3-7 Complete Failure 3-8 Ethernet Port Failure (4 blinks) 3-5 Ethernet Port Tests Good (3 blinks) 3-5 Force PROM Mode in Effect (5 Blinks) 3-5 GBIC Bypass Test Failure (7 Blinks) 3-6 Hung Flash Control Code 3-8 NVRAM Test Failure (15 Blinks) 3-8 Port Loop-back Test Failure (8 blinks) 3-6 PROM Checksum Failure (1 blink) 3-5 RAM Failure (2 b
Index I M el ar im in L laser information label 2-3 labeling requirements 1-7 safety information 1-7 specifications A-5, A-6 latency cascade 5-12 mesh 5-15 multistage 5-18 specifications A-3 LED ethernet activity 1-22 ethernet link status 1-22 fan fail 1-20 heartbeat 1-20, 3-4 logged-in 1-21 over temperature 1-20 switch logic power good 1-20, 2-6 traffic 1-21 Logged-In LED 1-21 loopback plug 2-1 Pr maintainability A-3 maintenance interfaces A-3 strategy A-3 manual how to use 1-1 intended audience 1-1
Index rack administration 2-21 mount 2-2 RAID 2-14, 2-15 RAM Failure 3-5 reference information A-1 regulatory standards A-5 rubber feet 2-2 S Pr el safety notices 1-3 standards A-5 SANsurfer 1-5, 1-8, 1-15 segmented loop example 2-14 features 1-4 overview 1-3 zone 1-13, 2-17, 2-20 Segmented Loop Port - See SL_Port.
Index in ar y translation entries list 1-7, 2-18 zoning 1-8 topology cascade 5-11 choosing 5-9 mesh 5-15 multistage 5-18 Traffic LED 1-21 translated loop example 2-15 Translated Port - See TL_Port. translation 1-6 transmission ranges A-3 Trivial File Transfer Protocol 1-16 troubleshooting cable continuity 3-8 power supply 3-1 Trunk Port - See T_Port. tuning ports 2-19 unpack 2-1 user interface A-3 V im U W el VCCI - See Voluntary Control Council for Interference.
Notes Index 59008-03 Rev.
