McDATA 4416 Fibre Channel Switch Module Installation Guide P/N 59180-00 REV A
Record of Revisions and Updates Revision Date Description 59180-00 A 01/13/06 Release Copyright © 2006 McDATA Corporation. All rights reserved. The software includes technology under a license from QLogic Corporation. Printed January 2006 First Edition No part of this publication may be reproduced or distributed in any form or by any means, or stored in a database or retrieval system, without the prior written consent of McDATA Corporation.
Contents Preface ........................................................................................................................................ xi Who Should Use this Manual ......................................................................... xi How to Use this Manual.................................................................................. xi Related Documentation ..................................................................................
Contents Performance .................................................................................................... 2-4 Distance..................................................................................................... 2-4 Bandwidth ................................................................................................ 2-5 Latency...................................................................................................... 2-5 Multiple Chassis Fabrics......................
Contents Fabric Management Specifications ............................................................. A-3 Dimensional Specifications .......................................................................... A-3 Electrical Specifications ................................................................................ A-3 Environmental Specifications ...................................................................... A-4 Regulatory Certifications.........................................................
Contents Notes vi McDATA 4416 Fibre Channel Switch Module Installation Guide
Figures 1-1 1-2 1-3 1-4 1-5 1-6 1-7 3-1 3-2 4-1 McDATA 4416 Switch Module ................................................................................... 1-1 Switch Module Controls and LEDS ........................................................................... 1-2 Switch Module LEDs.................................................................................................... 1-3 Fibre Channel Ports .............................................................................................
Figures Notes viii McDATA 4416 Fibre Channel Switch Module Installation Guide
Tables 2-1 2-2 3-1 A-1 A-2 A-3 A-4 A-5 A-6 A-7 Zoning Database Limits ............................................................................................... 2-2 Port-to-Port Latency ..................................................................................................... 2-5 Workstation Requirements.......................................................................................... 3-1 Fabric Specifications ........................................................................
Tables Notes x McDATA 4416 Fibre Channel Switch Module Installation Guide
Preface This manual describes the features and installation of the McDATA 4416 switch module, firmware version 5.2.3. Who Should Use this Manual This manual introduces users to the switch module and explains its installation and service. It is intended for users who are responsible for installing and servicing network equipment. How to Use this Manual This publication is organized as follows: • Chapter 1 is an overview of the switch module. It describes the ports and indicator LEDs.
Preface Related Documentation Other publications that provide additional information about the McDATA 4416 switch module are: • McDATA 4416 Product Information Guide, publication number, 59179-00. • McDATA 4416 Quick Start Guide, publication number 50562-00. • McDATA Switch Module Management Guide, publication number 59181-00. • McDATA 4416 Command Line Interface Guide, publication number 59182-00. • Fibre Channel-Arbitrated Loop (FC-AL-2) Rev. 6.8. • Fibre Channel-10-bit Interface Rev. 2.3.
1 General Description This section describes the features and capabilities of the McDATA 4416 Fibre Channel Switch Module in a server blade chassis. The following topics are described: • Switch Module Controls and LEDs • Fibre Channel Ports • Ethernet Port • Switch Module Management Fabrics are managed with the McDATA Embedded Web Server™ switch management application (version 5.02.03) and the Command Line Interface (CLI).
Switch Module Controls and LEDs Switch Module Controls and LEDs The switch module LEDs provide information about the switch module’s operational status. These LEDS include the Identifier LED, System Fault LED, and Input Power LED. The Maintenance button shown in Figure 1-2 is the only switch module control and is used to reset a switch module or to recover a disabled switch module. Switch Module LEDS Maintenance Button Figure 1-2.
Switch Module Controls and LEDs Switch Module LEDs The switch module LEDs shown in Figure 1-3 provide status information about switch module operation. Refer to “External Port LEDs” on page 1-5 for information about port LEDs. Identifier LED (Green) System Fault LED (Amber) Input Power LED (Green) Figure 1-3. Switch Module LEDs Identifier LED (Green) The Identifier LED identifies a specific switch module through the server blade interface.
Fibre Channel Ports Fibre Channel Ports The switch module has 6 external Fibre Channel ports through which to connect to devices or other switches and 10 internal ports connecting to the server midplane. Each of the external Fibre Channel ports is served by a Small Form-Factor Pluggable (SFP) optical transceiver and is capable of 1-Gbps, 2-Gbps, or 4-Gbps transmission. SFPs are hot-pluggable.
Fibre Channel Ports External Port LEDs Each external port has its own Logged-In LED (L) and Activity LED (A) as shown in Figure 1-6. Logged-In LED (Green) Activity LED (Green) 14 10 15 11 12 13 Figure 1-6. External Port LEDs Port Logged-In LED (Green) The Logged-in LED indicates the logged-in or initialization status of the connected devices. After successful completion of the POST, the switch module extinguishes all Logged-In LEDs.
Fibre Channel Ports Transceivers Switch modules support SFP optical transceivers for the Fibre Channel ports. A transceiver converts electrical signals to and from optical laser signals to transmit and receive data. Duplex fiber optic cables plug into the transceivers which then connect to the devices. A Fibre Channel port is capable of transmitting at 1-Gbps, 2-Gbps, or 4-Gbps; however, the transceiver must also be capable of delivering at these rates. The SFP transceivers are hot pluggable.
Ethernet Port Ethernet Port The Ethernet port shown in Figure 1-7 is an RJ-45 connector that provides a connection to a management workstation through a 10/100 Base-T Ethernet cable. A management workstation can be a Windows® or a Linux® workstation that is used to configure and manage the switch fabric. The switch through which the fabric is managed is called the fabric management switch.
Switch Module Management Switch Module Management The switch supports the following management tools: • McDATA Embedded Web Server • McDATA Element Manager • Command Line Interface • Simple Network Management Protocol • File Transfer Protocol McDATA Embedded Web Server McDATA Embedded Web Server is a graphical user interface that provides both fabric and switch module management functions. Because McDATA Embedded Web Server resides in the switch firmware, no installation is needed.
2 Planning Consider the following when planning a fabric: • Devices • Device Access • Performance • Multiple Chassis Fabrics • Switch Module Services • Fabric Security • Fabric Management Devices When planning a fabric, consider the number of public devices and the anticipated demand. This will determine the number of ports that are needed and in turn the number of switches. The switch module uses SFP optical transceivers, but the device host bus adapters you are using may not.
Device Access Device Access Consider device access needs within the fabric. Access is controlled by the use of zones and zone sets. Some zoning strategies include the following: • Group devices by operating system. • Separate devices that have no need to communicate with other devices in the fabric or have classified data. • Separate devices into department, administrative, or other functional group. • Reserve a path and its bandwidth from one port to another.
Device Access Soft Zones Soft zoning divides the fabric for purposes of controlling device discovery. Devices in the same soft zone automatically discover and communicate freely with all other members of the same zone. The soft zone boundary is not secure; traffic across soft zones can occur if addressed correctly. The following rules apply to soft zones: • Soft zones that include members from multiple switches need not include the ports of the inter-switch links.
Performance Performance The switch module supports class 2 and class 3 Fibre Channel service with a maximum frame size of 2148 bytes at transmission rates of 1-Gbps, 2-Gbps, or 4-Gbps. An external port adapts its transmission speed to match that of the device to which it is connected prior to login when the connected device powers up.
Performance Bandwidth Bandwidth is a measure of the volume of data that can be transmitted at a given transmission rate. A Fibre Channel port can transmit or receive at nominal rates of 1-Gbps, 2-Gbps, or 4-Gbps depending on the device to which it is connected. This corresponds to actual bandwidth values of 106 MB, 212 MB, and 425 MB respectively. Multiple source ports can transmit to the same destination port if the destination bandwidth is greater than or equal to the combined source bandwidth.
Multiple Chassis Fabrics Multiple Chassis Fabrics By connecting switches together you can expand the number of available ports for devices. Each switch in the fabric is identified by a unique domain ID, and the fabric can automatically resolve domain ID conflicts. Because the Fibre Channel ports are self-configuring, you can connect switches together in a wide variety of topologies.
Switch Module Services The domain ID lock allows (False) or prevents (True) the reassignment of the domain ID on that switch. Switches come from the factory with the domain ID set to 1, the domain ID lock set to False, and the principal priority set to 254. Refer to the McDATA Switch Module Management Guide for information about changing the domain ID and domain ID lock using McDATA Embedded Web Server.
Switch Module Services • Secure Socket Layer (SSL): Provides for secure SSL connections for McDATA Embedded Web Server, McDATA Element Manager, and CIM. This service must be enabled to authenticate users through a RADIUS server when using McDATA Embedded Web Server or McDATA Element Manager. To enable secure SSL connections, you must first synchronize the date and time on the switch and workstation. Enabling SSL automatically creates a security certificate on the switch. The default is enabled.
Fabric Security Fabric Security An effective security profile begins with a security policy that states the requirements. A threat analysis is needed to define the plan of action followed by an implementation that meets the security policy requirements. Internet portals, such as remote access and E-mail, usually present the greatest threats. Fabric security should also be considered in defining the security policy.
Fabric Security Device Security NOTE: Device security is available only with the SANtegrity Enhanced PFE key. Refer to McDATA Switch Module Management Guide for information about installing a PFE key. For additional McDATA PFE keys, please contact your McDATA representative or visit the web site at www.mcdata.com. Device security provides for the authorization and authentication of devices that you attach to a switch.
Fabric Management User Account Security User account security consists of the administration of account names, passwords, expiration date, and authority level. If an account has Admin authority, all management tasks can be performed by that account in McDATA Embedded Web Server, McDATA Element Manager, and the Telnet command line interface. Otherwise only monitoring tasks are available. The default account name, Admin, is the only account that can create or change account names and passwords.
Fabric Management Notes 2-12 McDATA 4416 Fibre Channel Switch Module Installation Guide
3 Installation This section describes how to install and configure the McDATA 4416 switch module. It also describes how to load new firmware and how to recover a disabled switch module. Site Requirements Consider the following items when installing a McDATA 4416 switch module: • Fabric Management Workstation • Environmental Conditions Fabric Management Workstation The requirements for fabric management workstations running McDATA Embedded Web Server are described in Table 3-1: Table 3-1.
Installing a Switch Environmental Conditions Consider the factors that affect the climate in your facility such as equipment heat dissipation and ventilation. The switch requires the following operating conditions: • Operating temperature range: 5 – 40°C (41 – 104°F) • Relative humidity: 5 – 90%, non-condensing Installing a Switch Installing a McDATA 4416 switch module involves the following steps: 1. Install SFP Transceivers 2. Mount the Switch Module in the Server Chassis 3.
Installing a Switch Mount the Switch Module in the Server Chassis McDATA 4416 switch modules are installed in server chassis I/O module slots 3 and 4 as shown in Figure 3-1. For a single switch module installation, use I/O module slot 3. Do not attempt to install the McDATA 4416 switch module in any other I/O module slots. Switch Module in I/O Module Slot 3 Switch Module in I/O Module Slot 4 Figure 3-1.
Installing a Switch When energized, the switch module responds in the following sequence: 1. The switch module LEDs (Identifier, Input Power, System Fault) illuminate followed by all port Logged-In LEDs. 2. After a couple seconds the System Fault LED is extinguished while the Input Power LED remains illuminated. 3. After approximately one minute, the POST executes. 4. After about another minute, the POST is complete, all LEDs are extinguished except the Input Power LED.
Installing a Switch The default IP address of a new switch module is 10.0.0.1. Many management workstations are not configured to communicate with the 10.0.0 subnet. Use the McDATA Embedded Web Server Configuration Wizard to set the IP address of a new switch without re-configuring the management workstation. To establish an Ethernet connection, do the following: 1.
Installing a Switch Configure the Switch Module You can configure the switch using the McDATA Embedded Web Server application, the McDATA Element Manager, or the command line interface. Using McDATA Embedded Web Server or McDATA Element Manager, click the Open Configuration Wizard radio button in the Initial Start dialog, then click the Proceed button.
Install Firmware Cable Devices to the Switch Connect cables to the SFP transceivers and their corresponding devices, and then energize the devices. Device host bus adapters can have SFP (or SFF) transceivers or GigaBit Interface Converters (GBIC). LC-type duplex fiber optic cable connectors are designed for SFP transceivers, while SC-type connectors are designed for GBICs. Duplex cable connectors are keyed to ensure proper orientation.
Install Firmware Using McDATA Embedded Web Server or McDATA Element Manager to Install Firmware To install firmware using McDATA Embedded Web Server or McDATA Element Manager, do the following: 1. In the faceplate display, open the Switch menu and select Load Firmware. 2. In the Firmware Upload window, click the Select button to browse and select the firmware file to be uploaded. 3. Click the Start button to begin the firmware load process.
Install Firmware Using the CLI to Install Firmware To install firmware using the CLI when a File Transfer Protocol (FTP) server is present on the management workstation, use the Firmware Install command. Refer to the McDATA 4416 Command Line Interface Guide for information about this command. NOTE: Installing firmware using the Firmware Install command is disruptive to the fabric. To perform a non-disruptive firmware installation refer to the Image command in the McDATA 4416 Command Line Interface Guide.
Install Firmware Notes 3-10 McDATA 4416 Fibre Channel Switch Module Installation Guide
4 Troubleshooting Diagnostic information about the switch is available through the switch module LEDs and the external port LEDs. Diagnostic information is also available through the McDATA Embedded Web Server and CLI event logs and error displays. The switch performs a series of tests as part of its power-up procedure.
Logged-In LED Indications Logged-In LED Indications Port diagnostics are indicated by the Logged-In LED for each port as shown in Figure 4-1. Logged-In LED Figure 4-1. Logged-In LED The Logged-In LED has three indications: • Continuous illumination: A device is logged in to the port. • Flashing once per second: A device is logging in to the port. • Flashing twice per second: The port is down, offline, or an error has occurred.
Logged-In LED Indications Review the event browser and do the following to diagnose and correct an isolated E_Port: 1. Does the event browser show an alarm about an invalid attach on the affected port? • Yes - Review the ISL group in the active security set to ensure that the membership includes the necessary ports and that the secrets on all switches are correct. • No - Continue. 2.
Logged-In LED Indications Excessive Port Errors The switch can monitor a set of port errors and generates alarms based on user-defined sample windows and thresholds. These port errors include the following: • CRC errors • Decode errors • ISL connection count • Login errors • Logout errors • Loss-of-signal errors Port threshold alarm monitoring is disabled by default. Refer to the McDATA Switch Module Management Guide for information about managing port threshold alarms.
Recovering a Switch Module 3. Replace the Fibre Channel port cable. Is the problem corrected? • Yes - Complete. • No - Continue. 4. Inspect the device to which the affected port is connected and confirm that the device and its HBA are working properly. Make repairs and corrections as needed. If the condition remains, contact your authorized maintenance provider.
Recovering a Switch Module 5. The maintenance menu displays several recovery options. To select a switch recovery option, press the corresponding number (displayed in option: field) on the keyboard and press the Enter key. 0) Exit 1) Image Unpack 2) Reset Network Config 3) Reset User Accounts to Default 4) Copy Log Files 5) Remove Switch Config 6) Remake Filesystem 7) Reset Switch 8) Update Boot Loader Option: These options and their use are described in the following subsections.
Recovering a Switch Module Maintenance – Reset Network Config This option resets the network properties to the factory default values and saves them on the switch. Refer to the Reset command in the McDATA 4416 Command Line Interface Guide for the default network configuration values. Maintenance – Reset User Accounts to Default This option restores the password for the Admin account name to the default (password) and removes all other user accounts from the switch.
Recovering a Switch Module Notes 4-8 McDATA 4416 Fibre Channel Switch Module Installation Guide
A Specifications This appendix contains the specifications for the McDATA 4416 switch module. Refer to Chapter 1 for the location of all connections, switches, controls, and components. Fabric Specifications Table A-1. Fabric Specifications Specification Description Fibre Channel Protocols ............................... FC-PH Rev. 4.3 FC-PH-2 FC-PH-3 FC-AL Rev 4.6 FC-AL-2 Rev 7.0 FC-FLA FC-GS FC-GS-2 FC-GS-3 FC-FG FC-Tape FC-VI FC-SW-2 Fibre Channel Element MIB RFC 2837 Fibre Alliance MIB Version 4.
Maintainability Specifications Table A-1. Fabric Specifications (Continued) Specification Description Maximum User Ports .................................... > 475,000 ports depending on configuration Buffer Credits ................................................ 16 buffer credits per port, ASIC embedded memory Media Type.................................................... SFP optical transceiver, hot-pluggable Fabric Port Speed ......................................... 1.0625, 2.125, or 4.
Fabric Management Specifications Fabric Management Specifications Table A-3. 1 Fabric Management Specifications Specification Description Management Methods .................................. McDATA Embedded Web Server McDATA Element Manager1 through EFCM Command Line Interface GS-3 Management Server SNMP FTP Ethernet Connection ..................................... RJ-45 connector; 10/100 BASE-T cable Switch Agent.................................................
Environmental Specifications Environmental Specifications Table A-6. A-4 Environmental Specifications Specification Description Temperature • Operating .............................................. • Non-operating ....................................... 5 to 40°C (41 to 104°F) -40 to 70°C (-40 to 158°F) Humidity • Operating .............................................. • Non-operating .......................................
Regulatory Certifications Regulatory Certifications Table A-7. Regulatory Certifications Certification Description Safety Standards .......................................... UL60950:2000 CSA 22.2 No. 60950-00 (Canada) EN60950:2000 (EC) CB Scheme-IEC 60950:1999 Emissions Standards .................................... FCC Part 15B Class A ICES-03 Issue 3 VCCI Class A ITE CISPR 22, Class A EN 55022, Class A Voltage Fluctuations...................................... EN 61000-3-3 Harmonics...........
Regulatory Certifications Notes A-6 McDATA 4416 Fibre Channel Switch Module Installation Guide
gGlossary A Access Control List Zone Access Control List zoning divides the fabric for purposes of controlling discovery and inbound traffic. Active Zone Set The zone set that defines the current zoning for the fabric. Active Firmware The firmware image on the switch that is in use. Activity LED Administrative State A port LED that indicates when frames are entering or leaving the port. State that determines the operating state of the port, I/O blade, or switch.
B BootP Buffer Credit Boot Strap Protocol. A type of network server. A measure of port buffer capacity equal to one frame. C Cascade Topology A fabric in which the switches are connected in series. If you connect the last switch back to the first switch, you create a cascade-with-a-loop topology. Class 2 Service A service which multiplexes frames at frame boundaries to or from one or more N_Ports wit h acknowledgment provided.
Fabric Device Management Interface Fabric Management Switch Fabric Name Fabric Port An interface by which device host bus adapters can be managed through the fabric. The switch through which the fabric is managed. User defined name associated with the file that contains user list data for the fabric. An F_Port or FL_Port. Fabric Security The functions that provide security for fabric users and devices including user account security, and fabric services.
IP Internet Protocol L LIP Logged-In LED Loop Initialization Primitive sequence A port LED that indicates device login or loop initialization status. M Maintenance Button Momentary button on the switch used to reset the switch or place the switch in maintenance mode. Maintenance Mode Maintenance mode sets the IP address to 10.0.0.1 and provides access to the switch for maintenance purposes.
P Pending Firmware POST Power-On Self Test Principal Switch The firmware image that will be activated upon the next switch reset. Power-On Self Test Diagnostics that the switch chassis performs at start up. The switch in the fabric that manages domain ID assignments. S Simple Network Management Protocol Security Set SFP Small Form-Factor Pluggable SNMP Soft Zone An application protocol that manages and monitors network communications and functions. It also controls the Management Information Base (MIB).
Voluntary Control Council for Interference A consortium of Japanese electronics industry associations that have established voluntary standards for controlling electromagnetic interference (EMI). W Worldwide Name (WWN) WWN A unique 64-bit address assigned to a device by the device manufacturer. Worldwide Name Z Zone Zone Set Zoning Database g--6 A set of ports or devices grouped together to control the exchange of information. A set of zones grouped together.
iIndex Numerics D 10/100 Base-T straight cable 3-4 device access 2-2 authentication 2-10 authorization 2-10 cabling 3-7 description 2-1 performance 2-6 security 2-10 diagnostics A-2 dimensions A-3 distance 2-4 domain ID conflict 4-3 description 2-6 lock 2-7 donor port 2-4 A Access Control List zone 2-3 account name 4-5 Activity LED 1-5, 1-7 altitude A-4 authorization 2-10 B bandwidth 2-5, A-2 boot loader 4-7 browser 3-1 buffer credit 2-4, A-2 C cable 10/100 Base-T 3-4 10/100 Base-T crossover 3-4 fibr
Index fabric management 2-11, A-3 management switch 1-7 management workstation 3-1 point-to-point bandwidth A-2 port 1-6 security 2-9 factory defaults 4-7 fiber optic cable 2-1 Fibre Channel ports 1-4 protocols A-1 File Transfer Protocol description 1-8 service 2-8 firmware install with CLI 3-9 install with EFCM BASIC 3-8 unpack image 4-6 FL_Port 1-6 flash memory 1-2 frame size A-2 FRU - See Field Replaceable Unit FTP - See File Transfer Protocol G G_Port 1-6 GBIC - See GigaBit Interface Converter generic
Index port buffer credits 2-4 characteristics A-1 diagnostics 4-2 Ethernet 1-7 external 1-4 fabric 1-6 Fibre Channel 1-4 generic 1-6 internal 1-4 LEDs 1-5 maximum number of ports/users A-2 number of A-1 speed A-2 types 1-6, A-1 Port Activation PFE key 1-4 POST - See Power On Self Test power consumption A-3 source loading A-3 power on self test 3-4, 4-1 principal priority 2-6 switch 2-6 processor 3-1 Product Features Enabled key 1-4, 1-8, 2-10 small form-factor pluggable 1-6 SNMP See - Simple Network Manag
Index Notes i-4 i-McDATA 4416 Fibre Channel Switch Module Installation Guide
