McDATA 4314 Fibre Channel Switch Module Installation Guide P/N 59140-00 REV A
Record of Revisions and Updates Revision 59140-00 A Date Description 5/2005 Initial release of manual Copyright © 2005 McDATA Corporation. All rights reserved. Printed April 2005 First Edition No part of this publication may be reproduced or distributed in any form or by any means, or stored in a database or retrieval system, without the prior written consent of McDATA Corporation. The information contained in this document is subject to change without notice.
Contents Preface ........................................................................................................................................ xi Who Should Use this Manual ......................................................................... xi How to Use this Manual.................................................................................. xi Related Documentation ...................................................................................
Contents Performance .................................................................................................... 2-4 Distance..................................................................................................... 2-4 Bandwidth ................................................................................................ 2-4 Latency...................................................................................................... 2-5 Multiple Chassis Fabrics......................
Contents Dimensional Specifications .......................................................................... A-3 Electrical Specifications ................................................................................ A-3 Environmental Specifications ...................................................................... A-4 Regulatory Certifications.............................................................................. A-5 Glossary ...............................................................
Contents vi McDATA 4314 Fibre Channel Switch Module Installation Guide
Figures 1-1 1-2 1-3 1-4 1-5 1-6 1-7 3-1 3-2 4-1 McDATA 4314 Switch Module ................................................................................... 1-1 Switch Module Controls and LEDS ........................................................................... 1-2 Switch Module LEDs.................................................................................................... 1-3 Fibre Channel Ports .............................................................................................
Figures viii McDATA 4314 Fibre Channel Switch Module Installation Guide
Tables 2-1 2-2 3-1 3-2 A-1 A-2 A-3 A-4 A-5 A-6 A-7 Zoning Database Limits ............................................................................................... 2-2 Port-to-Port Latency ..................................................................................................... 2-5 Workstation Requirements.......................................................................................... 3-1 Management Workstation Requirements ......................................................
Tables x McDATA 4314 Fibre Channel Switch Module Installation Guide
Preface This manual describes the features and installation of the McDATA 4314 switch module, firmware version 5.2. Who Should Use this Manual This manual introduces users to the switch module and explains its installation and service. It is intended for users who are responsible for installing and servicing network equipment. How to Use this Manual This publication is organized as follows: • Chapter 1 is an overview of the switch module. It describes the ports and indicator LEDs.
Preface • Fibre Channel-10-bit Interface Rev. 2.3. • Definitions of Managed Objects for the Fabric Element in Fibre Channel Standard (draft-ietf-ipfc-fabric-element-mib-04.txt). The Fibre Channel Standards are available from: Global Engineering Documents, 15 Inverness Way East, Englewood, CO 80112-5776 Phone: (800) 854-7179 or (303) 397-7956 Fax: (303) 397-2740.
1 General Description This section describes the features and capabilities of the McDATA 4314 Fibre Channel Switch Module in a server blade chassis. The following topics are described: • Switch Module Controls and LEDs • Fibre Channel Ports • Ethernet Port • Switch Module Management Fabrics are managed with the EFCM BASIC™ switch management application (version 5.02) and the Command Line Interface (CLI).
Switch Module Controls and LEDs Switch Module Controls and LEDs The switch module LEDs provide information about the switch module’s operational status. These LEDS include the Identifier LED, System Fault LED, and Input Power LED. The Maintenance button shown in Figure 1-2 is the only switch module control and is used to reset a switch module or to recover a disabled switch module. Switch Module LEDS Maintenance Button Figure 1-2.
Fibre Channel Ports To exit maintenance mode and return to normal operation, momentarily press and release the Maintenance button to reset the switch module. Switch Module LEDs The switch module LEDs shown in Figure 1-3 provide status information about switch module operation. Refer to “External Port LEDs” on page 1-4 for information about port LEDs. Identifier LED (Green) System Fault LED (Amber) Input Power LED (Green) Figure 1-3.
Fibre Channel Ports 10 11 12 13 Figure 1-4. Fibre Channel Ports Internal ports are named Int0–Int9 and numbered 0–9. The port numbers 0–9 correspond to server blades 1–10 as shown in Figure 1-5. Server Blades 1 2 3 4 5 6 7 8 9 10 0 1 2 3 4 5 6 7 8 9 10 11 12 13 Switch Module Ports Figure 1-5. Internal Port/Server Blade Mapping External Port LEDs Each external port has its own Logged-In LED (L) and Activity LED (A) as shown in Figure 1-6.
Fibre Channel Ports Logged-In LED (Green) Activity LED (Green) 10 11 12 13 Figure 1-6. External Port LEDs Port Logged-In LED (Green) The Logged-in LED indicates the logged-in or initialization status of the connected devices. After successful completion of the POST, the switch module extinguishes all Logged-In LEDs. Following a successful loop initialization or port login, the switch module illuminates the corresponding logged-in LED.
Ethernet Port Port Types Switch modules support generic ports (G_Port, GL_Port), fabric ports (F_Port, FL_Port), and expansion ports (E_Port). Switch modules come from the factory with all Fibre Channel ports configured as GL_Ports. Generic, fabric, and expansion ports function as follows: • A GL_Port self-configures as an FL_Port when connected to a public loop device, as an F_Port when connected to a single public device, or as an E_Port when connected to another switch.
Switch Module Management Activity LED (Green) Link Status LED (Green) RJ-45 Ethernet Port Figure 1-7. Ethernet Port Switch Module Management The switch supports the following management tools: • EFCM BASIC • McDATA Embedded Web Server • Command Line Interface • Simple Network Management Protocol • File Transfer Protocol EFCM BASIC EFCM BASIC is a workstation-based Java® application that provides a graphical user interface for fabric management.
Switch Module Management BASIC application. Refer to the McDATA 4314 Command Line Interface Guide for information about disabling the embedded GUI service using the Set Setup Services command.
2 Planning Consider the following when planning a fabric: • Devices • Device Access • Performance • Multiple Chassis Fabrics • Switch Module Services • Fabric Security • Fabric Management Devices When planning a fabric, consider the number of public devices and the anticipated demand. This will determine the number of ports that are needed and in turn the number of switches. The switch module uses SFP optical transceivers, but the device host bus adapters you are using may not.
Device Access Device Access Consider device access needs within the fabric. Access is controlled by the use of zones and zone sets. Some zoning strategies include the following: • Group devices by operating system. • Separate devices that have no need to communicate with other devices in the fabric or have classified data. • Separate devices into department, administrative, or other functional group. • Reserve a path and its bandwidth from one port to another.
Device Access secure; traffic across soft zones can occur if addressed correctly. The following rules apply to soft zones: • Soft zones that include members from multiple switches need not include the ports of the inter-switch links. • Soft zone boundaries yield to ACL zone boundaries. • Soft zones can overlap; that is, a port can be a member of more than one soft zone. • Membership can be defined by Fibre Channel address, domain ID and port number, or port worldwide name.
Performance Performance The switch module supports class 2 and class 3 Fibre Channel service with a maximum frame size of 2148 bytes at transmission rates of 1-Gbps or 2-Gbps. An external port adapts its transmission speed to match that of the device to which it is connected prior to login when the connected device powers up. Related performance characteristics include the following: • Distance • Bandwidth • Latency Distance Consider the physical distribution of devices and switches in the fabric.
Performance ports if the combined destination bandwidth is greater than or equal to the source bandwidth. In multiple chassis fabrics, each link between chassis contributes 106 or 212 MB of bandwidth between those chassis depending on the speed of the link. When additional bandwidth is needed between devices, increase the number of links between the connecting switches. The switch module guarantees in-order-delivery with any number of links between chassis.
Multiple Chassis Fabrics Multiple Chassis Fabrics By connecting switches together you can expand the number of available ports for devices. Each switch in the fabric is identified by a unique domain ID, and the fabric can automatically resolve domain ID conflicts. Because the Fibre Channel ports are self-configuring, you can connect switches together in a wide variety of topologies.
Multiple Chassis Fabrics Domain ID, Principal Priority, and Domain ID Lock The following switch configuration settings affect multiple chassis fabrics: • Domain ID • Principal priority • Domain ID lock The domain ID is a unique number from 1–239 that identifies each switch in a fabric. The principal priority is a number (1–255) that determines the principal switch which manages domain ID assignments for the fabric.
Switch Module Services Switch Module Services You can configure your switch module to suit the demands of your environment by enabling or disabling a variety of switch services. Familiarize yourself with the following switch services and determine which ones you need: 2-8 • Telnet: Provides for the management of the switch over a Telnet connection. Disabling this service is not recommended. The default is enabled. • Secure Shell (SSH): Provides for secure remote connections to the switch using SSH.
Fabric Security • Network Time Protocol (NTP): Provides for the synchronizing of switch and workstation dates and times with an NTP server. This helps to prevent invalid SSL certificates and timestamp confusion in the event log. The default is disabled. • Common Information Model (CIM): Provides for the management of the switch through third-party applications that use CIM. The default is enabled.
Fabric Security Connection Security Connection security provides an encrypted data path for switch management methods. The switch supports the Secure Shell (SSH) protocol for the command line interface and the Secure Socket Layer (SSL) protocol for management applications such as EFCM BASIC and Common Information Module (CIM). The SSL handshake process between the workstation and the switch involves the exchanging of certificates.
Fabric Security Device Security NOTE: Device security is available only with the McDATA SANtegrity Enhanced Product Features Enabled (PFE) key. Refer to EFCM Basic Management Guide for information about installing a PFE key. For additional McDATA PFE keys, please contact your McDATA representative or visit the web site at www.mcdata.com. Device security provides for the authorization and authentication of devices that you attach to a switch.
Fabric Management User Account Security User account security consists of the administration of account names, passwords, expiration date, and authority level. If an account has Admin authority, all management tasks can be performed by that account in both EFCM BASIC™ and the Telnet command line interface. Otherwise only monitoring tasks are available. The default account name, Admin, is the only account that can create or change account names and passwords.
3 Installation This section describes how to install and configure the McDATA 4314 switch module. It also describes how to load new firmware and how to recover a disabled switch module. Site Requirements Consider the following items when installing a McDATA 4314 switch module switch: • Fabric Management Workstation • Environmental Conditions Fabric Management Workstation The requirements for fabric management workstations running EFCM BASIC are described in Table 3-2: Table 3-1.
Site Requirements Table 3-2. Management Workstation Requirements Operating System • • Windows 2000/2003 Linux® Red Hat® EL 3.x, 4.x Memory 256 MB or more Disk Space 150 MB per installation Processor 500 MHz or faster Hardware CD-ROM drive, RJ-45 Ethernet port Internet Browser Microsoft® Internet Explorer® 5.0 and later Netscape Navigator® 4.72 and later Mozilla™ 1.02 and later Java 2 Runtime Environment to support the McDATA Embedded Web Server.
Installing a Switch Environmental Conditions Consider the factors that affect the climate in your facility such as equipment heat dissipation and ventilation. The switch requires the following operating conditions: • Operating temperature range: 5 – 40°C (41 – 104°F) • Relative humidity: 5 – 90%, non-condensing Installing a Switch Installing a McDATA 4314 switch module involves the following steps: 1. Install SFP transceivers. 2. Insert the switch module in the server chassis. 3.
Installing a Switch Mount the Switch Module in the Server Chassis McDATA 4314 switch modules are installed in server chassis I/O slots 3 and 4 as shown in Figure 3-1. For a single switch module installation, use slot 4. Do not attempt to install the McDATA 4314 switch module in any other I/O slots. Switch Module in I/O Slot 3 Switch Module in I/O Slot 4 Figure 3-1. Mounting the Switch Module in the Server Chassis To insert the McDATA 4314 switch module, do the following: 1.
Installing a Switch 3. After approximately one minute, the POST executes. 4. After about another minute, the POST is complete, all LEDs are extinguished except the Input Power LED. The Input Power LED remains illuminated indicating that the switch logic circuitry is receiving DC voltage. If not, contact your authorized maintenance provider.
Installing a Switch 3. Open a Telnet session by entering the following command with the switch IP address. The default IP address is 10.0.0.1 telnet 10.0.0.1 4. Log in to the switch. The default account name and password are (admin, password). Switch Login: admin Password: ******** Install EFCM BASIC You can install EFCM BASIC on a Windows or Linux workstation. To install the EFCM BASIC application, do the following: For a Windows platform: 1.
Installing a Switch Start EFCM BASIC To start the EFCM BASIC application for the first time, do the following: NOTE: After the switch is operational, you can also open the McDATA Embedded Web Server, by entering the switch IP address in an internet browser. If your workstation does not have the Java 2 Run Time Environment program, you will be prompted to download it. 1.
Installing a Switch Configure the Switch Module You can configure the switch using the EFCM BASIC application or the command line interface. To configure the switch using EFCM BASIC, click the Open Configuration Wizard radio button in the Initial Start dialog, then click the Proceed button.
Installing a Switch To configure the switch using the command line interface, do the following: 1. Open a Telnet session with the default switch IP address and log in to the switch with default account name and password (admin/password). telnet 10.0.0.1 Switch Login: admin Password: ******* 2. Open an admin session and enter the Set Setup System command. Enter the values you want for switch IP address (Eth0NetworkAddress) and the network mask (Eth0NetworkMask).
Install Firmware Install Firmware The switch module comes with current firmware installed. You can upgrade the firmware from the management workstation as new firmware becomes available. You can use the EFCM BASIC application or the CLI to install new firmware. You can load and activate version 5.2 firmware on an operating switch without disrupting data traffic or having to re-initialize attached devices.
Install Firmware Refer to the McDATA 4314 Command Line Interface Guide for information about this command. 1. Enter the following command to download the firmware from a remote host to the switch, install the firmware, then reset the switch to activate the firmware. If possible, a non-disruptive activation will be performed. DFCSM (admin) #> firmware install Warning: Installing new firmware requires a switch reset.
Install Firmware 3-12 McDATA 4314 Fibre Channel Switch Module Installation Guide
4 Troubleshooting Diagnostic information about the switch is available through the switch module LEDs and the external port LEDs. Diagnostic information is also available through the EFCM BASIC and CLI event logs and error displays. The switch performs a series of tests as part of its power-up procedure.
Logged-In LED Indications Logged-In LED Indications Port diagnostics are indicated by the Logged-In LED for each port as shown in Figure 4-1. Logged-In LED Figure 4-1. Logged-In LED The Logged-In LED has three indications: • Continuous illumination: A device is logged in to the port. • Flashing once per second: A device is logging in to the port. • Flashing twice per second: The port is down, offline, or an error has occurred.
Logged-In LED Indications • Yes - Review the ISL group in the active security set to ensure that the membership includes the necessary ports and that the secrets on all switches are correct. • No - Continue. 2. Does the event browser show a repeating alarm about an unsupported E_Port command on the affected port? • Yes - The port is configured as an FL_Port and connected to another switch. Correct the port connection or the port type. • No - Continue. 3.
Recovering a Switch Module Port threshold alarm monitoring is disabled by default. Refer to the EFCM Basic Management Guide for information about managing port threshold alarms. If the count for any of these errors exceeds the rising trigger for three consecutive sample windows, the switch generates an alarm and disables the affected port, changing its operational state to “down”.
Recovering a Switch Module • Forgotten password In these specific cases, you can recover the switch using maintenance mode. Maintenance mode temporarily returns the switch IP address to 10.0.0.1 and provides opportunities to do the following: • Unpack a firmware image file • Restore the network configuration parameters to the default values • Remove all user accounts and restore the Admin account name password to the default.
Recovering a Switch Module Maintenance – Image Unpack This option unpacks and installs new firmware when the current firmware has become corrupt. Before using this option, you must load the new firmware image file onto the switch. The steps to install new firmware using this option are as follows: 1. Place the switch in maintenance mode. Refer to the procedure for maintenance mode in “Recovering a Switch Module” on page 4-4. 2. Use the Image command to load a new firmware image file onto the switch.
Recovering a Switch Module Maintenance – Remake Filesystem In the event of a loss of power, the switch configuration may become corrupt. The file system on which the configuration is stored must be re-created. This option resets the switch to the factory default values including user accounts and zoning. Refer to the Reset command in the McDATA 4314 Command Line Interface Guide for the factory default values.
Recovering a Switch Module Notes 4-8 McDATA 4314 Fibre Channel Switch Module Installation Guide
A Specifications This appendix contains the specifications for the McDATA 4314 switch module. Refer to Chapter 1 for the location of all connections, switches, controls, and components. Fabric Specifications Table A-1. Fabric Specifications Specification Description Fibre Channel Protocols ............................... FC-PH Rev. 4.3 FC-PH-2 FC-PH-3 FC-AL Rev 4.6 FC-AL-2 Rev 7.0 FC-FLA FC-GS FC-GS-2 FC-GS-3 FC-FG FC-Tape FC-VI FC-SW-2 Fibre Channel Element MIB RFC 2837 Fibre Alliance MIB Version 4.
Maintainability Specifications Table A-1. Fabric Specifications (Continued) Specification Description Scalability...................................................... Maximum 239 switches depending on configuration Maximum User Ports .................................... > 475,000 ports depending on configuration Buffer Credits ................................................ 16 buffer credits per port, ASIC embedded memory Media Type....................................................
Fabric Management Specifications Fabric Management Specifications Table A-3. Fabric Management Specifications Specification Description Management Methods .................................. EFCM BASIC Graphical User Interface Command Line Interface GS-3 Management Server SNMP FTP Ethernet Connection ..................................... RJ-45 connector; 10/100 BASE-T cable Switch Agent.................................................
Environmental Specifications Environmental Specifications Table A-6. A-4 Environmental Specifications Specification Description Temperature • Operating .............................................. • Non-operating ....................................... 5 to 40°C (41 to 104°F) -40 to 70°C (-40 to 158°F) Humidity • Operating .............................................. • Non-operating .......................................
Regulatory Certifications Regulatory Certifications Table A-7. Regulatory Certifications Certification Description Safety Standards .......................................... UL60950:2000 CSA 22.2 No. 60950-00 (Canada) EN60950:2000 (EC) CB Scheme-IEC 60950:1999 Emissions Standards .................................... FCC Part 15B Class A ICES-03 Issue 3 VCCI Class A ITE CISPR 22, Class A EN 55022, Class A Voltage Fluctuations...................................... EN 61000-3-3 Harmonics...........
Regulatory Certifications Notes A-6 McDATA 4314 Fibre Channel Switch Module Installation Guide
gGlossary A Access Control List Zone Access Control List zoning divides the fabric for purposes of controlling discovery and inbound traffic. Active Zone Set The zone set that defines the current zoning for the fabric. Active Firmware The firmware image on the switch that is in use. Activity LED Administrative State Alarm Alias AL_PA Arbitrated Loop Arbitrated Loop Physical Address (AL_PA) ASIC Auto Save A port LED that indicates when frames are entering or leaving the port.
B BootP Buffer Credit Boot Strap Protocol. A type of network server. A measure of port buffer capacity equal to one frame. C Cascade Topology A fabric in which the switches are connected in series. If you connect the last switch back to the first switch, you create a cascade-with-a-loop topology. Class 2 Service A service which multiplexes frames at frame boundaries to or from one or more N_Ports wit h acknowledgment provided.
Fabric Device Management Interface Fabric Management Switch Fabric Name Fabric Port An interface by which device host bus adapters can be managed through the fabric. The switch through which the fabric is managed. User defined name associated with the file that contains user list data for the fabric. An F_Port or FL_Port. Fabric Security The functions that provide security for fabric users and devices including user account security, and fabric services.
Inter-Switch Link IP The connection between two switches using E_Ports. Internet Protocol L LIP Logged-In LED Loop Initialization Primitive sequence A port LED that indicates device login or loop initialization status. M Maintenance Button Momentary button on the switch used to reset the switch or place the switch in maintenance mode. Maintenance Mode Maintenance mode sets the IP address to 10.0.0.1 and provides access to the switch for maintenance purposes.
P Pending Firmware POST Power-On Self Test Principal Switch The firmware image that will be activated upon the next switch reset. Power-On Self Test Diagnostics that the switch chassis performs at start up. The switch in the fabric that manages domain ID assignments. S Simple Network Management Protocol Security Set SFP Small Form-Factor Pluggable SNMP Soft Zone An application protocol that manages and monitors network communications and functions. It also controls the Management Information Base (MIB).
Voluntary Control Council for Interference A consortium of Japanese electronics industry associations that have established voluntary standards for controlling electromagnetic interference (EMI). W Worldwide Name (WWN) WWN A unique 64-bit address assigned to a device by the device manufacturer. Worldwide Name Z Zone Zone Set Zoning Database g--6 A set of ports or devices grouped together to control the exchange of information. A set of zones grouped together.
iIndex Numerics 10/100 Base-T straight cable 3-5 A Access Control List zone 2-3 account name 4-5 Activity LED 1-5, 1-6 altitude A-4 authorization 2-11 B bandwidth 2-4, A-2 boot loader 4-7 browser 3-1, 3-2 buffer credit 2-4, A-2 C cable 10/100 Base-T 3-5 10/100 Base-T crossover 3-5 fibre optic 2-1 certificate 2-10 chassis marking A-5 shock A-4 vibration A-4 classes of service A-1 command line interface 1-8 Common Information Model 2-9 configuration file system error 1-2 remove 4-6 restore default 4-6 cre
Index port 1-6 security 2-9 factory defaults 4-6 fiber optic cable 2-1 Fibre Channel ports 1-3 protocols A-1 File Transfer Protocol description 1-8 service 2-9 firmware install with CLI 3-10 install with EFCM BASIC 3-10 unpack image 4-6 FL_Port 1-6 flash memory 1-2 frame size A-2 FRU - See Field Replaceable Unit FTP - See File Transfer Protocol maintainability A-2 maintenance exit 4-5 menu 4-5 mode 1-2, 4-5 maintenance button 1-2, 4-5 management server 2-9 workstation 1-6 management workstation 3-5 markin
Index principal priority 2-7 switch 2-7 processor 3-1, 3-2 R RADIUS - See Remote Dial-In User Service.
Index i-4 i-McDATA 4314 Fibre Channel Switch Module Installation Guide