Intel® Blade Server Fibre Channel Switch Module SBCEFCSW and Fibre Channel Expansion Card SBFCM: Hardware Maintenance Manual and Troubleshooting Guide A Guide for Technically Qualified Assemblers of Intel Identified Subassemblies & Products Order Number C46558-003
NOTE Before using this information and the product it supports, be sure to read the general information in “Safety and regulatory information” on page iii. 12 1 Disclaimer Information in this document is provided in connection with Intel. products. No license, express or implied, by estoppel or otherwise, to any intellectual property rights is granted by this document. Except as provided in Intel's Terms and Conditions of Sale for such products.
Safety and regulatory information ✏ NOTE The service procedures are designed to help you isolate problems. They are written with the assumption that you have model-specific training on all computers, or that you are familiar with the computers, functions, terminology, and service information provided in this manual.
General Safety Follow these rules to ensure general safety: • Observe good housekeeping in the area of the machines during and after maintenance. • Do not perform any action that causes hazards to the customer, or that makes the equipment unsafe. • Place removed covers and other parts in a safe place, away from all personnel, while you are servicing the machine. • Keep your tool case away from walk areas so that other people will not trip over it.
Handling electrostatic discharge-sensitive devices Any computer part containing transistors or integrated circuits (IC) should be considered sensitive to electrostatic discharge (ESD). ESD damage can occur when there is a difference in charge between objects. Protect against ESD damage by equalizing the charge so that the server, the part, the work mat, and the person handling the part are all at the same charge. ✏ NOTE Use product-specific ESD procedures when they exceed the requirements noted here.
Danger: DANGER Danger: Some laser products contain an embedded Class 3A or Class 3B laser diode. Note the following: Danger: Laser radiation when open. Do not stare into the beam, do not view directly with optical instruments, and avoid direct exposure to the beam. CAUTION: Hazardous energy is present when the blade is connected to the power source. Always replace the blade cover before installing the blade. Regulatory specifications and disclaimers Safety compliance USA: UL 60950 - 3rd Edition/CSA 22.
Electromagnetic compatibility (EMC) USA: FCC CFR 47 Part 2 and 15, Verified Class A Limit Canada: IC ICES-003 Class A Limit Europe: EMC Directive, 89/336/EEC EN55022, Class A Limit, Radiated & Conducted Emissions EN55024 ITE Specific Immunity Standard EN61000-4-2 ESD Immunity (Level 2 Contact Discharge, Level 3 Air Discharge) EN61000-4-3 Radiated Immunity (Level 2) EN61000-4-4 Electrical Fast Transient (Level 2) EN61000-4-5 AC Surge EN61000-4-6 Conducted RF EN61000-4-8 Power Frequency Magnetic Fields E
Electromagnetic compatibility notices (International) Europe (CE Declaration of Conformity): This product has been tested in accordance to, and complies with the Low Voltage Directive (73/23/EEC) and EMC Directive (89/336/EEC). The product has been marked with the CE Mark to illustrate its compliance. Japan EMC Compatibility: English translation of the notice above: This is a Class A product based on the standard of the Voluntary Control Council for Interference by Information Technology Equipment (VCCI).
RRL Korea: ix
English translation of the previous notice: Device Class A device User’s Information This device complies with RRL EMC and is operated in commercial environment so that distributors or users pay attention to this point. If the product is sold or purchased improperly, please exchange this product to what can be used at home. Class B device This device complies with RRL EMC and is operated in a residential area so that it can be used at all other location as well as residential area.
Contents Safety and regulatory information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iii General Safety . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iv Electrical Safety . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iv Handling electrostatic discharge-sensitive devices . . . . . . . . . . . . . . . . . . . . . . . . . .
Zoning command . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66 Using the SAN Utility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69 SAN Utility user interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69 Menu bar . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70 Toolbar . . . . . . . .
Fibre Channel switch module monitoring using SNMP . . . . . . . . . . . . . . . . . . . . . . . SNMP configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SNMP trap configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Restoring Fibre Channel switch module configuration . . . . . . . . . . . . . . . . . . . . . . . Configuration backup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Management module error messages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Switch diagnostic information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . LED error codes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . I2C diagnostic register definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Undetermined problems. . . . . . . . . . .
1 General information Fibre Channel technology is outlined in the SCSI-3 Fibre Channel Protocol (SCSI-FCP) standard. Fibre Channel is a high-speed data transport technology used for mass storage and networking. By adding Fibre Channel Expansion Cards to the blade servers and Fibre Channel switch modules to the Intel® Blade Server Chassis SBCE, you can attach the blade server to an external storage area network (SAN) through the external 2 Gbps (gigabits per second) optical ports on the switch modules.
• QLogic® SAN Interoperability Guide This publication is provided in PDF on the Resource CD. It is a key resource for SAN planning and implementation. It provides interoperability matrices that let you identify at a glance the certified SAN products, solutions, and services that best suit your needs. • QLogic® SAN Configuration Guide: CLARiiON Storage This publication is provided in PDF on the Resource CD.
2 Intel® Blade Server Fibre Channel Switch Module SBCEFCSW ✏ NOTE Throughout this publication, the phrases "switch module" and "fibre channel switch module" refer to the Intel® Blade Server Fibre Channel Switch Module SBCEFCSW. You can manage and configure your Intel® Blade Server Fibre Channel Switch Module SBCEFCSW through a Telnet connection to the embedded command line interface (CLI) or by using the SAN Utility application.
Command line interface (CLI) Your switch module contains an embedded Telnet server. This server enables a Telnet client to establish a Telnet session with the switch module to retrieve information or to configure parameters using the CLI. You can use the CLI to perform a variety of fabric and switch management tasks through an Ethernet connection to your Intel® Blade Server Chassis SBCE.
Command syntax The command syntax is as follows: command keyword keyword [value] keyword [value1] [value2] The command is followed by one or more keywords. Consider the following rules and conventions: • Commands and keywords are lowercase and case sensitive. • Required keyword values are shown in standard font: [value]. Optional values are shown in italics: [value]. • The underlined portion of each keyword indicates the abbreviated form that can be used.
Table 1. Commands listed by authority level User authority commands Help “Help command” on page 14. History “History command” on page 15. Ps “Ps command” on page 19. Quit “Quit command” on page 20. Show “Show command” on page 38. Show Config “Show Config command” on page 45. Show Log “Show Log command” on page 48. Show Perf “Show Perf command” on page 50. Show Setup “Show Setup command” on page 52. Uptime “Uptime command” on page 57.
Admin command Opens and closes an admin session. The admin session provides commands that change the fabric and switch configurations. Only one admin session can be open on the switch at any time. An inactive admin session will time out after a period of time that can be changed using the Set Setup System command. See the “Set Setup command” on page 35. Authority Admin Syntax admin start end cancel Keywords start Opens the admin session. end Closes the admin session.
Alias command Creates a named set of ports. Aliases make it easier to assign a set of ports to many zones. An alias cannot have a zone or another alias as a member. Authority Admin Syntax alias add [alias] [members] copy [alias_source] [alias_destination] create [alias] delete [alias] list members [alias] remove [alias] [members] rename [alias_old] [alias_new] Keywords add [alias] [members] Specifies one or more ports given by [members] to add to the alias named [alias].
remove [alias] [members] Removes the ports given by [members] from the alias given by [alias]. [members] can have one of the following formats: • Domain ID and port number pair (domain ID, port number). Domain IDs and port numbers are in decimal format. Ports are numbered beginning with 0. • 6-character hexadecimal device Fibre Channel address (hex) • 16-character hexadecimal port worldwide name (PWWN) for the device with the format xx:xx:xx:xx:xx:xx:xx:xx.
Config command Manages the Fibre Channel configurations on a switch. For information about setting the port and switch configurations, see the “Set Config command” on page 26. Authority Admin for all keywords except List Syntax config activate [config] backup cancel copy [config_source] [config_destination] delete [config] edit [config] list restore save [config] Keywords activate [config] Activates the configuration given by [config].
Notes If you edit the active configuration, changes will be suspended until you reactivate the configuration or activate another configuration. Examples The following shows an example of how to open and close a Config Edit session. FCSM: user1> admin start FCSM (admin) : user1> config edit . . . FCSM (admin-config) : user1> config cancel Configuration mode will be canceled.
Date command Displays or sets the blade server date and time. To set the date and time, you must provide the information string in this format: MMDDhhmmCCYY, where MM = month, DD = day, hh = hour, mm = minute, CC = century, and YY = year. You must reset the switch for the new date to take effect. Authority Admin to change the date; user to display the date. Syntax date [MMDDhhmmCCYY] Keywords [MMDDhhmmCCYY] Specifies the date – this requires an admin session.
Fallback command Loads the fallback version of the firmware from switch memory. The switch stores two versions of the firmware. This command alternately activates the two versions. Authority Admin Syntax fallback Notes • • The Show Switch command displays the available firmware versions and the currently active version. After running the Fallback command, reset the switch for the firmware to be in effect. Examples The following is an example of the Fallback command.
Help command Displays a brief description of the specified command and its keywords. Authority User Syntax help [command] [keyword] Keywords [command] A command name. If you omit this value, all available commands from which to choose are displayed. [keyword] A keyword associated with the command named by [command]. If you omit this value, available keywords for the specified command are displayed. all Displays a list of all available commands (including command variations).
History command Displays a numbered list of the previously entered commands from which you can re-execute selected commands. Authority User Syntax history Notes Use the History command to provide context for the! command. • Enter ![command] to re-enter the most recent execution of that command. • Enter ![line number] to re-execute the corresponding command from the History display • Enter ![partial command string] to re-execute a command that matches the command string.
Image command Manages and installs switch firmware. Authority Admin Syntax image cleanup fetch [account_name] [ip_address] [file_source] [file_destination] list unpack [file] Keywords cleanup Removes all firmware image files from the switch. All firmware image files are removed automatically each time the switch is reset.
Lip command (for external ports only) Reinitializes the specified loop port. Authority Admin Syntax lip [port_number] Keywords [port_number] The number of the port to be reinitialized. Examples The following is an example of the Lip command.
Passwd command Changes the password for a user account. Authority Admin to change the password for another account; user to change your own. Syntax passwd [account_name] Keywords [account_name] The user account name. You must open an admin session to change the password for an account name other than your own. If you omit [account_name], you are prompted to change the password for the current account name. Examples The following is an example of the Passwd command.
Ps command Displays current blade server process information. Authority User Syntax ps Examples The following is an example of the Ps command. FCSM: user1> ps PID 19 PPID %CPU TIME ELAPSED COMMAND 341 329 0.0 00:00:00 2-00:58:29 cns 342 329 0.0 00:00:02 2-00:58:29 ens 343 329 0.0 00:00:27 2-00:58:29 dlog 344 329 1.3 00:40:39 2-00:58:29 ds 345 329 1.4 00:41:38 2-00:58:29 mgmtApp 346 329 0.0 00:00:06 2-00:58:29 fc2 347 329 0.5 00:16:35 2-00:58:29 nserver 348 329 0.
Quit command Closes the Telnet session. Authority User Syntax quit, exit, or logout Reset command Resets the switch and port configuration parameters. Authority Admin Syntax reset config [config_name] factory port [port_number] snmp switch (default) system zoning Keywords config [config_name] Resets the configuration given by [config_name] to the factory default values for switch, port, alarm threshold, and zoning configuration. This keyword clears all zoning definitions.
Notes The following tables specify the various factory default settings. Table 2. Switch configuration defaults Parameter Default Admin State Online Broadcast Enabled True Inband Enable True Domain ID 1 Domain ID Lock False Symbolic Name Fibre Channel Switch Module R_T_TOV 100 R_A_TOV 10000 E_D_TOV 2000 FS_TOV 5000 DS_TOV 5000 Principal Priority 254 System Description Fibre Channel Switch Module Configuration Last Saved By Initial Configuration Last Saved On Initial Table 3.
Table 3. Port configuration defaults (continued) Parameter External port (0,15) default Internal port (1-14) default MFS_TOV 10 10 MSEnable True True NoClose False False IOStreamGuard False False VIEnable False False CheckAlps False False Table 4.
Table 5. SNMP configuration defaults Parameter Default Contact Undefined Location Undefined Description Undefined Trap [1] Address 10.0.0.1 Trap [2-5] Address 0.0.0.0 Trap [1-5] Port 162 Trap [1-5] Severity Warning Trap [1-5] Enabled False ObjectID 1.3.6.1.4.1.1663.1.1.1.1.16 AuthFailureTrap False Table 6. System configuration defaults Parameter Ethernet Network IP Address Default Switch module bay 3: 192.168.70.129 Switch module bay 4: 192.168.70.
Set command Sets a variety of port and switch parameters. Authority Admin for all keywords except Alarm Clear, Beacon, and Pagebreak which are available with User authority. Syntax set alarm clear beacon [state] config [option] log [option] pagebreak [state] port [option] setup [option] switch [state] Keywords alarm clear Clears the alarm log. This keyword is available with User authority. beacon [state] Enables or disables the flashing of the Port Logged-in LEDs according to [state].
switch [state] Temporarily changes the administrative state for all ports on the switch to the state given by [state]. The previous Set Config Switch settings are restored after a switch reset or a reactivation of a switch configuration. [state] can be one of the following: Online Places all ports online Offline Places all ports offline. Diagnostics Prepares all ports for testing.
Set Config command Sets port, switch, alarm threshold, and zoning configuration parameters. Authority Admin authority and a Config Edit session. See the “Config command” on page 10 for information about starting a Config Edit session. Syntax set config port [port_number] ports [port_number] switch threshold zoning Keywords port [port number] Initiates an editing session in which to change configuration parameters for the port number given by [port_number].
Table 7. Set Config port parameters (continued) Parameter Description TLPortMode Initiates the configuration of external ports attributes. Indicates whether using initiator or target devices on the loop. If you specify [port_number], the display will present attributes for that port only; otherwise, all attributes for all ports will be available for configuration. ISLSecurity E_Port security. Determines which switches a port will establish a link with. • • • Any - Will link with any switch.
Table 8. Set Config switch parameters (continued) Parameter Description SymbolicName Descriptive name. R_T_TOV Receiver Transmitter Timeout Value. Specifies the number of milliseconds a port is to wait to receive a response from another port. The default is 100. R_A_TOV Resource Allocation Timeout Value. The number of milliseconds the switch waits to allow two ports to allocate enough resources to establish a link. The default is 10000. E_D_TOV Error Detect Timeout Value.
zoning Initiates an editing session in which to change switch zoning attributes. Each parameter is displayed, one line at a time, and you are prompted for a value. For each parameter, enter a new value or press the Enter key to accept the current value shown in brackets. Table 10. Set Config zoning parameters Parameter Description AutoSave Determines whether zoning changes will be saved to flash (nonvolatile) memory (On) or to RAM (volatile) (Off). The default is On.
Finished configuring attributes. This configuration must be saved (see config save command) and activated (see config activate command) before it can take effect. To discard this configuration use the config cancel command. The following is an example of the Set Config Switch command. FCSM: user1> admin start FCSM (admin) : user1> config edit FCSM (admin-config) : user1> set config switch A list of attributes with formatting and current values will follow.
DecodeErrorsMonitoringEnabled (True / False) [True ] RisingTrigger (decimal value, 1-1000) [200 ] FallingTrigger (decimal value, 0-1000) [0 ] SampleWindow (decimal value, 1-1000 sec) [10 ] (True / False) [True ] RisingTrigger (decimal value, 1-1000) [2 ] FallingTrigger (decimal value, 0-1000) [0 ] SampleWindow (decimal value, 1-1000 sec) [10 ] (True / False) [True ] RisingTrigger (decimal value, 1-1000) [5 ] FallingTrigger (decimal value, 0-1000) [1 ] SampleWindow (de
Set Log command Specifies the type of entries to be entered in the event log. The log is a storage file contained on the switch. The log can hold a maximum of 200 entries. When the log becomes full, the entries are replaced, starting with the oldest entry, to produce a list of the last 200 events which occurred. Log entries are created for ports, components, and event severity levels.
Port Monitors all port events. Switch Monitors switch management events. Zoning Monitors zoning conflict events. level [level] Specifies the severity level given by [level] to use in monitoring events for the specified components or ports. [level] can be one of the following values: Critical Monitors critical events. Warn Monitors warning events. Info Monitors informational events. To maintain optimal switch performance, do not use this setting with the Component keyword set to All.
Set Port command Sets port state and speed for the specified port temporarily until the next switch reset or new configuration activation. This command also clears port counters. For information about port numbering and mapping, see Table 37 on page 124. ✏ NOTE For external ports (0,15), all port parameters apply. For internal ports, only the port state setting is configurable.
Set Setup command Changes SNMP and blade server configuration settings. The switch maintains one SNMP configuration and one configuration. Authority Admin Syntax set setup snmp system Keywords snmp Prompts you, line-by-line, to change SNMP configuration settings. Table 11 describes the SNMP fields. For each parameter, enter a new value or press the Enter key to accept the current value shown in brackets. Table 11.
system Prompts you, line-by-line, to change blade server configuration settings. Table 12 describes the system configuration fields. For each parameter, enter a new value or press the Enter key to accept the current value shown in brackets. Table 12. System configuration settings Entry Description Eth0NetworkAddress Ethernet Internet protocol (IP) address Eth0NetworkMask Ethernet subnet mask address for the Ethernet port.
Trap1Port Trap1Severity Trap1Enabled Trap2Address Trap2Port Trap2Severity Trap2Enabled Trap3Address Trap3Port Trap3Severity Trap3Enabled Trap4Address Trap4Port Trap4Severity Trap4Enabled Trap5Address Trap5Port Trap5Severity Trap5Enabled ReadCommunity WriteCommunity TrapCommunity AuthFailureTrap (decimal value) (see allowed options above) (True / False) (dot-notated IP Address) (decimal value) (see allowed options above) (True / False) (dot-notated IP Address) (decimal value) (see allowed options above) (Tr
Show command Displays fabric, switch, and port operational information. Authority User Syntax show about alarm broadcast chassis config [option] domains donor fabric interface log [option] lsdb mem [count] ns [option] pagebreak perf [option] port [port_number] post log setup [option] steering [domain_id] support switch topology users version Keywords about Displays an introductory set of information about operational attributes of the switch. This keyword is equivalent to the Version keyword.
domains Displays a list of each domain and its worldwide name in the fabric. donor Displays list of current donor configuration for all ports. fabric Displays list of each domain, fabric ID, worldwide name, node IP address, port IP address, and symbolic name in the fabric. interface Displays the status of the active network interfaces. log [option] Displays log entries. See the “Show Log command” on page 48. lsdb Displays Link State database information.
Table 13. Show Port parameters Entry 40 Description AIinit Incremented each time the port begins AL initialization. AIinitError Number of times the port entered initialization and the initialization failed. ClassXFramesIn Number of class x frames received by this port. ClassXFramesOut Number of class x frames sent by this port. ClassXWordsIn Number of class x words received by this port. ClassXWordsOut Number of class x words sent by this port. DecodeError Decoding error detected.
Table 13. Show Port parameters (continued) Entry Description TotalErrors Total number of errors detected. TotalLIPsRecvd Number of loop initialization primitive frames received by this port. TotalLinkResets Total number of link reset primitives. TotalOfflineSeq Total number of Offline Sequences issued by this port. TotalRxFrames Total number of frames received by this port. TotalRxWords Total number of words received by this port. TotalTxFrames Total number of frames issued by this port.
switch Displays switch operational information. topology Displays all connected devices. users Displays a list of logged-in users. This is equivalent to the User List command. version Displays an introductory set of information about operational attributes of the switch. This keyword is equivalent to the About keyword. Examples The following is an example of the Show Setup SNMP command.
The following is an example of the Show Topology command. FCSM: user1> show topology Unique ID Key ------------A = ALPA, D = Domain ID, P = Port ID Loc Local Port ---- Type ---- PortWWN ------- Rem Ext:15 E 20:0f:00:c0:dd:00:90:fb E Remote Unique Type NodeWWN ---- ------- ID ------ 10:00:00:c0:dd:00:90:d74 (0x4) D The following is an example of the Show Topology (for Port #15) command.
OperationalState Online ALInit 11 FlowErrors 0 PrimSeqErrors 0 ALInitError 1 FReject 0 RxLinkResets 0 Class2FramesIn 0 InvalidCRC 0 RxOfflineSeq 0 Class2FramesOut 0 InvalidDestAddr 0 TotalErrors 1 Class2WordsIn 0 LIP_AL_PD_AL_PS 0 TotalLIPsRecvd 15 Class2WordsOut 0 LIP_F7_AL_PS 0 TotalLinkResets 0 Class3FramesIn 0 LIP_F7_F7 15 TotalOfflineSeq 0 Class3FramesOut 0 LIP_F8_AL_PS 0 TotalRxFrames 0 Class3Toss 0 LIP_F8_F7 0 TotalRxWords 0 Class3WordsIn 0 LinkFailur
Show Config command Display port, switch, alarm threshold, and zoning attributes for the current configuration. Authority User Syntax show config port [port_number] switch threshold zoning Keywords port [port_number] Displays configuration parameters for the port number given by [port_number]. Ports are numbered beginning with 0. If the port value is omitted, all ports are specified. ✏ NOTE For external ports (0,15), all parameters apply. For internal ports (1 through 14) only AdminState applies.
MFS_TOV 10 MSEnable True NoClose False IOStreamGuard Disabled VIEnable False CheckAlps False The following is an example of the Show Config Switch command.
ISLMonitoringEnabled True RisingTrigger 2 FallingTrigger 0 SampleWindow 10 LoginMonitoringEnabled True RisingTrigger 5 FallingTrigger 1 SampleWindow 10 LogoutMonitoringEnabled True RisingTrigger 5 FallingTrigger 1 SampleWindow 10 LOSMonitoringEnabled True RisingTrigger 100 FallingTrigger 5 SampleWindow 10 The following is an example of the Show Config Zoning command.
Show Log command Displays the contents of the log or the parameters used to create entries in the log. The log contains a maximum of 200 entries. When the log reaches its entry capacity, subsequent entries overwrite the existing entries, beginning with the oldest. Authority User Syntax show log component level options port settings Keywords component Displays the components currently being monitored for events. level Displays the event severity level needed to create an entry in the log.
Current setting(s) for log port: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 The following is an example of the Show Log command. [327][Wed Jan 25 09:36:54.860 1989][I][Eport:0xdd00b8b6.304.4 Port: 0/8][Eport State = E_A0_GET_DOMAIN_ID] [328][Wed Jan 25 09:36:54.860 1989][I][Eport:0xdd00b8b6.304.4 Port: 0/8][FSPF PortUp state=0] [329][Wed Jan 25 09:36:54.861 1989][I][Eport:0xdd00b8b6.304.4 Port: 0/8][Sending init hello] [330][Wed Jan 25 09:36:54.861 1989][I][Eport:0xdd00b8b6.304.
Show Perf command Displays port performance in frames per second and bytes per second. If you omit the keyword, the command displays data transmitted (out), data received (in), and total data transmitted and received in frames per second and bytes per second.
Examples The following is an example of the Show Perf command.
Show Setup command Displays the current SNMP and system settings. Authority User Syntax show setup mfg snmp system Keywords mfg Displays manufacturing information about the switch. snmp Displays the current SNMP settings. system Displays the current system settings. Examples The following is an example of the Show Setup Mfg command.
Trap1Enabled False Trap2Address 0.0.0.0 Trap2Port 162 Trap2Severity warning Trap2Enabled False Trap3Address 0.0.0.0 Trap3Port 162 Trap3Severity warning Trap3Enabled False Trap4Address 0.0.0.0 Trap4Port 162 Trap4Severity warning Trap4Enabled False Trap5Address 0.0.0.0 Trap5Port 162 Trap5Severity warning Trap5Enabled False ObjectID 1.3.6.1.4.1.1663.1.1.1.1.16 AuthFailureTrap False The following is an example of the Show Setup System command.
Shutdown command Terminates all data transfers on the switch at convenient points and closes the Telnet session. Always power cycle the switch after entering this command. Authority Admin Syntax shutdown Notes Always use this command to effect an orderly shutdown before removing power from the switch. Failure to do so could damage the flash memory and the switch configuration.
Test command Tests switch module ports using internal (SerDes level), external small form-factor pluggable (SFP), and online loopback tests. Internal and external tests require that the switch module port be placed in diagnostic mode. See the “Set Port command” on page 34 for information about changing the port administrative state. While the test is running, the remaining ports on the switch remain fully operational. See “Port testing” on page 117 for more information.
4. Choose one of the two types of port loopback tests to run: • To run an internal loopback test, type the following command: test x internal • To run an external loopback test, type the following command. A loopback plug must be installed for this test to pass. test x external ✏ NOTE The external loopback test can be performed only on external switch module ports. After the test type has been chosen and the command executed, a message on the screen will appear detailing the test results. 5.
Uptime command Displays the elapsed time since the switch was last reset and reset method. Authority User Syntax uptime Examples The following is an example of the Uptime command.
User command Administers or displays user accounts. Authority Admin. The List keyword is available with User authority. Syntax user accounts add delete [account_name] list Keywords accounts Displays all user accounts that exist on the switch. add Add a user account to the switch. After this command is executed, the administrator will be prompted for the information needed to establish the user account. A switch can have a maximum of 15 user accounts.
The following is an example of the User Delete command. FCSM (admin) : user1> user del user3 The user account will be deleted. Please confirm (y/n): [n] y The following is an example of the User List command.
Whoami command Command Displays the account name, session number, and switch domain ID for the Telnet session. Authority User Syntax whoami Examples The following is an example of the Whoami command.
Zone command Manages zones and zone membership on a switch. The Zone command defines members (ports and devices) for a single switch. Zones are members of zone sets. Authority Admin authority and a Zoning Edit session. See the “Zoning command” on page 66 for information about starting a Zoning Edit session. The List, Members, and Zonesets keywords are available with User authority and do not require a Zoning Edit session.
members [zone] Displays all members of the zone given by [zone]. This keyword is available with User authority and does not require a Zoning Edit session. remove [zone] [members] Removes the ports given by [members] from the zone given by [zone]. [members] can have one of the following formats: • Domain ID and port number pair (Domain ID, Port Number). Domain IDs and port numbers are in decimal. Ports are numbered beginning with 0.
wwn_0160ed zone_set_1 wwn_c001b0 zone_set_1 wwn_401248 zone_set_1 wwn_02402f zone_set_1 wwn_22412f zone_set_1 The following is an example of the Zone Members command. FCSM: user1> zone members wwn_b0241f Current List of Members for Zone: wwn_b0241f --------------------------------50:06:04:82:bf:d2:18:c2 50:06:04:82:bf:d2:18:d2 21:00:00:e0:8b:02:41:2f The following is an example of the Zone Zonesets command.
Zoneset command Manages zone sets and zone set membership across the fabric. Authority Admin authority and a Zoning Edit session. See the “Zoning command” on page 66 for information about starting a Zoning Edit session. The Active, List, Zones keywords are available with User authority. You must close the Zoning Edit session before using the Activate and Deactivate keywords.
remove [zone_set] [zone_list] Removes a list of zones and aliases given by [zone_list] from the zone set given by [zone_set]. Zone and alias names are delimited by spaces in [zone_list]. If [zone_set] is the active zone set, the zone will not be removed until the zone set has been deactivated. This keyword requires a Zoning Edit session. rename [zone_set_old] [zone_set_new] Renames the zone set given by [zone_set_old] to the name given by [zone_set_new]. You can rename the active zone set.
Zoning command Opens a Zoning Edit session in which to create and manage zone sets and zones. See the “Zone command” on page 61” and the “Zoneset command” on page 64” for information about managing zone and zone sets. Authority Admin. The List keyword is available with User authority. Syntax zoning active cancel clear edit history limits list restore save Keywords active Displays membership information for the active zone set including member zones and zone members.
Examples The following is an example of the Zoning Edit command. FCSM: user1> admin start FCSM (admin) : user1> zoning edit FCSM (admin-zoning) : user1> . . FCSM (admin-zoning) : user1> zoning cancel Zoning edit mode will be canceled. Please confirm (y/n): [n] FCSM (admin) : user1> admin end The following is an example of the Zoning List command.
Configured Zoning Information ZoneSet Zone ZoneMember -------------------------------wwn wwn_b0241f 50:06:04:82:bf:d2:18:c2 50:06:04:82:bf:d2:18:d2 21:00:00:e0:8b:02:41:2f wwn_23bd31 50:06:04:82:bf:d2:18:c2 50:06:04:82:bf:d2:18:d2 10:00:00:00:c9:23:bd:31 wwn_221416 50:06:04:82:bf:d2:18:c2 50:06:04:82:bf:d2:18:d2 10:00:00:00:c9:22:14:16 wwn_2215c3 50:06:04:82:bf:d2:18:c2 50:06:04:82:bf:d2:18:d2 10:00:00:00:c9:22:15:c3 68 Intel Blade Server Fibre Channel Switch Module SBCEFCSW / FC Expansion Card SBFCM G
Using the SAN Utility You can use the SAN Utility application to access and configure switch modules. For information about installing, uninstalling, and starting the SAN Utility application, see the Fibre Channel Switch Module Installation Guide. The SAN Utility application can be installed on an SBCE blade server or an external network management workstation configured with one of the operating systems described in the Fibre Channel Switch Installation Guide.
The Faceplate window displays the front of a single switch module and its active ports, as shown in Figure 2 Figure 2. Faceplate window Menu bar The menu bar is displayed at the top of the Faceplate window and Topology window. Depending on which window is open, the menu bar has similar menu selections. Figure 3 shows menu items that are available in the Topology window and the Faceplate window.
Some menu selections have shortcut keys as shown in Table 14. Table 14. Menu shortcut keys Shortcut key Menu selection F5 View ” Refresh Ctrl+O File ” Open View File In addition to the menu bar, both the Topology and Faceplate windows have context-sensitive menus that open when you click in the graphic window with the right mouse button. See “Opening the Faceplate window and pop-up menus” on page 76 for more information about these pop-up menus.
Fabric tree The fabric tree, in the FC Fabric pane, lists the managed fabrics and their switch modules. To adjust the window, click and drag the moveable window border. An entry handle to the left of an entry in the tree indicates that you can expand the entry. When you click the handle or double-click the entry, the entry expands to show its member switches. These fabric tree elements are shown in Figure 4 on page 72 Figure 4.
Working status indicator The working status indicator as shown in Figure 1 on page 69 is in the lower-right corner of the Topology window and shows when the network management workstation is exchanging information with the fabric. As conditions change, the fabric forwards this information to the network management workstation where it is reflected in the various displays. Using the Topology window The Topology window shown in Figure 5 polls the selected fabric and displays its topology.
Working with switch modules and links Switch module and link icons are selectable and moveable and serve as access points for other windows and menus. You select switch modules and links to display information, modify configurations, or delete them from the window. The context-sensitive pop-up menus are accessible through the switch module and link icons. Click a switch module or link in the graphic window to display its status in the data window.
Selecting switch modules and links Selected switch module icons are highlighted in violet. Selected ISLs are highlighted in amber. You can select switch modules and links by performing the following tasks: • To select a switch module or a link, click the icon or link. • To select multiple switch modules or links, hold down the Ctrl key and click the switch modules or links that you want. • To select all switch modules or links, right-click in the graphic window background.
Opening the Faceplate window and pop-up menus The Faceplate window shows the front of a single switch module and its ports. You can open the Faceplate window and pop-up menus when you are in the Topology window by performing the following tasks: • To open the Faceplate window when viewing the Topology window, click a switch module entry or icon in the fabric tree, or double-click the switch module graphic.
Opening pop-up menus You can manage the switch module and its ports using the following methods: • To open the pop-up menu, right-click anywhere in the graphic window. If no ports are selected, port specific tasks are unavailable in the menu. • To select one or more ports and open the Port pop-up menu, right-click a port. Faceplate data window tabs The Faceplate Data window contains six tabs at the bottom of the display.
Managing the fabric database A fabric database contains the set of fabrics that you have added during a SAN Utility session. Initially, a Topology window with an empty fabric database opens.
Opening a fabric view file Complete the following steps to open an existing fabric view file: 1. 2. 3. 4. In the Faceplate window, click File / Open View File, or click the Open icon. If there is a change to the fabric you are using, you are prompted to save the changes to the view file before opening a different view file. The Open View window opens. In the Open View window, type the name of the file you want to open. Type a file password if necessary. Click Load View File.
6. 7. Connect the Fibre Channel devices to the switch module. In the Edit Zoning window, make the necessary zoning changes. Replacing a failed switch module in a fabric Complete the following steps to replace a failed switch module for which an archive is available. See “Restoring a switch module” on page 121 and “Archiving a switch module” on page 102 for more information. 1. Remove the failed switch module. For more information, see the Installation Guide. 2. 3.
displayed on the right side of the switch. A green Ethernet icon indicates normal operation, amber indicates operational with errors, and red indicates inactive or failure. Table 17 on page 81 shows the different switch module icons and their descriptions. ✏ NOTE Different switch module icons are displayed depending on the different switch vendor products presented in the attached fabric.
Active Zoneset Data window The Active Zoneset Data window displays the zone membership for the active zone set that resides on the fabric management switch. The active zone set is the same on all switch modules in the fabric. You can confirm this by adding a fabric through another switch module and comparing Active Zone Set displays. To open the Active Zoneset Data window, click the Active Zoneset tab below the data window in the Topology window.
Zones A zone is a named group of ports or devices that can communicate with each other. Membership in a zone is defined by port number, device Fibre Channel address, or device World Wide Name (WWN). Zone members can communicate only with members of the same zone. Zones can overlap; that is, a port or device can be a member of more than one zone. There are three zone types that are supported but have restrictive levels of communication.
Zone sets A zone set is a named group of zones. A zone can be a member of more than one zone set. All zones that are not members of a zone set belong to the orphan zone set. The orphan zone set is saved to the switch module. Each switch module in the fabric maintains its own zoning database containing one or more zone sets. This zoning database resides in nonvolatile or permanent memory and is therefore retained after a reset.
Using the Zoning Config window Use the Zoning Config window to change the Auto Save and Default Visibility configuration parameters. Complete the following steps to open the Zoning Config window and change configuration parameters: 1. In the Faceplate window, click Zoning / Edit Zoning Config.The Zoning Config window opens. Figure 10. Zoning Config window 2. Make the necessary changes to the Auto Save and Default Visibility fields and click OK.
Zone merge failure recovery When a zone merge failure occurs, the conflict that caused the failure must be resolved. You can correct a failure due to a zone conflict by deactivating one of the active zone sets or editing the conflicting zones so that their membership is the same. You can deactivate the active zone set on one switch module if the active zone set on the other switch accurately defines your zoning needs. If not, you must edit the zone memberships and reactivate the zone sets.
The following table explains the toolbar buttons and functions. Table 18. Edit Zoning window toolbar buttons Toolbar button Function Create a new zone set. Create a new zone. Create an additional name for a set of objects. Add the selected zone to a zone set, or add the selected port to a zone. Delete the selected zone from a zone set, or delete the selected port from a zone.
Creating a zone set Complete the following steps to create a zone set: 1. In the Faceplate window, click Zoning / Edit Zoning. The Edit Zoning window opens. 2. Click Edit / Create Zone Set. The Create Zone Set window opens. 3. Type a name for the zone set, and click OK. The new zone set name is displayed in the Zone Sets window. Complete one of the following tasks to create new zones in a zone set: 4. • • 5. Right-click a zone set and select Create A Zone from the pop-up menu.
Removing a zone set Removing a zone set from the database affects the member zones in the following ways: • Member zones that are members of other zone sets are not affected. • Member zones that are not members of other zone sets become members of the orphan zone set. The orphan zone set is saved on the switch module. Complete the following steps to remove a zone set from the database: 2. In the Faceplate window, click Zoning / Edit Zoning. The Edit Zoning window opens.
✏ NOTE 4. 5. If you type the name of a zone that already exists in the database, the SAN Utility will create a copy of that zone and its membership in the zone set. Use one of the following methods to add ports or devices to the zone: • In the zone set tree, select the zone set. In the graphic window, select the port to add to the zone. Click Edit / Add Members. • Select a port by port number, Fibre Channel address, or worldwide name in the Port or Device tree, and drag it into the zone.
Removing a zone from all zone sets Complete the following steps to delete a zone from all zone sets: 1. In the Edit Zoning window, select the zone to be removed 2. Click Edit / Remove Zone from All Sets. 3. Click OK to save the changes and close the Edit Zoning window. Changing zone types Zones that are no longer members of any zone set are moved to the orphan zone set. The orphan zone set is saved on the switch module. Complete the following steps to change a zone type: 1.
1. 2. In the right pane of the Faceplate window, click and hold down the mouse button on the member to be added to the alias. Drag the selected member from the right pane to the alias in the left pane. Complete the following steps to add a member to an alias using the menu options: 1. Click Zoning / Edit Zoning. The Edit Zoning window opens. 2. In the left pane of the Edit Zoning window, select an alias. 3. In the right pane, select the member to add to the selected alias. 4.
Figure 12. Faceplate data window A fabric updates the Topology and Faceplate windows by forwarding changes in status to the network management workstation as they occur. You can use the fabric to update the switch module status, or you can refresh the switch status at any time. To refresh a switch module status that is displayed, use one of the following actions: • Click Refresh. • • Click View / Refresh. Press the F5 key. • Right-click a switch module in the Topology window and click Refresh Switch.
Table 19. Name server data window entries (continued) Entry Description NWWN Node worldwide name PWWN Port worldwide name Vendor Host bus adapter and device vendor FC-4 types Device Fibre Channel protocol types Active zones Zones in the current active zone set that contains the device Switch Data window The Switch Data window displays current network and switch module information for the selected switches.
Table 20.
Port Statistics Data window The Port Statistics Data window displays port performance data for the selected ports. To open the Port Statistics Data window, click the Port Stats tab below the data window in the Faceplate window. For a description of the Port Statistics Data window entries, see Table 28 on page 106. The Statistics menu is accessible in the Port Statistics Data window, and provides different ways to view detailed port information. Click the down arrow to open the Statistics menu.
Managing alarms You can configure the switch module to generate and log alarms. To display the Alarm Log, click the Alarm Log tab in the Faceplate window. For information about the alarm log, see “Alarm Log Data window.” You can also export the alarm log to a file in XML format. Configuring alarms Configuring an alarm involves choosing an event type, rising and falling thresholds, a sampling interval, and then enabling or disabling the alarm. Complete the following steps to configure an alarm: 1.
Exporting alarm log information to a file Complete the following steps to save the switch module alarm log to a file: 1. 2. In the Faceplate window, click Switch / Export Alarm Log. Type a file name in the Save window. 3. Click Save. Exporting name server information to a file Complete the following steps to save switch module name server information to a file: 1. 2. In the Topology window, click Switch / Export Name Server. Type a file name in the Save window. 3. Click Save.
Figure 15. Switch Properties window Symbolic name The symbolic name is a user-defined name that identifies the switch module. Switch module administrative state The switch module administrative state determines the operational state of the switch and its ports. The switch module administrative state exists in two forms: the configured administrative state and the current administrative state.
on page 26 for information about the switch module keyword and the Domain ID Lock and Principal Priority parameters. If you connect a new switch module to an existing fabric with its domain ID unlocked and a domain conflict occurs, the new switch module will be isolated as a separate fabric. However, you can remedy this by resetting the new switch module or taking it offline then back online. The principal switch module will reassign the domain ID, and the switch will join the fabric.
✏ NOTE The Read Community, Trap Community, and Write Community settings are like passwords; therefore, they are write-only fields. The current settings are not displayed. Figure 16. Network Properties window IP configuration The IP configuration identifies the switch module on the Ethernet network and determines which start (boot) method to use. Start methods described in the following table are for external and internal ports. Table 23 describes the IP configuration parameters. Table 23.
To save log information to a remote host, you must edit the syslog.conf file and then restart the syslog daemon. The syslog.conf file on the remote host must contain an entry that specifies the name of the log file in which to save error messages. Add the following line to the syslog.conf file: local0.info /var/adm/messages.name Use to separate the selector field (local0.info) and action field, which contains the log file path name (/var/adm/messages/messages.name).
1. 2. In the Faceplate window, click Switch / Firmware Fallback. The Firmware Fallback window displays the file name of the current firmware and the fallback firmware versions. Click Yes to select the fallback firmware or No to cancel. 3. The SAN Utility prompts you to reset the switch module. Click OK to reset the switch and activate the new fallback firmware.
Displaying port modes To display port mode status, from the Faceplate window, click View / View Port Modes. Table 24 on page 104 lists the available port modes and their descriptions. Table 24.
Displaying SFP module media status To display SFP module media status, click View / View Port Media. Table 27 on page 105 lists and describes the available media states. Table 27. SFP module media view Media icon Description The SFP module is online (green) The SFP module is offline (gray) None The port is empty; no SFP module is detected or installed Port graphing and Fabric View application You can use the Fabric View application to view port performance as graphs.
Port Statistics Data window The Port Statistics Data window displays statistics about port performance. To open the Port Statistics Data window, select one or more ports in the Faceplate window and click the Port Stats tab in the data pane of the Faceplate window. Table 28 describes the Port Statistics Data window entries. See Table 37 on page 124 for information about port numbering and mapping. The Statistics menu is available on the Port Statistics Data window.
Table 28. Port Statistics Data window entries (continued) Entry Description Decode Error Count Number of invalid transmission words detected during decoding. Decoding is from the 10-bit characters and special K characters. Loss Of Sync Count Number of synchronization losses (>100 ms) detected by this port. A loss of synchronization is detected by receipt of an invalid transmission word. Invalid CRC Count Number of invalid CRC frames detected.
Port Information data window The Port Information data window displays port detail information for the selected port. To open the Port Information data window, click the Port Info tab below the data window in the Faceplate window. Table 29. Port Information Data window entries Entry Description Port Address Port Fibre Channel address. Administrative Port Mode The current administrative port mode: GL, G, FL, F, TL. Operational Port Mode The operational port mode.
The buffer credit flow control mechanism provides a way to ensure full use of the media, regardless of length, by providing for frame streaming. With frame streaming, the sender can transmit as many frames as there are credits without having to wait for a response to one frame before transmitting the next frame. The media can then be continuously in use at its rated capacity.
Figure 19. Internal Port Properties window Changing port administrative states The Port Administrative state determines the operational state of a port. The port administrative state exists in two forms: the configured administrative state and the current administrative state. The Configured Administrative state is the state that is saved in the switch module configuration and is preserved across switch module resets. The SAN Utility always makes changes to the configured administrative state.
Table 30. Port administrative states State Description Online Activates and prepares the port to send data. Offline The port cannot receive a signal or accept a device login. Test Prepares a port for testing and prevents the port from accepting a device login. Changing port speeds (external ports only) The switch module external ports (0,15) are capable of transmitting and receiving at 1 Gbps or 2 Gbps.
Table 32. Port modes (continued) State Description TL_Port Translated loop port - Supports a loop of up to 124 private target devices or 125 private initiator devices capable of communicating with up to 63 off-loop initiator devices or 64 off-loop target devices. G_Port Generic port - Self-discovers as an F_Port or an E_Port. GL_Port Generic loop port - Self-discovers as an F_Port, FL_Port, or an E_Port. Donor Donor port - Allows buffer credits to be used by another port.
1. In the Faceplate window, select the ports that are to serve as donor ports. Click Port / Port Properties. In the Port Properties window, click Donor / OK. ✏ NOTE 2. Donor ports are incapable of transmitting or receiving data. In the Faceplate window, select the recipient port. Recipient ports must be external ports configured as G_Ports or F_Ports. Click Port / Extended Credits. The Extended Credits window opens as shown in Figure 20 Figure 20. Extended Credits window 3. 4.
To run an internal, external, or online port loopback test on an external port, see “Port testing” on page 117. Switch management utility functions This chapter contains information about the following topics: • LED diagnostics • Port testing • Fibre Channel switch module monitoring using SNMP • Restoring Fibre Channel switch module configuration defaults • Using the Fabric View application LED diagnostics The Fibre Channel switch module performs a POST as part of its power-on procedure.
Figure 21. Switch module LEDs Heartbeat LED patterns The heartbeat LED uses different flash patterns to indicate the following conditions: • Normal • Internal firmware failure • Fatal error • Configuration file system error Normal (all pass) LED flash pattern If POST diagnostics pass and the switch module processor is operating correctly, the switch will go to normal operation, and the heartbeat LED will flash at a steady rate of one flash per second.
Configuration file system error LED flash pattern A configuration file system error flash pattern is four flashes per second followed by a 2-second pause, as shown in the following illustration. The four-flash error pattern indicates that a configuration file system error has occurred. Switch module fault LED flash pattern The amber Switch Fault LED is lit to indicate one or more of the following conditions: • POST failure • Over temperature condition • Port operational test failure.
Table 33. E-port isolation causes and fixes Isolation cause Fix Two switch modules in the same fabric have the same domain ID Correct the domain IDs on the malfunctioning switch modules. Domain IDs are decimal numbers in the range from 1 to 239. Domain IDs must be unique. All switch modules in the fabric do not have the same timeout values Correct the timeout values on the malfunctioning switch modules.
Figure 22. Port Loopback Test window ✏ NOTE The internal SerDes and external SFP level tests disrupt communication on the selected port. The online node-to-node level test does not disrupt communication, because it requires that the port is online. Complete the following steps to run the internal, external, or online port loopback test on an external port: 1. In Faceplate window, select the external port to be tested. 2. 3. 4. 5. Click Port / Port Loopback Test. The Port Loopback Test window opens.
Table 34. SNMP configuration parameters Parameter Description Contact Specifies the name of the person to contact for trap events. The default is undefined. Read community Read Community Authentication. A write-only field; the value on the switch module and the SNMP management server must be the same. The default value is Public. Trap community Trap Community Authentication. A write-only field; the value on the switch module and the SNMP management server must be the same.
Configuration backup Changes made to the switch module since it was manufactured can be saved to a file in nonvolatile memory. However, the backup file is lost if the switch module is reset. Use the File Transfer Protocol (FTP) user images procedures to save the configdata file to the network management workstation. (In FTP, no directory listing is available. The configuration backup file is always named configdata.
Table 36. Factory default configuration settings (continued) Settings Port mode Value GL - external; F - internal Reinitializing the configuration file system If the heartbeat LED on the switch module is showing the four-flash pattern, the configuration file system might be damaged. To recover the factory switch module configuration, use the Config Restore Telnet command. The heartbeat LED four-flash pattern continues until a previous switch module configuration is successfully restored.
Figure 23. Fabric View graphs Starting the Fabric View application To start Fabric View using the SAN Utility, open the Faceplate window and click Start Fabric View from the Switch menu. Displaying port performance graphs Complete the following steps to display port performance graphs: 1. Click Fabric and select Add Fabric or click the Add button. Type a fabric name and an IP address in the Add a New Fabric window. Include a login name and a password if required. 2.
Customizing port performance graphs You can customize the graph polling frequency, what is plotted in the graphs, and the graph color scheme. Complete the following steps to customize the port performance graphs: 1. To set the polling frequency for all graphs, click Graph and click Set Polling Frequency. 2. Type an interval, in seconds (0 through 60), and click OK. 3. To select what is to be plotted, click Graph and click Options. The Modify Graph Display window opens. Figure 24.
Mapping port locations and software numbering Your switch module has two external Fibre Channel ports (external Fibre Channel port 1 and external Fibre Channel port 2) and 14 internal Fibre Channel ports that connect to each of the 14 blade server bays (ports 1 to 14). The SAN Utility and CLI for the switch module require port numbering from 0 to 15. The SNMP monitoring agent for the switch module numbers the ports from 1 to 16.
3 Intel® Server FC Expansion Card SBFCM This Hardware Maintenance Manual and Troubleshooting Guide contains instructions for installing your Fibre Channel Expansion Card in a blade server. This publication contains information about: • Installing and configuring the Expansion Card • Updating the BIOS code and device drivers of the Expansion card The Fibre Channel Expansion Card is a 2 Gb Fibre Channel device that has two configurable adapter ports.
Humidity • Blade server on: 8% to 80% • Blade server off: 5% to 80% Table 38. Expansion Card specifications Type Specification Expansion card bus Supports subset of PCI local bus specification, revision 2.2 and the PCIX specification 1.0a PCI/PCI-X signaling environment Supports 3.3 V only PCI/PCI-X transfer rate The burst transfer rate is based on the input clock speed multiplied by the number of bytes (8).
Inventory checklist The SBFCM Expansion Card option package contains the following items: • SBCFM Expansion Card • I/O expansion option tray Notices and statements used in this book The caution and danger statements used in this book are also in the multilingual Intel Server Boards and Server Chassis Safety Information book provided on the SBCEFCSW Resource CD. The following types of notices and statements are used in this book: • Note: These notices provide important tips, guidance, or advice.
Figure 25. Expansion Card (top) ISP2312 chip (U5): The ISP2312 chip provides a PCI-X local bus interface and two completely independent 2 Gb serial Fibre Channel ports. Each port has a RISC processor, an integrated serializer/deserializer (SERDES), a receive DMA sequencer, frame buffer, five-channel DMA controller, and an external memory interface in a single-chip solution.
The following illustration shows the components on the bottom of the Expansion Card. Figure 26. Expansion Card (bottom) PCI-X connector (J3): This connector is a 64-bit PCI-X interface with a 200-pin board-to-board connector that is connected to the blade server. Fibre Channel high-speed connector (J2): Communication signals are routed from the blade server through the Fibre Channel high-speed connector on the Expansion Card to switch-module bay 3 and bay 4 in the Blade Server Chassis SBCE.
Handling static-sensitive devices Attention: Static electricity can damage electronic devices, including your blade server. To avoid damage, keep static-sensitive devices in their static-protective packages until you are ready to install them. To reduce the possibility of damage from electrostatic discharge, observe the following precautions: • Limit your movement. Movement can cause static electricity to build up around you. • Handle the device carefully, holding it by its edges or its frame.
Figure 27. Fibre Channel Switch Module Locations 4. If the blade server is operating, press the power-control button (behind the blade server control panel door) to shut down the operating system and turn off the blade server. For the location of the control panel door, see the illustration on page 132 Wait at least 30 seconds, until the drives stop spinning, before proceeding to the next step. 5. Open the two release levers. The blade server moves out of the bay approximately 0.6 cm (0.25 inch). 6.
10. If an IDE hard disk drive is in IDE connector 2, remove the drive and tray (save the screws that secure the tray to the system board); otherwise, remove the two screws near IDE connector 2 that secure the system board to the chassis. 11. Install the I/O expansion option tray, which comes with the Expansion Card. Secure the tray to the system board using a Phillips* screwdriver and the screws from the option kit.
Figure 28. I/O expansion option tray 12. Remove the Expansion Card from the static-protective package. 13. Slide the narrow end of the Expansion Card into the raised hook on the tray. 14. Align the Expansion Card connectors with the network-interface option connector and the PCI-X expansion slot. 15. Gently press the card into the connectors.
Figure 29. Important: The blade server cannot be inserted into the Blade Server Chassis SBCE until the cover is installed and closed. Do not attempt to override this protection. 16. Lower the cover so that the slots at the rear slide down onto the pins at the rear of the blade server, as shown in the illustration. 17. Pivot the cover to the closed position as shown in the illustration, until it clicks into place.
18. 19. 20. 21. Hazardous energy is present when the blade is connected to the power source. Always replace the blade cover before installing the blade. Ensure that the release levers on the blade server are in the open position (perpendicular to the blade server). Slide the blade server into the bay until it stops. The spring-loaded doors that are further back in the bay and cover the bay opening move out of the way as you insert the blade server into the Blade Server Chassis SBCE.
Using Fast!UTIL This chapter provides detailed configuration information for advanced users who want to customize the configuration of the Expansion Card. You can configure the expansion card using the Fast!UTIL utility. Starting Fast!UTIL Start or restart the blade server. On the blade server control panel, press the keyboard/video/mouse select button.To access Fast!UTIL, press Ctrl+Q during the expansion card BIOS initialization (it might take a few seconds for the Fast!UTIL menu to be displayed).
Host adapter BIOS: When this option is disabled, the read-only memory (ROM) BIOS code on the Expansion Card is disabled, freeing space in upper memory. The default is Disabled. Frame size: This setting specifies the maximum frame length supported by the Expansion Card. The default size is 2048. If you are using F-port (point-to-point) connections, use the default size for maximum performance. Spin up delay: When this option is enabled, the BIOS code waits up to 5 minutes to find the first drive.
Raw NOVRAM data This option displays the Expansion Card NVRAM contents in hexadecimal format. This is a troubleshooting tool; you cannot modify the data. Advanced Adapter Settings Use this option to view and set advanced adapter settings. The default settings for the Expansion Card are listed in Table <$elemparanumonly138 and are described in this section. Table 41.
Extended error logging: When set to Enabled, this setting provides additional error and debugging information to the Windows operating system event error log. The default is Disabled. Extended Firmware Settings Use this option to view and set extended firmware settings. The default settings for the Expansion Card are listed in Table <$elemparanumonly139 and are described in this section. Table 42.
Fibre Channel tape support: This setting is reserved for Fibre Channel tape support. The default is Disabled. Interrupt delay timer: This setting contains the value (in 100-microsecond increments) used by a timer to set the wait time between accessing a set of handles and generating an interrupt using direct memory access (DMA). The default is 0. Data rate: This setting determines the data rate. The default setting is 2. Table 45.
4 Diagnostic information If you are having a problem, use the following information to help you determine the cause of the problem and the action to take. General Fibre Channel configuration diagram Refer to the following diagram and note the differences between a SBCEFCSW Fibre Channel installation and other Fibre Channel installations: Figure 31. High level Fibre Channel architecture The Expansion Card contains two virtual adapters on a single card.
Use the following procedure to checkout the Expansion Card and Fibre Channel Switch module. 1. Run the SAN utility to verify the Fibre Channel Switch Modules are functioning correctly. 2. Use management utilities supplied by the manufacturer to verify the attached Fibre Channel devices are functioning correctly. Hardware problems To determine whether your installation problem is caused by the hardware, perform the following tasks: 1. Verify any recent hardware changes. 2.
Fibre channel problems To determine whether your installation problem is caused by an attached Fibre Channel device, perform the following tasks: 1. Verify that all the Fibre Channel devices were turned on before you turned on the blade server. 2. Ensure that all cables are connected properly. 3. Verify that you configured your RAID storage subsystem using the utilities provided by the manufacturer 4.
144 Intel Blade Server Fibre Channel Switch Module SBCEFCSW / FC Expansion Card SBFCM Guide
5 Symptom-to-FRU index This index supports the Fibre Channel Switch Module and Fibre Channel Expansion Card. Notes: 1. 2. 3. Check the configuration before you replace a FRU. Configuration problems can cause false errors and symptoms. For devices not supported by this index, refer to the manual for that device. Blade switch modules and management modules must be replaced during service within two minute. The symptom-to-FRU index lists symptoms, errors, and the possible causes.
Fast!UTIL utility status codes You can use the following information to find solutions to problems that have definite symptoms. Attention: If diagnostic status messages appear that are not listed in the following tables, make sure that your Blade Server Chassis SBCE has the latest level of firmware code installed. If you have just added a new option and your system is not working, complete the following procedure before using the troubleshooting charts: 1. Remove the option that you just added. 2.
✏ NOTE See Chapter 6, “SBCEFCSW / SBFCM Parts listing,” on page 153 to determine which components should be replaced by a field service technician. Message Action Switch module x was installed Information only. Take action as required. Switch module x was powered on Information only. Take action as required. Switch module x was powered on Information only. Take action as required. Switch System running nonredundant switch modules Information only. Take action as required.
Management module error messages ✏ NOTE See Chapter 6, “SBCEFCSW / SBFCM Parts listing,” on page 153 to determine which components should be replaced by a field service technician. Message 148 Action Application posted alert to ASM The alert button on the web interface was tested. Information only. Take action as required. System log 75% full Information only. Take action as required. System log full Information only. Take action as required.
Switch diagnostic information The following LED error codes, I2C diagnostic register definitions, and alarms support the Fibre Channel Switch Module. LED error codes ✏ NOTE See Chapter 6, “SBCEFCSW / SBFCM Parts listing,” on page 153 to determine which components should be replaced by a field service technician.
✏ NOTE See Chapter 6, “SBCEFCSW / SBFCM Parts listing,” on page 153 to determine which components should be replaced by a field service technician. Failures Action 0x80 - Internal port failure 0xa0 - External port failure ✏ NOTE See Chapter 6, “SBCEFCSW / SBFCM Parts listing,” on page 153 to determine which components should be replaced by a field service technician. Alarms Action Compromised failure (single port failure) POST has detected a partial failure. Use "show post log" for more information.
5. Disconnect the switch modules one at a time. To do this, remove all cables connected to the switch module; then, pull the release lever all the way down. Slide the switch module out of the bay approximately 1 inch. ✏ NOTE • • • The minimum configuration is: unit (media tray may be connected). power module in bay 1. management module.
✏ NOTE 1. 2. 3. 4. 5. 6. 7. 8.
6 SBCEFCSW / SBFCM Parts listing This parts listing supports the Blade Server Switch Module SBCEFCSW and Fibre Expansion Card SBFCM. ✏ NOTE Field replaceable units (FRUs) should be serviced only by qualified field service technicians. Customer replaceable units can be replaced by the customer.
Intel® Blade Server Fibre Channel Expansion Card SBFCM Option SBCFM Expansion Card 154 Intel Blade Server Fibre Channel Switch Module SBCEFCSW / FC Expansion Card SBFCM Guide CRU/FRU CRU
A Getting help and technical assistance If you need help, service, or technical assistance or just want more information about Intel products, you will find a wide variety of sources available from Intel to assist you. This appendix contains information about where to go for additional information about Intel and Intel products, what to do if you experience a problem with your Blade Server Chassis SBCE, and whom to call for service, if it is necessary.
156 Intel Blade Server Fibre Channel Switch Module SBCEFCSW / FC Expansion Card SBFCM Guide
