RS/6000 SP IBM SP Switch2 Service Guide GA22-7444-03
RS/6000 SP IBM SP Switch2 Service Guide GA22-7444-03
Note! Before using this information and the product it supports, read the information in “Safety and environmental notices” on page ix and “Notices” on page A-1. Fourth edition (April 2002) IBM welcomes your comments.
Contents Figures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . v Tables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii Safety and environmental notices . Safety notices (in English) . . . . Danger notices. . . . . . . . Caution notices . . . . . . . Laser safety information . . . . Environmental notices . . . . . . Product recycling and disposal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Removing and restoring switch resources . . . . . . . . Removing an SP Switch2 from the active configuration . . Restoring an SP Switch2 to the active configuration . . . Using Perspectives to fence and unfence nodes attached to Service position procedures . . . . . . . . . . . . . Placing an SP Switch2 into service position . . . . . . Replacing an SP Switch2 from service position . . . . . Resetting the clock and bootlist after servicing a node . . . Running diagnostics on a switch port . . . . . . . . .
Figures 1-1. 1-2. 1-3. 2-1. 2-2. 2-3. 2-4. 2-5. 2-6. 2-7. 2-8. 4-1. 4-2. 4-3. 4-4. 4-5. 4-6. SP Switch2 Assembly High-Level Diagram . . . . . . . . . . . . . . . . . . . SP Switch2 Wrap Plugs . . . . . . . . . . . . . . . . . . . . . . . . . . SP Switch2 Chassis Assembly . . . . . . . . . . . . . . . . . . . . . . . Front view of frame locations . . . . . . . . . . . . . . . . . . . . . . . . Front view of multi-switch frame locations . . . . . . . . . . . . . . . . . . . Rear view of frame locations . . .
vi RS/6000 SP: SP Switch2 Service Guide
Tables 1-1. 1-2. 1-3. 1-4. 1-5. 1-6. 1-7. 1-8. 1-9. 2-1. 2-2. 3-1. 3-2. 3-3. 3-4. 5-1. 5-2. 5-3. 5-4. 5-5. 5-6. 5-7. Switch Problem Diagnostics . . . . . . . . . . . . SP Switch2 supervisor LED indications . . . . . . . . Perspectives SP Switch2 status indicators . . . . . . . Fan Failure Diagnostics . . . . . . . . . . . . . Power supply failure diagnostics . . . . . . . . . . SP Switch2 error conditions . . . . . . . . . . . . Problem from the out.top file . . . . . . . . . . .
viii RS/6000 SP: SP Switch2 Service Guide
Safety and environmental notices Safety notices (in English) For general information concerning safety, refer to Electrical Safety for IBM Customer Engineers (S229-8124). For a copy of this publication, contact your IBM marketing representative or the IBM branch office serving your locality. The following is a list of all safety notices (in English only) pertaining to SP hardware maintenance tasks from this and other RS/6000 SP hardware publications.
Before you connect the power cable of this product to ac power, verify that the power receptacle is correctly grounded and has the correct voltage. (SPSFD004) DANGER During an electrical storm, do not connect or disconnect any cable that has a conductive outer surface or a conductive connector. (SPSFD005) DANGER Switch off power and unplug the machine power cable from the power receptacle, before removing or installing any part that is connected to primary power.
DANGER The frame main circuit breaker and the controller must not be switched on again now. Before disconnecting the power cables from the power receptacles, ensure that the customer’s branch distribution circuit breakers (customer power source circuit breakers) are Off and tagged with DO NOT OPERATE tags, S229-0237. Refer to “Lockout safety procedures” in RS/6000 SP: System Service Guide, before proceeding.
CAUTION: Due to weight of each thin node (under 18 Kg [40 lbs]), use care when removing and replacing thin nodes above shoulder height. (SPSFC005) CAUTION: The wide node weight may exceed 32 Kg (70.5 lbs). (SPSFC006) CAUTION: Do not open more than one wide node or switch assembly drawer at a time. (SPSFC007) CAUTION: Make sure the stability foot and wheel chocks are installed on the frame. These are required to maintain frame balance and position during service operations.
CAUTION: When using step ladder or step stool, be sure that the work surface is level and the step ladder or step stool is in good working order. (SPSFC016) CAUTION: Portable ladders present a serious safety hazard if not used properly. Follow these general guidelines: v v v v Make sure the ladder is firm and steady, and has no defective rungs or braces. Work only on a level surface. Never use a metal ladder near electrical power lines. Never overreach. Instead, move the ladder.
xiv RS/6000 SP: SP Switch2 Service Guide
About this book This book covers the SP Switch2 only. Refer to RS/6000 SP: SP Switch Service Guide, GA22-7443 for information related to the SP Switch.
User’s responsibilities Before calling IBM® for service, the system administrator should use the problem determination section of the Parallel System Support Programs for AIX®: Diagnosis Guide (GA22-7350), for initial problem determination. If there is nothing wrong with the customer operating procedures, customer-supplied cables, or the power source, the customer should then call IBM for service. How to use this book This book is intended for RS/6000 SP product-trained service personnel.
Chapter 1. Maintenance Analysis Procedures (MAPs) This chapter provides information for identifying problems and guides you to the most likely failed Field Replaceable Unit (FRU). The MAPs then refer you to the FRU Removal/Replacement procedures for the corrective action.
Switch Description and Problem Determination (MAP 0590) Switch Connection Types Standard Node Processor nodes in 9076 SP frames are attached to the switches with switch cables. Switch-to-Switch Connections between switches. Switch Assembly Description SP Switch2 Each switch chip has its own clock and all clocks communicate through the switch data cables. Each switch provides a maximum of 16 switch-to-node ports and 16 switch-to-switch ports.
Switch Description and Problem Determination (MAP 0590) Figure 1-1. SP Switch2 Assembly High-Level Diagram There are two LEDs on the front of each switch assembly. For quick reference, their definitions are as follows: Chapter 1.
Switch Description and Problem Determination (MAP 0590) Yellow (Environment) LED Off No environmental problems detected by switch supervisor card. On Warning of environmental condition out of nominal range. Preventative Maintenance should be scheduled for this switch. Flashing Serious environmental condition detected; power shut off. Green (Power) LED Off No 48 V dc power available at switch assembly. Flashing Power available at switch assembly, but switch logic is Off.
Switch Description and Problem Determination (MAP 0590) Note: In a frame with processor nodes, entries for the switch will refer to “node17” or “slot17”. In a multi-switch frame, switches will be listed as even slot addresses. Figure 1-2. SP Switch2 Wrap Plugs Notes: 1. SP Switch2 advanced diagnostics use the 8.75 meter data cable provided by the SPS feature bill of material. 2. Advanced cable wrap tests will not run successfully for 10-, 15-, and 20-meter SPS data cables.
Switch Description and Problem Determination (MAP 0590) Table 1-1. Switch Problem Diagnostics (continued) Priority 2 (2 of 4) 3 (3 of 4) 4 (4 of 4) Message or condition Action Go to “Switch environment (MAP 0600)” on Environmental problems page 1-9.
Switch supervisor communications (MAP 0595) Table 1-2. SP Switch2 supervisor LED indications (continued) Green LED Yellow LED Indication Flashing Flashing Defective supervisor card (replace card) Note: For this indication, the green and yellow LEDs are flashing alternately. Step 0595-001 Perspectives indicates that a power problem exists and the yellow LED on the SP Switch2 supervisor is On and it is not flashing. 1. Perform the “SP Switch2 supervisor self-test” on page 3-6.
Switch supervisor communications (MAP 0595) Step 0595-006 The supervisor self-test failed because the yellow LED flashed the wrong address. 1. Make certain that the correct supervisor harness connector is plugged into the supervisor. 2. Is the correct harness plugged in? v If yes, go to the Start MAP (0100) in the RS/6000 SP: System Service Guide and troubleshoot the supervisory bus system. v If no: a. Plug in the correct supervisor connector. b.
Switch environment (MAP 0600) Switch environment (MAP 0600) Purpose of this MAP This MAP provides diagnostic information for switch problems that are related to the operating environment. Note: Refer to “Service position procedures” on page 3-10 for placing a switch into the service position or for removing the switch from the service position. Step 0600-001 A switch environmental problem has been detected. 1.
Switch environment (MAP 0600) Step 0600-004 Perspective display shows ″Fan X: Failure″ on a red background. 1. Use Table 1-4 to service components 2. Refer to Chapter 4, “FRU removals and replacements” on page 4-1 for instructions about the component being serviced. Table 1-4. Fan Failure Diagnostics Priority 1 Component Action Fan 1, 2, 3, or 4 a. Check specified fans for blockages or loose connections. (1 of 6) b. Fix any obvious problems and continue at “Step 0600-005” on page 1-11. c.
Switch environment (MAP 0600) Figure 1-3. SP Switch2 Chassis Assembly Step 0600-005 You performed the recommended action in Table 1-4 on page 1-10. 1. Component replaced or reseated. 2. Check the yellow switch supervisor LED for an On or flashing condition. 3. Is the yellow switch supervisor LED On or flashing? v If yes, return to “Step 0600-004” on page 1-10 and continue service with the next highest priority. v If no, go to “Step 0620-021” on page 1-27.
Switch environment (MAP 0600) Step 0600-007 You are here for one of the following reasons: v An over temperature condition exists v You fixed an obvious airflow blockage or removed a high temperature source near the air intakes v A problem with the switch supervisor card sensors may exist For any of the reasons listed above: 1. Perform “SP Switch2 supervisor self-test” on page 3-6. 2. Does the card pass self-test? v If yes, go to “Step 0600-008”. v If no, replace the switch supervisor card.
Switch environment (MAP 0600) 3. Is the yellow switch supervisor LED On or flashing? v If yes, return to “Step 0600-010” on page 1-12 and continue service with the next highest priority. v If no, go to “Step 0620-021” on page 1-27. Switch power (MAP 0610) Purpose of this MAP This MAP provides diagnostic steps for resolving problems related to SP Switch2 power. Note: Refer to “Service position procedures” on page 3-10 for placing the switch into the service position or removing it from the service position.
Switch power (MAP 0610) Step 0610-004 The green switch supervisor LED is Off. 1. Make certain that the switch power cable is properly connected to jack J1 on the switch and on the SEPBU. 2. Place the inline switch on the switch power cable into the On (‘1’) position if it is not already in that position. 3. Place the switch circuit breaker into the On (‘1’) position if it is not already in that position. 4. Does the switch circuit breaker trip to the Off (‘0’) position? v If yes, go to “Step 0610-005”.
Switch power (MAP 0610) Step 0610-009 The switch circuit breaker no longer trips to the Off (‘0’) position when a fan/power supply pair is removed. 1. Reinstall the power supply into the switch. 2. Check circuit breaker. 3. Does the circuit breaker still trip? v If yes, go to “Step 0610-010”. v If no, go to “Step 0610-011”. Step 0610-010 A power supply caused the circuit breaker to trip. 1. Replace the power supply. 2. Return to “Step 0610-004” on page 1-14 to verify the replacement.
Switch power (MAP 0610) 3. If all interposers have been tested, go to “Step 0610-004” on page 1-14. Step 0610-017 You tested all interposers and the circuit breaker still trips. 1. Replace the circuit breaker assembly. 2. Check the circuit breaker. 3. Does the circuit breaker still trip? v If yes, go to “Step 0610-018”. v If no, return to “Step 0610-004” on page 1-14 to verify fix. Step 0610-018 You replaced the circuit breaker assembly but the circuit breaker still trips. 1. Replace the switch planar. 2.
Switch power (MAP 0610) Step 0610-022 The switch’s front panel power LED remained Off after replacing the LED power extension cable. 1. Replace the switch planar. v Refer to “Removing the switch planar” on page 4-7 and “Replacing the switch planar” on page 4-8 2. Is the front panel power LED On? v If yes, go to Switch function (MAP 0620), “Step 0620-021” on page 1-27 and return the switch to the active configuration. v If no, call the next level of support.
Switch Function (MAP 0620) You should receive a message indicating successful initialization. If you receive any other message, consult the “Diagnosing SP Switch2 Problems” section of Parallel System Support Programs for AIX: Diagnosis Guide (GA22-7350). 3. Determine the primary node number. From an AIX window on the control workstation, enter: Eprimary 4. Determine the host name for this node by checking “reliable_hostname” for the node number with the command: splstdata -n | pg 5.
Switch Function (MAP 0620) b. Return to “Step 0620-001” on page 1-17. Table 1-6. SP Switch2 error conditions Error # 2 Device Message Link Message Description and Action Initialized N/A Description: Initialization detected a wrapped port where a processor node was expected (this may result from isolation procedures), or else a disconnected cable. Action: 1. If this is an unexpected condition, check cabling against the configuration file var/adm/SPlogs/cssX/p0/out.
Switch Function (MAP 0620) Table 1-6. SP Switch2 error conditions (continued) Error # 0 Device Message Link Message Description and Action Uninitialized Uninitialized Description: Switch adapter has not been initialized. Processor node may not recognize adapter due to hardware failure or bad software configuration. Action: 1. If there are any other errors in the /var/adm/SPlogs/css0/p0/out.top file on the primary node, address those errors first.
Switch Function (MAP 0620) Table 1-6. SP Switch2 error conditions (continued) Error # Device Message Link Message Description and Action −4 Device has been removed from network, faulty Link has been removed from network or miswire, faulty Description: Switch network not wired as specified in switch topology or problem with connection between switch and device. Note: You may get this error number for a jack which could connect to a node, but instead has a wrap plug.
Switch Function (MAP 0620) Table 1-6. SP Switch2 error conditions (continued) Error # −9 Device Message Link Message Description and Action Destination not reachable Link has been removed from network, not connected Description: Possible hardware problem. Action: Go to “Step 0620-004”. Step 0620-004 You were directed here by an Error Condition listed in Table 1-6 on page 1-19 which lists functional problems reported in /var/adm/SPlogs/css0/p0/out.top file.
Switch Function (MAP 0620) Step 0620-005 The /var/adm/SPlogs/css0/p0/out.top file indicates a problem with a “Primary node” or “Secondary node” connection. 1. Open frame rear cover and check the cable connection from the indicated switch assembly jack to the processor node. 2. Is there a cable connected to the indicated jack on the switch assembly? v If yes, go to “Step 0620-008”. v If no, go to “Step 0620-006”.
Switch Function (MAP 0620) b. Go to ″Processor node diagnostics and descriptions (MAP 0130)″ in RS/6000 SP: System Service Guide to fix problem. Step 0620-011 The Power (green) LED is lit, indicating the processor node is powered on. 1. Run advanced diagnostics in service mode on device “cssX” (where X=0 or 1) on this processor node and its associated switch port. Refer to: v “Running diagnostics on a switch port” on page 3-12.
Switch Function (MAP 0620) Table 1-8. Service Request Numbers (SRNs) for SP Switch2 adapters (continued) Service Request Number SRN Source Failing Component Notes Description Notes: 1. If y = 1 in these SRNs, you must troubleshoot the SP Switch2 adapter software (SRN 765-x1xx) before you follow procedures related to a hardware item. 2. x may be any digit. Step 0620-012 An SRN was obtained and Table 1-8 on page 1-24 was used to determine the list of possible failing components. 1.
Switch Function (MAP 0620) 1. From the node front panel on the control workstation, put the node in the SERVICE mode. 2. Power-on this processor node. 3. Go to “Step 0620-014”. Step 0620-014 At this point, you must run the advanced diagnostics in service mode on the device “cssX” (where X=0 or 1) and its associated switch port. 1. Did you get an SRN from the diagnostics? v If yes, go to “Step 0620-016”. v If no, go to “Step 0620-015”.
Switch Function (MAP 0620) v If no, go to “Step 0620-019”. Step 0620-019 Some but not all switch data cables appear to be having problems. 1. Depending on whether the problem is a wrapped port or a switch-to-switch connection, perform one of the following steps: v Wrapped port (wrap plug installed): Remove the existing wrap plug. Install a different wrap plug on the interposers indicated. v Switch-to-switch connection: Disconnect the switch data cable from both ports indicated.
Switch Function (MAP 0620) dsh -a /usr/lpp/ssp/css/rc.switch Note: When working with a two-plane SP Switch2 system, add the adapter name to the command, as follows: dsh -a /usr/lpp/ssp/css/rc.switch -a Example: dsh -w fr2n03,fr2n04,fr3n01 /usr/lpp/ssp/css/rc.switch Attention: Issuing this command on processor nodes that did not lose a connection may cause unpredictable results. 3. Have customer start the switch code from the control workstation by entering: Estart 4.
Chapter 2. Locations Naming standard for RS/6000 SP components . . . . . Format structure . . . . . . . . . . . . . . . Example of format structure . . . . . . . . . . Frame (WWW) . . . . . . . . . . . . . . . Major assembly (XXX) . . . . . . . . . . . . Sub-assembly (YY) . . . . . . . . . . . . . Connection location (ZZZZ) . . . . . . . . . . Examples for using complete levels of nomenclature . Location diagrams of the RS/6000 SP components . . . . Front and rear views of RS/6000 SP frame . . . . . .
– 01 - 99 for frames 1-99 (specific to that frame) Notes: 1. E01 designates RS/6000 SP physical frame 1 2. L00 designates any/all RS/6000 SP logical frames 3. S00 designates any/all RS/6000 SP multi-switch frames 4.
Front and rear views of RS/6000 SP frame Figure 2-1 shows a front view of the RS/6000 SP frame locations. “Frame (FRA)” on page 2-5 describes the assembly designations for the RS/6000 SP frame. Figure 2-1. Front view of frame locations. See notes below. Figure notes: 1. Frames equipped with the SP Redundant Power Supply must have four power modules (books) installed in the SEPBU. 2. Wide processor nodes take up an entire shelf position (two thin processor node slots).
Figure 2-2 shows a front view of the RS/6000 SP multi-switch frame. SP Switch Frame Locations - Front View Switch Asm S16 Switch Asm S14 Switch Asm S12 Switch Asm S10 Switch Asm S8 Switch Asm S6 Switch Asm S4 Switch Asm S2 Main Power Switch with LED Left Skirt Right Skirt A B C 48 V Power Modules (Front Cover and Skirt, and Air Filter Removed) Figure 2-2. Front view of multi-switch frame locations Figure 2-3 on page 2-5 shows a rear view of the RS/6000 SP frame locations.
Figure 2-3. Rear view of frame locations Note: See notes under Figure 2-1 on page 2-3 for processor node/switch assembly numbering. Frame locations Figure 2-1 on page 2-3 shows a front view of the RS/6000 SP frame locations, with numbered processor nodes, and the three phase SEPBU. Frame (FRA) This list shows the designations specifically for the RS/6000 SP frame: G1: Right-hand rear ground G2: Left-hand rear ground G3: PDU ac ground G4: PDU dc ground G5: Input cable ground Chapter 2.
G6: Front door ground G7: Rear door ground G8: Ground SW: Power-on switch LD: LED card FC: Front cover RC: Rear cover Example: E01-FRA-G1 2-6 RS/6000 SP: SP Switch2 Service Guide
Switch assembly locations Figure 2-4. SP Switch2 high level planar view Connector details Figure 2-5 on page 2-8 shows RS/6000 SP component connector details. Chapter 2.
Figure 2-5. RS/6000 SP connector details (as seen at receiving ends, not at cable ends) Cable routing Figure 2-6 on page 2-9 and Figure 2-7 on page 2-9 show back views of the RS/6000 SP frame, showing the horizontal and vertical paths of cable routing from connector-to-connector, with the depth amplified on the drawing. Note: When attaching exterior and interior cables to a POWER3 SMP High Node allow for enough cable for a 2-foot service loop for node movement into service position.
Figure 2-6. Frame cabling routing path in rear of RS/6000 SP frame — 1.93 m frame Figure 2-7. Frame cabling routing path in rear of RS/6000 SP frame — 2.01 m frame Note: For a multi-switch frame (F/C 2032), refer to Figure 2-6. Table 2-1 on page 2-10 shows external cable routing in a RS/6000 SP frame populated with 16 processor nodes. (Refer to “Cable routing” on page 2-8 to see the routing paths.) Chapter 2.
Table 2-1.
Figure 2-8. Frame cable routing paths in rear of RS/6000 SP multi-switch frame (F/C 2032) — 1.93 m frame Switch data cables SP Switch2 data cables Table 2-2 describes the attachment locations and routing for the internal SP Switch2 data cables. Table 2-2.
Table 2-2. SP Switch2 data cable chart (continued) Cable Part Number 05N6351 Plug from Location Plug to Location E00-S00-BH-J15 E00-N16-BH-PA Notes: 1. “PA” refers to connector on SP Switch2 adapter. 2. Only one cable type is used for all switch locations. Note: For external frame-to-frame cable locations, see RS/6000 SP: Installation and Relocation.
Chapter 3. Service procedures Personal ESD requirements . . . . . . . . . . . . . Tools and files overview . . . . . . . . . . . . . . . Using the css.snap script . . . . . . . . . . . . . . css.snap file structure . . . . . . . . . . . . . . Files collected by css.snap. . . . . . . . . . . . css.snap file package names . . . . . . . . . . . . Disk space handling . . . . . . . . . . . . . . . SP Switch2 supervisor self-test . . . . . . . . . . . . Self-test Conditions . . . . . . . . . . . . . . .
Table 3-1. Service procedure tools Utility Runs on Description Directory fault_service_Worm_RTG_CS All nodes Monitors the switch for faults. It restarts the switch if a fault is detected. /usr/lpp/ssp/css css.snap All nodes, CWS Collects log, trace, and dump information created by SP Switch2 support code (device driver, worm, fault-service daemon, diagnostics) /usr/lpp/ssp/css rc.switch All nodes Starts the daemons and IP configuration tools.
Table 3-2. Setup output files (continued) File Location Description Directory css.snap.log All nodes Log files created by the switch support code /var/adm/SPlogs/css File Location Description Directory daemon.stdout All nodes Keeps a detailed account of the /var/adm/SPlogs/css tuning process initiated by the Estart command. It includes data from every tuning operation since the current daemon on the primary node was initiated. topology.
v -n Assumes that the device driver or daemon has flushed the cache. v -s Takes a soft snap, which does not dump the adapter state. This excludes the col_dump.out. This flag is used for temporary errors (TYPE=TEMP) where the integrity of the adapter is in doubt, or when it is not desirable to corrupt the adapter state by the use of diagnostic routines. v -a Specifies a single adapter. When this flag is not used, all the node’s configured adapters will be selected. This is the default.
Table 3-4. SP Switch2 log files (continued) Log File Information Level File Location File Contents core node nodes Fault service daemon core dump file. css.snap.log node nodes css.snap snapshot command log information. Contains a list of all files gathered in the last snapshot. CSS_test.log node nodes Present if the CSS_test command was run on the node. daemon.log node nodes Fault service daemon output file. DeviceDB.
Table 3-4. SP Switch2 log files (continued) Log File Information Level File Location File Contents topology.data port primary node System error messages from the distribution of the topology file to the secondary nodes. Note: The files ending in .out are produced by running the appropriate command to dump internal (in memory) trace information or dump data to a file. The complete package of output files will be found in /var/adm/SPlogs/css/. css.snap file package names Once the css.
Self-test Conditions ?? Pass sequence 1. Both LEDs light for about 10 seconds 2. Both LEDs go off 3. Green LED stays off, while the yellow LED flashes the switch address 4. Yellow LED goes off for about two seconds (green LED stays off) 5. Both LEDs light for about one second 6.
Base code verification Note: This is not a Perspectives function. Perform the following procedure to check for supervisor conditions that require action. 1. From the control workstation window, enter: smitty supervisor 2.
Removing and restoring switch resources This procedure can be performed to allow customer to use a switch feature while extended service actions are performed on an individual frame of a multi-frame system with the switch feature.
Using Perspectives to fence and unfence nodes attached to the switch Fencing nodes 1. Bring up Hardware Perspectives for the system 2. Select the node to be fenced by either: v Double clicking the node v Opening the node’s notebook 3. Select either: v Fence v Fence with autojoin Note: Selecting the autojoin option will automatically place the node back into the operations of the partition on successful power on of the Node.
Replacing an SP Switch2 from service position Note: Make certain the switch has been returned to the active configuration after replacing the switch from the service position. 1. Install the switch by sliding it into the front of the frame. 2. Reinstall the screws holding the switch to the front of the frame. 3. Reconnect all switch cables to their recorded interposer positions. 4. Reattach the power cable to slot J1 and the supervisor cable to slot J2. 5. Set the inline switch to the On (‘1’) position. 6.
9. On the control workstation, set the node to boot from disk. For example: spbootins -r disk 2 12 1 10. On the control workstation, use Perspectives to power off the node and then power it back on. The node will now boot from the device that you specified in step 7 with the correct time. Running diagnostics on a switch port Attention: Servicing a processor node or switch assembly may interrupt customer usage of the processor node and the remainder of the switch network.
Chapter 4. FRU removals and replacements Handling static-sensitive devices . . . . . . . SP Switch2 service procedures . . . . . . . . Removing a fan assembly . . . . . . . . . Replacing a fan assembly . . . . . . . . . Removing a power supply . . . . . . . . . Replacing a power supply . . . . . . . . . Removing the LED bracket assembly . . . . . Replacing the LED bracket assembly . . . . . Removing the switch supervisor card . . . . . Replacing the switch supervisor card . . . . .
SP Switch2 service procedures Figure 4-1. Handling an anti-static device SP Switch2 service procedures CAUTION: The unit weight exceeds 18 Kg (40 lbs) and requires two service personnel to lift.
SP Switch2 service procedures 3. Return to the procedure that directed you here. Removing a power supply Note: The power supply is a card-mounted assembly and is hot-pluggable. Note: Refer to “Handling static-sensitive devices” on page 4-1. 1. Remove the fan assembly blocking access to the power supply assembly. v Refer to “Removing a fan assembly” on page 4-2. 2.
SP Switch2 service procedures Removing the LED bracket assembly Note: The LED bracket assembly is hot-pluggable. Note: Refer to “Handling static-sensitive devices” on page 4-1. 1. Remove the fan assembly housing the LED bracket assembly. v Refer to “Removing a fan assembly” on page 4-2. 2. Remove the LED bracket mounting screw from the side of the fan assembly. 3. Remove the LED bracket assembly. Note: If you are replacing a failed fan, save the LED bracket assembly for use with the new fan. Figure 4-3.
SP Switch2 service procedures Removing the switch supervisor card Note: The switch supervisor card is hot-pluggable. Note: Refer to “Handling static-sensitive devices” on page 4-1. 1. 2. 3. 4. Remove the switch supervisor cable from the supervisor card located in slot J2. Loosen the captive screw holding the card retention bracket to the switch chassis. Swing the bracket out and remove it from the switch chassis. Remove the supervisor card from switch by pulling outward on the card’s hot-plug actuator.
SP Switch2 service procedures Figure 4-5. Installing an SP Switch2 supervisor and interposer cards Replacing the switch supervisor card 1. Position and hold the switch supervisor card at the far end of the hot-plug actuator. 2. Insert the far end of the actuator into the actuator guides of switch slot J2. 3. Push the actuator to the end of the guide track. 4. Push the actuator handle inward and seat the supervisor card into switch planar jack J2. 5.
SP Switch2 service procedures Note: Refer to “Handling static-sensitive devices” on page 4-1. Note: If multiple cards are to be removed, label and record the position of each card and its associated I/O cable. 1. If the interposer card is a switch interposer, remove the I/O cable. v Only switch interposer cards have an attached I/O cable 2. Loosen the captive screw holding the card retention bracket to the switch chassis. 3. Swing the bracket out and remove it from the switch chassis. 4.
SP Switch2 service procedures Replacing the switch planar Attention: Replacement of the switch planar involves the replacement of the removed switch’s externally accessible plug-ins into a new, partially populated switch planar-in-chassis assembly. 1. Remove all fan assemblies from the new switch planar assembly. v Refer to “Removing a fan assembly” on page 4-2. 2. Install the components from the old switch into the new chassis assembly in the following order: a. Replace the switch supervisor card.
SP Switch2 service procedures Figure 4-6. Removing SP Switch2 circuit breaker assembly Replacing the 48 V dc circuit breaker assembly 1. Insert the 48 V dc circuit breaker assembly into the switch chassis. 2. Secure the assembly to the chassis with the mounting screws. 3. Plug the circuit breaker assembly power cable into J48V on the switch planar. 4. Install the center top-cover and secure it by tightening the captive screws. 5. Replace the switch supervisor card and the card retention bracket.
SP Switch2 service procedures 8. Remove the front top-cover from the chassis as follows: a. Remove the cover mounting screws. b. Slide the front top-cover toward the center of the chassis. c. Remove the cover when it disengages from the chassis framework. 9. Cut the tie-wrap securing the LED power extension cable to the cover mounted power tray. 10. Slide the LED extension cable out of the holding slot. 11.
Chapter 5. Parts catalog SP Switch2 assembly (view 1) . . . . . . SP Switch2 assembly (view 2) . . . . . . Switch cables . . . . . . . . . . . . SP Switch2 Frame (F/C 2032) . . . . . . F/C 2032 frame extender . . . . . . . . SP Switch2 Frame Model 556 and F/C 2034. Model 556 and F/C 2034 frame extender . . © Copyright IBM Corp. 2000, 2002 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
SP Switch2 assembly (view 1) 5-2 RS/6000 SP: SP Switch2 Service Guide
Table 5-1. SP Switch2 assembly (view 1) Assembly index Part number Units Description SP Switch2 Assembly (reference only) 1 31L7106 4 Fan assembly 2 11P1636 4 Power Supply, 3.4 V 3 31L7137 2 Baffle, Air Flow 4 21L3969 1 Cover, Center Top 5 05N6603 1 Replacement Assembly, Switch Planar 6 31L7112 1 Cable, LED Power Extension 77G0818 1 Wrap Plug, Diagnostic, Male (not shown) 46H9688 1 Wrap Plug, Diagnostic, Female (not shown) 05N6647 1 Cable, 8.
SP Switch2 assembly (view 2) 5-4 RS/6000 SP: SP Switch2 Service Guide
Table 5-2.
Switch cables This page intentionally left blank.
Table 5-3. Switch cables Assembly index Part number Units Description SP Switch2 Data Cable 11P0006 AR Cable, Switch Data - (2615 mm) -----------------------------------SP Switch2 External Cables 31L7152 1 Cable, SP Switch 2 Power 46G9698 AR Cable, S - S External 5 m 46G9699 AR Cable, S - S External 10 m 46G9700 AR Cable, S - S External 15 m 46G9701 AR Cable, S - S External 20 m Chapter 5.
SP Switch2 Frame (F/C 2032) 1 C 1 -3 2 4 3 FR ON T 5 6 5-8 RS/6000 SP: SP Switch2 Service Guide
Table 5-4.
F/C 2032 frame extender 1 2 6 5 3 4 5-10 RS/6000 SP: SP Switch2 Service Guide
Table 5-5. F/C 2032 frame extender Assembly index Part number Units 1 44P1029 1 Top cover, frame extender 2 4491031 1 Right side, frame extender 3 Description Bracket, lower frame 4 54G2943 2 Leveling pad 5 44P1032 16 Cable bracket, frame extender 6 44P1030 1 Left side, frame extender 54G2882 36 Screw, hex head, M5 Chapter 5.
SP Switch2 Frame Model 556 and F/C 2034 1 2 4 REAR 3 5 5 6 FRONT 5-12 RS/6000 SP: SP Switch2 Service Guide
Table 5-6.
Model 556 and F/C 2034 frame extender 1 2 6 5 4 5-14 RS/6000 SP: SP Switch2 Service Guide 3
Table 5-7. Model 556 and F/C 2034 frame extender Assembly index Part number Units 1 21L3091 1 Top cover, frame extender 2 21L3088 1 Right side, frame extender 3 Description Bracket, lower frame 4 54G2943 2 Leveling pad 5 21L3090 16 Cable bracket, frame extender 6 21L3089 1 Left side, frame extender 54G2882 36 Screw, hex head, M5 Chapter 5.
5-16 RS/6000 SP: SP Switch2 Service Guide
Notices This information was developed for products and services offered in the U.S.A. IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used.
Electronic emissions notices Federal Communications Commission (FCC) statement This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment.
For installations in Japan: The following is a summary of the VCCI Japanese statement in the box above. This is a Class A product based on the standard of the Voluntary Control Council for Interference by Information Technology Equipment (VCCI). If this equipment is used in a domestic environment, radio disturbance may arise. When such trouble occurs, the user may be required to take corrective actions.
A-4 RS/6000 SP: SP Switch2 Service Guide
Index Numerics A 0375867 5-9, 5-13 05N6603 5-3, 5-5 05N6647 5-3 08J5557 5-9 11J4774 5-9 11J5155 5-9, 5-13 11J5189 5-9 11J5191 5-9 11J5193 5-9 11J5195 5-9 11P0006 5-7 11P0097 5-9, 5-13 11P0492 5-13 11P1636 5-3 12K0486 5-5 12K0487 5-5 12K0606 5-5 21L3088 5-15 21L3089 5-15 21L3090 5-15 21L3091 5-15 21L3966 5-5 21L3967 5-5 21L3969 5-3 31L7106 5-3 31L7109 5-3 31L7112 5-3, 5-5 31L7113 5-5 31L7137 5-3 31L7152 5-7 31L8514 5-9, 5-13 31L8515 5-9, 5-13 31L8752 5-5 44P0769 5-13 44P0771 5-13 44P1029 5-11 44P1030 5-11
files created by css.snap 3-4 package names, css.snap 3-6 structure, css.snap 3-4 files overview, service 3-1 format structure 2-1 frame multi-switch 5-8, 5-12 rear view 2-4 frame cable routing path in rear of frame 2-8, 2-10 frame extender F/C 2032 5-10 F/C 2034 5-14 Model 556 5-14 frame locations 2-3, 2-5 frame naming standard 2-1 front view of frame locations 2-3 front view of multi-switch frame locations 2-4 N names, css.
removing (continued) LED bracket 4-4 LED power extension cable 4-9 power supply 4-3 RS/6000 components 4-1 switch interposer 4-6 switch planar 4-7 switch supervisor card 4-5 wrap interposer 4-6 removing switch from active configuration 3-9 removing switch resources 3-9 replacing 48 V dc circuit breaker assembly 4-9 blank interposer 4-7 fan assembly 4-2 interposer card 4-7 LED bracket 4-4 LED power extension cable 4-10 power supply 4-3 RS/6000 components 4-1 switch interposer 4-7 switch planar 4-8 switch sup
verification, service procedures 3-1 W who should use book wrap interposer removing 4-6 replacing 4-7 wrap plugs 1-5 X-4 xv RS/6000 SP: SP Switch2 Service Guide
Reader’s comments – We’d like to hear from you RS/6000 SP SP Switch2 Service Guide Publication No.
GA22-7444-03 IBMR ___________________________________________________________________________________________________ Readers’ Comments — We’d Like to Hear from You Cut or Fold Along Line _ _ _ _ _ _ _Fold _ _ _ and _ _ _Tape _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _Please _ _ _ _ _do _ _not _ _ staple _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _Fold _ _ _and _ _ Tape ______ NO POSTAGE NECESSARY IF MAILED IN THE UNITED STATES BUSINESS REPLY MAIL FIRST-CLASS MAIL PERMIT NO.
IBMR Printed in the United States of America on recycled paper containing 10% recovered post-consumer fiber.
