SPARC Enterprise T5120 and T5220 Servers Service Manual TM Manual Code C120-E463-04EN Part No.
Copyright © 2009 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved. FUJITSU LIMITED provided technical input and review on portions of this material. Sun Microsystems, Inc. and Fujitsu Limited each own or control intellectual property rights relating to products and technology described in this document, and such products, technology and this document are protected by copyright laws, patents and other intellectual property laws and international treaties.
Copyright © 2009 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, Etats-Unis. Tous droits réservés. Entrée et revue tecnical fournies par FUJITSU LIMITED sur des parties de ce matériel. Sun Microsystems, Inc. et Fujitsu Limited détiennent et contrôlent toutes deux des droits de propriété intellectuelle relatifs aux produits et technologies décrits dans ce document.
Contents Preface xiii Identifying Server Components 1 Infrastructure Boards in SPARC Enterprise T5120 Servers 2 Infrastructure Boards in SPARC Enterprise T5220 Servers 3 Internal System Cables for SPARC Enterprise T5120 Servers 4 Internal System Cables for SPARC Enterprise T5220 Servers 5 Front Panel Controls and Indicators on SPARC Enterprise T5120 Servers 5 Rear Panel Components and Indicators on SPARC Enterprise T5120 Servers 8 Front Panel Controls and Indicators on SPARC Enterprise T5220
How to Switch From the System Console to the Service Processor 25 How to Switch From the Service Processor to the System Console 25 Service-Related ILOM Command Summary Faults Displayed by show faulty 26 29 Example of show faulty Output When No Fault is Present 30 Example of show faulty Output for Environmental Faults 30 Example of show faulty Output for Faults Detected by POST Example of show faulty Output for Faults Detected by PSH Technology 30 ▼ Clear FRU Faults Manually ▼ Display FRU Info
Viewing Solaris OS Messages 48 ▼ Check the Message Buffer ▼ View the System Message Log Files 49 49 Managing Components With Automatic System Recovery Commands ASR Overview 50 ▼ Display System Components 51 ▼ Disable System Components 52 ▼ Enable System Components 53 Detecting Faults Using SunVTS Software ▼ Run the SunVTS Software Preparing to Service the System General Safety Information Safety Symbols 53 54 57 57 57 Electrostatic Discharge Safety Measures Antistatic Wrist Strap Us
▼ Remove the Top Cover Servicing Hard Drives 67 69 Hard Drive Servicing Overview Hard Drive LEDs 69 70 ▼ Remove a Hard Drive ▼ Install a Hard Drive 71 73 Four-Drive Capable Backplane Configuration Reference 77 Eight-Drive Capable Backplane Configuration Reference 78 Sixteen-Drive Capable Backplane Configuration Reference Servicing Motherboard Components Servicing FB-DIMMs 81 81 Memory Fault Handling Overview 82 ▼ Identify Faulty FB-DIMMs Using the show faulty Command ▼ Identify Faul
▼ Remove a PCIe/XAUI Riser ▼ Install a PCIe/XAUI Riser ▼ Remove a PCIe or XAUI Card ▼ Install a PCIe or XAUI Card 102 104 106 107 PCIe/XAUI Card Configuration Reference for SPARC Enterprise T5120 Servers 110 PCIe and XAUI Card Reference for SPARC Enterprise T5220 Servers Servicing the Battery 112 System Battery Overview ▼ Remove a Battery ▼ Install a Battery 112 113 114 Servicing the SCC Module 114 SCC Module Overview 114 ▼ Remove a Faulty SCC Module ▼ Install a New SCC Module 115
Servicing Power Supplies 129 Power Supplies Overview 129 Power Supply Status LEDs ▼ Remove a Power Supply ▼ Install a Power Supply 129 131 134 Power Supply Configuration Reference Servicing Boards and Components 137 Important Safety Instructions 137 Servicing DVD/USB Modules 138 DVD/USB Module Overview 139 ▼ Remove the DVD/USB Module ▼ Install the DVD/USB Module Servicing Fan Power Boards 136 139 141 143 Fan Power Board Overview 143 ▼ Remove the Fan Power Board ▼ Install the F
Servicing Power Distribution Boards 160 Power Distribution Board Overview 160 ▼ Remove the Power Distribution Board ▼ Install the Power Distribution Board 161 163 Servicing Power Supply Backplanes (SPARC Enterprise T5220 Servers) Power Supply Backplane Overview 168 ▼ Remove the Power Supply Backplane ▼ Install the Power Supply Backplane Servicing Paddle Cards 167 168 170 171 Paddle Card Overview 172 ▼ Remove the Paddle Card ▼ Install the Paddle Card 173 Returning the Server to Oper
HDD Data Cable Routing for SAS RAID Controller Cards in Eight-Disk Capable SPARC Enterprise T5120 Servers 193 Identifying FRUs in SPARC Enterprise T5220 Servers Motherboard Components in T5220 Servers 195 196 I/O Components in SPARC Enterprise T5220 Servers 198 Power Distribution/Fan Module Components in SPARC Enterprise T5220 Servers 200 Internal Cables for Onboard SAS Controller Cards in SPARC Enterprise T5220 Servers 202 HDD Data Cable Routing for SAS RAID Controller Cards in SPARC Enterprise T5220
Preface This manual provides detailed procedures that describe the removal and replacement of replaceable parts in the SPARC Enterprise™ T5120 and T5220 servers. This manual also includes information about the use and maintenance of the servers. This document is written for technicians, system administrators, authorized service providers (ASPs), and users who have advanced experience troubleshooting and replacing hardware.
Structure and Contents of This Manual This manual is organized as described below: ■ “Identifying Server Components” on page 1 Identifies key components of the SPARC Enterprise T5120 and T5220 servers, including major boards and internal system cables, as well as front and rear panel features. ■ “Detecting and Managing Faults” on page 15 Describes the diagnostics that are available for monitoring and troubleshooting the server.
Related Documentation The latest versions of all the SPARC Enterprise Series manuals are available at the following Web sites: Global Site (http://www.fujitsu.com/sparcenterprise/manual/) Japanese Site (http://primeserver.fujitsu.
xvi Title Description Manual Code SPARC Enterprise T5120 and T5220 Servers Installation Guide Detailed rackmounting, cabling, power on, and configuring information C120-E462 SPARC Enterprise T5120 and T5220 Servers Service Manual How to run diagnostics to troubleshoot the server, and how to remove and replace parts in the server C120-E463 SPARC Enterprise T5120 and T5220 Servers Administration Guide How to perform administrative tasks that are specific to the servers C120-E464 Integrated Lights
Note – Product Notes are available on the website only. Please check for the recent update on your product. UNIX Commands This document might not contain information on basic UNIX® commands and procedures such as shutting down the system, booting the system, and configuring devices. Refer to the following for this information: ■ Software documentation that you received with your system ■ Solaris™ Operating System documentation, which is at (http://docs.sun.
Prompt Notations The following prompt notations are used in this manual.
Caution – This indicates that hazardous voltages are present. To reduce the risk of electric shock and danger to personal health, follow the instructions. Tip – This indicates information that could help the user to use the product more effectively. Alert Messages in the Text An alert message in the text consists of a signal indicating an alert level followed by an alert statement. A space of one line precedes and follows an alert statement.
Task Warning Maintenance Damage The server is heavy. Two persons are required to remove it from the rack. The servers are heavy. Two people might be required to carry the chassis and install it in the rack. Caution – This indicates that hazardous voltages are present. To reduce the risk of electric shock and danger to personal health, follow the instructions. Task Warning Maintenance Electric shock Never attempt to run the server with the covers removed. Hazardous voltage present. Because 3.
Caution – This indicates that surfaces are hot and might cause personal injury if touched. Avoid contact. Task Warning Maintenance Extremely hot Some components on the motherboard might be hot. Use caution when handling the motherboard, especially near the CPU heat sink. FB-DIMMs and heat sinks on the motherboard may be hot. Use care when removing the bus bar screws to avoid touching a heat sink, which can be dangerously hot.
Product Handling Maintenance Warning – Certain tasks in this manual should only be performed by a certified service engineer. User must not perform these tasks. Incorrect operation of these tasks may cause electric shock, injury, or fire.
Alert Label The following is a label attached to this product: ■ Never peel off the label. ■ The following label provides information to the users of this product.
Fujitsu Welcomes Your Comments If you have any comments or requests regarding this document, or if you find any unclear statements in the document, please state your points specifically on the form at the following URL. For Users in U.S.A., Canada, and Mexico: (https://download.computers.us.fujitsu.com/) For Users in Other Countries: (http://www.fujitsu.com/global/contact/computing/sparce_index.
Identifying Server Components These topics identify key components of the SPARC Enterprise T5120 and T5220 servers, including major boards and internal system cables, as well as front and rear panel features.
Infrastructure Boards in SPARC Enterprise T5120 Servers SPARC Enterprise T5120 servers are based on a 1U chassis family. The following table provides a summary of the circuit boards used in these servers. Board Description Motherboard This board includes two CMP modules, slots for 16 FB-DIMM, memory control subsystems, and all service processor (ILOM) logic. It also hosts a removable SCC module, which contains all MAC addresses, host ID, and ILOM configuration data.
■ “Identifying FRUs in SPARC Enterprise T5120 Servers” on page 181 ■ “Identifying FRUs in SPARC Enterprise T5220 Servers” on page 195 Infrastructure Boards in SPARC Enterprise T5220 Servers SPARC Enterprise T5220 servers are based on a 2U chassis family. The following table provides a summary of the circuit boards used in these servers. Board Description Motherboard This board includes two CMP modules, slots for 16 FB-DIMM, memory control subsystems, and all service processor (ILOM) logic.
Board Description Hard drive backplane This board includes the connectors for the hard drives. This board also contains the interconnect for the front I/O board, Power and Locator buttons, and system/component status LEDs. Each drive has its own Power/Activity, Fault, and Ready-to-Remove LEDs. Front I/O board This board connects directly to the hard drive backplane. This board is packaged with the DVD drive as a single unit.
Internal System Cables for SPARC Enterprise T5220 Servers The following table identifies the internal system cables used in SPARC Enterprise T5220 servers. Cable Description Top cover interlock cable This cable connects the safety interlock switch on the top cover to the power distribution board. Ribbon cable This cable carries signals between the power supply backplane and the power distribution board. Ribbon cable This cable carries signals between the power distribution board and the motherboard.
FIGURE: Front Panel Controls and Indicators on SPARC Enterprise T5120 Servers Figure Legend 6 1 Locator LED and button 5 Hard Drive map 2 Service Required LED 6 Power Supply Service Required LED 3 Power OK LED 7 Overtemp LED 4 Power button 8 Fan Module Service Required LED SPARC Enterprise T5120 and T5220 Servers Service Manual • July 2009
The following table provides descriptions of these controls and indicators. TABLE: Front Panel Controls and Indicators (SPARC Enterprise T5120 and T5220 Servers) LED or Button Icon or Label Description Locator LED and button (white) The Locator LED can be turned on to identify a particular system. When on, it blinks rabidly. There are three methods for turning a Locator LED on: • Issuing the ILOM command set /SYS/LOCATE value=Fast_Blink • Issuing the ALOM CMT command setlocator on.
Related Information ■ “LED Overview” on page 21 Rear Panel Components and Indicators on SPARC Enterprise T5120 Servers The following figure shows the layout of the connectors associated with the system I/O ports, PCIe ports, 10 Gbit Ethernet (XAUI) ports (if equipped) and power supplies on the rear panel of SPARC Enterprise T5120 servers. It also shows the locations of the rear panel LEDs.
The following table provides descriptions of the LEDs located on the rear panel. TABLE: Rear Panel LED Indicators (SPARC Enterprise T5120 and T5220 Servers) LED or Button Icon or Label Description Locator LED and button (white) The Locator LED can be turned on to identify a particular system. When on, it blinks rabidly. There are three methods for turning a Locator LED on: • Issuing the ILOM command set /SYS/LOCATE value=Fast_Blink • Issuing the ALOM CMT command setlocator on.
FIGURE: Front Panel Controls and Indicators on SPARC Enterprise T5220 Servers Figure Legend 10 1 Locator LED and button 5 Power Supply Service Required LED 2 Service Required LED 6 Overtemp LED 3 Power OK LED 7 Fan Module Service Required LED 4 Power button 8 Hard Drive map SPARC Enterprise T5120 and T5220 Servers Service Manual • July 2009
The following table provides descriptions of these controls and indicators. TABLE: Front Panel Controls and Indicators (SPARC Enterprise T5120 and T5220 Servers) LED or Button Icon or Label Description Locator LED and button (white) The Locator LED can be turned on to identify a particular system. When on, it blinks rabidly. There are three methods for turning a Locator LED on: • Issuing the ILOM command set /SYS/LOCATE value=Fast_Blink • Issuing the ALOM CMT command setlocator on.
Related Information ■ “LED Overview” on page 21 Rear Panel Components and Indicators on SPARC Enterprise T5220 Servers The following figure shows the layout of the I/O ports, PCIe ports, 10 Gbit Ethernet (XAUI) ports (if equipped) and power supplies on the rear panel.
The following table provides descriptions of the LEDs located on the rear panel. TABLE: LED Indicators on the SPARC Enterprise T5220 Server Rear Panel LED or Button Icon or Label Description Locator LED and button (white) The Locator LED can be turned on to identify a particular system. When on, it blinks rabidly. There are three methods for turning a Locator LED on: • Issuing the ILOM command set /SYS/LOCATE value=Fast_Blink • Issuing the ALOM CMT command setlocator on. • Pressing the Locator button.
Status LEDs for Ethernet Ports and Network Management Port The following table describes the status LEDs assigned to each Ethernet port. TABLE: Ethernet Port LEDs (NET0, NET1, NET2, NET3) LED Color Description Left LED Amber or Green Speed indicator: • Amber on – The link is operating as a Gigabit connection (1000 Mbps). • Green on – The link is operating as a 100-Mbps connection. • Off – The link is operating as a 10-Mbps connection.
Detecting and Managing Faults These topics explain how to use various diagnostic tools to monitor server status and troubleshoot faults in the server.
■ Power-on self-test (POST) – POST performs diagnostics on system components whenever the system is turned on or a system reset is issued. ■ Solaris OS Predictive Self-Healing (PSH) – PSH continuously monitors the health of the processor and memory, collecting data that can be used to predict component failures before they occur. PSH works with ILOM to take a component offline if data indicate there is a high risk it will fail.
Multiple service processor accounts can be active concurrently. A user can issue ILOM shell commands while logged in under one account and, at the same time, issue ALOM CMT shell commands while operating in another account. Related Information ■ “Diagnostics Tools Quick Reference” on page 17 Diagnostics Tools Quick Reference The following flowchart illustrates the complementary relationship of the different diagnostic tools and indicates a default sequence of use.
FIGURE: 18 Diagnostics Flowchart SPARC Enterprise T5120 and T5220 Servers Service Manual • July 2009
The following table provides brief descriptions of the troubleshooting actions shown in the flowchart. It also provides links to topics with additional information on each diagnostic action. TABLE: Diagnostic Flowchart Reference Table Diagnostic Action Possible Outcome Additional Information Check Power OK and AC Present LEDs on the server. (Flowchart item 1) The Power OK LED is located on the front and rear of the chassis. The AC Present LED is located on the rear of the server on each power supply.
TABLE: Diagnostic Flowchart Reference Table (Continued) Diagnostic Action Possible Outcome Check if the fault is environmental. (Flowchart item 6) Determine if the fault is an environmental fault or a • “Faults Displayed by show configuration fault. faulty” on page 29 If the fault listed by the show faulty command displays a temperature or voltage fault, then the fault is an environmental fault.
LED Overview The server provides the following groups of LEDs: ■ Front panel system LEDs ■ Rear panel system LEDs ■ Hard drive LEDs ■ Power supply LEDs ■ Fan module LEDs ■ Rear panel Ethernet port LEDs ■ FB-DIMM Locate LEDs The following table provides quick-reference information about the various LEDs. It also points to more detailed descriptions for each.
TABLE: System Faults and the Corresponding LED States (Continued) (Continued) Component Fault Fault LEDs Lit Additional Information Hard drive • Service Required LED (front and rear panel) • Individual hard drive Fault LED See these sections: • “Hard Drive Servicing Overview” on page 69 • “Hard Drive LEDs” on page 70 • “Remove a Hard Drive” on page 71 • “Install a Hard Drive” on page 73 FB-DIMM • Service Required LED (front and rear panel) • FB-DIMM Fault LED on motherboard (when FB-DIMM Locate butt
ILOM Troubleshooting Overview ILOM enables you to remotely run diagnostics such as power-on self-test (POST), that would otherwise require physical proximity to the server’s serial port. You can also configure ILOM to send email alerts of hardware failures, hardware warnings, and other events related to the server or to ILOM. The service processor runs independently of the server, using the server’s standby power.
Note – No ILOM command is needed to manually repair an environmental fault. The service processor can automatically detect when a FRU is removed. In many cases, it does this even if the FRU is removed while the service processor is not running. Note – If the service processor does not automatically clear a fault state after the fault is corrected, you must perform these tasks manually. The procedure for clearing faults manually is described in “Clear FRU Faults Manually” on page 31.
How to Switch From the System Console to the Service Processor The following example shows the character sequence (hash-period) used to change from the system console to the service processor: ok #.
Service-Related ILOM Command Summary The following table describes the ILOM shell commands most frequently used when performing service related tasks. The middle column identifies the ALOM CMT command that produces the same result. TABLE: Service-Related Commands ILOM Command ALOM CMT Command Description help [command] help [command] Displays a list of all available commands with syntax and descriptions. Specifying a command name as an option displays help for that command.
TABLE: Service-Related Commands (Continued) ILOM Command ALOM CMT Command Description set /HOST/bootmode property= value [where property is state, config, or script] bootmode [normal] [reset_nvram] [config=configname] [bootscript= string] Controls the host server OpenBoot PROM firmware method of booting. stop /SYS; start /SYS powercycle [-f] The -f option forces an immediate poweroff. Otherwise the command attempts a graceful shutdown. Performs a poweroff followed by poweron.
TABLE: Service-Related Commands (Continued) ILOM Command ALOM CMT Command Description set /SYS/LOCATE value=value [Fast_blink | Off] setlocator value [on | off] Turns the Locator LED on the server on or off. (No ILOM equivalent.) showenvironment Displays the environmental status of the host server. This information includes system temperatures, power supply, front panel LED, hard drive, fan, voltage, and current sensor status. See “Display FRU Information With the show Command” on page 32.
Related Information ■ “Managing Components With Automatic System Recovery Commands” on page 50 Faults Displayed by show faulty The ILOM show faulty command will display the following kinds of fault information.
Example of show faulty Output When No Fault is Present -> show faulty Target | Property | Value --------------------+------------------------+----------------------------------------------------------------------------------------------------------- Example of show faulty Output for Environmental Faults -> show faulty Target | Property | Value --------------------+------------------------+------------------------------/SP/faultmgmt/0 | fru | /SYS/FANBD0/FM0 /SP/faultmgmt/0 | timestamp | Dec 14 23:01:32 /SP
PSH Technology -> show faulty Target | Property | Value --------------------+------------------------+------------------------------/SP/faultmgmt/0 | fru | /SYS/MB/CMP0/BR0/CH1/D0 /SP/faultmgmt/0 | timestamp | Dec 14 22:43:59 /SP/faultmgmt/0/ | sunw-msg-id | SUN4V-8000-DX faults/0 | | /SP/faultmgmt/0/ | uuid | 3aa7c854-9667-e176-efe5-e487e520 faults/0 | | 7a8a /SP/faultmgmt/0/ | timestamp | Dec 14 22:43:59 faults/0 | | Related Information ■ “Clear FRU Faults Manually” on page 31 ■ “Display FRU Informati
▼ Display FRU Information With the show Command ● At the -> prompt, enter the show command. The following example illustrates show command output for a memory module (FB-DIMM).
The service processor sends email alerts to all ALOM CMT users that are logged in. It also enters the event in the ILOM event log. 1. Log onto the service processor with username root. When powered on, the service processor boots to the ILOM login prompt. The factory default password is changeme. login: root Password: Waiting for daemons to initialize... Daemons ready Integrated Lights Out Manager Version 2.0.0.0 Copyright 2007 Sun Microsystems, Inc. All rights reserved.
3. Log out of the root account after you have finished creating the new account. -> exit 4. Log into the ALOM CLI shell (indicated by the sc> prompt) from the ILOM login prompt using the username and password you created in Step 2. login: admin Password: ******** Waiting for daemons to initialize... Daemons ready Integrated Lights Out Manager Version 2.0.0.0 Copyright 2007 Sun Microsystems, Inc. All rights reserved. Use is subject to license terms.
POST Overview Power-on self-test (POST) is a group of PROM-based tests that run when the server is powered on or when it is reset. POST checks the basic integrity of the critical hardware components in the server (CMP, memory, and I/O subsystem). If POST detects a faulty component, the component is disabled automatically. If the system is able to run without the disabled component, it will boot when POST completes its tests.
Note – The value of keyswitch_state must be normal when individual POST parameters are changed. TABLE: ILOM Properties Used to Manage POST Operations Parameter Values keyswitch_state normal diag_mode diag_level diag_trigger diag_verbosity Description The system can power on and run POST (based on the other parameter settings). This parameter overrides all other commands. diag The system runs POST based on predetermined settings. stby The system cannot power on.
FIGURE: Flowchart of ILOM Properties Used to Manage POST Operations Examples of POST Management This topic shows examples of the ILOM set command being used to configure POST behavior. The examples illustrate only a subset of the ILOM properties that can be used to control POST operations.
Note – When you change individual POST parameter values, the keyswitch_state value must be set to normal. keyswitch_state Set to normal You put POST in its default mode by setting the virtual keyswitch property to normal. This enables the system to turn on and for POST to run. -> set /SYS keyswitch_state=normal Set ‘keyswitch_state’ to ‘normal’ keyswitch_state Set to diag You can apply preconfigured diagnostic settings to POST operations by setting the virtual keyswitch property to diag.
▼ Run POST in Maximum Mode POST can be helpful when used as a first-stage diagnostic tool. When a fault’s symptoms are unclear, you can run POST in maximum mode to generate extensive status information on all the key system components. 1. From the ILOM prompt, set the virtual keyswitch to diag so that POST will run in service mode: -> set /SYS/keyswitch_state=Diag Set ‘keyswitch_state’ to ‘Diag’ 2. Reset the system so that POST runs. There are several ways to initiate a reset.
----------------------------------------------------------------2007-12-19 22:01:32.004 0:0:0>End : Neptune 1G Loopback Test Port 3 2007-12-19 22:01:32.012 0:0:0>INFO: 2007-12-19 22:01:32.019 0:0:0>POST Passed all devices. 2007-12-19 22:01:32.028 0:0:0>POST:Return to VBSC. 2007-12-19 22:01:32.036 0:0:0>Master set ACK for vbsc runpost command and spin... ----------------------------------------------------------------T5220, No Keyboard OpenBoot ..., 7968 MB memory available, Serial #75916434.
Note – The system can boot and run using memory that was not disabled. Related Information ■ “Clear POST-Detected Faults” on page 41 ■ “Examples of POST Management” on page 37 ■ “POST Output Quick Reference” on page 42 ▼ Clear POST-Detected Faults In most cases, when POST detects a faulty component, POST logs the fault and automatically takes the failed component out of operation by placing the component in the ASR blacklist.
2. Clear the fault by setting the FRU’s component_state property to Enabled. This will remove the component from the ASR blacklist. Use the FRU name that was reported in the fault in Step 1: -> set /SYS/MB/CMP0/BR1/CH0/D0 component_state=Enabled The fault is cleared and should not show up when you run the show faulty command. Additionally, the Service Required LED is no longer on. 3. Reset the server. You must reboot the server for the change to the component_state property to take effect. 4.
The following example. POST reports a memory error at FB-DIMM location /SYS/MB/CMP0/BR1/CH0/D0. The error was detected by POST running on core 7, strand 2. 7:2> 7:2>ERROR: TEST = Data Bitwalk 7:2>H/W under test = /SYS/MB/CMP0/BR1/CH0/D0 7:2>Repair Instructions: Replace items in order listed by 'H/W under test' above. 7:2>MSG = Pin 149 failed on /SYS/MB/CMP0/BR1/CH0/D0 (J2001) 7:2>END_ERROR 7:2>Decode of Dram Error Log Reg Channel 2 bits 60000000.
Solaris PSH Feature Overview The Solaris OS uses the Fault Manager daemon, fmd(1M), which starts at boot time and runs in the background to monitor the system. If a component generates an error, the daemon handles the error by correlating the error with data from previous errors and other related information to diagnose the problem. Once diagnosed, the Fault Manager daemon assigns the problem a Universal Unique Identifier (UUID) that distinguishes the problem across any set of systems.
acceptable levels. Refer to http://sun.com/msg/SUN4V-8000-DX for more information. AUTO-RESPONSE: Pages of memory associated with this memory module are being removed from service as errors are reported. IMPACT: Total system memory capacity will be reduced as pages are retired. REC-ACTION: Schedule a repair procedure to replace the affected memory module. Use fmdump -v -u to identify the module. PSH-detected faults also cause the Service Required LED to be turned on.
1. Check the event log using the fmdump command with -v for verbose output. # fmdump -v -u fd940ac2-d21e-c94a-f258-f8a9bb69d05b TIME UUID SUNW-MSG-ID Jul 31 12:47:42.2008 fd940ac2-d21e-c94a-f258-f8a9bb69d05b SUN4V-8000-JA 100% fault.cpu.ultraSPARC-T2.
Impact System performance may be affected. Suggested Action for System Administrator Schedule a repair procedure to replace the affected CPU, the identity of which can be determined using fmdump -v -u . Details The Message ID: SUN4V-8000-JA indicates diagnosis has determined that a CPU is faulty. The Solaris fault manager arranged an automated attempt to disable this CPU.... 3. Follow the suggested actions to repair the fault.
3. Use the clear_fault_action property of the FRU to clear the fault from the service processor. -> set /SYS/MB/CMP0/BR0/CH0/D0 clear_fault_action=True Are you sure you want to clear /SYS/MB/CMP0/BR0/CH0/D0 (y/n)? y Set ’clear_fault_action’ to ’true 4. Clear the fault from all persistent fault records. In some cases, even though the fault is cleared, some persistent fault information remains and results in erroneous fault messages at boot time.
The /var/adm directory contains several message files. The most recent messages are in the /var/adm/messages file. After a period of time (usually every week), a new messages file is automatically created. The original contents of the messages file are rotated to a file named messages.1. Over a period of time, the messages are further rotated to messages.2 and messages.3, and then deleted. 1. Log in as superuser. 2. Type the following command: # more /var/adm/messages 3.
The database that contains the list of disabled components is referred to as the ASR blacklist (asr-db). In most cases, POST automatically disables a faulty component. After the cause of the fault is repaired (FRU replacement, loose connector reseated, and so on), you might need to remove the component from the ASR blacklist. The following ASR commands enable you to view and add or remove components (asrkeys) from the ASR blacklist. You run these commands from the ILOM -> prompt.
● At the -> prompt, enter the show components command. In the following example, PCIE3 is shown as disabled.
-> start /SYS Are you sure you want to start /SYS (y/n)? y Starting /SYS Note – In the ILOM shell there is no notification when the system is actually powered off. Powering off takes about a minute. Use the show /HOST command to determine if the host has powered off.
Detecting Faults Using SunVTS Software This topic explains in general terms how to use SunVTS software to exercise system components. For detailed instructions on using SunVTS software, see the latest version of the SunVTS Software User’s Guide and any associated Release Notes. ■ “Run the SunVTS Software” on page 54 ▼ Run the SunVTS Software The following procedure description is based on use of the SunVTS software’s browser interface, which is the default interface.
FIGURE: SunVTS Browser Interface 4. (Optional) Select the test category you want to run. The following are test categories that are recommended for running on this server.
6. Click the Start button to start the test process. Status and error messages appear in the test messages area located across the bottom of the window. You can stop testing at any time by clicking the Stop button Status and error messages appear in the test messages area spread across the bottom of the window. Note – You can stop the test process at any time by clicking on the Stop button. 7. To check for SunVTS messages, click on the Logs tab.
56 SPARC Enterprise T5120 and T5220 Servers Service Manual • July 2009
Preparing to Service the System These topics describe how to prepare the SPARC Enterprise T5120 and T5220 servers for servicing.
Caution – There is a risk of personal injury or equipment damage. To avoid personal injury and equipment damage, follow the instructions. Caution – Hot surface. Avoid contact. Surfaces are hot and might cause personal injury if touched. Caution – Hazardous voltages are present. To reduce the risk of electric shock and danger to personal health, follow the instructions.
Antistatic Mat Place ESD-sensitive components such as motherboards, memory, and other PCBs on an antistatic mat. Essential Tools The following tools should be available for most service operations: ■ Antistatic wrist strap ■ Antistatic mat ■ No. 1 Phillips screwdriver ■ No. 2 Phillips screwdriver ■ No.
Properties: type = Host System keyswitch_state = Normal product_name = T5220 product_serial_number = 0723BBC006 fault_state = OK clear_fault_action = (none) power_state = On Commands: cd reset set show start stop Removing Power From the System These topics describe different methods for removing power from the chassis.
Note – Additional information about powering off the server is located in the SPARC Enterprise T5120 and T5220 Servers Administration Guide. 1. Log in as superuser or equivalent. Depending on the type of problem, you might want to view server status or log files. You also might want to run diagnostics before you shut down the server. Refer to the SPARC Enterprise T5120 and T5220 Servers Administration Guide for log file information. 2. Notify affected users that the server will be shut down.
▼ Power Off the Server (Power Button - Graceful) ● Press and release the Power button. If necessary, use a pen or pencil to press the Power button. Related Information ■ “Power Off the Server (Service Processor Command)” on page 60 ■ “Power Off the Server (Emergency Shutdown)” on page 62 ▼ Power Off the Server (Emergency Shutdown) Caution – All applications and files will be closed abruptly without saving changes. File system corruption might occur. ● Press and hold the Power button for four seconds.
▼ Extend the Server to the Maintenance Position The following components can be serviced with the server in the maintenance position: ■ Hard drives ■ Fan modules ■ Power supplies ■ DVD/USB module ■ Fan power boards ■ FB-DIMMs ■ PCIe/XAUI cards ■ Motherboard battery ■ SCC module If the server is installed in a rack with extendable slide rails, use this procedure to extend the server to the maintenance position. 1.
FIGURE: Slide Release Latches 4. While squeezing the slide release latches, slowly pull the server forward until the slide rails latch.
1. Disconnect all the cables and power cords from the server. 2. Extend the server to the maintenance position. See “Power Off the Server (Service Processor Command)” on page 60. 3. Press the metal lever that is located on the inner side of the rail to disconnect the cable management arm (CMA) from the rail assembly, as shown in the following figure. The CMA is still attached to the cabinet, but the server chassis is now disconnected from the CMA.
4. From the front of the server, pull the release tabs forward and pull the server forward until it is free of the rack rails as shown in the following figure. A release tab is located on each rail. FIGURE: Release Tabs and Slide Assembly 5. Set the server on a sturdy work surface. Accessing Internal Components These topics explain how to access components contained within the chassis and the steps needed to protect against damage or injury from electrostatic discharge.
▼ Perform Electrostatic Discharge Prevention Measures Many components housed within the chassis can be damaged by electrostatic discharge. To protect these components from damage, perform the following steps before opening the chassis for service. 1. Prepare an antistatic surface to set parts on during the removal, installation, or replacement process. Place ESD-sensitive components such as the printed circuit boards on an antistatic mat.
FIGURE: Removing the Top Cover 3. Remove the top cover. Lift up and remove the cover.
Servicing Hard Drives These topics explain how to remove and install hard drives in SPARC Enterprise T5120 and T5220 servers.
If either of these conditions exist, you must power off the server before replacing a hard drive.
The following table explains how to interpret the hard drive status LEDs. TABLE: Status LEDs for Hard Drives LED Color Description 1 Ready to Remove Blue Indicates that a hard drive can be removed during a hot-plug operation. 2 Service Required Amber Indicates that the hard drive is has experienced a fault condition. 3 OK/Activity (HDDs) Green Indicates the HDD’s availability for use. • On -- Drive is idle and available for use. • Off -- Read or write activity is in progress.
1. At the Solaris prompt, type the cfgadm -al command. This will list all drives in the device tree, including drives that are not configured. # cfgadm -al This command should identify the Ap_id for the hard drive you plan to remove, as shown below.
FIGURE: Locating the Hard Drive Release Button and Latch Caution – The latch is not an ejector. Do not bend the latch too far to the right. Doing so can damage the latch 5. Grasp the latch and pull the drive out of the drive slot.
Note – SPARC Enterprise T5120 servers might have up to seven blank panels covering unoccupied drive slots. SPARC Enterprise T5220 servers might have as many as fifteen blank panels covering unoccupied hard drive slots. 2. Align the replacement drive to the drive slot. Hard drives are physically addressed according to the slot in which they are installed. If you install a hard drive as a replacement for a drive that was removed, the new drive must go into the same slot as the drive it is replacing.
4. At the Solaris prompt, type the cfgadm -al command. This will list all drives in the device tree, including drives that are not configured. # cfgadm -al This command should identify the Ap_id for the hard drive you plan to remove, as shown below.
7. At the Solaris prompt, type the cfgadm -al command to list all drives in the device tree, including any drives that are not configured. # cfgadm -al This command should identify the Ap_id for the hard drive that you installed. The output should indicate that the drive you installed is configured.
Four-Drive Capable Backplane Configuration Reference The following table shows the physical hard drive locations in a four-drive capable backplane. TABLE: Physical Drive Locations in a Four-Drive Capable Backplane DVD HDD0 HDD1 HDD2 HDD3 The following table matches the FRU names and the default OpenBoot PROM/Solaris drive pathnames with the physical drive locations in a four-drive capable backplane.
Eight-Drive Capable Backplane Configuration Reference The first table below identifies the hard drive slot numbering in an eight-drive capable backplane. The second table matches the FRU names and the default OpenBoot PROM/Solaris drive pathnames with the physical drive locations in an eight-drive capable backplane.
Sixteen-Drive Capable Backplane Configuration Reference The first table below identifies the hard drive slot numbering in a sixteen-disk capable backplane. The second table matches the FRU names and the default OpenBoot PROM/Solaris drive pathnames with the physical drive locations.
TABLE: Physical Drive Locations, FRU Addresses, and Default Drive Pathnames for a Sixteen-Disk Capable Backplane (Continued) Physical Location FRU Address OpenBoot PROM/Solaris Default Drive Pathname HDD14 /SYS/HDD14 c0::dsk/c1t14d0 HDD15 /SYS/HDD15 c0::dsk/c1t15d0 DVD /SYS/DVD Related Information 80 ■ “Install a Hard Drive” on page 73 ■ “Remove a Hard Drive” on page 71 ■ “Four-Drive Capable Backplane Configuration Reference” on page 77 ■ “Eight-Drive Capable Backplane Configuration Re
Servicing Motherboard Components These topics explain how to replace the motherboard and its components in the SPARC Enterprise T5120 and SPARC Enterprise T5220 servers.
Memory Fault Handling Overview A variety of features play a role in how the memory subsystem is configured and how memory faults are handled. Understanding the underlying features helps you identify and repair memory problems. The following server features manage memory faults: ■ POST – By default, POST runs when the server is powered on. For correctable memory errors (CEs), POST forwards the error to the Solaris Predictive Self-Healing (PSH) daemon for error handling.
▼ Identify Faulty FB-DIMMs Using the show faulty Command The ILOM show faulty command displays current system faults, including FB-DIMM failures. ● Enter show faulty at the -> prompt.
Note – The FB-DIMM Fault Locator button is near the left edge of the motherboard (as viewed from the front panel). It has the label SW6500 in the following figure. FIGURE: FB-DIMM Fault Locator Button on the Motherboard 6. Note the FB-DIMM next to the illuminated LED. 7. Ensure that all other FB-DIMMs are seated correctly in their slots.
Related Information ■ “Identify Faulty FB-DIMMs Using the show faulty Command” on page 83 ▼ Remove FB-DIMMs Before beginning this procedure, ensure that you are familiar with the cautions and safety instructions described in “General Safety Information” on page 57. Caution – Do not leave FB-DIMM slots empty. You must install filler panels in all empty FB-DIMM slots. 1. Extend the server to the maintenance position. See “Extend the Server to the Maintenance Position” on page 63. 2.
FIGURE: Removing FB-DIMMs 6. Press the Fault Locator button on the motherboard to identify the FB-DIMMs that need to be replaced. Tip – Make a note of the faulty FB-DIMM location. Note – For memory configuration information, see “FB-DIMM Configuration Guidelines” on page 95. 7. Push down on the ejector tabs on each side of the FB-DIMM until the FB-DIMM is released.See FIGURE: Removing FB-DIMMs on page 86. See panel 3 in the preceding figure.
9. Place the FB-DIMM on an antistatic mat. 10. Repeat Step 7 through Step 9 for any other FB-DIMMs you intend to remove. 11. If you do not plan to install replacement FB-DIMMs at this time, install filler panels in the empty slots.
FIGURE: Installing FB-DIMMs 7. Align the FB-DIMM notch with the key in the connector. Caution – Ensure that the orientation is correct. The FB-DIMM might be damaged if the orientation is reversed. 8. Push the FB-DIMM into the connector until the ejector tabs lock the FB-DIMM in place. If the FB-DIMM does not easily seat into the connector, verify the FB-DIMM orientation. 9. Repeat Step 6 through Step 8 until all new FB-DIMMs are installed. 10.
Note – As soon as the power cords are connected, standby power is applied. Depending on how the firmware is configured, the system might boot at this time. Related Information ■ “Remove FB-DIMMs” on page 85 ■ “Verify Successful Replacement of Faulty FB-DIMMs” on page 89 ▼ Verify Successful Replacement of Faulty FB-DIMMs 1. Access the ILOM -> prompt. Refer to the Sun Integrated Lights Out Manager (ILOM) 3.0 Supplement for Sun SPARC Enterprise T5120 and T5220 Servers for instructions. 2.
-> start /SYS Are you sure you want to start /SYS (y/n)? y Starting /SYS Note – The server takes about one minute to power off. Use the show /HOST command to determine when the host has been powered off. The console will display status=Powered Off. c. Switch to the system console to view POST output. Watch the POST output for possible fault messages. The following output indicates that POST did not detect any faults: -> start /SYS/console . . . 0:0:0>INFO: 0:0:0> POST Passed all devices.
6. Run the show faulty command. -> show faulty Target | Property | Value --------------------+------------------------+------------------------------/SP/faultmgmt/0 | fru | /SYS/MB/CMP0/BR0/CH1/D0 /SP/faultmgmt/0 | timestamp | Dec 14 22:43:59 /SP/faultmgmt/0/ | sunw-msg-id | SUN4V-8000-DX faults/0 | | /SP/faultmgmt/0/ | uuid | 3aa7c854-9667-e176-efe5-e487e520 faults/0 | | 7a8a /SP/faultmgmt/0/ | timestamp | Dec 14 22:43:59 faults/0 | | If the show faulty command reports a fault with a UUID go on to Step 7.
Caution – You must disconnect the power cables from the system before performing this procedure. 1. Unpack the replacement FB-DIMMs and place them on an antistatic mat. 2. (SPARC Enterprise T5120. 8-drive capable server) Disconnect and stow the hard drive data cable. a. Unplug the hard drive data cable from J6401 on the motherboard. b. Remove the hard drive data cable from its seat on the CMP air duct. c. Place the hard drive cable end out of the way of the air duct. 3.
Note – If the FB-DIMM does not easily seat into the connector, it may not have the correct orientation. If the orientation is reversed, damage to the FB-DIMM might occur. 8. Repeat Step 5 through Step 7 until all FB-DIMMs are installed. 9. Rotate the air duct back into its operating position. The air duct snaps into position above the CMP and memory modules. 10. (SPARC Enterprise server, 8-drive capable) Reconnect the hard drive data cable. a.
-> start /SYS Are you sure you want to start /SYS (y/n)? y Starting /SYS Note – The server takes about one minute to power off. The ILOM console does not indicate when the system is actually powered off. c. Switch to the system console to view POST output. -> start /SYS/console Watch the POST output for possible fault messages. The following output is a sign that POST did not detect any faults: . . . 0:0:0>INFO: 0:0:0> POST Passed all devices. 0:0:0>POST: Return to VBSC.
FB-DIMM Configuration Guidelines Use the guidelines described in this topic when installing, upgrading, or replacing FB-DIMMs: ■ There are a total of 16 slots that support industry-standard FB-DIMMs. ■ Supported FB-DIMM capacities are 1 GByte, 2 GByte, 4 GByte, and 8 GByte. ■ Valid quantities of FB-DIMMs are 4, 8, or 16. ■ All FB-DIMMs in the server must be the same capacity. ■ All FB-DIMMs in a branch must have the same part number. Note – FB-DIMMs that run on 1.
FB-DIMM Configuration Reference The following figure illustrates the physical arrangement of FB-DIMM slots on the motherboard.
FIGURE: FB-DIMM Slot Layout on the Motherboard Figure Legend 1 Branch 3 FB-DIMM slots 2 Branch 2 FB-DIMM slots 3 Branch 0 FB-DIMM slots 4 Branch 1 FB-DIMM slots 5 FB-DIMM fault locator button Note: Pressing the fault locator button causes the LED next to any faulty FB-DIMM to turn on.
The following table maps FB-DIMM locations with FB-DIMM FRU names. The FRU name is displayed in memory faults. Use this table to identify the motherboard location of an FB-DIMM FRU name.
FIGURE: Slot Use Map for Quantities of 4, 8, and 16 FB-DIMMs Figure Legend 1 4 FB-DIMM configuration 2 8 FB-DIMM configuration 3 16 FB-DIMM configuration Servicing Motherboard Components 99
Related Information ■ “Identify Faulty FB-DIMMs Using the show faulty Command” on page 83 ■ “Remove FB-DIMMs” on page 85 ■ “Install Replacement FB-DIMMs” on page 87 ■ “Verify Successful Replacement of Faulty FB-DIMMs” on page 89 ■ “Upgrade Memory Configuration With Additional FB-DIMMs” on page 91 Servicing the Air Duct These topics explain how to remove and replace the air duct.
3. (SPARC Enterprise T5120 server; 8 drive-capable) Disconnect and stow the hard drive data cable. a. Route the hard drive data cable over the fan module and along the air duct. b. Plug the data cable into J6401 on the motherboard. 4. Open the air duct. Disengage the rear of the air duct from the motherboard and rotate the air duct forward. 5. Press in the edges of the air duct to disengage its pins from the chassis. 6. Set the air duct aside.
Servicing PCIe/XAUI Risers These topics explain how to service the riser units that support PCIe and XAUI cards and how to remove and install the I/O cards themselves.
2. Disconnect all power cables. See “Disconnect Power Cords From the Server” on page 62. 3. Attach an antistatic wrist strap. 4. Disconnect any data cables connected to the cards on the PCIe/XAUI riser being removed. Label the cables to ensure proper connection later. 5. Slide the server out of the rack. See “Extend the Server to the Maintenance Position” on page 63 6. If you are servicing a PCIe/XAUI card, locate its position in the system. 7. Remove the PCI cross beam. a.
FIGURE: Removing the PCIe/XAUI Riser (SPARC Enterprise T5220 Server) 8. Loosen the captive screw securing the riser to the motherboard. 9. Lift the riser up to remove it from the system. Remove the riser and any PCIe/XAUI cards attached to it as a unit. Related Information ■ “Install a PCIe/XAUI Riser” on page 104 ■ “Remove a PCIe or XAUI Card” on page 106 ■ “Install a PCIe or XAUI Card” on page 107 ▼ Install a PCIe/XAUI Riser 1.
FIGURE: Installing the PCIe/XAUI Riser (SPARC Enterprise T5120) FIGURE: Installing the PCIe/XAUI Riser (SPARC Enterprise T5220) 4. Install the PCI cross beam. Slide the cross beam forward over the PCIe/XAUI risers. Ensure that the cross beam is engaged with the standoffs on either side of the chassis rear panel PCI cross beam.
5. Engage the two captive Phillips screws on both sides of the removable PCI cross beam and tighten the two screws to secure the removable PCI cross beam to the chassis. 6. Install the top cover. See “Install the Top Cover” on page 175. 7. Slide the server into the rack. See “Return the Server to the Normal Rack Position” on page 177. 8. Connect any data cables you removed to service the PCIe/XAUI cards. 9. Connect all power cables. See “Connect Power Cords to the Server” on page 178.
■ SPARC Enterprise T5220: PCIe filler panels are located on the riser board assembly. Press the filler panel into the riser board back panel from the rear. Caution – To ensure proper system cooling and EMI shielding, you must use the appropriate PCIe filler panel for the server. Related Information ■ “Install a PCIe or XAUI Card” on page 107 ■ “Remove a PCIe/XAUI Riser” on page 102 ■ “Install a PCIe/XAUI Riser” on page 104 ▼ Install a PCIe or XAUI Card 1.
FIGURE: Installing a PCIe Card (SPARC Enterprise T5120) ■ 108 SPARC Enterprise T5220 servers: PCIe filler panels are located on the riser board assembly. Press the filler panel in from the rear until it snaps into place as shown in the following figure.
FIGURE: Installing a PCIe Card (SPARC Enterprise T5220) 6. Insert the PCIe/XAUI card into the correct slot on the riser board. 7. Replace the PCIe/XAUI riser. See “Install a PCIe/XAUI Riser” on page 104. 8. Install the top cover. See “Install the Top Cover” on page 175. 9. Slide the server into the rack. See “Return the Server to the Normal Rack Position” on page 177. 10. Connect any data cables required to the PCIe/XAUI card. Route data cables through the cable management arm.
11. Connect the power supplies. See “Connect Power Cords to the Server” on page 178 Note – As soon as the power cords are connected, standby power is applied. Depending on how the firmware is configured, the system might boot at this time. 12. Power on the server. See “Power On the Server Using the poweron Command” on page 179 or “Power On the Server Using the Front Panel Power Button” on page 180.
* Slots 0 and 1 are shared PCIe/XAUI slots. You can only install one or the other type of card. † Slots 0 and 1 are shared PCIe/XAUI slots. You can only install one or the other type of card. PCIe and XAUI Card Reference for SPARC Enterprise T5220 Servers The following table shows the physical PCIe/XAUI slot locations on the SPARC Enterprise T5220 server, as viewed from the rear of the system.
Related Information ■ “Remove a PCIe or XAUI Card” on page 106 ■ “Install a PCIe or XAUI Card” on page 107 ■ “Remove a PCIe/XAUI Riser” on page 102 ■ “Install a PCIe/XAUI Riser” on page 104 Servicing the Battery These topics explain how to replace a faulty battery ■ “System Battery Overview” on page 112 ■ “Remove a Battery” on page 113 ■ “Install a Battery” on page 114 System Battery Overview The battery maintains system time when the server is powered off and a time server is unavailable.
FIGURE: Battery Location (SPARC Enterprise T5120 Server Shown) Related Information ■ “Remove a Battery” on page 113 ■ “Install a Battery” on page 114 ▼ Remove a Battery 1. Remove PCIe/XAUI riser 2. See “Remove a PCIe/XAUI Riser” on page 102. 2. Using a No. 1 flat-blade screwdriver, press the latch and remove the battery from the motherboard.
▼ Install a Battery 1. Unpack the replacement battery. 2. Press the new battery into the battery holder on the motherboard. Install with the positive side (+) facing upward, away from the motherboard. 3. Install PCIe/XAUI riser 2. See “Install a PCIe/XAUI Riser” on page 104. 4. Use the ILOM setdate command to set the day and time. See the Sun Integrated Lights Out Manager (ILOM) 3.0 Supplement for Sun SPARC Enterprise T5120 and T5220 Servers. 5.
■ Replacing a faulty SCC module -- When replacing a faulty SCC module, you must obtain the host ID, MAC addresses, and ILOM configuration settings stored in the SCC module you are replacing. This will enable you to configure them into new SCC module. See “Remove a Faulty SCC Module” on page 115 and “Install a New SCC Module” on page 116 for additional information. Note – Some firmware variable settings are not stored in the SCC module.
Note – The server will not function correctly without the SCC module installed. 8. Pull the SCC module straight up from its connector. Related Information ■ “SCC Module Overview” on page 114 ■ “Install a New SCC Module” on page 116 ▼ Install a New SCC Module Caution – This procedure requires that you handle components that are sensitive to electrostatic discharge. This discharge can cause server components to fail. 1. Unpack the replacement SCC module and set it on an antistatic mat. 2.
9. If the previous SCC module had modified ILOM configuration variables and you recorded them, configure the new SCC module with those values. Related Information ■ “SCC Module Overview” on page 114 ■ “Remove a Faulty SCC Module” on page 115 ■ “Servicing the Motherboard Assembly” on page 117 Servicing the Motherboard Assembly These topics explain how to remove and install the motherboard assembly.
Note – The firmware configuration variable settings are not stored in the SCC module. If you replace the motherboard, these settings will become the factory default settings. If possible, keep a record of any firmware variables that have been changed from the factory default values so you can configure the new motherboard with those settings.
Note – Make note of the location of expansion cards in PCIe/XAUI risers 0 and 1. 10. Disconnect the motherboard-to-power distribution board ribbon cable. 11. Disconnect the hard drive data cables: a. Press the latching mechanism on the connector to release the cable plug. If you have difficulty releasing the cable plug, first push the plug slightly into the connector, then press the latching mechanism. b. Keeping the latching mechanism pressed, pull the plug from the connector on the hard drive backplane.
FIGURE: Removing the Motherboard Assembly (SPARC Enterprise T5120 Server Shown) 16. Place the motherboard assembly on an antistatic mat. Related Information ■ “Install the Motherboard Assembly” on page 120 ▼ Install the Motherboard Assembly Caution – This procedure requires that you handle components that are sensitive to static discharge. Static discharges can cause the components to fail. 1. Tilt the motherboard assembly to position it into the chassis.
FIGURE: Installing the Motherboard Assembly (SPARC Enterprise T5120 Server) 3. Using the green handle and the back edge of the motherboard tray, push down firmly and equally while sliding the motherboard to the front of the chassis. Tip – After installing the motherboard into the chassis, ensure that the motherboard is correctly seated by gently lifting up on the handles. If the board moves upward, then it is not correctly seated. Ensure that the motherboard tray sits flush with the chassis floor.
6. If you are installing a new motherboard, install the following components: a. All FB-DIMMs removed from the previous motherboard. Ensure that the FB-DIMM modules are installed in the same memory configuration as they were in before. See “FB-DIMM Configuration Guidelines” on page 95. b. SCC module. See “SCC Module Overview” on page 114. 7. Connect the hard drive data cables.
Servicing Fan Modules These topics explain how to service faulty fan modules. ■ “Fan Module Overview” on page 123 ■ “Remove a Fan Module” on page 125 ■ “Install a Fan Module” on page 127 Related Information ■ “Preparing to Service the System” on page 57 Fan Module Overview The fan modules are mounted across the width of the chassis between the hard drive cage and the CPU modules. They are accessed by lifting the top cover door.
Fan Module Configurations for SPARC Enterprise T5120 Servers (4- and 8-Disk Capable) The following table shows the FRU device names for the fan modules in the four hard drive capable SPARC Enterprise T5120 server.
Fan Module Status LEDs Each fan module contains a pair of LEDs, which are visible when you open the fan compartment access door. The following table describes the status LEDs located on the fan modules. TABLE: Fan Module Status LEDs LED Color Notes Power OK Green This LED is lit when the system is powered on and the fan module is functioning correctly. Service Required Amber This LED is lit when the fan module is faulty. In addition, the system Fan Fault LED is lit.
1. Extend the server to the maintenance position. See “Extend the Server to the Maintenance Position” on page 63. 2. Lift the latch and open the top cover door. Caution – The system might start to overheat if the top cover door is left open for more than 60 seconds. 3. The faulty fan module is identified with a corresponding fault LED. On SPARC Enterprise T5120 servers, the Fan Fault LEDs are located on the fan board. On SPARC Enterprise T5220 servers, the Fan Fault LEDs are located on the fan modules. 4.
FIGURE: Removing a Fan Module Related Information ■ “Extend the Server to the Maintenance Position” on page 63 ▼ Install a Fan Module Caution – To ensure proper system cooling, be certain to install the replacement fan module in the same slot from which the faulty fan was removed. 1. With the top cover door open, install the replacement fan module into the server. The fan modules are keyed to ensure that they are installed facing in the correct direction.
FIGURE: Installing a Fan Module 2. Apply firm pressure to fully seat the fan module. 3. Verify that the Fan Fault LED on the replaced fan module is off. 4. Close the top cover door. 5. Verify that the system Fan Fault LED, Service Required LEDs, and the individual fan module Fault LED are off. 6. Run the ILOM show faulty command to verify that the fan fault has been cleared. See “Detecting Faults With ILOM” on page 22 for more information on using the show faulty command.
Servicing Power Supplies The topics explain how to remove and replace power supply modules. ■ “Power Supplies Overview” on page 129 ■ “Remove a Power Supply” on page 131 ■ “Install a Power Supply” on page 134 ■ “Power Supply Configuration Reference” on page 136 Power Supplies Overview These servers are equipped with redundant hot-swappable power supplies. With redundant power supplies, you can remove and replace a power supply without shutting the server down.
FIGURE: Power Supply LEDs (SPARC Enterprise T5120 Server Shown) The following table describes the three power supply LEDs TABLE: Power Supply Status LEDs Legend LED Icon 1 OK Green This LED lights when the power supply DC voltage from the PSU to the server is within tolerance. 2 Fault Amber This LED is lit when the power supply is faulty. Note - The front and rear panel Service Required LEDs are also lit if the system detects a power supply fault.
■ “Servicing Power Supply Backplanes (SPARC Enterprise T5220 Servers)” on page 167 ■ “Remove a Power Supply” on page 131 ■ “Install a Power Supply” on page 134 ▼ Remove a Power Supply Caution – Hazardous voltages are present. To reduce the risk of electric shock and danger to personal health, follow the instructions. 1. Move to the rear of the server chassis so you can view the power supply status LEDs. The amber Fault LED on the failed power supply will be on.
FIGURE: Cable management Arm Release Mechanism 4. Based on the model of your server (AC or DC), remove power from the server in one of the following ways: ■ AC server models – Disconnect the power cord from the faulty power supply. ■ DC server models – Turn off the power using the circuit breaker on the power source. Caution – For server models with DC input power, do not disconnect the power cable at the Wago connector on the server DC power supply unit.
FIGURE: Power Supply Release Handle (SPARC Enterprise T5120 Servers) FIGURE: Power Supply Release Handle (SPARC Enterprise T5220 Servers) 6. Pull the power supply out of the chassis.
▼ Install a Power Supply 1. Align the replacement power supply with the empty power supply chassis bay. 2. Slide the power supply into the bay until it is fully seated.
FIGURE: Installing a Power Supply (SPARC Enterprise T5220 Server) 3. Based on the model of your server (AC or DC), apply power to the power supply in one of the following ways: ■ AC server models – Connect the power cord to the power supply. ■ DC server models – Turn on the power using the circuit breaker at the power source. Caution – For server models with DC input power, always remove power by turning off the power at the power source circuit breaker.
7. At the ALOM CMT sc> prompt, type the showenvironment command to verify the status of the power supplies. Power Supply Configuration Reference The following table shows the positions of the power supplies in a SPARC Enterprise T5120 server as viewed from the server rear panel.
Servicing Boards and Components These topics explain how to service field-replaceable units (FRUs) in SPARC Enterprise T5120 and T5220 servers.
TABLE: Components That Require Removal of System Power Before Servicing is Performed Component Servicing procedures Hard drive backplane “Servicing the Hard Drive Backplane” on page 152 Front control panel light pipe “Servicing Front Control Panel Light Pipe Assemblies” on page 156 Power distribution board “Servicing Power Distribution Boards” on page 160 Power supply backplane (SPARC Enterprise T5220 server) “Servicing Power Supply Backplanes (SPARC Enterprise T5220 Servers)” on page 167 Paddle
Related Information ■ “Remove the Hard Drive Backplane” on page 152 DVD/USB Module Overview The DVD ROM drive and front USB board are mounted in a removable module that is accessed from the system’s front panel. The DVD/USB module must be removed from the hard drive cage in order to service the hard drive backplane. FIGURE: DVD/USB Module in a SPARC Enterprise T5120 Server The Hard Drive backplane supports either a SATA DVD or a PATA DVD, depending on when it was manufactured.
2. Unplug the power cords. See “Disconnect Power Cords From the Server” on page 62. 3. Attach an antistatic wrist strap. 4. Remove the hard drive that is adjacent to the DVD/USB module. The number of this HDD will vary, depending on the backplane type: ■ 4-disk capable backplane: remove HDD3 See “Four-Drive Capable Backplane Configuration Reference” on page 77. ■ 8-disk capable backplane: remove HDD7 See “Eight-Drive Capable Backplane Configuration Reference” on page 78.
FIGURE: Removing the DVD/USB Module (illustrates removal from a SPARC Enterprise T5120 server) 6. Slide the DVD/USB module out of the hard drive cage. 7. Place the module on an antistatic mat. Related Information ■ “Install the DVD/USB Module” on page 141 ■ “Servicing the Hard Drive Backplane” on page 152 ▼ Install the DVD/USB Module Caution – Be certain the DVD type and Hard Drive backplane are compatible: both are SATA or both are PATA types.
FIGURE: Installing the DVD/USB Module (Illustrates installing in a SPARC Enterprise T5120 server) 2. Slide the pull tab back into the system. 3. Install the hard drive you removed during the DVD/USB module removal procedure. 4. Plug in the power cords. See “Connect Power Cords to the Server” on page 178. 5. Power on the system. See “Power On the Server Using the poweron Command” on page 179 or “Power On the Server Using the Front Panel Power Button” on page 180.
Servicing Fan Power Boards These topics explain how to remove and install fan power boards. ■ “Fan Power Board Overview” on page 143 ■ “Remove the Fan Power Board” on page 143 ■ “Install the Fan Power Board” on page 145 Related Information ■ “Remove the Hard Drive Backplane” on page 152 Fan Power Board Overview Fan power boards carry power to the system fan modules. They also contain fan module status LEDs and carry status and control data for the fan modules.
2. Disconnect the power cables. See “Disconnect Power Cords From the Server” on page 62. 3. Extend the server into the maintenance position. See “Extend the Server to the Maintenance Position” on page 63. Note – If you are removing the fan power boards to service the paddle card or hard drive cage, you must remove the server from the rack. See the topic “Remove the Server From the Rack” on page 64. 4. Attach an antistatic wrist strap. 5. Remove the top cover. See “Remove the Top Cover” on page 67. 6.
Related Information ■ “Install the Fan Power Board” on page 145 ▼ Install the Fan Power Board 1. Lower the board into its mushroom standoffs in the chassis floor and slide the board to the right into the paddle card. FIGURE: Installing a Fan Power Board (Illustrates installation in a SPARC Enterprise T5120 server) 2. Secure the board to the chassis with a Phillips screw. 3. Install the fan modules. See “Install a Fan Module” on page 127. 4. Install the top cover. See “Install the Top Cover” on page 175.
Related Information ■ “Remove the Fan Power Board” on page 143 Servicing the Hard Drive Cage These topics explain how to remove and install the hard drive cage.
2. Disconnect all external cables. 3. Remove the server from the rack. Place the server on a hard, flat surface. See “Remove the Server From the Rack” on page 64. 4. (SPARC Enterprise T5120) Remove the inner glides from the server. Each inner glide is secured with a locking tab. Release the tab and slide each inner glide off the server mounting studs. 5. Attach an antistatic wrist strap. 6. Remove the top cover. See “Remove the Top Cover” on page 67. 7.
FIGURE: Removing a Hard Drive Cage (Illustrating Removal From a SPARC Enterprise T5120 Server) 14. Disconnect the hard drive data cables. a. Press the release button. b. Remove the plug from the connector on the hard drive backplane. See panel 4 in the preceding figure. Caution – The hard drive data cables are delicate. Ensure that they are safely out of the way when servicing the motherboard. 15. Lift the hard drive cage up and out of the chassis. 16. Set the hard drive cage on an antistatic mat.
■ “Remove the Hard Drive Backplane” on page 152 ▼ Install the Hard Drive Cage Before performing any installation steps, review the proper cable routing and connections. The following topics contain detailed cable routing information. ■ “Internal Cables for Onboard SAS Controller Cards in SPARC Enterprise T5120 Servers” on page 188 ■ “Internal Cables for Onboard SAS Controller Cards in SPARC Enterprise T5220 Servers” on page 202 1.
FIGURE: Installing a Hard Drive Cage (Illustrating Installation in a SPARC Enterprise T5220 Server) 2. Connect the hard drive data cables (panel 1). Follow the proper cable routing for your server model.
3. (SPARC Enterprise T5120 server, 8 disk-capable) Remove fan FM1. 4. Slide the hard drive cage back until the hard drive backplane engages with the paddle card connector. Caution – Use care when installing the hard drive cage in the chassis. Align the hard drive cage with the base of the chassis before sliding the cage back. This care is needed to avoid damaging components. 5. Replace the No. 2 Phillips screws securing the hard drive cage to the chassis.
14. Power on the system. See “Power On the Server Using the poweron Command” on page 179. Related Information ■ “Remove the Hard Drive Cage” on page 146 Servicing the Hard Drive Backplane These topics explain how to remove and install hard drive backplanes. ■ “Hard Drive Backplane Overview” on page 152 ■ “Remove the Hard Drive Backplane” on page 152 ■ “Install the Hard Drive Backplane” on page 154 Hard Drive Backplane Overview The hard drive backplane is housed in the hard drive cage.
■ Four screws secure the backplane in the SPARC Enterprise T5220 server. See the second figure below.
FIGURE: Removing a Hard Drive Backplane (Illustrating removal from a SPARC Enterprise T5220 server) 3. Slide the backplane down and off the hard drive cage retention hooks. 4. Place the hard drive backplane on an antistatic mat. Related Information ■ “Install the Hard Drive Backplane” on page 154 ▼ Install the Hard Drive Backplane 1. Slide the backplane under the retention hooks on the hard drive cage. 2. Install the No. 1 Phillips screws that secure the backplane to the hard drive cage.
FIGURE: Installing a Hard Drive Backplane in a SPARC Enterprise T5120 Server Servicing Boards and Components 155
FIGURE: Installing a Hard Drive Backplane in a SPARC Enterprise T5220 Server 3. Install the hard drive cage. See “Install the Hard Drive Cage” on page 149. Related Information ■ “Remove the Hard Drive Backplane” on page 152 Servicing Front Control Panel Light Pipe Assemblies These topics explain how to remove and install front control panel light pipe assemblies.
Front Control Panel Light Pipe Assemblies Overview The front control panel light pipe assemblies are mounted on each side of the hard drive cage. You must remove the hard drive cage to access the screws that attach the light pipe assemblies to the hard drive cage. ▼ Remove the Front Control Panel Light Pipe Assemblies 1. Remove the hard drive cage. See “Remove the Hard Drive Cage” on page 146. 2. Remove the No. 1 Phillips screws securing the front control panel light pipe assembly to the hard drive cage.
FIGURE: Removing the Front Control Panel Light Pipe Assembly From a SPARC Enterprise T5220 Server 3. Slide the light pipe assembly out of the control panel. Related Information ■ “Install the Front Control Panel Light Pipe Assemblies” on page 158 ■ “Remove the Hard Drive Cage” on page 146 ▼ Install the Front Control Panel Light Pipe Assemblies 1. Insert the light pipe assembly into the control panel. 2. Align the control panel light pipe assembly with the mounting holes on the hard drive cage.
FIGURE: Installing a Front Control Panel Light Pipe Assembly in a SPARC Enterprise T5220 Server 3. Secure the light pipe assembly with the No. 1 Phillips screws. ■ Two screws secure the assembly to the hard drive cage in the SPARC Enterprise T5120 server. ■ Three screws secure the assembly to the hard drive cage in the SPARC Enterprise T5220 server. 4. Install the hard drive cage. See “Install the Hard Drive Cage” on page 149.
Servicing Power Distribution Boards The following topics explain how to remove and install power distribution boards. They also provide important safety information related to working with power distribution boards. ■ “Power Distribution Board Overview” on page 160 ■ “Remove the Power Distribution Board” on page 161 ■ “Install the Power Distribution Board” on page 163 Related Information ■ .
▼ Remove the Power Distribution Board 1. Note the chassis serial number and part number. The chassis serial number and server part number are printed on a label affixed to the side of the chassis. 2. Remove the motherboard assembly. See “Remove the Motherboard Assembly” on page 118. 3. (SPARC Enterprise T5120 server) Remove all power supplies. a. Grasp the power supply handle and press the release latch. See the following figure. b. Slide the power supply out of the system.
FIGURE: Removing a Power Distribution Board From a SPARC Enterprise T5220 Server 6. (SPARC Enterprise T5220 server) Remove the four No. 2 Phillips screws securing the power distribution board to the power supply backplane. See Panel 2 in the previous figure. 7. Remove the No. 2 Phillips screw securing the power distribution board to the chassis.
FIGURE: Removing the Power Distribution Board From a SPARC Enterprise T5120 Server 8. Grasp the bus bar and pull the power distribution board/bus bar assembly to the left, away from the paddle card. 9. Lift the power distribution board/bus bar assembly up and out of the system. 10. Place the power distribution board/bus bar assembly on an antistatic mat. Related Information ■ “Install the Power Distribution Board” on page 163 ▼ Install the Power Distribution Board 1.
FIGURE: Installing a Power Distribution Board in a SPARC Enterprise T5120 Server 3. Install the No. 2 Phillips screw to secure the power distribution board to the chassis. 4. (SPARC Enterprise T5220 server) Attach the four No. 2 Phillips screws securing the power distribution board to the power supply backplane.
FIGURE: Installing a Power Distribution Board in a SPARC Enterprise T5220 Server 5. (SPARC Enterprise T5220 server) Connect the power supply backplane ribbon cable to its plug on the power distribution board. 6. Connect the top cover interlock cable to the power distribution board. 7. (SPARC Enterprise T5120 server) Install the power supplies. Slide each power supply into its bay until the power supply locks into place.
FIGURE: Installing a Power Supply in a SPARC Enterprise T5120 Server 8. Install the motherboard assembly. See “Install the Motherboard Assembly” on page 120. Note – After replacing the power distribution board and powering on the system, you must run the ALOM CMT setcsn and setcpn commands to set the electronically readable chassis serial number and server part number. 9.
Caution – When performing the following steps, use special care to enter the correct numbers. Once the power distribution board has been programmed with a chassis serial number or server part number, the number cannot be changed. sc> setsc sc_servicemode true Warning: misuse of this mode may invalidate your warranty. sc> setcsn -c chassis_serial_number Are you sure you want to permanently set the Chassis Serial Number to chassis_serial_number [y/n]? y setcsn: Chassis serial number recorded.
Power Supply Backplane Overview The power supply backplane carries 12V power from the power supplies to the power distribution board over a pair of bus bars. Note – SPARC Enterprise T5120 servers do not use a power supply backplane. In these systems, the power supplies connect directly to the power distribution board. Caution – The system supplies standby power to the power supply backplane even when the server is powered off.
FIGURE: Removing a Power Supply From a SPARC Enterprise T5220 Server 3. Remove the power distribution board. See “Remove the Power Distribution Board” on page 161. 4. Remove the No. 2 Phillips screw securing the power supply backplane to the power supply bay. 5. Lift the power supply backplane up and off its standoffs and out of the system. FIGURE: Removing a Power Supply Backplane From a SPARC Enterprise T5220 Server 6. Place the power supply backplane on an antistatic mat.
Related Information ■ “Install the Power Supply Backplane” on page 170 ▼ Install the Power Supply Backplane 1. Mount the power supply backplane to the front of the power supply bay. Place the backplane over its standoffs. Press down toward the floor of the chassis. FIGURE: Installing a Power Supply Backplane (Illustrating an Installation in a SPARC Enterprise T5220 Server) 2. Secure the power supply backplane with one No. 2 Phillips screw. 3. Install the power distribution board.
FIGURE: Installing a Power Supply (Illustrating Installation of a Power Supply in a SPARC Enterprise T5220 Server) 5. Install the motherboard assembly. See “Install the Motherboard Assembly” on page 120. Related Information ■ “Remove the Power Supply Backplane” on page 168 Servicing Paddle Cards These topics explain how to remove and install paddle cards in SPARC Enterprise T5120 and T5220 servers.
Paddle Card Overview The paddle card serves as the interconnect between the power distribution board and the fan power boards, hard drive backplane, and front panel I/O board. Related Information ■ “Remove the Paddle Card” on page 172 ▼ Remove the Paddle Card 1. Remove the motherboard assembly. See “Remove the Motherboard Assembly” on page 118. 2. Remove the power distribution board. See “Remove the Power Distribution Board” on page 161. 3. Remove the fan power boards.
6. Tilt the paddle card away from the side of the chassis and lift the paddle card up and out of the system. 7. Place the paddle card on an antistatic mat. Related Information ■ “Install the Paddle Card” on page 173 ▼ Install the Paddle Card 1. Lower the paddle card into the chassis. FIGURE: Installing a Paddle Card (Illustrating Installation Into a SPARC Enterprise T5120 Server) 2. Slide the paddle card forward to plug it into the hard drive backplane. 3. Secure the paddle card with two No.
174 SPARC Enterprise T5120 and T5220 Servers Service Manual • July 2009
Returning the Server to Operation These topics explain how to return SPARC Enterprise T5120 and T5220 servers to operation after you have performed service procedures.
FIGURE: Installing the Top Cover Note – If an emergency shutdown occurred when the top cover was removed, you must install the top cover and use the poweron command to restart the system. See “Power On the Server Using the poweron Command” on page 179 for more information about the poweron command. Related Information ■ “Power On the Server Using the poweron Command” on page 179 ▼ Reinstall the Server in the Rack Caution – The chassis is heavy.
FIGURE: Returning the Server to the Rack 2. Slide the server into the rack until the brackets lock into place. The server is now in the extended maintenance position. Related Information ■ “Return the Server to the Normal Rack Position” on page 177 ▼ Return the Server to the Normal Rack Position 1. Release the slide rails from the fully extended position by pushing the release tabs on the side of each rail.
FIGURE: Release Tabs on the Rail 2. While pushing on the release tabs, slowly push the server into the rack. Ensure that the cables do not get in the way. 3. Reconnect the cables to the back of the server. If the CMA is in the way, disconnect the left CMA release and swing the CMA open. 4. Reconnect the CMA. Swing the CMA closed and latch it to the left rack rail.
Note – As soon as the power cords are connected, standby power is applied. Depending on how the firmware is configured, the system might boot at this time.
▼ Power On the Server Using the Front Panel Power Button ● Use a pointed object, such as a pen or pencil, to press the Power button on the front panel. See “Power On the Server Using the Front Panel Power Button” on page 180 for more information on the Power button.
Identifying FRUs in SPARC Enterprise T5120 Servers These topics identify and illustrate Field Replaceable Units (FRUs) contained in SPARC Enterprise T5120 servers.
Motherboard Components in T5120 Servers FIGURE: 182 Motherboard Components (SPARC Enterprise T5120 Servers) SPARC Enterprise T5120 and T5220 Servers Service Manual • July 2009
The following table identifies the components located on the motherboard and points to instructions for servicing them. TABLE: Item Motherboard Components (SPARC Enterprise T5120 Servers) FRU Replacement Instructions Notes FRU Name (If Applicable) 1 PCIe/XAUI risers “Servicing PCIe/XAUI Risers” on page 102 Back panel PCI cross beam must be removed to access risers.
I/O Components in SPARC Enterprise T5120 Servers FIGURE: 184 I/O Components (SPARC Enterprise T5120 Servers) SPARC Enterprise T5120 and T5220 Servers Service Manual • July 2009
The following table identifies the I/O components in the server and points to instructions for servicing them. TABLE: Item I/O Components (SPARC Enterprise T5120 Servers) FRU Replacement Instructions Notes FRU Name (If Applicable) 1 Top cover “Remove the Top Cover” on page 67 “Install the Top Cover” on page 175 Removing top cover while the system is running will cause an immediate shutdown.
Power Distribution/Fan Module Components in SPARC Enterprise T5120 Servers FIGURE: 186 Power Distribution/Fan Module Components (SPARC Enterprise T5120 Servers) SPARC Enterprise T5120 and T5220 Servers Service Manual • July 2009
The following table identifies the power distribution and fan module components in the server and points to instructions for servicing them. TABLE: Item Power Distribution/Fan Module Components (SPARC Enterprise T5120 Servers) FRU Replacement Instructions Notes 1 Power distribution board/bus bar “Servicing Power Distribution Boards” on page 160 Bus bar is attached to the /SYS/PDB PDB with four screws.
Internal Cables for Onboard SAS Controller Cards in SPARC Enterprise T5120 Servers There are two SAS controller card options for the SPARC Enterprise T5120 and T5220 servers (both options support RAID). The standard option uses the on-board SAS controller card preinstalled on every server. The second option is a StorageTek SAS RAID Internal Host Bus Adapter (HBA) PCIe card. The internal cabling of your server will be different depending on the SAS controller card option you choose.
FIGURE: HDD Cable from Onboard SAS to HDD Backplane (4-Disk Capable SPARC Enterprise T5120 Server) Figure Legend 1 Connector on the motherboard. 2 Hard drive data cable; connects J6401 on the motherboard to J0301 on the hard drive backplane Note - Do not route this cable over the air duct. Instead route it next to the air duct.
FIGURE: Internal Cables for the Onboard SAS Controller Card (Eight-Disk Capable SPARC Enterprise T5120 Servers) Figure Legend 1 Connectors on motherboard 2 Hard drive data cables: - The short cable connects to the motherboard J6402 connector and to J0302 connector on the hard drive backplane. Do not route this cable over the air duct. Instead, route it alongside the air duct - The longer cable connects to the motherboard J6401 connector and to J0301 connector on the hard drive backplane.
HDD Data Cable Routing for SAS RAID Controller Cards in Four-Disk Capable SPARC Enterprise T5120 Servers There are two SAS controller card options for the SPARC Enterprise T5120 and T5220 servers (both options support RAID). The standard option uses the on-board SAS controller card preinstalled on every server. The second option is a StorageTek SAS RAID Internal Host Bus Adapter (HBA) PCIe card. The internal cabling of your server will be different depending on the SAS controller card option you choose.
FIGURE: Hard Drive Data Cable Routing for SAS RAID Controller Card in Four-Disk Capable SPARC Enterprise T5120 Servers Figure Legend 1 Route the cable between the PCIe slots and FB-DIMMs 2 Route the cable through the cable retainer 3 Route the cable along the power supply midwall 4 Proper location of heat-shrink tubing 5 Route the cable through the fan midwall to the hard drive backplane Note – For information about installing PCIe HBA cards, refer to the document, Installing the StorageTek SAS
HDD Data Cable Routing for SAS RAID Controller Cards in Eight-Disk Capable SPARC Enterprise T5120 Servers There are two SAS controller card options for the SPARC Enterprise T5120 and T5220 servers (both options support RAID). The standard option uses the on-board SAS controller card preinstalled on every server. The second option is a StorageTek SAS RAID Internal Host Bus Adapter (HBA) PCIe card. The internal cabling of your server will be different depending on the SAS controller card option you choose.
FIGURE: Hard Drive Data Cable Routing for SAS RAID Controller Card in Eight-Disk Capable SPARC Enterprise T5120 Servers Figure Legend 1 Route the cable between the PCIe slots and FB-DIMMs 2 Route the cable through the cable retainer 3 Route the cable along the power supply midwall 4 78 cm cable routing through the channel on the clear plastic air duct 5 Proper positions of heat-shrink tubing 6 Route the cable through the fan midwall to the hard drive backplane Note – For information about ins
Identifying FRUs in SPARC Enterprise T5220 Servers These topics identify and illustrate Field Replaceable Units (FRUs) contained in SPARC Enterprise T5220 servers.
Motherboard Components in T5220 Servers FIGURE: 196 Motherboard Components in SPARC Enterprise T5220 Servers SPARC Enterprise T5120 and T5220 Servers Service Manual • July 2009
The following table identifies the components located on the motherboard and points to instructions for servicing them. TABLE: Item Motherboard Components (SPARC Enterprise T5220 Servers) FRU Replacement Instructions Notes FRU Name (If Applicable) 1 Removable back panel cross beam “Servicing PCIe/XAUI Risers” on page 102 Remove this to service PCIe/XAUI risers and cards. N/A 2 PCIe/XAUI risers “Servicing PCIe/XAUI Risers” on page 102 Back panel PCI cross beam must be removed to access risers.
I/O Components in SPARC Enterprise T5220 Servers FIGURE: 198 I/O Components (SPARC Enterprise T5220 Servers) SPARC Enterprise T5120 and T5220 Servers Service Manual • July 2009
The following table identifies the I/O components in the server and points to instructions for servicing them. TABLE: Item I/O Components (SPARC Enterprise T5220 Servers) FRU Replacement Instructions Notes FRU Name (If Applicable) 1 Top cover “Remove the Top Cover” on page 67 “Install the Top Cover” on page 175 Removing top cover if the system is running will result in immediate shutdown.
Power Distribution/Fan Module Components in SPARC Enterprise T5220 Servers FIGURE: 200 Power Distribution/Fan Module Components (SPARC Enterprise T5220 Servers) SPARC Enterprise T5120 and T5220 Servers Service Manual • July 2009
The following table identifies the power distribution and fan module components in the server and points to instructions for servicing them. TABLE: Item Power Distribution/Fan Module Components (SPARC Enterprise T5220 Servers) FRU Replacement Instructions Notes FRU Name (If Applicable) 1 Paddle card “Servicing Paddle Cards” on page 171 Includes the top cover interlock switch.
Internal Cables for Onboard SAS Controller Cards in SPARC Enterprise T5220 Servers There are two SAS controller card options for the SPARC Enterprise T5120 and T5220 servers (both options support RAID). The standard option uses the on-board SAS controller card preinstalled on every server. The second option is a StorageTek SAS RAID Internal Host Bus Adapter (HBA) PCIe card. The internal cabling of your server will be different depending on the SAS controller card option you choose.
FIGURE: Internal Cables for Onboard SAS Controller Cards (Eight-Disk Capable SPARC Enterprise T5220 Servers) Figure Legend 1 Motherboard to PDB ribbon cable; connects J0403 on the PDB to J5201 on the motherboard 2 PDB to PSU backplane cable; connects J0103 on the PSU backplane to J0101 on the PDB.
FIGURE: Internal Cables for the Onboard SAS Controller Card (Eight-Disk Capable SPARC Enterprise T5220 Servers) Figure Legend 1 Connectors on motherboard 2 Hard drive data cables: - The short cable connects to J6402 on the motherboard and to J0302 on the hard drive backplane. - The longer cable connects to J6401 on the motherboard and to J0301 on the hard drive backplane. Note - Both cables are routed around the air duct, under the chassis center wall and under the fan power boards.
FIGURE: Internal Cables for Onboard SAS Controller Cards (Sixteen-Disk Capable SPARC Enterprise T5220 Servers) Figure Legend 1 SAS Connector on motherboard 2 Hard drive data cable; connects J6401 on the motherboard to J0301 on the hard drive backplane Note - The cable is routed around the air duct, under the chassis center wall and under the fan power boards.
HDD Data Cable Routing for SAS RAID Controller Cards in SPARC Enterprise T5220 Servers There are two SAS controller card options for the SPARC Enterprise T5120 and T5220 servers (both options support RAID). The standard option uses the on-board SAS controller card preinstalled on every server. The second option is a StorageTek SAS RAID Internal Host Bus Adapter (HBA) PCIe card. The internal cabling of your server will be different depending on the SAS controller card option you choose.
FIGURE: HDD Data Cable Routing for SAS RAID Controller Cards in Eight- or Sixteen-Disk Capable SPARC Enterprise T5220 Servers Figure Legend 1 Route both cables between the PCIe slots and FB-DIMMs 2 Route both cables along the power supply midwall 3 Route the 530-4119 cable under the fan midwall and fan boards, to the hard drive backplane 4 Route the 530-3892 cable under the fan midwall and fan boards, to the hard drive backplane Note – For information about installing the PCIe HBA card, refer to
208 SPARC Enterprise T5120 and T5220 Servers Service Manual • July 2009
Index A about, 16 AC Present (power supply LED), 19, 135 airflow, blocked, 20 antistatic wrist strap, 58 ASR blacklist, 50 asrkeys (system components), 51 B battery FRU name, 183, 197 locating, 112 blacklist, ASR, 50 bootmode command, 27 break command, 26 C cable management arm, 131 clearfault command, 26 clearing POST detected faults, 41 clearing PSH detected faults, 47 command fmdump, 45 removefru, 27 setdate, 114 setlocator, 28, 63 setscn, 187 show faulty, 22 showfaults, 28 showfru, 28 component_state
fan power board FRU name, 187, 201 Fault (fan module LED), 128 Fault (hard drive LED), 22 Fault (power supply LED), 131 fault manager daemon, fmd(1M), 44 fault records, 48 faults clearing POST-detected faults, 41 clearing with ILOM set command, 31 detected by POST, 19 detected by PSH, 19 environmental, 19, 20 forwarded to ILOM, 23 recovery, 23 repair, 23 FB-DIMM Fault LEDs, 22 FB-DIMMs troubleshooting, 82 fmadm command, 48 fmdump command, 45 FRU event ID, 45 FRU ID PROMs, 23 G graceful shutdown, 60, 61 ha
power supply about, 129 AC Present LED, 19, 135 Fault LED, 21, 131 FRU name, 136, 187, 201 Power Supply Fault (system LED) interpreting to diagnose faults, 21 using to verify successful power supply replacement, 135 powercycle command, 27, 39 poweron command, 27 power-on self-test (POST) about, 35 components disabled by, 50 fault clearing, 41 faults detected by, 19 faulty components detected by, 41 troubleshooting with, 20 using for fault diagnosis, 19 Predictive Self-Healing (PSH) clearing faults, 47 fault
removing, 67 topic guidelines, 1, 15, 57, 69, 81, 123, 129, 137, 175, 181, 195 troubleshooting AC OK LED state, 19 by checking Solaris OS log files, 19 FB-DIMMs, 82 Power OK LED state, 19 using POST, 19, 20 using SunVTS, 19 using the show faulty command, 19 U Universal Unique Identifier (UUID), 44 USB ports also see DVD/USB module USB ports (front) FRU name, 185, 199 V virtual keyswitch, 93 212 SPARC Enterprise T5120 and T5220 Servers Service Manual • July 2009
