SGI® Altix® XE340 User’s Guide 007-5536-001
COPYRIGHT © 2009, Silicon Graphics, Inc. All rights reserved; provided portions may be copyright in third parties, as indicated elsewhere herein. No permission is granted to copy, distribute, or create derivative works from the contents of this electronic documentation in any manner, in whole or in part, without the prior written permission of Silicon Graphics, Inc.
Record of Revision Version Description -001 July, 2009 First Release 007-5536-001 iii
Contents 1. 007-5536-001 Introduction and Overview . . . . . . . . . . . . . . . . . . . . 1 ESD and Safety Precautions. . . . . . . . . . . . . . . . . . . . . 1 Serverboard Features . . . . . . . . . . . . . . . . . . . . . 2 Processors . . . . . . . . . . . . . . . . . . . . . . . . 3 Memory . . . . . . . . . . . . . . . . . . . . . . . . 3 Serial ATA/SAS . . . . . . . . . .
Contents 2. System Operation . . . . . . . . . . . . . . . 9 Unpacking the System and Choosing an Operating Location . . . . . . . . . . . . 9 . . . . . . . . . . . . 9 Preparing for Setup . . . . . . . Choosing a Setup Location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 . . . . . . . . . . . . . . . . . . . . . . 10 Server Precautions . . . . . . . . . . . . . . . . . . . . .
Contents 3. 4. System Interfaces Overview . . . . . . . . . . . . . . . . . . . . 19 System Interface Overview . . . . . . . . . . . . . . . . . . . . . 19 Control Panel Buttons . . . . . . . . . . . . . . . . . . . . . 19 Control Panel LEDs . . . . . . . . . . . . . . . . . . . . . . . . 19 Overheat/Fan Fail . . . . . . . . . . . . . . . . . . . . . . 20 NICs 1 and 2 . . . . . . . . . .
Contents 5. Server BIOS Information . . . . . . . . . . . . . . . . . . . . . 31 Starting the BIOS Setup Utility . . . . . . . . . . . . . . . . . . . . 31 How To Change the Configuration Data . . . . . . . . . . . . . . . . . . 32 Starting the Setup Utility . . . . . . . . . . . . . . . . . . . . 32 Main Setup Screen . . . . . . . . . . . . . . . . . . . . . 32 Advanced Setup Configurations. . . . .
Chapter 1 1. Introduction and Overview This chapter provides an overview of your server’s main features. Operating precautions are provided in this chapter, followed by a general overview of the product. Before operating your system, familiarize yourself with the safety information in the following section: ESD and Safety Precautions Caution: Observe all ESD precautions. Failure to do so can result in damage to the equipment.
1: Introduction and Overview Warning: If a lithium battery is installed in your system as a soldered part, only qualified SGI service personnel should replace this lithium battery. For a battery of another type, replace it only with the same type or an equivalent type recommended by the battery manufacturer, or an explosion could occur. Discard used batteries according to the manufacturer’s instructions.
ESD and Safety Precautions Processors Each serverboard supports two Intel® Xeon quad-core processors in LGA1366 sockets (a total of 4 quad-core processors per chassis). The exact type of processors provided with your system depends on the specific configuration you ordered. Check with your sales or service representative for information on processor upgrades.
1: Introduction and Overview On-board Controllers/Ports On-board I/O backpanel ports on each serverboard include one COM port, a VGA port, two USB ports, a dedicated IPMI LAN port and two Gigabit LAN (NIC) ports. An (optional) InfiniBand port is also included on specific models of the server. There are two sets of I/O ports included in the server (one set for each serverboard). Graphics Controller The system features an integrated Matrox G200eW graphics chip, which includes 8 MB of DDR2 memory.
ESD and Safety Precautions B A B B B DDR3 DIMM DDR3 DIMM 1 2 3 B 1 2 1 CPU#1 2 CPU#2 3 3 Port1 QSFP MT25408 Connect-X IB PCI-E Gen2/DDR or QDR Port0 Ports 2,1 A 1 2 3 Kawela Ports 3,4 Intel Ports 5,6 PCI-E x16 DDR3 DIMM A A A B DDR3 DIMM A RJ45 RJ45 5520 Ports 7,8,9,10 ESI CLINK SST25 VF016 SPI PE5 PE4-1 DMI CLINK ICH10R SATA DDR II PCI WBD BMC/VGA VGA LPC SATA #1 SATA #2 SATA #3 SATA #4 SATA #5 SATA #6 LPCIO W83527 ACPI KBC RTL8201N PHY Dedicate LAN Figure 1-1
1: Introduction and Overview Server Chassis Features The following sections provide a general outline of the main features of the 1U system chassis. Figure 1-2 shows the rear panel of the SGI Altix XE340 server.
1U Twin: System Notes activity and system overheat conditions. Each control panel also includes a main power button and a system reset button. Rear I/O Panel The system is a 1U rackmount chassis. Its I/O panel provides slots for two low-profile PCI-E x16 expansion cards, two COM ports, four USB ports, two VGA ports and four Gb Ethernet ports. Two optional InfiniBand ports are available (one per serverboard).
1: Introduction and Overview System Backplane and Drives As a system, the Altix XE340 server supports the use of four hard disk drives. The disk-drive backplane works as a single backplane divided into two sections. This means that while a single power connector is used and functions such as overheating apply to both sections together, each pair of hard drives is logically connected to its own serverboard.
Chapter 2 2. System Operation This chapter describes the basic steps needed to get your Altix XE340 up and running. Following these steps in the order given should enable you to have the system operational within a minimum amount of time. Unpacking the System and Choosing an Operating Location You should inspect the box the system was shipped in and note if it was damaged in any way. If the server itself shows damage you should file a damage claim with the carrier who delivered it.
2: System Operation This product is for installation only in a Restricted Access Location (dedicated equipment rooms, service closets and the like). This product is not suitable for use with visual display work place devices according to the German Ordinance for Work with Visual Display Units. Rack Precautions Ensure that the leveling jacks on the bottom of the rack are fully extended to the floor with the full weight of the rack resting on them.
Unpacking the System and Choosing an Operating Location Rack Mounting Considerations Use the guidelines in the following subsections to properly install, use and maintain a server in a rack. Ambient Operating Temperature If installed in a closed or multi-unit rack assembly, the ambient operating temperature of the rack environment may be greater than the ambient temperature of the room.
2: System Operation Installing the System into a Rack This section provides information on installing the Altix XE340 server into a rack unit with the rack rails provided. If the system has already been mounted into a rack, you can skip ahead to the next section. There are a variety of rack units on the market, which may mean the assembly procedure will differ slightly. You should also refer to the installation instructions that came with the rack unit you are using.
Installing the System into a Rack Installing the Inner Rails Both the left and right side inner rails have been pre-attached to the chassis. Proceed to the next step. Installing the Outer Rails Begin by measuring the distance from the front rail to the rear rail of the rack. Attach a short bracket to the front side of the right outer rail and a long bracket to the rear side of the right outer rail.
2: System Operation Locking Tabs Both chassis rails have a locking tab, which serves two functions. The first is to lock the server into place when installed and pushed fully into the rack, which is its normal position. Secondly, these tabs also lock the server in place when fully extended from the rack. This prevents the server from coming completely out of the rack when you pull it out for servicing.
Installing the System into a Rack Figure 2-3 Sliding the Server into a Rack Server Access After Rack Installation After you install the unit in the rack, you will need to open the top cover to make sure the serverboard is properly installed and all the connections have been made. Grasp the two handles on either side and pull the system straight out until it locks (you should hear a "click"). Remove the four screws (two on the sides and two on the top) that secure the top cover to the chassis.
2: System Operation (toward the rear of the chassis) until it stops. You can then lift the top cover from the chassis to gain full access to the inside of the server (see Figure 2-4). To remove the system completely from the rack, depress the locking tabs in the chassis rails (push the right-side tab down and the left-side tab up) to continue to pull the system out past the locked position.
Installing the System into a Rack Note that all power and data cables should be routed in such a way that they do not block the airflow generated by the fans. Providing Power Plug the power cord from the server power supply unit into a rack power distibution unit (PDU) or high-quality power strip that offers protection from electrical noise and power surges. For higher availability it is recommended that you use an optional uninterruptible power supply (UPS) with the server.
Chapter 3 3. System Interfaces Overview This chapter provides an overview of the standard and optional interfaces available on your SGI Altix XE340 system. The major components of the system are described and illustrated. System Interface Overview There are several LEDs on the two control panels as well as others on the disk drive carriers to keep you constantly informed of the overall status of the system as well as the activity and health of specific components.
3: System Interfaces Overview Control panel: Node board 1 Control panel: Node board 2 RESET RESET RESET 2 1 Overheat/Fan fail/Unit ID (bi-color) LED NIC 2 activity LED Power RESET Power LED HDD activity LED NIC 1 activity LED Figure 3-1 Serverboard Control Panel Example Overheat/Fan Fail/UID When this LED flashes, it indicates a fan failure.
Control Panel LEDs NICs 1 and 2 • NIC1 - Indicates network activity on LAN1 when flashing. • NIC2 - Indicates network activity on LAN2 when flashing. HDD Channel activity for the hard disk drives. This light indicates disk drive activity on the server when flashing. Power The LED indicates power is being supplied to the system's power supply unit. This LED should normally be illuminated when the system is operating. Disk Drive Carrier LEDs Each disk drive carrier has two LEDs.
General Precautions Chapter 4 4. Internal Component Replacement and Upgrades This chapter describes basic component replacement and upgrades for the SGI Altix XE340 server. General Precautions Care must be taken to assure that the chassis cover is in place when the server is operating to assure proper cooling. Out of warranty damage to the system can occur if this practice is not strictly followed. Caution: Electrostatic Discharge (ESD) can damage electronic components.
4: Internal Component Replacement and Upgrades Each serverboard has twelve 240-pin DIMM slots that can support up to 96 GB of registered ECC DDR3-1333/1066/800 SDRAM (for a total of 192 GB in the system). Note: Check with your SGI sales or service representative for approved replacement or upgrade DIMM memory modules. Installing Memory Modules Insert each memory module vertically into a slot using the information and illustrations in this section.
Adding PCIe Cards Adding PCIe Cards The server includes two pre-installed riser cards designed specifically for use in the 1U rackmount server chassis. These riser cards support two low-profile PCI Express (PCIe) x16 cards that install inside the chassis. A riser card has already been preinstalled into each serverboard. The PCIe card cannot be “hot installed”. Perform the following steps to add a PCIe add-on card: 1.
4: Internal Component Replacement and Upgrades Drive Bay Installation/Removal Hard Disk Drives: Because of their hot-swap capability, you do not need to access the inside of the chassis or power down the system to install or replace SATA drives. Proceed to the next step for instructions. Note that the operating system you use must have RAID support to enable the hot-swap capability of the SATA/SAS drives. Use caution when working around the disk drive backplane.
Disk Drive Removal and Installation Figure 4-2 Mounting a Drive in a Carrier Installing/Removing Hot-swap Drives To remove a carrier, push the release button located beside the drive LEDs. Swing the handle fully out and use it to pull the unit straight out (see Figure 4-3).
4: Internal Component Replacement and Upgrades Figure 4-3 Server Disk Drive Remove/Replace Example Power Supply The SGI Altix XE340 server has a single 1200-Watt, cold-swap power supply. This power supply has the capability of operating at 100 - 240 input volts. Depress both main power buttons on the front of the chassis and then unplug the AC power cord to completely remove power from the system before removing the power supply.
Power Supply The LED located directly above the power connector on the supply has three states: • Dark - no AC power is available to the supply • Yellow - AC power available to the supply but the server is not powered on • Green - AC power is applied and the system is on (front panel power button pushed to on) Power Supply Failure If the power supply unit fails, the system will shut down and you will need to replace the power supply unit.
4: Internal Component Replacement and Upgrades Figure 4-5 Power Supply Removal Example (System Top Cover Removal Not Required) Installing a New Power Supply Use the following steps to replace a failed power supply in the server: 1. Replace the failed power supply with the exact same model from SGI or another approved vendor, contact your sales or service representative for more information. 2. Insert the new unit into the chassis and push it in until seated.
Chapter 5 5. Server BIOS Information This chapter describes the functions and features of the AMI BIOS Setup Utility for the SGI Altix XE340 server. The AMI ROM BIOS is stored in a Flash EEPROM and can be easily updated; check with your SGI sales or service representative for information on updates. This chapter covers basic navigation of the AMI BIOS Setup Utility screens. Starting the BIOS Setup Utility To enter the AMI BIOS Setup Utility screens, press the key while the system is booting up.
5: Server BIOS Information How To Change the Configuration Data The configuration data that determines the system parameters may be changed by entering the AMI BIOS Setup utility. This Setup utility can be accessed by pressing at the appropriate time during system boot. Starting the Setup Utility Normally, the only visible Power-On Self-Test (POST) routine is the memory test. As the memory is being tested, press the key to enter the main menu of the AMI BIOS Setup Utility.
How To Change the Configuration Data BIOS Build Version: This item displays the BIOS revision used in your system. BIOS Build Date: This item displays the date when this BIOS was completed. AMI BIOS Core Version: This item displays the revision number of the AMI BIOS Core upon which your BIOS was built. Processor: The AMI BIOS will automatically display the status of the processor used in your system: CPU Type: This item displays the type of CPU used in the system motherboard.
5: Server BIOS Information This item displays the memory size detected by the BIOS. Advanced Setup Configurations Use the arrow keys to select Boot Setup and hit to access the submenu items: Boot Features Quick Boot If enabled, this option will skip certain tests during POST to reduce the time needed for system boot. The options are Enabled and Disabled. Quiet Boot This option allows the bootup screen options to be modified between POST messages or the OEM logo.
How To Change the Configuration Data Interrupt 19 is the software interrupt that handles the boot disk function. When this item is set to Enabled, the ROM BIOS of the host adaptors will "capture" Interrupt 19 at boot and allow the drives that are attached to these host adaptors to function as bootable disks. If this item is set to Disabled, the ROM BIOS of the host adaptors will not capture Interrupt 19, and the drives attached to these adaptors will not function as bootable devices.
5: Server BIOS Information Select Enabled to use the feature of Enhanced Halt State. C1E significantly reduces the CPU's power consumption by reducing the CPU's clock cycle and voltage during a "Halt State." The options are Disabled and Enabled. Hardware Prefetcher (Available when supported by the CPU) If set to Enabled, the hardware pre-fetcher will pre-fetch streams of data and instructions from the main memory to the L2 cache in a forward or backward manner to improve CPU performance.
How To Change the Configuration Data Set to Enabled to use a processor's Second Core and beyond. (Please refer to Intel's web site for more information.) The options are All, 1 and 2. Intel® EIST Technology EIST (Enhanced Intel SpeedStep Technology) allows the system to automatically adjust processor voltage and core frequency in an effort to reduce power consumption and heat dissipation.
5: Server BIOS Information Advanced Chipset Control The items included in the Advanced Settings submenu are listed below: CPU Bridge Configurations/QPI Links Speed QPI Links Speed This feature selects QPI's data transfer speed. The options are Slow-mode, and Full Speed. QPI Frequency This selects the desired QPI frequency. The options are Auto, 4.800 GT, 5.866GT, 6.400 GT. QPI L0s and L1 This enables the QPI power state to low power. L0s and L1 are automatically selected by the motherboard.
How To Change the Configuration Data Patrol Scrubbing A memory error-correction scheme that works in the background looking for and correcting resident errors. The options are Enabled and Disabled. Throttling - Closed Loop/Throttling - Open Loop Throttling improves reliability and reduces power in the processor by automatic voltage control during processor idle states. Available options are Disabled and Enabled.
5: Server BIOS Information This feature defines how many meters above or below sea level the system is located. The options are Sea Level or Below, 1~300, 301~600, 601~900, 901~1200, 1201~1500, 1501~1800, 1801~2100, 2101~2400, 2401~2700, 2701~3000. DIMM Pitch This is the physical space between each DIMM module. Each step is in 1/1000 of an inch. The default is [400]. Press "+" or "-" on your keyboard to change this value.
How To Change the Configuration Data SouthBridge Configuration This feature allows the user to configure the settings for the Intel ICH South Bridge chipset. USB Functions This feature allows the user to decide the number of onboard USB ports to be enabled. The Options are: Disabled, 2 USB ports, 4 USB ports, 6 USB ports, 8 Ports, 10 Ports and 12 USB ports. Legacy USB Support Select Enabled to use Legacy USB devices.
5: Server BIOS Information This feature allows the user to select the drive type for SATA#1. The options are IDE, RAID and AHCI. • SATA#2 Configuration Selecting Enhanced will set SATA#2 to native SATA mode. The options are Disabled, and Enhanced. Primary IDE Master/Slave, Secondary IDE Master/Slave, Third IDE Master, and Fourth IDE Master These settings allow the user to set the parameters of Primary IDE Master/Slave, Secondary IDE Master/Slave, Third and Fourth IDE Master slots.
How To Change the Configuration Data Select Auto to allow the AMI BIOS to automatically detect the PIO mode. Use this value if the IDE disk drive support cannot be determined. Select 0 to allow the AMI BIOS to use PIO mode 0. It has a data transfer rate of 3.3 MBs. Select 1 to allow the AMI BIOS to use PIO mode 1. It has a data transfer rate of 5.2 MBs. Select 2 to allow the AMI BIOS to use PIO mode 2. It has a data transfer rate of 8.3 MBs. Select 3 to allow the AMI BIOS to use PIO mode 3.
5: Server BIOS Information Select UDMA3 to allow the BIOS to use Ultra DMA mode 3. It has a data transfer rate of 66.6 MBs. Select UDMA4 to allow the BIOS to use Ultra DMA mode 4. It has a data transfer rate of 100 MBs. The options are Auto, SWDMAn, MWDMAn, and UDMAn. S.M.A.R.T. For Hard disk drives Self-Monitoring Analysis and Reporting Technology (SMART) can help predict impending drive failures. Select Auto to allow the AMI BIOS to automatically detect hard disk drive support.
How To Change the Configuration Data When enabled, the BIOS uses PCI bus mastering for reading/writing to IDE drives. The options are Disabled and Enabled. Load Onboard LAN1 Option ROM/Load Onboard LAN2 Option ROM Select Enabled to enable the onboard LAN1 or LAN2 Option ROM. This is to boot the computer using a network interface. The options are Enabled and Disabled.
5: Server BIOS Information Note: This setting may not be supported by some operating systems. Select Boot Loader to keep Console Redirection active during POST and Boot Loader. The options are Disabled, Boot Loader, and Always. Terminal Type This feature allows the user to select the target terminal type for Console Redirection. The options are ANSI, VT100, and VT-UTF8. VT-UTF8 Combo Key Support A terminal keyboard definition that provides a way to send commands from a remote console.
How To Change the Configuration Data • The Early Alarm: Select this setting if you want the CPU overheat alarm (including the LED and the buzzer) to be triggered as soon as the CPU temperature reaches the CPU overheat threshold as predefined by the CPU manufacturer.
5: Server BIOS Information Medium – The processor is running warmer. This is a ‘precautionary’ level and generally means that there may be factors contributing to this condition, but the CPU is still within its normal operating state and below the CPU ‘Temperature Tolerance’. The motherboard fans and CPU will run normally as configured in the BIOS. The fans may adjust to a faster speed depending on the Fan Speed Control settings. User intervention: No action is required.
How To Change the Configuration Data ACPI Configuration Use this feature to configure Advanced Configuration and Power Interface (ACPI) power management settings for your system. ACPI Version Features The options are ACPI v1.0, ACPI v2.0 and ACPI v3.0. Please refer to ACPI's website for further explanation: http://www.acpi.info/. ACPI APIC Support Select Enabled to include the ACPI APIC Table Pointer in the RSDT pointer list. The options are Enabled and Disabled.
5: Server BIOS Information Baseboard Management Controller (BMC) manages the interface between system management software and platform hardware. This is an informational feature which returns the status code of the BMC micro controller. View BMC System Event Log This feature displays the BMC System Event Log (SEL). It shows the total number of entries of BMC System Events.
How To Change the Configuration Data Set LAN Configuration Set this feature to configure the IPMI LAN adapter with a network address. Channel Number - Enter the channel number for the SET LAN Configuration command. This is initially set to [1]. Press "+" or "-" on your keyboard to change the Channel Number. Channel Number Status -This feature returns the channel status for the Channel Number selected above: "Channel Number is OK" or "Wrong Channel Number".
5: Server BIOS Information The BIOS will automatically enter the Mac address of this machine; however it may be over-ridden. Mac addresses are 6 two-digit hexadecimal numbers (Base 16, 0 ~ 9, A, B, C, D, E, F) separated by dots. (i.e., 00.30.48.D0.D4.60). Current Mac Address in BMC This item displays the current Mac address used for your IPMI connection. Subnet Mask Configuration Subnet masks tell the network which subnet this machine belongs to.
How To Change the Configuration Data PEF Startup Delay -This sets the pre-determined time to delay PEF after system power-ups and resets. Refer to Table 24.6 of the IPMI 1.5 Specification for more information at www.intel.com. The options are No Delay, 30 sec, 60 sec, 1.5 min, 2.0 min. Event Message for PEF Action - This enables of disables Event Messages for PEF action. Refer to Table 24.6 of the IPMI 1.5 Specification for more information at www.intel.com. The options are Disabled and Enabled.
5: Server BIOS Information This item indicates if a supervisor password has been entered for the system. Clear means such a password has not been used and Set means a supervisor password has been entered for the system. User Password: This item indicates if a user password has been entered for the system. Clear means such a password has not been used and Set means a user password has been entered for the system.
How To Change the Configuration Data Use this feature to configure boot settings. Boot Device Priority This feature allows the user to specify the sequence of priority for the Boot Device. The settings are 1st boot device, 2nd boot device, 3rd boot device, 4th boot device, 5th boot device and Disabled. 1st Boot Device - [USB: XXXXXXXXX] 2nd Boot Device - [CD/DVD: XXXXXXXXX] Hard Disk Drives This feature allows the user to specify the boot sequence from all available hard disk drives.
5: Server BIOS Information When you have completed the system configuration changes, select this option to leave the BIOS Setup Utility and reboot the computer, so the new system configuration parameters can take effect. Select Save Changes and Exit from the Exit menu and press . Discard Changes and Exit Select this option to quit the BIOS Setup without making any permanent changes to the system configuration, and reboot the computer.
BIOS Error Beep Codes BIOS Error Beep Code List The following list of error codes my be helpful in diagnosing certain system problems. BIOS Error Beep Codes Beep Code Error Message Description 1 beep Refresh Circuits have been reset.
Appendix A A. Technical Specifications This appendix contains technical specification information about your system. Server Specifications and Features Table A-1 shows the physical specifications of the Altix XE340 server system. Table A-1 Altix XE340 Physical Specifications System Features Specification Height 1.7 in. (43 mm) Width 17.2 in. (43.7 cm) Depth 27.75 in. (70.5 cm) Weight (full) maximum ~40 lbs. (18.
A: Technical Specifications Environmental Specifications Table A-2 lists the environmental specifications of the system. Table A-2 60 Environmental Specifications Feature Specification Temperature tolerance (operating) +5 °C (41 °F) to +35 °C (95 °F) (up to 1500 m / 5000 ft.) +5 °C (41 °F) to +30 °C (86 °F) (1500 m to 3000 m /5000 ft. to 10,000 ft.
Appendix B B. SGI Altix XE System Drivers SGI Altix XE systems may sometimes require driver versions that are not included in the original operating system release. The SGI Altix XE Driver CD and Linux Updates SGI provides these required drivers on the SGI Altix XE Driver CD, which ships with all SGI Altix XE systems, and on systems that are pre-installed in the factory. Novell and Red Hat also provide driver updates for supported operating system releases.