IBM System x3850 X5 and x3950 X5 Types 7145, 7146, 7143, and 7191 Installation and User's Guide
IBM System x3850 X5 and x3950 X5 Types 7145, 7146, 7143, and 7191 Installation and User's Guide
Note: Before using this information and the product it supports, read the general information in “Notices” on page 121, the IBM Safety Information and Environmental Notices and User Guide documents on the IBM Documentation CD, and the Warranty Information. Ninth Edition (July 2011) © Copyright IBM Corporation 2011. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
Contents Safety . . . . . . . . . . . . . . . v The IBM Documentation CD . . . . . . . . . 3 Hardware and software requirements . . . . . 3 Using the Documentation Browser . . . . . . 3 Related documentation . . . . . . . . . . . 4 Notices and statements in this document . . . . . 5 Features and specifications. . . . . . . . . . 5 What your server offers. . . . . . . . . . . 8 Reliability, availability, and serviceability . . . . 11 IBM Systems Director . . . . . . . . . . .
Configuring RAID arrays . . . . . . . . . 109 IBM Advanced Settings Utility program . . . . 109 Updating IBM Systems Director . . . . . . . 109 Configuring an EXA multi-node system . . . . 110 Creating an EXA multi-node system . . . . . 111 Partitioning an EXA multi-node system. . . . 113 Using the IMM Telnet interface . . . . . . 114 Configuring a QPI multi-node system . . . . . 116 Appendix. Getting help and technical assistance. . . . . . . . . . . . . 117 Before you call . . . . . . .
Safety Before installing this product, read the Safety Information. Antes de instalar este produto, leia as Informações de Segurança. Læs sikkerhedsforskrifterne, før du installerer dette produkt. Lees voordat u dit product installeert eerst de veiligheidsvoorschriften. Ennen kuin asennat tämän tuotteen, lue turvaohjeet kohdasta Safety Information. Avant d'installer ce produit, lisez les consignes de sécurité. Vor der Installation dieses Produkts die Sicherheitshinweise lesen.
Antes de instalar este produto, leia as Informações sobre Segurança. Antes de instalar este producto, lea la información de seguridad. Läs säkerhetsinformationen innan du installerar den här produkten. Important: Each caution and danger statement in this document is labeled with a number. This number is used to cross reference an English-language caution or danger statement with translated versions of the caution or danger statement in the Safety Information document.
DANGER Electrical current from power, telephone, and communication cables is hazardous. To avoid a shock hazard: v Do not connect or disconnect any cables or perform installation, maintenance, or reconfiguration of this product during an electrical storm. v Connect all power cords to a properly wired and grounded electrical outlet. v Connect to properly wired outlets any equipment that will be attached to this product. v When possible, use one hand only to connect or disconnect signal cables.
Statement 3 CAUTION: When laser products (such as CD-ROMs, DVD drives, fiber optic devices, or transmitters) are installed, note the following: v Do not remove the covers. Removing the covers of the laser product could result in exposure to hazardous laser radiation. There are no serviceable parts inside the device. v Use of controls or adjustments or performance of procedures other than those specified herein might result in hazardous radiation exposure.
CAUTION: Use safe practices when lifting. Statement 5 CAUTION: The power control button on the device and the power switch on the power supply do not turn off the electrical current supplied to the device. The device also might have more than one power cord. To remove all electrical current from the device, ensure that all power cords are disconnected from the power source. Statement 8 CAUTION: Never remove the cover on a power supply or any part that has the following label attached.
CAUTION: The following label indicates sharp edges, corners, or joints nearby. Statement 12 CAUTION: The following label indicates a hot surface nearby. Statement 13 DANGER Overloading a branch circuit is potentially a fire hazard and a shock hazard under certain conditions. To avoid these hazards, ensure that your system electrical requirements do not exceed branch circuit protection requirements. Refer to the information that is provided with your device for electrical specifications.
CAUTION: The following label indicates moving parts nearby. Statement 26 CAUTION: Do not place any object on top of rack-mounted devices. Statement 37 DANGER When you populate a rack cabinet, adhere to the following guidelines: v Always lower the leveling pads on the rack cabinet. v Always install the stabilizer brackets on the rack cabinet. v Always install the heaviest devices in the bottom of the rack cabinet.
xii IBM System x3850 X5 and x3950 X5 Types 7145, 7146, 7143, and 7191: Installation and User's Guide
Chapter 1. The System x3850 X5 and x3950 X5 server This Installation and User's Guide contains instructions for setting up your IBM System x3850 X5 or x3950 X5 Type 7145, 7146, 7143, or 7191 server, installing optional devices, and starting and configuring the server.
to weekly e-mail notifications about new technical documents, search for information and downloads, and access various administrative services. If you participate in the IBM client reference program, you can share information about your use of technology, best practices, and innovative solutions; build a professional network; and gain visibility for your business. For more information about the IBM client reference program, see http://www.ibm.com/ibm/ clientreference/.
The IBM Documentation CD The IBM Documentation CD contains documentation for your server in Portable Document Format (PDF) and includes the IBM Documentation Browser to help you find information quickly. Hardware and software requirements The IBM Documentation CD requires the following minimum hardware and software: v Microsoft Windows XP, Windows 2000, or Red Hat Linux v 100 MHz microprocessor v 32 MB of RAM v Adobe Acrobat Reader 3.
in order of the most occurrences. Click a document to view it, and press Ctrl+F to use the Acrobat search function, or press Alt+F to use the xpdf search function within the document. Click Help for detailed information about using the Documentation Browser. Related documentation This Installation and User's Guide contains general information about the server, including how to set up the server, install supported optional devices, and configure the server.
to provide additional information that is not included in the server documentation. To check for updated documentation and technical updates, go to http://www.ibm.com/supportportal/. Notices and statements in this document The caution and danger statements in this document are also in the multilingual Safety Information document, which is on the IBM Documentation CD. Each statement is numbered for reference to the corresponding statement in your language in the Safety Information document.
http://www.ibm.com/supportportal/. The documentation provides additional installation and configuration information that you must follow before you use the memory expansion module.
Table 1. Features and specifications Microprocessor: v Intel Xeon EX versions of the 6000 and 7000 Series or E7 Series multi-core microprocessor with up to 24 MB or 30 MB last level cache. v 1066 MHz front-side bus (FSB) v Support for up to four microprocessors – Four Quick Path Interconnect (QPI) links per microprocessor at up to 6.4 GT/s (gigatransfers per second) – Four Scalable Memory Interconnect (SMI) links per microprocessor at up to 6.
Table 2.
threshold or if a system component fails, the IMM lights LEDs to help you diagnose the problem, records the error in the IMM event log, and alerts you to the problem. Optionally, the IMM also provides a virtual presence capability for remote server management capabilities. The IMM provides remote server management through industry-standard interfaces: – Intelligent Platform Management Interface (IPMI) version 2.
sparing through the Setup utility, select System Settings > Memory. (Memory sparing and memory mirroring cannot be used together.) v IBM ServerGuide Setup and Installation CD The ServerGuide Setup and Installation CD, which you can download from the web, provides programs to help you set up the server and install a Windows operating system. The ServerGuide program detects installed optional hardware devices and provides the correct configuration programs and device drivers.
– Service processor status and configuration – System configuration – Vital product data, firmware, and UEFI configuration v v v v For additional information about DSA, see the Problem Determination and Service Guide on the IBM Documentation CD. Redundant connection The addition of an optional network interface card (NIC) provides a failover capability to a redundant Ethernet connection.
v v v v v v v v v v v v v v v v v v v v IBM Systems Director workgroup-hardware-management tool Information and light path diagnostics LED panels Integrated management module Service processor adapter for remote systems management Parity checking on the SAS bus and PCI Express buses Power managed and Advanced Configuration and Power Interface (ACPI) compliant Power-on self-test (POST) Predictive Failure Analysis (PFA) alerts Redundant Ethernet capabilities (requires optional Ethernet adapter) with failove
v Configuring settings of a single system and creating a configuration plan that can apply those setting to multiple systems v Updating installed plug-ins to add new features and functions to the base capabilities v Managing the life cycles of virtual resources For more information about IBM Systems Director, see the documentation on the IBM Systems Director DVD that comes with the server, the IBM Systems Director Information Center at http://publib.boulder.ibm.com/infocenter/director/v6r1x/ index.
DVD drive activity LED: When this LED is lit, it indicates that the DVD drive is in use. USB 1 and 2 connectors: Connect USB devices to these connectors. Scalability LED: This white LED is lit when the server is connected to another server in a multi-node configuration. This LED is lit and remains on after POST on the primary and secondary server. Hard disk drive activity LED: When this LED is flashing, it indicates that the drive is in use.
v Information LED: When this LED is lit, it indicates that a noncritical event has occurred. An LED on the light path diagnostics panel is also lit to help isolate the error. v System-error LED: When this LED is lit, it indicates that a system error has occurred. An LED on the light path diagnostics panel is also lit to help isolate the error. v Locator button and locator LED: Use this LED to visually locate the server among other servers.
Remind button REMIND OVER SPEC LOG FAN CNFG CPU LINK PS TEMP MEM PCI SP NMI VRM DASD RAID NMI button BRD Check point code display Light Path Diagnostics Reset button v Remind button: This button places the system-error LED on the front panel into Remind mode. In Remind mode, the system-error LED flashes once every 2 seconds until the problem is corrected, the server is restarted, or a new problem occurs.
System-management connector: Use this connector to connect the server to a network for systems-management information control. This connector is used only by the IMM. USB connectors: Connect USB devices, such as a USB mouse or keyboard, to these connectors. Video connector: Connect a monitor to this connector. In a two-node configuration, connect the monitor to the primary server to see standard system output. Serial connector: Connect a 9-pin serial device to this connector.
AC power LED (green) AC DC power LED (green) DC Error LED (amber) ! A thumbscrew is in this position only when a 2-node lock bracket is installed (2-node Scalability Kit Option) AC QPI Link 1 LED AC AC DC DC DC !! ! QPI Link 2 LED QPI Link 3 LED QPI Link 4 LED Power on LED Locator LED System error LED AC power LED: Each hot-swap power supply has an ac power LED and a dc power LED.
Table 3. QPI link LEDs (continued) QPI wrap card or cable status Link LEDs Number of nodes Off at failing port 1 Wrap card installed, not working On 2 Cables installed, working Off at failing port 2 Cables installed, not working Power-on LED: See “Operator information panel” on page 14 for the various states of the power-on LED. System-error LED: When this LED is lit, it indicates that a system error has occurred. An LED on the light path diagnostics panel is also lit to help isolate the error.
Note: Some memory is reserved for various system resources and is unavailable to the operating system. The amount of memory that is reserved for system resources depends on the operating system, the configuration of the server, and the configured PCI options. Turning off the server When you turn off the server and leave it connected to ac power, the server can respond to requests from the IMM, such as a remote request to turn on the server.
IBM MAX5 for System x memory expansion module If you purchased an optional IBM MAX5 for System x (MAX5) memory expansion module, it supports up to 32 DDR3 DIMMs, two 675-watt power supplies, and five 40 mm hot-swap speed-controlled fans. It provides added memory and multi-node scaling support for host servers. The MAX5 expansion module is based on eX5, the next generation of Enterprise X-Architecture.
The following illustration shows the memory expansion module. The illustrations in this document might differ slightly from your hardware. See http://www.ibm.com/systems/info/x86servers/serverproven/compat/us/ for a list of supported optional devices for the memory expansion module. For information about the terms of the warranty for the expansion module, see the documentation that comes with the expansion module.
Memory expansion module features and specifications The following table contains a summary of the features and specifications of the memory expansion module. Table 4.
Table 4. MAX5 expansion module features and operating specifications (continued) Acoustical noise emissions: For maximum system configurations (32 DIMMs installed) v Sound power (idling): 6.2 bels v Sound power (operating): 6.2 bels v Sound pressure (idling): 48 dBA v Sound pressure (operating): 48 dBA Size: v Height: 4.4 cm (1.73 in.) v Depth: 72.4 cm (28.5 in.) v Width: 48.3 cm (19.0 in.) v Weight: approximately 12.8 kg (28.2 lb) for a standard unit; when fully configured, 15.4 kg (33.
v Light path diagnostics LEDs The memory expansion module has light path diagnostics LEDs (front and rear) to indicate hardware, scaling, and power problems. v Redundant cooling and power capabilities The memory expansion module supports a maximum of two 675-watt hot-swap power supplies and five single-motor hot-swap fans. The redundant fans provide continued cooling if one fan fails. The memory expansion module comes with one 675-watt hot-swap power supply and five fans.
LEDs and connectors on the memory expansion module This section describes the light-emitting diodes (LEDs) and connectors on the front and rear of the memory expansion module. Front view The following illustration shows the indicators on the front of the memory expansion module. All of the LEDs are controlled by the integrated management module (IMM) in the host server. Note: The memory expansion module does not have a power-on control.
Rear view The following illustration shows the indicators on the rear of the memory expansion module. EXA port 1 EXA port 2 EXA port 3 QPI QPI port 1 port 2 QPI port 3 QPI port 4 Power connectors Power-on LED EXA port 1 link LED AC LED (green) Locate LED EXA port 2 link LED DC LED (green) System error LED EXA port 3 link LED Power supply fault (error) LED v Power-on LED: When this green LED is lit, it indicates that the memory expansion module is powered on.
Turning on the memory expansion module The memory expansion module is controlled by the server. Turning on the memory expansion module refers to connecting the memory expansion module power cord to the power source and pressing the power-control button on the host server. The host server must be connected to the memory expansion module and configured to identify the memory expansion module.
Chapter 2. Installing optional devices This chapter provides detailed instructions for installing optional hardware devices in the server. In addition to the instructions in this chapter for installing optional hardware devices, updating firmware and device drivers, and completing the installation, IBM Business Partners must also complete the steps in “Instructions for IBM Business Partners.
3. Shut down and restart the server multiple times to ensure that the server is correctly configured and functions correctly with the newly installed devices. 4. Save the DSA log as a file and send it to IBM. 5. To ship the server, repackage it in the original undamaged packing materials and observe IBM procedures for shipping. Support information for IBM Business Partners is available at http:// www.ibm.com/partnerworld/pwhome.nsf/weblook/index_us.html.
Blue on a component indicates touch points, where you can grip the component to remove it from or install it in the server, open or close a latch, and so on. Orange on a component or an orange label on or near a component indicates that the component can be hot-swapped, which means that if the server and operating system support hot-swap capability, you can remove or install the component while the server is running. (Orange can also indicate touch points on hot-swap components.
Memory-card LEDs The following illustration shows the LEDs on a memory card.
SAS-backplane connectors The following illustration shows the hard disk drive connectors on the SAS backplane. Rear Front Cofiguration connector Backplane 2 (for HDD 4-7) SAS signal connector SAS power connector Cofiguration connector Backplane 1 (for HDD 0-3) SAS signal connector SAS power connector SAS hard disk drive connectors eXFlash backplane connectors The following illustration shows the cable connectors on the eXFlash backplane.
Microprocessor-board connectors The following illustration shows the connectors on the microprocessor board.
Microprocessor-board LEDs The following illustration shows the LEDs on the microprocessor board. Microprocessor 1 Microprocessor 2 error LED error LED Microprocessor 3 Microprocessor 4 error LED error LED Microprocessor board error LED H8 heartbeat LED Chapter 2.
I/O-board connectors The following illustration shows the connectors on the I/O board. USB 4-5 Power supply 1 System management USB Serial Video Ethernet 6-7 Ethernet 2 Ethernet 1 PCIe2 x8 slot 7 PCIe2 x8 PCIe2 x8 slot 6 slot 5 PCIe2 x8 slot 4 PCIe2 x8 slot 3 PCIe2 x8 (x4 electrically) slot 2 PCIe2 x16 slot 1 Battery Power supply 2 Internal USB Internal USB SATA DVD Front USB PCIe auxiliary power Slot 2 is electrically a x4 connector.
I/O-board jumpers The following illustration shows the jumpers on the I/O board. Wake on LAN bypass (J31) 1 2 3 Password override (J29) 1 2 3 Boot recovery (J22) 1 2 3 Table 5. I/O-board jumpers Jumper number Jumper name J31 Wake on LAN bypass J29 Password override J22 Boot recovery Jumper setting v Pins 1 and 2: Normal operation (default). v Pins 2 and 3: Clears Wake on LAN bypass. When you change the position of this jumper, the server bypasses the power-on password check.
I/O-board LEDs The following illustration shows the LEDs on the I/O board. Slot 7 error LED Slot 6 error LED I/O board Slot 5 Slot 4 Slot 3 Slot 2 Slot 1 error error error error error error LED LED LED LED LED LED Power fault LED Installation guidelines Before you install optional devices, read the following information: v Read “Safety” on page v, “Working inside the server with the power on” on page 40, and “Handling static-sensitive devices” on page 40. This information will help you work safely.
starts, if an operating system is installed, or that a 19990305 error code is displayed, indicating that an operating system was not found but the server is otherwise working correctly. If the server is not working correctly, see the Problem Determination and Service Guide on the IBM Documentation CD for information about how to run diagnostics. v Observe good housekeeping in the area where you are working. Place removed covers and other parts in a safe place.
v If the server has redundant power, each of the power-supply bays has a power supply installed in it. v There is adequate space around the server to allow the server cooling system to work properly. Leave approximately 50 mm (2.0 in.) of open space around the front and rear of the server. Do not place objects in front of the fans. For proper cooling and airflow, replace the top cover before you turn on the server.
v Do not leave the device where others can handle and damage it. v While the device is still in its static-protective package, touch it to an unpainted metal surface on the outside of the server for at least 2 seconds. This drains static electricity from the package and from your body. v Remove the device from its package and install it directly into the server without setting down the device. If it is necessary to set down the device, put it back into its static-protective package.
Internal cable routing and connectors The following illustration shows the routing of the DVD power, fans 1 and 2, scalability LED, and operator information cables.
The following illustration shows the routing of the USB and DVD signal cables. DVD signal cable USB cable Chapter 2.
Removing the top cover Note: Before you install optional hardware devices, make sure that the server is working correctly. Start the server, and make sure that the operating system starts, if an operating system is installed, or that a 19990305 error code is displayed, indicating that an operating system was not found but the server is otherwise working correctly.
5. Slide the blue latches on the top-cover bracket toward the center of the server. Latch Latch 6. Tilt and lift the top-cover bracket out of the server. 7. If you are instructed to return the top-cover bracket, follow all packaging instructions, and use any packaging materials for shipping that are supplied to you. Chapter 2.
Installing the top-cover bracket Latch Latch To replace the top-cover bracket, complete the following steps: 1. Make sure that all internal cables are correctly routed. 2. Align the top-cover bracket on top of the server so that the metal tabs line up correctly on the chassis, and then rotate it into place. 3. Slide the blue latches on the top cover bracket toward the outside of the server to lock it in place.
Removing the bezel Note: You do not have to remove the top cover before you remove the bezel. To remove the bezel, complete the following steps: 1. Read “Safety” on page v and “Working inside the server with the power on” on page 40. 2. Press on the bezel retention tabs on the sides of the bezel and pull the bezel away from the server.
Note: To change the startup sequence, start the Setup utility and select Start Options from the main menu. See “Using the Setup utility” on page 96 for details about using the Setup utility. v The PCI Express 2.0 bus configuration is as follows: – Expansion slot 1 is x16, slot 2 is x8 (x4 lanes), and slots 3 through 6 are x8. – Expansion slot 7 is a non-standard, 106-pin connector but accepts PCI Express x8, x4, and x1 standard adapters.
7. Touch the static-protective package that contains the adapter to any unpainted surface on the outside of the server; then, grasp the adapter by the top edge or upper corners of the adapter and remove it from the package. 8. Carefully grasp the adapter by its top edge or upper corners, and align it with the connector on the I/O board. 9. Press the adapter firmly into the adapter connector. 10. Push down on the blue adapter retention latch until it clicks into place, securing the adapter. 11.
To install a ServeRAID adapter, for use with eXFlash drives, in a rear PCI connector, complete the following steps. 1. Read “Safety” on page v and “Installation guidelines” on page 38. 2. Turn off the server and peripheral devices, and disconnect the power cords and all external cables. 3. Remove the server cover (see “Removing the top cover” on page 44) and determine which PCI Express expansion slot you will use for the adapter. 4. Remove the top cover bracket. 5.
11. Route the SAS cables under the bottom of the I/O shuttle. SAS signal cables (2) 12. Connect one end of each SAS signal cable that came with the eXFlash drive cage and backplane option to the backplane and the other end to the ServeRAID adapter. v Connect one end of the first cable to Port 0 on the ServeRAID adapter and the other end to connector J39 on the backplane. v Connect one end of the second cable to Port 1 on the ServeRAID adapter and the other end to connector J40 on the backplane. 13.
Installing a hot-swap power supply Statement 5 CAUTION: The power control button on the device and the power switch on the power supply do not turn off the electrical current supplied to the device. The device also might have more than one power cord. To remove all electrical current from the device, ensure that all power cords are disconnected from the power source.
4. Slide the power supply into the bay and fully close the locking handle by sliding it down to the locked position. 5. Connect one end of the power cord for the new power supply into the ac connector on the back of the power supply, and connect the other end of the power cord into a properly grounded electrical outlet. 6. Make sure that the ac power LED on the power supply is lit, indicating that the power supply is operating correctly.
The following illustration shows how to install a hot-swap hard disk drive. Activity LED Status LED Hard disk Drive handle (in open position) drive assembly Filler panel To install a hot-swap hard disk drive, complete the following steps: 1. Read “Safety” on page v and “Installation guidelines” on page 38. 2. Remove the filler panel from one of the empty hot-swap bays. 3. 4. 5. 6. Note: When you install a drive in bays 4 through 7, you must first install a hard disk drive backplane.
Installing a DVD (optical) drive DVD bracket Release button To confirm that the server supports the DVD drive that you are installing, see http://www.ibm.com/systems/info/x86servers/serverproven/compat/us/. To install a DVD drive, compete the following steps: 1. Read “Safety” on page v and “Installation guidelines” on page 38. 2. Turn off the server and peripheral devices, and disconnect the power cord and all external cables. 3. Remove the front bezel. 4.
7. Disconnect the SAS signal cables from the ServeRAID adapter. 8. Lift the SAS power and configuration cable handle up to disconnect the cables from the microprocessor board. 9. Slide the backplane carrier release tab forward and slightly lift the carrier. 10. Remove the backplane carrier and SAS power cable handle from the server together. SAS power and configuration cables Backplane carrier Alignment pins Release tab 11. Remove the backplane filler from the backplane carrier. a.
12. Orient and install the new backplane into the backplane carrier. a. Position the notch in the backplane over the bottom right of the carrier. b. Position the holes in the backplane over the pins in the carrier. c. Push the backplane into the carrier. 13. Connect the new SAS signal cable that came with the backplane to the new backplane. 14. Connect the two unconnected power cables from the SAS power cable handle to the new backplane.
18. Install the ServeRAID adapter onto the RAID adapter carrier, and then install the carrier into the server. Release latch Post Tabs 19. Install the top cover bracket (see “Installing the top-cover bracket” on page 46). 20. Push the hard disk drives and hard disk drive fillers back into place so that they connect to the backplane. 21. Install the top cover. 22. Connect the cables and power cords (see “Connecting the cables” on page 79). 23. Turn on all attached devices and the server. 24.
2. Turn off the server and peripheral devices, and disconnect the power cord and all external cables. 3. Remove the server cover (see “Removing the top cover” on page 44). 4. If any hard disk drives or fillers are installed in the server, pull out the bottom four just enough to disconnect them from the backplane, and completely remove any fillers from the top four bays. 5. Remove the backplane carrier and the SAS power cable handle: a.
7. Remove the backplane filler from the backplane carrier. 8. 9. 10. 11. a. Push the tabs on the backplane outward. b. Pull the filler out of the backplane carrier. Check the label on the cable handle to make sure you use the correct power and configuration cable handle from the option kit. Connect the new power and configuration cables from the power cable handle to the backplane in the carrier. Use the shorter cables when connecting to the backplane in the bottom position of the carrier.
14. Connect the two SAS signal cables to the ServeRAID adapter (such as a ServeRAID B5015 SSD Controller or a 6Gb SSD HBA). Connect the cable from the bottom backplane to port 0 and the cable from the new top backplane to port 1. 15. To install a ServeRAID adapter in one of the PCI connectors, see “Installing a ServeRAID adapter for use with eXFlash drives” on page 49 for installation and cabling information. 16. Install the top cover. 17. To install the solid state drives, see “Installing a 1.
Installing a QPI wrap card Wrap card Release latch In a one node server only, if your server has more than two microprocessors installed, you must install two QPI wrap cards in the server. To confirm that the server supports the QPI wrap card that you are installing, see http://www.ibm.com/systems/info/x86servers/serverproven/compat/us/. To install a QPI wrap card, complete the following steps: 1. Read “Safety” on page v and “Installation guidelines” on page 38. 2.
Installing an internal removable flash drive The server supports two internal removable flash drives that are installed in the USB connectors on the I/O board. You do not have to turn off the server to install an internal removable flash drive. Locking collar To confirm that the server supports the flash drive that you are installing, see http://www.ibm.com/systems/info/x86servers/serverproven/compat/us/. To install an internal removable flash drive, complete the following steps: 1.
Note: To remove an internal removable flash memory drive, push down on the locking collar to unlock the drive before you remove the drive. 6. Reinstall the power supply (see Installing a hot-swap power supply) and reconnect the power cable. 7. (IBM Business Partners only) Restart the server. Confirm that it starts correctly and recognizes the newly installed devices, and make sure that no error LEDs are lit. 8.
v When you restart the server after you add or remove a DIMM, the server displays a message that the memory configuration has changed. v Memory cards in connectors 1 and 2 support microprocessor 1, memory cards in connectors 3 and 4 support microprocessor 2, memory cards in connectors 5 and 6 support microprocessor 3, and memory cards in connectors 7 and 8 support microprocessor 4. v There are four memory power buses, which are split among the eight memory cards.
DIMM 1 DIMM 2 DIMM 3 DIMM 4 DIMM 5 DIMM 6 DIMM 7 DIMM 8 v In a low-cost and low-power DIMM installation, install the DIMMs on each memory card in the order shown in the following tables. The goal in a low-cost and low-power configuration is to completely fill each memory card before you install the next memory card. Table 6.
Table 8.
available when memory mirroring is enabled. Note that some Windows operating systems do not recognize memory mirroring when they report the amount of available memory and instead report the total DIMM capacity. To enable memory mirroring, you must install DIMMs in sets of four, one pair in each memory card. All DIMMs in each set must be the same size and type. Memory cards 1 and 2 mirror each other, cards 3 and 4 mirror each other, memory cards 5 and 6 mirror each other, and cards 7 and 8 mirror each other.
v Memory sparing reserves memory capacity for failover in the event of a DIMM failure, and the reserved capacity is subtracted from the total available memory. Memory sparing provides less redundancy than memory mirroring does. If a predetermined threshold of correctable errors is reached, the contents of the failing DIMM are copied to the spare memory, and the failing DIMM or rank is disabled. To enable memory sparing through the Setup utility, select System Settings > Memory.
Installing a memory card At least one memory card with one pair of DIMMs must be installed for the server to operate correctly. The Intel 7500 Scalable Memory Buffer memory card and the Intel 7510 Scalable Memory Buffer memory card are not interchangeable and cannot be used in the same server. To verify that your server supports the memory card that you are installing, look at the label on the top of the memory card.
mirroring. The following instructions are for installing one pair of DIMMs. To install DIMM pairs on more than one memory card, repeat steps 3 though 7 for each memory card. To confirm that the server supports the DIMMs that you are installing, see http://www.ibm.com/systems/info/x86servers/serverproven/compat/us/. To install a DIMM, complete the following steps: 1. Read “Safety” on page v and “Installation guidelines” on page 38. 2.
7. Touch the static-protective package that contains the DIMM to any unpainted metal surface on the outside of the server; then, remove the DIMM from the package. 8. Turn the DIMM so that the DIMM keys align correctly with the slot. DIMM Retaining clip 9. Insert the DIMM into the connector by aligning the edges of the DIMM with the slots at the ends of the DIMM connector. Firmly press the DIMM straight down into the connector 2 by applying pressure on both ends of the DIMM simultaneously.
10. Install the memory card. Release lever Memory card filler a. If this is a new memory card, remove the memory card filler from the server. b. Insert the memory card into the memory-card connector. c. Press the memory card into the connector and close the release levers. d. Slide the blue release latch to the locked position. If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.
– Intel Xeon EX versions of the 6000 and 7000 Series microprocessors are supported only on machine types 7145 and 7146. – Intel Xeon EX E7 Series microprocessors are supported only on machine types 7143 and 7191. v The server can operate as a symmetric multiprocessing (SMP) server. With SMP, certain operating systems and application programs can distribute the processing load among the microprocessors.
Attention: When you handle static-sensitive devices, take precautions to avoid damage from static electricity. For details about handling these devices, see “Handling static-sensitive devices” on page 40. 4. Slide the blue latches on the top cover bracket toward the center of the server. Latch Latch 5. Lift the top cover bracket out of the server. 6. Remove the heat-sink blank and store it for future use. 7. Open the release socket lever and rotate the load plate. Release socket lever 8.
a. Remove the static-protective bag, and the foam surrounding the bag, from the box. b. Touch the static-protective bag that contains the new microprocessor to any unpainted metal surface on the outside of the server. c. Carefully remove the microprocessor from the static-protective bag, touching only the edges of the microprocessor. d. If there is a plastic protective cover on the bottom of the microprocessor, carefully remove it. Protective cover Microprocessor e.
Handle Installation tool Microprocessor 10. Carefully position the microprocessor with the microprocessor tool over the microprocessor socket. Twist the microprocessor tool counterclockwise to insert the microprocessor into the socket. 11. Close the load plate and then rotate the microprocessor-release lever to secure the microprocessor.
Heat sink Clips Clips Tabs Tabs 15. Press on the top of the heat sink and rotate the lever to the closed position. If you have other devices to install or remove, do so now. Otherwise, go to “Completing the installation” on page 79.
Completing the installation To complete the installation, complete the following steps: 1. If you removed the front bezel, slide the bezel onto the front of the server chassis. 2. If you removed the top-cover bracket, reinstall it. Slide the blue latches into the locked position. 3. Place the top cover over the top of the server. 4. Slide the top cover forward; then, press down on the cover handle until it clicks into place. 5. Connect the cables and power cords to the rear of the server.
Updating the server configuration When you start the server for the first time after you add or remove a device, you might receive a message that the configuration has changed. The Setup utility starts automatically so that you can save the new configuration settings. For more information, see Chapter 3, “Configuring the server,” on page 95. Some optional devices have device drivers that you must install. For information about installing device drivers, see the documentation that comes with each device.
Installing hardware devices in the memory expansion module The following sections provide detailed instructions for installing optional hardware devices in the optional IBM MAX5 for System x memory expansion module. Memory expansion module components The following illustration shows the major components in the memory expansion module. The illustrations in this document might differ slightly from your hardware.
Alignment tab Release tab Alignment tab Bezel Release tab Removing the memory expansion module system-board tray To remove the memory expansion module system-board tray, complete the following steps: 1. Read “Safety” on page v and “Installation guidelines” on page 38. 2. Turn off the host server (see “Turning off the server” on page 20) and all attached peripheral devices. Disconnect all power cords; then, disconnect all external cables from the server.
5. Grasp the handles and pull the system-board tray out until it stops; then, press in the blue stop-tabs on both sides of the system-board tray and pull the tray out of the chassis. If you have other devices to install or remove, do so now. Otherwise, go to “Completing the memory expansion module installation” on page 90.
v Double-device data correction support is only available when 16 GB x4 DRAM technology DIMMs are installed in the memory expansion module and the memory expansion module is connected to a host server. v The memory expansion module supports memory sparing through the host server. Memory sparing reserves memory capacity for failover in the event of a DIMM failure, and the reserved capacity is subtracted from the total available memory. Memory sparing provides less redundancy than memory mirroring does.
v A minimum of two DIMMs must be installed in the memory expansion module for each microprocessor in the host server. v The maximum operating speed of the memory expansion module is determined by the slowest DIMM installed in the memory expansion module. v The memory expansion module does not come with any DIMMs when you purchase it as an optional device. When you install DIMMs, install them in the order shown in the following tables to optimize system performance.
- The maximum available memory is reduced to half of the installed memory when memory mirroring is enabled. For example, if the memory expansion module has 64 GB of memory installed, only 32 GB of addressable memory is available when you use memory mirroring. - The following table lists the DIMM installation sequence for memory-mirroring mode. Table 13.
The following illustration shows the locations of the DIMM connectors on the system-board tray. To install a DIMM (memory module) in the memory expansion module, complete the following steps. Note: The memory expansion module might come with DIMM fillers on DIMM connectors that are not populated. Remove them before you install DIMMs in those connectors. 1. Read “Safety” on page v and “Installation guidelines” on page 38. 2.
6. Touch the static-protective package that contains the new DIMM to any unpainted metal surface on the outside of the memory expansion module; then, remove the DIMM from the package. 7. Carefully open both retaining clips on each end of the DIMM connector. Attention: To avoid breaking the retaining clips or damaging the DIMM connectors, open and close the clips gently. 8. Turn the DIMM so that the DIMM keys align correctly with the connector. 9.
v The IBM MAX5 for System x memory expansion module comes with one or two 675-watt hot-swap 12-volt output power supplies (depending on the model). The input voltage is 110 V ac or 220 V ac auto-sensing. Two power supplies must be installed for redundancy support. Note: You cannot mix 110 V ac and 220 V ac power supplies in the memory expansion module; it is not supported. v These power supplies are designed for parallel operation.
2. If the server is in a rack, at the back of the server, pull back the cable-management arm to gain access to the rear of the server and the power supply. 3. If you are installing a hot-swap power supply into an empty bay, remove the power-supply filler panel from the power-supply bay. 4. Touch the static-protective package that contains the hot-swap power supply to any unpainted metal surface on the server; then, remove the power supply from the package and place it on a static-protective surface. 5.
3. Reconnect the cables and power cords (see “Connecting the memory expansion module cables” on page 92). 4. Slide the memory expansion module and the server back into the rack, if necessary. 5. Turn on the peripheral devices and the host server Replacing the memory expansion module system-board tray To confirm that the memory expansion module supports the system-board tray that you are installing, see http://www.ibm.com/systems/info/x86servers/ serverproven/compat/us/.
Replacing the memory expansion module bezel To confirm that the memory expansion module supports the bezel that you are installing, see http://www.ibm.com/systems/info/x86servers/serverproven/ compat/us/. To replace the memory expansion module bezel, complete the following steps: 1. Read “Safety” on page v and “Installation guidelines” on page 38. 2. Align the bezel alignment tabs with the chassis and press the bezel onto the chassis until it snaps into place.
Updating the memory expansion module configuration No configuration updates are required to be made directly to the memory expansion module. When the host server configuration is updated, the updates are automatically applied to the memory expansion module through the host server IMM. Chapter 2.
94 IBM System x3850 X5 and x3950 X5 Types 7145, 7146, 7143, and 7191: Installation and User's Guide
Chapter 3. Configuring the server The following configuration programs come with the server: v Setup utility The Setup utility (formerly called the Configuration/Setup Utility program) is part of the IBM UEFI firmware. Use it to perform configuration tasks such as changing the startup-device sequence, setting the date and time, and setting passwords. For information about using this program, see “Using the Setup utility” on page 96.
The blue-screen capture feature captures the video display contents before the IMM restarts the server when the IMM detects an operating-system hang condition. A system administrator can use the blue-screen capture feature to assist in determining the cause of the hang condition.
Select this choice to view information about the server. When you make changes through other choices in the Setup utility, some of those changes are reflected in the system information; you cannot change settings directly in the system information. This choice is on the full Setup utility menu only.
Select this choice to select the memory speed or to specify a preset operating mode to configure the server for maximum power savings, maximum efficiency, or maximum performance. - Efficiency mode Select this choice to maintain the optimal balance between performance and power consumption. The server generally produces the best performance per watt while it is in this mode. - Acoustic mode Select this choice to configure the server to draw the minimum amount of power and generate the least noise.
Select this choice to enable or disable devices from taking control of the boot process. The default is Disable. - Legacy Thunk Support Select this choice to enable or disable UEFI to interact with PCI mass storage devices that are not UEFI compliant. - Network Select this choice to view or configure optional network devices, such as iSCSI, PXE, and network devices. There might be additional configuration choices for optional network devices that are compliant with UEFI 2.1 and later.
Select this choice to set, change, or clear passwords. For information about passwords, see “Passwords.” This choice is on the full and limited Setup utility menu. – Set Power-on Password Select this choice to set or change a power-on password. For more information, see “Power-on password” on page 101. – Clear Power-on Password Select this choice to clear a power-on password. – Set Administrator Password Select this choice to set or change an administrator password.
password has access to only the limited Setup utility menu; the user can set, change, and delete the power-on password, if the system administrator has given the user that authority. Power-on password If a power-on password is set, when you turn on the server, you must type the power-on password to complete the system startup. You can use any combination of 6 - 20 printable ASCII characters for the password.
Using the Boot Selection Menu program The Boot Selection Menu is used to temporarily redefine the first startup device without changing boot options or settings in the Setup utility. To 1. 2. 3. use the Boot Selection Menu program, complete the following steps: Turn off the server. Restart the server. When the prompt Select Boot Device is displayed, press F12. If a bootable USB mass storage device is installed, a submenu item (USB Key/Disk) is displayed. 4.
To start the ServerGuide Setup and Installation CD, complete the following steps: 1. Insert the CD, and restart the server. If the CD does not start, see "ServerGuide problems" in the Problem Determination and Service Guide on the IBM Documentation CD. 2. Follow the instructions on the screen to complete the following tasks: a. Select your language. b. Select your keyboard layout and country. c. View the overview to learn about ServerGuide features. d.
Typical operating-system installation The ServerGuide program can reduce the time it takes to install an operating system. It provides the device drivers that are required for your hardware and for the operating system that you are installing. This section describes a typical ServerGuide operating-system installation. Note: Features and functions can vary slightly with different versions of the ServerGuide program. 1.
v DIMM error assistance. The Unified Extensible Firmware Interface (UEFI) disables a failing DIMM that is detected during POST, and the IMM lights the associated system-error LED and the failing DIMM error LED. v Environmental monitor with fan speed control for temperature, voltages, fan failure, and power supply failure. v Intelligent Platform Management Interface (IPMI) Specification V2.0 and Intelligent Platform Management Bus (IPMB) support. v Invalid system configuration (CNFG) LED support.
3. Select System Settings → Integrated Management Module → Network Configuration. 4. Locate the IP address. 5. Exit from the Setup utility. Logging on to the IMM web interface For detailed information about the integrated management module (IMM) and how to use it, see the Integrated Management Module User's Guide at http://www.ibm.com/systems/support/. To log on to the IMM web interface, complete the following steps: 1.
The blue-screen capture feature captures the video display contents before the IMM restarts the server when the IMM detects an operating-system hang condition. A system administrator can use the blue-screen capture to assist in determining the cause of the hang condition. Using the embedded hypervisor The VMware ESXi embedded hypervisor software might be available on the IBM USB flash device with embedded hypervisor.
1. Turn on the server. 2. 3. 4. 5. 6. Note: Approximately 1 to 3 minutes after the server is connected to ac power, the power-control button becomes active. When the prompt Setup is displayed, press F1. From the Setup utility main menu, select Boot Manager. Select Add Boot Option; then, select USB Storage. Press Enter, and then press Esc. Select Change Boot Order and then select Commit Changes; then, press Enter. Select Save Settings and then select Exit Setup.
Configuring RAID arrays Through the Setup utility, you can access utilities to configure RAID arrays. The specific procedure for configuring arrays depends on the RAID controller that you are using. For details, see the documentation for your RAID controller. To access the utility for your RAID controller, complete the following steps: 1. Turn on the server. 2. When the prompt Setup is displayed, press F1.
b. If a newer version of IBM Systems Director than what comes with the server is shown in the drop-down list, follow the instructions on the Web page to download the latest version. 2. Install the IBM Systems Director program. If your management server is connected to the Internet, to locate and install updates and interim fixes, complete the following steps: 1. Make sure that you have run the Discovery and Inventory collection tasks. 2.
Rear view QPI cables Server Memory expansion module Server Memory expansion module EXA cables QPI cables The Scalable Partition web interface is an extension of the IMM web interface and is used to create, delete, control, and view scalable partitions. The Scalable Partition web interface firmware is in the IMM. A multi-node configuration interconnects multiple servers or scalable partitions.
Note: To check for the latest firmware levels and to download firmware updates, go to http://www.ibm.com/supportportal/.
Note: To reorder the sequence in which the nodes appear in the diagram on the page, click Redraw. For example, you can reorder the diagram to reflect the order in which the nodes are physically installed in a rack. The nodes are reordered according to the QPI or EXA cabling, with the node that you select in the top position.
5. Make sure that each chassis is in Standalone mode, which indicates that the system is now partitioned into two independent systems. Using the IMM Telnet interface You can create, modify, and control partitions through the IMM Telnet interface. To use the IMM Telnet interface, log in to the IMM Telnet interface on either node and use the scale command for multi-node control and configuration. To display scale information, in the IMM Telnet interface, type scale at the system prompt.
You can create partitions through the IMM Telnet interface by using the auto command (scale -auto primarynodeid) or the create command (scale -create primarynodeid, nodeid) command. You can use the auto command to create a partition that includes all the nodes in the complex and specify the node that is to be the primary node. For example, if the EXA system contains only two nodes, 3c0d and 8bb9, to create a 2-node partition with node 3c0d as the primary node, type scale -auto 3c0d.
Toggling partitions by using the IMM Telnet interface Note: Before you toggle a partition to Standalone mode, make sure that all the nodes in the partition are powered off. A partition can be in either of two modes: Standalone and Partition. When the partition is in Standalone mode, each node operates independently. When the partition is in Partition mode, all the nodes in the partition boot as a single system. The command to toggle the partition is scale -mode standalone|partition -partid id.
Appendix. Getting help and technical assistance If you need help, service, or technical assistance or just want more information about IBM products, you will find a wide variety of sources available from IBM to assist you. Use this information to obtain additional information about IBM and IBM products, determine what to do if you experience a problem with your IBM system or optional device, and determine whom to call for service, if it is necessary.
of determining a solution to your problem by making the pertinent information available to IBM service quickly and efficiently. IBM service technicians can start working on your solution as soon as you have completed and submitted an Electronic Service Request. Using the documentation Information about your IBM system and preinstalled software, if any, or optional device is available in the documentation that comes with the product.
IBM Taiwan product service Use this information to contact IBM Taiwan product service. IBM Taiwan product service contact information: IBM Taiwan Corporation 3F, No 7, Song Ren Rd. Taipei, Taiwan Telephone: 0800-016-888 Appendix.
120 IBM System x3850 X5 and x3950 X5 Types 7145, 7146, 7143, and 7191: Installation and User's Guide
Notices This information was developed for products and services offered in the U.S.A. IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used.
Adobe and PostScript are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States and/or other countries. Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc., in the United States, other countries, or both and is used under license therefrom. Intel, Intel Xeon, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.
Some software might differ from its retail version (if available) and might not include user manuals or all program functionality. Particulate contamination Attention: Airborne particulates (including metal flakes or particles) and reactive gases acting alone or in combination with other environmental factors such as humidity or temperature might pose a risk to the server that is described in this document.
Documentation format The publications for this product are in Adobe Portable Document Format (PDF) and should be compliant with accessibility standards. If you experience difficulties when you use the PDF files and want to request a web-based format or accessible PDF document for a publication, direct your mail to the following address: Information Development IBM Corporation 205/A015 3039 E. Cornwallis Road P.O. Box 12195 Research Triangle Park, North Carolina 27709-2195 U.S.A.
Australia and New Zealand Class A statement Attention: This is a Class A product. In a domestic environment this product may cause radio interference in which case the user may be required to take adequate measures. European Union EMC Directive conformance statement This product is in conformity with the protection requirements of EU Council Directive 2004/108/EC on the approximation of the laws of the Member States relating to electromagnetic compatibility.
Deutschland: Einhaltung des Gesetzes über die elektromagnetische Verträglichkeit von Geräten Dieses Produkt entspricht dem “Gesetz über die elektromagnetische Verträglichkeit von Geräten (EMVG)”. Dies ist die Umsetzung der EU-Richtlinie 2004/108/EG in der Bundesrepublik Deutschland. Zulassungsbescheinigung laut dem Deutschen Gesetz über die elektromagnetische Verträglichkeit von Geräten (EMVG) (bzw.
Japan Electronics and Information Technology Industries Association (JEITA) Confirmed Harmonics Guidelines (products less than or equal to 20 A per phase) Korea Communications Commission (KCC) statement This is electromagnetic wave compatibility equipment for business (Type A). Sellers and users need to pay attention to it. This is for any areas other than home.
128 IBM System x3850 X5 and x3950 X5 Types 7145, 7146, 7143, and 7191: Installation and User's Guide
Index Numerics backplane connectors, hard disk drive 33 installing hard disk drive 55 backplane and drive cage, installing 58 bays 5, 7 bezel memory expansion module removing 81 replacing 92 server removing 47 blue-screen capture feature, overview 106 boot selection menu program, using 102 Broadcom Gigabit Ethernet Utility program, enabling 108 Business Partner instructions 29 button, locator 14 cabling external 79 memory expansion module 92 server 79 caution statements 5 CD, documentation 3 China Class A
Ethernet (continued) Gigabit controller 8 icon LED 14 transmit/receive activity LED 16 Ethernet-link status LED 14 European Union EMC Directive conformance statement 125 eXFlash backplane cable connectors 33 drive cage, installing 58 expansion bays 5 slots 5 slots, adapter 47 expansion bays 7 expansion module, memory front view 26 rear view 27 expansion slots 7 external cabling 79 F fan cable routing 42 fans 8 fans and redundant cooling 24 FCC Class A notice 124 features IMM 104 memory expansion module 23
internal cabling (continued) operator information cables 42 scalability LED 42 internal removable flash drive 63 IP address, obtaining for IMM Web interface 105 J J22 jumper 37 J29 jumper 37 J31 jumper 37 Japan Electronics and Information Technology Industries Association statement 126 Japan VCCI Class A statement 126 Japan Voluntary Control Council for Interference Class A statement 126 JEITA statement 126 jumpers, I/O board 37 K Korea Communications Commission statement 127 L LED ac power 17 dc power 1
PCI bus configuration 49 PCI Express expansion slots 47 People's Republic of China Class A electronic emission statement 127 power features 19 requirement 8 requirement in server 5 power on, working inside server 40 power requirement memory expansion module 23 server 5 power requirement specifications 24 power supply installing in server 52 installing, memory expansion module 88 limitations of one 39 specification 7 specifications 23 memory expansion module 23 server 5 power-control button 14 power-cord con
updating IBM Systems Director 109 memory expansion module configuration 93 server configuration 80, 95 USB external connectors, rear 16 external connectors, server front 13 internal connectors 63 using boot selection menu program 102 embedded hypervisor 107 remote presence feature 106 scalable partition 110 ServerGuide 102 Setup utility 96 UXSPI 13 V video connector 16 W warranty information 25 Web interface obtaining IP address 105 web interface, scalable partition 110, 111, 113, 114 website ServerGuide
134 IBM System x3850 X5 and x3950 X5 Types 7145, 7146, 7143, and 7191: Installation and User's Guide
Part Number: 81Y1249 Printed in USA (1P) P/N: 81Y1249
