SPARC Enterprise M4000/M5000 Servers Overview Guide Part No.
Copyright © 2007, 2010, Oracle and/or its affiliates. All rights reserved. FUJITSU LIMITED provided technical input and review on portions of this material. Oracle and/or its affiliates and Fujitsu Limited each own or control intellectual property rights relating to products and technology described in this document, and such products, technology and this document are protected by copyright laws, patents, and other intellectual property laws and international treaties.
Copyright © 2007, 2010, Oracle et/ou ses sociétés affiliées. Tous droits réservés. FUJITSU LIMITED a fourni et vérifié des données techniques de certaines parties de ce composant. Oracle et/ou ses sociétés affiliées et Fujitsu Limited détiennent et contrôlent chacune des droits de propriété intellectuelle relatifs aux produits et technologies décrits dans ce document.
Contents Preface 1. ix System Overview 1–1 1.1 Product Overview 1.2 Features 1.3 1–1 1–2 1.2.1 SPARC Enterprise M4000 Server 1–5 1.2.2 SPARC Enterprise M5000 Server 1–7 1.2.3 Operator Panel Overview Components 1–8 1–9 1.3.1 Motherboard Unit 1.3.2 CPU Module 1.3.3 Memory Board 1.3.4 Fan Unit 1.3.5 Power Supply 1–10 1–11 1–13 1–15 1–17 CPU Types and Server Maximum Power Consumption 1.3.6 Operator Panel 1.3.7 eXtended System Control Facility Unit (XSCFU) 1.3.
1.4 1.5 2. Hard Disk Drive 1–30 1.3.9.3 Tape Drive Unit 1–31 I/O Options 1–31 1.4.1 External I/O Expansion Unit 1.4.2 PCI Cards 1–31 Software Features 1–32 System Features and Capabilities 2.1 Hardware Configuration 2.1.1 2.2 2.3 2.4 CPU Module 1–31 2–1 2–1 2–1 2.1.1.1 CPU Types and Features 2.1.1.2 Supported Processors and CPU Operational Modes 2.1.2 Memory Subsystem 2.1.3 I/O Subsystem 2.1.4 System Bus 2.1.
3. 2.4.2 Availability 2.4.3 Serviceability About the Software 3.1 3.2 2–10 3–1 Oracle Solaris Operating System Software 3.1.1 Domains 3.1.2 PCI Hot-Plug XSCF Firmware 3–1 3–1 3–2 3–2 3.2.1 XSCF User Interfaces 3.2.2 XSCF Features 3.2.3 Index 2–9 3–2 3–3 3.2.2.1 System Management 3.2.2.2 Security Management System Status Management 3–3 3–3 3–4 3.2.3.1 Error Detection and Management 3.2.3.2 Remote Control and Monitoring 3.2.3.3 Configuration Management 3.2.3.
viii SPARC Enterprise M4000/M5000 Servers Overview Guide • December 2010
Preface This overview guide describes the hardware and software features of the SPARC Enterprise M4000/M5000 servers from Oracle and Fujitsu. References herein to the M4000 server or M5000 server are references to the SPARC Enterprise M4000 or SPARC Enterprise M5000 server.
Book Titles Sun/Oracle Fujitsu SPARC Enterprise M4000/M5000 Servers Site Planning Guide 819-2205 C120-H015 SPARC Enterprise Equipment Rack Mounting Guide 819-5367 C120-H016 SPARC Enterprise M4000/M5000 Servers Getting Started Guide* 821-3045 C120-E345 SPARC Enterprise M4000/M5000 Servers Overview Guide 819-2204 C120-E346 SPARC Enterprise M3000/M4000/M5000/M8000/M9000 Servers Important Legal and Safety Information 821-2098 C120-E633 SPARC Enterprise M4000/M5000 Servers Safety and Compliance
Text Conventions This manual uses the following fonts and symbols to express specific types of information. Fonts/symbols Meaning Example AaBbCc123 What you type, when contrasted with on-screen computer output. This font represents the example of command input in the frame. XSCF> adduser jsmith AaBbCc123 The names of commands, files, and directories; on-screen computer output. This font represents the example of command input in the frame.
Documentation Feedback If you have any comments or requests regarding this document, go to the following web sites. ■ For Oracle users: http://docs.sun.com ■ For Fujitsu users in U.S.A., Canada, and Mexico: http://www.computers.us.fujitsu.com/www/support_servers.shtml?s upport/servers ■ For Fujitsu users in other countries, refer to this SPARC Enterprise contact: http://www.fujitsu.com/global/contact/computing/sparce_index.
CHAPTER 1 System Overview This chapter provides information on the hardware and software features and configurations for the SPARC Enterprise M4000/M5000 midrange servers. This chapter contains these sections. 1.1 ■ Section 1.1, “Product Overview” on page 1-1 ■ Section 1.2, “Features” on page 1-2 ■ Section 1.3, “Components” on page 1-9 ■ Section 1.4, “I/O Options” on page 1-31 ■ Section 1.
1.2 Features TABLE 1-1 provides features for fully configured servers. For more detailed specifications on each component, see Section 1.3, “Components” on page 1-9. For specifications of equipment racks, refer to the technical information manual for your equipment rack.
TABLE 1-1 Server Features (Continued) Features M4000 Server M5000 Server Redundant cooling • Two 172-mm fans (One fan is redundant) • Two 60-mm fans (One fan is redundant) Four 172-mm fans per server Two fans are redundant Internal drives 1 CD-RW/DVD-RW drive unit, 2 hard disk drives, 1 tape drive unit (optional) 1 CD-RW/DVD-RW drive unit, 4 hard disk drives, 1 tape drive unit (optional) Domains 2 4 Architecture Platform group: sun4u Platform name: SUNW, SPARC-Enterprise Rackmountable Equip
Environmental Requirements TABLE 1-2 Operating Range Non-Operating Range Optimum Ambient temperature 5˚C to 35˚C (41˚F to 95˚F) Unpacked: 0˚C to 50˚C (32˚F to 122˚F) Packed: -20˚C to 60˚C (-4˚F to 140˚F) 21˚C to 23˚C (70˚F to 74˚F) Relative humidity 20% RH to 80% RH to 93% RH 45% RH to 50% RH 3,000 m (10,000 ft) 12,000 m (40, 000 ft) * Altitude restriction † Temperature conditions 5˚C to 35˚C (41˚ F to 95˚F): 0 m to 500 m (0 ft to 1,640 ft) 5˚C to 33˚C (41˚ F to 91.
1.2.1 ■ Redundant power and cooling ■ Hot FRU replacement capability ■ I/O expandability with the External I/O Expansion Unit SPARC Enterprise M4000 Server The M4000 server is a six-rack unit (6 RU) enclosure (10.35 inches, 263 mm), which supports up to two dynamic server domains. FIGURE 1-2 and FIGURE 1-3 illustrate the components. See Section 1.3, “Components” on page 1-9 for a brief description of each component.
Location Number Component Maximum Number per Server 4 Power supply units (PSU) 2 5 Hard disk drives (HDD), Serial-attached SCSI (SAS) 2 6 CD-RW/DVD-RW drive unit (DVDU) 1 7 Tape drive unit (TAPEU), optional 1 FIGURE 1-3 M4000 Server (Internal Rear View) 1 1 2 3 1-6 Location Number Component Maximum Number per Server 1 60-mm fans (FAN_B) 2 2 eXtended System Control Facility unit (XSCFU) 1 3 I/O unit—supports one PCI-X slot (lowest slot) and four PCI Express slots (four upper slot
1.2.2 SPARC Enterprise M5000 Server The M5000 server is a ten-rack unit (10 RU) enclosure (17.25 inches, 438 mm), which supports up to four dynamic server domains. FIGURE 1-4 and FIGURE 1-5 illustrates the components. See Section 1.3, “Components” on page 1-9 for a brief description of each component.
FIGURE 1-5 M5000 Server (Rear View) 2 1 2 1.2.3 Location Number Component Maximum Number per Server 1 eXtended System Control Facility Unit (XSCFU) 1 2 I/O unit (IOU) Each I/O unit supports one PCI-X slot (lowest slot) and four PCIe slots (four upper slots) 2 Operator Panel Overview The operator panel, which is identical for both midrange servers, is located on the front of the server in the upper right corner.
For complete details on the operator panel controls, refer to the SPARC Enterprise M4000/M5000 Servers Service Manual. 1.3 Components The components of both midrange servers are described in the following sections: ■ Section 1.3.1, “Motherboard Unit” on page 1-10 ■ Section 1.3.2, “CPU Module” on page 1-11 ■ Section 1.3.3, “Memory Board” on page 1-13 ■ Section 1.3.4, “Fan Unit” on page 1-15 ■ Section 1.3.5, “Power Supply” on page 1-17 ■ Section 1.3.6, “Operator Panel” on page 1-20 ■ Section 1.
TABLE 1-3 FRU Components for Both Midrange Servers (Continued) Component Redundant Cold Replacement Hot Replacement Active Replacement Power supply unit Yes Yes Yes Yes Bus bar, I/O backplane, and power backplane unit (M5000 server) No Yes I/O backplane and power backplane unit (M4000 server) No Yes Hard disk drive No Yes Yes Yes Tape drive unit (optional) No Yes Yes Yes CD-RW/DVD-RW drive unit No Yes Operator panel No Yes 1.3.
FIGURE 1-6 1.3.2 Removing the Motherboard Unit From the M5000 Server CPU Module Each CPU module contains SPARC64 VI processors or SPARC64 VII/SPARC64 VII+ processors. Each processor chip incorporates and implements the following: ■ Chip multithreading (CMT) design that sequentially executes the multiple processes on the CPU. ■ SPARC64 VI processors are two-core processors. ■ SPARC64 VII/SPARC64 VII+ processors are four-core processors.
The CPU modules can be accessed from the top of the midrange server. FIGURE 1-7 and FIGURE 1-8 illustrate the number of CPU modules per midrange server and their location. TABLE 1-4 lists features of the CPU modules. For additional information on the CPU module, refer to the SPARC Enterprise M4000/M5000 Servers Service Manual.
FIGURE 1-8 1.3.3 CPU Modules in the M5000 Server Memory Board Each memory board provides a memory access controller (MAC) and eight DIMM slots (FIGURE 1-9 and FIGURE 1-10). To remove or install memory boards, you must power the server off. TABLE 1-5 lists the memory board features. TABLE 1-5 Memory Board Features Location Top of server Cold FRU replacement capability Yes To install DIMMs, you must remove the memory board and open the case of the memory board.
1-14 FIGURE 1-9 Memory Board Location in the M4000 Server FIGURE 1-10 Memory Board Location in the M5000 Server SPARC Enterprise M4000/M5000 Servers Overview Guide • December 2010
1.3.4 Fan Unit Both midrange servers use 172-mm fan units as the primary cooling system. The M4000 server also use two 60-mm fans. FIGURE 1-11 and FIGURE 1-12 illustrate the number of fans per midrange server, fan location, and the fan types used in both midrange servers. The fan units in both midrange servers move air currents into and out of the server. The fans in both midrange servers are redundant. Because of the redundancy, system operation continues when a failure occurs with one fan.
FIGURE 1-12 172-mm Fan Unit Locations in the M5000 Server 1 1 1 1 1-16 Location Number Component Maximum Number per Server 1 Fan units, 172-mm (FAN_A#0 - FAN_A#3) 4 SPARC Enterprise M4000/M5000 Servers Overview Guide • December 2010
1.3.5 Power Supply Power is provided to both midrange servers by power supply units (FIGURE 1-13 and FIGURE 1-14).
FIGURE 1-14 Power Supply Units in the M5000 Server 1 1 1 1 . Location Number Component Maximum Number per Server 1 Power supply units 4 The redundant power supplies allow continued server operation if a power supply fails. You can remove a power supply by way of active replacement, cold replacement, or hot replacement.
TABLE 1-6 lists the power supply features and some specifications. For additional specifications, refer to the SPARC Enterprise M4000/M5000 Servers Site Planning Guide.
TABLE 1-7 CPU Types and Maximum Power Consumption on the M4000 Server* CPU Type Frequency (GHz) Number Power Consumption (W) Apparent Power (VA) Heat Dissipation (KJ/h) SPARC 64 VI processor 2.15 4 1556 1621 5602 SPARC 64 VII processor 2.4/2.53 4 1656 1725 5962 SPARC 64 VII+ processor 2.66 4 1692 1763 6091 * M4000 system configuration: CPUM x 2, MEMB x 4, 8GB DIMM x 32, HDD x 2, PCIe x 4, PCI-X x 1, DAT x 1.
FIGURE 1-15 Operator Panel 1 2 3 4 5 6 7 Location Number Function 1 Operator panel (FRU) 2 POWER LED 3 XSCF STANDBY LED 4 CHECK LED 5 Power switch 6 Mode switch (key switch) 7 Antistatic ground socket Chapter 1 System Overview 1-21
During startup, the front panel LED status indicators are individually toggled on and off to verify that each component is working correctly. After startup, the front panel LED status indicators operate as described in TABLE 1-9. TABLE 1-9 Icon Operator Panel LEDs and Switches Name Color Description POWER LED Green Indicates the server power status. • On: Server has power. • Off: Server is without power. • Blinking: The power-off sequence is in progress.
TABLE 1-10 Status Indicator LED Pattern Summary LED 1.3.7 POWER XSCF STANDBY CHECK Description of the State Off Off Off The circuit breaker is switched off. Off Off On The circuit breaker is switched on. Off Blinking Off The XSCF is being initialized. Off Blinking On An error occurred in the XSCF. Off On Off The XSCF is on standby. The system is waiting for power-on of the air conditioning system. On On Off Warm-up standby processing is in progress (power-on is delayed).
FIGURE 1-16 XSCFU Location in the M4000 Server FIGURE 1-17 XSCFU Location in the M5000 Server The XSCFU uses the eXtended System Control Facility (XSCF) firmware to provide the following functions: 1-24 ■ Controls and monitors the main unit hardware ■ Monitors the Oracle Solaris Operating System (Oracle Solaris OS), power-on self-test (POST), and the OpenBoot PROM SPARC Enterprise M4000/M5000 Servers Overview Guide • December 2010
■ Controls and manages the interface for the system administrator (such as a terminal console) ■ Administrators device information ■ Controls remote messaging of various events Both midrange servers have one XSCFU, which is serviced from the rear of the server. To replace it, you must power off the server. For more information, refer to the SPARC Enterprise M4000/M5000 Servers Service Manual. The XSCF firmware provides the system control and monitoring interfaces listed below.
1.3.8 I/O Unit The I/O unit is illustrated in FIGURE 1-18 and FIGURE 1-19. Four PCIe buses are connected from one I/O controller. These buses support all of the systems on-board I/O controllers in addition to the interface cards in the server.
FIGURE 1-19 I/O Unit Locations in the M5000 Server 1 1 . Location Number Component Maximum Number per Server 1 I/O unit 2 The I/O unit (IOU) is used in both the midrange servers. Refer to the SPARC Enterprise M4000/M5000 Servers Service Manual for more information on the IOU. The IOU houses the following: ■ Four PCIe 8 lane, short card slots (four upper slots) ■ One PCI-X short card slot (lowest slot) The IOU holds cassettes that support four PCIe cards and one PCI-X card.
1.3.9 On-Board Drive Units Both midrange servers provide front-panel access to the drives (FIGURE 1-20 and FIGURE 1-21).
FIGURE 1-21 CD-RW/DVD-RW Drive Unit, Hard Disk Drive, and Tape Drive Unit in the M5000 Server 3 1 2 2 2 2 Location Number Component Maximum Number per Server 1 CD-RW/DVD-RW drive unit 1 2 Hard disk drive, Serial-attached SCSI (SAS) 4 3 Tape drive unit 1 Chapter 1 System Overview 1-29
1.3.9.1 CD-RW/DVD-RW Drive Unit TABLE 1-11 lists the features, location, and specifications of the CD-RW/DVD-RW drive unit. TABLE 1-11 CD-RW/DVD-RW Drive Unit Features and Specifications for Both Servers Number of CD-RW/DVD-RW drive unit 1 Location Front of server to the right of the hard disk drives Hot FRU replacement No There are two types of CD-RW/DVD-RW drive units: tray load or slot load. Each type of drive unit will connect only with its corresponding drive unit backplane.
1.3.9.3 Tape Drive Unit The tape drive unit in both midrange servers is an optional component. TABLE 1-12 lists the features, location, and specifications of the optional tape drive unit. Contact your sales representative for tape drive unit options on M4000/M5000 servers.
1.5 Software Features Oracle Solaris OS is installed on the system domains. In addition to its suite of software capabilities, Oracle Solaris OS provides functions that interact with system hardware. ■ Dynamic Reconfiguration ■ Oracle Solaris zones ■ PCI hot-plug ■ Capacity on Demand Both midrange servers use the eXtended System Control Facility (XSCF) firmware. This firmware runs on the service processor and provides control and monitoring functions for the system platform.
CHAPTER 2 System Features and Capabilities This chapter provides information on hardware and domain configuration, resource management, and reliability, availability, and serviceability (RAS). 2.1 ■ Section 2.1, “Hardware Configuration” on page 2-1 ■ Section 2.2, “Partitioning” on page 2-5 ■ Section 2.3, “Resource Management” on page 2-6 ■ Section 2.4, “Reliability, Availability, and Serviceability” on page 2-8 Hardware Configuration This section describes the hardware configuration.
2.1.1.1 CPU Types and Features This section describes the CPU types and features. TABLE 2-1 2.1.1.
2.1.2 Memory Subsystem Each memory board in the server contains four or eight DIMMs (dual inline memory modules). Both midrange servers use Double Data Rate II (DDR II) type DIMMs. The memory subsystem supports up to eight-way memory interleaving for high-speed memory access. For more information on memory boards and DIMMs, see Section 1.3.3, “Memory Board” on page 1-13. 2.1.
2.1.5.1 eXtended System Control Facility Unit (XSCFU) The eXtended System Control Facility Unit (XSCFU), also known as the Service Processor, operates independently from the SPARC64 VI/SPARC64 VII/SPARC64 VII+ domains. The Service Processor directs the system startup, reconfiguration, and fault diagnosis. This is where the system management software, which is the eXtended System Control Facility (XSCF) firmware, runs. 2.1.5.
2.2 Partitioning The M4000 and M5000 servers can be divided into multiple independent systems for operation. This dividing function is called partitioning. This section describes features of partitioning and system configurations that can be implemented through partitioning. The individual systems that result from the partitioning of the server are called domains. Domains are sometimes called partitions. Partitioning enables arbitrary assignment of resources in the server.
2.3 Resource Management Both midrange servers provide four means of managing the server’s resources: 2.3.1 ■ Dynamic Reconfiguration ■ PCI Hot-Plug ■ Capacity on Demand (COD) ■ Zones Dynamic Reconfiguration Dynamic reconfiguration (DR) enables hardware resources on system boards to be added and removed dynamically without stopping system operation. DR thus enables optimal relocation of system resources.
2.3.3 Capacity on Demand (COD) The COD feature allows you to configure spare processing resources on your M4000/M5000 server in the form of one or more COD CPUs which can be activated at a later date when additional processing power is needed. To access each COD CPU, you must purchase a COD hardware activation permit. Under certain conditions, you can use COD resources before purchasing COD permits for them.
2.4 Reliability, Availability, and Serviceability Reliability, availability, and serviceability (RAS) are aspects of the system design that affect the ability of the system to: ■ Operate without stopping ■ Remain accessible and usable ■ Minimize the time necessary to service the system TABLE 2-2 defines each RAS feature. TABLE 2-2 2.4.1 RAS Definitions RAS Feature Description Reliability Length of time the midrange server can operate normally without failure.
■ Periodically performs memory patrol to detect memory software errors and stuck-at faults, even in memory areas not normally used (Memory patrol). Memory patrol prevents faulty areas from being used and thereby prevents the occurrence of system failures. ■ 2.4.2 Keeps checking the status of each component to detect signs of an imminent fault, such as system down occurrences. Prevents system failures (Status checking of components).
2.4.3 Serviceability Serviceability represents the ease of recovery from a system failure.
CHAPTER 3 About the Software Both midrange servers include these types of software: 3.1 ■ Section 3.1, “Oracle Solaris Operating System Software” on page 3-1 ■ Section 3.2, “XSCF Firmware” on page 3-2 Oracle Solaris Operating System Software The Oracle Solaris OS is installed on the system domains. For complete information about the Oracle Solaris OS, refer to the Oracle Solaris documentation collection.
3.1.2 PCI Hot-Plug Both midrange servers support the insertion and removal of PCI cards while the Oracle Solaris OS is running for certain PCIe and PCI-X slots. PCI cards must be unconfigured and disconnected using the Oracle Solaris cfgadm(1M) command before the cards can be physically removed. For additional information on PCI hot-plug operations, refer to the SPARC Enterprise M4000/M5000 Servers Service Manual. 3.2 XSCF Firmware Both midrange servers use the XSCF firmware to manage the system.
3.2.2 XSCF Features The XSCF firmware provides commands to manage the system platform, access control, security, faults, logs, domains, and capacity on demand. Each feature is described briefly in the following sections. The XSCF firmware is preinstalled in the XSCFU at the factory. The XSCF firmware supports the following functions: 3.2.2.
Because operation failures and unauthorized accesses during system operation are logged, the system administrator can immediately use the logs to investigate the causes of unauthorized accesses. 3.2.
3.2.3.2 Remote Control and Monitoring The XSCF firmware provides the following remote notification services: 3.2.3.3 ■ Notifying the administrator of any problem that occurs by sending email to the specified email address. ■ The SNMP agent function can be used for trap notification. ■ Maintenance can be performed with the remote maintenance services.
For details of the showenvironment(8) command, refer to the man page. For installation details of the SPARC Enterprise M4000/M5000 servers from Oracle and Fujitsu, see the SPARC Enterprise M4000/M5000 Servers Site Planning Guide and the SPARC Enterprise M4000/M5000 Servers Installation Guide. You can also obtain the exhaust air data using the SNMP agent function. To obtain the data of exhaust air using the SNMP agent function, install the latest XSCF extension MIB definition file to the SNMP manager.
Index C H cabinet, expansion, 1-3 CD-RW/DVD-RW drive unit, 1-30 components, 1-5, 1-9 cooling, 1-3 CPU modules, 1-2, 1-12 CPU operational modes, 2-2 cpumode, 2-2 cpumode,auto, 2-2 hardware features, 1-1 hot-swappable PCI cards, 2-3 D memory boards, 1-2, 1-13 motherboard unit, 1-2, 1-10 dimensions, 1-3 DIMMs, 1-2, 1-13 domains, 1-3 drives, 1-28 CD-RW/DVD-RW, 1-30 tape, 1-31 E environmental conditions, 1-4 expansion cabinet, 1-3 eXtended System Control Facility (XSCF), 1-24 F fan carriers, 1-3 fans, 1
S SCFB, 1-2 software features, 1-32 SPARC64 VI Compatible Mode, 2-2 SPARC64 VII Enhanced Mode, 2-2 specifications, 1-2 system, 1-5 cabinet, 1-3 components, 1-5, 1-9 features, 1-2 System Control Facility Board (SCFB), 1-2 T tape drive unit, 1-31 W weight, 1-3 X XSCF, 1-24 Index-2 SPARC Enterprise M4000/M5000 Servers Overview Guide • December 2010
