HP StorageWorks Scalable File Share for SFS20 Enclosure Hardware Installation Guide Version 2.2 Published: November 2006 Edition: 2.
© Copyright 2006 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein.
Table of Contents About This Manual..........................................................................................................13 1 Audience..............................................................................................................................................13 2 Organization.........................................................................................................................................13 3 Related Documentation....................................
2.2.3 Server Front and Rear Panels........................................................................................................47 2.2.3.1 HP ProLiant DL380 G5 Server Panels....................................................................................47 2.2.3.2 HP ProLiant DL360 G5 Server Panels....................................................................................49 2.2.3.3 ProLiant DL380 G4 Server Panels..........................................................................
7.1.3 HP ProLiant DL360 G5 Rear Panel LEDs and Buttons....................................................................81 7.1.4 System Insight Display................................................................................................................82 7.1.5 ProLiant DL360 G4 Rear Panel LEDs............................................................................................83 7.2 HP ProLiant DL380 LEDs....................................................................................
B.5 Rackmount Monitor Specifications.....................................................................................................135 B.6 HP Server Console Switch Specifications............................................................................................136 Glossary.........................................................................................................................139 Index.............................................................................................
List of Figures 1-1 1-2 1-3 1-4 1-5 1-6 1-7 1-8 1-9 1-10 1-11 1-12 1-13 1-14 1-15 1-16 2-1 2-2 2-3 2-4 2-5 2-6 2-7 2-8 2-9 2-10 2-11 2-12 2-13 2-14 2-15 2-16 2-17 2-18 2-19 2-20 2-21 2-22 5-1 5-2 5-3 Block Diagram of MDS Server and Administration Server with Two HP SFS20 Enclosures (1:1 Configuration)...............................................................................................................................
5-4 5-5 6-1 7-1 7-2 7-3 7-4 7-5 7-6 7-7 7-8 7-9 7-10 7-11 7-12 7-13 7-14 8 KVM Name Modify Dialog Box....................................................................................................72 Names Dialog Box after Name Change.........................................................................................73 Smart Array 6404 Controller Numbering......................................................................................77 ProLiant DL360 G5 Front Panel LEDs....................
List of Tables 1-1 1-2 1-3 1-4 2-1 2-2 2-3 2-4 2-5 2-6 2-7 2-8 2-9 3-1 3-2 4-1 6-1 7-1 7-2 7-3 7-4 7-5 7-6 7-7 7-8 7-9 7-10 7-11 7-12 7-13 7-14 A-1 A-2 A-3 A-4 A-5 A-6 A-7 A-8 A-9 A-10 A-11 A-12 G4 Server Slot Positions for Interconnect Cards Using One Interconnect....................................23 G5 Server Slot Positions for Interconnect Cards Using One Interconnect....................................24 Number of Object Storage Servers in a Cabinet Using ProLiant DL360 Servers........................
A-13 A-14 A-15 A-16 A-17 A-18 A-19 A-20 A-21 A-22 A-23 A-24 A-25 A-26 A-27 A-28 A-29 A-30 A-31 A-32 A-33 B-1 B-2 B-3 B-4 B-5 B-6 B-7 B-8 10 Ethernet Switch 3 for DL360 2:1 Configurations with between 24 and 34 Object Storage Servers.......................................................................................................................................108 Ethernet Switches 1 and 2 for DL360 2:1 Configurations with between 36 and 64 Object Storage Servers.......................................
List of Examples 6-1 Verifying SFS20 Controller Firmware..................................................................................................78 A-1 Wiring Designation.............................................................................................................................
About This Manual This manual describes how to assemble and install an HP StorageWorks Scalable File Share system using the HP StorageWorks Scalable File Share 20 Enclosure for storage. Read this entire manual and the HP StorageWorks Scalable File Share Release Notes before beginning the installation. Familiarity with the general sequence of installation steps can save time and prevent problems.
Chapter 4 “Connecting Describes how to connect power to the racks, and how to power on the racks. the Power and Powering On the System” Chapter 5 “Using the Describes how to select the server for display using the KVM switch Keyboard, Video, and Mouse Switch” Chapter 6 “Verifying Component Firmware” Describes how to verify the firmware of the various HP SFS hardware components. Chapter 7 “Hardware Provides a description of the HP SFS hardware component LEDs.
• • • • • • • • • • • • • • • • HP ProLiant DL380 Generation 5 Server Maintenance and Service Guide HP ProLiant DL380 Generation 4 Quickspecs HP ProLiant DL380 Generation 4 Server Maintenance and Service Guide HP ProCurve Switch 2600 Series Installation and Getting Started Guide HP StorageWorks Modular Smart Array 20 QuickSpecs HP StorageWorks Modular Smart Array 20 Installation Overview HP StorageWorks Modular Smart Array 20 User Guide HP StorageWorks Scalable File Share 20 User Guide HP Smart Array 6400
6 Symbols on Equipment WARNING: This symbol, in conjunction with any of the following symbols, indicates the presence of a potential hazard. The potential for injury exists if warnings are not observed. Consult your documentation for specific details. zk-2071 ! This symbol indicates the presence of hazardous energy circuits or electric shock hazards. Refer all servicing to qualified personnel. zk-2072 WARNING: To reduce the risk of injury from electric shock hazards, do not open this enclosure.
7 Symbols in Text zk-2071 ! WARNING: Text set off in this manner indicates that failure to follow directions in the warning could result in bodily harm or loss of life. ! CAUTION: Text set off in this manner indicates that failure to follow directions in the caution could result in damage to equipment or loss of information. zk-2071 Important: Text set off in this manner presents clarifying information or specfic instructions.
WARNING CAUTION IMPORTANT NOTE A warning calls attention to important information that if not understood or followed will result in personal injury or nonrecoverable system problems. A caution calls attention to important information that if not understood or followed will result in data loss, data corruption, or damage to hardware or software.
Safety Considerations To avoid bodily harm and damage to electronic components, read the following safety and comfort guidelines before unpacking and configuring the system components. 1 Avoiding Electrical Shocks To avoid electrical shock, do not open the power supplies. There are no user-serviceable parts inside. To avoid electrical shock and harm to your eyes by laser light, do not open the DVD laser module. The laser module should be serviced by service personnel only.
them, to the dealer from whom you purchased your system, or to HP so that they can either be recycled or disposed of correctly. Returned batteries are accepted free of charge. 7 Avoiding Hearing Damage Your HP StorageWorks Scalable File Share might exceed local safety requirements for noise. For your safety and comfort, always use hearing protection if you are going to be within 10 feet of the equipment. 8 Avoiding Burn Injuries Some components are hot.
1 Overview An HP StorageWorks Scalable File Share (HP SFS) system is a set of independent computers and storage subsystems combined into a unified system through system software and networking technologies that provides a storage system for standalone servers or compute clusters. An HP SFS storage system may use the EVA4000 or HP StorageWorks Scalable File Share 20 Enclosure (HP SFS20 Enclosure, or SFS20). This manual covers the HP SFS system using the SFS20 for storage.
the interconnect is between the compute nodes in the compute cluster and the HP SFS MDS and Object Storage Servers. The storage in an HP SFS system is the HP SFS20 Enclosure. An SFS20 is a modified MSA20 with a dual-port contoller. It is only sold as part of an HP SFS system, and has been named the HP SFS20 Enclosure. The documentation for the HP SFS20 Enclosure is the MSA-20 documentation and SFS20 supplemental documentation.
• SA-6404 PCI-X array controller. NIC2, an embedded Gigabit Ethernet controller, or a Dual port Gigabit Ethernet controller, is used as the system interconnect. ProLiant DL380 G5 or G4 2U servers if the system interconnect is other than Ethernet. Each DL380 Object Storage Server has 2 GB of memory or more, a single 72GB disk drive, and one or two SA-6404 PCI-X array controllers.
Table 1-2 G5 Server Slot Positions for Interconnect Cards Using One Interconnect Interconnect Type ProLiant DL360 G5 ProLiant DL380 G5 InfiniBand PCI slot 1 PCI slot 1 Gigabit Ethernet Embedded 1000Base-TX Ethernet, NIC2 (top NIC) or PCI slot 1 Embedded 1000Base-TX Ethernet, NIC2 (left-hand NIC) Dual port Gigabit Ethernet PC1 slot 1 PCI slot 1 1 1 The MDS/Admin nodes are always DL380s.
Servers require a second ProCurve Switch for the management network. A third ProCurve Switch is required for configurations of between 24 and 34 Object Storage Servers. For larger configurations, up to a maximum of 64 Object Storage Servers, you must use three HP Procurve 2650 switches. 1.4.1 HP SFS Configuration Block Diagrams The illustrations in this section provide block diagrams of the MDS server and administrative server or Object Storage Servers.
Server with Two HP SFS20 Enclosures (1:1 Configuration)”, the MDS server and the administration server must be ProLiant DL380 servers. This configuration could also be used as an entry-level configuration.
Figure 1-3 Block Diagram of a Pair of DL360 Object Storage Servers with Two HP SFS20 Enclosures using NIC2 as the System Interconnect Management Network HP ProCurve Switch hp procurve switch 2650 1 1 2 3 4 5 6 7 8 9 7 9 8 10 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 23 Gig-T Ports J4899 A Self Test Power Fault System Interconnect Fan Status Reset Port LED View T 25 M T 26 M MiniGBIC Ports Clear 2 Spd mode: off = 10 Mbps, 24 flash = 100 Mbps, on = 1000 Mbps 101
Figure 1-4 Block Diagram of a Pair of DL360 Object Storage Servers with Four HP SFS20 Enclosures Management Network HP ProCurve Switch hp procurve switch 26 50 1 2 3 4 1 5 6 7 8 9 7 9 8 10 10 11 12 13 14 15 16 17 18 19 20 21 22 24 23 23 Gi g-T Ports J48 9 9 A Self Test Power Fa ult System Interconnect Fa n Status Reset Port LED View T 26 M T 25 M MiniGB IC Ports 2 Clear Spd mode: off = 10 Mbps, 24 flash = 10 0 Mbps, on = 1000 Mbps 10100Base-=Tx Ports (1 - 24)
Figure 1-6 “Block Diagram of a Pair of DL380 Object Storage Servers with Four HP SFS20 Enclosures” shows a block diagram of a pair of DL380 Object Storage Servers with four HP SFS20 Enclosures (2:1 configuration).
Figure 1-7 Block Diagram of a Pair of DL380 Object Storage Servers with Six HP SFS20 Enclosures Management Network HP ProCurve Switch hp procurve switch 26 50 1 1 2 3 4 5 6 7 8 9 7 9 8 10 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 23 Gi g-T Ports J48 9 9 A Self Test Power Fa ult Fa n Status Reset Port LED View T 25 M Spd mode: off = 10 Mbps, flash = 10 0 Mbps, on = 1000 Mbps 10100Base-=Tx Ports (1 - 24) 24 ! Use only one (T or M) for ea ch Gigabit port PS/2 iL
Figure 1-8 Block Diagram of a Pair of DL380 Object Storage Servers with Eight HP SFS20 Enclosures Management Network HP ProCurve Switch hp procurve switch 26 50 1 1 2 3 4 5 6 7 8 9 7 9 8 10 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 23 Gi g-T Ports J48 9 9 A Self Test Power Fa ult Fa n Status Reset Port LED View T 25 M T 26 M MiniGB IC Ports 2 Clea r Spd mode: off = 10 Mbps, flash = 10 0 Mbps, on = 1000 Mbps 24 10100Base-=Tx Ports (1 - 24) ! Use only one (T o
Table 1-3 Number of Object Storage Servers in a Cabinet Using ProLiant DL360 Servers Ratio Cabinet 1:11 2:12 3:13 4:14 Base 8 4 2 2 Expansion 14 8 6 4 1 2 3 4 The maximum configuration requires 5 racks. The maximum configuration requires 9 racks. The maximum configuration requires 12 racks. The maximum configuration requires 16 racks.
Figure 1-9 “Maximum Rack Configuration Using a 1:1 Ratio of HP SFS20 Enclosures to ProLiant DL360 Object Storage Servers” shows maximum cabinet configurations using ProLiant DL360 Object Storage Servers with a ratio of 1:1 (HP SFS20 Enclosures to Object Storage Servers).
Figure 1-10 Maximum Rack Configuration Using a 2:1 Ratio of HP SFS20 Enclosures to ProLiant DL360 Object Storage Servers Expansion Rack 8 Expansion Rack 6 Expansion Rack 4 Expansion Rack 2 Expansion Rack 1 Base Rack Expansion Rack 5 Expansion Rack 3 Expansion Rack 7 MDS & Admin Servers SFS20 Enclosures SFS20-M0A, SFS20-M0B, SFS20-M1A, SFS20-M1B HP ProCurve Switch 1, 2, 3 Object Storage Servers 60 - 63 SFS20 Enclosures SFS20-60A, SFS20-60B, SFS20-61A, SFS20-61B, SFS20-62A, SFS20-62B, SFS20-63A, SFS20
Figure 1-11 Maximum Rack Configuration Using a 1:1 Ratio of HP SFS20 Enclosures to ProLiant DL380 Object Storage Servers Expansion Rack 2 Expansion Rack 6 Expansion Rack 4 Expansion Rack 1 Base Rack Expansion Rack 3 Expansion Rack 5 MDS & Admin Servers SFS20 Enclosures SFS20-M0A, SFS20-M0B, SFS20-M1A, SFS20-M1B HP ProCurve Switch 1, 2, 3 Object Storage Servers 56 - 63 Object Storage Servers 36 - 45 Object Storage Servers 16 - 25 Object Storage Servers 0 - 5 SFS20 Enclosures SFS20-56A, SFS20-57A, S
Overview Object Storage Servers 34 - 39 SFS20 Enclosures SFS20-34A, SFS20-34B, SFS20-35A, SFS20-35B, SFS20-36A, SFS20-36B, SFS20-37A, SFS20-37B, SFS20-38A, SFS20-38B, SFS20-39A, SFS20-39B Object Storage Servers 46 - 51 SFS20 Enclosures SFS20-46A, SFS20-46B, SFS20-47A, SFS20-47B, SFS20-48A, SFS20-48B, SFS20-49A, SFS20-49B, SFS20-50A, SFS20-50B, SFS20-51A, SFS20-51B SFS20 Enclosures SFS20-58A, SFS20-58B, SFS20-59A, SFS20-59B, SFS20-60A, SFS20-60B, SFS20-61A, SFS20-61B, SFS20-62A, SFS20-62B, SFS20-63A, S
Figure 1-13 Maximum Rack Configuration Using a 3:1 Ratio of HP SFS20 Enclosures to ProLiant DL380 Object Storage Servers (Part 1) Expansion Rack 6 Expansion Rack 8 Expansion Rack 4 Expansion Rack 2 Expansion Rack 1 Base Rack MDS & Admin Servers Expansion Rack 5 Expansion Rack 7 Expansion Rack 3 SFS20 Enclosures SFS20-M0A, SFS20-M0B, SFS20-M1A, SFS20-M1B HP ProCurve Switch 1, 2, 3 Object Storage Servers 30 - 33 Object Storage Servers 22 - 25 Object Storage Servers 14 - 17 Object Storage Servers 6
amaximum cabinet configurations using ProLiant DL380 Object Storage Servers with a ratio of 4:1.
Figure 1-16 Maximum Rack Configuration Using a 4:1 Ratio of HP SFS20 Enclosures to ProLiant DL380 Object Storage Servers (Part 2) Expansion Rack 14 Expansion Rack 16 Expansion Rack 12 Expansion Rack 10 Expansion Rack 9 Expansion Rack 11 Expansion Rack 15 Expansion Rack 13 Object Storage Servers 62 - 63 Object Storage Servers 54 - 57 Object Storage Servers 46 - 49 Object Storage Servers 38 - 41 Object Storage Servers 34 - 37 Object Storage Servers 42 - 45 Object Storage Servers 50 - 53 Object St
2 HP StorageWorks Scalable File Share Components An HP SFS system consists of the following: • A failover pair of administration server and MDS server • Failover pairs of Object Storage Servers (up to 64 Object Storage Servers) • Management network ProCurve Switches • Data storage in the form of internal disks and and HP StorageWorks Scalable File Share 20 (SFS20) Enclosures • KVM switch and TFT5600 rackmount keyboard and monitor These components are integrated and mounted in a 42U rack with 0U/1U power dis
Figure 2-1 HP SFS 10000-Series Rack 535.3mm 34.5mm Leveling Screws 2000mm 885.3mm 34.5mm Rotating Castors The rack arrives already populated with the HP SFS components. The order and component placement in the rack were preconfigured based on such factors as configuration requirements (number of Object Storage Servers, server type, and ratio of SFS20 Enclosures to Object Storage Servers), weight, accessibility, power, temperature, and airflow requirements.
G5 server characteristics, and “ProLiant DL380 G4 Server Characteristics” discusses the ProLiant DL380 G4 server characteristics. 2.2.1.1 ProLiant DL360 G5 Server Characteristics The next generation HP ProLiant DL360 G5 allows up to two dual-core Intel Xeon 5100/5000 series processors and offers up to six hot-pluggable SATA/SAS drive bays (depending on model).
Table 2-1 HP ProLiant DL360 G5 Features (continued) Feature Model/Type Description Redundancy Multiple layers of fault tolerance through critical component redundancy (power supply and fan redundancy), mirrored memory, embedded RAID capability, and full-featured remote Lights-Out management Management New Integrated Lights-Out 2 featuring Integrated Remote Console with KVM over IP performance over shared network access HP Power Meter and Power Regulator for ProLiant, delivering integrated power monito
Table 2-2 ProLiant DL360 G4 and G4p Features (continued) Feature HP ProLiant DL360 G4 and G4p Chassis 1U; sliding rails standard, optional cable management arm Power 460W 2.2.1.3 ProLiant DL380 G5 Server Characteristics The HP ProLiant DL380 G5 is a 2U rack-mount server with up to two Intel Xeon 5000 series processors with Hyper Threading and Intel VT technology.
Table 2-4 ProLiant DL360 G4 Features (continued) Feature HP ProLiant DL380 G4 Drive bays Up to six 1-inch hot-pluggable U320 hard drives Management Embedded iLO I/O slots Two 64-bit, 100MHz and one 64-bit, 133 MHz 3.3V PCI-X slots (hot-pluggable is optional) Video Integrated ATI RAGE XL video controller with 8 MB SDRAM video memory USB Three USB connections (one on the front, and two on the back) Fan Hot-pluggable fans with optional redundancy Chassis 2U form factor (8.90 cm/3.
— — DL380 G4: 2GB 333 MHz 2-way interleaved PC2700 DDR SDRAM DL380 G5: 2GB (2 x 1GB) PC2-5300 Fully Buffered DIMMs (DDR2-667) • Disks: — DL380 G4: One 72GB 10K RPM U320 hard drive — DL380 G5: One 72 GB SAS drive • Optional CD-ROM, DVD-ROM, DVD/CD-RW Combo (standard in performance models), DVD-RW, or Slimline floppy drive Redundant power supplies Redundant fans One or more HP PCI-X Four Channel U320 RAID (Smart Array 6404, SA-6404) Controllers • • • 2.2.2.
Figure 2-2 HP ProLiant DL380 G5 Front Panel 4 5 W P PO P P P S 6 FA 1 I OV 2 3 4 5 6 7 8 U ID 1 2 3 Item Description 1 Media drive bay (IDE/diskette multi-bay) 2 Video connector 3 USB connectors (2) 4 Systems Insight Display 5 Hard drive bays – 1 through 8 6 Quick release levers (2) The rear panel of the HP ProLiant DL380 G5 is shown in Figure 2-3.
Item Description HP SFS20 Usage 3 Expansion slot 4 Smart Array 6404 adapter and optional second Smart Array 6404 adapter. A PCI-X riser is used to convert PCI slot 5 and PCI slot 4 from PCI Express to PCI-X. PCI slot 4 is reserved for a second Smart Array 6404 adapter; the second adapter is present if more than four SFS20 arrays are connected to the server. 4 Expansion slot 5 PCI slot 5 is used for a Smart Array 6404 adapter.
Figure 2-4 HP ProLiant DL360 G5 Front Panel 1 11 2 5 6 1 2 10 9 3 3 8 4 7 5 4 Item Description 1 Hard drive bay 5 (an optional controller is required when the server is configured with 6 hard drives) 2 Hard drive bay 6 (an optional controller is required when the server is configured with 6 hard drives) 3 Multi-bay drive bay 4 USB port 5 Slide-out System Insight Display 6 Video connector 7 Hard drive bay 4 8 Hard drive bay 3 9 Hard drive bay 2 10 Hard drive bay 1 11 Sl
Figure 2-5 HP ProLiant DL360 G5 Rear Panel 1 5 6 7 2 8 9 3 4 10 11 12 613 Item Description HP SFS20 Usage 1 Low-profile PCI-Express slot (Optional) PCI Express interconnect adapter.
Figure 2-6 ProLiant DL380 G4 Front Panel 2 4 5 1 Table 2-5 “Description of ProLiant DL380 G4 Front Panel Hardware” describes the callouts shown in Figure 2-6 “ProLiant DL380 G4 Front Panel”. Table 2-5 Description of ProLiant DL380 G4 Front Panel Hardware Item Description 1 Six hard-drive bays 2 USB port 3 Bay for tape drive 4 Diskette drive 5 CD drive Figure 2-7 “ ProLiant DL380 G4 Rear Panel” shows the rear panel of the ProLiant DL380 G4 server.
Table 2-6 ProLiant DL380 G4 Rear Panel Components (continued) Item Description 9 NIC 1 connector 10 NIC 2 connector 11 USB connectors (black) 12 Video connector (blue) 13 VHDCI SCSI connector 2.2.3.4 ProLiant DL360 G4 Server Panels Figure 2-8 “ProLiant DL360 G4 Front Panel” and Figure 2-9 “ ProLiant DL360 G4 Rear Panel” show the front and rear panels, respectively, of the ProLiant DL360 G4 servers.
Table 2-7 ProLiant DL360 G4 Rear Panel Components (continued) Item Description 10 Keyboard connector (purple) 11 Video connector (blue) 12 Serial connector (teal) 2.2.4 Embedded Technologies The embedded technologies of the ProLiant DL360 and ProLiant DL380 servers include Integrated Lights-Out (iLO) remote management and dual 10/100/1000 Fast Ethernet network interface cards (NICS). Integrated Lights-Out The iLO device is the console power manager for an HP SFS system.
2.3.1 HP SFS20 Enclosure The SFS20 is a serial advanced technology attachment (SATA) disk drive 2U enclosure. It houses up to 12 1-inch universal hot-pluggable SATA 1.5 Gb/s drives with 160- or 250-GB capacity. The storage consists of a minimum of one SFS20 for each Object Storage Server, and a mirrored pair of HP SFS20 Enclosures for the MDS and administration servers.
Figure 2-11 HP SFS20 Enclosure Rear View 1 2 3 5 1 4 HPTC-xxxx Table 2-9 HP SFS20 Enclosure Rear Panel Item Description 1 Power supply units 2 SFS20 controller module 3 U320 VHDCI port A 4 U320 VHDCI port B 5 Fan assemblies The SFS20 provides Ultra320 low-voltage differential (LVD) host connectivity. One HP SFS20 Enclosure input port is connected to a PCI host bus adapter in each server of the MDS/administration or Object Storage Server pair.
2.4.
• • If the Full Duplex (FDx) indicator LED is lit, the port LEDs light for those ports that are operating in full-duplex mode. If the Speed (Spd) indicator LED is lit, the port LEDs behave as follows to indicate the connection speed for the port: — OFF = 10 Mb/s — Flashing = 100 Mb/s (the flashing behavior is a repeated on/off cycle once every 0.5 s) — ON = 1000 Mb/s 2.4.1.3 Reset Button The reset button is used to reset the switch while it is turned on.
Note: The ProCurve Switch is installed in the rack with its back side facing the front of the rack. 2.4.2 HP ProCurve Switch 2650 The HP ProCurve switch has 48 dual-speed ports that are spread across the front panel. To the right is a pair of fixed triple-speed copper gigabit ports, and below these are two mini-GBIC slots that accept fiber-optic cables. These are referred to as dual-personality ports because you can use either the copper port or the corresponding fiber-optic port.
Note: The HP ProCurve switch is installed in the rack with the back side facing the front of the rack. 2.4.2.1 Reset Button The reset button is used to reset the switch while it is turned on. This action clears any temporary error conditions that may have occurred and executes the switch self-test. 2.4.2.
Figure 2-17 Rear View of 8-Port KVM Server Console Switch The components on the rear of a KVM switch include: 1. Power connector 2. Power switch 3. Activity indicator light 4. Serial download connector 5. Connection to keyboard 6. Connection to monitor 7. Connection to mouse 8. RJ-45 interface port 9.
2.6 Power Distribution System AC power is distributed to the rack through three 24-amp (North America, Latin America, or Japan) or 32-amp (international) 0/1U power distribution unit (PDU) assemblies. The PDUs consist of two main parts: the control unit (Figure 2-19 “Power Distribution Unit”) and the extension bars, more commonly called power strips (Figure 2-20 “Group of Three Power Strips”). Each PDU has one control unit and four power strips. The control units are usually referred to as the PDU.
Figure 2-20 Group of Three Power Strips zk-2071 ! CAUTION: Do not use the power strips to supply power to any components not already configured into the cluster. This could cause a power overload. Each PDU is connected to a separate circuit-breaker-protected, AC site power source (220-240 VAC ±10%, 50 or 60 Hz ± 5%). The 24-amp PDU power cord has a NEMA L6-30P, 3-wire, 30-amp, 60-Hz connector. The NEMA L6-30R wall receptacle is shown in Figure 2-21 “NEMA L6-30R Wall Receptacle”.
• • • • • 64 InfiniBand interconnect: Serial copper multicore cable Myrinet interconnect: Small form factor (SFF) Lucent Connector to Lucent Connector (LC-LC) fiber-optic cable Quadrics QSNetII: Quadrics QSNetII 12x EOP Link Cable Ethernet: CAT5 RJ-45 Ethernet cable SCSI: VHDCI-to-VHDCI SCSI cables HP StorageWorks Scalable File Share Components
3 Installing the Interrack and Intersystem Cables After the HP SFS system hardware has been set in place and the racks bolted together, the HP SFS hardware components in the various racks must be cabled to associated hardware in other racks. Also, the HP SFS hardware must be cabled to the interconnect of a supported compute cluster, and some HP SFS hardware may be cabled to the site network.
3.2.1 System Interconnect Cables This section discusses the interconnect cables in an HP SFS system that must be connected to a compute cluster. An HP SFS system communicates with a supported compute cluster over the interconnect, which can be: • InfiniBand • Myrinet XP or 2XP • Quadrics QsNetII • Gigabit Ethernet There can be one or two interconnects.
The following sections discuss the interconnect connections for each type of rack. 3.2.1.1 Base Rack Connect the interconnect cables from the administration server, MDS server, and each of the Object Storage Servers in the base cabinet to the compute cluster system interconnect. 3.2.1.2 Expansion Racks Connect the interconnect cables from each of the Object Storage Servers in the expansion racks to the compute cluster system interconnect. 3.2.
4 Connecting the Power and Powering On the System After the HP SFS system has been installed and all interrack and intersystem cables connected, power must be connected to each cabinet, and the system must be powered on. See the Cluster Platform Site Preparation Guide and ensure that you have complied with the following power-related topics: • Power calculation • Power connections • General and building guidelines • Grounding • Power distribution • Uninterruptible power supply (UPS) 4.
Table 4-1 KVM Port Assignment Port Connection 1 Administration server 2 MDS server 3 Object Storage Servers1 1 8. 9. 10. 11. 12. 13. 14. 70 Temporary connection for an Object Storage Server. Turn on power to each HP SFS20 Enclosure by depressing the power button on the rear of the enclosure (Figure 7-14 “HP SFS20 Enclosure LEDs”).
5 Using the Keyboard, Video, and Mouse Switch To install and operate the servers in an HP SFS system, you must be able to select the administration or MDS server from the KVM switch. You can select the servers based on name, electronic identification number (EID), or port number. This chapter discusses how to set the server name, and how to select the administration or MDS server. 5.1 Assigning Server Names To set the server name on the KVM switch, follow these steps: 1.
Figure 5-3 KVM Names Dialog Box 4. In the Names dialog box, use the up or down arrow key to select the server name or port number to be changed. Click the Modify button to display the Name Modify dialog box (Figure 5-4 “KVM Name Modify Dialog Box”). Figure 5-4 KVM Name Modify Dialog Box 5. 6. 72 Enter a name in the New Name field. The name can be from 1 to 15 characters in length. The characters are case sensitive and can consist of A-Z, 0-9, spaces, and hyphens.
Figure 5-5 Names Dialog Box after Name Change ? Names Toggle Name/EID Port Type south1 south2 Svr-3 Svr-4 Svr-5 Svr-6 Svr-7 Svr-8 01 02 03 04 05 06 07 08 Srvr Srvr Srvr Srvr Srvr Srvr Srvr Srvr Modify OK HPTC-0056 7. Repeat steps 4 through 6 to change the name of other servers. 5.2 Selecting a Server When you select a new server, the console switch reconfigures the KVM to the setting for the newly selected server.
6 Verifying Component Firmware You must verify that the HP SFS system has the correct firmware before you start a software installation. Note: Refer to the HP StorageWorks Scalable File Share System User Guide to obtain the current firmware version number. If an upgrade is necessary, obtain the most recent firmware and its installation instructions from the Web site provided in that manual. 6.
To determine the ProCurve Switch firmware version using the CLI, follow these steps: 1. Connect to the switch through a PC terminal emulator or Telnet session. 2. If you are using PC terminal emulation, press Enter one or more times until a prompt appears. 3. When the switch screen appears, enter the password if one has been configured: Password: 4.
6.3 Verifying PCI Host Bus Adapter Firmware With the exception of the Smart Array 6404, the firmware version of the PCI host bus adapters does not have to be verified. See “Verifying Smart Array 6404 Firmware Version” for information about checking Smart Array 6404 firmware. The software drivers for the PCI adapters determine the firmware version. When the drivers are loaded, firmware is downloaded to the PCI adapters during driver initialization. 6.
In this example, the server has one SA6404 module, and each of the two controllers on the module has firmware revision 2.58. 6.5 Verifying the SFS20 Firmware Version To check the firmware version of the SFS20 enclosure controller, use the show array command as shown in Example 6-1 “Verifying SFS20 Controller Firmware”.
7 Hardware Component LEDs The next step necessary to verify that an HP SFS system configuration is operating properly is a check of the component light-emitting diodes (LEDs). The LEDS indicate the status and settings of hardware components. They warn of impending failures and allow you to take preventive action. This section explains the LEDS found in an HP SFS configuration. 7.1 HP ProLiant DL360 LEDs The HP ProLiant DL360 servers have LEDs on both the front and rear panels. 7.1.
Table 7-1 ProLiant DL360 G5 Front Panel LEDs (continued) Item Description Status 5 NIC 1 link/activity LED Green = Network link exists. Flashing green = Network link and activity exist. Off = No link to network exists. If power is off, the front panel LED is not active. View the LEDs on the RJ-45 connector for status by referring to the rear panel LEDs 6 NIC 2 link/activity LED Green = Network link exists. Flashing green = Network link and activity exist. Off = No link to network exists.
Note: The ProLiant DL360 G4 has a USB connection below the power switch. The LEDs are the same. Table 7-2 ProLiant DL360 G4 Front Panel LEDs LED Description Status 1 Unit identification (UID) Blue = Activated. Blinking = System remotely managed. Off = Deactivated. 2 Internal health Red = System critical. View system board LEDs to identify component in critical state. Amber = System degraded. View system board LEDs to identify component in degraded state. Green = Normal.
Table 7-3 ProLiant DL360 G5 Rear Panel LEDs and Buttons (continued) Item Description Status 2 iLO 2 NIC link LED Green = Link exists. Off = No link exists. 3 10/100/1000 NIC 1 activity Green = Activity exists. LED Flashing green = Activity exists. Off = No activity exists. 4 5 10/100/1000 NIC 1 link LED Green = Link exists. Off = No link exists. 10/100/1000 NIC 2 activity Green = Activity exists. LED Flashing green = Activity exists. Off = No activity exists.
Note: The System Insight Display LEDs represent the board layout. Figure 7-5 System Insight Display Map Table 7-4 describes the status of the System Insight Display LEDs.
Figure 7-6 ProLiant DL360 G4 Rear Panel LEDs 1 5 2 3 6 4 7 Table 7-5 ProLiant DL360 G4 Rear Panel LEDs LED Description Status 1 iLO activity Green=Activity Off = No activity Blinking = Activity 2 iLO link Green = Link Off = No link 3 10/100/1000NIC2 Activity Green=Link exists Off = No link Flashing green = Activity 4 10/100/1000NIC2 Link Green = Network link Off = No link 5 Rear unit identification LED Blue = Activated.
Figure 7-7 HP ProLiant DL380 G5 Front LEDs W P PO P P P S FA 1 2 3 1 I OV 4 5 2 3 6 Table 7-6 HP ProLiant DL380 G5 Front Panel LEDs Item Description Status 1 UID LED button Blue = Activated Flashing = System being remotely managed Off = Deactivated 2 Internal health LED Green = Normal Amber = System degraded. To identify component in degraded state, refer to Section 7.2.4 Systems Insight Display LEDs Red = System critical. To identify component in critical state, refer to Section 7.
Figure 7-8 ProLiant DL380 Front Panel LEDs 1 2 3 4 5 6 xc-016-ig Table 7-7 ProLiant DL380 Front Panel LEDs Item Description Status 1 Internal health Green = Normal. Amber = System degraded. View system board LEDs to identify component in degraded state. Red = System critical. View system board LEDs to identify component in critical state. 2 External health (power supply) Green = Normal. Amber = Power redundancy failure. Red = Critical power supply failure.
Figure 7-9 HP ProLiant DL380 G5 Rear LEDs 1 2 2 1 3 4 5 6 Table 7-8 HP ProLiant DL380 G5 Rear LEDs Item Description Status 1 Power supply LEDs Green = Normal Off = System is off or power supply has failed 2 NIC activity LED Green = Network activity Flashing = Network activity Off = No network activity 3 NIC link LED Green = Network link Off = No network link 4 iLO 2 activity LED Green = Network activity Flashing = Network activity Off = No network activity 5 iLO 2 link LED Green = N
Figure 7-10 HP ProLiant DL380 G5 Systems Insight Display ONLINE SPARE MIRROR POWER POWER SUPPLY SUPPLY PPM PPM DIMMS PCI RISER CAGE PROC PROC FANS INTER LOCK OVER TEMP Table 7-9 Systems Insight Display LEDs Status Description Status Online spare Off = No protection Green = Protection enabled Amber = Memory failure occurred Flashing amber = Memory configuration error Mirror Off = No protection Green = Protection enabled Amber = Memory failure occurred Flashing amber = Memory configuration erro
Figure 7-11 ProLiant DL380 G4 Rear Panel LEDs 3 1 2 4 3 2 7 5 8 6 Table 7-10 ProLiant DL380 G4 Rear Panel LEDs Item Description LED Color Status 1 PCI hot plug fault LED (slot 3, top slot) Amber On = Expansion board failed. PCI hot plug power LED (slot 3) Green 2 Off = Normal. On = Power is applied to the slot. Flashing = Power is cycling. Off = Power is not applied to the slot. 3 4 PCI hot plug fault LED (slot 2, middle Amber slot) On = Expansion board failed.
7.3 HP ProCurve Switch 2626 LEDs An administration subnetwork handles management and installation tasks. The administration server, MDS server, and every Object Storage Server is connected to a ProCurve Switch. The front view of a ProCurve Switch 2626 is shown in Figure 2-12 “HP ProCurve Switch 2626 Front View”. The front panel of the HP ProCurve Switch 2650 is used to show the LEDs for the ProCurve Switch. It is shown with cut-away views in Figure 7-12 “ProCurve Switch 2626 LEDs”.
Table 7-11 ProCurve Switch 2626 LEDs (continued) Component Description State Description 3 Self-Test Green On—The switch self-test and initialization are in progress after power has been cycled or the switch has been reset. The switch is not operational until this LED goes off. Off—The switch is not undergoing self-test. Blinking1 —A component of the switch has failed its self-test. The status LED for that component and the switch fault LED will blink simultaneously.
Figure 7-13 ProCurve Switch 2650 LEDs 3 4 7 2 6 5 Table 7-12 ProCurve LED Identification Item Description State Meaning 1 Power Green On = The switch is receiving power. Off = The switch is not receiving power. 2 Fault Orange On = The switch has encountered a fatal hardware failure or has failed its self-test. Off = Indicates that there are no fault conditions on the switch. Blinking* = A fault has occurred on the switch, one of the switch ports, or the fan.
Table 7-12 ProCurve LED Identification (continued) Item Description State Meaning 7 T/M Green — T = Indicates the 10/100/1000Base-T RJ-45 port is enabled. ports 49 and M = Indicates the mini-GBIC port is enabled. 50 only * The blinking behavior is an on/off cycle once every 1.6 seconds, approximately.**The flashing behavior is an on/off cycle once every 0.5 seconds, approximately. The HP ProCurve switch uses a single LED for each port.
Table 7-13 HP ProCurve 2650 Switch Diagnostics (continued) Power Fault Self-Test Fan Status Port LED Problem On Off Off a On, but the port is not communicating. The port may be improperly configured, or the port may be in a blocking state. a This LED is not important for the diagnosis. b The blinking behavior is an on/off cycle once every 1.6 seconds, approximately. 7.5 HP SFS20 Enclosure Status LEDs The HP SFS20 Enclosure status LEDs are on the rear of the enclosure.
8 Verifying System Operation When you have completed installing the hardware, verify system operation as follows: • Verify that the HP SFS system hardware components have the correct firmware version. See Chapter 6 “Verifying Component Firmware”. • Verify that an HP SFS system hardware component light-emitting diodes (LEDs) indicate proper operation. See Chapter 7 “Hardware Component LEDs”. • Execute the installation verification procedure. See the HP StorageWorks Scalable File Share System User Guide.
A Wiring Tables This appendix provides the wiring label specifications, and the wiring tables for HP StorageWorks Scalable File Share 20 Enclosure configurations. Tables are provided for each of the various configurations using the ProLiant DL360 and ProLiant DL380 as the Object Storage Servers, with each of the supported ratios of SFS20 Enclosures to servers (1:1, 2:1, 3:1, and 4:1). When connecting SFS to HP Cluster Platform, use the following generic cabling algorithm for all interconnects: 1.
The wiring tables are listed first by type of ProLiant Server, DL360 then DL380. Then they are grouped according to the ratio of SFS20 Enclosures to servers, and within the group by the number of Object Storage Servers in the configuration. Within each ratio group, there will be one table and one management network Ethernet switch for configurations with 2 to 10 Object Storage Servers.
Table A-3 Ethernet Switch for DL360 1:1 Configurations with between 2 and 10 Object Storage Servers (continued) Base-ESW1-P19 Exp1-OSS9-ILO Base-ESW1-P20 Exp1-OSS9-NIC1 Base-ESW1-P21 Base-ESW1-P22 Base-ESW1-P23 Base-MDS-ILO Base-ESW1-P24 Base-AD-ILO Base-ESW1-P25 Base-MDS-NIC1 Base-ESW1-P26 Base-AD-NIC1 A.2.1.
Table A-5 Ethernet Switch 2 for DL360 1:1 Configurations with between 12 and 22 Object Storage Servers (continued) Base-ESW1-P4 Base-OSS1-NIC1 Base-ESW1-P4 Exp1-OSS12-NIC1 Base-ESW1-P5 Base-OSS2-ILO Base-ESW1-P5 Exp1-OSS13-ILO Base-ESW1-P6 Base-OSS2-NIC1 Base-ESW1-P6 Exp1-OSS13-NIC1 Base-ESW1-P7 Base-OSS3-ILO Base-ESW1-P7 Exp1-OSS14-ILO Base-ESW1-P8 Base-OSS3-NIC1 Base-ESW1-P8 Exp1-OSS14-NIC1 Base-ESW1-P9 Base-OSS4-ILO Base-ESW1-P9 Exp1-OSS15-ILO Base-ESW1-P10 Base-OSS4-NIC1 Base-E
Table A-6 Ethernet Switches 1 and 2 for DL360 1:1 Configurations with between 24 and 34 Object Storage Servers (continued) Base-ESW1-P8 Base-OSS3-NIC1 Base-ESW2-P8 Exp1-OSS14-NIC1 Base-ESW1-P9 Base-OSS4-ILO Base-ESW2-P9 Exp1-OSS15-ILO Base-ESW1-P10 Base-OSS4-NIC1 Base-ESW2-P10 Exp1-OSS15-NIC1 Base-ESW1-P11 Base-OSS5-ILO Base-ESW2-P11 Exp1-OSS16-ILO Base-ESW1-P12 Base-OSS5-NIC1 Base-ESW2-P12 Exp1-OSS16-NIC1 Base-ESW1-P13 Base-OSS6-ILO Base-ESW2-P13 Exp1-OSS17-ILO Base-ESW1-P14 Base-O
Table A-7 Ethernet Switch 3 for DL360 1:1 Configurations with between 24 and 34 Object Storage Servers (continued) Base-ESW3-P13 Exp2-OSS29-ILO Base-ESW3-P14 Exp2-OSS29-NIC1 Base-ESW3-P15 Exp2-OSS30-ILO Base-ESW3-P16 Exp2-OSS30-NIC1 Base-ESW3-P17 Exp2-OSS31-ILO Base-ESW3-P18 Exp2-OSS31-NIC1 Base-ESW3-P19 Exp2-OSS32-ILO Base-ESW3-P20 Exp2-OSS32-NIC1 Base-ESW3-P21 Exp2-OSS33-ILO Base-ESW3-P22 Exp2-OSS33-NIC1 Base-ESW3-P23 Reserved Base-ESW3-P24 Base-AD-ILO Base-ESW3-P25 Base-ESW2-P26
Table A-8 Ethernet Switches 1 and 2 for DL360 1:1 Configurations with between 36 and 64 Object Storage Servers (continued) Base-ESW1-P17 Exp1-OSS8-ILO Base-ESW2-P17 Exp2-OSS31-ILO Base-ESW1-P18 Exp1-OSS8-NIC1 Base-ESW2-P18 Exp2-OSS31-NIC1 Base-ESW1-P19 Exp1-OSS9-ILO Base-ESW2-P19 Exp2-OSS32-ILO Base-ESW1-P20 Exp1-OSS9-NIC1 Base-ESW2-P20 Exp2-OSS32-NIC1 Base-ESW1-P21 Exp1-OSS10-ILO Base-ESW2-P21 Exp2-OSS33-ILO Base-ESW1-P22 Exp1-OSS10-NIC1 Base-ESW2-P22 Exp2-OSS33-NIC1 Base-ESW1-P23
Table A-9 Ethernet Switch 3 for DL360 1:1 Configurations with between 35 and 64 Object Storage Servers Origin Destination Base-ESW3-P1 Exp3-OSS47-ILO Base-ESW3-P2 Exp3-OSS47-NIC1 Base-ESW3-P3 Exp3-OSS48-ILO Base-ESW3-P4 Exp3-OSS48-NIC1 Base-ESW3-P5 Exp3-OSS49-ILO Base-ESW3-P6 Exp3-OSS49-NIC1 Base-ESW3-P7 Exp4-OSS50-ILO Base-ESW3-P8 Exp4-OSS50-NIC1 Base-ESW3-P9 Exp4-OSS51-ILO Base-ESW3-P10 Exp4-OSS51-NIC1 Base-ESW3-P11 Exp4-OSS52-ILO Base-ESW3-P12 Exp4-OSS52-NIC1 Base-ESW3-P13 Exp4
Table A-9 Ethernet Switch 3 for DL360 1:1 Configurations with between 35 and 64 Object Storage Servers (continued) Base-ESW3-P36 Base-ESW3-P37 Base-ESW3-P38 Base-ESW3-P39 Base-ESW3-P40 Base-ESW3-P41 Base-ESW3-P42 Base-ESW3-P43 Base-ESW3-P44 Base-ESW3-P45 Base-ESW3-P46 Base-ESW3-P47 Base-ESW3-P48 Base-Admin-ILO Base-ESW3-P49 Base-ESW2-P50 Base-ESW3-P50 Base-Admin-NIC1 A.2.
Table A-10 Ethernet Switch for DL360 2:1 Configurations with between 2 and 10 Object Storage Servers (continued) Base-ESW1-P11 Exp1-OSS5-ILO Base-ESW1-P12 Exp1-OSS5-NIC1 Base-ESW1-P13 Exp1-OSS6-ILO Base-ESW1-P14 Exp1-OSS6-NIC1 Base-ESW1-P15 Exp1-OSS7-ILO Base-ESW1-P16 Exp1-OSS7-NIC1 Base-ESW1-P17 Exp1-OSS8-ILO Base-ESW1-P18 Exp1-OSS8-NIC1 Base-ESW1-P19 Exp1-OSS9-ILO Base-ESW1-P20 Exp1-OSS9-NIC1 Base-ESW1-P21 Base-ESW1-P22 Base-ESW1-P23 Base-MDS-ILO Base-ESW1-P24 Base-AD-ILO Base-ESW1
Table A-11 Ethernet Switch 1 for DL360 2:1 Configurations with between 12 and 22 Object Storage Servers (continued) Base-ESW1-P15 Exp1-OSS7-ILO Base-ESW2-P15 Exp2-OSS18-ILO Base-ESW1-P16 Exp1-OSS7-NIC1 Base-ESW2-P16 Exp2-OSS18-NIC1 Base-ESW1-P17 Exp1-OSS8-ILO Base-ESW2-P17 Exp2-OSS19-ILO Base-ESW1-P18 Exp1-OSS8-NIC1 Base-ESW2-P18 Exp2-OSS19-NIC1 Base-ESW1-P19 Exp1-OSS9-ILO Base-ESW2-P19 Exp3-OSS20-ILO Base-ESW1-P20 Exp1-OSS9-NIC1 Base-ESW2-P20 Exp3-OSS20-NIC1 Base-ESW1-P21 Exp1-OSS1
Table A-12 Ethernet Switches 1 and 2 for DL360 2:1 Configurations with between 24 and 34 Object Storage Servers (continued) Base-ESW1-P19 Exp1-OSS9-ILO Base-ESW2-P19 Exp3-OSS20-ILO Base-ESW1-P20 Exp1-OSS9-NIC1 Base-ESW2-P20 Exp3-OSS20-NIC1 Base-ESW1-P21 Exp1-OSS10-ILO Base-ESW2-P21 Exp3-OSS21-ILO Base-ESW1-P22 Exp1-OSS10-NIC1 Base-ESW2-P22 Exp3-OSS21-NIC1 Base-ESW1-P23 Base-MDS-ILO Base-ESW2-P23 Exp3-OSS22-ILO Base-ESW1-P24 Reserved Base-ESW2-P24 Exp3-OSS22-NIC1 Base-ESW1-P25 Base-M
Table A-13 Ethernet Switch 3 for DL360 2:1 Configurations with between 24 and 34 Object Storage Servers (continued) Base-ESW3-P24 Base-AD-ILO Base-ESW3-P25 Base-ESW2-P26 Base-ESW3-P26 Base-AD-NIC1 A.2.2.
Table A-14 Ethernet Switches 1 and 2 for DL360 2:1 Configurations with between 36 and 64 Object Storage Servers (continued) Base-ESW1-P28 Exp2-OSS13-NIC1 Base-ESW2-P28 Exp5-OSS36-NIC1 Base-ESW1-P29 Exp2-OSS14-ILO Base-ESW2-P29 Exp5-OSS37-ILO Base-ESW1-P30 Exp2-OSS14-NIC1 Base-ESW2-P30 Exp5-OSS37-NIC1 Base-ESW1-P31 Exp2-OSS15-ILO Base-ESW2-P31 Exp5-OSS38-ILO Base-ESW1-P32 Exp2-OSS15-NIC1 Base-ESW2-P32 Exp5-OSS38-NIC1 Base-ESW1-P33 Exp2-OSS16-ILO Base-ESW2-P33 Exp5-OSS39-ILO Base-ESW1-
Table A-15 Ethernet Switch 3 for DL360 2:1 Configurations with between 36 and 64 Object Storage Servers (continued) Base-ESW3-P9 Exp6-OSS51-ILO Base-ESW3-P10 Exp6-OSS51-NIC1 Base-ESW3-P11 Exp7-OSS52-ILO Base-ESW3-P12 Exp7-OSS52-NIC1 Base-ESW3-P13 Exp7-OSS53-ILO Base-ESW3-P14 Exp7-OSS53-NIC1 Base-ESW3-P15 Exp7-OSS54-ILO Base-ESW3-P16 Exp7-OSS54-NIC1 Base-ESW3-P17 Exp7-OSS55-ILO Base-ESW3-P18 Exp7-OSS55-NIC1 Base-ESW3-P19 Exp7-OSS56-ILO Base-ESW3-P20 Exp7-OSS56-NIC1 Base-ESW3-P21 Exp7
Table A-15 Ethernet Switch 3 for DL360 2:1 Configurations with between 36 and 64 Object Storage Servers (continued) Base-ESW3-P45 Base-ESW3-P46 Base-ESW3-P47 Base-ESW3-P48 Base-Admin-ILO Base-ESW3-P49 Base-ESW2-P50 Base-ESW3-P50 Base-Admin-NIC1 A.3 Management Network Wiring Tables for Configurations Using the ProLiant DL380 as Object Storage Servers This section provides the management network wiring tables for configurations which use the ProLiant DL380 as Object Storage Servers. A.3.
Table A-16 Ethernet Switch 1 for 1:1 Configurations with between 2 and 10 Object Storage Servers (continued) Base-ESW1-P17 Exp1-OSS8-ILO Base-ESW1-P18 Exp1-OSS8-NIC1 Base-ESW1-P19 Exp1-OSS9-ILO Base-ESW1-P20 Exp1-OSS9-NIC1 Base-ESW1-P21 Reserved Base-ESW1-P22 Reserved Base-ESW1-P23 Base-MDS-ILO Base-ESW1-P24 Base-AD-ILO Base-ESW1-P25 Base-MDS-NIC1 Base-ESW1-P26 Base-AD-NIC1 A.3.1.
Table A-17 Ethernet Switches 1 and 2 for 1:1 Configurations with between 12 and 22 Object Storage Servers (continued) Base-ESW1-P21 Exp1-OSS10-ILO Base-ESW2-P21 Exp2-OSS21-ILO Base-ESW1-P22 Exp1-OSS10-NIC1 Base-ESW2-P22 Exp2-OSS21-NIC1 Base-ESW1-P23 Base-MDS-ILO Base-ESW2-P23 Reserved Base-ESW1-P24 Reserved Base-ESW2-P24 Base-AD-ILO Base-ESW1-P25 Base-MDS-NIC1 Base-ESW2-P25 Base-ESW1-P26 Base-ESW1-P26 Base-ESW2-P25 Base-ESW2-P26 Base-AD-NIC1 A.3.1.
Table A-18 Ethernet Switches 1 and 2 for 1:1 Configurations with between 24 and 34 Object Storage Servers (continued) Base-ESW1-P25 Base-MDS-NIC1 Base-ESW2-P25 Base-ESW1-P26 Base-ESW1-P26 Base-ESW2-P25 Base-ESW2-P26 Base-ESW3-P25 Table A-19 “Ethernet switch 3 for Configurations between 24 and 34 Object Storage Servers” provides the management network wiring for the third ProCurve Switchin configurations with between 22 and 34 Object Storage Servers.
Table A-20 Ethernet Switches 1 and 2 for 1:1 Configurations with between 36 and 64 Object Storage Servers Switch 1 Origin 116 Switch 1 Destination Switch 2 Origin Switch 2 Destination Base-ESW1-P1 Base-OSS0-ILO Base-ESW2-P1 Exp2-OSS23-ILO Base-ESW1-P2 Base-OSS0-NIC1 Base-ESW2-P2 Exp2-OSS23-NIC1 Base-ESW1-P3 Base-OSS1-ILO Base-ESW2-P3 Exp2-OSS24-ILO Base-ESW1-P4 Base-OSS1-NIC1 Base-ESW2-P4 Exp2-OSS24-NIC1 Base-ESW1-P5 Base-OSS2-ILO Base-ESW2-P5 Exp2-OSS25-ILO Base-ESW1-P6 Base-OSS2-
Table A-20 Ethernet Switches 1 and 2 for 1:1 Configurations with between 36 and 64 Object Storage Servers (continued) Base-ESW1-P36 Exp2-OSS17-NIC1 Base-ESW2-P36 Exp4-OSS40-NIC1 Base-ESW1-P37 Exp2-OSS18-ILO Base-ESW2-P37 Exp4-OSS41-ILO Base-ESW1-P38 Exp2-OSS18-NIC1 Base-ESW2-P38 Exp4-OSS41IC1 Base-ESW1-P39 Exp2-OSS19-ILO Base-ESW2-P39 Exp4-OSS42-ILO Base-ESW1-P40 Exp2-OSS19-NIC1 Base-ESW2-P40 Exp4-OSS42-NIC1 Base-ESW1-P41 Exp2-OSS20-ILO Base-ESW2-P41 Exp4-OSS43-ILO Base-ESW1-P42 Exp
Table A-21 Ethernet Switches 1 and 2 for 1:1 Configurations with between 36 and 64 Object Storage Servers (continued) Base-ESW3-P17 Exp5-OSS55-ILO Base-ESW3-P18 Exp5-OSS55-NIC1 Base-ESW3-P19 Exp6-OSS56-ILO Base-ESW3-P20 Exp6-OSS56-NIC1 Base-ESW3-P21 Exp6-OSS57-ILO Base-ESW3-P22 Exp6-OSS57-NIC1 Base-ESW3-P23 Exp6-OSS58-ILO Base-ESW3-P24 Exp6-OSS58-NIC1 Base-ESW3-P25 Exp6-OSS59-ILO Base-ESW3-P26 Exp6-OSS59-NIC1 Base-ESW3-P27 Exp6-OSS60-ILO Base-ESW3-P28 Exp6-OSS60-NIC1 Base-ESW3-P29 E
A.3.2 Wiring Tables for Configurations with a 2:1 Ratio of SFS20 Enclosures to Object Storage Servers This section provides management network Ethernet switch wiring tables for configurations using ProLiant DL380 Object Storage Servers with a ratio of 2 SFS20 Enclosures to 1 Object Storage Server. A.3.2.
A.3.2.2 DL380 Configurations with a 2:1 Ratio and 12 to 22 Object Storage Servers Table A-23 “Ethernet Switches 1 and 2 for 2:1 Configurations with between 12 and 22 Object Storage Servers” provides the management network wiring for the ProCurve Switches used in configurations with between 12 and 22 Object Storage Servers.
Table A-24 Ethernet Switches 1 and 2 for 2:1 Configurations with between 24 and 34 Object Storage Servers Switch 1 Origin Switch 1 Destination Switch 2 Origin Switch 2 Destination Base-ESW1-P1 Base-OSS0-ILO Base-ESW2-P1 Exp2-OSS11-ILO Base-ESW1-P2 Base-OSS0-NIC1 Base-ESW2-P2 Exp2-OSS11-NIC1 Base-ESW1-P3 Base-OSS1-ILO Base-ESW2-P3 Exp2-OSS12-ILO Base-ESW1-P4 Base-OSS1-NIC1 Base-ESW2-P4 Exp2-OSS12-NIC1 Base-ESW1-P5 Base-OSS2--ILO Base-ESW2-P5 Exp2-OSS13--ILO Base-ESW1-P6 Base-OSS2-NIC
Table A-25 Ethernet Switch 3 for 2:1 Configurations with between 24 and 34 Object Storage Servers (continued) Base-ESW3-P5 Exp4-OSS25--ILO Base-ESW3-P6 Exp4-OSS25-NIC1 Base-ESW3-P7 Exp4-OSS26-ILO Base-ESW3-P8 Exp4-OSS26-NIC1 Base-ESW3-P9 Exp4-OSS27-ILO Base-ESW3-P10 Exp4-OSS27-NIC1 Base-ESW3-P11 Exp5-OSS28-ILO Base-ESW3-P12 Exp5-OSS28-NIC1 Base-ESW3-P13 Exp5-OSS29-ILO Base-ESW3-P14 Exp5-OSS29-NIC1 Base-ESW3-P15 Exp5-OSS30-ILO Base-ESW3-P16 Exp5-OSS30-NIC1 Base-ESW3-P17 Exp5-OSS31-IL
Table A-26 Ethernet Switches 1 and 2 for 2:1 Configurations with between 36 and 64 Object Storage Servers (continued) Base-ESW1-P9 Exp1-OSS4-ILO Base-ESW2-P9 Exp4-OSS27-ILO Base-ESW1-P10 Exp1-OSS4-NIC1 Base-ESW2-P10 Exp4-OSS27-NIC1 Base-ESW1-P11 Exp1-OSS5-ILO Base-ESW2-P11 Exp5-OSS28-ILO Base-ESW1-P12 Exp1-OSS5-NIC1 Base-ESW2-P12 Exp5-OSS28-NIC1 Base-ESW1-P13 Exp1-OSS6-ILO Base-ESW2-P13 Exp5-OSS29-ILO Base-ESW1-P14 Exp1-OSS6-NIC1 Base-ESW2-P14 Exp5-OSS29-NIC1 Base-ESW1-P15 Exp1-OSS7
Table A-26 Ethernet Switches 1 and 2 for 2:1 Configurations with between 36 and 64 Object Storage Servers (continued) Base-ESW1-P45 Exp4-OSS22-ILO Base-ESW2-P45 Exp7-OSS45-ILO Base-ESW1-P46 Exp4-OSS22-NIC1 Base-ESW2-P46 Exp7-OSS45-NIC1 Base-ESW1-P47 Base-MDS-ILO Base-ESW2-P47 Exp8-OSS46-ILO Base-ESW2-P48 Exp8-OSS46-NIC1 Base-ESW1-P48 Base-ESW1-P49 Base-MDS-NIC1 Base-ESW2-P49 Exp1-ESW1-50 Base-ESW1-P50 Base-ESW2-P49 Base-ESW2-P50 Base-ESW3-P49 Table A-27 “Ethernet Switches 3 for 2:1 Con
Table A-27 Ethernet Switches 3 for 2:1 Configurations with between 36 and 64 Object Storage Servers (continued) Base-ESW3-P26 Exp10-OSS59-NIC1 Base-ESW3-P27 Exp10-OSS60-ILO Base-ESW3-P28 Exp10-OSS60-NIC1 Base-ESW3-P29 Exp10-OSS61-ILO Base-ESW3-P30 Exp10-OSS61-NIC1 Base-ESW3-P31 Exp10-OSS62-ILO Base-ESW3-P32 Exp10-OSS62-NIC1 Base-ESW3-P33 Exp10-OSS63-ILO Base-ESW3-P34 Exp10-OSS63-NIC1 Base-ESW3-P35 Base-ESW3-P36 Base-ESW3-P37 A.3.
Table A-28 Ethernet Switch for 3:1 or 4:1 Configurations with between 2 and 10 Object Storage Servers (continued) Base-ESW1-P13 Exp2-OSS6-ILO Base-ESW1-P14 Exp2-OSS6-NIC1 Base-ESW1-P15 Exp2-OSS7-ILO Base-ESW1-P16 Exp2-OSS7-NIC1 Base-ESW1-P17 Exp2-OSS8-ILO Base-ESW1-P18 Exp2-OSS8-NIC1 Base-ESW1-P19 Exp2-OSS9-ILO Base-ESW1-P20 Exp2-OSS9-NIC1 Base-ESW1-P21 Reserved Base-ESW1-P22 Reserved Base-ESW1-P23 Base-MDS-ILO Base-ESW1-P24 Base-AD-ILO Base-ESW1-P25 Base-MDS-NIC1 Base-ESW1-P26 Ba
Table A-29 Ethernet Switches 1 and 2 for 3:1 or 4:1 Configurations with between 12 and 22 Object Storage Servers (continued) Base-ESW1-P17 Exp2-OSS8-ILO Base-ESW2-P17 Exp5-OSS19-ILO Base-ESW1-P18 Exp2-OSS8-NIC1 Base-ESW2-P18 Exp5-OSS19-NIC1 Base-ESW1-P19 Exp2-OSS9-ILO Base-ESW2-P19 Exp5-OSS20-ILO Base-ESW1-P20 Exp2-OSS9-NIC1 Base-ESW2-P20 Exp5-OSS20-NIC1 Base-ESW1-P21 Exp3-OSS10-ILO Base-ESW2-P21 Exp5-OSS21-ILO Base-ESW1-P22 Exp3-OSS10-NIC1 Base-ESW2-P22 Exp5-OSS21-NIC1 Base-ESW1-P23
Table A-30 Ethernet Switches 1 and 2 for 3:1 or 4:1 Configurations with between 24 and 34 Object Storage Servers (continued) Base-ESW1-P21 Exp3-OSS10-ILO Base-ESW2-P21 Exp5-OSS21-ILO Base-ESW1-P22 Exp3-OSS10-NIC1 Base-ESW2-P22 Exp5-OSS21-NIC1 Base-ESW1-P23 Base-MDS-ILO Base-ESW2-P23 Exp6-OSS22-ILO Base-ESW1-P24 Reserved Base-ESW2-P24 Exp6-OSS22-NIC1 Base-ESW1-P25 Base-MDS-NIC1 Base-ESW2-P25 Base-ESW1-P26 Base-ESW1-P26 Base-ESW2-P25 Base-ESW2-P26 Base-ESW3-P25 Table A-31 “Ethernet Swi
Table A-31 Ethernet Switches 3 for 3:1 or 4:1 Configurations with between 24 and 34 Object Storage Servers (continued) Base-ESW3-P25 Base-ESW2-P26 Base-ESW3-P26 Base-AD-NIC1 A.3.3.
Table A-32 Ethernet Switches 1 and 2 for 3:1 or 4:1 Configurations with between 36 and 64 Object Storage Servers (continued) Base-ESW1-P29 Exp4-OSS14-ILO Base-ESW2-P29 Exp9-OSS37-ILO Base-ESW1-P30 Exp4-OSS14-NIC1 Base-ESW2-P30 Exp9-OSS37-NIC1 Base-ESW1-P31 Exp4-OSS15-ILO Base-ESW2-P31 Exp10-OSS38-ILO Base-ESW1-P32 Exp4-OSS15-NIC1 Base-ESW2-P32 Exp10-OSS38-NIC1 Base-ESW1-P33 Exp4-OSS16-ILO Base-ESW2-P33 Exp10-OSS39-ILO Base-ESW1-P34 Exp4-OSS16-NIC1 Base-ESW2-P34 Exp10-OSS39-NIC1 Base-
Table A-33 Ethernet Switch 3 for 3:1 or 4:1 Configurations with between 36 and 64 Object Storage Servers (continued) Base-ESW3-P10 Exp13-OSS51-NIC1 Base-ESW3-P11 Exp13-OSS52-ILO Base-ESW3-P12 Exp13-OSS52-NIC1 Base-ESW3-P13 Exp13-OSS53-ILO Base-ESW3-P14 Exp13-OSS53-NIC1 Base-ESW3-P15 Exp14-OSS54-ILO Base-ESW3-P16 Exp14-OSS54-NIC1 Base-ESW3-P17 Exp14-OSS55-ILO Base-ESW3-P18 Exp14-OSS55-NIC1 Base-ESW3-P19 Exp14-OSS56-ILO Base-ESW3-P20 Exp14-OSS56-NIC1 Base-ESW3-P21 Exp14-OSS57-ILO Base-
Table A-33 Ethernet Switch 3 for 3:1 or 4:1 Configurations with between 36 and 64 Object Storage Servers (continued) Base-ESW3-P46 Base-ESW3-P47 132 Base-ESW3-P48 Base-Admin-ILO Base-ESW3-P49 Base-ESW2-P50 Base-ESW3-P50 Base-Admin-NIC1 Wiring Tables
B Hardware Component Specifications This appendix provides operating and performance specifications for HP SFS system components. B.1 High-Voltage 24-Amp and 32-Amp Power Distribution Unit Specifications Table B-1 “PDU Specifications” describes the specifications for the high-voltage 24-amp and 32-amp modular PDU. Table B-1 PDU Specifications 252663-D72 (24-amp)1 Characteristic Mechanical dimensions (WxHxD) 252663-B31 (32-amp)2 44.5 x 4.11 x 14.22 cm (17.5 x 1.62 x 5.
Table B-2 ProCurve Switch 2626 Specifications Characteristic Value Dimensions Height 4.4 cm (1.73 in) Depth 36.7 cm (14.4 in) Width 44.3 cm (17.42 in) Weight 4.62 kg (10.20 lb) Input Requirements Rated input voltage 100 VAC/240 VAC Rated input frequency 50 Hz/60 Hz Maximum current 0.6A/0.
Table B-3 HP ProCurve Switch 2650 Specifications (continued) Characteristic Value Operating 15% to 95% @ 40°C (104°F) Non-operating 15% to 95% @ 65°C (149°F) Acoustic Noise per ISO 9296 Idle or operating 1 <3.0 LWAd (BELS) (<20 LpAm (dBA)) Altitude up to 4.6 km (15,091 ft) B.4 HP StorageWorks Scalable File Share 20 Enclosure Specifications Table B-4 “HP StorageWorks Scalable File Share 20 Enclosure Specifications” lists the specifications for the HP SFS20 Enclosure.
Table B-5 Rackmount Monitor Specifications (continued) Characteristic Value Maximum graphics resolution 1024x768 @ 70 Hz refresh rate Horizontal dot pitch 0.29 mm Horizontal frequency 48.2 kHz Vertical frequency 60 Hz Pixel clock speed 80 Hz Keys 104, 105, 107, and 109 layout (depending on country), plus 9 programmable hot keys and wizard key Environmental Temperature Operating 10 – 50°C Storage temperature 0 – 60°C Physical Dimensions HxWxD 4.32x39.6x43.2 cm (1.7x15.6x17 in) Weight 6.
Table B-6 KVM Physical Specifications (continued) Characteristic Value Depth 16.51 cm (6.5 in) Weight 2.04 kg (4.5 lb) Table B-7 “KVM Power Requirements” lists the power requirements for the keyboard viedo mouse switch.. Table B-7 KVM Power Requirements Requirement Value Voltage 100 to 240V AC Frequency 50 to 60 Hz Rated current 1 to 0.5A Table B-8 “KVM Environmental Specifications” lists the KVM environmental specifications.
Glossary administrative server The inactive MDS server that handles all administrative functions. advanced ECC memory Advanced error checking and correcting memory. Detects and corrects single-bit memory errors. BIOS Basic input/output system. cluster A cluster is a set of independent computers combined into a unified system through system software and networking technologies. DHCP Dynamic Host Control Protocol.
management network Consists of a private network of administration server, MDS server, and Object Storage Servers. Handles the management and installation tasks and isolates administration traffic from I/O activity. MDS Server Metadata Server. The server responsible for I/O metadata. The second, inactive MDS server is the administrative server. network Two or more computing systems that are linked for the purpose of exchanging information and sharing resources. Network File System See NFS.
Index obtaining current version, 75 verifying iLO, 75 PCI adapters, 77 ProCurve switch, 75 ProLiant DL360, 75 ProLiant DL380, 75 SA-6404, 77 SFS20, 78 Symbols 10000-series rack, 41 24-amp PDU (see PDU) 32-amp PDU (see PDU) A AC power strips (see power strips) acoustics component specifications , 133 administration server as standby MDS server, 21 characteristics, 45, 46 configuration, 46 function, 21 advanced ECC memory, 54 C cables used, 63, 66 cabling management network, 65, 97 cluster, 21 cluster inte
L LED ProCurve switch, 91 LEDs ProCurve Switch, 57, 90 ProCurve Switch 2626, 90 ProLiant DL360 front panel, 81 ProLiant DL360 G4 rear panel, 84 ProLiant DL380 front panel LEDs, 85 ProLiant DL380 rear panel LEDs, 89 SFS20, 94 Lustre File System, 21 M management network, 23, 56 cabling, 97 cabling between racks, 65 iLO and NIC1, 65 maximum number of servers, 21 maximum rack configurations, 33 MDS server, 21 characteristics, 45, 46 configuration, 46 metadata, 21 metadata server (see MDS server) MSA20, 22 MSA2
characteristics, 45 front panel LEDs, 84 rear panel, 53 rear panel LEDs, 86 server, 45 systems insight display LEDs, 87 R rack configurations, 33 rack contents, 24 redundant ROM, 54 S SA-6404, 23, 56 controller numbering, 77 SATA disks, 23 SCSI bus numbering, 77 verifying firmware, 77 SATA drives, 23, 55 server characteristics, 44, 45 how configured, 22, 23 maximum number, 21 ProLiant DL360, 22 ProLiant DL360 G5, 43 ProLiant DL380, 22 ProLiant DL380 G5, 45 SFS20, 41, 55, 56 LEDs, 94 number of ports, 56 RA
