AlphaServer GS160/320 Upgrade Manual Order Number: EK-GS320-UP. D01 This manual is for service providers of HP AlphaServer GS160/320 systems. It discusses system expansion and upgrade of an original system with faster CPUs.
August 2002 © 2002 Hewlett-Packard Company. Portions of the software are © copyright Cimetrics Technology. UNIX is a trademark of The Open Group in the United States and other countries. All other product names mentioned herein may be trademarks of their respective companies. HP shall not be liable for technical or editorial errors or omissions contained herein. The information in this document is provided “as is” without warranty of any kind and is subject to change without notice.
Japanese Notice Canadian Notice This Class A digital apparatus meets all requirements of the Canadian Interference-Causing Equipment Regulations. Avis Canadien Cet appareil numérique de la classe A respecte toutes les exigences du Règlement sur le matériel brouilleur du Canada. European Union Notice Products with the CE Marking comply with both the EMC Directive (89/336/EEC) and the Low Voltage Directive (73/23/EEC) issued by the Commission of the European Community.
Contents Preface ........................................................................................................................ix Chapter 1 1.1 1.2 1.2.1 1.2.2 1.3 1.4 1.5 1.5.1 1.5.2 1.5.3 The Systems .......................................................................................... 1-2 System Diagrams .................................................................................. 1-3 Block Diagrams .....................................................................................
Chapter 4 4.1 4.2 4.3 4.4 4.4.1 4.4.2 4.4.3 4.4.4 Control Panel Keyswitch....................................................................... 4-2 Installing the System Management Console ........................................ 4-4 Powering Up the System....................................................................... 4-5 Q-Vet Verification ............................................................................... 4-14 Installing Q-Vet..........................................................
Index Examples 4–1 A–1 Power-Up Display ................................................................................. 4-5 Updating the Firmware ........................................................................A-4 Figures 1–1 1–2 1–3 1–4 1–5 2–1 2–2 2–3 2–4 2–5 2–6 2–7 2–8 2–9 3–1 3–2 3–3 3–4 3–5 3–6 3–7 3–8 3–9 3–10 3–11 4–1 5–1 5–2 GS160 Block Diagram........................................................................... 1-3 GS160 Block Diagram.............................................
5–3 5–4 5–5 5–6 5–7 5–8 5–9 5–10 5–11 5–12 5–13 5–14 5–15 5–16 5–17 5–18 5–19 5–20 5–21 5–22 5–23 5–24 A–1 A–2 A–3 A–4 A–5 Preparing the Cabinet for Installation ................................................. 5-6 Cable Connections of the PCI Box ........................................................ 5-8 Power and CSB Connectors on PCI Box and AC Input Box ............... 5-11 Installing a System Box ......................................................................
Preface Intended Audience This manual is for service providers of HP AlphaServer systems. It discusses system upgrades and CPU upgrades for GS160/320 systems. Document Structure This manual uses a structured documentation design. Topics are organized into small sections, usually consisting of two facing pages. Most topics begin with an abstract that provides an overview of the section, followed by an illustration or example. The facing page contains descriptions, procedures, and syntax definitions.
Documentation Titles Table 1 HP AlphaServer GS160/320 Documentation Title Order Number QA–6GAAA–G8 AlphaServer GS80/160/320 Documentation Kit EK–GS320–UG AlphaServer GS80/160/320 User’s Guide EK–GS320–RM AlphaServer GS80/160/320 Firmware Reference Manual EK–GSPAR–RM AlphaServer GS80/160/320 Getting Started with Partitions EK–GS320–IN AlphaServer GS160/320 Installation Guide EK–GSR80–IN AlphaServer GS80 Installation Guide AG–RKSW*–BE AlphaServer GS80/160/320 User Information CD QA–6GAAB–G8 A
Chapter 1 Overview The AlphaServer GS160/320 systems are high-performance server platforms designed for enterprise-level applications. They are distinguished by their versatility and high degree of scalability and expandability. These powerful, switch-based systems use four Alpha microprocessors per quad 0 building block (QBB). Two QBBs paired back-to-back and rotated 180 with reference to each other form a system box.
1.1 The Systems The GS160/320 system consists of a power cabinet and one system cabinet (GS160) or two system cabinets (GS320), depending on the configuration. The power cabinet contains the power supplies, the I/O components—the PCI boxes and storage units—and the OCP. The system cabinets house the system boxes that carry interconnect modules as well as CPU and memory modules. The system cabinet can be configured with one or two system boxes.
1.2 1.2.1 System Diagrams Block Diagrams Figure 1–1 shows the block diagram of a GS160 system with a single system box installed. A distribution board makes the interconnect between the QBBs through their global ports.
Figure 1–2 shows a block diagram of a GS160 with two system boxes. A hierarchical switch makes the interconnect between the QBBs in the two system boxes through their global ports.
Figure 1–3 shows a block diagram of a GS320 with four system boxes. A hierarchical switch makes the interconnect between the QBBs in the four system boxes through their global ports.
1.2.2 Physical Diagrams Figure 1–4 shows a fully configured GS160 system.
Figure 1–5 shows a fully configured GS320 system.
1.3 Cabinets Table 1–1 shows the model number of cabinets and power requirements for systems operating in various electrical environments.
1.4 Color Codes System boxes and the associated power subracks and cables are color-coded for ease of reference and identification. Table 1–2 shows the color codes used for the system components.
1.5 Upgrades Upgrades of the GS160/320 are conducted at two levels: component and system. At the component level, an upgrade consists of the addition of either a PCI box or a storage unit. At the system level, upgrade procedures depend on the existing system, and the configuration to which the system needs to be brought up. 1.5.
1.5.3 Original System Upgrade In this upgrade, the original 4-Mbyte B-cache B4125 CPUs are replaced with faster B4166 CPUs (8-Mbyte B-cache) or B4168 CPUs (16-Mbyte B-cache); or B4166 or B4168 CPUs are added to the existing system. The original system has the following characteristics: 1. The system cabinet is blue. 2. The system drawer(s) supports 4 Mbytes of CPU B-cache. 3. The system contains 731 MHz B4125 CPUs only. 4. The system runs on a 9.6 ns clock.
Chapter 2 Upgrade to Two System Boxes This chapter discusses the requirements and procedures for upgrading an AlphaServer GS160 from one system box to two system boxes. To upgrade a one system box GS160 system to a two or more system-box system, you must remove the distribution board assembly and replace it with a hierarchical switch.
2.1 Removing the Distribution Board Assembly Remove the distribution board assembly as shown in Figure 2–1 and Figure 2–2.
Remove the distribution board assembly as follows: 1. Remove EMI covers from front and rear of the blue system box . 2. Loosen the two captive screws holding the EMI cover to the distribution board assembly and remove the assembly EMI cover . and detach global port 3. Pull front global port module from system box cables using a flat-blade screwdriver . Repeat for rear global port module. 4. Disconnect ground cable from distribution board assembly Figure 2–2. (see 5.
Figure 2– 2 Removing the Distribution Board Assembly (2) 5 7 10 8 6 9 6 (Rear View) MR0004 2-4 AlphaServer GS160/320 Upgrade Manual
2.2 Installing the Hierarchical Switch Figure 2– 3 shows how to install the H-switch. Figure 2– 3 Installing the Hierarchical Switch 4 5 Special long screwdriver required.
Install the H-switch as follows: 1. Remove the shipping covers from the front and rear of the green system box and install the green system box as explained in Chapter 5. 2. Remove EMI covers from the front and rear of the green system box. 3. Unpack the H-switch and the plenum. 4. Remove the pivot bracket and pivot bushing set from the H-switch by cutting the wrap . 5. Install the bushing in the hole in the cabinet frame 6. Insert the lower pivot pin on the H-switch cabinet frame. .
2.3 Connecting the Clock Cables Connect the clock cables as shown in Figure 2– 4.
Connect the clock cables as follows: 1. Pull the clock splitter module of the blue rear quadrant half way out. Route the “ 0” clock cable on the H-switch to the clock module and connect it to the clock module connector . Secure the clock cable to the frame by passing the cable through the clamps on the frame. Push the clock module in and lock it in place. 2. Remove filler module adjacent to the clock splitter module in the blue front qudrant (not shown).
2.4 Connecting the Power Cables Connect the power cables as shown in Figure 2– 5. Figure 2– 5 Connecting the Power Cables Blue System Box Green System Box 1 2 MR0008 Connect the power cables as follows: to the backplane in the rear of the blue system 1. Connect the power cable box. Route the power cable through clamps. 2. Repeat step 1 for the green system box . You have now made power connections to the blue and green system boxes.
2.5 Connecting the Global Port Cables Each global port module has two connectors. Attach the global port module connectors as shown in Figure 2– 6.
There are two global port modules on each system box. Each global port module has two connectors, “ A” and “ B” . “ A” connectors on the “ A” cables connect to “ A” connectors on the global modules and the “ B” connectors on the global port cables connect to the “ B” connectors on the global port modules. Make the connections to the global port modules of the blue system box as follows: 1. Connect the blue cable “ A0” on the H-switch to the “ A” connector on the global port 0 module. 2.
2.6 Connecting GRD Cables and the CSB Cable Attach the ground cables and the CSB cable as shown in Figure 2– 7.
Attach the ground cables and the CSB cable as shown in Figure 2–7: to the system cabinets using existing screws on Connect the CSB cable to the H-switch . 1. Attach the ground cables the H-switch. 2.
2.7 I/O Hose Connections Connect the hose cables from the local I/O riser ports to the remote risers in the PCI boxes.
Connect the hose cables from the local I/O riser ports to the remote risers in the PCI boxes. Figure 2–8 shows typical connections of I/O hoses between the local I/O riser ports and the remote risers in the PCI box. Note that Port 0 (or Port 2) is connected to J14 on the PCI box and Port 1 (or Port 3) is connected to J15. NOTE: Use label to identify port number and QBB number on both ends of the I/O hose.
2.8 Preparing System for Booting Replace the service cover on the H-switch and make DC power and signal cable connections (Figure 2– 9). Power up the system and set the serial number at the SRM prompt.
To prepare the system for booting you must do the following: 1. Reinstall the EMI covers on the H-switch. 2. Reinstall the EMI covers on the blue and green system boxes. Connect the DC power cables and the DC signal cables . The power 3. Make the CSB cable connection between the H-switch and the CSB adapter and terminator on the power cabinet (if not connected). 4. and signal cables are color-coded. Signal cables for the system box are located right next to the connector on the system box.
Chapter 3 Upgrade to Two System Cabinets This chapter describes how to upgrade a GS160 system to a GS320 system. Prior to the upgrade, consult the AlphaServer GS80/160/320 Site Preparation manual to ensure that appropriate measures are taken for the desired system expansion.
3.1 AlphaServer GS320 System The basic AlphaServer GS320 system is contained in three cabinets: power cabinet; system cabinet 1; system cabinet 2. Figure 3–1 shows a basic AlphaServer GS320 system.
The GS320 system consists of two system cabinets (system cabinet 1 and system cabinet 2) and a power cabinet. The power cabinet contains the operator control panel, up to four power subracks (one power subrack for each system box), up to eight AC input boxes (two per system box) with power supplies, a 14-slot PCI box assembly (BA54A), and a PCI box mounting and accessory kit (CK-BA54A). System cabinet 1 contains two system boxes. System cabinet 2 may contain one or two system boxes.
3.2 System Cabinet 2 Figure 3–2 shows system cabinet 2. It is similar to system cabinet 1. It contains a blower and can accommodate two system boxes.
System cabinet 2 is similar to system cabinet 1. It contains up to two system boxes. It is joined to system cabinet 1 to expand the system configuration from two system boxes to three or four system boxes. Refer to the Illustrated Parts Breakdown (EK-GS320-IP) for system cabinet parts.
3.3 Upgrading GS160 to GS320 Prepare the site for the expansion of the system. Make sure that you have the tools needed for the installation. Following the installation, wait for any condensation on the metal surfaces to evaporate before powering up the system. Table 3–1 gives the joining kits required for the installation. Only kit 70-40121-01 is needed to join system cabinet 2 to system cabinet 1.
System cabinet 2 is joined to system cabinet 1. Certain preparations need to be made before joining system cabinet 2 to the existing system. Before you start any installation procedure: 1. Ensure that the site is properly prepared for expansion of the system. Refer to the AlphaServer GS80/160/320 Site Preparation manual for spatial guidance, system specifications, and power requirements. 2. Roll system cabinet 2 off pallets. 3. Remove all protective packaging. 4.
3.3.1 Preparing System Cabinet 1 for Joining Figure 3–3 shows how to prepare system cabinet 1 for joining.
Position system cabinet 1 at the predetermined location. Lower the corner leveling feet on system cabinet 1 until the system cabinet is anchored and the casters are free to rotate. Release the tie wraps on the CSB cable and hose cables that are coiled and attached to the sides of system cabinets for later routing. Prepare system cabinet 1 for joining. 1. Remove the left side panel , top cover , and blower . 2. Remove system box rear covers (not shown) and hierarchical switch (H-switch) covers . 3.
3.3.2 Preparing System Cabinet 2 for Joining Figure 3– 4 shows how to prepare system cabinet 2 for joining.
Prepare system cabinet 2 for joining. 1. Remove and discard the shipping brackets (front and rear) . 2. Remove the blower . Remove the fastening screws at the front and rear of the system cabinet and disconnect the power cable harness. Pull the blower out from the front of the cabinet. 3. Remove the top cover . Open front and rear doors of the cabinet and gently lift off the top cover. 4. Remove the protective sleeves on the tapered pins . 5.
3.3.3 Joining System Cabinet 2 to System Cabinet 1 Figure 3– 5 shows how to join system cabinet 2 to system cabinet 1.
Join system cabinet 2 to system cabinet 1. 1. Position system cabinet 2 to the left of system cabinet 1. Note the taper pins on system cabinet 2 and the corresponding alignment holes on system cabinet 1 . 2. With the front of the system cabinet bases aligned, roll system cabinet 2 toward system cabinet 1 until there is a minimum separation between the frames . 3.
10. Make system box 3 and system box 4 cable connections to the H-switch. The connections include power , the global ports , clock modules (see Chapter 2 for illustration of clock splitter cable routing), and system ground . Figure 3–6 shows the cable connections to the right side and Figure 3–7 to the left side of the H-switch.
Figure 3– 7 Cable Connections to the Hierarchical Switch (2) H-switch 3 4 4 5 6 7 1 1 4 (Left Side) PK1271 12. Remove and discard the filler plate from the right side of the H-switch bottom. Install plenum to the H-switch (Figure 3–8) using the filler plate mounting screw. 13. Lower an outside corner leveling foot of system cabinet 2 until the associated caster is free to rotate. Repeat for the other three corner casters. Do not lower the center leveling feet. 14.
Figure 3– 8 External Cable Connections 2 2 Orange Brown 3 3 4 1 PK1272 (Figure 3–9) from the H-switch (if the H-switch 15. Connect the CSB cable has been installed during the current upgrade) to the CSB adapter and terminator on the power cabinet.
16. Connect the system ground wire (Figure 3–9) from the power cabinet to the system cabinet as follows: remove the M5 Phillips screw from the system cabinet, attach the loose end of the ground wire, and secure it to the system cabinet with the screw.
17. Connect the hose cables from the local I/O riser ports to the remote risers in the PCI boxes. Figure 3–10 shows typical connections of I/O hoses between the local I/O riser ports and the remote risers in the PCI box. Note that Port 0 (or Port 2) is connected to J14 on the PCI box and Port 1 (or Port 3) is connected to J15.
Labels on the I/O hoses indicate the I/O port and the QBB to which they should be connected. Table 3–2 gives the label codes on the I/O hoses for system cabinet 2. Refer to Chapter 2 for I/O hose labels for system cabinet 1. Table 3– 2 I/O Hose Labels for System Cabinet 2 Hose Label QBB No. Port No.
3.4 Preparing System for Booting Replace the service cover on the H-switch and make DC power and signal cable connections (Figure 3– 11). Power up the system and set the serial number at the SRM prompt.
To prepare the system for booting, you must do the following: 1. Install new covers on the H-switch. Discard the old covers. 2. Connect the DC power cables and the DC signal cables . The power and signal cables are color-coded. Signal cables for the system box are located right next to the connector on the system box. The system has now been upgraded from one system box to two system boxes and is ready for booting.
Chapter 4 System Power-Up This chapter tells how to power up the system and what happens upon power-up. Sections include: • Control Panel Keyswitch • Installing the System Management Console • Powering Up the System • Q-Vet Verification Check the power-up display for the new configuration of the system.
4.1 Control Panel Keyswitch The operator control panel (OCP) keyswitch has three positions: Off, On, and Secure. Figure 4–1 shows the OCP keyswitch.
Table 4–1 explains the functions selected by the keyswitch. Table 4–1 Keyswitch Functions on the Control Panel Keyswitch Position Function Off System is powered off and cannot be powered on remotely. On System is powered on and can be remotely powered on or powered off. Secure System is powered on and cannot be remotely powered on or off. Refer to the AlphaServer GS80/160/320 User’s Guide or the AlphaServer GS80/160/320 Service Manual for functional descriptions of all control panel components.
4.2 Installing the System Management Console Before you power up the system, you must install the system management console (SMC). Steps to be followed in installing the SMC are listed below. The procedures to install the SMC are fully detailed in the AlphaServer GS80/160/320 System Management Console Installation Guide. Steps to Install the SMC 1. Set up the SMC PC. 2. Install the SMC terminal server in the GS160/320 system. 3. Connect the terminal server to the power source. 4.
4.3 Powering Up the System To power up the system, first turn the circuit breakers in all cabinets on, then set the keyswitch on the OCP to the On position. Example 4– 1 shows a sample console display on power-up. See the AlphaServer GS80/160/320 Service Manual or the AlphaServer GS80/160/320 User’s Guide for explanations of the power-up display.
Testing SIO Shared RAM(please wait) Initializing shared ram Shared RAM Initialized Powering ON H-Switch SCM_E0> ~I~ HSW4/HPM40 SysEvent: HS_INIT_CD1 Reg1:D581 Reg0:000F Phase 0 ~I~ Enable HS Links: 0f ~I~ QbbConf(gp/io/c/m)=0000bbff Assign=0f SQbb0=00 PQbb=00 SoftQbbId=0000ba98 ~I~ SysConfig: 00 00 00 00 00 00 00 00 07 1f 07 9f 37 3f 37 9f SCM_E0> ~I~ HSW4/HPM40 SysEvent: LINK0_ON Reg0:000F Reg1:D581 ~I~ HSW4/HPM40 SysEvent: LINK1_ON Reg1:D581 SCM_E0> ~I~ HSW4/HPM40 SysEvent: LINK2_ON Reg1:D581 SCM_E0> ~I
QBB0 QBB1 QBB2 QBB3 IO_MAP0: IO_MAP1: IO_MAP2: IO_MAP3: 0000A0C001333333 0000A1C101333333 0000000000000003 0000000000000003 ~I~ QbbConf(gp/io/c/m)=0000bbff Assign=0f SQbb0=00 PQbb=00 SoftQbbId=0000ba98 ~I~ SysConfig: 00 00 00 00 00 00 00 00 07 1f 07 9f 37 3f 37 9f SCM_E0> . QBB0 now Testing Step-7 QBB1 Step(s)-5 6 Tested QBB2 Step(s)-5 6 Tested QBB3 Step(s)-5 6 Tested QBB0 now Testing Step-9.. QBB0 now Testing Step-A. QBB0 now Testing Step-7 QBB0 now Testing Step-9.. QBB0 now Testing Step-A.
Phase 3 ~I~ QbbConf(gp/io/c/m)=0000bbff Assign=0f SQbb0=00 PQbb=00 SoftQbbId=0000ba98 ~I~ SysConfig: 00 00 00 00 00 00 00 00 07 1f 07 9f 37 3f 37 9f SCM_E0> . QBB0 now Testing Step-D QBB1 now Testing Step-D QBB2 now Testing Step-D QBB3 now Testing Step-D....
(-) 1/31 32.0 (-) 2/32 29.0 (-) 3/33 30.0 PPPP --PP --.- --.- P1.1 P1.0 P P P P-P PPPP P--P --.- --.- --.- --.- P P P -PP PPPP ---P --.- --.- --.- --.- P P P -PP HSwitch Type HPM40 4-port PCI Rise1-1 Cab 7 6 5 4 10 11 - - L - - - - Cables 7 6 5 4 3 2 1 0 - - - - P P P P Temp(:C) 32.0 Rise1-0 3 2 1 Rise0-1 7 6 5 4 Rise0-0 3 2 1 RIO 1 0 PS 21 Temp (:C) - - - - - - - - - - - - L - S - - S * * * * PP PP 35.0 34.5 OpenVMS PALcode V1.80-1, Tru64 UNIX PALcode V1.
lowering IPL CPU 0 speed is 731 MHz create dead_eater create poll create timer create powerup access NVRAM QBB 0 memory, 3 GB QBB 1 memory, 3 GB QBB 2 memory, 3 GB QBB 3 memory, 1 GB total memory, 10 GB copying PALcode to 10bffe0000 copying PALcode to 20bffe0000 copying PALcode to 303ffe0000 probe I/O subsystem probing hose 0, PCI probing PCI-to-ISA bridge, bus 1 bus 1, slot 0 -- dva -- Floppy bus 0, slot 1 -- pka -- QLogic ISP10x0 bus 0, slot 3 -- ewa -- DE500-BA Network Controller bus 0, slot 15 -- dqa --
CPU 2 speed is 731 MHz create powerup starting console on CPU 3 initialized idle PCB initializing idle process PID lowering IPL CPU 3 speed is 731 MHz create powerup starting console on CPU 4 initialized idle PCB initializing idle process PID lowering IPL CPU 4 speed is 731 MHz create powerup starting console on CPU 5 initialized idle PCB initializing idle process PID lowering IPL CPU 5 speed is 731 MHz create powerup entering idle loop starting console on CPU 6 initialized idle PCB initializing idle proces
initialized idle PCB initializing idle process PID lowering IPL CPU 10 speed is 731 MHz create powerup starting console on CPU 11 initialized idle PCB initializing idle process PID lowering IPL CPU 11 speed is 731 MHz create powerup starting console on CPU 12 initialized idle PCB initializing idle process PID lowering IPL CPU 12 speed is 731 MHz create powerup starting console on CPU 13 initialized idle PCB initializing idle process PID lowering IPL CPU 13 speed is 731 MHz create powerup starting console on
The SRM console prompt (P00>>>) is displayed at the end of power-up. This completes the power-up initialization/testing sequence. The operating system can be installed from the SRM console prompt. Follow instructions given in the AlphaServer GS80/160/320 User’s Guide to: • Set boot options • Install Tru64 UNIX or OpenVMS After installing the operating system, you can install and run Q-Vet to verify the system operation (Section 4.4).
4.4 Q-Vet Verification CAUTION: Customers are not authorized to access, download, or use Q-Vet. Q-Vet is for use by service engineers to verify the system installation. Misuse of Q-Vet may result in loss of customer data. Q-Vet is the Qualification Verifier Exerciser Tool that is used by product engineers to exercise systems under development. We recommend running the latest Q-Vet released version to verify that hardware is installed correctly and is operational.
Swap or Pagefile Space The system must have adequate swap space (on Tru64 UNIX) or pagefile space (on OpenVMS) for proper Q-Vet operation. You can set this up either before or after Q-Vet installation. During initialization, Q-Vet will display a message indicating the minimum amount of swap/pagefile needed, if it determines that the system does not have enough. You can then reconfigure the system.
4.4.1 Installing Q-Vet The procedures for installation of Q-Vet differ between operating systems. You must install Q-Vet on each partition in the system. Install and run Q-Vet from the SYSTEM account on VMS and the root account on UNIX. Remember to install Q-Vet in each partition. Tru64 UNIX 1. Make sure that there are no old Q-Vet or DECVET kits on the system by using the following command: setld -i | grep VET Note the names of any listed kits, such as OTKBASExxx etc.
9. On reboot you can start Q-Vet GUI via vet& or you can run non GUI (command line) via vet –nw. OpenVMS 1. Delete any QVETAXPxxx.A or QVETAXPxxx.EXE file from the current directory. 2. Copy the self-extracting kit image file (QVETAXPxxx.EXE) to the current directory. 3. It is highly recommended, but not required, that you purge the system disk before installing Q-Vet. This will free up space that may be needed for pagefile expansion during the AUTOGEN phase. $purge sys$sysdevice:[*… ]*.* 4.
4.4.2 Running Q-Vet You must run Q-Vet on each partition in the system to verify the complete system. We recommend that you review the Special Notices and the Testing Notes section of the Release Notes located at http://chump2.mro.cpqcorp.net/qvet/ before running Q-Vet. Follow the instructions listed for your operating system to run Q-Vet in each partition. Tru64 UNIX Graphical Interface 1.
OpenVMS Graphical Interface 1. From the Main Menu, select IVP, Load Script and select Long IVP (the IVP tests will then load into the Q-Vet process window). 2. Click the Start All button to begin IVP testing. Command-Line Interface $ vet /int=char Q-Vet_setup> execute ivp.vms Q-Vet_setup> start Note that commands are case sensitive. NOTE: A short IVP script is provided for a simple verification of device setup. It is selectable from the GUI IVP menu, and the script is called .Ivp_short.scp (ivp_short.
4.4.3 Reviewing Results of the Q-Vet Run After running Q-Vet, check the results of the run by reviewing the summary log. If you follow the above steps, Q-Vet will run all exercisers until the slowest device has completed one full pass. Depending on the size of the system (number of CPUs and disks), this will typically take 2 to 12 hours. Q-Vet will then terminate testing and produce a summary log. The termination message will tell you the name and location of this file.
4.4.4 De-Installing Q-Vet The procedures for de-installation of Q-Vet differ between operating systems. You must de-install Q-Vet from each partition in the system. Failure to do so may result in the loss of customer data at a later date if Q-Vet is misused. Follow the instructions listed under your operating system to de-install Q-Vet from a partition. The qvet_uninstall programs will remove the Q-Vet supplied tools and restore the original system tuning/configuration settings. Tru64 UNIX 1.
Chapter 5 Upgrade Component Installation This chapter gives installation procedures for the following components: • PCI Box • System Box • CPU Module • Power Subrack • Power Supply • AC Input Box Procedures are applicable for the installation of the component in any location. Configuration rules and component locations for the expander cabinet are given at the end of the chapter.
5.1 Installing a PCI Box Unpack the shipping box and note its contents. Figure 5–1 shows the PCI box.
The shipping box contains the following items: PCI box (BA54A-AA) Mounting hardware kit (CK-BA54A-AA) Table 5–1 lists the items in the PCI box mounting hardware (CK-BA54A-AA). Table 5–1 PCI Box Mounting Hardware Part Number Description CK-BA54A-AA 70-33596-01 Latch assembly 1 74-53016-01 Plate, strike 1 74-52544-01 Through cable 1 74-53597-01 Bracket, shipping 2 74-52428-01 Bracket, slide, front mounting (RH) 4 74-60022-01 Bracket, adapter, mounting 1 12-45925-01 Conn.
5.1.1 Preparing the PCI Box for Installation Figure 5–2 shows how to prepare the PCI box for installation.
Prepare the PCI box for installation as follows: 1. Slide the outer track of the mounting rail assembly of the PCI box all the way out. Press on the retaining lever to release the outer track from the assembly. 2. Repeat step 1 on the other side of the PCI box. The next step is to mount the outer tracks to the cabinet rails.
5.1.2 Preparing the Cabinet for PCI Box Installation Figure 5–3 shows how to prepare the cabinet for the PCI box installation.
Prepare the cabinet for installation as follows: 1. Select the location in the power cabinet or the expander cabinet where the PCI box is to be installed (see 5.7). Chapter 3 discusses the configuration rules for each system and shows assigned component locations with cabinet rail hole numbers to be used for each location. 2. Attach the two track mounting brackets (P/N 7452428-01) to the two ends of the outer track bracket with two M4 x 6 truss head screws for each bracket .
5.1.3 Installing the PCI Box and Making Cable Connections Install the PCI box and make the cable connections. Figure 5– 4 shows how to connect the PCI box power cable and module cables.
CAUTION: Proper alignment during the insertion of the PCI box in the cabinet is critical. Two people are needed to lift the PCI box and slide it gently into the ball bearing track. Any mishandling or misalignment at this stage could damage the hardware and result in jamming. Install the PCI box as follows: 1. Lift the PCI box and gently insert the rear sides of the inner tracks fastened on the sides of the PCI box into the outer ball bearing tracks attached to the cabinet.
4. If shipping the system, install the shipping brackets on each side of the cabinet (see Figure 5–3) using U-nuts and M5 screws to hold the PCI box securely in place. CAUTION: It is absolutely necessary to install the shipping brackets before moving the cabinet. Failure to install the shipping brackets while moving the cabinet could be hazardous as the retainer latch may disengage. Shocks and vibrations may also cause component damage. 5.
Figure 5– 5 Power and CSB Connectors on PCI Box and AC Input Box (Rear View) J-15 (Front View) J-14 J-7 J-6 J-5 J-3 J-4 J-13 J-12 J-11 J-10 J-2 J-1 J-9 B A B J-5 A B J-4 J-1 J-3 J-2 J-4 A B J-3 J-2 J-5 J-7 J-3 J-4 J-5 J-6 J-1 J-10 J-12 J-14 J-16 J-9 J-7 J-2 A J-9 J-11 J-13 J-15 J-6 J-8 J-1 A B J-8 J-12 J-14 J-11 J-16 J-18 J-10 J-15 J-13 J-17 J-19 J-21 J-20 J-22 PK-0527-99 The installation of the PCI box is complete.
5.2 Installing a System Box The procedure for installing a system box is the same for all upgrades. Figure 5– 6 shows the installation of a system box.
Install the system box as follows: 1. Unscrew and remove the shipping brackets (painted red) from the system cabinet and power cabinet. 2. Unpack the shipping box. The shipping box contains the system box, mounting brackets, and an installation kit. 3. Loosen the three screws on the upper locking bracket of the system box cage and push the bracket up . Tighten the screws. Loosen the three screws on the lower locking bracket and let the bracket down . 4.
5.3 Making System Box Cable Connections After installing the system box, you must make two classes of cable connections: 1) system cabinet to power cabinet connections; 2) console serial bus (CSB) connections. Figure 5– 7 and Figure 5– 8 show these cable connections.
System Cabinet to Power Cabinet Cabling (Figure 5– 7) • • • . Connect system box signal cable . Connect blower cable . Note that the blower cable splits into two Connect system box power cable connectors on the power cabinet side. Console Serial Bus and I/O Cabling (Figure 5– 8) • Connect cable from the H-switch to the CSB adapter and terminator on the power cabinet . • Connect I/O cables . I/O cabling depends on the configuration of the system box. There are eight I/O slots per system box.
5.4 Installing a CPU Module Refer to Figure 5– 9 and follow the procedure outlined next to install a CPU module.
The unoccupied slot is covered with a filler. First remove the filler from the selected slot, then proceed to install the module as follows: 1. Check the firmware revisions and update, if necessary. See Appendix A. 2. Ensure that the color code of the CPU module matches the color code of the slot. 3. Push the retainers on the module latches with your thumbs in the direction of the arrows and release the latch. 4. Slide the module into the slot guide and gently push it in until the latches are activated. 5.
5.5 Installing a Power Subrack The procedure for installing a power subrack is the same for all upgrades. Figure 5– 10 shows a power subrack.
The shipping box of the power subrack assembly contains the following items: • Subrack power supply assembly • Two base support brackets, right-hand and left-hand • Mounting kit hardware consisting of two M6 screws, six M5 screws, and four M6 nuts The installation areas are color-coded in the same manner as the associated system boxes. Starting from the top, the area is blue for the first power subrack, green for the second, orange for the third, and brown for the forth.
5.5.1 Installing Power Subrack into Cabinet Figure 5– 11 shows how to install a power subrack into the cabinet.
Install the power subrack into the cabinet as follows: 1. Insert the screw on the left-hand base support bracket (74-52913-01) through the appropriate hole on the left-hand rail of the cabinet front (see Table 5–2) so that the bracket is inside the cabinet and the three securing holes are lined up with the cabinet rail holes. Secure with an M6 nut . 2. Secure the back of the base support bracket to the rear cabinet rail hole (see Table 5–2) with an M6 screw and nut . 3.
5.5.2 Connecting Cables to the System Box Figure 5– 12 shows the power subrack cabling. The connection to the system box is made through the power distribution panel. First insert the power subrack cable connectors into their respective locations on the power distribution panel. Then connect the system cable connectors to their counterparts from the power subrack on the power distribution panel.
5.5.
Locate the color-coded area on the power distribution panel and insert the power subrack cables into their respective positions on the panel as follows. Refer to Figure 5–13: NOTE: The cable connections of the orange and brown system boxes are made through the second power distribution panel located right underneath the first one on the power cabinet. You need to attach this panel if it is not already installed by manufacturing. 1.
Figure 5– 14 Cable Connections from System Box 1 2 3 PK-0564-99 Upgrade Component Installation 5-25
Refer to Figure 5–14 and proceed as follows: from the system box to the 6 AWG 1. Connect the 6 AWG harness assembly harness assembly connector on the power distribution panel. Push the cable connector in until it locks firmly. to the 2. Connect the 50-conductor DC signal harness assembly connector DC connector on the power distribution panel.
5.5.4 Connecting Cables to the AC Input Box Figure 5– 15 shows how to make connections to the AC input box.
Connect the power cords to the AC input box as follows: 1. Let the three power cords hang down on the side of the power cabinet and pull the connectors in toward the front of the AC input box . NOTE: Connectors on the AC input box are color-coded, so that the lowest row of connectors is blue, the next row above is green. If there is another AC input box on top of the first one, then the next row of connectors is orange, and the top row of connectors is brown.
5.5.5 Installing a Power Supply Figure 5– 16 shows how to install a power supply.
Each power subrack requires a minimum of two power supplies. A redundant third power supply is recommended. Figure 5–17 shows the power supply slot assignments and the placement of the three power supplies for each of the four power subracks.
1. Place the power supply onto the power subrack and push it in until firmly engaged . 2. Tighten the two front screws on the power supply to connect it firmly to the power subrack . You have now completed the installation of a power subrack.
5.6 Installing an AC Input Box Figure 5– 18 shows how to install an AC input box.
A system with one system box requires one AC input box. A system with more than one system box requires two AC input boxes. Systems with four system boxes may require a third AC input box, depending on the configuration. Install an AC input box as follows: 1. Unscrew and remove from the two side rails the displacement stopper brackets that are installed to prevent the AC input boxes from moving during shipment. 2.
5.7 Expander Cabinet Configurations The expander cabinet provides space for additional I/O components and the memory channel adapter. Figure 5– 19, Figure 5– 20, and Figure 5– 21 show various configurations for the expander cabinet. Figure 5– 21, Figure 5– 22, Figure 5– 23, and Figure 5– 24 show the locations in the expander cabinet where the I/O devices are mounted.
The expander cabinet is used for additional PCI boxes and storage devices. In addition, the expander cabinet holds two memory channel adapters for the PCI boxes. The expander cabinet is shipped with a default configuration but can be built to order as shown by other configurations. Figure 5–19, Figure 5–20, and Figure 5–21 show the various configurations available for the expander cabinet and the placement order of the I/O devices.
Figure 5– 21 Mounting Locations for the Starlight Storage Device Front Rails ("U" 34) Starlight - Mounting Locations Starlight 1 Starlight 2 Starlight 3 Starlight 4 Starlight 5 Starlight 6 Starlight 7 ("U" 33) ("U" 32) ("U" 31) ("U" 30) ("U" 29) ("U" 28) ("U" 27) ("U" 26) ("U" 25) ("U" 24) ("U" 23) ("U" 22) ("U" 21) ("U" 20) ("U" 19) ("U" 18) ("U" 17) ("U" 16) ("U" 15) ("U" 14) ("U" 13) Starlight 8 Starlight 9 ("U" 12) Mount Storage Shelves so that the Front Surfaces are at or Near the
Figure 5– 22 Mounting Locations for the StorageWorks Storage Device BA356 - Hole Locations Front Rails 99 98 95 94 87 86 83 82 75 74 71 70 63 62 59 58 51 50 47 46 39 38 35 34 27 26 23 22 15 14 11 10 BA356 1 BA356 2 BA356 3 BA356 4 BA356 5 BA356 6 BA356 7 BA356 8 (Use BA35X-RK Mounting Hardw are) PK0550-00 Upgrade Component Installation 5-37
Figure 5– 23 Mounting Locations for the PCI Box BA54A PCI Box - Hole Locations Rear Rails Front Rails (80) PCI Box 4 (77) (80) (79) (78) (77) (75)* (74)* (72) (71) (65) PCI Box 3 (62) (65) (64) (63) (62) (60)* (59)* (57) (56) (50) PCI Box 2 (47 ) (50) (49) (48) (47) (45)* (44)* (43) (42) (35) PCI Box 1 (35) (34) (33) (32) (Location for single unit) (30)* (29)* (32 ) (27) (26) * CSB Mounting Holes. (Mounts on Rear/Right Rail Only).
Figure 5– 24 Mounting Locations for the Memory Channel Memory Channel - Hole Locations Front Rails (29) Rear Rails Memory Channel 2 (27) (26) (25) (14) (27) (26) (25) Memory Channel 1 (12) (11) (10) (12) (11) (10) Use Memory Channel 2 Rackmount Kit 2T-MAVRK PK0551-00 Upgrade Component Installation 5-39
Appendix A Upgrades Using B4166 and B4168 CPUs Upgrading original systems depends upon whether the customer decides to retain the older, slightly slower CPUs or not. There are three types of upgrades: • Adding CPUs to a (black) system that always had B4166 CPUs. See Section 5.4. • Replacing B4125 CPUs in a (blue) system with B4166 or B4168 CPUs. • Adding B4166 or B4168 CPUs to a (blue) system containing B4125 CPUs.
A.1 Upgrades Retaining Older CPUs These upgrades consist of adding new CPUs and new system boxes. Follow the procedures in Chapter 5 for adding new CPUs and adding a new system box. Table A–1 describes the different CPUs. The CPU derives its operating clock speed from the system clock. The B4125 CPU is not supported when the system clock is run at 9.0 ns. Be sure to update the firmware. See Section A.2.1.
Table A–1 Comparison of CPUs (Continued) CPU Part Number B-cache Size Speed in MHz B4168 Uses 4 of its 16 MB B-cache 1148 The B4168 runs at this speed when placed in a QBB that supports only 4 Mbytes of B-cache, when all CPUs in the system are B4168 or B4166, and the clock runs at 9.0 ns. Uses 8 of its 16 MB B-cache 1001 The B4168 runs at this speed and uses 8 Mbytes of its B-cache when the B4168 is placed in the same QBB as the B4166 and the clock is at 9.0 ns.
From outside the box, there is no easy way to visually distinguish between the two system boxes; to see the components that differ requires looking inside the box. The best way to determine which box is in the system is to use the show fru command. The 54-class part number is listed on the QBBx line when the show fru command is issued from either the SCM monitor or the SRM console. Configuration Rules The original (blue) system upgrade is governed by the following rules: 1.
A.2 Upgrades Replacing Older CPUs These upgrades consist of updating the firmware, replacing old CPUs, old system box(es), and changing the speed of the system clock. A.2.1 Firmware Requirements Before replacing anything, upgrade the system firmware to V6.0-514 or a later revision if you are installing B4166 CPUs, or to V6.3 or a later revision if installing B4168 CPUs.
P00>>> power off Powering off Hard_partition_0 consisting of: QBB0 QBB1 QBB-0 Powering OFF QBB-1 Powering OFF Issue the SRM show config command. Note the version of the SRM console. The B4166 requires V6.0-514 or higher, and the B4168 requires V6.3 or higher. Note the firmware revision of the microprocessors. The B4166 requires V6.0-514 or higher, and the B4168 requires V6.3 or higher Issue the SCM command to get to the SCM monitor. Only necessary if the system is partitioned.
A.2.2 System Box Removal and Replacement If a QBB backplane requires replacement, the system box is replaced. This procedure requires two people.
Removal (Requires two people) 1. Once the system is powered off and the AC circuit breakers are in the Off position, access the system boxes to be removed. 2. Place an ESD mat, two of which are included with the system box spare, on two horizontal surfaces, one in front of the machine and one in back. 3. Remove all modules from the front and rear QBBs. Place them on the ESD mats. 4. Move the cables (global port and clock) out of the system box.
A.2.3 CPU Replacement As part of the system box replacement, replace the old B4125 CPUs with the new B4166 or B4168 CPUs. CAUTION: The B4180-BD and B4181-BD global ports are required for the BA51A-BA system box and 8-Mbyte B-cache support. The B4180-BE and B4181-BE global ports are required for the BA51A-DA system box and 16-Mbyte B-cache support. Do not swap in the B4180-BC or B4181-BC modules when configuring the system.
A.3 Dealing with the System Clock There are two variants of the system clock: one can be set to different frequencies, the other is fixed. If the upgrade kit does not have a new clock module, change the clock frequency (Section A.3.1). If the upgrade includes a new clock module (30-56061-03), replace the clock (Section A.3.2). A.3.1 Changing Clock Module Switch Settings Two switch packs on the clock module control the clock frequency.
The switch packs on the master clock control the speed of the system. When B4125 CPUs are in the system, the clock runs at 9.6 ns. To set the system speed to 9.0 ns, access the clock module and change the switches. Clock Module Access 1. At the rear of the system remove the EMI covers from the left side of the H-switch. 2. Remove the upper H-switch power supply. The clock module is now exposed. 3. Check the bit settings on the two switches. See Figure A–2 for switch orientation and bit settings.
A.3.2 H-switch Clock Module AC power must be off when removing the clock. The module is located above the H-switch in the upper left side of the H-switch housing.
Removal 1. Remove the EMI covers from the left side of the H-switch. 2. Remove the upper H-switch power supply. The clock module is now exposed. 3. Unplug all coax cables connected to the module making sure that the QBB ID labels are secure. (You may want to use needle-nosed pliers for this.) 4. Unplug the ribbon cable that goes to the H-switch module. 5. Unscrew the four Phillips head screws that hold the module in place and remove it from the H-switch housing.
A.3.3 B4168 Compatibility Switch The B4168 CPU module has a switch that must be set if the module is to be used with B4125 modules in the same QBB. Figure A– 4 Setting the B4168 Switch For use with B4168 or B4166 CPUs For use with B4125 CPUs S1 Switch Power Converter CPU Chip MR0489 Figure A–4 shows the location of the S1 switch that must be changed if the module is to be in a QBB with a B4125 module.
A.4 Verification When you power up the system, check that the SCM correctly maps the QBBs in the system. Execute the SRM set sys_serial_num command. Run Q-Vet/IVP (see Section 4.4).
A.5 Replacing the System Cosmetics When systems are completely upgraded (when B4125 CPUs are replaced), they may also receive new black doors and panels.
Door Removal 1. Open the door. 2. On front doors remove the screw at the cabinet end of the ground strap. 3. If the door contains the OCP, disconnect all cables to it. 4. If the door has a service pouch on it, remove it and place it inside the cabinet. 5. 6. 7. Remove the outer screw of the upper bracket holding the door to the frame. Loosen the inner screw of the upper bracket and slide the door and bracket to let the screw pass through the bracket.
Index A AC input box, 5-8 connections, 5-27 installation, 5-32 AlphaServer GS160 system two system boxes, 1-6 AlphaServer GS320 system four system boxes, 1-7 Color codes, 1-9 Configuration rules, A-3 Configurations, expander cabinet, 5-34 Connections I/O hose, 2-14 Connections, I/O, 3-18 Control panel keyswitch, 4-1, 4-2 CPU comparisons, A-2 CPU module installing, 5-16 B CPU switch, A-13 Backplane removal and replacement system box, A-7 Block diagrams, 1-3 D C Cabinet 1, joining, 3-8 Cabinet 2 , join
I/O hose labels, 3-19 Installation AC input box, 5-32 PCI box, 5-2 power subrack, 5-18 power supplies, 5-29 system box, 5-12 Installing CPU module, 5-16 Installing Q-Vet, 4-16 J Joining cabinet 1, 3-8 Joining cabinet 2, 3-10 Joining cabinet 2 to cabinet 1, 3-12 Joining kits, 3-6 K Keyswitch, 4-1, 4-2 Keyswitch functions, 4-3 M Master clock module removal and replacement, A-9, A-11 Memory channel, 5-39 Mounting locations memory channel, 5-39 PCI box, 5-38 Starlight, 5-36 StorageWorks, 5-37 P PCI box cabl