'HOO 3RZHU(GJH &OXVWHU 3RZHU(GJH ,167$//$7,21 $1' 7528%/(6+227,1* *8,'( ® 0RGHO &6
'HOO 3RZHU(GJH &OXVWHU 3RZHU(GJH ,167$//$7,21 $1' 7528%/(6+227,1* *8,'( ®
_______________ Information in this document is subject to change without notice. 1997 Dell Computer Corporation. All rights reserved. Reproduction in any manner whatsoever without the written permission of Dell Computer Corporation is strictly forbidden.
Safety Instructions U se the following safety guidelines to help protect your computer system from potential damage and to ensure your own personal safety. See the Preface in this guide for information about the notational conventions used in this manual, including the distinction between warnings, cautions, and notes. Before You Begin Observe the following warnings while servicing this system: ADVARSEL: Dette system kan have mere end et strømforsyningskabel.
When Working Inside the WARNING Computer There is a danger of a new battery exploding if it is incorrectly installed. Replace the battery only with the same or equivalent type recommended by the manufacturer. Discard used batteries according to the manufacturer’s instructions. Before taking the covers off of the computer, perform the following steps in the sequence indicated: 1. Turn off the computer and any peripherals. 2. Disconnect the computer and peripherals from their power sources.
When Using the Computer • If your computer has a voltage selection switch on the power supply, be sure the switch is set to match the alternating current (AC) power available at your location: To help prevent electric shock, plug the computer and peripheral power cables into properly grounded power sources. These cables are equipped with three-prong plugs to ensure proper grounding. Do not use adapter plugs or remove the grounding prong from a cable.
viii
Preface About This Guide This guide provides information about installing, configuring, and troubleshooting the hardware and software components of the Dell PowerEdge Cluster. This document addresses the use of two PowerEdge 4200 server systems and one or two PowerEdge Scalable Disk System 100 (SDS 100) storage systems in the PowerEdge Cluster. Dell plans future clustering products that will incorporate other products in the Dell server family.
• Appendix G, “Warranties and Return Policy,” describes the warranty information pertaining to the system. Other Documentation You May Need Expandable RAID Controller User’s Guide, Dell PowerEdge Expandable RAID Controller Client User’s Guide, Dell PowerEdge Expandable RAID Controller General Alert Server User’s Guide, and Dell PowerEdge Expandable RAID Controller Battery Backup Module User’s Guide.
CAUTION: A CAUTION indicates either potential damage to hardware or loss of data and tells you how to avoid the problem. • Examples: autoexec.bat and c:\windows • NOTE: A NOTE indicates important information that helps you make better use of the computer system.
xii
Contents Chapter 1 Getting Started . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-1 PowerEdge Cluster Components. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-1 Minimum System Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-2 Basic Installation Procedure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Chapter 3 Configuring the Cluster Software . . . . . . . . . . . . . . . . . . . . . . . . . 3-1 Low-Level Software Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Important System Warning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SCSI Host Adapter IDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Disabling a RAID Controller BIOS . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Chapter 4 Running Applications on a Cluster . . . . . . . . . . . . . . . . . . . . . . . . 4-1 Setting Up Applications Software to Run on the Cluster . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-1 Internet Information Server Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-1 File Share Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-2 Print Spooler Service . . . . . . . . . . .
Appendix E Regulatory Compliance. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . E-1 Regulatory Standards . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . CE Notice . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Safety Standard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . EMC Standards . . . . . . . . . . . . . . . . .
Figure B-4. Figure D-1. Attaching the Rack-Mounting Hardware on the Network Switch . . .B-6 PowerEdge Cluster Configuration Matrix . . . . . . . . . . . . . . . . . . . . .D-2 Table Table 5-1. Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
xviii
Chapter 1 Getting Started T he Dell PowerEdge Cluster is an enterprise system that implements clustering technology based on the ® ® Microsoft® Windows NT ® Server, Enterprise Edition 4.0 operating system and Microsoft Windows NT Cluster Server.
3Com SuperStack II Switch 3000 TX PowerEdge 4200 systems (2) PowerEdge SDS 100 storage systems (1 or 2) with RAID Figure 1-1. PowerEdge Cluster Layout Minimum System Requirements — Two 4-GB internal SCSI hard-disk drives (three drives are required for an internal RAID 5 configuration). NOTE: If you are upgrading an existing system to a PowerEdge Cluster, check this list to ensure that your upgrade meets these requirements. — Two Ethernet NICs, installed in PCI slots 4 and 8.
— At least three SCSI hard-disk drives in each SDS 100 storage system to support RAID 5 functionality. Microsoft Cluster Server currently supports only the Microsoft Windows NT file system (NTFS) format for the shared storage subsystem. — Two 4-meter (m) SCSI cables for each SDS 100 storage system in the cluster.
8. Configure the public and private NIC interconnects in each node and place the interconnects on separate IP subnetworks. 9. If not already done, install and/or configure the Microsoft Cluster Server software on each cluster node. 10. Check out the functionality of the fully installed cluster. 11. Install and set up applications. The following sections briefly describe each of these steps.
RJ45 Ethernet connector node-to-node interconnected NIC second cluster-specific RAID controller (not shown) standard RAID controller (optional) cluster-specific RAID controller (required) RAID channel 0 RAID channel 1 LAN-connected NIC Figure 1-2. Back View of a PowerEdge 4200 Cluster Node Setting Up the Cluster Hardware Cabling the Cluster Hardware The PowerEdge Cluster can be set up in either a freestanding configuration or installed in a Dell Rack-Mountable Solutions enclosure.
Setting Up the Shared Storage Subsystem Hard-Disk Drives If your Power-Edge Cluster consists of all new components, the hard-disk drives in the shared storage subsystem may already be partitioned, formatted, and set up in a RAID configuration for clustering. If you are upgrading a shared storage subsystem in an existing system, the shared hard-disk drives must be set up for clustering as part of the upgrade. The first step is to configure the RAID level that you will be using in your cluster.
Chapter 2 Cabling the Cluster Hardware T he Dell PowerEdge Cluster must be installed and cabled correctly to ensure that the cluster functions properly. This chapter instructs you on how to cable your system hardware for a cluster configuration. Information about configuring your PowerEdge Cluster is provided in Chapter 3, “Configuring the Cluster Software.
ultra-high density connector Ultra/Wide SCSI connections from channel 0 on each cluster-enabled RAID controller 68-pin connectors (2) PowerEdge SDS 100 storage system Figure 2-1. Cabling a Clustered System With One PowerEdge SDS 100 Storage System 1. Connect the 68-pin connector on the 4-m SCSI cable to SCSI connector A on the back of the SDS 100 storage system, and tighten the retaining screws. 3.
Two SDS 100 Storage Systems Cabled to a Single RAID Controller Connecting the cluster to two SDS 100 storage systems is similar to connecting to a single SDS 100 storage system. Ultra/Wide SCSI connections from channel 1 on each RAID controller First, connect the channel 0 connector of each PowerEdge Expandable RAID Controller to the back of the first storage system, as described in the preceding section.
Two SDS 100 Storage Systems Cabled to Dual RAID Controllers To cable cluster nodes with dual RAID controllers to two SDS 100 storage systems, connect the channel 0 connector of each RAID controller of the primary node (or the first node) to the “A” connectors on the back of each storage system, and connect the channel 0 connectors of the secondary node’s RAID controllers to the “B” connectors on each storage system (see Figure 2-3).
SMB Cabling The SMB connector enables a host PowerEdge system to provide system-level management of the storage system(s). chain connects to the SMB connector on the PowerEdge system’s back panel. The second storage system connects the SMB cable from its connector labeled “IN” to the connector labeled “OUT” on the first storage system’s back panel. NOTE: The SDS 100 storage system is connected to only one of the two PowerEdge systems in the cluster.
node-to-node (private) network connection LAN connections to client systems Figure 2-6.
Power Cabling Observe the following warnings when connecting the power cables to your PowerEdge Cluster system: WARNING: Although each component of the PowerEdge Cluster meets leakage current safety requirements, the total leakage current may exceed the maximum that is permitted when the components are used together. To meet safety requirements in the Americas, you must use a Type B plug and socket connection for the cluster power to enable the appropriate level of ground protection.
redundant power supplies on one AC power strip (or on one AC power distribution unit [not shown]) primary power supplies on one AC power strip (or on one AC power distribution unit [not shown]) Figure 2-7.
Chapter 3 Configuring the Cluster Software T his chapter provides information about configuring the Dell PowerEdge Cluster system software. This guide does not provide instructions for installing the operating system or the cluster software. Installation instructions for the operating system are documented in the Microsoft Windows NT Server Enterprise Edition Administrator’s Guide and Release Notes.
This warning alerts you to the possibility of data loss if certain precautions are not taken to protect the integrity of the data on your cluster.
High-Level Software Configuration When the SCSI drives and RAID levels have been set up, Windows NT Server Enterprise Edition can be installed and configured. A number of operating system configurations must be set during the installation to enable clustering. These configuration requirements are described in the Microsoft Windows NT Server Enterprise Edition Administrator’s Guide and Release Notes. The following subsections briefly discuss these configurations.
When a packet gets sent across the network from a local client, the source and destination IP addresses of the packet are inserted in the IP header. The system checks whether the network ID of the destination address matches the network ID of the source address. If they match, the packet is sent directly to the destination computer on the local network. If the network IDs do not match, the packet is forwarded to the default gateway for delivery.
Updating the NIC Driver Dell recommends that you use Windows NT NIC driver version 2.22 or later for the Intel Pro100B network controller. Perform the following procedure on both cluster nodes to update the NIC driver: 1. Go to the Control Panel, double-click the Network icon, and click on the Adapters tab. 2. Highlight one of the adapters and click Update. 3. In the dialog box, type A:. Place the diskette containing the updated Intel Pro100B driver into drive A and press .
SCSI Controller IDs The SDS 100 storage system of the cluster has two RAID controllers connected to the same channel. In this setup, each controller must be assigned a unique SCSI ID number. The cluster-specific firmware running on the two RAID controllers enables two controllers to reside on the same SCSI channel and operate with unique SCSI ID numbers.
Cluster Service The Cluster Service performs most of the cluster functionality, including membership management, communication management, and fail-over management. When the Cluster Server has been properly installed, the Cluster Service is started on each node and is activated automatically in the event that one of the nodes fails or goes off-line. To verify that the Cluster Service is running on a cluster node, click the Start button, point to Settings, and then click Control Panel.
Setting Up the Quorum Resource A quorum resource is typically a hard-disk drive in the shared storage subsystem that serves the following two purposes in a cluster system: • Acts as an arbiter between the two nodes to ensure that the specific data necessary for system recovery is maintained consistently across the nodes • Logs the recovery data sent by the cluster nodes Only one cluster node can control the quorum resource at one time, and it is that node that remains running when the two nodes are una
Rebuild Operation in RAID Console The following conditions apply to the way PowerEdge RAID Console handles rebuilds of hard-disk drives in a cluster environment: • When you rebuild a failed drive, RAID Console shows the status of the drive as Rebuild but may not display the Rebuild Progress window during the rebuild process. You can verify that the rebuild is in operation by observing the activity indicator on the front panel of the SDS 100 storage system.
3-10 Dell PowerEdge Cluster (PowerEdge 4200) Installation and Troubleshooting Guide
Chapter 4 Running Applications on a Cluster T his section provides general information about configuring and running applications software on the PowerEdge Cluster. To configure applications software, click the Start button, point to Programs, point to Administrative Tools (Common), and then click Cluster Administrator. In Cluster Administrator, open a connection to the cluster.
3. Use the New Resource wizard to create a disk resource. To start the New Resource wizard, right-click any group or resource, point to New, and then select Resource from the submenu. You can also move an existing disk resource from other groups by right-clicking the disk, pointing to Change Group, and then selecting Web Service. 4. In the dialog box, type Web Disk for the new disk resource name. 5. Set the Resource Type in the dialog box as Physical Disk.
9. Set the Resource Type as File Share. Select both nodes as possible owners. Set File Share Disk, File Share IP, and File Share NetName as the dependencies for XYZ Files. Then type the share name and share path in the Parameters tab. For example, you can configure y:\groupfiles as share name xyzfiles. 5. There is no dependency for IP addresses. 6. Use the New Resource wizard to create a Network Name resource called “Spool NetName.” Set the Resource Type as Network Name.
j. Click Cancel to close the Add Printer wizard. NOTE: Do not add the printer at this point. Identical printer ports must be set up on both nodes before the printer can be added. k. Repeat steps a through j on the other node. At step g, if the system cannot find the printer, you may need to update the HP JetAdmin's printer directory to include the printer's IP address. 11. Add the printers to the clustered spooler. a. On the first cluster node, click the Start button and click Run. b.
Running chkdsk /f on a Quorum Tape Backup for Clustered Disk Systems The chkdsk command with the /f (“fix”) option cannot be run on a device on which an open file handle is active. The Cluster Service maintains an open handle on the quorum resource; therefore, chkdsk /f cannot be run on the hard-disk drive that contains the quorum resource.
4-6 Dell PowerEdge Cluster (PowerEdge 4200) Installation and Troubleshooting Guide
Chapter 5 Troubleshooting T his chapter provides general troubleshooting information for the Dell PowerEdge Cluster. For troubleshooting information that is specific to the Windows NT Server Enterprise Edition operating system and the cluster software, refer to the Microsoft Windows NT Cluster Server Administrator’s Guide. Table 5-1.
Table 5-1. Troubleshooting (continued) Problem Probable Cause Corrective Action The redundant array of inexpensive disks (RAID) drives in the SDS 100 storage system are not accessible by one of the cluster nodes, or the shared storage subsystem is not functioning properly with the cluster software. The SCSI cables are loose or defective, or the cables exceed the maximum allowable length of 4 meters (m). Check the cable connections or replace the cable with a working cable.
Table 5-1. Troubleshooting (continued) Problem Probable Cause Corrective Action One or more of the SCSI controllers are not detected by the system. The controllers have conflicting SCSI IDs. Change one of the controller SCSI IDs so that the ID numbers do not conflict. The controller in the primary node should be set to SCSI ID 7, and the controller in the secondary node should be set to SCSI ID 10. Refer to Chapter 3 for instructions for setting the SCSI IDs on the nodes.
Table 5-1. Troubleshooting (continued) Problem Probable Cause Corrective Action The dialogue box Snmp.exe Entry Point Not Found appears during system start-up. The Windows NT system errantly reports this condition if the Simple Network Management Protocol (SNMP) service was installed after Windows NT and the Service Pack was installed. Reapply the Service Pack that came with Windows NT Enterprise Edition. Attempts to connect to a cluster using Cluster Administrator fail.
Appendix A Upgrading to a Cluster Configuration T his appendix provides instructions for upgrading your noncluster system to a PowerEdge Cluster if components of the cluster hardware are already present. To properly upgrade your system to a PowerEdge Cluster, you must ensure that your existing hardware components meet the minimum configuration required for clustering and acquire the additional hardware and software clustering components as needed.
You may choose to install a standard PowerEdge Expandable RAID Controller as the second RAID controller in your system instead of a cluster-enabled RAID controller. This is the configuration you will use if you plan to set up the internal hard-disk drives in the cluster node in a RAID array. In this configuration, install the standard RAID controller in PCI slot 6. Because this standard RAID controller will handle the system partition on the cluster node, do not disable this controller’s BIOS.
Installing and Configuring the Cluster Software Instructions on installing the Microsoft Windows NT Server, Enterprise Edition 4.0 operating system and clustering software are provided in the Microsoft documentation that accompanied the software. Refer to these documents for information about installing these software components. Before installing Windows NT Server Enterprise Edition, be sure to have the NIC and PowerEdge Expandable RAID Controller driver diskettes handy for installation.
NICs installed in the same node must reside on separate subnetworks. Therefore, the second NIC added to a cluster node must have a different network Internet Protocol (IP) address than the first NIC on the same node. 6. For example, if the first NIC in the node had an address of 143.166.110.2 with a subnet mask of 255.255.255.0, you may enter the following IP address and subnet mask for the second NIC: The procedure for adding and setting up a NIC in a cluster node is provided below.
Appendix B Stand-Alone and Rack Configurations T he Dell PowerEdge Cluster can be set up in a floorstanding (stand-alone) configuration or can be mounted in a Dell Rack-Mountable Solutions enclosure. Certain rules and parameters must be followed in either case to ensure that the PowerEdge Cluster is properly configured and meets safety specifications. Dell supports only PowerEdge Cluster systems that are configured according to the instructions in this appendix.
Supported Stand-Alone Kit Installation Restrictions Configurations Figures B-1 and B-2 show the stand-alone configurations of the PowerEdge Cluster that Dell supports. These configurations are specified to provide a safe operating environment for the cluster components. As evident in the figures, two general rules govern the stand-alone configurations: • The heaviest cluster component must be at the bottom of the stack and the lightest component at the top.
PowerEdge SDS 100 storage system network switch Configuration 1 SDS 100 storage system network switch Configuration 2 Figure B-1.
PowerEdge SDS 100 storage systems (2) Configuration 1 network switch optional placement for the network switch Configuration 2 Figure B-2.
Supported Rack Configuration Dell supports one configuration of the Dell PowerEdge Cluster mounted in a Dell rack.
Rack-Mounting the Network Switch For the 3Com Superstack II Switch 3000 TX to be accessible to the network interface controller (NIC) connectors on each cluster node, the switch must be placed behind the keyboard tray with the front of the switch facing toward the back of the rack. screws (3) Use the following procedure to install the network switch in the rack. CAUTION: Do not connect cables to the network switch prior to installing the switch in the rack. 1.
Appendix C Cluster Data Sheet T he data sheet on the following page is provided for the system installer to tear out and use to record pertinent information about the Dell PowerEdge Cluster. Have this form available when calling Dell Technical Assistance.
C-2 Dell PowerEdge Cluster (PowerEdge 4200) Installation and Troubleshooting Guide
Dell ® PowerEdge® Cluster Installer Data Card and Checklist Instructions: Before installing the Microsoft® Windows NT® Enterprise Edition operating system with clustering, use this checklist to gather information and ensure the preparation required for a successful installation. Ensure that all equipment is present and properly cabled and that you know how to install Windows NT Server Enterprise Edition.
❑ TCP/IP address for each NIC: Node 1, NIC 1 __________________ NIC 2 ___________________ Node 2, NIC 1 __________________ NIC 2 ___________________ ❑ The subnet masks for NIC 1 and NIC 2 are different. Subnet masks for the NIC 1s should match. Subnet masks for the NIC 2s should match. Node 1, NIC 1 __________________ NIC 2 ___________________ Node 2, NIC 1 __________________ NIC 2 ___________________ ❑ Domain name: ____________________________ ❑ Gopher service is not enabled for IIS.
Appendix D PowerEdge Cluster Configuration Matrix T he Cluster Configuration Matrix form, which is shown on the following page, is attached to the back of each cluster node and is used by the system installer to record important information about the hardware on each cluster component. Keep these completed forms attached to their respective cluster components. Have these forms handy any time you call Dell for technical support.
Dell Computer Corporation Date:________________________ PowerEdge Cluster Configuration Matrix Unique Cluster ID: _________________________________ System PE 4200 PE 4200 Service Tag # Node Number Node 1 Node 2 RAID Controller IDD 7 10 SDS 100 SDS 100 SDS 100 SDS 100 Slot # 1 PCI/EISA Slot # EISA slot 1 2 3 4 EISA slot 2 EISA slot 3 PCI slot 4 (Secondary bus) PCI slot 5 (Secondary bus) 5 Adapter Usage Attachment Instruction Private NIC Private Network Second Cluster PERC (if applicable) S
Appendix E Regulatory Compliance Regulatory Standards Dell PowerEdge Cluster has been tested and certified to the following standards: • • • • • • EMC Standards • EN 55022 — “Limits and Methods of Measurement of Radio Interference Characteristics of Information Technology Equipment.” IEC950:1991 + A1:1992 + A2:1993 + A3:1995 NOTE: EN 55022 emissions requirements provide for two classifications—Class A and Class B.
E-2 Dell PowerEdge Cluster (PowerEdge 4200) Installation and Troubleshooting Guide
Appendix F Safety Information for Technicians B efore you perform any procedures on the PowerEdge Cluster equipment, read the following warnings for your personal safety and to prevent damage to the system from electrostatic discharge (ESD). Refer to the appropriate system documentation before servicing any system. WARNING: The components of this cluster system may have more than one power supply cable.
F-2 Dell PowerEdge Cluster (PowerEdge 4200) Installation and Troubleshooting Guide
Appendix G Warranties and Return Policy Limited Three-Year Warranty (U.S. and Canada Only) Dell Computer Corporation (“Dell”) manufactures its hardware products from parts and components that are new or equivalent to new in accordance with industrystandard practices. Dell warrants that the hardware products it manufactures will be free from defects in materials and workmanship. The warranty term is three years beginning on the date of invoice, as described in the following text.
Coverage During Years Two and Three During the second and third years of this limited warranty, Dell will provide, on an exchange basis and subject to Dell’s Exchange Policy in effect on the date of the exchange, replacement parts for the Dell hardware product(s) covered under this limited warranty when a part requires replacement.
risk of loss or damage during shipment. You may return software for refund or credit only if the sealed package containing the diskette(s) or CD(s) is unopened. Returned products must be in as-new condition, and all of the manuals, diskette(s), CD(s), power cables, and other items included with a product must be returned with it. This “Total Satisfaction” Return Policy does not apply to DellWare products, which may be returned under DellWare’s then-current return policy.
G-4 Dell PowerEdge Cluster (PowerEdge 4200) Installation and Troubleshooting Guide
Index A Apex switch cabling, 2-7 applications setting up to run on a cluster, 4-1 audience level, ix B basic input/output system.
E M electrostatic discharge. See ESD maximize feature in RAID Console, 3-8 ESD about, vi preventing, vi, F-1 Microsoft Cluster Server uninstalling, 3-7 expansion cards placement on PCI bus, 1-4, A-1 mouse cabling, 2-7 monitor cabling, 2-7 N F File Share service, 4-2 ftdisk driver, 3-8 network configuring separate networks, 3-3 network communications verifying, 3-6 network interface controller.
PowerEdge Cluster checking the functionality, 3-5 components, 1-1 getting started, 1-1 installation overview, 1-3 layout, 1-2 minimum system requirements, 1-2 rebuild incomplete, 3-8 operation in RAID Console, 3-9 rate, 3-8 PowerEdge RAID Console rebuild operation, 3-9 using the maximize feature, 3-8 return policy, G-2 PowerEdge Scalable Disk System 100.
T V tape backup for clustered systems, 4-5 verifying 1 x 8 mode on shared storage subsystem, 3-5 cluster domain, 3-6 cluster resource availability, 3-7 cluster service operation, 3-7 network communications, 3-6 RAID controller driver, 3-6 SCSI controller IDs, 3-6 shared storage subsystem drive letters, 3-6 troubleshooting cluster mode failure, 5-2 connecting to a cluster, 5-4 network communications, 5-3 SCSI controllers, 5-3 shared storage subsystem, 5-1, 5-2, 5-3 SNMP service, 5-4 system management bus
® www.dell.com Printed in the U.S.A.
