HARDWARE GUIDE MegaRAID® SCSI 320-1 RAID Controller September 2002 ®
This document contains proprietary information of LSI Logic Corporation. The information contained herein is not to be used by or disclosed to third parties without the express written permission of an officer of LSI Logic Corporation. LSI Logic products are not intended for use in life-support appliances, devices, or systems. Use of any LSI Logic product in such applications without written consent of the appropriate LSI Logic officer is prohibited.
FCC Regulatory Statement This device complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions: (1) this device may not cause harmful interference, and (2) this device must accept any interference received, including interference that may cause undesired operation. Warning: Changes or modifications to this unit not expressly approved by the party responsible for compliance could void the user's authority to operate the equipment.
iv Copyright © 2002 by LSI Logic Corporation. All rights reserved.
Preface This book is the primary reference and Hardware Guide for the LSI Logic MegaRAID® SCSI 320-1 Controller. It contains instructions for installing the MegaRAID controller and for configuring RAID arrays. It also contains background information on RAID. The MegaRAID SCSI 320-1 controller supports single-ended and lowvoltage differential (LVD) SCSI devices on an Ultra320 and Wide SCSI channel with data transfer rates up to 320 Mbytes/s.
· Chapter 6, Hardware Installation, explains how to install the MegaRAID SCSI 320-1 controller. · Chapter 7, Troubleshooting, provides troubleshooting information for the MegaRAID SCSI 320-1 controller. · Appendix A, SCSI Cables and Connectors, describes the SCSI cables and connectors used with the MegaRAID SCSI 320-1 controller. · Appendix B, Audible Warnings, explains the meaning of the warning tones generated by the MegaRAID SCSI 320-1 controller.
MegaRAID Problem Report Form (Cont.) Operating System: BIOS Date: Op. Sys. Ver.: Video Adapter: MegaRAID Driver Ver.: CPU Type/Speed: Network Card: System Memory: Other disk controllers installed: Other adapter cards Installed: Description of problem: Steps necessary to re-create problem: 1. 2. 3. 4. Logical Drive Configuration Use this form to record the configuration details for your logical drives.
Logical Drive Configuration (Cont.) Logical Drive RAID Level Stripe Size Logical Drive Size Cache Policy Read Policy LD7 LD8 LD9 LD10 LD11 LD12 LD13 LD14 LD15 LD16 LD17 LD18 LD19 LD20 LD21 LD22 LD23 LD24 LD25 LD26 LD27 LD28 LD29 LD30 LD31 viii Preface Copyright © 2002 by LSI Logic Corporation. All rights reserved.
Logical Drive Configuration (Cont.) Logical Drive RAID Level Stripe Size Logical Drive Size Cache Policy Read Policy Write Policy # of Physical Drives LD32 LD33 LD34 LD35 LD36 LD37 LD38 LD39 Physical Device Layout Use this form to record the physical device layout.
Physical Device Layout (Cont.
Physical Device Layout (Cont.
Physical Device Layout (Cont.) Channel 0 Device type Logical drive number/Drive number Manufacturer/Model number Firmware level Target ID Device type Logical drive number/Drive number Manufacturer/Model number Firmware level Target ID Device type Logical drive number/Drive number Manufacturer/Model number Firmware level xii Preface Copyright © 2002 by LSI Logic Corporation. All rights reserved.
Contents Chapter 1 Overview 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 Chapter 2 Introduction to RAID 2.1 2.2 2.3 Features SCSI Channel NVRAM and Flash ROM SCSI Connectors Single-Ended and Differential SCSI Buses Maximum Cable Length for SCSI Standards SCSI Bus Widths and Maximum Throughput Documentation 1.8.1 MegaRAID SCSI 320-1 Hardware Guide 1.8.2 MegaRAID Configuration Software Guide 1.8.3 MegaRAID Operating System Driver Installation Guide 1-2 1-2 1-2 1-2 1-3 1-3 1-4 1-4 1-4 1-4 RAID Benefits 2.1.
2.3.6 2.3.7 2.3.8 2.3.9 2.3.10 2.3.11 2.3.12 2.3.13 2.3.14 2.3.15 Disk Mirroring Disk Spanning Parity Hot Spares Hot Swapping Disk Rebuild Logical Drive States SCSI Drive States Disk Array Types Enclosure Management 2-6 2-7 2-8 2-8 2-9 2-9 2-10 2-10 2-11 2-11 Chapter 3 RAID Levels 3.1 3.2 3.3 3.4 3.5 3.6 Selecting a RAID Level RAID 0 RAID 1 RAID 5 RAID 10 RAID 50 3-1 3-2 3-3 3-4 3-6 3-7 4.1 4.2 4.3 4.4 4.5 4.6 4.7 4.8 4.
4.10 4.11 4.9.7 SCSI Termination 4.9.8 SCSI Firmware RAID Management 4.10.1 MegaRAID BIOS Configuration Utility 4.10.2 WebBIOS Configuration Utility 4.10.3 Power Console Plus 4.10.4 MegaRAID Manager Compatibility 4.11.1 Server Management 4.11.2 SCSI Device Compatibility 4.11.3 Software Chapter 5 Configuring Physical Drives, Arrays, and Logical Drives 5.1 Configuring SCSI Physical Drives 5.1.1 Basic Configuration Rules 5.1.2 Current Physical Device Configuration 5.1.3 Logical Drive Configuration 5.1.
6.2.4 6.2.5 6.2.6 6.2.7 6.2.8 6.2.9 6.3 Step 4: Set Termination Step 5: Install MegaRAID SCSI 320-1 Step 6: Connect SCSI Devices Step 7: Set Target IDs Step 8: Power Up Step 9: Run the MegaRAID BIOS Configuration Utility 6.2.10 Step 10: Install the Operating System Driver Summary 7.1 7.2 7.3 7.4 General Troubleshooting BIOS Boot Error Messages Other BIOS Error Messages Other Potential Problems 6-6 6-12 6-13 6-14 6-16 6-17 6-17 6-18 Chapter 7 Troubleshooting Appendix A SCSI Cables and Connectors A.
Index Customer Feedback Contents Copyright © 2002 by LSI Logic Corporation. All rights reserved.
xviii Contents Copyright © 2002 by LSI Logic Corporation. All rights reserved.
Chapter 1 Overview This chapter provides an overview of the MegaRAID® SCSI 320-1 and basic SCSI features. It contains the following sections: · Section 1.1, “Features” · Section 1.2, “SCSI Channel” · Section 1.3, “NVRAM and Flash ROM” · Section 1.4, “SCSI Connectors” · Section 1.5, “Single-Ended and Differential SCSI Buses” · Section 1.6, “Maximum Cable Length for SCSI Standards” · Section 1.7, “SCSI Bus Widths and Maximum Throughput” · Section 1.
1.1 Features MegaRAID SCSI 320-1 features include: 1.
1.5 Single-Ended and Differential SCSI Buses The SCSI standard defines two electrical buses: 1.6 · Single-ended bus · Low-voltage differential bus Maximum Cable Length for SCSI Standards Table 1.1 lists the maximum SCSI cable length and number of disk drives that you can use, depending on the SCSI speeds and type of device. Table 1.1 Maximum Cable Length for SCSI Standards Standard Single Ended SCSI Low-Voltage Differential SCSI Maximum # of Drives Ultra SCSI 1.
1.7 SCSI Bus Widths and Maximum Throughput Table 1.2 lists the SCSI bus widths and maximum throughput, based on the SCSI speeds. Table 1.2 1.8 SCSI Bus Widths and Maximum Throughput SCSI Standard SCSI Bus Width SCSI Throughput Fast Wide SCSI 16 bits 20 Mbytes/s Wide Ultra SCSI 16 bits 40 Mbytes/s Wide Ultra 2 SCSI 16 bits 80 Mbytes/s Wide Ultra 160 SCSI 16 bits 160 Mbytes/s Ultra 320 SCSI 16 bits 320 Mbytes/s Documentation The MegaRAID SCSI 320-1 documentation set includes: 1.8.
1.8.3 MegaRAID Operating System Driver Installation Guide This manual provides detailed information about installing the MegaRAID SCSI 320-1 operating system drivers. Documentation Copyright © 2002 by LSI Logic Corporation. All rights reserved.
1-6 Overview Copyright © 2002 by LSI Logic Corporation. All rights reserved.
Chapter 2 Introduction to RAID This chapter introduces important RAID concepts. It contains the following sections: · Section 2.1, “RAID Benefits” · Section 2.2, “MegaRAID SCSI 320-1 – Host-Based RAID Solution” · Section 2.3, “RAID Overview” RAID (Redundant Array of Independent Disks) is a data storage method in which data, along with parity information, is distributed among two or more hard disks (called an array) to improve performance and reliability.
2.1.2 Increased Reliability The electromechanical components of a disk subsystem operate more slowly, require more power, and generate more noise and vibration than electronic devices. These factors reduce the reliability of data stored on disks. RAID provides a way to achieve much better fault tolerance and data reliability. 2.2 MegaRAID SCSI 320-1 – Host-Based RAID Solution RAID products are either host-based or external. The MegaRAID SCSI 320-1 controller is a host-based RAID solution.
2.2.2 SCSI-to-SCSI External RAID A SCSI-to-SCSI external RAID product puts the RAID intelligence inside the RAID chassis and uses a plain SCSI host adapter installed in the network server. The data transfer rate is limited to the bandwidth of the SCSI channel. A SCSI-to-SCSI external RAID product that has two Wide SCSI channels operating at speeds up to 320 Mbytes/s must squeeze the data into a single Wide SCSI (320 Mbytes/s) channel back to the host computer.
· 2.3.3 A combination of any two of the above conditions Consistency Check A consistency check verifies the correctness of redundant data in a RAID array. For example, in a system with distributed parity, checking consistency means computing the parity of the data drives and comparing the results to the contents of the parity drives. 2.3.4 Fault Tolerance Fault tolerance is achieved through cooling fans, power supplies, and the ability to hot swap drives.
Figure 2.1 Disk Striping MegaRAID Controller Segment 1 Segment 5 Segment 9 Segment 2 Segment 6 Segment 10 Segment 3 Segment 7 Segment 11 Segment 4 Segment 8 Segment 12 Disk striping involves partitioning each disk drive’s storage space into stripes that can vary in size from 2 to 128 Kbytes. These stripes are interleaved in a repeated, sequential manner. The combined storage space is composed of stripes from each drive. MegaRAID SCSI 320-1 supports stripe sizes of 2, 4, 8, 16, 32, 64, or 128 Kbytes.
2.3.5.2 Stripe Size The stripe size is the length of the interleaved data segments that MegaRAID SCSI 320-1 writes across multiple drives. MegaRAID SCSI 320-1 supports stripe sizes of 2, 4, 8, 16, 32, 64, or 128 Kbytes. 2.3.6 Disk Mirroring With disk mirroring (used in RAID 1), data written to one disk drive is simultaneously written to another disk drive, as shown in Figure 2.2. Figure 2.
2.3.7 Disk Spanning Disk spanning allows multiple disk drives to function like one big drive. Spanning overcomes lack of disk space and simplifies storage management by combining existing resources or adding relatively inexpensive resources. For example, four 60 Gbyte disk drives can be combined to appear to the operating system as one single 240 Gbyte drive. Disk spanning alone does not provide reliability or performance enhancements.
Table 2.1 describes how disk spanning is used for RAID 10 and RAID 50. Table 2.1 Spanning for RAID 10 and RAID 50 Level Description 10 Configure RAID 10 by spanning two contiguous RAID 1 logical drives. The RAID 1 logical drives must have the same stripe size. 50 Configure RAID 50 by spanning two contiguous RAID 5 logical drives. The RAID 5 logical drives must have the same stripe size. Note: 2.3.
has a capacity closest to and at least as great as that of the failed drive to take the place of the failed drive. Note: Hot spares are employed only in arrays with redundancy— for example, RAID levels 1, 5, 10, and 50. A hot spare connected to a specific MegaRAID SCSI 320-1 controller can be used only to rebuild a drive that is connected to the same controller. 2.3.10 Hot Swapping Hot swapping is the manual replacement of a defective physical disk unit while the computer is still running.
The MegaRAID SCSI 320-1 rebuild rate can be configured between 0% and 100%. At 0%, the rebuild is only done if the system is not doing anything else. At 100%, the rebuild has a higher priority than any other system activity. 2.3.12 Logical Drive States Table 2.2 describes the logical drive states. Table 2.2 Logical Drive States State Description Optimal The drive operating condition is good. All configured drives are online. Degraded The drive operating condition is not optimal.
2.3.14 Disk Array Types Table 2.4 describes the RAID disk array types. Table 2.4 Disk Array Types Type Description SoftwareBased The array is managed by software running in a host computer using the host CPU bandwidth. The disadvantages associated with this method are the load on the host CPU and the need for different software for each operating system. SCSI to SCSI The array controller resides outside of the host computer and communicates with the host through a SCSI adapter in the host.
2-12 Introduction to RAID Copyright © 2002 by LSI Logic Corporation. All rights reserved.
Chapter 3 RAID Levels This chapter describes each supported RAID level and the factors to consider when choosing a RAID level. It contains the following sections: 3.1 · Section 3.1, “Selecting a RAID Level” · Section 3.2, “RAID 0” · Section 3.3, “RAID 1” · Section 3.4, “RAID 5” · Section 3.5, “RAID 10” · Section 3.6, “RAID 50” Selecting a RAID Level To ensure the best performance, you should select the optimal RAID level when you create a system drive.
3.2 RAID 0 RAID 0 provides disk striping across all drives in the RAID subsystem. RAID 0 does not provide any data redundancy, but does offer the best performance of any RAID level. RAID 0 breaks up data into smaller blocks and then writes a block to each drive in the array. The size of each block is determined by the stripe size parameter, set during the creation of the RAID set. RAID 0 offers high bandwidth.
Figure 3.1 RAID 0 Array MegaRAID Controller Segment 1 Segment 5 Segment 9 3.3 Segment 2 Segment 6 Segment 10 Segment 3 Segment 7 Segment 11 Segment 4 Segment 8 Segment 12 RAID 1 In RAID 1, the MegaRAID SCSI 320-1 duplicates all data from one drive to a second drive. RAID 1 provides complete data redundancy, but at the cost of doubling the required data storage capacity. Uses Use RAID 1 for small databases or any other environment that requires fault tolerance but small capacity.
Figure 3.2 RAID 1 Array MegaRAID Controller Segment 1 Segment 2 Segment 3 Segment 4 3.4 Segment 1 Duplicated Segment 2 Duplicated Segment 3 Duplicated Segment 4 Duplicated RAID 5 RAID 5 includes disk striping at the byte level and parity. In RAID 5, the parity information is written to several drives. RAID 5 is best suited for networks that perform many small I/O transactions simultaneously. RAID 5 addresses the bottleneck issue for random I/O operations.
exclusive-or assist make RAID 5 performance exceptional in many different environments. Uses Provides high data throughput, especially for large files. Use RAID 5 for transaction processing applications, because each drive can read and write independently. If a drive fails, the MegaRAID SCSI 320-1 uses the parity drive to recreate all missing information. Use also for office automation and online customer service that requires fault tolerance.
3.5 RAID 10 RAID 10 is a combination of RAID 0 and RAID 1. RAID 10 has mirrored drives. RAID 10 breaks up data into smaller blocks, and then stripes the blocks of data to each RAID 1 RAID set. Each RAID 1 RAID set then duplicates its data to its other drive. The size of each block is determined by the stripe size parameter, which is set during the creation of the RAID set. RAID 10 can sustain one to four drive failures while maintaining data integrity, if each failed disk is in a different RAID 1 array.
Figure 3.4 RAID 10 Array MegaRAID Controller Data Flow RAID 1 Disk 1 Segment 1 Segment 3 Segment 5 RAID 1 Disk 2 Disk 3 Segment 2 Segment 4 Segment 6 Segment 1 Segment 3 Segment 5 Disk 4 Segment 2 Segment 4 Segment 6 RAID 0 3.6 RAID 50 RAID 50 provides the features of both RAID 0 and RAID 5, including both parity and disk striping across multiple drives. RAID 50 is best implemented on two RAID 5 disk arrays with data striped across both disk arrays.
RAID 50 can sustain one to four drive failures while maintaining data integrity, if each failed disk is in a different RAID 5 array. Uses Works best when used with data that requires high reliability, high request rates, high data transfer, and medium to large capacity. Strong Points Provides high data throughput, data redundancy, and very good performance. Weak Points Requires 2 to 4 times as many parity drives as RAID 5. Drives 6 to 15 The initiator takes one ID per channel.
Chapter 4 Features This chapter explains the features of the MegaRAID SCSI 320-1. It contains the following sections: · Section 4.1, “SMART Technology” · Section 4.2, “Configuration on Disk” · Section 4.3, “Configuration Features” · Section 4.4, “Array Performance Features” · Section 4.5, “RAID Management Features” · Section 4.6, “Fault Tolerance Features” · Section 4.7, “Software Utilities” · Section 4.8, “Operating System Software Drivers” · Section 4.
4.2 Configuration on Disk Configuration on Disk (drive roaming) saves configuration information both in nonvolatile random access memory (NVRAM) on the MegaRAID SCSI 320-1, and on the disk drives controlled by the MegaRAID SCSI 320-1. If the MegaRAID SCSI 320-1 is replaced, the new MegaRAID SCSI 320-1 controller can detect the actual RAID configuration, maintaining the integrity of the data on each drive, even if the drives have changed channel and/or target ID. 4.3 Configuration Features Table 4.
Table 4.1 Configuration Features (Cont.) Specification Feature Flashable firmware Yes Hot swap devices supported Yes Non-disk devices supported Yes Mixed capacity hard disk drives Yes Number of 16-bit internal connectors 1 Number of 16-bit external connectors 1 Support for hard disk drives with capacities of more than 8 Gbytes.
4.5 RAID Management Features Table 4.3 lists the RAID management features. Table 4.3 4.6 RAID Management Features Specification Feature Support for SNMP Yes Performance Monitor provided Yes Remote control and monitoring Yes Event broadcast and event alert Yes Hardware connector RS232C Drive roaming Yes Support for concurrent multiple stripe sizes Yes Windows NT, 2000, XP, and .NET server support using a GUI client utility Yes Fault Tolerance Features Table 4.
4.7 Software Utilities Table 4.5 lists the software utility features. Table 4.5 4.8 Software Utilities Specification Feature Graphical user interface Yes Management utility Yes Bootup configuration using MegaRAID Manager Yes Online read, write, and cache policy switching Yes Operating System Software Drivers MegaRAID SCSI 320-1 includes a DOS software configuration utility, and drivers for: · Windows NT 4.0 · Windows 2000 · Windows .NET · Windows XP · Novell NetWare 5.1, 6.
4.9 MegaRAID SCSI 320-1 Specifications Table 4.6 lists the specifications for the SCSI 320-1. Table 4.6 MegaRAID SCSI 320-1 Specifications Parameter Specification Card size Low profile PCI Adapter card size (6.875" X 2.5") Processor Intel GC80302 64-bit RISC processor at 100 MHz Bus type PCI 2.
Table 4.6 4.9.1 MegaRAID SCSI 320-1 Specifications (Cont.) Parameter Specification SCSI connectors One 68-pin internal high-density connector for 16-bit SCSI devices. One very-high density 68-pin external connector for Ultra and Wide SCSI. Serial port 3-pin RS232C-compatible berg PCI Bridge/CPU MegaRAID SCSI 320-1 uses the Intel GC80302 PCI bridge with an embedded 80960JT RISC processor running at 66 MHz.
software or device drivers. The MegaRAID BIOS provides an extensive setup utility that can be accessed by pressing at BIOS initialization. The MegaRAID BIOS Configuration Utility is described in the MegaRAID Configuration Software Guide. 4.9.4 Serial Port MegaRAID SCSI 320-1 includes a 3-pin RS232C-compatible serial port berg connector, which can connect to communications devices. 4.9.
4.9.8 SCSI Firmware The MegaRAID SCSI 320-1 firmware handles all RAID and SCSI command processing and also supports the features listed in Table 4.7. Table 4.
It is independent of any operating system. See the MegaRAID Configuration Software Guide for additional information. 4.10.2 WebBIOS Configuration Utility The WebBIOS Configuration Utility is an HTML-based utility used to configure and maintain RAID arrays, format hard drives, and manage the RAID system. See the MegaRAID Configuration Software Guide for additional information. 4.10.3 Power Console Plus Power Console Plus runs in Windows NT, 2000, XP, and .NET.
4.11.3 Software All SCSI backup and utility software should work with MegaRAID SCSI 320-1. This software is not provided with MegaRAID SCSI 320-1. Compatibility Copyright © 2002 by LSI Logic Corporation. All rights reserved.
4-12 Features Copyright © 2002 by LSI Logic Corporation. All rights reserved.
Chapter 5 Configuring Physical Drives, Arrays, and Logical Drives This chapter explains how to configure SCSI physical drives, arrays, and logical drives connected to the MegaRAID SCSI 320-1 controller. It contains the following sections: 5.1 · Section 5.1, “Configuring SCSI Physical Drives” · Section 5.2, “Configuring Arrays” · Section 5.3, “Creating Logical Drives” · Section 5.4, “Configuring Logical Drives” · Section 5.
Note: 5.1.2 Be sure to back up your data regularly, even when using RAID. Current Physical Device Configuration Use Table 5.1 to record the current configuration for your physical devices. Table 5.1 Physical Device Configuration - SCSI Channel 1 SCSI ID Device Description 0 1 2 3 4 5 6 8 9 10 11 12 13 14 15 5-2 Configuring Physical Drives, Arrays, and Logical Drives Copyright © 2002 by LSI Logic Corporation. All rights reserved.
5.1.3 Logical Drive Configuration Use Table 5.2 to record the configuration for your logical drives. Table 5.2 Logical Drive Logical Drive Configuration RAID Level Stripe Size Logical Drive Size Cache Policy Read Policy Write Policy # of Physical Drives LD0 LD1 LD2 LD3 LD4 LD5 LD6 LD7 LD8 LD9 LD10 LD11 LD12 LD13 LD14 LD15 LD16 LD17 LD18 LD19 LD20 LD21 Configuring SCSI Physical Drives Copyright © 2002 by LSI Logic Corporation. All rights reserved.
Table 5.2 Logical Drive Logical Drive Configuration (Cont.) RAID Level Stripe Size Logical Drive Size Cache Policy Read Policy Write Policy LD22 LD23 LD24 LD25 LD26 LD27 LD28 LD29 LD30 LD31 LD32 LD33 LD34 LD35 LD36 LD37 LD38 LD39 5-4 Configuring Physical Drives, Arrays, and Logical Drives Copyright © 2002 by LSI Logic Corporation. All rights reserved.
5.1.4 Physical Device Layout Use Table 5.3 to record the physical device layout. Table 5.
Table 5.3 Physical Device Layout (Cont.
Table 5.3 Physical Device Layout (Cont.
Table 5.3 Physical Device Layout (Cont.) Channel 1 Target ID Device type Logical drive number/Drive number Manufacturer/Model number Firmware level 5.2 Configuring Arrays You organize the physical disk drives in arrays after they are connected to the MegaRAID SCSI 320-1, and after they are formatted and initialized. An array can consist of up to 15 physical disk drives, depending on the RAID level. The MegaRAID SCSI 320-1 supports up to eight arrays.
You can also designate drives as hot spares using the MegaRAID BIOS Configuration Utility, the MegaRAID Manager, or Power Console Plus. 5.3 Creating Logical Drives Logical drives are arrays or spanned arrays that are presented to the operating system. You must create one or more logical drives. The logical drive capacity can include all or any portion of an array. The logical drive capacity can also be larger than an array by using spanning. The MegaRAID SCSI 320-1 supports up to 40 logical drives. 5.3.
Table 5.4 RAID Level Description Drives Required Capacity 10 Mirroring and Striping 4 – 14 (Number of disks) X (capacity of (Must be a smallest disk) / (2) multiple of 2.) 50 RAID 5 and Striping 6 – 15 (Must be a multiple of the number of arrays.) Note: 5.3.1.2 Capacity for RAID Levels (Cont.) (Number of disks) X (capacity of smallest disk) – (capacity of 1 disk X number of Arrays) The Megaraid SCSI 320-1 controller supports a maximum of 15 physical drives.
characteristics for RAID drive arrays at each RAID level is shown in Table 5.6. Table 5.6 Performance Characteristics for RAID Levels RAID Level 5.3.2 Performance Characteristics 0 Excellent for all types of I/O activity, but provides no data security. 1 Provides data redundancy and good performance. 5 Provides data redundancy and good performance in most environments. 10 Provides data redundancy and excellent performance. 50 Provides data redundancy and very good performance.
5.4 Configuring Logical Drives After you have installed the MegaRAID SCSI 320-1 controller in the server and have attached all physical disk drives, perform the following actions to prepare a RAID array: 1. Optimize the MegaRAID SCSI 320-1 controller options for your system. See Chapter 6 for additional information. 2. If necessary, perform a low-level format of the SCSI drives that will be included in the array and the drives to be used for hot spares. 3. Press to run the MegaRAID Manager. 4.
must be available 24 hours per day? Will the information stored in this disk array contain large audio or video files that must be available on demand? Will this disk array contain data from an imaging system? You must identify the purpose of the data to be stored in the disk subsystem before you can confidently choose a RAID level and a RAID configuration. 5.5 Planning the Array Configuration Fill out Table 5.8 to help plan this array. Table 5.
Use Table 5.9 to plan the array configuration. Table 5.
Table 5.9 Array Configuration Planner (Cont.) # of Drives Possible RAID Levels Relative Performance Fault Tolerance Effective Capacity 8 RAID 0 Excellent No 100% 8 RAID 5 Good Yes 87% 8 RAID 10 Good Yes 50% 8 RAID 50 Good Yes 75% Planning the Array Configuration Copyright © 2002 by LSI Logic Corporation. All rights reserved.
5-16 Configuring Physical Drives, Arrays, and Logical Drives Copyright © 2002 by LSI Logic Corporation. All rights reserved.
Chapter 6 Hardware Installation This chapter explains how to install the MegaRAID SCSI 320-1 controller. It contains the following sections: 6.1 · Section 6.1, “Hardware Requirements” · Section 6.2, “Installation Steps” · Section 6.3, “Summary” Hardware Requirements You must have the following in order to install the MegaRAID SCSI 320-1 controller and create arrays: · A host computer with the following: – A motherboard with 5 V/3.
6.2 Installation Steps The MegaRAID SCSI 320-1 provides extensive customization options. If you need only basic MegaRAID SCSI 320-1 features and your computer does not use other adapter cards with resource settings that may conflict with MegaRAID SCSI 320-1 settings, even custom installation can be quick and easy. Table 6.1 lists the hardware installation steps. Each step is described in detail in the following pages. Table 6.
6.2.1 Step 1: Unpack Unpack and install the hardware in a static-free environment. Remove the MegaRAID SCSI 320-1 controller card from the anti-static bag and inspect it for damage. If the card appears damaged, or if any item listed below is missing, contact LSI Logic or your MegaRAID OEM support representative. The MegaRAID SCSI 320-1 controller is shipped with the following: · · 6.2.
Table 6.2 Jumpers for the MegaRAID SCSI 320-1 Item Description Type J8 Battery backup unit (BBU) daughter card connector 40-pin header J9 SCSI bus termination power 2-pin header J10 SCSI bus termination enable control 3-pin header Figure 6.1 shows the location of these items on the MegaRAID SCSI 320-1 controller. Figure 6.
6.2.3.2 J3 Clear EPROM J3 is a two-pin header that clears the erasable progammable read-only memory (EPROM) configuration data. 6.2.3.3 J4 BIOS Enable J4 is a 2-pin header that enables or disables the MegaRAID onboard BIOS. The onboard BIOS should be enabled (J4 unjumpered) for normal board position. Table 6.3 shows the jumper settings. Table 6.3 6.2.3.
6.2.3.8 J10 Termination Enable J10 is a three-pin header that specifies hardware or software control of SCSI termination, as shown in Table 6.4. Leave at the default setting (jumper on pins 1 and 2) to allow the MegaRAID controller to automatically set its own SCSI termination. Table 6.4 6.2.4 Pinout for J10 Termination Enable Type of SCSI Termination J10 Setting Software control of SCSI termination using drive detection (default). Short pins 1-2 Permanently disable all onboard SCSI termination.
6.2.4.2 Selecting a Terminator Use standard external SCSI terminators on a SCSI channel operating at 10 Mbytes/s or higher synchronous data transfer. 6.2.4.3 Terminating Internal SCSI Disk Arrays Set the termination so that SCSI termination and termination power are intact when any hard drive is removed from a SCSI channel, as shown in Figure 6.2. Installation Steps Copyright © 2002 by LSI Logic Corporation. All rights reserved.
Figure 6.2 Termination of Internal SCSI Disk Arrays Termination Enabled ID2 ID1 – No Termination ID0 – Boot Drive No Termination MegaRAID SCSI 320-1 SCSI ID 7 6-8 Hardware Installation Copyright © 2002 by LSI Logic Corporation. All rights reserved.
6.2.4.4 Terminating External Disk Arrays In most array enclosures, the end of the SCSI cable has an independent SCSI terminator module that is not part of any SCSI drive. In this way, SCSI termination is not disturbed when any drive is removed, as shown in Figure 6.3: Figure 6.3 Terminating External Disk Arrays External SCSI Drives ID 0 ID 1 ID 2 ID 3 ID 4 ID 5 ID 6 6.2.4.
Figure 6.4 Terminating Internal and External Disk Arrays Host Computer Terminator ID2 External SCSI Drives ID1 – No Termination ID 0 ID0 – Boot Drive No Termination ID 1 ID 2 ID 3 ID 4 ID 5 ID 6* Note: *Termination enabled from last SCSI drive SCSI 320-1 SCSI ID 7 6-10 Hardware Installation Copyright © 2002 by LSI Logic Corporation. All rights reserved.
6.2.4.6 Connecting Non-Disk SCSI Devices SCSI tape drives and SCSI CD-ROM drives must each have a unique SCSI ID regardless of the SCSI channel they are attached to. The general rule for Unix systems is: · Tape drive set to SCSI ID 2 · CD-ROM drive set to SCSI ID 5 Caution: Figure 6.5 Since all non-disk SCSI devices are single ended, it is not advisable to attach a non-disk device to a MegaRAID SCSI 320-1 RAID controller if LVD disk drives are also attached.
6.2.5 Step 5: Install MegaRAID SCSI 320-1 Select a 3.3 V or 5 V PCI slot and align the MegaRAID SCSI 320-1 controller bus connector with the slot. Figure 6.6 shows the differences between the 3.3 V and 5 V slots. Figure 6.6 3.3 V and 5 V PCI Slots Insert the MegaRAID SCSI 320-1 card in the PCI slot, as shown in Figure 6.7. Press down gently but firmly to make sure that the card is properly seated in the slot. The bottom edge of the controller card should be flush with the slot.
Figure 6.7 Installing the MegaRAID SCSI 320-1 Controller Bracket Screw 32-bit Slots (3.3 V) 64-bit Slots (5 V) 6.2.6 Step 6: Connect SCSI Devices Use SCSI cables to connectSCSI devices to the MegaRAID SCSI 320-1. The MegaRAID SCSI 320-1 provides two SCSI connectors: · J1, the internal high-density 68-pin SCSI connector for Wide (16-bit) SCSI · J7, the external very high-density 68-pin SCSI connector Use this procedure to connect SCSI devices: 1.
2. Configure all SCSI devices to supply TermPWR. 3. Set proper target IDs (TIDs) for each SCSI device. The cable length can be up to 20 m. 6.2.6.1 Cable Suggestions System throughput problems can occur if SCSI cable use is not maximized. Here are some cabling guidelines: 6.2.7 · You can use cables up to 12 meters for LVD devices. · For single-ended SCSI devices, use the shortest SCSI cables. · Use active termination. · Avoid clustering the cable nodes.
Important: 6.2.7.1 Non-disk devices (CD-ROM or tape drive) should have unique SCSI IDs regardless of the channel they are connected to. Example of MegaRAID SCSI 320-1 ID Mapping Table 6.6 provides an example of ID mapping for the SCSI 320-1. Table 6.
6.2.7.2 Target IDs as Presented to the Operating System Table 6.7 shows the target IDs as presented to the operating system. Table 6.7 6.2.8 Target IDs as Presented to the Operating System ID LUN Device ID LUN 0 Device 0 Disk (A1-X) 1 0 0 1 Disk (A2-X) 2 0 CD 0 2 Disk (A3-X) 3 0 Tape 0 3 Disk (A4-X) 4 0 CD 0 4 Disk (A5-X) 5 0 Tape 0 5 Disk (A6-X) 6 0 0 6 Disk (A7-X) 0 7 Disk (A8-X) Step 8: Power Up Replace the computer cover and reconnect the AC power cords.
The utility prompt times out after several seconds. The MegaRAID SCSI 320-1 host adapter (controller) number, firmware version, and cache DRAM size are displayed in the second portion of the BIOS message. The numbering of the controllers follows the PCI slot scanning order used by the host motherboard. 6.2.9 Step 9: Run the MegaRAID BIOS Configuration Utility Press to run the MegaRAID BIOS Configuration Utility.
6.3 Summary This chapter discussed hardware installation. Configure the RAID system using software configuration utilities. See the MegaRAID Configuration Software Guide for all information about MegaRAID SCSI 320-1 software utilities. Table 6.8 lists the utility programs for configuring MegaRAID SCSI 320-1. Table 6.
Chapter 7 Troubleshooting This chapter provides troubleshooting information for the MegaRAID SCSI 320-1 controller. It contains the following sections: 7.1 · Section 7.1, “General Troubleshooting” · Section 7.2, “BIOS Boot Error Messages” · Section 7.3, “Other BIOS Error Messages” · Section 7.4, “Other Potential Problems” General Troubleshooting Table 7.1 lists the general problems that can occur, along with suggested solutions. Table 7.
Table 7.1 General Problems and Suggested Solutions (Cont.) Problem Suggested Solution Pressed . Ran Megaconf.exe and tried to make a new configuration. The system hangs when scanning devices. Check the drives IDs on each channel to make sure each device has a different ID. Check the termination. The device at the end of the channel must be terminated. Replace the drive cable. Multiple drives connected to the MegaRAID SCSI 320-1 use the same power supply.
7.2 BIOS Boot Error Messages Table 7.2 describes BIOS error messages that can display when you boot the system, and suggested solutions. Table 7.2 BIOS Boot Error Messages Message Problem Suggested Solution Adapter BIOS Disabled. No Logical Drives Handled by BIOS The MegaRAID BIOS is disabled. Sometimes the BIOS is disabled to prevent booting from the BIOS. Enable the BIOS using the MegaRAID BIOS Configuration Utility.
Table 7.2 BIOS Boot Error Messages (Cont.) Message Problem Suggested Solution 1 Logical Drive Degraded A logical drive signed on in a degraded state. Make sure all physical drives are properly connected and are powered on. Run MegaRAID Manager to find out if any physical drives are not responding. Reconnect, replace, or rebuild any drive that is not responding. The following SCSI IDs are not responding: Channel x:a.b.c 7.
Table 7.3 Other BIOS Error Messages (Cont.) Message Problem Suggested Solution Unresolved configuration mismatch between disks and NVRAM on the adapter The configuration stored in the MegaRAID NVRAM does not match the configuration stored on the drives. 1. Press a key to run MegaRAID Manager. 2. Select View/Add Configuration from the Configure menu. 3. Use View/Add Configuration to examine both the configuration in NVRAM and the configuration stored on the disk drives. 4.
Table 7.4 Other Potential Problems (Cont.) Topic Information MegaRAID power requirements The maximum MegaRAID SCSI 320-1 power requirements are 15 W at 5 V and 3 A. SCSI bus requirements The ANSI specification dictates the following: · The maximum signal path length between terminators is 3 meters when using up to 4 maximum capacitance (25 pF) devices and 1.5 meters when using more than 4 devices.
Appendix A SCSI Cables and Connectors MegaRAID SCSI 320-1 provides several different types of SCSI connectors. The connectors are: A.1 · One 68-pin high density internal connector · One 68-pin very high density external connector 68-Pin High-Density SCSI Internal Connector The SCSI channel on the MegaRAID SCSI 320-1 controller has a 68-pin high density 0.050 inch pitch unshielded connector. This connector provides all signals needed to connect MegaRAID SCSI 320-1 to Wide SCSI devices.
A.1.1 Cable Assembly for Internal Wide SCSI Devices The cable assembly for connecting internal Wide SCSI devices is shown below. Pin 1 Connectors: 68 Position Plug (Male) AMP – 786090-7 Cable: Flat Ribbon or Twisted-Pair Flat Cable 68 Conductor 0.025 Centerline 30 AWG Pin 1 Pin 1 A-2 SCSI Cables and Connectors Copyright © 2002 by LSI Logic Corporation. All rights reserved.
A.1.2 Connecting Internal and External Wide Devices The cable assembly for connecting internal Wide and external Wide SCSI devices is shown below. A Pin 1 Pin 1 B Connector A: 68 Position Panel Mount Receptacle with 4-40 Holes (Female) AMP – 786096-7 Note: To convert to 2-56 holes, use screwlock kit 749087-1, 749087-2, or 750644-1 from AMP Connectors B: 68 Position Plug (Male) AMP – 786090-7 Pin 1 B 68-Pin High-Density SCSI Internal Connector Copyright © 2002 by LSI Logic Corporation.
A.1.3 Converting Internal Wide to Internal Non-Wide (Type 2) The cable assembly for converting internal Wide SCSI connectors to internal non-Wide (Type 2) SCSI connectors is shown below.
A.1.4 Converting Internal Wide to Internal Non-Wide (Type 30) The cable assembly for converting internal Wide SCSI connectors to internal non-Wide (Type 30) SCSI connectors is shown below. Pin 1 Connector A: 68 Position Plug (Male) AMP– 749925-5 A Connector B: 50 Position Plug (Male) AMP – 749925-3 Pin 1 Wire: Twisted-Pair Flat Cable or Laminated Discrete Wire Cable 25 Pair 0.050 Centerline 28 AWG B A.1.
A.2 SCSI Cable and Connector Vendors Table A.1 lists SCSI cable vendors, and contact information. Table A.1 SCSI Cable Vendors Manufacturer Telephone Number Cables To Go Voice: 800-826-7904 Fax: 800-331-2841 System Connection Voice: 800-877-1985 Technical Cable Concepts Voice: 714-835-1081 GWC Voice: 800-659-1599 Table A.2 table lists SCSI connector vendors. Table A.
A.3 High-Density 68-Pin Connector Pinout for SE SCSI Table A.3 lists the pinout for the high-density 68-pin connector for singleended SCSI. Table A.
Table A.
A.4 68-Pin Connector Pinout for LVD SCSI Table A.4 lists the pinout for the 68-pin connector for LVD SCSI. Table A.
Table A.4 Signal Connector Pin Cable Pin Cable Pin Connector Pin Signal +BSY 23 45 46 57 -BSY +ACK 24 47 48 58 -ACK +RST 25 49 50 59 -RST +MSG 26 51 52 60 -MSG +SEL 27 53 54 61 -SEL +C/D 28 55 56 62 -C/D +REQ 29 57 58 63 -REQ +I/O 30 59 60 64 -I/O +DB(8) 31 61 62 65 -DB(8) +DB(9) 32 63 64 66 -DB(9) +DB(10) 33 65 66 67 -DB(10) +DB(11) 34 67 68 68 -DB(11) Note: A-10 68-Pin Connector Pinout for LVD SCSI (Cont.
Appendix B Audible Warnings The MegaRAID SCSI 320-1 RAID controller has an onboard tone generator that indicates events and errors. Note: Table B.1 This is available only if the optional series 502 Battery Backup Unit (BBU) is installed. Audible Warnings and Descriptions Tone Pattern Meaning Examples Three seconds on and one second off A logical drive is offline. One or more drives in a RAID 0 configuration failed. Two or more drives in a RAID 1, or 5 configuration failed.
B-2 Audible Warnings Copyright © 2002 by LSI Logic Corporation. All rights reserved.
Appendix C Glossary Array A grouping of individual disk drives that combines the storage space on the disk drives into a single segment of contiguous storage space. MegaRAID can group disk drives on one or more SCSI channels into an array. Array Management Software Software that provides common control and management for a disk array. Array management software most often executes in a disk controller or intelligent host bus adapter, but it can also execute in a host computer.
Channel An electrical path for the transfer of data and control information between a disk and a disk controller. Consistency Check An examination of the disk system to determine whether all conditions are valid for the specified configuration (such as parity.) Cold Swap A cold swap requires that you turn the power off before replacing a defective disk drive in a disk subsystem. Data Transfer Capacity The amount of data per unit time moved through a channel.
provides high I/O performance at low cost, but provides lowers data reliability than any of its member disks. Disk Subsystem A collection of disks and the hardware that connects them to one or more host computers. The hardware can include an intelligent controller, or the disks can attach directly to a host computer I/O bus adapter. Double Buffering A technique that achieves maximum data transfer bandwidth by constantly keeping two I/O requests for adjacent data outstanding.
Host Computer Any computer to which disks are directly attached. Mainframes, servers, workstations, and personal computers can all be considered host computers. Hot Spare A stand-by disk drive ready for use if a drive in an array fails. A hot spare does not contain any user data. Up to eight disk drives can be assigned as hot spares for an adapter. A hot spare can be dedicated to a single redundant array, or it can be part of the global hot-spare pool for all arrays controlled by the adapter.
Mbyte (Megabyte) An abbreviation for 1,000,000 (10 to the sixth power) bytes. One Mbyte equals 1,000 Kbytes (kilobytes). Multi-threaded Having multiple concurrent or pseudo-concurrent execution sequences. Used to describe processes in computer systems. Multi-threaded processes allow throughput-intensive applications to efficiently use a disk array to increase I/O performance.
RAID Redundant Array of Independent Disks. A data storage method in which data, along with parity information, is distributed among two or more hard disks (called an array) to improve performance and reliability. A RAID disk subsystem improves I/O performance on a server using only a single drive. The RAID array appears to the host server as a single storage unit. I/O is expedited because several disks can be accessed simultaneously. RAID Levels A style of redundancy applied to a logical drive.
Redundancy The provision of multiple interchangeable components to perform a single function to cope with failures or errors. Redundancy normally applies to hardware; disk mirroring is a common form of hardware redundancy. Replacement Disk A disk available to replace a failed member disk in a RAID array. Replacement Unit A component or collection of components in a disk subsystem that is always replaced as a unit when any part of the collection fails.
Service Provider The Service Provider (SP) is a program that resides in the desktop system or server and is responsible for all DMI activities. This layer collects management information from products (whether system hardware, peripherals, or software), stores that information in the DMI database, and passes it to management applications as requested. SNMP Simple Network Management Protocol.
Ultra320 A subset of Ultra3 SCSI that allows a maximum throughput of 320 Mbytes/s, which is twice as fast as Wide Ultra2 SCSI. Ultra320 SCSI provides 320 Mbytes/s on a 16-bit connection. Virtual Sizing FlexRAID virtual sizing is used to create a logical drive up to 80 Gbytes. A maximum of 40 logical drives can be configured on a RAID controller, and RAID migration is possible for all logical drives except the fortieth.
C-10 Glossary Copyright © 2002 by LSI Logic Corporation. All rights reserved.
Index Numerics Creating hot spares 5-8 Creating logical drives 5-9 160M and Wide SCSI 4-1 68-pin connector pinout for LVD SCSI A-9 68-Pin High Density Connectors A-1 D A AMPLIMITE .
H Other BIOS error messages 7-4 Hardware Installation 6-1 High-density 68-pin SCSI connector pinout A-7 High-density single-ended connector A-8 Host computer C-4 Host-based array C-3 Host-based RAID solution 2-2 Hot spare 2-8, 2-10, C-4 Using during disk rebuild 2-9 Hot swap 2-9, C-4 P I I/O driver C-4 Initialization C-4 Install Drivers 6-17 Installation steps Custom 6-2 R J Jumpers Setting 6-3 L Linux Red Hat 4-5 Logical disk C-4 Logical drive 2-3, C-4 Logical drive states 2-10 M Mapping C-4 MB C-5
Connecting 6-13 SCSI cables and connectors A-1 SCSI channel C-7 SCSI Connector Vendors A-6 SCSI connectors 4-7, 4-8 SCSI controller 4-6 SCSI data transfer rate 4-6 SCSI Device Compatibility 4-10 SCSI device types supported 4-6 SCSI Drive State C-7 SCSI firmware 4-9 SCSI termination 4-6, 4-8, 6-6 Set 6-6 SCSI to SCSI 2-11 SCSI-to-SCSI RAID product 2-3 Serial port 4-8 Server management 4-10 Service provider C-8 Setting SCSI termination 6-6 SMART Technology 4-1 SNMP C-8 SNMP agent 4-10 SNMP managers 4-10 Softw
IX-4 Index Copyright © 2002 by LSI Logic Corporation. All rights reserved.
LSI Logic Confidential Customer Feedback We would appreciate your feedback on this document. Please copy the following page, add your comments, and fax it to us at the number shown. If appropriate, please also fax copies of any marked-up pages from this document. Important: Please include your name, phone number, fax number, and company address so that we may contact you directly for clarification or additional information. Thank you for your help in improving the quality of our documents.
LSI Logic Confidential Reader’s Comments Fax your comments to: LSI Logic Corporation Technical Publications M/S E-198 Fax: 408.433.4333 Please tell us how you rate this document: MegaRAID SCSI 320-1 Hardware Guide. Place a check mark in the appropriate blank for each category.
