Installation Guide 3ware® SATA RAID Controller Supports the 9000 Series PN 720-0117-01 March 2005
Copyright ©2004-2005 AMCC. All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form by any means, electronic, mechanical, photocopying, recording or otherwise, without the proper written consent of AMCC, 455 West Maude Ave., Sunnyvale, CA 94085. Trademarks 3ware, Escalade, and 3DM are all registered trademarks of AMCC. The 3ware logo, 3BM, StorSwitch, TwinStor, and R5 Fusion are all trademarks of AMCC.
Table of Contents About this Guide . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . v Conventions Used in This Guide . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . v About the 3ware RAID Controller . . . . . . . . . . . . . . . . . . . . . . . 1 Product Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . What’s New With the 3ware 9000 Series Controllers . . . . . . . . . . . . . . . . System Requirements . . . . . . . .
Working with the 3ware BIOS Manager (3BM) . . . . . . . . . . . . . . . . . . . . Starting 3BM. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Exiting 3BM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Working in the 3BM Screens . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Specifying the Unit Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Basic Steps for Creating a Unit . . . . . . . . . . .
Driver Installation Under FreeBSD . . . . . . . . . . . . . . . . . . . . . 87 Obtaining 3ware FreeBSD Drivers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Materials Required. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Installing the Driver While Installing FreeBSD on the 3ware RAID Controller . . . . . . . . . . . . . . . . . . . . . . Installing the 3ware Driver on a FreeBSD System that Boots from a Different Device . . . . . . . . . . . . . . . . . . .
iv 3ware 9000 Series Serial ATA RAID Controller Installation Guide
About this Guide This guide describes how to install the 3ware 9000 series RAID controller, configure arrays, and make the arrays available to your operating system—Microsoft Windows, Red Hat Linux, SuSE Linux, or FreeBSD. For more complete information about managing and using arrays connected to the 3ware RAID controller, see 3ware 9000 Series Serial ATA RAID Controller User Guide. You may also want to refer to the Knowledgebase available at the 3ware website at http://www.3ware.
About this Guide vi 3ware 9000 Series Serial ATA RAID Controller Installation Guide
About the 3ware RAID Controller This section includes the following topics: Product Features What’s New with the 3ware 9000 Series Controllers About 3ware Driver Versions System Requirements Package Contents Product Features The 3ware 9000 Series Serial ATA family includes 9500S-4LP, 9500S-8, 9500S-12, 9500S-8MI, and 9500S-12MI. Features of the 3ware 9000 series controllers include: Advanced RAID features for greater data protection and management.
About the 3ware RAID Controller An enhanced firmware platform allows future upgrades. Anticipated upgrades include Enclosure Management Services (EMS). AMCC’s remote management software, 3ware Disk Manager 2 (3DM®2) simplifies storage configuration and management via a Web browser.
System Requirements Drives Depending on the particular model, the 3ware RAID controller may be connected to up to, four, eight, or twelve SATA drives using the supplied interface cables. Drives must meet serial ATA 150 (SATA I) or serial ATA 300 (SATA 2) Gb/s standards. Drives may be of any capacity or physical form factor. The length of both shielded and unshielded interface cables may not exceed 1M (39”) for serial ATA controllers.
About the 3ware RAID Controller Package Contents If your package is missing any of the items listed below, contact 3ware before proceeding with installation (disk drives and disk mounting brackets are not included). 3ware Serial ATA RAID Controller in an ESD-protective bag Serial ATA interface cables (one per port). (Cables are not included in 9500S-8MI and 9500S-12MI.
Installation Overview Details about each step in the installation process are included in this guide. For your reference, the list below provides an overview of the main steps required. If you have a Battery Backup Unit (BBU), install it on the controller. (For details, see “Appendix A. Installing the Battery Backup Unit” on page 99.) Install the controller, cables, and drives. The basic steps are listed here. For details, see “Installing the Hardware” on page 7.
Installation Overview Check the motherboard boot sequence. Refer to your system BIOS guide for more details. Configure RAID units. The basic steps are listed here. For details, see “Configuring Units” on page 27. a b c d e f Start 3BM (the 3ware BIOS Manager). Select the drives to be included and indicate that you want to create a disk array. Select the desired RAID configuration. Set other parameters, depending on the type of RAID configuration. Confirm the array configuration.
Installing the Hardware This section describes the physical installation of the 3ware 9000 RAID controllers. It contains the following topics: “Before You Begin” provides important information about things you should consider before starting installation, and tools and equipment you will need. “Safety Factors” describes important precautions for your personal safety and to protect your equipment and data. Be sure to read this section.
Installing the Hardware Before You Begin The next few pages describe some factors you may want to consider during installation, and the tools and equipment you will need. Installation Considerations Cable Length, Routing Space, and Air Flow When you are installing multiple drives with a controller, make sure there is adequate space in the chassis for the required cables. It is important that the cables do not obstruct the air flow or prevent proper ventilation of the system.
Before You Begin Whether to Use the LED Status Connector 3ware RAID controllers include two types of LED status connectors: Overall indicator, which lights when any drive is active. Individual LED indicators, for each drive. (Not supported on chassis that have a common ground.
Installing the Hardware What You Need: Tools and Equipment Tools Required You will need the following tools during installation: An ESD grounding strap or mat Standard hand tools to open your system’s case and install the 3ware RAID controller into an available PCI expansion slot. Safety Factors Be sure to follow the guidelines presented on the next few pages to insure your own safety, and that of your equipment. Personal Safety Warning! High voltages may be found inside computer equipment.
Safety Factors ESD (Electrostatic Discharge) Precautions To avoid damaging computer components and accessories when installing or removing the 3ware RAID controller, follow standard electrostatic discharge (ESD) precautions: When your computer case is open and its internal parts are exposed, do not touch any internal part unnecessarily. Always wear a grounded strap or work on an ESD-protective mat. Do not remove the 3ware RAID controller from its protective bag until you are properly grounded.
Installing the Hardware Installing a Serial ATA RAID Controller Figure 1 shows a 3ware Serial ATA RAID controller with twelve ports. Up to twelve drives can be attached to this particular controller, through serial ATA cables. LED indicators for individual drives on J7, J8, and J9 Overall LED drive status indicator: the last two pins of J9. The anode is the lower of the two pins and the cathode is the upper. Ports 10 and 11 Serial ports are doubleI 2C connector stacked connectors.
Installing a Serial ATA RAID Controller LED indicators for individual drives on J7 and J8 Overall LED drive status indicator: the last two pins of J7. The anode is the lower of the two pins and the cathode is the upper. Serial ports are doubleI2C connector stacked connectors. Odd-numbered ports 1 through 7 are located below even-numbered ports 0 through 6.
Installing the Hardware Warning: A common or shared LED ground on a chassis is not supported and can damage the 3ware controller. Check with your chassis documentation before connecting. Table 1: LED Indicator Pin Positions Controller 9500S-4LP LED Header J3 Pin Pair Comment : : : : : Orientation Horizontal 0 1 2 3 All Port number/All (all activity indicator) k-cathode-minus is on the top a-anode-plus is on the bottom 9500S-8 (Pchip v1.
Installing a Serial ATA RAID Controller Table 1: LED Indicator Pin Positions LED Header Controller 9500S-12 J7 J8 J9 Pin Pair Comment : : : : : Orientation Horizontal 0 1 2 3 NU Port number/NU (Not Used) : : : : : Orientation Horizontal 4 5 6 7 NU Port number/NU (Not Used) : : : : : Orientation Horizontal 8 9 10 11 All Port number/All (all activity indicator) k-cathode-minus is on the top a-anode-plus is on the bottom LED indicators for individual drives on J7 and J8 Overall LED drive
Installing the Hardware LED indicators for individual drives on J3: 0, 1, 2, 3 (left to right) Overall LED drive status indicator: the last two pins of J3. The anode is the lower of the two pins and the cathode is the upper. I2C connector Serial ports are double-stacked connectors. Oddnumbered ports 1 and 3 are located below evennumbered ports 0 and 2. Ports: 2 and 3 0 and 1 Serial number (on plate) SODIMM (memory module) BBU (Battery Backup Unit) connector Figure 4.
Installing a Serial ATA RAID Controller Note: The connectors on the end of the serial controller and the drive are susceptible to damage from excessive bending. Be careful not to insert or remove the serial cable connector at an angle. 3 Repeat steps 2 and 3 for each additional interface cable. (You will connect one cable for each hard drive you will attach.) To install the controller in the computer 1 If the computer is running, shut it down.
Installing the Hardware 7 Press down gently on the edge of the 3ware RAID controller directly above the slot until it is fully seated. 8 Check that the 3ware RAID controller’s metal bracket covers the hole in the case and secure the bracket with the screw that was used to secure the filler bracket in step 5. To connect the interface cables to the drives 1 If your drives are not already installed in the computer chassis or hot swap carriers, install them now.
Installing a Serial ATA RAID Controller with Multi-lane Internal Connectors Installing a Serial ATA RAID Controller with Multi-lane Internal Connectors LED indicators for I2C connector individual drives on J7, J8, and J9. The overall LED drive status indicator is on the last two pins of J7.
Installing the Hardware Figure 6. Multi-lane Cable (InfiniBand 4x, SFF-8470) For use with a backplane that has individual SATA connectors or individual serial ATA drives, use the break-out cable, which has a multi-lane connector on one end, and four individual SATA connectors on the other end. To connect the multi-lane cables Depending on the model of the controller and the number of drives you will be connecting, you will connect two or three multi-lane cables.
Installing a Serial ATA RAID Controller with Multi-lane Internal Connectors To install the controller in the computer 1 If the computer is running, shut it down. Turn off power to the computer and disconnect the power cord from the outlet. 2 Open the computer case according to the manufacturer’s instructions. 3 Find the PCI slot you want to use for the serial RAID controller. 4 Remove the metal filler bracket for the slot.
Installing the Hardware 3 Power down the system, disconnect the drives from the 7/8000 controller and remove the controller from the system. 4 Attach the drives to the 9000 controller, as described earlier in this section. Finishing Up After you have installed the controller in the computer and attached appropriate cables to the controller and drives, complete the following steps to complete the hardware installation.
Moving Units from an 8000 Controller to a 9000 Controller Moving Units from an 8000 Controller to a 9000 Controller It is possible to move your 8000 storage units to a 9000 series controller. You will then have the advantages of the 9000 series controller. The drive units must be in normal mode before moving the units. Incomplete, degraded, rebuilding, or initializing units cannot be converted. In addition, RAID 0, 10, and 5 units must use a standard 64 KB stripe size.
Installing the Hardware To move units under Linux or FreeBSD 1 Upgrade your driver to the 9000 series driver. (For details, refer to the Linux or FreeBSD Driver Installation section.) 2 Run the conversion utility to convert the units. 3 Power down the system, disconnect the drives from the 8000 controller and remove the controller from the system. 4 Install the 9000 controller and attach the drives to the 9000 board, as described earlier in this section.
Moving Units from an 8000 Controller to a 9000 Controller 4 Reboot the system and enter the 3ware 9000 series BIOS (3BM) by pressing Alt-3. Enable the Export JBOD policy on the Policy screen. (The next section in this guide, “Configuring Units”, describes how to work in 3BM. Additional information about 3BM is available in 3ware 9000 Series Serial ATA RAID Controller User Guide.) 5 Press the F8 or Esc key to save and exit.
Installing the Hardware 26 3ware 9000 Series Serial ATA RAID Controller Installation Guide
Configuring Units After you have physically installed your 3ware RAID controller and connected it to your disk drives, you configure how the drives connected to the controller will be used in RAID arrays.
Configuring Units Note: This section describes how to configure your RAID arrays as part of the installation process. For complete information about using 3ware BIOS Manager (3BM), including how to use it to change existing configurations, and for information about how to define and change the configuration using 3ware Disk Manager (3DM 2), see the 3ware 9000 Series Serial ATA RAID Controller User Guide. Note: You must attach drives before you can configure RAID arrays.
Understanding RAID Concepts and Levels disk arrays achieve highest transfer rates and performance at the expense of fault tolerance. Distributed Parity. Parity works in combination with striping on RAID 5 and RAID 50. Parity information is written to each of the striped drives, in rotation. Should a failure occur, the data on the failed drive can be reconstructed from the data on the other drives. Hot Spare.
Configuring Units cause a system hang, depending on your operating system. RAID 0 arrays are not recommended for high availability systems unless additional precautions are taken to prevent system hangs and data loss. RAID 1. Also known as a mirrored array. Mirroring is done on pairs of drives. Mirrored disk arrays write data to two drives using RAID 1 algorithms. This gives your system fault tolerance by preserving the data on one drive if the other drive fails.
Determining What RAID Level to Use Disk as a replacement for JBOD, to take advantage of advanced features such as OCE, and RLM. JBOD units are not fault tolerant and therefore not recommended for high availability systems unless additional precautions are taken to prevent system hangs and data loss. Hot Spare. A single drive, available online, so that a redundant array can be automatically rebuilt in case of drive failure.
Configuring Units Table 2: Possible Configurations Based on Number of Drives # Drives Possible Configurations 2 RAID 0 or RAID 1 3 RAID 0 RAID 1 with hot spare RAID 5 4 RAID 5 + hot spare RAID 10 Combination of RAID 0, RAID 1, single disks 5 RAID 5 + hot spare RAID 10 + hot spare Combination of RAID 0, RAID 1, hot spare, or single disks 6 or more RAID 50 Depending on the number of drives, a RAID 50 may contain from 2 to 4 subunits.
Determining What RAID Level to Use Table 3: Drive Capacity RAID Level Capacity RAID 5 (number of drives - 1) X (capacity of the smallest drive) Storage efficiency increases with the number of disks: storage efficiency = (number of drives -1)/ (number of drives) RAID 10 (number of drives / 2) X (capacity of smallest drive) RAID 50 (number of drives - number of subunits) X (capacity of the smallest drive) Through drive coercion, the capacity used for each drive is rounded down so that drives from dif
Configuring Units Working with the 3ware BIOS Manager (3BM) This section describes the basics of working with the 3ware BIOS Manager (3BM) configuration utility. It includes the following sections: Starting the 3BM configuration utility Exiting the 3BM configuration utility Working in the 3BM configuration screens Starting 3BM You access the 3BM configuration utility during the start-up process for your computer. To start 3BM 1 Power up or reboot your system.
Working with the 3ware BIOS Manager (3BM) A message warns you that changing your disk array configuration may overwrite data on the disks. Figure 8. Warning Message When you Start 3BM 4 If you need to backup data before continuing, press ESC and do so now. Otherwise, press any key to continue. www.3ware.
Configuring Units Exiting 3BM When you are ready to exit the 3BM configuration utility, you have the option to save the configuration changes you have made, or to discard the changes. To save your configuration modifications 1 Press the F8 or Esc key. A list of affected drives appears, and a message asks you to confirm the configuration. 2 Type Y. 3BM closes and the booting process resumes. To exit without saving changes 1 Press Esc.
Working with the 3ware BIOS Manager (3BM) Working in the 3BM Screens Figure 9. 3BM Configuration Utility Main Display The main 3BM screen shows a list of available drives. After you have configured one or more drives, it also lists the existing configuration. Available Drives lists the drives that are available to create units and hot spares. Exportable Units lists any existing units along with the drives contained in the units. Incomplete Drives and Others.
Configuring Units Unusable Units. Any unit that is missing too many drives to be constructed properly will be listed here. Table 4 lists how to move around and select information in the 3BM screens. Table 4: Working in 3BM To do this Use these keys Move between units or drives in a list, and between fields and buttons Up and Down Arrow Keys OR Left and Right Arrow Keys OR Tab and Shift+Tab Select (or unselect) what is currently highlighted.
Working with the 3ware BIOS Manager (3BM) Table 4: Working in 3BM To do this Use these keys Specify (or unspecify) a drive as a hot spare S Unlock the drives in a unit, so that they can be removed and used with a controller other than a 9000-series controller. R (Remove) Return to starting values for this session in the 3ware BIOS Manager F6 Note: F6 cannot bring back previous policy settings; they are saved when you exit the Policy screen.
Configuring Units Table 4: Working in 3BM To do this Use these keys Exit the utility and save or abandon all changes. Esc Exit the utility and save all changes F8 Specifying the Unit Configuration You can implement one or more units of supported RAID levels on a single controller, depending on the number of drives that the specific 3ware RAID controller supports and the number of drives attached.
Specifying the Unit Configuration You may include from one to twelve drives in the unit, depending on the number available. (For information about how many drives to select for a given RAID level, see Table 2 on page 31.) Note: To include drives that are part of an existing unit you must first delete the other unit. Be cautious in doing this, as any existing data on that unit will be overwritten. Figure 10.
Configuring Units Figure 11. Create Disk Array Display, RAID 0 Example Figure 12.
Specifying the Unit Configuration To select the desired RAID configuration 1 Press Enter in the RAID Configuration field to display the available RAID levels for the number of drives you selected. Figure 13. List of Configuration Choices for Four Drives 2 Use the arrow keys to highlight the desired RAID configuration and press Enter. For information about the different RAID levels and when to use each, see “Understanding RAID Concepts and Levels” on page 28.
Configuring Units Note: Striping size is not applicable for RAID 1, because it is a mirrored array without striping. In general, use smaller stripe sizes for sequential access (such as video access) and larger stripe sizes for random access (such as a database). Figure 14. Stripe Sizes for a RAID 5 For information about the field “Continue on Source Error,” see the 3ware 9000 Series Serial ATA RAID Controller User Guide.
Specifying the Unit Configuration 2 If you have additional drives, go ahead and configure an additional RAID unit or designate a hot spare. Then continue on with the next section. (For details about hot spares, see page 46.) 3 If you configured more than one unit, and you plan to install the operating system on one of them, make that unit be the first unit (Unit 0) in the list of Exportable Units. To move a unit up in the list, highlight it and press the Page Up key.
Configuring Units Depending on the RAID configuration you are creating, initialization of the unit may begin immediately. For details, see “Initializing Units” on page 49. Specifying a Hot Spare You can designate one of the Available Drives as a hot spare in 3BM. If a hot spare is specified and a redundant unit degrades, an event notification will be generated. The hot spare will automatically replace the failed drive without user intervention.
Specifying the Unit Configuration If a hot spare is already enabled, you can disable it by following the same process. Note: In order to replace a failed drive in a degraded unit, a hot spare drives must have the same or larger storage capacity than the failed drive.
Configuring Units 3 Tab to OK and press Enter. After you start your system, you will see multiple volumes available in the operating system: 2 TB each, plus one volume with any remaining storage beyond the multiple of 2TB. (In this release, 3BM does not show individual volumes.) Leaving Individual Drives as JBODs By default, if you leave individual drives unconfigured (JBODs), they will not be available to the operating system.
Initializing Units Initializing Units Performance of RAID 5 units with 5 or more disks, and RAID 50 units with 10 or 12 disks configured into two subunits will improve after the unit has been initialized. For these configurations, foreground initialization (also known as “zeroing”) starts immediately. If you want to begin using the units right away, you can halt the zeroing process and initialize them in the background later, after the operating system is booted.
Configuring Units If you want to use a RAID configuration which has started initializing, press Esc to cancel the progress box. You can then exit 3BM and boot to the operating system before the process of writing zeroes to the drives is complete. Once you have booted to the operating system, initialization of the RAID 5 or RAID 50 unit will begin after a delay of up to ten minutes.
Checking the Motherboard Boot Sequence 4 On the Maintain Disk Array screen, Tab to Verify Array and change the selection to Yes. 5 Tab to OK and press Enter. Initialization of the unit begins. Initialization of a RAID 1 unit results in data from one disk (the disk on the lower channel number) being copied to the other disk. In RAID 10 units, data from one half of the array is copied to the other half.
Configuring Units Installing Drivers and Making the Units Available For Use The final steps in setting up your RAID arrays are to load the 3ware drivers and make the units available to your operating system. Will the unit you have created be your system's boot device? If so, you will install the driver for the controller as you install the operating system.
Driver Installation Under Windows Note: Before installing the 3ware driver, you must have already installed your 3ware RAID controller in the system. The 3ware RAID controller can be used with Microsoft Windows 2000 (SP3 or newer), Windows XP (SP1 or newer), and Windows Server 2003. Windows 2003 64-bit for AMD Opteron is also supported. It is recommended that you upgrade to the latest service pack available.
Driver Installation Under Windows Materials Required 3ware software CD-ROM Microsoft Windows 2000, XP, or Server 2003 installation CDROM. (Not required if Windows is already installed on another drive.). Floppy diskette, to create a driver diskette. If you are installing Windows, you must create a 3ware driver diskette. If Windows is already installed on another device, you may install the 3ware driver from either the 3ware software CD-ROM or from a diskette.
Installing the 3ware Driver and Windows on a New Unit 3 In the 3ware Driver & Firmware Images menu, click the appropriate button to create the driver diskette that you need. Note that there are both 32-bit and 64-bit AMD drivers available for Windows. Be sure to select the correct one. 4 When the confirm message appears, insert a blank diskette into a floppy drive and click the Yes button to begin the process.
Driver Installation Under Windows 5 Type S if you have additional devices to add. Otherwise, press Enter. 6 If the “Digital Signature Not Found” message appears, click Yes to continue the installation. (If there are multiple controllers in the system, you will see this message once for each controller.) 7 Continue with the normal Windows installation at this point. There are no instructions after installing the driver that are specific to 3ware.
Installing the Driver on a System that Boots from a Different Device To install the 3ware driver under Windows 2000 When you start Windows after installing a 3ware RAID controller, Windows recognizes it as a Plug and Play device, and brings up the Found New Hardware Wizard. This wizard guides you through installing the 3ware drivers (see Figure 17). Note that you will see screens for the installation of two drivers during this process. Figure 17.
Driver Installation Under Windows 4 When the Completing the Found New Hardware Wizard screen appears (Figure 18), click Finish. Figure 18. Completing Found New Hardware Wizard 5 58 If the “Completing” screen similar to Figure 18 indicates that you should restart your computer, do so now.
Installing the Driver on a System that Boots from a Different Device 6 When the Install Hardware Device Drivers screen appears (Figure 19), click Next and follow the prompts on the screen to install the second driver. Figure 19. Install Hardware Device Drivers 7 When the second Completing the Found New Hardware screen appears, click Finish. Figure 20. Completing Found New Hardware Wizard www.3ware.
Driver Installation Under Windows After the driver has been installed, continue with the instructions under “Making Units Managed by a 3ware Controller Available to Windows” on page 63. To install the 3ware driver under Windows XP or 2003 When you start Windows after installing a 3ware RAID controller, Windows recognizes it as a Plug and Play device, and brings up the Found New Hardware Wizard. This wizard guides you in installing the 3ware drivers (see Figure 21).
Installing the Driver on a System that Boots from a Different Device 4 When the Completing the Found New Hardware Wizard screen appears (Figure 22), click Finish. Figure 22. Completing Found New Hardware Wizard 5 If the “Completing” screen similar to Figure 22 indicates that you should restart your computer, do so now. 6 When the Welcome to the Found New Hardware Wizard screen appears again (Figure 23), click Next and follow the prompts on the screen to install the second driver. www.3ware.
Driver Installation Under Windows Figure 23. Welcome to the Found New Hardware Wizard 7 When the second Completing the Found New Hardware screen appears, click Finish. Figure 24. Completing Found New Hardware Wizard After the driver has been installed, continue with the instructions below under “Making Units Managed by a 3ware Controller Available to Windows” on page 63.
Making Units Managed by a 3ware Controller Available to Windows Making Units Managed by a 3ware Controller Available to Windows After the 3ware driver has been installed, you need to partition and format the new units or disks. 1 Remove the driver diskette or CD, reboot the system, and log in as the system administrator. 2 Use Disk Administrator to partition and format the new arrays or disks: a From the Start menu, choose Administrative Tools > Computer Management.
Driver Installation Under Windows Finishing Up Your RAID unit is now ready for use. You may also want to install 3ware’s browser-based Disk Management tool, 3DM 2, or the 3ware Command Line Interface (CLI). With 3DM 2 and CLI, you can maintain your RAID units while running Windows. For more information, see the 3ware 9000 Series Serial ATA RAID Controller User Guide and the 3ware Escalade 9000 Series Serial ATA RAID Controller CLI Guide.
Driver Installation Under Linux Note: Before installing the 3ware driver, you must have already installed your 3ware RAID controller in the system. A drive or unit managed by the 3ware RAID controller may be configured to be your system’s boot device. Or, you can use another device as your boot device, such as a disk attached to the motherboard.
Driver Installation Under Linux If you are using a Linux distribution for which there is not a compiled driver available from 3ware, you can copy the source from the 3ware software CD or download the source from the 3ware website and compile a new driver. For more information, see “Compiling a 3ware Driver for Red Hat Linux” on page 77 and “Compiling a 3ware Driver for SuSE Linux” on page 83.
Obtaining 3ware Linux Drivers refer only to the 9000 series driver. For information about using the 7/8000 driver and controller, refer to the user guide or installation procedure for the 7/8000-series controller. Warning: Be sure to use the correct driver for your processor. Be sure you load the correct driver on your system. It is possible to load the wrong driver onto a system, however when you boot such systems, they will not work.
Driver Installation Under Linux Determining the Current Version of your 3ware Driver If you already have a 3ware controller installed, you can check the current driver version. If you have a 2.4 kernel or earlier, type the following command: cat /proc/scsi/3w-9xxx/* where the asterisk (*) represents SCSI host ID and “9xxx” represents the family of the controller. For example: cat /proc/scsi/3w-9xxx/0 If you have a 2.
Driver Installation Under Red Hat Linux Creating a Red Hat Linux Driver Diskette If you are installing Linux on the new drive or unit managed by the 3ware RAID controller, you must create a 3ware driver diskette. If Linux is already installed on another device, you may install the 3ware driver from either the 3ware software CD-ROM or make a driver diskette. To create a driver diskette 1 Insert the 3ware software CD into your system.
Driver Installation Under Linux 1 Boot with the Red Hat CD or diskette: a Insert either the Red Hat CD-ROM disk or a Red Hat boot diskette into your computer. b Start or reboot your computer. c When the Welcome to Red Hat display appears, type expert at the boot prompt. boot: expert A number of files will load and then a message will prompt you to insert your driver disk. 2 Install the driver: Insert the driver diskette containing the 3ware driver for Red Hat and press Enter.
Driver Installation Under Red Hat Linux About Variables In the Driver Installation Instructions These conventions are used for variable text for kernel strings and module names in the instructions on the following pages. Kernel String Conventions refers to the kernel version. The kernel string will have different endings, depending on the kernel you are using. For an SMP kernel (multi-processor), the kernel string will end in smp. For example: 2.4.18-14smp.
Driver Installation Under Linux To install the 3ware driver and update the RAM disk 1 2 3 Log in as root and open a console window. Mount the CD which contains the 3ware driver: To mount the CD, type: mount /dev/cdrom and press Enter. Copy the driver: For Redhat workstation on Intel x86, type: cp /mnt/cdrom/packages/drivers/linux/redhat/ ws3_u3/x86_intel/3w-9xxx.* /lib/modules/ /kernel/drivers/scsi/ 3w-9xxx.o If prompted to overwrite, type y.
Driver Installation Under Red Hat Linux 4 If you installed a previous driver when you installed your operating system, then perform this step to copy the driver into the update directory, as well. Otherwise, go on to Step 5. For Redhat workstation on Intel x86, type: cp /mnt/cdrom/packages/drivers/linux/redhat/ ws3_us/x86_intel/3w-9xxx.* /lib/modules/ /update 3w-9xxx.o If prompted to overwrite, type y.
Driver Installation Under Linux 6 Update the modules.dep file, by issuing the following command: Run /sbin/depmod -a 7 Run mkinitrd by entering the following: /sbin/mkinitrd -v -f /boot/initrd-.img where is the /lib/modules directory from which to copy the 3w-9xxx driver. Example: /sbin/mkinitrd –v –f /boot/initrd-2.4.18-14.img 2.4.18-14 8 If you are using the GRUB boot loader, skip to Step 5.
Driver Installation Under Red Hat Linux 3 Copy the driver: For Redhat workstation on Intel x86, type: cp /mnt/cdrom/packages/drivers/linux/redhat/ ws3_u3/x86_intel/3w-9xxx.* /lib/modules/ /kernel/drivers/scsi/ 3w-9xxx.o If prompted to overwrite, type y. For Redhat workstation on AMD Athlon 32-bit, type: cp /mnt/cdrom/packages/drivers/linux/redhat/ ws3_u3/x86_athlon/3w-9xxx.* /lib/modules/ /kernel/drivers/scsi/ 3w-9xxx.o If prompted to overwrite, type y.
Driver Installation Under Linux For Redhat workstation on AMD Athlon 32-bit, type: cp /mnt/cdrom/packages/drivers/linux/redhat/ ws3_u3/x86_athlon/3w-9xxx.* /lib/modules/ /update 3w-9xxx.o If prompted to overwrite, type y. For Redhat workstation on AMD Opteron and EM64T, type: cp /mnt/cdrom/packages/drivers/linux/redhat/ ws3_u3/x86_64/3w-9xxx.* /lib/modules/ /update 3w-9xxx.ko If prompted to overwrite, type y.
Driver Installation Under Red Hat Linux Compiling a 3ware Driver for Red Hat Linux For Experts Only If necessary, you can compile the 3ware driver yourself. (For example, if you are running a different kernel version.) Notes: You must have a full Linux kernel source tree in /usr/src/linux in order to do the compile. In addition, you must boot to the UP kernel to use the make targets. Otherwise errors will result that will cause the driver build to fail.
Driver Installation Under Linux Note: In the commands below, remember that the text you enter is case sensitive. (Be sure to type Makefile.rh, not makefile.rh.) To build UP module, type: make -f Makefile.rh The file created is 3w-9xxx.o for 2.4 kernels, and 3w-9xxx.ko for 2.6 kernels. To build SMP module, type: make smp -f Makefile.rh The file created is 3w-9xxx.smp To build Enterprise module, type: make ent -f Makefile.rh The file created is 3w-9xxx.
Driver Installation Under Red Hat Linux To build IA32E module (this is used when creating a driver for the x86_64/EM64T 64-bit driver diskette), type: make ia32e -f Makefile.rh The file created is 3w-9xxx.i32 6 Copy the module as follows: For 2.4 kernels, copy module to: /lib/modules//kernel/drivers/scsi/ If you installed a previous driver when you installed your operating system, then perform this step to copy the driver into the update directory, as well.
Driver Installation Under Linux Driver Installation Under SuSE Linux Materials required 3ware software CD-ROM Floppy diskette, if you need to make a driver diskette. SuSE Linux Installation CD-ROM/DVD (Not required if SuSE Linux is already installed on another drive.) Creating a SuSE Linux Driver Diskette If you are installing Linux on the new drive or unit managed by the 3ware RAID controller, you must create a 3ware driver diskette.
Driver Installation Under SuSE Linux Installing the 3ware Driver and SuSE Linux with YaST2 on a New Unit Note: If SuSE Linux is already installed on another drive, turn to “Installing the 3ware Driver on a SuSE Linux System that Boots from a Different Device” on page 81. 1 Boot directly from the SuSE installation CD #1 or DVD. 2 When installing SuSE, press the F6 key You will then be prompted to insert the driver disk. 3 Insert the 3ware Linux driver installation diskette.
Driver Installation Under Linux Note about variables: In the instruction below, replace with the kernel version you are using (i.e. 2.6, etc.), replace *** with your version of SuSE. In addition, replace 3w-9xxx.* with the appropriate module file for your kernel. The available module files are: For UP kernels: 3w-9xxx.ko For SMP kernels: 3w-9xxx.smp For BigSMP (high memory) kernels: 3w-9xxx.big 3 If you are using SuSE 9.
Driver Installation Under SuSE Linux 7 If you are using the GRUB boot loader, you are finished. If you are using the LILO boot loader, run LILO to update the boot record on disk by typing the following: /sbin/lilo The output should be similar to: Added linux * Compiling a 3ware Driver for SuSE Linux For Experts Only If you wish to compile the driver yourself (for a different kernel version that you are running), then perform the following steps. (Note that the steps vary somewhat for 2.4 kernels and 2.
Driver Installation Under Linux 5 Copy the config file for the kernel you want to build module for from the appropriate /usr/src/linux/arch directory (listed below) to /usr/src/linux/.config. kernel directory x86 UP /usr/src/linux/arch/i386/defconfig.default x86 SMP /usr/src/linux/arch/i386/defconfig.smp4g x86 ATHLON /usr/src/linux/arch/i386/defconfig.athlon 6 Make oldconfig 7 Untar the driver source with this command: tar zxfv 3w-9xxx.
Driver Installation Under SuSE Linux To compile a 3ware driver for SuSE Linux 2.6 kernels 1 Download the 3ware 2.6 driver source from the 3ware website (www.3ware.com). 2 Copy the driver source into a working directory. (The latest 3ware driver source is bundled with the latest firmware and is in the /src sub-directory.) 3 Install the Kernel source under /usr/src 4 Create a symbolic link.
Driver Installation Under Linux 9 Change directory to driver. cd driver 10 To build the module, type make The 3w-9xxx.ko module will be built and output to the driver directory created when you untared the 3w-9xxx.tgz file. This will take a while, since the 2.6 build process exports our module to the kernel module list and then builds all kernel modules. 11 Copy the module 3w-9xxx.ko to /lib/modules//kernel/drivers/scsi/ 3w-9xxx.ko 12 Edit /etc/modprobe.
Driver Installation Under FreeBSD Note: Before installing the 3ware driver, you must have already installed your 3ware RAID controller in the system. A drive or unit managed by the 3ware RAID controller may be configured to be your system’s boot device. Or, you can use another device as your boot device, such as a disk attached to the motherboard. The steps you follow to install the driver and make your RAID unit available depend on whether it will be your boot device.
Driver Installation Under FreeBSD Obtaining 3ware FreeBSD Drivers FreeBSD 4.10 and later have 9.xxx driver support built in. No driver installation is required. If you are using FreeBSD 4.8 or 4.9, you will need to install the 3ware FreeBSD driver as described below. The 3ware software CD-ROM that came with the 3ware RAID controller includes compiled and tested drivers for FreeBSD 4.8 and 4.9. To see if a more recent driver is available, please see the 3ware web site.
Installing the Driver While Installing FreeBSD on the 3ware RAID Controller To install the driver as a module 1 Boot with the FreeBSD CD-ROM or diskette. 2 In the sysinstall menu, select Configure > Load KLD module. Note: Immediately after the OS starts booting from the CD, insert an MS-DOS floppy with the 3ware driver, twa.ko, into the floppy drive. If you do not insert it immediately, sysinstall may fail to recognize the floppy drive. 3 Load the driver from the floppy drive.
Driver Installation Under FreeBSD b Mount the floppy. mount -t msdos /dev/fd0 /floppy c Copy the driver file to the appropriate directory. For FreeBSD 4.x, copy the files to: cp /floppy/twa.ko /modules/twa.ko For FreeBSD 5.x, copy the files to: cp /floppy/twa.ko /boot/kernel/twa.ko d Add line 'twa_load="YES"' to the file /boot/loader.conf 5 Eject the floppy disk and reboot. The 3ware driver, twa.ko, should be automatically loaded at reboot time.
Installing the Driver While Installing FreeBSD on the 3ware RAID Controller drive. If you do not insert it immediately, the loader may fail to recognize the floppy drive. 7 At the loader prompt, run ‘lsdev’ to make sure the floppy drive has been discovered. 8 Run ‘load disk0:twa.ko’ (assuming disk0 is the floppy drive) 9 Run ‘boot’. The system should now be able to boot. 10 After the system boots up, change the kernel build infrastructure to include the 3ware driver sources.
Driver Installation Under FreeBSD TWA_FIRMWARE_FLASH opt_twa.h and the following line to your kernel configuration file (“custom” in the example above): options j TWA_FLASH_FIRMWARE If you intend to enable printing of debug messages in the driver, add the following line to /sys/conf/options: TWA_DEBUG opt_twa.
Installing the 3ware Driver on a FreeBSD System that Boots from a Differ- Note: Since twa.ko behaves like a SCSI driver, the units that it controls are seen as da0, da1 etc. To make the driver part of the kernel 1 Create the directory /sys/dev/twa mkdir /sys/dev/twa 2 Copy the 3ware driver source file archive (twa.tgz) to the directory you created in step 1. 3 Unpack the 3ware driver source files. cd /sys/dev/twa tar -xzvf twa.
Driver Installation Under FreeBSD h Add the following line to “Makefile.i386’ CFLAGS+=-I/sys/dev/twa i If you intend to bundle the firmware image with the driver, add the following line to /sys/conf/options: TWA_FIRMWARE_FLASH opt_twa.h and the following line to your kernel configuration file (“custom” in the example above): options j TWA_FLASH_FIRMWARE If you intend to enable printing of debug messages in the driver, add the following line to /sys/conf/options: TWA_DEBUG opt_twa.
Installing the 3ware Driver on a FreeBSD System that Boots from a Differ- 3 Unpack the driver source files. cd /sys/dev/twa tar -xzvf twa.
Driver Installation Under FreeBSD 96 3ware 9000 Series Serial ATA RAID Controller Installation Guide
Troubleshooting: Problems and Solutions This chapter includes solutions to problems users sometimes encounter when using 3ware RAID controllers. For support, troubleshooting tips, frequently asked questions, software releases, and compatibility information related to 3ware RAID controllers, refer to: 3ware support page at: http://www.3ware.com/support/ 3ware knowledgebase: http://www.3ware.com/KB/kb.asp 3ware software downloads: http://www.3ware.com/support/download.
Troubleshooting: Problems and Solutions Use a screwdriver to remove the black end rail. It aligns and secures the 3ware RAID controller in the computer chassis but is not critical for operation. Q2: The system doesn’t begin booting (no BIOS runs) when the 3ware RAID controller is installed but boots OK when the controller is removed. Check the cabling between the drives and the 3ware RAID controller. A cable plugged in upside down can prevent your system from running its BIOS.
Appendix A. Installing the Battery Backup Unit The Battery Backup Unit (BBU) is an add-on that can be attached to a 3ware 9000 RAID controller to supply power to the memory module from an attached battery pack in the event of a system power loss. This allows the controller to use write-caching for optimal performance and not be exposed to data loss in the event of a system power failure.
Appendix A.
Installation Overview a) Slots on the edge b) BBU receptacle c) Hole for post Figure 2. Points of connection on the full-height controller (top view) a) Slots on the edge b) BBU receptacle c) Hole for post Figure 3. Points of connection on the half-height controller (top view) Note: If your 9000 series controller does not have the BBU receptacle, contact technical support for assistance. www.3ware.
Appendix A. Installing the Battery Backup Unit Installation Instructions 1 For full-height controllers, turn the controller memory-side down on a flat surface. 2 Remove the screws that connect the PCI bracket to the controller and set the bracket aside. Half-height board: bracket unscrews from top side of board. Full-height board: bracket unscrews from bottom side of board. Figure 4. Removing the screws from the PCI bracket 3 102 For full-height controllers, turn the controller memory side up.
Installation Instructions 4 Make sure the battery cable is fastened under the cable management clips, as shown in Figure 5. Cable management clips Figure 5. Battery cable inserted through cable management clips 5 Match the clips on the end of the BBU to the slots on the edge of the controller to create a hinge and rotate the BBU to position it over the card, as shown in Figures 6 and 7. Figure 6. Clips on the BBU match to slots on the controller Hole for post Figure 7.
Appendix A. Installing the Battery Backup Unit 6 7 Align the Battery Backup Unit to the controller with these connectors: Mate the connector on the BBU with the receptacle on the controller. Match the plastic post on the BBU with the hole on the controller. Press down gently until the BBU is seated. Figure 8. BBU attached to controller 8 Reconnect the PCI bracket, using the phillips screws you removed in Step 2.
Installation Instructions 9 Insert the battery power connector into the power receptacle on the BBU. Figure 9. Battery power connector and power receptacle The controller is now ready to install in your system. Figures 10 and 11 show the BBU fully installed on 3ware controllers. You can check the status of the battery, and run a battery test to determine if the battery needs to be replaced. For details, see 3ware 9000 Series Serial ATA RAID Controller User Guide. www.3ware.
Appendix A. Installing the Battery Backup Unit Figure 10.
Replacing the Battery Replacing the Battery The Battery Backup Unit (BBU) will last for many years. The battery has an expected life span of one to two years depending on usage. You can check the current status of the battery, and test it. For details, see instructions in 3ware 9000 Series Serial ATA RAID Controller User Guide. Caution: There is a risk of explosion if the battery is replaced by an incorrect type. To obtain a replacement battery, contact AMCC.
Appendix A. Installing the Battery Backup Unit 3 Disconnect the battery power cable from the BBU. To do so, press down on the lever-like clip on the battery power connector and slide it out of the slot. Figure 11. Power cable from the battery to the BBU 4 Slide the battery out of the plastic. 5 Insert the new battery and cable it up. 6 If necessary, reinstall the 3ware RAID controller, close up your system and restart it.
Appendix B. Compliance and Conformity Statements Federal Communications Commission Radio Frequency Interference Statement This equipment has been tested and found to comply with the limits for a Class B digital device, pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference in a residential installation.
Appendix B. Compliance and Conformity Statements Consult the dealer or an experienced radio/TV technician for help. To maintain compliance with FCC radio frequency emission limits, use shielded cables and connectors between all parts of the computer system. Microsoft Windows Hardware Quality Lab (WHQL) AMCC is committed to Microsoft Windows Hardware Quality Labs (WHQL) certification for all its products.
European Community Conformity Statement EN 61000-4-2 Electromagnetic compatibility (EMC) Part 4: Testing and measurement techniques Section 2: Electrostatic discharge immunity test EN 61000-4-3 Electromagnetic compatibility (EMC) Part 4: Testing and measurement techniques Section 3: Radiated, RadioFrequency, Electromagnetic Field Immunity Test EN 61000-4-4 Electromagnetic compatibility (EMC) Part 4: Testing and measurement techniques Section 4: Electrical fast transient/ burst immunity test EN 60950 Safet
Appendix C. Warranty, Technical Support, and Service Appendix C. Warranty, Technical Support, and Service Limited Warranty RAID Controller Hardware. 3-Year Hardware Warranty: AMCC warrants this product against defects in material and workmanship for a period of thirty-six (36) months from the date of original purchase. AMCC, at no charge and at its option, will repair or replace any part of this product which proves defective by reason of improper workmanship or materials.
Exclusions For detailed terms and conditions, please see the Limited Hardware Warranty and Software License Agreement at our website: http://www.3ware.com/support/rma_form.asp AMCC warranty service is provided by returning the defective product to AMCC. Exclusions This warranty does not cover any damage to this product which results from accident, abuse, misuse, natural or personal disaster, or any unauthorized disassembly, repair or modification.
Appendix C. Warranty, Technical Support, and Service Obtaining Warranty Protection To obtain warranty service during the warranty period call AMCC toll free at (800)-945-7273 or (408) 523-1145 (direct) as soon as you have identified a problem with your AMCC 3ware Serial ATA RAID controller unit. You will be issued a return material authorization (RMA) number. AMCC will send a replacement in approximately two business days after receipt of the defective unit (transit time not included).
Sales and Ordering Information The 3ware software library is accessible at: http://www.3ware.com/support/download.asp Web-based software downloads feature upgrading multiple switches simultaneously. For specific answers to questions or to give feedback about the product, visit our Web site at http://www.3ware.com/support and use our convenient e-mail form. AMCC also offers toll-free (800) 945-7273 and (408) 523-1145 direct phone support during normal business hours.
Appendix C.
Index Numerics 3BM BIOS Manager 34 configuration utility 34 navigating 38 shortcut keys while working in 38 A Accelerated Graphics Port (AGP) 8 auto-carving 33, 47 B backplane, using with multi-lane connectors 19 BBU (battery backup unit) installation 99 replacing the battery 99 BIOS Manager 34 C cable length, routing space, air flow 8 Compliance and Conformity 109 configuring BIOS Manager 34 determining RAID level to use 31 initializing units 49 RAID concepts and levels 28 units 40 using 3BM 38 D distribut
Index driver under Linux 65 driver under Red Hat Linux 68 driver under SuSE Linux 80 driver, Windows 53 formatting 63 hardware 7 LED status connectors 9 making units available 63 overview 5 partitioning 63 RAID controller 7 safety 10 serial ATA RAID controller 12 serial ATA RAID controller with multi-lane internal connectors 19 slot location 8 tools and equipment 10 troubleshooting 97 J JBOD 48 K kernel strings for RedHat 71 L LED Status Connector details about connecting 13 whether to use 9 LED status con
