Sun StorageTek™ SAS RAID HBA Installation Guide Eight-Port, External HBA Model SG-XPCIESAS-R-EXT-Z Sun Microsystems, Inc. www.sun.com Part No. 820-1260-15 November 2009, Revision A Submit comments about this document by clicking the Feedback[+] link at: http://docs.sun.
Copyright © 2009 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved. U.S. Government Rights - Commercial software. Government users are subject to the Sun Microsystems, Inc. standard license agreement and applicable provisions of the FAR and its supplements. Use is subject to license terms. This distribution may include materials developed by third parties.
Contents Preface 1. xv HBA Overview Kit Contents HBA Features 1 1 2 Array-Level Features 2 Advanced Data Protection Suite Component Layout 3 3 Operating System and Technology Requirements System Interoperability 6 Host Platform Support Server Support 6 7 Storage System Support Software Support 2.
Installing the Battery Backup Module ▼ 12 To Install the Battery Backup Module 12 Verifying the Current Devices on a SPARC System ▼ To Verify the Current Devices Installing the HBA ▼ 14 15 To Install the HBA 15 Connecting Disk Drive Enclosures ▼ 16 17 ▼ To Test the HBA Installation on a SPARC System ▼ To Test the HBA Installation on an x64 System Next Steps 17 20 22 Removing the Hardware 22 ▼ To Prepare the HBA for Removal ▼ To Remove the HBA 22 23 Installing the Driver on an E
BIOS Utility Issues 30 Creating an Array With the BIOS Utility Changes the BIOS Boot Order Hot-Plug Functionality Does Not Work in the BIOS Utility Performance Issues 30 30 30 ZFS Forces a Flush of the NVRAM on the HBA When Completing Synchronous Writes, Which Impacts Performance 31 The System Freezes When a Sun Storage 32GB SLC SATA Solid State Drive (SSD) Is Configured In the HBA 32 A Space Usage Error Message Is Displayed When Trying to Expand an Existing Volume 32 Cannot Access the HBA From the GU
SATA Pin-Out C.
▼ To Identify a Disk Drive With the Disk Utilities Viewing the BIOS-Based Event Log ▼ D. 59 To View the BIOS-Based Event Log Troubleshooting 59 61 Troubleshooting Checklist Silencing the Alarm 61 62 Recovering From a Disk Drive Failure 62 Failed Disk Drive Protected by a Hot-Spare ▼ To Recover From the Failure 62 62 Failed Disk Drive Not Protected by a Hot-Spare Failure in Multiple Arrays Simultaneously Disk Drive Failure in a RAID 0 Array Multiple Failures in the Same Array E.
Replacing an HBA On a SPARC System Replacing an HBA On an x64 System F. Selecting the Best RAID Level 73 Understanding Drive Segments 74 Nonredundant Arrays (RAID 0) 74 RAID 1 Arrays RAID 10 Arrays 76 77 78 RAID 5EE Arrays RAID 50 Arrays RAID 6 Arrays 79 80 82 RAID 60 Arrays 83 Selecting the Best RAID Level Migrating RAID Levels G.
Backplane Connections 90 SAS Expander Connections 91 Differences Between SAS and Parallel SCSI H.
x Sun StorageTek SAS RAID HBA Installation Guide Eight-Port, External HBA • November 2009
Figures FIGURE 1-1 Sun StorageTek SAS RAID External HBA Component Layout 4 FIGURE 2-1 External SAS Cable (SFF-8088 Connector) Used to Connect to an External Hard Disk Drive Enclosure 11 FIGURE 2-2 Installing the BBU FIGURE 2-3 Remove Slot Cover from Expansion Slot FIGURE 2-4 Installing the Sun StorageTek SAS RAID External HBA FIGURE F-1 RAID 0 Array 75 FIGURE F-2 RAID 1 Array 76 FIGURE F-3 RAID 1 Enhanced Array FIGURE F-4 RAID 10 Array 78 FIGURE F-5 RAID 5 Array FIGURE F-6 RAID 5EE
xii Sun StorageTek SAS RAID HBA Installation Guide Eight-Port, External HBA • November 2009
Tables TABLE 1-1 Sun StorageTek SAS RAID External HBA Features TABLE 1-2 Supported Operating System Versions TABLE 1-1 Supported Servers TABLE 1-3 Software Support 8 TABLE B-1 Environmental Specifications TABLE B-2 SAS Pin-Out TABLE B-3 SATA Data Pin-Out TABLE B-4 SATA Power Pin-out TABLE C-1 General HBA Settings TABLE C-2 SAS HBA Settings 55 TABLE C-3 Information Provided by Disk Utilities TABLE F-1 Selecting the Best RAID Level TABLE F-2 Supported RAID Level Migrations TABLE G-1
xiv Sun StorageTek SAS RAID HBA Installation Guide Eight-Port, External HBA • November 2009
Preface This installation guide explains how to install the eight-port, external Sun StorageTekTM SAS RAID HBA (referred to in this document as Sun StorageTek SAS RAID External HBA). It also describes how to install the driver, and provides a basic overview of Serial Attached SCSI (SAS) and Redundant Array of Independent Disk (RAID) technology.
Related Documentation The following table lists the documentation for this product. The online documentation is available at: http://docs.sun.com/app/docs/prod/stortek.raid.
Third-Party Web Sites Sun is not responsible for the availability of third-party web sites mentioned in this document. Sun does not endorse and is not responsible or liable for any content, advertising, products, or other materials that are available on or through such sites or resources.
xviii Sun StorageTek SAS RAID HBA Installation Guide Eight-Port, External HBA • November 2009
CHAPTER 1 HBA Overview This chapter provides an overview of the eight-port, external Sun StorageTek SAS RAID HBA (referred to in this document as Sun StorageTek SAS RAID External HBA), which uses Adaptec® technology. The chapter describes the various operating systems, host platforms, and infrastructure configurations that support the HBA.
HBA Features The external Sun StorageTek SAS RAID HBA (SG-XPCIESAS-R-EXT-Z) has the following features: Note – These features are supported by some operating systems but not others. For more information, refer to the Sun StorageTek RAID Manager Software User’s Guide or online Help.
■ Support for array migration from one RAID level to another Advanced Data Protection Suite ■ Copyback Hot-Spare—You can use this feature to move data from a hot-spare back to its original location after a failed disk drive is replaced. ■ Striped Mirror (RAID 1E)—A RAID 1 Enhanced array is similar to a RAID 1 array except that data is both mirrored and striped, and more disk drives can be included.
FIGURE 1-1 Sun StorageTek SAS RAID External HBA Component Layout TABLE 1-1 Sun StorageTek SAS RAID External HBA Features Feature Specification Form Factor Low-profile MD2 Bus compatibility PCIe PCIe bus width x8 PCIe bus speed 2.
TABLE 1-1 Sun StorageTek SAS RAID External HBA Features Feature (Continued) Specification (Continued) Enclosure Support I2C and SGPIO (Serial General Purpose Output) Automatic Failover Onboard speaker Audible alarm Battery Backup Module ABM-800 Operating System and Technology Requirements This HBA supports, at a minimum, the following operating system and technology versions.
TABLE 1-2 Supported Operating System Versions (Continued) Operating System/Technology Supported Versions (minimum) • SUSE Linux Enterprise Server (SLES) 10 • SUSE Linux Enterprise Server (SLES) 9, SP4 VMware® Technology ESX Server version 3.0.2, Update 1 (driver support only; storage management must be done through the command-line interface and BIOS utility. For more information, see the Uniform Command-Line Interface User’s Guide at: http://docs.sun.com/app/docs/prod/stortek.raid.
Server Support TABLE 1-1 lists the servers that the HBA supports.
■ Sun Storage J4400 ■ Sun Storage J4500 Software Support TABLE 1-3 lists the software applications that are supported by this HBA. TABLE 1-3 8 Software Support Software Supported OS VERITAS Software Foundation 5.0 Solaris Sun StorEdge Enterprise Backup Software 6.0B/7.0/7.1 Solaris, Linux, and Windows VERITAS NetBackup 6.
CHAPTER 2 Hardware Installation and Removal This chapter explains how to install and remove the Sun StorageTek SAS RAID External HBA, and how to connect external disk drive enclosures.
■ Always use a properly fitted and grounded wrist strap or other suitable ESD protection when handling the HBA and observe proper ESD grounding techniques. ■ Hold the HBA by the edge of the PCB, not the connectors. ■ Place the HBA on a properly grounded antistatic work surface pad when it is out of its protective antistatic bag. Preparing for Hardware Installation ▼ To Prepare for Hardware Installation 1. Read “Safety Agency Compliance Statements” on page 99. 2.
FIGURE 2-1 External SAS Cable (SFF-8088 Connector) Used to Connect to an External Hard Disk Drive Enclosure 5. If you are installing the HBA into a full-height computer chassis, replace the original low-profile bracket with the full-height bracket included in the HBA ship kit. Caution – Handle the HBA by its bracket or edges only. Installation Task Map The following procedure describes the tasks to perform in order to install the HBA on an existing operating system (OS): 1.
4. Install the HBA driver. See “Installing the Driver on an Existing Operating System” on page 25. 5. Install the Sun StorageTek RAID Manager GUI and begin to manage data storage. Use the Sun StorageTek RAID Manager CD provided in the HBA ship kit to install the Sun StorageTek RAID Manager software. For information about installing and using the software, see the Sun StorageTek RAID Manager Software User’s Guide. For the latest version of the software, go to: http://support.intel.com/support/go/sunraid.htm.
FIGURE 2-2 Installing the BBU 5. Place a spacer over each screw. The BBU connector on the HBA is between the two screw holes closest to the right edge of the HBA. 6. Line up the BBU connector on the BBU module with the connector on the HBA. The screws you inserted will line up with matching holes in the BBU. 7. Gently press down on the right edge of the BBU module until the connectors click into place. Caution – DO NOT force the connection.
b. With the Phillips head screw driver, reach underneath the HBA and, while holding the nut in place with your other hand (or with needle nose pliers or tweezers), screw the plastic screw into the nut. c. Repeat Step a - Step b for the remaining nuts. Note – If you are unable to place a nut onto the screw that is close to the heat sink, use a small pair of needle nose pliers or tweezers. Caution – Do not over-tighten the nuts.
Installing the HBA Note – For the Sun SPARC Enterprise T5120, T5220, T5140, and T5240 servers, contact Sun support to install the HBA. ▼ To Install the HBA 1. Turn off the computer and disconnect the power cord. 2. Open the cabinet, following the manufacturer instructions. 3. Select an available x8 PCI-Express expansion slot that is compatible with the HBA and remove the slot cover as shown in FIGURE 2-3. Caution – Touch a grounded metal object before handling the HBA.
FIGURE 2-4 Installing the Sun StorageTek SAS RAID External HBA 5. Secure the bracket in the x8 PCI Express slot, using the retention device (for instance, a screw or lever) supplied with the computer. 6. Connect the disk activity LED cable of the computer to the LED connector on the HBA. Ensure that the positive lead of the LED cable (usually a red wire or a wire marked with a red stripe) is attached to pin 1. 7.
Testing the HBA Installation This section contains the following subsections: ■ “To Test the HBA Installation on a SPARC System” on page 17 ■ “To Test the HBA Installation on an x64 System” on page 20 ▼ To Test the HBA Installation on a SPARC System 1. Power-up the computer and storage systems. a. Ensure that all hard disk drives are securely installed. b. Connect all power cords securely and plug them into the proper power sources. c.
Note – When you run this command, omit /disk from the HBA device path, as shown in the following example. {0} ok select /pci@0/pci@0/pci@8/pci@0/pci@8/scsi@0 Waiting for AAC Controller to start: . . . . . . . Started Config Changes: 1 ->One or more device either moved or removed or not responding or added Press to accept current config changes - with in 30 seconds (Default - Ignore changes and check the setup) Pressed. Current Config is accepted 4.
5. To display additional configuration information, list the device properties by using the .properties command. {0} ok .properties firmware-version 15815 assigned-addresses 820f0010 00000000 00e00000 00000000 00200000 820f0030 00000000 00d00000 00000000 00080000 compatible pciex9005,285.108e.286.9 pciex9005,285.108e.286 pciex9005,285.9 pciex9005,285 pciexclass,010400 pciexclass,0104 model AAC,285 reg 000f0000 00000000 00000000 00000000 00000000 030f0010 00000000 00000000 00000000 00200000 version 0.00.
▼ To Test the HBA Installation on an x64 System 1. Power-up the computer and storage systems: a. Ensure that all hard disk drives are securely installed. b. Connect all power cords securely and plug them into the proper power sources. c. If applicable, power-on the disk drive enclosure, and verify that all available HDD status indicators are normal for the storage enclosure(s) that they are in. d. Power-on the computer system. 2. Enter the BIOS RAID Configuration Utility (RCU) by doing the following: a.
4. Press Enter as prompted. 5. Verify that all attached HDDs are detected by the HBA: a. At the Main Menu, highlight Initialize Drives and press Enter. b. In the Select drives for initialization column, verify that all attached HDDs are displayed. c. Select drives to initialize them for verification. You can initialize all of the drives now or wait until you are ready to create arrays. 6. Verify that all HDDs are available for array creation: a.
d. Press Esc to exit. If any issues were discovered, correct them and retest the HBA before continuing. Next Steps To complete the installation, continue with “Installing the Driver on an Existing Operating System” on page 25. Removing the Hardware The following instructions describe the tasks required to remove the HBA. If you need to replace a failed HBA, remove the hardware, as described in this section, and see “Best Practices For Replacing an HBA” on page 70.
▼ To Remove the HBA 1. Remove the retention mechanism (screw, clip, and so on) that is securing the HBA bracket to the chassis. 2. Hold the upper portion of the bracket with one hand and the rear of the HBA with the other hand. 3. Pull straight up until the HBA clears the PCI Express expansion slot. 4. Lift the HBA from the computer chassis.
24 Sun StorageTek SAS RAID HBA Installation Guide Eight-Port, External HBA • November 2009
CHAPTER 3 Installing the Driver on an Existing Operating System This chapter describes how to install the HBA driver on an existing operatin system. The chapter contains the following sections: ■ “Preparing to Install the HBA Driver” on page 25 ■ “Installing the Driver on an Existing OS” on page 26 Preparing to Install the HBA Driver Before you begin, prepare to install the driver by doing the following. 1. Install and connect the HBA and disk drives. See “Hardware Installation and Removal” on page 9.
Installing the Driver on an Existing OS The driver can be installed on various operating systems.
2. Mount the CD. For example, to insert and mount a CD: Red Hat: mount /dev/cdrom /mnt/cdrom SUSE: mount /dev/cdrom /media/cdrom 3. Install the module RPM: rpm -Uvh mount-point/xxx/yyy.rpm Where mount-point is the specific mount point on the Linux system, xxx is the driver path, and yyy.rpm is the rpm file. 4. Reboot the computer to ensure the driver loaded correctly. 5. Run fdisk, mkfs, and create mount points for any new disk drives. 6.
▼ To Install the Driver on VMware Technology Note – The embedded driver provided by VMware ESX Server is suitable for most applications. If an updated driver is needed, use the following procedure. 1. Start the computer, then insert the driver CD. 2. At the console screen of the VMware ESX Server, mount the CD. For example: mount –r /dev/cdrom /mnt/cdrom 3. Install the module RPM: rpm –ivh /mnt/cdrom/xxx/yyy.rpm where xxx is the driver path, and yyy.rpm is the rpm file. 4.
CHAPTER 4 Known Issues This chapter contains the latest supplementary information for the preceding chapters in this guide. Specific Change Request (CR) identification numbers are provided for service personnel, when necessary. This chapter contains the following topics: ■ “Ship Kit Issues” on page 29 ■ “BIOS Utility Issues” on page 30 ■ “Performance Issues” on page 30 ■ “JBOD Issues” on page 33 Ship Kit Issues This section describes the known ship kit issue.
BIOS Utility Issues The following are known issues with the BIOS RAID Configuration utility: ■ “Creating an Array With the BIOS Utility Changes the BIOS Boot Order” on page 30 ■ “Hot-Plug Functionality Does Not Work in the BIOS Utility” on page 30 Creating an Array With the BIOS Utility Changes the BIOS Boot Order Workaround: After creating the array, check the BIOS settings to verify the correct boot order and make changes as necessary.
■ “Cannot Access the HBA From the GUI Nor Access a LUN From the Host” on page 33 ZFS Forces a Flush of the NVRAM on the HBA When Completing Synchronous Writes, Which Impacts Performance Workaround: As of Solaris 10 8/07 (s10u4), you can prevent ZFS from issuing SYNCHRONIZE CACHE commands to the NVRAM on the HBA by defining a ZFS global setting in the Solaris /etc/system file. This setting improves ZFS performance and is appropriate for Solaris 10 8/07.
The System Freezes When a Sun Storage 32GB SLC SATA Solid State Drive (SSD) Is Configured In the HBA CR 6806467 Issue: This occurs because the HBA has firmware prior to version 16732 installed on it and the Sun Storage 32GB SLC SATA SSD has firmware version 8626 or earlier installed on it. Workaround: Do the following: 1. Upgrade the HBA firmware to version 16732, at minimum. You can obtain the latest HBA firmware at: http://support.intel.com/support/go/sunraid.htm 2. Power cycle the HBA host system. 3.
Cannot Access the HBA From the GUI Nor Access a LUN From the Host CR 6820225 Workaround: Reboot the host system on which the HBA resides.
During System Boot Time, JBOD Affiliations Cause HBA Inoperability and System Panic CR 6723287 Issue: If you connect a JBOD with SATA disks to an HBA, and the JBOD has affiliations, the HBA might become inoperable and the Solaris system might panic during boot time. This occurs when the system has an old firmware version. Workaround: Do either of the following: ■ Upgrade the HBA firmware to version 15872, at minimum. To obtain the latest version of the firmware, go to: http://support.intel.
Chapter 4 Known Issues 35
36 Sun StorageTek SAS RAID HBA Installation Guide Eight-Port, External HBA • November 2009
APPENDIX A Configuration Rules This appendix provides configuration rules for the Sun StorageTek SAS RAID External HBA. Note – Use only Sun-approved devices and cabling with the Sun StorageTek SAS RAID External HBA.
Note – Mixing SATA and SAS HDDs in the same logical RAID array is not supported. Although it is not an unsupported configuration, it is also highly recommended that SAS and SATA HDDs not be mixed in the same enclosure.
APPENDIX B HBA Specifications This appendix provides specifications for the Sun StorageTek SAS RAID External HBA. The appendix contains the following sections: ■ “Physical Dimensions” on page 39 ■ “Environmental Specifications” on page 40 ■ “DC Power Requirements” on page 40 ■ “Current Requirements” on page 40 ■ “Performance Specifications” on page 40 ■ “Connector Pin Definitions” on page 41 Physical Dimensions Meets PCI low-profile MD2 specification.
Environmental Specifications Note – With a Battery Backup Unit (BBU), the ambient temperature must not exceed 40 ˚C TABLE B-1 Environmental Specifications Ambient temperature without forced airflow 0 ˚C to 40 ˚ C Ambient temperature with forced airflow 0 ˚C to 55 ˚ C Relative humidity 10% to 90%, noncondensing Altitude Up to 3,000 meters Note – Forced airflow is recommended. DC Power Requirements PCI-Express, DC Voltage 3.3 V 9%, 12 V 8% Current Requirements 1.04 A @ 3.3 VDC; 0.98 A @ 12.
■ Physical layer: Consists of two sets of differential lines, one receive set and one transmit set [4-wire total]. This layer defines the cable, connector, and transceiver [Transmitter / Receiver] characteristics. ■ PHY layer: Connects the differential Transmitter and Receiver circuits [ICs] to the Physical Layer. ■ Link layer ■ Port layer ■ Application layer The external connector accepts 4 physical links and the cable may hold between 1 and 4 physical links.
TABLE B-2 SAS Pin-Out Signal Name 1 Physical Link 2 Physical Links 3 Physical Links 4 Physical Links Rx 3- N/A N/A N/A S8 Tx 3- N/A N/A N/A S9 Tx 3+ N/A N/A N/A S10 Tx 2- N/A N/A S11 S11 Tx 2+ N/A N/A S12 S12 Tx 1- N/A S13 S13 S13 Tx 1+ N/A S14 S14 S14 Tx 0- S15 S15 S15 S15 Tx 0+ S16 S16 S16 S16 Signal Ground G1 - G9 G1 - G9 G1 - G9 G1 - G9 Chassis Ground Housing Housing Housing Housing SATA Pin-Out The Serial ATA [SATA] bus is defined over two sep
TABLE B-4 SATA Power Pin-out Pin# Signal Name Signal Description 1 V33 3.3v Power 2 V33 3.3v Power 3 V33 3.
44 Sun StorageTek SAS RAID HBA Installation Guide Eight-Port, External HBA • November 2009
APPENDIX C Using the BIOS RAID Configuration Utility The BIOS RAID Configuration utility is a BIOS-based utility that you can use to create and manage controllers, disk drives and other devices, and arrays. Note – If you are using a SPARC system, you cannot use the BIOS RAID Configuration utility. Instead, use the Sun StorageTek RAID Manager graphical user interface (GUI). For more information, see the Sun StorageTek RAID Manager Software User’s Guide at: http://docs.sun.com/app/docs/prod/stortek.raid.
Introduction to the BIOS RAID Configuration Utility The BIOS RAID Configuration utility comprises these tools: ■ The Array Configuration Utility (ACU)—For creating and managing arrays, and initializing and rescanning disk drives. See “Using the ACU to Create and Manage Arrays” on page 49. ■ A -Select Utility—SerialSelect, or SATASelect, for modifying the HBA and disk drive settings. See “Using the -Select Utility to Modify HBA Settings” on page 53.
■ The hard disk drive to be removed must not be a part of a logical device (its status must be ‘available’). ■ After the hard disk drive is removed from the enclosure, you must perform a bus scan by using the Rescan Drives option from the main menu of the Array Configuration Utility (ACU). ■ You must confirm that the Disk Utility reports the correct configuration of the attached target devices.
Running the BIOS RAID Configuration Utility This section describes how to start and navigate through the BIOS RAID Configuration utility. The section contains the following subsections: ■ “To Start the BIOS RAID Configuration Utility” on page 48 ■ “To Navigate the BIOS RAID Configuration Utility” on page 48 ▼ To Start the BIOS RAID Configuration Utility 1. If the HBA is connected to a RAID enclosure, power on the enclosure (or enclosures) before you power on the computer. 2.
Using the ACU to Create and Manage Arrays You can use the ACU, a tool of the BIOS RAID Configuration utility, to create and manage arrays.
▼ To Start Using the ACU 1. To open the ACU, start the BIOS RAID Configuration utility. See “Running the BIOS RAID Configuration Utility” on page 48. 2. If you have more than one HBA, select the HBA that you want to manage, and press Enter. 3. Select Array Configuration Utility, then press Enter. 4. Follow the on-screen instructions to create and manage arrays, and initialize, rescan, and erase disk drives.
▼ To Manage Existing Arrays With the ACU 1. Select Manage Arrays from the main ACU menu. 2. From the Manage Arrays menu, do any of the following: ■ View the properties of an array. Note – Failed drives are displayed in a different text color. ■ Make an array bootable. See “To Make an Array Bootable With the ACU” on page 51. ■ Assign or remove hot-spares. ■ Delete an array. Caution – Before deleting an array, back up the data to avoid permanently losing it.
▼ To Initialize Disk Drives With the ACU If a disk drive is displayed grayed-out (unavailable for use in a new array), it may need to be initialized. ● Select Initialize Drives from the main ACU menu. Caution – Do not initialize a disk drive that is part of an array. Initializing a disk drive that is part of an array may make the array unusable. Back up all data from the disk drive before you initialize it. ▼ To Rescan Disk Drives With the ACU ● Select Rescan Drives from the main ACU menu.
▼ To Stop a Secure Erase in Progress With the ACU 1. In the main ACU window, select Secure Erase. 2. Select the disk drive being secure erased, then press Ctrl+Q. The secure erase stops and the ACU returns to its main window. Using the -Select Utility to Modify HBA Settings Included in the BIOS RAID Configuration utility is a tool for modifying the settings of the HBA and the disk drives connected to it. This utility is called SerialSelect or SATASelect.
▼ To Modify General HBA Settings With a -Select Utility Note – Default HBA settings are suitable for most computers. Do not change any default settings. ● Select Controller Configuration from the main -Select utility menu and change the settings listed in the following table. Some options may not be available for the HBA. Note – Default settings are shown in bold type. TABLE C-1 General HBA Settings Option Description Drive’s Write Cache When enabled, write cache is enabled on the disk drive.
TABLE C-1 General HBA Settings Option Description CD-ROM Boot Support When enabled, the system can be booted from a bootable CD. Note—CDs are not supported by current software. Removable Media Devices Boot Support When enabled, removable media devices, such as CD drives, are supported. Alarm Control When enabled, the alarm sounds. Default is enabled. Note—When the alarm is turned off (disabled), it will automatically turn back on after a reboot.
Formatting and Verifying Disk Drives With the Disk Utilities You can use the disk utilities to low-level format or verify the disk drives. (New disk drives are low-level formatted at the factory and do not need to be low-level formatted again.) Caution – Before you format a disk drive, back up all data. Formatting destroys all data on a disk drive.
1. Start the BIOS RAID Configuration utility. See “Running the BIOS RAID Configuration Utility” on page 48. 2. Select the HBA you want, then press Enter. 3. Select Disk Utilities. 4. Select the disk drive you want, then press Enter. 5. Select Identify Drive, then press Enter. 6. When you have finished locating the disk drive, press any key to stop the blinking.
▼ To Identify a Disk Drive With the Disk Utilities You can identify disk drives by viewing the list of disk drives on the system. Only physical drives that display during POST are shown. 1. Start the BIOS RAID Configuration utility. See “Running the BIOS RAID Configuration Utility” on page 48. 2. Select the HBA you want, then press Enter. 3. Select Disk Utilities.
Viewing the BIOS-Based Event Log The BIOS-based event log records all firmware events, such as configuration changes, array creation, and boot activity. Some events are not stored indefinitely—the event log is cleared of any nonpersistent events each time you restart the computer; additionally, once the log is full, new events overwrite old events. ▼ To View the BIOS-Based Event Log 1. Start the BIOS RAID Configuration utility. See “Running the BIOS RAID Configuration Utility” on page 48. 2.
60 Sun StorageTek SAS RAID HBA Installation Guide Eight-Port, External HBA • November 2009
APPENDIX D Troubleshooting This appendix provides basic troubleshooting information and solutions for solving HBA problems.
Silencing the Alarm An alarm will sound when an error occurs. To silence the alarm, use BIOS RAID Configuration utility. See “Using the BIOS RAID Configuration Utility” on page 45. Recovering From a Disk Drive Failure This section explains how to recover when a disk drive fails: ■ If the array was protected by a hot-spare (see “Failed Disk Drive Protected by a Hot-Spare” on page 62). ■ If the array was not protected by a hot-spare (see “Failed Disk Drive Not Protected by a Hot-Spare” on page 63).
■ If copyback is enabled—Data is automatically moved back to its original location once the HBA detects that the failed drive has been replaced. No action is required. Failed Disk Drive Not Protected by a Hot-Spare When an array is not protected by a hot-spare, if a disk drive in that array fails, remove and replace the failed disk drive. The Sun StorageTek SAS RAID External HBA detects the new disk drive and begins to rebuild the array.
Multiple Failures in the Same Array Except in RAID 6 and RAID 60 arrays (see “Selecting the Best RAID Level” on page 73), if more than one disk drive fails at the same time in the same array, the data can’t be recovered. Correct the cause of the failure or replace the failed disk drives. Then, restore the data (if available). Note – In some instances, RAID 10 and RAID 50 arrays may survive multiple disk drive failures, depending on which disk drives fail.
APPENDIX E Best Practices This appendix provides information about how to best use the Sun StorageTek SAS RAID HBA to improve your overall user experience.
1. Run the arcconf getversion command at a terminal window. Assuming the newly installed HBA is the sole HBA installed in the system, the output of the arcconf getversion command will display 1 adapter. 2. Review the output of the arcconf getversion command and do one of the following: ■ If the output displays 1 adapter, the system has detected the HBA and you do not need to perform any further action.
Pulling a Cable and Reconnecting It To the Same Port Wait at least two minutes between pulling a cable and reconnecting it to the same port on an HBA or JBOD. To avoid confusing the controller, wait until the physical drives are removed from the display of the GUI and CLI. Connecting a JBOD With SATA Disks When connecting a JBOD with SATA disks to an HBA, connection problems might occur if the JBOD was previously connected to a different HBA. This is due to a SAS feature called, affiliation.
Best Practices For Deleting Logical Volumes Without Deleting Partitions When attempting to delete a logical volume, the Sun StorageTek RAID Manager graphical user interface (GUI) might require you to remove any partitions on the logical drive before it allows drive deletion. This is a safety feature designed to prevent accidental deletion of drives that contain valid data.
Typing this command causes the failed drive to return to a ready state in the GUI. Best Practices For Rescanning or Discovering Drives If you add a new enclosure to an existing card, or if you initiate a card rescan and the rescan finds a new physical disk drive on the card, the newly discovered drive might be displayed as failed in the Sun StorageTek RAID Manager GUI (with a red X over the drive).
2. Verify whether the logical drive of the RAID card is the first drive in the list. 3. If the first drive listed is the original system boot drive, you do not need to perform any further action. If the first drive listed is the logical drive of the RAID card, change the list so that the original boot drive is listed first. 4. To save the settings, do one of the following: ■ If you are working on an ILOM Remote Console, go to the ILOM Keyboard menu at the top of the window and choose F10.
Replacing an HBA On a SPARC System Upon replacing an existing HBA card with a new card on a SPARC system, the new card automatically detects the existing configuration upon installation and no further action is required. However, if the new HBA is not seeing one or more volumes in the existing configuration, rescan those volumes to enable their detection.
72 Sun StorageTek SAS RAID HBA Installation Guide Eight-Port, External HBA • November 2009
APPENDIX F Selecting the Best RAID Level When you create arrays (or logical drives) for the Sun StorageTek SAS RAID External HBA, you can assign a RAID level to protect data. Each RAID level offers a unique combination of performance and redundancy. RAID levels also vary by the number of disk drives they support. This appendix describes the RAID levels supported by the HBA, and provides a basic overview of each to help you select the best level of protection for your data storage.
Understanding Drive Segments A drive segment is a disk drive or portion of a disk drive that is used to create an array. A disk drive can include both RAID segments (segments that are part of an array) and available segments. Each segment can be part of only one logical device at a time. If a disk drive is not part of any logical device, the entire disk is an available segment.
FIGURE F-1 RAID 0 Array RAID 1 Arrays A RAID 1 array is built from two disk drives, where one disk drive is a mirror of the other (the same data is stored on each disk drive). Compared to independent disk drives, RAID 1 arrays provide improved performance, with twice the read rate and an equal write rate of single disks. However, capacity is only 50 percent of independent disk drives.
FIGURE F-2 RAID 1 Array RAID 1 Enhanced Arrays A RAID 1 Enhanced (RAID 1E) array—also known as a striped mirror—is similar to a RAID 1 array except that data is both mirrored and striped, and more disk drives can be included. A RAID 1E array can be built from three or more disk drives. In this example, the large bold numbers represent the striped data, and the smaller, non-bold numbers represent the mirrored data stripes.
FIGURE F-3 RAID 1 Enhanced Array RAID 10 Arrays A RAID 10 array is built from two or more equal-sized RAID 1 arrays. Data in a RAID 10 array is both striped and mirrored. Mirroring provides data protection, and striping improves performance. Drive segment size is limited to the size of the smallest disk drive in the array.
FIGURE F-4 RAID 10 Array RAID 5 Arrays A RAID 5 array is built from a minimum of three disk drives, and uses data striping and parity data to provide redundancy. Parity data provides data protection, and striping improves performance. Parity data is an error-correcting redundancy that’s used to re-create data if a disk drive fails. In RAID 5 arrays, parity data (represented by Ps in the next figure) is striped evenly across the disk drives with the stored data.
FIGURE F-5 RAID 5 Array RAID 5EE Arrays A RAID 5EE array—also known as a hot space—is similar to a RAID 5 array except that it includes a distributed spare drive and must be built from a minimum of four disk drives. Unlike a hot-spare, a distributed spare is striped evenly across the disk drives with the stored data and parity data, and can’t be shared with other logical disk drives. A distributed spare improves the speed at which the array is rebuilt following a disk drive failure.
In this figure, S represents the distributed spare, P represents the distributed parity data. FIGURE F-6 RAID 5EE Array RAID 50 Arrays A RAID 50 array is built from six to forty-eight disk drives configured as two or more RAID 5 arrays, and stripes stored data and parity data across all disk drives in both RAID 5 arrays. (For more information, see “RAID 5 Arrays” on page 78.) The parity data provides data protection, and striping improves performance. RAID 50 arrays also provide high data transfer speeds.
Drive segment size is limited to the size of the smallest disk drive in the array. For example, three 250 GB disk drives and three 400 GB disk drives comprise two equalsized RAID 5 arrays with 500 GB of stored data and 250 GB of parity data. The RAID 50 array can therefore contain 1000 GB (2 x 500 GB) of stored data and 500 GB of parity data. In this figure, P represents the distributed parity data.
RAID 6 Arrays A RAID 6 array—also known as dual drive failure protection—is similar to a RAID 5 array because it uses data striping and parity data to provide redundancy. However, RAID 6 arrays include two independent sets of parity data instead of one. Both sets of parity data are striped separately across all disk drives in the array. RAID 6 arrays provide extra protection for data because they can recover from two simultaneous disk drive failures.
RAID 60 Arrays Similar to a RAID 50 array (see “RAID 50 Arrays” on page 80), a RAID 60 array—also known as dual drive failure protection—is built from eight disk drives configured as two or more RAID 6 arrays, and stripes stored data and two sets of parity data across all disk drives in both RAID 6 arrays. Two sets of parity data provide enhanced data protection, and striping improves performance. RAID 60 arrays also provide high data transfer speeds.
Migrating RAID Levels As your storage space changes, you can migrate existing RAID levels to new RAID levels that better meet your storage needs. You can perform these migrations through the Sun StorageTek RAID Manager software. For more information, see the Sun StorageTek RAID Manager Software User’s Guide. TABLE F-2 lists the supported RAID level migrations.
APPENDIX G Introduction to Serial Attached SCSI This section provides a basic overview of the main features of Serial Attached SCSI (SAS), introduces some common SAS terms, and explains how SAS differs from parallel SCSI. Note – This section is not specific to the Sun StorageTek SAS RAID External HBA. Instead, this appendix provides general information. Diagrams are for reference purposes only and do not represent any specific configurations supported by the Sun StorageTek SAS RAID External HBA.
Terminology Used in This Appendix For convenience, SAS HBAs and SAS RAID HBAs are referred to generically in this chapter as SAS cards. HBAs, RAID HBAs, disk drives, and external disk drive enclosures are referred to as end devices and expanders are referred to as expander devices. For convenience, this chapter refers to end devices and expander devices collectively as SAS devices.
About SAS Device Communication SAS devices communicate with each other through links. A link is a physical connection between two phys. As shown in the following figure, SAS devices contain ports (see “About SAS Ports” on page 88), ports contain phys, and each phy contains one transmitter and one receiver—one transceiver. A phy can belong to one port only.
Phys are internal, within SAS connectors (see “About SAS Connectors” on page 89). SAS cables physically connect one or more phys on one SAS device to one or more phys on another SAS device. About SAS Ports Note – Because the physical link between SAS devices is from phy to phy, rather than port to port, a “port” is more of a virtual concept, different from what is normally considered a port on other types of RAID HBAs and storage devices. A port is one or more phys. A narrow port contains one phy.
About SAS Connectors A SAS or mini-SAS connector is the physical plug or receptacle that you see on a SAS device. It’s what you plug a SAS cable into, or the end of the SAS cable that’s being plugged in. A connector is what forms physical links between phys. Some SAS connectors can support multiple links. The number of links a SAS connector can support is referred to as its width. Narrow connectors support a single link; wide connectors supports more than 1 link.
where X is the count number. Note – Devices other than disk drives (CDROM, tape drives, and so on) are listed in order after the system disk drives. In parallel SCSI, XX is the disk drive’s channel number, YY is the target number, and ZZ is the logical unit number (LUN). About SAS Connection Options You can connect end devices to each other through direct cable connections and through backplane connections.
The number of end devices is limited to the number of slots available on the backplane. For example, the Sun S50 enclosure, which contains an expander, is a backplane connection that supports up to 12 SAS or SATA disk drives. Some backplanes support daisy-chain expansion to other backplanes. For example, you can daisy-chain (connect one to the next) up to nine Sun S50 enclosures to a single SAS card in a host system.
FIGURE G-2 SAS Expander Connections SAS Domain SATA Disk Drives SATA SATA Edge Expander Edge Expander SAS Disk Drives SATA SAS Edge Expander Fanout Expander SAS Card SAS SAS Card SATA Disk Drives SAS Edge Expander SAS Disk Drives SATA SAS Card Edge Expander Disk Drives SATA Disk Drives SAS SATA Disk Drives Differences Between SAS and Parallel SCSI In summary, although SAS and parallel SCSI both use the SCSI command set, how they move data from one place to another is very differen
This table describes many of the main differences between the two interfaces.
94 Sun StorageTek SAS RAID HBA Installation Guide Eight-Port, External HBA • November 2009
APPENDIX H Declaration of Conformity, Safety, and Regulatory Statements This appendix provides Declaration of Conformity, safety, and regulatory statements for the product.
96 Sun StorageTek SAS RAID HBA Installation Guide Eight-Port, External HBA • November 2009
Declaration of Conformity To receive a copy of the latest Declaration of Conformity (DoC) for the product, either contact your local Sun sales representative, or create an online request at: https://www2.sun.de/dct/forms/reg_us_1607_755_0.
98 Sun StorageTek SAS RAID HBA Installation Guide Eight-Port, External HBA • November 2009
Safety Agency Compliance Statements Read this section before beginning any procedure. The following text provides safety precautions to follow when installing a Sun Microsystems product. Depending on the type of power switch your device has, one of the following symbols may be used: On – Applies AC power to the system. Off – Removes AC power from the system.
Caution – Not all power cords have the same current ratings. Do not use the power cord provided with your equipment for any other products or use. Household extension cords do not have overload protection and are not meant for use with computer systems. Do not use household extension cords with your Sun product. The following caution applies only to devices with a Standby power switch: Caution – The power switch of this product functions as a standby type device only.
System Unit Cover Laser Compliance Notice You must remove the cover of your Sun computer system unit to add cards, memory, or internal storage devices. Be sure to replace the cover before powering on your computer system. Sun products that use laser technology comply with Class 1 laser requirements. Class 1 Laser Product Luokan 1 Laserlaite Klasse 1 Laser Apparat Laser Klasse 1 Caution – Do not operate Sun products without the cover in place.
■ Ce produit est destiné à être utilisé dans des zones à accès limité, dans lesquelles les accès sont contrôlés au moyen de systèmes de sécurité (par exemple, à clé, verrou, dispositif ou badge). Le personnel autorisé à accéder à ces zones doit avoir été préalablement informé des raisons justifiant la limitation des accès et de toutes les précautions à prendre.
système. Assurez-vous de le brancher dans une prise d'alimentation mise à la terre près du système et facile d'accès. Ne le branchez pas lorsque l'alimentation électrique ne se trouve pas dans le châssis du système.
Attention – L'utilisation de contrôles et de réglages ou l'application de procédures autres que ceux spécifiés dans le présent document peuvent entraîner une exposition à des radiations dangereuses. Einhaltung sicherheitsbehördlicher Vorschriften Lesen Sie vor dem Ausführen von Arbeiten diesen Abschnitt. Im folgenden Text werden Sicherheitsvorkehrungen beschrieben, die Sie bei der Installation eines Sun Microsystems-Produkts beachten müssen.
Anschluss des Netzkabels Warnung bezüglich Batterien Achtung – Sun-Geräte sind für Stromversorgungssysteme mit einem geerdeten neutralen Leiter (geerdeter Rückleiter bei gleichstrombetriebenen Geräten) ausgelegt. Um die Gefahr von Stromschlägen zu vermeiden, schließen Sie das Gerät niemals an andere Stromversorgungssysteme an.
■ Reduzierter Luftstrom - Die Installation des Geräts in einem Rack sollte so erfolgen, dass die Luftstrommenge, die für den sicheren Betrieb des Geräts erforderlich ist, nicht beeinträchtigt wird. ■ ■ Mechanische Belastung - Die Montage des Geräts im Rack sollte so erfolgen, dass bei einer ungleichmäßigen mechanischen Belastung keine gefährliche Betriebsbedingung entstehen kann.
Encendido – Suministra alimentación de CA al sistema. Apagado – Corta la alimentación de CA del sistema. Espera – El interruptor de encendido/espera está en la posición de espera. Modificaciones en el equipo No realice modificaciones de tipo mecánico ni eléctrico en el equipo. Sun Microsystems no se hace responsable del cumplimiento de normativas en caso de que un producto Sun se haya modificado. Colocación de un producto Sun Precaución – No obstruya ni tape las rejillas del producto Sun.
descritas en el manual de servicio del producto. No desmonte las baterías ni intente recargarlas fuera del sistema. No intente deshacerse de las baterías echándolas al fuego. Deshágase de las baterías correctamente de acuerdo con las instrucciones del fabricante y las normas locales. Tenga en cuenta que en las placas CPU de Sun, hay una batería de litio incorporada en el reloj en tiempo real. Los usuarios no deben reemplazar este tipo de baterías.
Danmark Advarsel! – Litiumbatteri — Eksplosionsfare ved fejlagtig håndtering. Udskiftning må kun ske med batteri af samme fabrikat og type. Levér det brugte batteri tilbage til leverandøren. Norge Advarsel – Apparatet må tilkoples jordet stikkontakt. Sverige Varning – Apparaten skall anslutas till jordat uttag. Suomi Varoitus – Paristo voi räjähtää, jos se on virheellisesti asennettu. Vaihda paristo ainoastaan laitevalmistajan suosittelemaan tyyppiin.
110 Sun StorageTek SAS RAID HBA Installation Guide Eight-Port, External HBA • November 2009
Regulatory Compliance Statements Your Sun product is marked to indicate its compliance class: • Federal Communications Commission (FCC) — USA • Industry Canada Equipment Standard for Digital Equipment (ICES-003) — Canada • Voluntary Control Council for Interference (VCCI) — Japan • Bureau of Standards Metrology and Inspection (BSMI) — Taiwan Please read the appropriate section that corresponds to the marking on your Sun product before attempting to install the product.
GOST-R Certification Mark 112 Sun StorageTek SAS RAID HBA Installation Guide Eight-Port, External HBA • November 2009
Index A B ACU creating arrays, 50 creating bootable arrays, 51 initializing disk drives, 52 managing arrays, 51 rescanning disk drives, 52 secure erasing disk drives, 52 Adaptec RAID Configuration utility, 45 to 59 advanced data protection, 3 Alarm Control setting, 55 Array Background Consistency Check setting, 54 Array Configuration Utility.
D I direct-attach connections, 90 disk drives connecting to SAS controllers, 16 connections, 58 failure recovery multiple arrays, 63 multiple disk drives, 64 RAID 0 arrays, 63 with hot spare, 62 without hot spare, 63 formatting, 56 identifying, 58 initializing, 52 recovering from failure, 62 rescanning, 52 SAS, 89 SAS identifiers, 89 secure erasing, 52 types of connections, 58 verifying, 56 drive requirements, 10 Drive’s Write Cache setting, 54 driver installation, 25 to 28 drivers installing on Linux, 26
requirements, 6 drive, 10 rescanning disk drives, 52 Runtime BIOS setting, 54 S SAS 4-wide ports, 88 backplane connections, 90 comparison to parallel SCSI, 92 connectors, 89 description, 86 direct-attach connections, 90 disk drive identifiers, 89 disk drives, 89 edge expanders, 91 end devices, 86 expander connections, 91 expander devices, 86 fanout expanders, 91 link speed, 86 links, 87 narrow connectors, 89 narrow ports, 88 phys, 87 ports, 87, 88 SAS address, 88 SAS cards, 86 SAS devices, 86 SAS domain, 9
116 Sun StorageTek SAS RAID HBA Installation Guide Eight-Port, External HBA • November 2009
