Syncro™ CS 9286-8e Solution User Guide Version 1.
Syncro CS 9286-8e Solution User Guide March 2013 Revision History Version and Date Version 1.0, March 2013 Description of Changes Initial release of this document. LSI, the LSI & Design logo, Syncro, CacheVault, and MegaRAID are registered trademarks of LSI Corporation or its subsidiaries. All other brand and product names may be trademarks of their respective companies. LSI Corporation reserves the right to make changes to the product(s) or information disclosed herein at any time without notice.
Syncro CS 9286-8e Solution User Guide March 2013 Table of Contents Table of Contents Chapter 1: Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 1.1 Concepts of High-Availability DAS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 1: Introduction Concepts of High-Availability DAS Chapter 1: Introduction This document explains how to set up and configure the hardware and software for the Syncro™ CS 9286-8e highavailability direct-attached storage (HA-DAS) solution. The Syncro CS 9286-8e solution provides fault tolerance capabilities as a key part of a high-availability data storage system.
Syncro CS 9286-8e Solution User Guide March 2013 1.2 Chapter 1: Introduction HA-DAS Terminology HA-DAS Terminology This section defines some additional important HA-DAS terms. 1.3 Cache Mirror: A cache coherency term describing the duplication of write-back cached data across two controllers. Exclusive Access: A host access policy in which a VD is only exposed to, and accessed by, a single specified server.
Syncro CS 9286-8e Solution User Guide March 2013 1.4 Chapter 1: Introduction Hardware Compatibility Hardware Compatibility The servers, disk drives, and JBOD enclosures you use in the Syncro CS 9286-8e solution must be selected from the list of approved components that LSI has tested for compatibility. Refer to this web link for the compatibility lists. http://www.lsi.com/channel/support/pages/interoperability.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 2: Hardware and Software Setup Chapter 2: Hardware and Software Setup This chapter explains how to set up the hardware and software for a Syncro CS 9286-8e solution with two controller nodes and shared storage. For this implementation you use two standard server modules with Syncro CS 9286-8e controllers that provide access to disks in one or more JBOD enclosures for reliable, high-access redundancy.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 2: Hardware and Software Setup Setting Up a Syncro CS 9286-8e Two-Server Cluster Configuration Figure 1 Two-Server Syncro CS 9286-8e Configuration I3#3) #LIENT WITH !PPLICATIONS I3#3) #LIENT WITH !PPLICATIONS I3#3) #LIENT WITH !PPLICATIONS .ETWORK $.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 2: Hardware and Software Setup Setting Up a Syncro CS 9286-8e Two-Server Cluster Configuration The CVFM03 module comes preinstalled on the Syncro CS controller; however, the module is not included in the following figure so that you can see all of the connectors and headers on the controller board. Figure 3 and Figure 4 show the controller with the CVFM03 module installed.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 2: Hardware and Software Setup Setting Up a Syncro CS 9286-8e Two-Server Cluster Configuration Table 1 Syncro CS 9286-8e Controller Jumpers (Continued) Jumper/ Connector Type Description J4A2 LSI Test header Reserved for LSI use. J5A1 Serial UART connector for the expander Reserved for LSI use. J6A1 Serial UART connector for the expander Reserved for LSI use. 5.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 2: Hardware and Software Setup Setting Up a Syncro CS 9286-8e Two-Server Cluster Configuration Press down gently, but firmly, to seat the Syncro CS 9286-8e controller correctly in the slot. NOTE The Syncro CS 9286-8e controller is a PCIe x8 card that can operate in x8 or x16 slots. Some x16 PCIe slots support only PCIe graphics cards; if you install a Syncro CS 9286-8e in one of these slots, the controller will not function.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 2: Hardware and Software Setup Setting Up a Syncro CS 9286-8e Two-Server Cluster Configuration Refer to the drive documentation to determine any pre-installation configuration requirements. Be sure to use SAS disk drives that are listed on the LSI-approved list. (To view this list, follow the URL listed in Section 1.4, Hardware Compatibility.) 14. If necessary, install network boards in the two server modules and install the cabling between them.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 2: Hardware and Software Setup Cabling Configurations NOTE The Syncro CS 9286-8e solution does not support booting from a shared operating system volume. 22. Install the Failover Cluster feature on both servers, following the instructions in the Microsoft documentation. 2.2 Cabling Configurations This section has information about initially setting up a Syncro CS configuration with one or two JBOD enclosures.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 2: Hardware and Software Setup Cabling Configurations The following figure shows the SAS cable connections for a two-controller-node configuration with two JBOD enclosures. NOTE To save space, the figure does not show the disk drives that are in the JBOD enclosures.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 2: Hardware and Software Setup Cabling Configurations Figure 7 Adding a Second JBOD Enclosure - Redundant Configuration 6HUYHU 1RGH $ 6HUYHU 1RGH % 6\QFUR &6 H 6\QFUR &6 H 4OP #ONNECTOR "OTTOM #ONNECTOR 4OP #ONNECTOR "OTTOM #ONNECTOR #ONNECTOR )N #ONNECTOR )N #ONNECTOR )N #ONNECTOR )N ([SDQGHU $ ([SDQGHU % #ONNECTOR /UT #ONNECTOR /UT 'ULYH (QFORVXUH $ #ONNECTOR )N #ONNECTOR )N #ONNECTOR
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 3: Creating the Syncro CS 9286-8e Configuration Validating the Failover Configuration Chapter 3: Creating the Syncro CS 9286-8e Configuration This chapter explains how to set up HA-DAS clustering on a Syncro CS 9286-8e configuration after the hardware is fully configured and the operating system is installed. 3.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 3: Creating the Syncro CS 9286-8e Configuration Creating Virtual Drives on the Controller Nodes 5. In the Select Destination Server box, select the system and click Next. 6. In the Select Server Roles list, click Next to present the Features list. 7. Make sure that failover clustering is installed, including the tools. If necessary, run the Add Roles and Features wizard to install the features dynamically from this user interface. 8.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 3: Creating the Syncro CS 9286-8e Configuration Creating Virtual Drives on the Controller Nodes As explained in the instructions in the following sections, VDs created for storage in an HA-DAS configuration must be shared. If you do not designate them as shared, the VDs are visible only from the controller node from which they were created. You can use the WebBIOS pre-boot utility to create the VDs.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 3: Creating the Syncro CS 9286-8e Configuration Creating Virtual Drives on the Controller Nodes The first Configuration Wizard window appears. 4. Select Add Configuration and click Next. 5. On the next wizard screen, select Manual Configuration and click Next. The Drive Group Definition window appears. 6.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 3: Creating the Syncro CS 9286-8e Configuration Creating Virtual Drives on the Controller Nodes 10. Select Provide Shared Access on the bottom left of the window, as shown in the following figure. Alternatively, deselect this option to create an exclusive VD as a boot volume for this cluster node. Figure 11 Virtual Drive Definition The Provide Shared Access option enables a shared VD that both controller nodes can access.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 3: Creating the Syncro CS 9286-8e Configuration Creating Virtual Drives on the Controller Nodes The steps for creating a VD are slightly different depending on whether you run MegaCLI in Windows PowerShell® or from a Windows command prompt. Therefore, two sets of instructions are included. 3.3.2.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 3: Creating the Syncro CS 9286-8e Configuration Creating Virtual Drives on the Controller Nodes The following figure shows some sample configuration information that appears in response to the command. Figure 13 Sample Configuration Information The command generates many lines of information that scroll down in the PowerShell window. You need to use some of this information in the command line to create the shared VD. 4.
Syncro CS 9286-8e Solution User Guide March 2013 — Chapter 3: Creating the Syncro CS 9286-8e Configuration Creating Virtual Drives on the Controller Nodes The HA-DAS version of MegaCLI creates, by default, a shared VD that is visible to all cluster nodes. NOTE To create a VD that is visible only to the node that created it (such as creating a boot volume for this cluster node), add the -exclusive parameter to the command line.
Syncro CS 9286-8e Solution User Guide March 2013 3. Chapter 3: Creating the Syncro CS 9286-8e Configuration Creating Virtual Drives on the Controller Nodes Right-click on the Command Prompt. A properties check indicator appears on the button, as shown in the following figure. Figure 16 Command Prompt The following button appears at the bottom of the desktop to open the command prompt as Administrator. Figure 17 Run as Administrator Button 4.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 3: Creating the Syncro CS 9286-8e Configuration Creating Virtual Drives on the Controller Nodes The following figure shows some sample configuration information that appears in response to the command. Figure 19 Sample Configuration Information The command generates many lines of information that scroll down in the command prompt window. You need to use some of this information in the command line to create the shared VD. 6.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 3: Creating the Syncro CS 9286-8e Configuration Creating Virtual Drives on the Controller Nodes NOTE To create a VD that is visible only to the node that created it (such as creating a boot volume for this cluster node), add the -exclusive parameter to the command line. — The -a0 parameter selects the first Syncro CS 9286-8e controller in the system.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 3: Creating the Syncro CS 9286-8e Configuration Creating Virtual Drives on the Controller Nodes 7. Select Always Write Back as the Write policy option, and select other VD settings as required. 8. Select the Provide Shared Access option, as shown in the following figure. NOTE If you do not select Provide Shared Access, the VD is visible only from the server node on which it is created.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 3: Creating the Syncro CS 9286-8e Configuration Creating Virtual Drives on the Controller Nodes The Create Virtual Drive Summary window appears, as shown in the following figure. Figure 22 Create Virtual Drive Summary 11. Click Finish to complete the VD creation process. 12. Click OK when the Create Virtual Drive - complete message appears. 3.3.3.
Syncro CS 9286-8e Solution User Guide March 2013 3.4 Chapter 3: Creating the Syncro CS 9286-8e Configuration HA-DAS CacheCade Support HA-DAS CacheCade Support The Syncro CS 9286-8e controller includes support for CacheCade 1.0, a feature that uses SAS SSD devices for read caching of frequently accessed read data. When a VD is enabled for the CacheCade feature, frequently read data regions of the VD are copied into the SSD when the CacheCade algorithm determines the region is a good candidate.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 3: Creating the Syncro CS 9286-8e Configuration HA-DAS CacheCade Support 3. Click Create Drive Group and then click Next. 4. In the Create CacheCade SSD Caching Virtual Drive window, update the SSD Caching VD name and set the size as necessary. The maximum allowable size for the CacheCade volume is 512 GB.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 3: Creating the Syncro CS 9286-8e Configuration HA-DAS CacheCade Support The CacheCade VD now appears on the Logical tab of MSM, as shown in the following figure. The CacheCade volume association with the drive groups appears in this view.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 4: System Administration High Availability Properties Chapter 4: System Administration This chapter explains how to perform system administration tasks, such as planned failovers and updates of the Syncro CS 9286-8e controller firmware. 4.1 High Availability Properties The following figure shows the high availability properties that MSM displays on the Controller Properties tab for a Syncro CS 9286-8e controller.
Syncro CS 9286-8e Solution User Guide March 2013 4.2 Chapter 4: System Administration Understanding Failover Operations Understanding Failover Operations A failover operation in HA-DAS is the process by which VD management transitions from one server node to the peer server node.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 4: System Administration Understanding Failover Operations The following figure shows the condition of the two server nodes after the failover. Figure 30 After Failover from Server A to Server B After failover, the cluster status is as follows, in terms of managing the drive group and the VDs: All shared VDs in A-DG0 have failed over and are now managed by Server B. VD3 in B-DG0 is still managed by Server B.
Syncro CS 9286-8e Solution User Guide March 2013 4.2.1 Chapter 4: System Administration Understanding Failover Operations Understanding and Using Planned Failover A planned failover occurs when you deliberately transfer control of the drive groups from one controller node to the other. The usual reason for initiating a planned failover is to perform some kind of maintenance or upgrade on one of the controller nodes—for example, upgrading the controller firmware, as described in the following section.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 4: System Administration Understanding Failover Operations Figure 31 Failover Cluster Manager 3. In the left panel, expand the tree to display the disks, as shown in the following figure. Figure 32 Expand Tree 4. Right-click on the entry in the Assigned To column in the center panel of the window. 5. On the pop-up menu, select Move > Select Node, as shown in the following figure.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 4: System Administration Updating the Syncro CS 9286-8e Controller Firmware Figure 33 Expand Tree 6. 4.2.2 Select the node for the planned failover. Understanding Unplanned Failover An unplanned failover might occur if the controller in one of the server nodes fails, or if the cable from one controller node to the JBOD enclosure is accidentally disconnected.
Syncro CS 9286-8e Solution User Guide March 2013 6. Chapter 4: System Administration Updating the MegaRAID Driver After you locate the file, click Ok. The MSM software displays the version of the existing firmware and the version of the new firmware file. 7. When you are prompted to indicate whether you want to upgrade the firmware, click Yes. The controller is updated with the new firmware code contained in the .rom file. 8. Reboot the controller node after the new firmware is flashed.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 4: System Administration Updating the MegaRAID Driver 4. Click Storage to expose the Syncro CS 9286-8e controller. 5. Right-click the Syncro CS 9286-8e controller and select Update Driver Software to start the Driver Update wizard, as shown in the following figure. Figure 35 Updating the Driver Software Syncro CS 92 6. 4.4.2 Follow the instructions in the wizard.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 4: System Administration Updating the MegaRAID Driver Figure 36 Updating the Driver Software 3. Select Computer Management, then click Device Manager. 4. Click Storage to expose the Syncro CS controller. 5. Right-click on the Syncro CS controller and select Update Driver Software, as shown in the following figure, to start the Driver Update wizard. Figure 37 Updating the Driver Software Syncro CS 92 6.
Syncro CS 9286-8e Solution User Guide March 2013 4.5 Chapter 4: System Administration Performing Preventive Measures on Disk Drives and VDs Performing Preventive Measures on Disk Drives and VDs The following drive and VD-level operations help to proactively detect disk drive and VD errors that could potentially cause the failure of a controller node. For more information about these operations, refer to the MegaRAID SAS Software User Guide.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 5: Troubleshooting Verifying HA-DAS Support in Tools and the OS Driver Chapter 5: Troubleshooting This chapter has information about troubleshooting a Syncro CS system. 5.1 Verifying HA-DAS Support in Tools and the OS Driver Not all versions of MegaRAID Storage Manager (MSM) support HA-DAS. The MSM versions that include support for HA-DAS have specific references to clustering.
Syncro CS 9286-8e Solution User Guide March 2013 5.2 Chapter 5: Troubleshooting Confirming SAS Connections Confirming SAS Connections The high availability functionality of HA-DAS is based on redundant SAS data paths between the clustered nodes and the disk drives. If all of the components in the SAS data path are configured and connected properly, each HA-DAS controller has two SAS addresses for every drive, when viewed from the HA-DAS controllers.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 5: Troubleshooting Confirming SAS Connections Figure 40 Redundant SAS Data Paths Are Missing The following figure shows the correct view with two drive SAS addresses. Figure 41 Redundant SAS Data Paths Are Present 5.2.3 Using MegaCLI to Verify Dual-Ported SAS Addresses to Disk Drives The MegaCLI configuration display command (-cfgdsply) returns many lines of information, including a summary for each physical disk.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 5: Troubleshooting Confirming SAS Connections The returned information relating to the physical disk is as follows. Some of the other preceding text is removed for brevity. The dual SAS addresses are listed at the end.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 5: Troubleshooting Understanding CacheCade Behavior During a Failover Figure 42 Redundant SAS Connections Displayed in MSM 5.3 Understanding CacheCade Behavior During a Failover A CacheCade VD possesses properties that are similar to a VD with exclusive host access, and it is not presented to the host operating system. Therefore, the CacheCade volume does not cache read I/Os for VDs that are managed by the peer controller node.
Syncro CS 9286-8e Solution User Guide March 2013 5.4 Chapter 5: Troubleshooting Error Situations and Solutions Error Situations and Solutions The following table lists some problems that you might encounter in a Syncro CS configuration, along with possible causes and solutions. Table 2 Error Situations and Solutions Problem Possible Cause A drive is reported as Unsupported, and the drive cannot be used in a drive group. The drive is not a SAS drive, or it does not support SCSI-3 PR.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 5: Troubleshooting Event Messages and Error Messages The following table lists MegaRAID Storage Manager event messages that might appear in the MSM event log when the Syncro CS system is running. Table 4 HA-DAS MSM Events and Messages Number Severity Level Event Text Cause Resolution 0x01cc Information Peer controller entered HA Domain A compatible peer controller entered None - Informational the HA domain.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 5: Troubleshooting Event Messages and Error Messages Table 4 HA-DAS MSM Events and Messages (Continued) Number Severity Level Event Text Cause Resolution 0x01d8 Warning Controller property mismatch A mismatch exists between the detected with Peer controller controller properties and the peer controller properties. Controller properties do not match between the controller and peer controller.
Syncro CS 9286-8e Solution User Guide March 2013 Chapter 5: Troubleshooting Event Messages and Error Messages The following table shows HA-DAS boot events and messages. Table 5 HA-DAS Boot Events & Messages Boot Event Text Generic Conditions when each event occurs Actions to resolve Peer controller firmware is not HA compatible. An incompatible peer controller parameter is detected.
