hwnotes.book Page i Friday, January 23, 2004 1:22 PM VERITAS Volume Manager™ 4.
hwnotes.book Page ii Friday, January 23, 2004 1:22 PM Disclaimer The information contained in this publication is subject to change without notice. VERITAS Software Corporation makes no warranty of any kind with regard to this manual, including, but not limited to, the implied warranties of merchantability and fitness for a particular purpose.
hwnotes.book Page iii Friday, January 23, 2004 1:22 PM Contents Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii Audience and Scope . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .vii Organization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .vii Related Documents . . . . . . . . . . .
hwnotes.book Page iv Friday, January 23, 2004 1:22 PM JNI Host Bus Adapters (HBA) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 VxVM Disk Array Configuration Updates . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 DMP and EMC Symmetrix Disk Array Support . . . . . . . . . . . . . . . . . . . . . . . . . . 17 HP SureStore™ E Disk Array XP256 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
hwnotes.book Page v Friday, January 23, 2004 1:22 PM Stable Backup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41 Dynamic Partitioning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41 Sun StorEdge A3000/A3500 Array Supported Configurations . . . . . . . . . . . . . . . . 41 Sun StorEdge A3000/A3500 Array Unsupported Configurations . . . . . . . . . . . . . .
hwnotes.
hwnotes.book Page vii Friday, January 23, 2004 1:22 PM Preface The VERITAS Volume ManagerTM Hardware Notes provides hardware information on VERITAS Volume Manager (VxVM) Release 4.0. Audience and Scope This guide is intended for system administrators responsible for installing, configuring, and maintaining systems under the control of VxVM. The purpose of this guide is to provide the system administrator with information on hardware requirements for VERITAS Volume Manager Release 4.0.
hwnotes.
hwnotes.book Page ix Friday, January 23, 2004 1:22 PM Getting Help Getting Help If you have any comments or problems with VERITAS products, contact VERITAS Technical Support: ◆ U.S. and Canadian Customers: 1-800-342-0652 ◆ International Customers: +1 (650) 527-8555 ◆ Email: support@veritas.com For license information (U.S. and Canadian Customers): ◆ Phone: 1-650-527-0300 ◆ Email: license@veritas.com ◆ Fax: 1-650-527-0952 For software updates: ◆ Email: swupdate@veritas.
hwnotes.
hwnotes.book Page 1 Friday, January 23, 2004 1:22 PM Hardware Notes This document provides hardware support information for VERITAS Volume Manager™ (VxVM) Release 4.0. This release of VxVM has been tested on: ◆ Solaris 7 (32- and 64-bit) ◆ Solaris 8 (32- and 64-bit) ◆ Solaris 9 (32- and 64-bit) Hardware Support in VxVM 4.0 You can extract a list of supported hardware including arrays from the VERITAS customer support web site at http://support.veritas.com.
hwnotes.book Page 2 Friday, January 23, 2004 1:22 PM Hardware Support in VxVM 4.0 ◆ SCSI 3 JBOD; arrays that support SCSI Inquiry Vital Product Data (VPD), pages 128 and 131. ◆ NEC arrays: DS1200, DS1200F, DS3000SL, DS3000SM, DS3001, DS3002, DS1000, DS1000F, DS1100, DS1100F, DS3011, DS1230, DS450, DS450F, iStorage 1000, iStorage 2000, iStorage 3000 and iStorage 4000. ◆ SEAGATE disks that return unique serial numbers in standard SCSI inquiry data. ◆ Storage Computer™ OmniRaid™ disk array.
hwnotes.book Page 3 Friday, January 23, 2004 1:22 PM Hardware Support in VxVM 4.0 Vendor ASL packages for Supported Arrays This section lists the disk arrays that are supported by Vendor ASL packages that can be installed as appropriate for your disk configuration. The following ASLs are supported with this release of VxVM; if your array is in this list, see“Installing an Array Support Library (ASL)” on page 11.
hwnotes.book Page 4 Friday, January 23, 2004 1:22 PM Arrays Supported for Boot Mirroring Vendor Array models supported arrays-asl ASL Package Name Storagetek STK D178/280/bladeStor SMstkasl Sun Sun StorEdge 3510 VRTS3510 Sun Sun StorEdge 6120/6320 VRTSt4 Toshiba AF1500/AF3500/AF200 0/AF7000 TSBvxafsl Toshiba Arrayfort AF1500 TSBalaf For the most up to date list of supported ASLs, you should visit The VERITAS support site at: http://support.veritas.
hwnotes.book Page 5 Friday, January 23, 2004 1:22 PM Using Prestoserve With VxVM Using Prestoserve With VxVM Prestoserve is designed to accelerate performance of file systems, particularly when used on a server for NFS advertised file systems. This is accomplished via the use of NVRAM hardware and the Prestoserve drivers.
hwnotes.book Page 6 Friday, January 23, 2004 1:22 PM Using Prestoserve With VxVM Edit the /etc/init.d/prestoserve file and replace the following line: presto -u with the following line: presto -u /mnt1 /mnt2 ... Where /mnt1 and /mnt2 should list every file system to be accelerated with Prestoserve. Note that this list must not include /, /usr, /usr/kvm, /var, or /var/adm.
hwnotes.book Page 7 Friday, January 23, 2004 1:22 PM The DMP Command Utility (vxdmpadm) The DMP Command Utility (vxdmpadm) The vxdmpadm utility administers the DMP functionality of VxVM. Refer to the manual page of the vxdmpadm(1M) utility for a detailed description of the options and attributes of this command. You can use the vxdmpadm utility option listctlr to list all controllers connected to disks that are attached to the host.
hwnotes.book Page 8 Friday, January 23, 2004 1:22 PM The DMP Command Utility (vxdmpadm) c1t16d0s2 c1t17d0s2 c1t18d0s2 c1t19d0s2 c1t20d0s2 c1t21d0s2 c1t22d0s2 ENABLED ENABLED ENABLED ENABLED ENABLED ENABLED ENABLED - c2t16d0s2 c2t17d0s2 c2t18d0s2 c2t19d0s2 c2t20d0s2 c2t21d0s2 c2t22d0s2 Disk Disk Disk Disk Disk Disk Disk Disk Disk Disk Disk Disk Disk Disk The output display shows the paths that are connected to the controller named c1.
hwnotes.book Page 9 Friday, January 23, 2004 1:22 PM Dynamic LUN Expansion Dynamic LUN Expansion The following form of the vxdisk command can be used to make VxVM aware of the new size of a virtual disk device that has been resized: # vxdisk [-f] [-g diskgroup] resize {accessname|medianame} \ [length=value] The device must have a SCSI interface that is presented by a smart switch, smart array or RAID controller.
hwnotes.book Page 10 Friday, January 23, 2004 1:22 PM Dynamic LUN Expansion If the device that is being resized has the only valid configuration copy for a disk group, the -f option may be specified to forcibly resize the device. Resizing a device that contains the only valid configuration copy for a disk group can result in data loss if a system crash occurs during the resize. Resizing a virtual disk device is a non-transactional operation outside the control of VxVM.
hwnotes.book Page 11 Friday, January 23, 2004 1:22 PM Installing an Array Support Library (ASL) Installing an Array Support Library (ASL) VxVM provides Dynamic MultiPathing (DMP) support for new disk arrays in the form of Array Support Library (ASL) software packages. You can obtain ASL packages for new arrays from: ◆ The VxVM release CDROM CD1 in the veritas_enabled directory. ◆ The Storage Array Vendor’ s support site. ◆ The VERITAS Technical Support site, http://support.veritas.com.
hwnotes.book Page 12 Friday, January 23, 2004 1:22 PM Installing an Array Support Library (ASL) Adding an ASL package Only one version of an ASL can be active in the system. If you find a version of the ASL is already installed, you need to refer to Upgrading an ASL Package. Note Disk arrays that are supported by an ASL do not have to be connected to the system when the ASL package is installed.
hwnotes.book Page 13 Friday, January 23, 2004 1:22 PM Installing an Array Support Library (ASL) 6. Verify that disk array was claimed by the ASL_name library: # vxdmpadm listenclosure all # vxdisk list cxtxdxs2 # vxdmpadm getsubpaths ctlr=cx (where x is the appropriate control unit no.) Note If disk array has multiple paths, use the above commands to verify that all paths to disk are claimed.
hwnotes.book Page 14 Friday, January 23, 2004 1:22 PM Installing an Array Support Library (ASL) Upgrading an ASL Package Before upgrading an ASL package (installing a new version of an already installed package), first find out if the old package (ASL_name) is already present; enter: # pkginfo -l ASL_name 1. Remove the package (ASL_name): # pkgrm ASL_name 2. Proceed with Adding an ASL package.
hwnotes.book Page 15 Friday, January 23, 2004 1:22 PM Extended Copy Service Extended Copy Service The Extended Copy Service feature of VxVM automatically works in tandem with the extended copy engines from array vendors. When VxVM detects that the source and destination devices are enabled for extended copy, VxVM automatically off loads copy requests to the array’s copy manager. The benefits of VxVM Extended Copy Service are: ◆ Non-disruptive copy operations from disk to disk.
hwnotes.book Page 16 Friday, January 23, 2004 1:22 PM JNI Host Bus Adapters (HBA) JNI Host Bus Adapters (HBA) If your JNI card has Model numbers FCE-1063, FCE2-1063, FCE-6410, FCE2-6410, or FCE2-6412, then you may experience error messages of the form: “Oct 22 00:16:16 ds13un jnic: [ID 847178 kern.notice] jnic1: Memory port parity error detected Oct 22 00:16:16 ds13un jnic: [ID 229844 kern.notice] jnic1: Link Down Oct 22 00:16:16 ds13un jnic: [ID 744007 kern.
hwnotes.book Page 17 Friday, January 23, 2004 1:22 PM VxVM Disk Array Configuration Updates VxVM Disk Array Configuration Updates This section lists some of the disk arrays supported for Dynamic Multipathing (DMP) and describes how to use VxVM with the Sun StorEdge A3000/A3500 Array. These topics are described in this section.
hwnotes.book Page 18 Friday, January 23, 2004 1:22 PM VxVM Disk Array Configuration Updates DMP supports the Ultra SCSI and the fast-wide differential (FWD) SCSI controllers used with the EMC Symmetrix disk array. ◆ Ultra SCSI and fast-wide differential (FWD) SCSI support has been tested on the EMC OSD (Open System Director) controller. ◆ DMP was tested on and supports the Jaycor fiber controllers: firmware release level F, and driver level V2.0.1EMC and V2.0.2EMC.
hwnotes.
hwnotes.book Page 20 Friday, January 23, 2004 1:22 PM VxVM Disk Array Configuration Updates Multipathing information: numpaths: 2 c5t11d12s2 state=enabled c6t8d12s2 state=enabled HP SureStore™ E Disk Array XP512 The minimum software driver and firmware levels for the JNI adapter are: ◆ FC64-1063 Software Driver: Minimum level is V2.3. Current level V2.4.1 is recommended. ◆ FC64-1063 Firmware level: Minimum level 13.3.5, or above.
hwnotes.
hwnotes.book Page 22 Friday, January 23, 2004 1:22 PM VxVM Disk Array Configuration Updates public: slice=4 offset=0 len=14417280 disk_offset=5112 private: slice=3 offset=1 len=2879 disk_offset=2556 update: time=976952456 seqno=0.88 ssb: actual_seqno=0.
hwnotes.
hwnotes.
hwnotes.book Page 25 Friday, January 23, 2004 1:22 PM VxVM Disk Array Configuration Updates Support for IBM-SDD (Subsystem Device Driver) VxVM now supports the co-existence of IBM-SDD (vpath) on the Solaris Operating System; the supported version is IBM-SDD Version 1.4.0.7. SDD supports the multipath configuration environments in the IBM ESS. VxVM uses enclosure-based names for SDD devices (vpath). Support for SDD is provided by the new ASL, libvxvpath.so.
hwnotes.book Page 26 Friday, January 23, 2004 1:22 PM VxVM Disk Array Configuration Updates You can extract a list of supported hardware including arrays from the VERITAS customer support web site at: http://support.veritas.com For the Hitachi DF array families (DF350, DF400, DF500), only A/P mode will be supported. If you have any of the Hitachi DF arrays installed, you must ensure that the arrays are configured as A/P mode. Contact Veritas support for assistance in determining your Hitachi array mode.
hwnotes.book Page 27 Friday, January 23, 2004 1:22 PM VxVM Disk Array Configuration Updates Caution If any disk does not provide a unique serial number, DMP cannot detect multiple paths to the disk correctly and results are unpredictable. Contact the JBOD disk/disk array vendors to get correct information about unique serial numbers on disks. ◆ The JBOD disk arrays that require multipathing functionality from DMP should be of the Active/Active or Active/Passive types.
hwnotes.book Page 28 Friday, January 23, 2004 1:22 PM VxVM Disk Array Configuration Updates If the system has a version of AP lower than 2.3.1 or the system does not have the Solaris Operating System patch 110722-01, the installation/upgrade to VxVM 4.0 will abort with the following messages. If the system has a version of AP lower than 2.3.1, the following message is displayed. Alternate Pathing (AP) version 2.3.0 has been detected. This version of VxVM co-exists only with AP 2.3.
hwnotes.
hwnotes.book Page 30 Friday, January 23, 2004 1:22 PM VxVM Disk Array Configuration Updates Using the ATF Driver with VxVM CLARiiON ATF driver and DMP co-existence is supported in VM 3.0 and above. For DMP to co-exist with the ATF driver, the CLatf package (Application Transparent Failover Driver for CLARiiON) must be installed before the VRTSvxvm or SUNWvxvm packages are installed on the system. Note In VxVM 4.0, ATF/DMP co-existence works only with the CLatf 1.3.1, 3.1.0, 3.3.0.3 and 3.4.0.7 packages.
hwnotes.book Page 31 Friday, January 23, 2004 1:22 PM VxVM Disk Array Configuration Updates DMP and ATF Driver Co-existence Procedure The following warning messages may be displayed after the ATF driver is forceloaded by the operating system (this is required for DMP co-existence with the ATF driver). The messages are similar to the following: WARNING: atf[ 0/ 0/ 1/ 0]:No peer found. WARNING: atf[ 0/ 0/ 1/ 1]:No peer found. WARNING: atf[ 0/ 0/ 1/ 2]:No peer found.
hwnotes.book Page 32 Friday, January 23, 2004 1:22 PM VxVM Disk Array Configuration Updates headers: 0 248 ssb: actual_seqno=0.
hwnotes.book Page 33 Friday, January 23, 2004 1:22 PM VxVM Disk Array Configuration Updates Similarly, the output of the vxdmpadm command also displays the NONAME string for the names of the paths that have been removed.
hwnotes.book Page 34 Friday, January 23, 2004 1:22 PM VxVM Disk Array Configuration Updates An example of such a configuration is shown in the following illustration. Domain Configuration Type 1 UE10K Domain System Board 15 System Board 8 C1 C2 C3 T3 Disk Array C4 A5000 Disk Array To reconfigure a system board in the domain, such as the System Board 8 in UE10K domain in the preceding figure, use the following steps: 1. Identify all the disk controllers that are on the system board.
hwnotes.book Page 35 Friday, January 23, 2004 1:22 PM VxVM Disk Array Configuration Updates # vxdmpadm disable ctlr=C1 # vxdmpadm disable ctlr=C2 This command insures that I/Os are shifted over from the specified controller to an alternate controller connected to one of the other system boards (System Board 15 in the figure, above). This is a blocking command and may take some time to return to the caller depending on the number of I/Os currently active through this controller. 3.
hwnotes.book Page 36 Friday, January 23, 2004 1:22 PM VxVM Disk Array Configuration Updates Domain Configuration Type 2 UE10K domain System Board 8 C1 T3 Disk Array The following procedure is used for this configuration: 1. If all disks that are connected to the same disk controller exist in a single diskgroup, you should deport the diskgroup using this command: # vxdg deport dgname 2. Run the following command on all disks: # vxdisk rm daname 3.
hwnotes.book Page 37 Friday, January 23, 2004 1:22 PM VxVM Disk Array Configuration Updates Domain Configuration Type 3 In this case, the system board being detached has disk arrays connected as follows: ◆ Some disk arrays are accessible only through the system board being reconfigured. For disk arrays that are accessible through one system board, use the procedure for Domain Configuration Type 2. ◆ The remaining disk arrays are accessible through the other system board(s) as well.
hwnotes.book Page 38 Friday, January 23, 2004 1:22 PM Using the Sun StorEdge A3000/A3500 Array with VxVM Using the Sun StorEdge A3000/A3500 Array with VxVM Note The information in this section is current at the time of this printing, but is subject to change with new versions of the Sun StorEdge A3000/A3500 Array software. The Sun StorEdge A3000/A3500 Array subsystem with the Sun StorEdge A3000/A3500Array RAID Manager software is compatible with VxVM 4.0.
hwnotes.book Page 39 Friday, January 23, 2004 1:22 PM Using the Sun StorEdge A3000/A3500 Array with VxVM Installation of VxVM with the Sun StorEdge A3000/A3500 Array The Sun StorEdge A3000/A3500 Array installation sequence must be followed as documented in the Sun StorEdge A3000/A3500 Array Subsystem Release Notes, the Sun StorEdge A3000/A3500 Array System Manual, and the Sun StorEdge A3000/A3500 Array RAID Manager Installation Guide.
hwnotes.book Page 40 Friday, January 23, 2004 1:22 PM Using the Sun StorEdge A3000/A3500 Array with VxVM After the host system reboot, the original set of device nodes should be seen (the device nodes that existed before the Sun StorEdge A3000/A3500 Array subsystem was installed), and the new device nodes for each StorEdge A3000/A3500 Array LUN.
hwnotes.book Page 41 Friday, January 23, 2004 1:22 PM Using the Sun StorEdge A3000/A3500 Array with VxVM Online Data Movement Between LUNs The backup/reconfigure/reload cycle required to change the layout of hardware RAID LUNs causes data access interruption and possible data loss. To reduce the likelihood of data loss, if extra disks are available, administrators can choose to construct the destination LUN according to the desired parameters, then copy data directly from the old location to the new one.
hwnotes.book Page 42 Friday, January 23, 2004 1:22 PM Using the Sun StorEdge T3 Array with VxVM Sun StorEdge A3000/A3500 Array Unsupported Configurations The following VxVM and Sun StorEdge A3000/A3500 Array configurations are not supported: ◆ VxVM RAID-5 Configuration ◆ Sun StorEdge A3000/A3500 Array RAID-5 Configuration Using RAID-5 at both levels in the I/O subsystem can result in poor performance for no significant gain in reliability or availability. Use of this configuration is not supported.
hwnotes.book Page 43 Friday, January 23, 2004 1:22 PM Using the Sun StorEdge T3 Array with VxVM In this mode, the Sun StorEdge Traffic Manager (SSTM) driver or DMP can be used to handle multipathing. To enable DMP to handle multipathing, the /kernel/drv/scsi_vhci.conf file must have the MPxIO mode enabled (mpxio-disable=”yes”). Note All hosts in the clustered environment must use the same configuration setup for the T3 array.
hwnotes.book Page 44 Friday, January 23, 2004 1:22 PM Using the Sun StorEdge T3 Array with VxVM Removing or Uninitializing a Disk on a T3 orT3+ Array in c#t#d# Mode 1. Use Option 20 of vxdiskadm “Change the disk naming scheme” to change the name scheming mode to enclosure based format. 2. Issue vxdg command to remove the disk from the disk group: # vxdg -g dg-name rmdisk disk01 3. Issue vxdiskunsetup to remove the disk from VxVM control: # /etc/vx/bin/vxdiskunsetup T30_1 4.
hwnotes.book Page 45 Friday, January 23, 2004 1:22 PM Using the Sun StorEdge T3 Array with VxVM Using a T3+ as a Boot Device To use a T3 as a boot device, the T3 needs to satisfy some requirements: 1. All T3 firmware should be at level version 2.1 or higher. To confirm that the T3 firmware is at the necessary level, log on to the T3+ and enter the command: # t3plus:/:<1>ver and you should see output similar to the following: T3B Release 2.01.00 2002/03/22 2.
hwnotes.book Page 46 Friday, January 23, 2004 1:22 PM Using the Sun StorEdge T3 Array with VxVM dm new-dg02 v mirror c2t1d0s2 - sliced ENABLED 6143 ACTIVE 212146176 20480 SELECT - fsgen pl sd pl sd mirror-01 new-dg01-02 mirror-02 new-dg02-03 mirror ENABLED ACTIVE 23560 CONCAT mirror-01 new-dg01 23560 23560 0 c0t1d0 mirror ENABLED ACTIVE 24576 CONCAT mirror-02 new-dg02 30720 24576 0 c2t1d0 RW ENA RW ENA 2.
hwnotes.book Page 47 Friday, January 23, 2004 1:22 PM Using the Sun StorEdge T3 Array with VxVM 5. Follow the upgrade procedures to upgrade T3B firmware from 2.0 to 2.1, as specified in the upgrade documentation of the hardware. 6. Run vxdctl enable to make device available back to VM: # vxdctl enable 7. Add the disk to original disk group and use original name: # vxdiskadd c2t1d0 or # vxdg -g new-dg adddisk new-dg02=c2t1d0 # vxprint -ht dg new-dg default default 1016220570.1347.csha5.veritas.
hwnotes.book Page 48 Friday, January 23, 2004 1:22 PM Using the Sun StorEdge T3 Array with VxVM 9. Wait until the mirrors are in sync for the volume. This can be determined by examining the plex's State field in vxprint output. Once the mirrors are in sync, you will see the following in the vxprint output: # vxprint -ht dg new-dg default default 1016220570.1347.csha5.veritas.
hwnotes.
hwnotes.
