Serviceguard Extension for RAC Version A.11.
Legal Notices © Copyright 2011 Hewlett-Packard Development Company, L.P. Confidential computer software. Valid license from HP required for possession, use, or copying. Consistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer Software Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government under vendor’s standard commercial license. The information contained herein is subject to change without notice.
Contents 1 Serviceguard Extension for RAC Version A.11.20 Release Notes........................5 Announcements........................................................................................................................5 SGeRAC Version and Components: Product Numbers ..............................................................5 Dependencies and Limitations................................................................................................5 Operating-System Dependencies..............
Known Problems.....................................................................................................................24 Types of Releases and Patches..................................................................................................24 Platform Release................................................................................................................24 Feature Release......................................................................................................
1 Serviceguard Extension for RAC Version A.11.20 Release Notes Announcements Effective September 2011, SGeRAC A.11.20 will be available bundled with HP-UX 11i v3 High Availability Operating Environment (HA-OE) and Data Center Operating Environment (DC-OE) September 2011 Update as an optional bundle media. Please note that performing a rolling upgrade from a Serviceguard only cluster with Serviceguard version A.11.19 and earlier version of OE to a Serviceguard and SGeRAC version A.11.
CLUSTER_INTERCONNECT_SUBNET parameter must not be used in SGeRAC A.11.20 toolkit Oracle Clusterware Multi-node and Oracle RAC database Multi-node packages. CLUSTER_INTERCONNECT_SUBNET requires the subnet to be configured within the SGeRAC cluster. NOTE: For the most complete and up-to-date list of support and compatibility requirements, see the Serviceguard/SGeRAC/SMS/Serviceguard Manager Plug-in Compatibility and Feature Matrix. Serviceguard and related documentation is available free at www.hp.
• • Other Rolling upgrade restrictions: ◦ You can upgrade OS during rolling upgrade only if your cluster uses SLVM and ASM over Raw disks, or ASM over SLVM configuration for the shared storage. ◦ Refer to Oracle documentation if the rolling upgrade involves an Oracle RAC version upgrade. ◦ For more information, see the HP-UX 11i v3 version of the HP Serviceguard Storage Management Suite Release Notes at www.hp.
After you deploy Oracle RAC, using the -d option with cmhaltcl (or cmhaltnode) command on a node in an SGeRAC cluster where CRS are running will return an error message and the cmhaltcl (or cmhaltnode) command is aborted. NOTE: In a mixed Serviceguard A.11.20 patch environment, where Serviceguard A.11.20 Patch PHSS_42137 is installed on some nodes and the other nodes of the cluster are on patch levels earlier to Serviceguard A.11.
Mass Storage Stack at www.hp.com/go/hpux-core-docs —> HP-UX 11i v3 —> white papers). Migration involves modifying system and application configuration files and scripts to use persistent device files, and in some cases, new commands and options. The process is described in the white papers HP-UX 11i v2 to 11i v3 Mass Storage Stack Update Guide and LVM Migration from Legacy to Agile Naming Model HP-UX 11i v3 at www.hp.com/go/hpux-core-docs —> HP-UX 11i v3 —> white papers.
1. 2. 3. If HP raw disks are being used for Oracle Clusterware and Database configuration, then you can create cDSFs and use them directly. The cluster running with Oracle clusterware and RAC Database related files on Shared Logical Volume groups using persistent Device Special File (DSF) format can be migrated to use cDSF without deactivating the volume groups (or halting OC/RAC MNP packages if they have been configured).
NOTE: To enable the this feature, Serviceguard A.11.20 Patch PHSS_41628 or later should be installed. This feature supports only Oracle 11gR2 RAC, CVM/CFS 5.0.1 or later shared storage. If SGeRAC toolkit legacy OC MNP and RAC MNP packages are configured then do not use this feature. ◦ The SGeRAC toolkit /opt/cmcluster/SGeRAC/toolkit/README file contents have been moved to Using Serviceguard Extension for RAC user guide (published March 2011 or later). Go to www.hp.
• “Support for the SGeRAC Toolkit ” (page 15) ◦ Support for new ASM DG packages ◦ Support for modular package format ◦ Support for toolkit maintenance mode ◦ Support for package halt reason feature ◦ Support for package description feature • Support for a maximum of 16 nodes in a cluster • Support for a maximum of four nodes over distances up to 100 kilometers in an extended-distance cluster with CFS/CVM 5.0.1, 5.1 SP1, and LVM 2.1. The previous maximum in this configuration was two nodes.
For Oracle Grid Infrastructure 11.2.0.2 HAIP feature to work properly in an SGeRAC cluster and to have a resilient network configured for Serviceguard heartbeat and Oracle cluster interconnect, use one of the following network configurations: 1. Configure one or more networks, each using one HP Auto Port Aggregation (APA) interface for Oracle cluster interconnect and Serviceguard heartbeat. The APA interfaces must contain two or more physical network interfaces in hot standby mode or in LAN monitor mode.
the Serviceguard package configuration parameter CLUSTER_INTERCONNECT_SUBNET. Note the following restrictions: • Cluster Interconnect subnet monitoring can support up to 4 nodes. • Only one CLUSTER_INTERCONNECT_SUBNET can be specified per multi-node package. The CLUSTER_INTERCONNECT_SUBNET parameter works similarly to the SUBNET parameter that is still supported for legacy packages. See Chapter 6 of the latest version of Managing Serviceguard at www.hp.
For more information on CFS/CVM, see the HP-UX 11i v3 version of the HP Serviceguard Storage Management Suite Release Notes at www.hp.com/go/hpux-serviceguard-docs —> HP Serviceguard Storage Management Suite —> Getting started. Support for Serviceguard A.11.20 Cluster Verification The following are the SGeRAC specific verifications supported by cmcheckconf in Serviceguard A.11.20: • The SLVM VG and CVM disk groups configured for the packages are validated.
GMS authorization GMS prevents unauthorized users from accessing cluster information and registering or de-registering group memberships. GMS authorization is disabled by default—use the GMS_USER[] parameter in /etc/opt/nmapi/nmutils.conf to configure it. Upgrade Using DRD DRD stands for Dynamic Root Disk. Using a Dynamic Root Disk on HP-UX 11i v3 allows you to perform the update on a clone of the root disk, then halt the node and reboot it from the updated clone root disk.
Documentation for this Version The following manual accompanies version A.11.20 of SGeRAC: • Using Serviceguard Extension for RAC. This manual has been updated for the A.11.20 release. It describes the RAC-specific extensions to Serviceguard that are used in configuring RAC clusters (formerly known as OPS clusters). You should also refer to the following documents: • The latest edition of Managing Serviceguard at www.hp.com/go/ hpux-serviceguard-docs —> HP Serviceguard —> User guide.
Port Requirements Oracle 11gR2 RAC requires HP-UX kernel TCP/IP ephemeral port range to be set in the range 9000- 65500. Use NDD to ensure that the HP-UX kernel TCP/IP ephemeral port range parameters are set to 900065500 on each node. Example: You can use the following command to check the existing TCP/IP port range. /usr/bin/ndd /dev/tcp tcp_smallest_anon_port tcp_largest_anon_port /usr/bin/ndd /dev/udp udp_smallest_anon_port udp_largest_anon_port Then, if required edit the file /etc/rc.config.
The correct version of SGeRAC will automatically be installed when you install one of the HP Serviceguard Storage Management Suite bundles. If SG SMS is already installed, do not install SGeRAC independently. For more information, see the HP-UX 11i v3 version of the HP Serviceguard Storage Management Suite Release Notes at www.hp.com/go/hpux-serviceguard-docs —> HP Serviceguard Storage Management Suite.
IMPORTANT: Not all paths that are supported for upgrade are supported for an upgrade using DRD, and there are additional requirements and restrictions for paths that are supported. Do not proceed until you have read the “Announcements”, “Compatibility”, and “Installing Serviceguard” sections of the latest version of the Serviceguard release notes and the corresponding sections of these SGeRAC release notes.
allow you to keep the node up and running in the cluster while you upgrade the other nodes. You will still need to investigate and solve the problems on this node before the cluster upgrade can complete. If you decide to perform a hot recovery, proceed as follows: 1. Halt the packages and restart them on another node. 2. Halt the node. 3. Reboot the node from the original root disk (contains the pre-upgrade versions of HP-UX and Serviceguard). 4.
6. 7. Reboot the nodes from their updated clone root disks. Restart the cluster: cmruncl 8. 9. If necessary, upgrade all the nodes in the cluster to the new Oracle (RAC, Clusterware) release. Restart Oracle (RAC, Clusterware) on all nodes in the cluster and configure the Serviceguard/SGeRAC packages and Oracle as needed. 10. Verify that the cluster is healthy, the packages can run, and applications are functioning properly.
6. 7. 8. Edit the cluster configuration ASCII file, using the back-up of cluster configuration taken in Step 1 to remove any OPS_VOLUME_GROUP entries, then run the cmapplyconf command. Start the cluster using cmruncl command. Reapply all necessary package configurations, using back-up of the configurations taken in Step 2. Troubleshooting Tips The core dump locations for the cluster manager and shared logical volume manager daemons are in /var/adm/cmcluster and /etc/lvmconf respectively.
Table 1 SGeRAC A.11.20 Fixes QXCR Number QXCR Title QXCR1000984570 SGeRAC instances cannot start properly after update to A.11.19 QXCR1000977899 cmgmsd reports pstat_getsocket errors unnecessarily from 11.18 onwards QXCR1000971142 SGeRAC toolkit does not handle Oracle user that uses csh QXCR1000985624 Serviceguard eRAC 11.
Patch A patch to a release is issued in response to a critical business problem found by a customer. With a patch, the following is guaranteed: • Patch-specific release testing is performed prior to posting the patch. • Existing functionality, scripts, etc., will continue to operate without modification. • All fixes from the previous patch are incorporated. For a patch, certification testing is recommended only for those fixes that are important to the customer.
