HP-UX Serviceguard Heartbeat Configuration Solutions

ManualsBrandsHP ManualsSoftwareHP Serviceguard Software

Version 1.0

October 24, 2005

Executive Summary...................................................................................... 2

Overview ................................................................................................... 2

What does this paper provide? .................................................................. 2

Interrupt Assignment Algorithm ................................................................... 3

Ensuring Heartbeat interfaces are optimally configured .................................... 4

Ensure that the heartbeat interface drivers are on different processors.............. 4

If Your System has a Non-Link Aggregate Interface for Serviceguard............. 4

If Your System has a Link Aggregate Interface for Serviceguard.................... 6

Managing Interrupts to Improve High Availability.......................................... 8

Systems with more Processors than Heartbeat interfaces.............................. 8

Systems with more Heartbeat interfaces than Processors.............................. 9

Moving interrupts................................................................................. 11

References................................................................................................ 13

Summary of content (13 pages)

PAGE 1
HP-UX Serviceguard Heartbeat Configuration Solutions October 24, 2005 Executive Summary...................................................................................... 2 Overview ................................................................................................... 2 What does this paper provide? .................................................................. 2 Interrupt Assignment Algorithm ...................................................................
PAGE 2
Executive Summary The ability to correctly configure the various heartbeat interfaces in a ServiceGuard environment helps to increase the High Availability (HA) “worthiness” of a customer solution. While some aspects may be considered common sense concepts, this paper reviews some of the more complicated configurations and instructs you how to optimize these particular configurations.
PAGE 3
Installed the Serviceguard product Installed and set up network heartbeat cards as part of the Serviceguard instructions. Installed the Interrupt migration tool (separate product for 11iv1) Interrupt Assignment Algorithm Cards and interrupts are assigned to CPU’s through a discovered round-robin algorithm. As the system queries the IO system to look for cards/devices, it assigns the interrupts to the CPU’s. The algorithm simply assigns interrupts to the CPU’s in a simple round robin fashion.
PAGE 4
Ensuring Heartbeat interfaces are optimally configured Ensure that the heartbeat interface drivers are on different processors Identify the interface(s) assigned to each of the primary and/or secondary heartbeat network interface cards (NICs) for ServiceGuard. 1. Enter the following command on the target system running HP ServiceGuard: /usr/sbin/cmgetconf 2. Look at the resulting output from /usr/sbin/cmgetconf. It should look something like this: NETWORK_INTERFACE lan9 HEARTBEAT_IP 1.1.1.
PAGE 5
NOTE Be sure you have determined that your system has a NON-Link Aggregate interface by completing the section “Ensure that the heartbeat interface drivers are on different processors” before continuing here. 1. Determine the hardware path of the interfaces. From the steps in the previous section, the Serviceguard information example showed NETWORK_INTERFACE lan9 HEARTBEAT_IP 1.1.1.1 NETWORK_INTERFACE lan15 NETWORK_INTERFACE lan5 HEARTBEAT_IP 1.1.2.
PAGE 6
hw path class drv card cpu cpu intr intr card name cell ID cell type ID description ====================================================================== 0/0/0/0 lan btlan N/A 4 N/A L 1 HP PCI 10/100Base-TX Core 0/0/1/0 ext_bus c720 N/A 1 N/A L 1 SCSI C895 Fast Wide LVD 0/0/2/0 ext_bus c720 N/A 2 N/A L 1 SCSI C87x Ultra Wide Single-Ended . 1/10/1 lan btlan N/A 5 N/A L 1 HP PCI 10/100Base-TX 4 port .
PAGE 7
interfaces – lan15 and lan16. The standby heartbeat interface is link aggregate lan905, which is made up of 2 interfaces - lan18 and lan19. 3. Determine the hardware paths of the interfaces. a) Determine the names of the interfaces.
PAGE 8
1/14/1 1/15/1 . . 1/17/1 1/18/1 c) lan lan btlan btlan N/A 9 N/A 10 N/A N/A L L 1 1 HP PCI 10/100Base-TX HP PCI 10/100Base-TX 4 port 4 port lan lan btlan btlan N/A N/A N/A N/A L L 1 1 HP PCI 10/100Base-TX HP PCI 10/100Base-TX 4 port 4 port 3 4 In the output example above, look for the hardware path obtained in step 3. It will be listed under the column labeled “hw path”.
PAGE 9
Figure 1 Systems with more Heartbeat interfaces than Processors • If you have more Heartbeat interfaces than processors (count both primary and standby interfaces): 1) Assign each primary interface to a different processor until all processors have one primary interface. Then, follow either (a) or (b). a) If there are still some unassigned primary interfaces (e.g.
PAGE 10
Number of interfaces greater than number of Processors CPU 1 CPU 2 CPU 3 P1 P2 P3 S2 CPU 4 S1 S3 Figure 2 In the next picture (Figure 3), we have multiple heartbeat pairs with APA. The configuration consists of: • APA aggregate primary heartbeat P1 contains interfaces P1A and P1B. The standby of S1 contains a single interface S1. • APA aggregate primary heartbeat P2 contains interfaces P2A and P2B. The standby APA aggregate of S2 contains interfaces S2A and S2B.
PAGE 11
APA – number of interfaces greater than number of Processors CPU 1 CPU 2 CPU 3 CPU 4 P1A P1B P2A P2B P3A S3 P3B S1 S2A S2B Figure 3 Moving interrupts If you have determined that you need to move one or more interrupts as explained in the previous section, perform the following steps: 1. Choosing the target processor.
PAGE 12
IMPORTANT: You should take into account the fact that devices may vary in their maximum bandwidth and processor consumption requirements. For example, highly utilized interfaces will tend to consume more processor cycles than lower utilized interfaces. Also, interfaces with high speeds (e.g., 1 Gbps vs 100 Mbps interfaces) can consume more bandwidth and cycles due to the higher throughput of the interface. CPU consumption can be measured by through tools such as TOP or GlancePlus. 2. Moving an interrupt.
PAGE 13
References http://docs.hp.com/en/ha.html (HP-UX High Availability) http://docs.hp.com/en/ha.html#Serviceguard (HP-UX Serviceguard) http://docs.hp.com/en/5969-4363/index.html (HP-UX Interrupt Migration Product Note) Legal Notices © 2005 Hewlett-Packard Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services.