System Fault Management Administrator’s Guide HP-UX 11i v1 HP Part Number: 5991-6717 Published: E0612
© Copyright 2006 Hewlett-Packard Development Company, L.P Legal Notices The information in this document is subject to change without notice. Hewlett-Packard makes no warranty of any kind with regard to this manual, including, but not limited to, the implied warranties of merchantability and fitness for a particular purpose.
Table of Contents About This Document ........................................................................................................9 Intended Audience.................................................................................................................................9 Publishing History..................................................................................................................................9 Document Organization.................................................
Viewing Information About Power Supplies..................................................................................42 Viewing Temperature Status...........................................................................................................42 Viewing Voltage Status....................................................................................................................42 Viewing Information About Firmware Revision...................................................................
Enabling Tracing Using EVWEB GUI..............................................................................................63 Enabling Tracing Using EVWEB CLI..............................................................................................63 Modifying Tracing Using EVWEB GUI...........................................................................................63 Modifying Tracing Using EVWEB CLI............................................................................................
List of Figures 1-1 3-1 3-2 3-3 3-4 3-5 3-6 3-7 3-8 3-9 3-10 3-11 3-12 3-13 3-14 4-1 4-2 4-3 4-4 6 Block Diagram of SFM on PA-RISC-Systems................................................................................13 HP SIM Home Page.......................................................................................................................28 Global Protocol Settings................................................................................................................
List of Tables 1 2 1-1 2-1 3-1 3-2 4-1 4-2 4-3 4-4 4-5 Publishing History..........................................................................................................................9 HP-UX Releases.............................................................................................................................10 Instance Providers.........................................................................................................................12 Online Diagnostics Versions...
About This Document This document describes how to install, administer, and troubleshoot the System Fault Management (SFM) software and its components. Document updates may be issued between editions to correct errors or to document product changes. To ensure that you receive the updated or new editions, subscribe to the appropriate product support service. Contact your local HP sales representative for more information. This document can also be found online at: http://docs.hp.
Emphasi Text that is emphasized. Bold The defined use of an important word or phrase. C o m p u t e r O u t p u t Text displayed or generated by the system. UserInput Commands and other text that you type. Command A command name or qualified command phrase. Variable The name of a variable that you can replace in a command or function or information in a display that represents several possible values. [] The contents are optional in formats and command descriptions.
1 Introduction This chapter introduces you to the System Fault Management (SFM) software and the tools that SFM includes. The chapter discusses the following topics: • • • • • “Overview” (page 11) “Features and Benefits” (page 11) “Providers” (page 11) “User Interfaces” (page 13) “Architecture” (page 13) Overview The SFM software is a collection of tools used to monitor the health of HP servers running HP-UX.
Instance Providers On request, an SFM instance provider dynamically queries the local or remote system for the property information described in Table 1-1 and reports the information to the CIMOM.
Service (EMS) events generated on a remote system. On the system on which SFM is installed, you can use an SFM tool called EVWEB to view and administer events through the HP SMH interface. NOTE: The terms events and indications are used interchangeably. User Interfaces You can use two types of interfaces to view SFM provider queries: HP SIM and HP SMH. This section describes these interfaces.
The following list describes the sequence of events when a request is made for information: 1. 2. 3. 4. 5. The CIMOM receives requests from the CMS for device information. The CIMOM converts the requests to a format that is deciphered by the SFM providers and directs the requests to the appropriate SFM provider, for example, the CPU Instance Provider. The SFM provider queries the associated hardware device for property information. The SFM provider returns the query information to the CIMOM.
2 Installing the SFM Software The System Fault Management (SFM) software is installed by default with the HP-UX 11i v1 Operating Environment (OE) media. However, at some point you may need to install the SFM software separately. This chapter describes how to install the SFM software as a standalone component on the HP-UX 11i v1 operating system.
NOTE: The version numbers of the products shown in the figures may be different from the version you are installing. Installing Using the TUI To install the SFM software using the TUI, complete the following steps: 1. 2. Log in to the system as a superuser. Mount the CD to a location of your choice as in the following example: # mount /dev/dsk/c1t2d0 /tmp/cdrom 3.
NOTE: The system selects some options by default. However, you must select the two options mentioned in step 5 to automatically install the prerequisites. 7. 8. Click OK in the Note window to confirm the selection of dependencies. In the SD Install - Software Selection window, select Actions->Install to begin installation, as shown in the following figure: NOTE: SFM is automatically configured after it is installed.
9. Unmount the CD. To unmount, enter the following command at the HP-UX prompt: # unmount /tmp/cdrom 10. To verify whether the SFM software is installed properly, enter the following command at the HP-UX prompt: # swlist | grep SysFaultMgmt If the SFM software is installed properly, SysFaultMgmt and the version number of the SFM software are displayed in the output. If the SFM software is not installed properly, you must repeat the installation procedure.
1. Go to HP Software Depot at: http://www.hp.com/go/softwaredepot 2. 3. 4. 5. 6. 7. 8. 9. Search for SysFaultMgmt. The Overview page is displayed. Go to the Installation page and review Prerequisites to ensure that your system meets the requirements. Select the Receive for Free >> option at the bottom right of the page. Select the appropriate release of the HP-UX operating system. Enter your registration information. Read and accept the terms and conditions. Click Next >> at the bottom right of the page.
The Logfile, which includes details about the installation, is displayed. If there are no errors in the Logfile, the SFM software is installed properly. If the SFM software is not installed properly, you must repeat the installation procedure. 3.
1. 2. Log in to the system as a superuser. Enter the following command at the HP-UX prompt: # swjob If the output contains no errors, the SFM software is installed properly. Otherwise, you must install the SFM software again. A sample output is shown in the following figure: 3.
4. Select Actions->Mark for Remove in the SD Remove window, as shown in the following figure: 5.
6.
7. When the SFM software is removed, the Remove Window is displayed, as shown in the following figure: 8. To verify whether the SFM software is removed properly, enter the following command at the HP-UX prompt: # swlist | grep SysFaultMgmt If the SFM software is removed properly, SysFaultMgmt and the version number of the SFM software does not appear in the output. If the SFM software is not removed properly, you must repeat the removal procedure.
2. Enter the following command at the HP-UX command prompt: # swremove SysFaultMgmt 3. To verify whether the SFM software is removed properly, enter the following command at the HP-UX prompt: # swlist | grep SysFaultMgmt If the SFM software is removed properly, SysFaultMgmt and the version number of the SFM software do not appear in the output. If the SFM software is not removed properly, you must repeat the removal procedure. For more information, see “Verifying Removal of the SFM Software” (page 25).
Filters are classified as follows: • HP-Defined Filters HP-Defined filters are defined by HP, and are present in the FMD repository at the time of installation. You can enable or disable HP-Defined filters. To enable HP-Defined filters, run fmdcontrol enable at the HP-UX prompt. To disable HP-Defined filters, run fmdcontrol disable at the HP-UX prompt. Indications fulfilling the conditions in the HP-Known HP-Defined filters are logged in the Event Archive.
3 Administering Indications and Instances Using HP SIM This chapter describes System Fault Management (SFM) administration on a remote system using HP Systems Insight Manager (HP SIM). NOTE: You can perform similar tasks using other management applications that are compliant with the Common Information Model (CIM) (2.7) schema of the Distributed Management Task Force (DMTF). The terms events and indications are used interchangeably in this document.
2. To create subscriptions, select Options-->Protocol Settings-->Global Protocol Settings in the HP SIM Home page, as shown in Figure 3-1. Figure 3-1 HP SIM Home Page The Global Protocol Settings window is displayed, as shown in Figure 3-2.
Figure 3-2 Global Protocol Settings 3. 4. In Figure 3-2, under Default WBEM settings, select Enable WBEM. Click OK to save your settings. Select Configure->Configure or Repair Agents, as shown in Figure 3-3.
The Configure or Repair Agents window is displayed, as shown in Figure 3-4. Figure 3-4 Configure or Repair Agents 5. 30 From the Add targets by selecting from: list in Figure 3-4, select All Systems to view and select the systems.
on the selected system. The list of systems is displayed in the Select Target Systems window, as shown in Figure 3-5. Figure 3-5 Select Target Systems 6. To select all the systems in the network, select the Select “All Systems” itself check box, as shown in Figure 3-5. Click Apply. The Verify Target Systems window is displayed, as shown in Figure 3-6.
7. Select the appropriate check box to verify the target systems and click Next, as shown in Figure 3-6. The Enter Credentials window is displayed, as shown in Figure 3-7.
8. Enter your credentials in the given fields, as shown in Figure 3-7. Click Next. The Configure or Repair Settings window is displayed, as shown in Figure 3-8. Figure 3-8 Configure or Repair Settings 9. On the Configure or Repair Settings window, click Run Now. The Task Results window is displayed, as shown in Figure 3-9. The Task Results window states that the Indication Subscription is successfully created.
Figure 3-9 Task Results 34 Administering Indications and Instances Using HP SIM
10. To obtain a printable report of the indication subscription details, click View Printable Report. The report is displayed, as shown in Figure 3-10. Figure 3-10 Printable Report of the Indication Subscription For more information, see the HP Systems Insight Manager Installation and User’s Guide at: http://docs.hp.com/en/netsys.
1. Select All Events in the left pane of the HP SIM window. The list of events is displayed, as shown in Figure 3-11.
2. To view the details of an event, select the event. The details are displayed at the bottom of the same window, as shown in Figure 3-12.
3. To obtain the printable version of the event details, click View Printable Details at the bottom of the window. The printable report is displayed in a new window, as shown in Figure 3-13. Figure 3-13 Printable Event Details To create subscriptions and view indications using the CLI, see “Creating Event Subscription Using the CLI” (page 50)“Creating Event Subscription Using the CLI” on page 79. The ProviderName in the Event Details window indicates the monitor that generated the event.
Table 3-2 compares the EMS Hardware Monitors properties with the equivalent EMS Wrapper Provider properties.
1. On the System Page of HP SIM, click System Management Homepage, as shown in Figure 3-14 (page 40). Figure 3-14 System Page The HP System Management Homepage (HP SMH) Home window is displayed. This window provides details about the system. 2. Select 4 items not shown under System on the (HP SMH) Home window. The system page is displayed. 3. To view information about the processors on the system, select Processors.
2. Select Disks on the system page. Information about the disks such as Hardware Path, Serial Number, and Disk FW Revision is displayed. 3. To return to the System Management Homepage Home window, select Home at the top of the window. NOTE: There is no CLI to view information about the voltage status. For more information, see the HP Systems Insight Manager Installation and User’s Guide at: http://docs.hp.com/en/netsys.
3. To return to the System Management Homepage Home window, select Home at the top of the window. NOTE: There is no CLI to view information about cooling devices. For more information, see the HP Systems Insight Manager Installation and User’s Guide at: http://docs.hp.com/en/netsys.html Viewing Information About Power Supplies To view information about the power supplies, complete the following steps: 1. 2. On the System Page, select System Management Homepage, as shown in Figure 3-14 (page 40).
3. Select Voltage on the system page. The voltage status of the system is displayed in the Voltage Status window. 4. To return to the System Management Homepage Home window, select Home at the top of the window. NOTE: There is no CLI to view information about the voltage status. For more information, see the HP Systems Insight Manager Installation and User’s Guide at: http://docs.hp.com/en/netsys.
4 Administering Indications and Instances Using HP SMH This chapter describes the SFM administration tasks that you can perform using HP SMH on a local system. This chapter discusses the following topics: • “Viewing Instances” (page 45) • “Administering Indications Using EVWEB” (page 48) • “Viewing Event Subscriptions” (page 54) • “Viewing Indications” (page 58) • “Tracing EVWEB” (page 61) Viewing Instances This section describes the tasks you must perform to view instances.
1. On the HP System Management Homepage (HP SMH), under System, select Processors, as shown in Figure 4-1. Figure 4-1 HP System Management Homepage Information about processors is displayed. 2. Select Home to return to the HP SMH. Viewing Information About Cooling Devices To obtain information about cooling devices using the Environmental Provider, complete the following steps: 1. On HP SMH (Figure 4-1), under System, select Cooling. Information about cooling devices is displayed. 2.
Viewing Information About Power Supplies To obtain information about the power supplies using the Environmental Provider, complete the following steps: 1. On HP SMH (Figure 4-1), under System, select Power. Information about power supplies is displayed. 2. Select Home to return to HP SMH.
Viewing Information About Temperature and Voltage To obtain information about the temperature and voltage using the Environmental Provider, complete the following steps: 1. On HP SMH (Figure 4-1), under System, select ...2 items not shown. The System page is displayed. 2. To view voltage status, Under System, select Voltage. Information about voltage is displayed. 3. To view temperature status, Under System, select Temperature. Information about temperature is displayed. 4.
NOTE: For information on how to configure user groups in HP SMH, see the HP System Management Homepage User’s Guide at: http://www.docs.hp.com Launching EVWEB for Administration You can launch EVWEB either through the CLI or through the HP SMH GUI. To Launch EVWEB using the CLI, enter the following command at the HP-UX prompt: # evweb subscribe To use HP SMH GUI to launch EVWEB for administering event subscription, complete the following steps: 1. Log in to HP SMH.
Creating an Event Subscription Using the GUI To create a new event subscription, complete the following steps: 1. 2. Repeat steps 1-5 from “Launching EVWEB for Administration” (page 49). Select Create subscription in the action pane on the top right corner of the page. The Create Subscription page is displayed. 3. Provide appropriate information in the fields present in the Create Subscription page. NOTE: 4. 5. It is mandatory to specify a unique name for creating an event subscription.
5. IMPORTANT: The subscription criteria is not copied when you copy an HP Advised event subscription. Therefore, ensure that you specify the subscription criteria in the Copy and Create Subscription page. 6. Select Create on the Copy and Create Subscription page. EVWEB creates the event subscription and displays a confirmation message. 7. Click OK on the confirmation message window. NOTE: There is no CLI equivalent of this action. The Copy and create subscription feature is available only on GUI.
For more information on modifying an event subscription using the HP SMH GUI, select Help on the action pane of the Modify Event Subscription page. Modifying an Event Subscription Using the CLI To modify an event subscription using CLI, enter the following command at the HP-UX prompt: # evweb subscribe -M -n -v -t Where: -M is an option used to modify event subscriptions. -n is a switch used to specify a name for an event.
7. Click OK on the confirmation message window. NOTE: There is no CLI equivalent of this action. The Copy and modify subscription feature is available only on GUI. IMPORTANT: The subscription criteria is not copied when you copy an HP Advised event subscription. Therefore, make sure that you specify the subscription criteria in the Copy and modify subscription page.
A message stating that the execution of the evweb subscribe command was successful is displayed on the screen. NOTE: Using CLI, you can delete only one event subscription at a time. For more information on deleting event subscriptions using the CLI, see evweb_subscribe(1). Configuring E-mail Consumer The E-mail Consumer is a component of EVWEB that receives indications from the WBEM Services, and redirects them to an SMTP server. Normally, the local system itself is the e-mail server.
HP Known event subscriptions are created by default during the installation of the SysFaultMgmt bundle. HP Known event subscriptions are also created by administrators using the /opt/sfm/bin/sfmconfig command. HP provides some event subscriptions with EVWEB. These event subscriptions are known as HP Advised event subscriptions. By default, the HP Advised event subscriptions store the events in the Event Archive.
Table 4-1 EVWEB Event Subscriptions (continued) Field Description Event Archive Displays TRUE if the subscription criterion is configured to store the WBEM indications in the Event Archive. Displays FALSE if the subscription criterion is not configured to store the WBEM indications in the Event Archive. Email Displays TRUE if the subscription criterion is configured to send an e-mail to the specified e-mail address, when a WBEM indication is generated.
Table 4-2 Details of an Event Subscriptions (continued) Field Description Subscription Criteria Displays the criteria that are specified for the subscription. For example, Severity, Event Id, Event Category, Device, and so on. Subscription Destination Displays the destination location where the WBEM indications are stored. For example, Event Archive, e-mail address.
Table 4-3 External Event Subscriptions Field Description Filter Name Displays the name of an event subscription. Handler Name Destination URL Displays the destination location where the indications are stored. Query Displays the subscription criteria. For information on viewing external subscriptions using the CLI, see evweb_subscribe(1). Viewing Indications This section describes how to perform non-administration tasks related to viewing WBEM indications using EVWEB.
You can view and delete WBEM indications using the Event Viewer. Searching WBEM Events You can search for WBEM events that are stored in the Event Archive using either the GUI or the CLI. Searching WBEM Events Using the GUI The Event Viewer GUI enables you to filter the WBEM events based on their severity level. To filter WBEM events, based on the severity of the event, complete the following steps: 1. 2. Repeat steps 1-5 from “Launching EVWEB for Viewing WBEM Indications” (page 58).
Viewing Summary Information About WBEM Events You can view summary information about events stored in the Event Archive database. Viewing Summary Information Using the GUI To view summary information about WBEM events, repeat steps 1-5 from “Launching EVWEB for Viewing WBEM Indications” (page 58). The List Events page is displayed. The List Event tables displays summary information about WBEM events that are stored in the event archive.
1. 2. Repeat steps 1-5 from “Launching EVWEB for Viewing WBEM Indications” (page 58). Select Delete Events in the action pane on the top right corner of the page. The Delete Events page is displayed. 3. Select the event you want to delete by selecting the appropriate check box. You can delete more than one WEBM event at a time. 4. Select Delete in the List Events page. EVWEB deletes the event from the event archive database and displays a confirmation message. 5.
this manual. The trace records are stored in the /var/opt/sfm/log/sfm.log file. You can send the sfm.log file to the HP support center whenever you encounter a problem. Following is a sample of the information logged in sfm.log. 01/04/06 06:50:08 EVMAN_COMMANDS ERROR 1069627450 1 Subscription with this name already exist, Please choose different name and try again. Table 4-4 describes the various fields included in the sfm.log file. Table 4-4 Entries in sfm.
Irrespective of whether tracing is enabled or not, the administrative commands for creating, modifying, and deleting subscriptions, and deleting events are stored in the /var/sam/log/ samlog.log file. From the GUI, you can access the samlog.log file from HP SMH home page -> Logs -> Samlog. NOTE: Tracing is available for administrators only. Enabling Tracing Using EVWEB GUI To enable tracing, complete the following steps: 1. Log in to the System Management Homepage.
4. Do one of the following: • Select Tools -> Subscription Administration. or • Select Logs -> Event Viewer. NOTE: 5. The Modify Tracing option is not displayed if tracing is not enabled. Select Modify Tracing available at the top right corner of the page. The Modify Tracing page is displayed. 6. 7. Change the trace level by selecting the level in the Trace Level list. Select Modify Tracing. The tracing level is modified and a confirmation message is displayed. 8.
# unset EVWEB_TRACE_LEVEL Tracing is now disabled. NOTE: Tracing is automatically disabled at the end of an EVWEB session.
5 Troubleshooting SFM This chapter describes how to troubleshoot SFM providers and EVWEB. This chapter addresses the following topics: • “Troubleshooting Instance Providers” (page 67) • “Troubleshooting Indication Providers” (page 69) • “Troubleshooting EVWEB” (page 72) Troubleshooting Instance Providers This section describes techniques for troubleshooting instance providers, such as the CPU Instance Provider, Memory Instance Provider, Filter Metadata (FMD) Provider, and Environmental Providers.
Solution Enter the following command at the HP-UX prompt: # cimprovider -ls | grep SFMProviderModule If the following output is displayed, all the providers are registered properly: SFMProviderModule OK If the output displayed is different from this output, the provider module is not registered. To register the provider module, enter the following command at the HP-UX prompt: # cimmof -nroot/PG-InterOp /opt/sfm/schemas/mof/SFMProvidersR.
To execute the file, enter the following command at the HP-UX prompt: # wbemexec /EnumerateInstances.xml The full path is the absolute path of the EnumerateInstances.xml file.
If no errors messages are displayed, the provider module is registered properly. If errors are displayed, restart the CIMOM by entering the following command at the HP-UX prompt: # cimserver After the CIMOM restarts, enter the following command at the HP-UX prompt to register the provider module: # cimmof -nroot/PG-InterOp /opt/sfm/schemas/mof/SFMProvidersR.
To enumerate instances, enter the following command at the HP-UX prompt: # wbemexec /enumerateInstances_sub.xml The full path is the absolute path of the enumerateInstances_sub.xml file.
Cause 5 The indication providers are not loaded properly. Solution To check whether the EMS Wrapper Provider is loaded properly, complete the following steps: 1. 2. 3. Open the /opt/sfm/conf/FMLoggerConfig.xml file. Using an editor, change the severity of logs from WARNING to INFORMATIONAL. Enter the /opt/sfm/bin/fmdcontrol command with the /opt/sfm/conf/FMLoggerConfig.xml option: # /opt/sfm/bin/fmdcontrol /opt/sfm/conf/FMLoggerConfig.xml 4.
To check whether the Event Archive Database service is running, enter the following command at the HP-UX prompt: # ps -eaf grep sfmdb If the output of this command is sfmdb, the Event Archive Database service is running. If the Event Archive Database service is stopped, enter the following command at the HP-UX prompt to start the service: # /sbin/init.d/sfmdb start If the Event Archive Database service is running and the problem persists, check for error logs in the /opt/sfm/log/sfm.log file.
Cause The Email Consumer is disabled. Solution To check whether the Email Consumer is running, enter the following command at the HP-UX prompt: # ps -eaf grep sfmdb The system registers the Email Consumer only when the first event subscription that has email as the destination is created. As the Email Consumer is initially inactive, you can disable or enable the Email Consumer only after an event subscription having an email as its destination, is created.
Glossary A-B Admin-Defined event subscription Subscriptions created by the administrator using the CLI. These subscriptions cannot be deleted. Admin-Defined filters Filters that can be created, deleted, and modified to set the criteria for indications that must be logged. C Central Management Server (CMS) The server monitoring the client systems in the network using SFM. CIM client An entity in WBEM architecture which sends CIM Operation requests and receives CIM Operation responses.
F-G fmControl The command used to configure software error logging parameters. fmdcontrol The command used to create, delete, and modify Admin-Defined filters. H HP System Management Homepage (HP SMH) HP's management application installed on the local system that uses WBEM instrumentation on operating systems such as HP-UX, Linux, and Windows.
subscription Configuring SFM for consumers to receive indications. For example, HP SIM could subscribe to indications generating on hardware devices on a system. SysFaultMgmt The name of the bundle that includes the SFM software. T-V Tracing Tracing is an error-logging and reporting facility provided by EVWEB. W-Z WBEM (Web-Based Enterprise Management) A collection of standards that aid large-scale systems management. WBEM allows management applications to monitor systems in a network.
Index A administrator, 48 Autoselect dependency, 16 B benefits SFM, 11 C Central Management Server (see CMS) CIMOM, 14 cimserver, 67, 68 -s option, 67 CMS, 13 command-line interface, 15 Common Information Model Object Manager (see CIMOM) configuration SFM, 17 cooling device, 46 cooling devices on a system, 41 CPU instance provider, 45 creation subscription, 27 HP-Known, 51 managing, 48 modifying, 52, 53 viewing external event subscription, 57 EVWEB, 48 CLI, 48, 58 component, 48 GUI, 48, 58 local administ
O V /opt/sfm/conf/evweb.conf file, 54 OEUR, 15 online diagnostics version, 15 OnlineDiag, 15 OpenSSL, 15 Operating Environment Update Release (see OEUR) /var/sam/log/samlog.