HP Insight Control Performance Management 6.
© Copyright 2003, 2010 Hewlett-Packard Development Company, L.P. Legal Notices Confidential computer software. Valid license from HP required for possession, use or copying. Consistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer Software Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government under vendor's standard commercial license. The information contained herein is subject to change without notice.
Table of Contents 1 Introduction...............................................................................................9 Overview...............................................................................................................................................9 Structure..............................................................................................................................................10 Features....................................................................
Generating a Static Analysis Report...................................................................................................30 Generating an SQL queries list.....................................................................................................30 Sample performance management Static Analysis report.......................................................................30 System Summary report..............................................................................................
Server metrics.......................................................................................................................................53 Server status....................................................................................................................................53 Server inventory...............................................................................................................................53 Processors........................................................
Fibre Channel Host Bus Adapter Inventory...........................................................................................63 Network storage controller.....................................................................................................................63 Network Storage Controller Status......................................................................................................64 Network Storage Controller Inventory..........................................................
List of Tables 5-1 6-1 6-2 6-3 6-4 6-5 6-6 Insight Control performance management overall performance summary................................................41 Installation and uninstallation issues...................................................................................................43 HP Systems Insight Manager integration.............................................................................................43 Insight Control performance management license administration issues.........
1 Introduction Overview HP Insight Control performance management detects, analyzes, and explains hardware configuration issues and performance bottlenecks on HP ProLiant servers, virtual machines, and MSA shared storage. Insight Control performance management provides the tools you need to receive proactive notification of building bottleneck conditions and to debug existing performance issues. With Insight Control performance management, performance can be monitored on one or more servers.
Structure The performance monitoring service is designed to run on a separate middle-tier server (analysis server), which also serves as the HP Insight Control console server and performs the bulk of the processing. The monitored servers are only required to run the standard HP Management Agents or/and WBEM Providers, installed as part of the HP ProLiant Support Pack.
2 Licensing Overview This chapter provides information about licensing servers for use with performance management. In the earlier releases of performance management, servers were licensed using the License Manager and the Unlicensed System page. Starting with the Insight Software 6.0 DVD release, licensing the servers procedures are different than the earlier versions.
To resolve: 1. Rediscover the server in Systems Insight Manager using the correct management protocol and valid SNMP community strings or WBEM credentials. 2. Verify the product name and operating system information on the system page of the server. After successfully completing the task, the server appears on the Monitoring Administration page. To verify if the server is a supported server, see to supported servers list in the HP Insight Software Support Matrix document.
Applying licenses to a server To apply licenses to a server, complete the following steps: 1. 2. 3. 4. Select the server you want to license. From the HP Insight Control console toolbar, select Configure→Managed System Setup wizard. The Introduction page appears. Click Next. List of features that can be configured for the systems is listed in Select Features page. Select HP Insight Control performance management and click Next. The Choose Options page appears. Click Next. The Select Features page appears.
3 Monitoring the server performance Overview This chapter provides an overview of the complete performance management functionality.
Monitoring Administration page This page lists the number of discovered and licensed servers. The server list includes all of the licensed servers by name, model, IP address, monitor status, mode of operation, sample rate, and number of samples. The default monitoring status and number of samples values are assigned to a server when it is monitored. The Monitoring Administration page also allows you to change the monitoring parameters of the monitored servers.
1. 2. 3. 4. Monitor - This mode enables server status monitoring, updating information that Systems Insight Manager and HP Insight Control performance management display. You can view the analysis information using the Online Analysis tool. Monitor & Alert - This mode, in addition to the capabilities enabled with Monitor, sends alerts to Systems Insight Manager when the status of a server changes.
NOTE: You cannot delete the logged data of a server for the same day or the same date. The data needs to be logged in for a minimum of 24 hours before deleting the logged-in data for the server. 4. To remove the data from the performance management database, click Delete Selected Data. Enabling virtual machine host and virtual machine guests logging Virtual machine guests that are configured on the virtual machine host currently being monitored are not automatically monitored.
1. 2. 3. 4. 5. From the HP Insight Control console toolbar, select Options→Performance Management→Monitoring Administration. The Monitoring Administration page appears in a new window. Select the Server tab. Servers or virtual machine hosts and virtual machine guests available for monitoring appear in the list. Select the virtual machine guest for which to change monitoring parameters. To select all the items listed on the page, select the checkbox at the top of the column.
4 Analyzing the server performance Overview This chapter provides you with the various tools available in the performance management for analysis of the monitored servers and also discusses the different options available for analyzing the information logged/available for the servers.
When Online Analysis is started for a server, an Online Analysis session is started automatically for any network storage enclosure connected to that server. If you have a hypervisor installed, and have configured Virtual Machines, performance management treats this server as a VM host. When performance management identifies the server as a VM host, you must license the server through Insight Control virtual machine management.
The Offline Analysis tool enables you to view recorded data sessions from the performance management database. To use Offline Analysis: 1. 2. 3. 4. 5. From the Insight Control/Insight Dynamics console toolbar, click Diagnose→Performance Management→Offline Analysis. Select the checkbox next to the server or select multiple servers for which you wish to view the performance data. Click Apply Selections→Run Now. Select the start date in the date selection column for a server to display the performance data.
System Details pane The Systems detail pane appears at the top left side of the browser window below the banner and provides the following information: • Server name - Displays the name of the server currently being monitored • Server OS - Displays the operating system version of the server currently being monitored • Server IP - Displays the IP address assigned to the server currently being monitored • Sample Rate - Displays the frequency with which the agents are collecting performance data on the
Expanding the local storage To expand the tree structure for the storage component, click the + icon next to Storage in the configuration tree, and then select the storage node. The graphical representation is as displayed in the following figure. Displaying the controller To display the tree structure for the Smart Array 6i controller, click the + icon next to Smart Array 6i controller in the configuration tree. The arrays defined for that controller and the SCSI bus entries (ports) appear.
Displaying the port To display the tree structure for the storage system port: 1. 2. Click the + icon next to SCSI Port 2 in the configuration tree. Scroll the pane to the right to display the Port Enclosure status. The graphical representation is as displayed in the following figure. Displaying the drive Click the ID 1: 16GU3 15K( LD1 ) drive. The graph displays the performance statistics for that drive over the duration shown in the screenshot.
Displaying the inventory To display information for the selected drive, select the Inventory tab. The graphical representation is as displayed in the following figure. Hardware or configuration details for the currently selected device appear.
5 Reports Overview The Insight Control performance management can generate reports illustrating the percentage of time a system was in a bottleneck state and the overall performance utilization for a system categorized by its components. A System Summary report can be generated from data in the performance database in HTML format. CSV File Generator can generate comma-separated value (CSV) files for import into desktop analysis or reporting tools.
Generating a Static Analysis Report 1. 2. 3. 4. From the Insight Control console, click Reports→Performance Management→Static Analysis Report Select the server for which you want to generate a Static Analysis report. Enter the appropriate dates in the Report on Data From and Report on Data To boxes to get the period for which you want to generate the report. Leave these boxes blank to generate a report from the current performance data. Click Generate Report.
System Summary report System Summary reports are created in a browser window in a printable format. The report has two sections. The first section consists of a table showing what percentage of time each server subsystem was in a bottleneck state during the selected interval. This table provides a convenient method for gauging the performance health of a server. The second section of the summary report includes a detailed system configuration listing.
Generating an SQL queries list 1. 2. From the System Summary Report screen, select the server for which you want to generate a list. Click Show SQL queries. The SQL query appears in a separate browser window. Sample performance management System Summary report System Summary reports are created in a browser window in a printable format. The report has two sections.
Secondary Bus 100.0 0.0 0.0 Bus 5 100.0 0.0 0.0 Storage 100.0 0.0 0.0 Smart Array 6i 100.0 0.0 0.0 Drive Array: A 100.0 0.0 0.0 Physical Disk: 0 100.0 0.0 0.0 SA SCSI Enclosure: Internal Drive Cage 100.0 0.0 0.0 Server Model: ProLiant DL380 G4 Processors Intel Xeon 2.8-GHz4 MByte L2 Cache 2.8 GHz with 4.
Subsystem % Normal % Minor % Major Processors 100.0 0 0 Memory 100 0 0 Network Connections 100 0 0 Server Model: ProLiant BL460c G1 Processors Processor 2 Physical Processor(s) CPU MHz 2666 Memory Total Memory: 2046 MB Network Connections IP Addresses: 172.24.38.69 Storage Capacity: 137984.0 MByte Free Space: 16533.0 MByte Mount Points /vmfs/volumes/Storage1 (3) /vmfs/volumes/SAN-ESX Guest SSR Subsystem % Normal % Minor % Major Processors 100.
Performance management Summary Report for 131.111.1.73 Hardware Configuration as of 03/16/2004 Reporting from 03/16/2004 to 03/19/2004 Subsystem % Normal % Minor % Major Processors 96.0 4.0 0 CSV File Generator report CSV File Generator generates comma-separated value (CSV) files for importing into desktop analysis or reporting tools. The CSV file documents each individual sample for every component analyzed, collecting different measurements for each.
Server Availability report A Server Availability report is created in a browser window in printable format. This report consists of a table listing what percentage of time each server component was in a bottleneck state during the selected interval, providing a convenient method for gauging the health of a server. Generating a Server Availability Report 1. 2. 3. 4. 5. 36 Reports From the Insight Control console, click Reports→Performance Management→Server Availability Report.
Generating an SQL queries list 1. 2. From the Server Availability Report screen, select the server for which to generate a list. Click Show SQL Queries. The SQL query appears in a separate browser window. NOTE: Server availability reports are not available for virtual machine guests. Sample performance management Server Availability report Server Availability report is created in a browser window in a printable format.
Server performance Page reads per second Processor performance Available Megabytes Average processor busy NIC performance Processor busy NIC Megabytes per second Interrupts per second Storage performance Context switches per second Storage transfers per second Memory performance Storage Megabytes per second Hard page faults per second PCI performance Pages input per second Host bus Megabytes per second Servers with VMware, Hyper-V or VMHost The following table lists the measurement categor
Drive array Read Megabytes per second Logical drive Write Megabytes per second Windows physical disk Milliseconds per read Drive ID Milliseconds per write Sample time Queue length Reads per second — SCSI buses attached to Smart Array controllers The following table lists the measurement categories for SCSI buses attached to Smart Array controllers.
Adapter Transfers per second Bus Megabytes per second Sample time SCSI bus utilization percent SCSI drives attached to SCSI adapters The following table lists the measurement categories for SCSI drives attached to SCSI adapters.
The following table describes the configuration details and performance status for components analyzed by performance management. The appropriate components are shown in the second section of the summary report. NOTE: When performance management is unable to analyze and log data for a component, the values of %Normal, %Minor, and %Major might be 0.
6 Troubleshooting Overview This chapter identifies and provides solutions for commonly encountered setup and installation problems.
Issue Occurs when After the performance management The PMPTools.xml file is not executed installation, the performance management properly during Systems Insight Manager menu might not appear on the Systems and performance management integration. Insight Manager console. Solution Add the performance management menu manually.
Issue Occurs when Solution While attempting to monitor a virtual host, When the virtual host is not licensed and To ensure that the Virtual Host is registered the PF column displays a critical icon for managed by virtual machine management. and licensed to virtual machine the virtual host. management, complete the following procedure: 1. Select the host server on the All Systems page. 2. Click Deploy on the All Systems page. 3. Select License Manager, and then click Virtual Machine Management. 4.
Table 6-5 Windows Server 2003/2008 issues Issue Occurs when When accessing Systems Insight Manager The site is not accepted as a trusted site by for the first time on a Windows Server the security settings. 2003/2008 system, the following message appears: Solution Add the site to the trusted zone. Be aware that it lowers the security settings for all content on the Systems Insight Manager pages. Content from Web site listed below is being blocked by Internet Explorer security configuration.
Table 6-6 Internet Explorer issues Issue Occurs when Solution When accessing the Manual Log Purge from Internet Explorer, Internet Explorer script error pops up on Manual Log Purge home page interrupting to proceed further. This behavior occurs when a large number of servers are selected for licensing or monitoring.
Support and other resources Information to collect before contacting HP Be sure to have the following information available before you contact HP: • Software product name • Hardware product model number • Operating system type and version • Applicable error message • Third-party hardware or software • Technical support registration number (if applicable) How to contact HP Use the following methods to contact HP technical support: • In the United States, see the Customer Service / Contact HP Uni
HP authorized resellers For the name of the nearest HP authorized reseller, see the following sources: • In the United States, see the HP U.S. service locator website: http://www.hp.com/service_locator • In other locations, see the Contact HP worldwide website: http://welcome.hp.com/country/us/en/wwcontact.html Documentation feedback HP welcomes your feedback. To make comments and suggestions about product documentation, send a message to: docsfeedback@hp.
CAUTION IMPORTANT NOTE TIP An alert that calls attention to important information that, if not understood or followed, results in data loss, data corruption, or damage to hardware or software. An alert that calls attention to essential information. An alert that contains additional or supplementary information. An alert that provides helpful information.
A Measurement parameter matrix This appendix details the measurement parameters evaluated by the performance management component for the various components of a system configuration. A brief description of each parameter that appears, in both the Status and Inventory view, is provided. Server metrics The following information is provided for server metrics.
are busy, the metric reads 25%. Average Processor Busy % can be viewed as the fraction of the time spent doing useful work. Each processor is assigned an idle thread in the idle process consuming unproductive processor cycles not used by another thread. Some processors might be more heavily loaded than other processors. In this case, the total processor time percentage is the average of the loads on each processor.
Memory Inventory • • System Memory • Displays the physical memory installed in the server • Displays the amount of memory that can be addressed by the operating system • Displays any server-specific memory technology or configurations Memory Board—Describes the configuration of the memory boards and lists the number of DIMMs configured in each particular DIMM socket and any empty sockets Network connections The following information is provided for network connections.
Network Port Status • MBytes/Sec—The average number of megabytes transferred (transmitted or received) over the NIC port each second. • MBits TX/Sec—The average number of megabits transmitted from the selected NIC port each second. • MBits RX/Sec—The average number of megabits received by the selected NIC port each second. • TX Utilization %—The percentage of data that is transmitted from the selected NIC port. This value is calculated from the TX MBits/Sec and the operating speed of the NIC port.
Smart Array Controller Status • Transfers/Sec—The number of requests between the server and this IDE Smart Array controller each second • MBytes/Sec—The sum of all megabytes transferred (read and written) between the server and this Smart Array controller each second • Millisec/Transfer—The average time for each request to complete • Queue Length—The average number of concurrent requests between the server and this Smart Array controller, including transfers currently being serviced and transfers wai
Drive Array Status • Reads/Sec—The number of reads from each drive in the drive array each second • Writes/Sec—The number of writes to each drive in the drive array each second • Read MBytes/Sec—The average number of megabytes read from each drive in the drive array each second • Write MBytes/Sec—The average number of megabytes written to each drive in the drive array each second • Millisec/Read—The average time for each read to complete • Millisec/Write—The average time for each write to complet
Smart Array SCSI Drive Status • Disk Reads/Sec—The number of reads from the drive each second • Disk Writes/Sec—The number of writes to the drive each second • Disk Read MBytes/Sec—The number of megabytes read from the drive each second • Disk Write MBytes/Sec—The number of megabytes written to the drive each second • Disk Millisec/Read—The average time for each read to complete • Disk Millisec/Write—The average time for each write to complete • Disk Queue Length—The average number of concurren
SATA Drive Inventory • • Drive Information • Displays description of the drive, including size • Displays the hard drive model number • Displays the exact size of the drive as seen by the operating system Configuration Information • Provides a summary of the drive configuration • Displays the name of the Smart Array controller to which it is attached • Displays the location of the hard drive in its enclosure • Displays the array in which the drive is configured • Provides the SATA protocol
SCSI Drive Status • Disk Reads/Sec—The average number of reads from the selected SCSI drive each second • Disk Writes/Sec—The average number of writes to the selected SCSI drive each second • Disk Read MBytes/Sec—The average number of megabytes read from the selected SCSI drive each second • Disk Write MBytes/Sec—The average number of megabytes written to the selected SCSI drive each second • Disk Millisec/Read—The average time required to complete a read • Disk Millisec/Write—The average time re
• Wide Ultra3 SCSI- 160 MB/s with 16-bit transfers at 80 MHz • Ultra320 SCSI- 320 MB/s with 16-bit transfers at 160 MHz SCSI storage enclosure performance is determined by the SCSI Utilization %.
ATA disk The following information is provided for an ATA disk.
Network Storage Controller Status • Transfer/Sec—The average number of transfers (reads and writes) on this network storage controller each second • MBytes/Sec—The average number of megabytes transferred on this network storage controller each second • Millisec/Transfer—The average time to complete a transfer to and from the selected network storage controller • Queue Length—The average number of transfer requests (reads and writes) waiting to be serviced by the network storage controller • Port Ut
Network Share Inventory Logical Drive Configuration • Displays the total capacity of the drive • Displays the network storage enclosure in which the selected logical drive is located • Displays the RAID level for this logical drive External storage enclosure The following information is provided for an external storage enclosure.
Network Storage Enclosure Inventory • Enclosure Configuration—Displays the type or model, name, and serial number of the network storage enclosure. • Controllers—Displays the name and model of the enclosure and whether it is operating with redundant controllers. • • If a redundant controller is configured, then both standby and active controllers are listed. • If redundancy is not configured, only active controllers are listed. Detected Servers—Displays a list of servers sharing the enclosure.
NOTE: Insight Control performance management does not accurately report the negotiated PCI bus protocol when unknown PCI devices with slower transfer rates than the controller are configured on the same bus.
B Bottleneck scenarios This appendix identifies and provides solutions for some bottleneck scenarios encountered while using Insight Control performance management. Analyzing a network storage bottleneck condition The following sections detail the appropriate responses when a bottleneck condition exists on network storage. Selecting the server To display the performance management Online Analysis window for the monitored server, click the Major icon on Monitoring Administration page.
The Analysis Explanation indicates that the storage components are operating normally within recommended ranges. Displaying the logical drive under network storage The logical drives and their performance characteristics are displayed on the left tree and by clicking on the listed logical drive the details of the subsystems can be obtained. Displaying the array In the tree frame, the array information and important array counters are displayed.
Analyzing a server bottleneck condition The following sections discuss the appropriate actions to take when a bottleneck condition exists on a server. In this scenario, the server name is pmpserver. Selecting the server To display the performance management Online Analysis window for performance management server, click the Major icon. The screen displays the server tree in the left navigation pane and the Status tab in the right pane.
The Analysis Explanation details an above-average page-read rate (higher than 30% of the hard page fault), and less than configured memory threshold. The analysis recommends more physical memory to handle the load. Many recommendations suggest adding hardware. In this example, the situation might have occurred because a new batch job was assigned to run on the server at night.
The pattern of the graph shows rising, peaking, and declining, which might be caused by the completion of the new batch job. The batch job no longer causes a problem. However, the performance information is logged in the database for later review with the Offline Analysis tool. Analyzing a virtual machine host and guest bottleneck condition The following sections detail the appropriate actions to take when a bottleneck condition exists on virtual machine hosts and guests.
The Analysis Explanation indicates that the virtual machine host includes the performance of the virtual machine guests. Displaying the virtual machine guests page From the navigation tree, to access the virtual machine guest and to display the status page in the right panel, click the associated virtual machine guests tree. Related and important counters for the virtual machine guest appear in the Analysis Data table.
In this example, the Analysis Explanation indicates that at least one component has a critical performance issue. Displaying the virtual machine guest performance From the navigation tree, click on the respective VM guest subcomponents to get the performance parameters for the VM guest components being monitored by performance management. In this example, the Analysis Explanation indicates that components of VM vmgurest2 are operating normally.
This recommendation indicates that more than one logical processor exists in the system and at least one processor is not fully utilized. This recommendation demonstrates not only a solution without involving hardware, but also the specificity of performance management. Online Analysis recommendations for these types of performance issues are component-specific. Performing a static analysis The following sections provide examples of using static analysis.
Performing a static analysis 77
Glossary agent A program that regularly gathers information or performs some other service without the user's immediate presence. HP Systems Insight Manager agents provide in-depth hardware and software information and subsystem status to Systems Insight Manager and numerous third-party management applications. See also management agent. enclosure A physical container for a set of server blades.
Simple Network Management Protocol (SNMP) One management protocol supported by Systems Insight Manager. Traditional management protocol used extensively by networking systems and most servers. Management Information Base for Network Management of TCP/IP-based internets (MIB-II) is the standard information available consistently across all vendors.
Index A R analysis offline, 22 online, 21 report CSV file generator, 35 performance management, 29 server availability, 36 static analysis, 29 system summary, 31 C CSV file generator report, 35 D display controller, 25 graphical, 24 inventory, 27 port, 26 G generating CSV file generator report, 35 server availability report, 36 static analysis report, 30 system summary report, 31 I S server configuration, 24 set performance monitoring parameters, 16 setting performance threshold, 17 static analysis