HP Fabric Clustering System HP-UX Administrator's Guide HP-UX Integrity Server Networking HP Part Number: AB399-90009 Published: March 2008 Edition: HP-UX 11i v2 and 11i v3
© Copyright 2004-2008 Hewlett-Packard Development Company, L.P Legal Notices The information in this document is subject to change without notice. Hewlett-Packard makes no warranty of any kind with regard to this manual, including, but not limited to, the implied warranties of merchantability and fitness for a particular purpose.
Table of Contents About This Document .....................................................................................................15 Intended Audience................................................................................................................................15 New and Changed Documentation in This Edition.............................................................................15 Publishing History...............................................................................
Installing the AH304A Host Channel Adapter ..............................................................................36 Installing the 410533-B21 Host Channel Adapter...........................................................................37 Installing the AD313A Host Channel Adapter ..............................................................................37 Installing the AB286C Host Channel Adapter ...............................................................................
Switch Administration and Management............................................................................................73 CLI Overview..................................................................................................................................74 Using the CLI...................................................................................................................................74 Starting A CLI Session...................................................................
Deleting Log Files.................................................................................................................95 Deleting Image Files.............................................................................................................96 Managing Log Files....................................................................................................................97 Event Message Types..........................................................................................
Health Monitoring.........................................................................................................................124 About Logging and Tracing...........................................................................................................125 About HP Fabric Events...........................................................................................................125 About Tracing........................................................................................
show ib sm switch..........................................................................................................................152 show ib-agent channel-adapter.....................................................................................................154 show ib-agent summary................................................................................................................155 show ib-agent switch..............................................................................
delete..............................................................................................................................................194 dir...................................................................................................................................................195 disable............................................................................................................................................196 enable.................................................
List of Figures 2-1 2-2 2-3 2-4 2-5 2-6 2-7 2-8 2-9 4-1 4-2 4-3 4-4 4-5 4-6 4-7 4-8 4-9 4-10 4-11 4-12 4-13 4-14 5-1 5-2 5-3 5-4 6-1 6-2 7-1 7-2 7-3 7-4 7-5 C-1 C-2 C-3 C-4 C-5 AB286C Host Channel Adapter (Connector View).......................................................................25 AB286C Host Channel Adapter (Side View).................................................................................26 AB286A Host Channel Adapter (Connector View).................................................
List of Tables 1 4-1 4-2 6-1 6-2 6-3 6-4 6-5 6-6 6-7 6-8 6-9 7-1 7-2 7-3 7-4 7-5 7-6 7-7 B-1 B-2 B-3 B-4 B-5 B-6 B-7 B-8 B-9 B-10 B-11 B-12 B-13 B-14 B-15 B-16 B-17 B-18 B-19 B-20 B-21 B-22 B-23 B-24 B-25 B-26 B-27 B-28 B-29 B-30 B-31 B-32 B-33 Publishing History Details............................................................................................................15 Cable Installation Minimum Bend Radius....................................................................................
B-34 B-35 B-36 B-37 B-38 B-39 B-40 B-41 B-42 B-43 B-44 B-45 B-46 B-47 B-48 B-49 B-50 B-51 B-52 B-53 B-54 B-55 B-56 B-57 B-58 B-59 B-60 B-61 B-62 B-63 B-64 B-65 B-66 B-67 B-68 B-69 B-70 B-71 B-72 B-73 B-74 B-75 B-76 B-77 14 show logging Command Syntax Description.............................................................................170 show running-status Keyword Descriptions..............................................................................171 show trace Command Syntax Descriptions.......
About This Document The document printing date and part number indicate the document’s current edition. The printing date will change when a new edition is printed. Minor changes may be made at reprint without changing the printing date. The document part number will change when extensive changes are made. Document updates may be issued between editions to correct errors or document product changes.
What’s in This Document Chapter 1 Chapter 2 Chapter 3 Chapter 4 Chapter 5 Chapter 6 Appendix A Appendix B Appendix C Introduction to Technology provides a brief and high-level overview of the HP Fabric for InfiniBand™ clustering system, the HP Fabric Clustering System architecture. Hardware Overview provides detailed information on the adapter, switch and cable hardware components of the HP Fabric Clustering System.
Related Documents Additional information about HP Fabric Clustering System for InfiniBand can be found within docs.hp.com in the I/O Cards and Networking Software collection, under Fabric Clustering System for InfiniBand. HP Encourages Your Comments HP encourages your comments concerning this document. We are truly committed to providing documentation that meets your needs. Please send comments to: netinfo_feedback@cup.hp.
1 Introduction to Technology Understanding the Fabric Clustering System HP Fabric Clustering System The HP Fabric Clustering System provides a high-performance InfiniBand computing environment intended for use for applications sensitive to latency, bandwidth, and CPU-consumption. HP Fabric is an RDMA-interconnect.
InfiniBand Transport Services The InfiniBand transport-service types include: • • • • Reliable Connection Unreliable Connection Reliable Datagram Unreliable Datagram HP only supports Reliable Connected and Unreliable Datagram transports in its fabric product. HP Fabric Subnet Manager The HP Fabric Subnet Manager (SM) configures and maintains fabric operations. There can be multiple Subnet Managers, but only one master. HP supports the use of an SM on the switch.
User-Space RDMA Library The User-Space RDMA Library exposes the IT-API interface and provides user-space access to the RDMA hardware. Support for HP Fabric only is provided. HCA The HP Fabric Host Channel Adapter (HCA) for InfiniBand™ is the RDMA-capable network interface card. Kernel RDMA Subsystem The Kernel RDMA Subsystem provides access to an extended IT-API for kernel applications such as IPoIB. Support for HP Fabric only is provided.
2 Hardware Overview This chapter provides detailed information on the adapter, switch, and cable hardware components of the HP Fabric Clustering System. HP Fabric hardware consists of host-based interface adapter cards, interconnect cables, and optional switches. HP Fabric software consists of HP-UX drivers and user-space components, as well as firmware on HP Fabric adapters and switches. Currently, copper-based cabling and connectors are supported on the HP Fabric hardware.
applications in High Performance Computing (HPC) and enterprise data centers. Parallel or distributed applications running on multi-processor multi-core servers benefit from the reliable transport connections, and advanced multicast support, offered by ConnectX IB. End-to-end Quality of Service (QoS) enables partitioning and guaranteed service levels, while hardware based congestion control prevents hot spots from degrading the effective throughput.
NOTE: For further information on the 448262-B21 and 410533-B21 Mezzanine HCAs, see Mezzanine Card Installation Instructions for supported HP Proliant c-Class BladeSystem servers (part number 413773-021) and Optimizing mezzanine performance (part number 433373-001). For further information on the 410398-B21 HP BLc 4X DDR Mezzanine Switch, see HP 4X DDR IB Switch Module Installation Instructions (part number 433375-001).
Figure 2-2 AB286C Host Channel Adapter (Side View) 26 Hardware Overview
Figure 2-3 AB286A Host Channel Adapter (Connector View) Hardware Components 27
Figure 2-4 AB286A Host Channel Adapter (Side View) 28 Hardware Overview
Hardware Components Figure 2-5 2-5 AD313A AD313A Channel (Connector View) Figure HostHost Channel AdapterAdapter (Connector View) 23 Chapter 2 Hardware Components 29
Hardware Components Figure 2-62-6 AD313A AD313A Channel (Side View) Figure Host Host Channel AdapterAdapter (Side View) 24 30 Hardware Overview Chapter 2
Switch HP offers the following switch: • 376227-B21 HP 24-port 4X Fabric Copper Switch NOTE: HP is in the process of transitioning to a new switch, the Cisco SFS 7000P. For documentation and ordering information, see http://www.cisco.com/en/US/products/ps6421/index.html Whenever a Cisco OS is loaded, you are required to turn on the HP-specific default values. To enable the HP-specific defaults, the process is as follows (the commands below ONLY apply to Cisco O/S version 2.7.
— — • • 32 7 meter 4x Fabric Copper Cable 10 meter 4x Fabric Copper Cable The software consists of HP-UX drivers and user-space components as well as firmware on adapters and switches. The software supports Remote Direct Memory Access (RDMA). RDMA provides higher bandwidth, lower CPU overhead, and lower latency (the time a message takes to get from one point to another).
3 Installation Planning This document contains the following sections that give installation planning information for HP Fabric Clustering System: • “Preliminary Considerations” • “Features, Parameters and Supported Configurations for Database/Oracle and TCP/UDP/IP Applications” • “Applications” Preliminary Considerations Before physically assembling a fabric, do the following to address all of the appropriate issues: 1. 2. 3. 4. 5. 6. 7. 8. 9.
Application Availability The following are the three families of applications that can use the InfiniBand interface: • • • • Technical Computing Applications that use the HP Message Passing Interface (HP-MPI). HP MPI is a native implementation of version 2.0 of the Message-Passing Interface Standard. It has become the industry standard for distributed technical applications and is supported on most technical computing platforms.
4 Installing HP Fabric Clustering System The installation procedure for the HP Fabric Clustering System installs the Switch, Host Channel Adapter (HCA), cables, cable guide, and gets the system up and running. Managing the Switch The Switch can be used without being managed. You can manage it using its Command Line Interface (CLI) - a text-based interface accessible through a direct serial connection, Telnet over IP, or SSH over IP.
• • • Confirm that HP Fabric Clustering System software suite software media is available. It is included on CD or available on the Web through http://www.software.hp.com. Confirm that HP-UX super-user privileges are available; they are necessary to complete the installation. Confirm that the /usr/bin, /usr/sbin, /sbin, and /opt/rdma/bin directories are in your PATH by logging in as root and using the echo $PATH command. To run InfiniBand applications the MLOCK privilege for the user needs to be set.
• Open the system to gain access to the PCI backplane. • Insert the card into the highest performance PCIe slot available. 2. Install the card 2.StepInstall the card • Slide the adapter edge-connector intothe thePCIe PCIeslot slot until it fully is fully seated. • Slide the adapter edge-connector into until it is seated. • Secure the card and reassemble the system. • Secure the card and reassemble the system.
• Open the system to gain access to the PCI backplane. • Insert the card into the highest performance PCIe slot available. 2. Install the card 2.StepInstall the card • Slide the adapter edge-connector intothe thePCIe PCIeslot slot until it fully is fully seated. • Slide the adapter edge-connector into until it is seated. • Secure the card and reassemble the system. • Secure the card and reassemble the system.
2. Install the card • Slide the adapter edge-connector into the PCI-X slot until it is fully seated. • Secure the card and reassemble the system. Figure 4-3 Inserting the AB286C Host Channel Adapter Back Front HCA ports PCI-X slot Your adapter may vary from this representation On-Line Addition and Replacement Operations (OL*) On-Line Addition and Replacement (OL*) of HP Fabric adapters is supported on HP Fabric Clustering System version B.11.23.
Install HP Fabric Clustering System Software This section describes the steps necessary to install HP Fabric Clustering System software. The same software version must be installed on each instance of the HP-UX operating system in the fabric. 1. 2. Log on to the system as root. Insert the software media into the appropriate drive. If the software is being loaded from a CD-ROM, go to step 3; otherwise, go to step 4. The software can also be located at http://www.software.hp.com.
NOTE: The IB4X-00 product bundle has three components: 1. IB subsystem (IB RDMA) 2. IPoIB 3. IB device driver (ib_t) The ib_t driver in B.11.31.06 versions of the IB4X-00 product bundle is dynamically loadable via the Dynamically Loadable Kernel Module (DLKM); however, the bundle as a whole requires a reboot on install, due to the presence of other static drivers in the bundle.
3. 4. Place the switch on a secure, clean surface. Open the plastic bag containing mounting parts.and locate: • (12) T-10 Torx screws for attaching the rails to the switch. • (8) T-25 Torx screws and clips for attaching the rails to the rack. NOTE: It is highly recommended that two people install the switch, but it can be installed with one, however it may be difficult to support and align the switch correctly in the rack rails with only one person. Installing the Switch 1.
Figure 4-6 Attach Rail to Switch 3. Repeat steps Steps 1 and 2 on the other side of the switch. The two sliding rails should still be unattached. 4. Loosely attach the switch with one screw through the front of each rail. CAUTION: Temporarily support the switch until the sliding rails are attached. Figure 4-7 Loosely Attach Rail to Rack CAUTION: 5. Do not let the switch hang unsupported from only the fixed rail flanges.
6. Attach the rails to the rack, both sides as shown in Figure 4-9 “ Attach Sliding Rail to Rack”. CAUTION: Keep switch supported until rail is attached to the rack. Figure 4-9 Attach Sliding Rail to Rack 7. Securely attach all rails to the rack. Remove Shipping Sleeve Underneath each power supply is a shipping sleeve. Take the bezel off and remove the entire sleeve by gently pulling on the tab. Replace the bezel.
Attach Cable Guides & Cables The HP Fabric cables are high performance impedance-controlled cables with protective shielding, and due to the thickness and stiffness of the cables, HP recommends that Cable Guides be installed prior to attaching cables to minimize stress on the connectors for both switch and HCA cabling. Figure 4-12 Cable Guide with Cables Copper cables for InfiniBand should be securely attached to the rack enclosure.
Figure 4-13 Cable Bend Radius R R Bend radius at the connector 4.6" (11.68 cm) or 5.2" (13.21 cm) depending on cable length (diameter) Bend radius away from a connector 2.3” (5.84 cm) or 2.7” (6.86 cm) depending on cable length (diameter) Table 4-1 Cable Installation Minimum Bend Radius HP Cable Product Cable Description Minimum Bend Radius at Connector Minimum Bend Radius in the middle of the cable, with both ends free 1m Cable 26AWG Cable OD: 0.345" (8.76 mm) 4.6" (11.68 cm) 2.3" (5.
Figure 4-14 Correct & Incorrect Cable Installation Cable Switch or Adapter Cable Switch or Adapter Cable Switch or Adapter Attach to other HP Fabric devices: Attach the free end of the cable to a compatible fabric switch or adapter. Push the connector in until you hear it click.
• Management ports: — Serial console port: RJ-45 connector — Ethernet Management port: RJ-45 jack for unshielded twisted-pair connections • Two 4X Fabric Copper connector for InfiniBand ports Setting up the Switch Configuring Basic Connectivity To configure the system, you must first assign an IP address to a management port. This is accomplished via the Command Line Interface (CLI). The CLI is a text-based interface that is initially accessed using a serial console.
10. You must save the configuration persistently by using the copy command. HP-IB(config mgmt-ethernet)# exit HP-IB# copy running-config startup-config Internet Protocol over InfiniBand (IPoIB) In order to use the Internet Protocol over InfiniBand™ (IPoIB) the same patches need to be installed on each server used for IPoIB in the HP Fabric Clustering System. For current patch requirement, see the latest HP Fabric Clustering System for InfiniBand Support Matrix on http://www.docs.hp.com.
5 Configuration This chapter presents some typical configurations using either the AB286A/C or AD313A HCA. NOTE: For 410533-B21 configuration information, see the “Component identification” section in the server blade user guide, or in the maintenance and server guide, at the HP website: http://h18004.www1.hp.com/products/blades/components/c-class-bladeservers.htmlhttp:// h18004.www1.hp.com/products/blades/components/c-class-bladeservers.
Minimum Number of Switches Trunking Between Switches (multiple connections) Maximum Cable Lengths Minimum Host Memory Required per HCA nodes. If additional ports are needed, HP recommends using a high-port count switch. You will need to have at least one 24-port copper switch in the database cluster. Trunking between switches can be used to increase bandwidth and cluster throughput. Trunking is also a way to eliminate a possible single point of failure.
Figure 5-1 Single 24-port 376227-B21 Switch 376227-B21 Switch 24 Port HP Fabric Switch Configuration A single 24-port 376227-B21 switch can be used to connect up to 24 HCAs. The maximum number of nodes that can be connected ranges from 3 (8 HCAs per node) to 24 (1 HCA per node). The figure above illustrates a configuration where all the ports of the switch are used.
The following example yields a 50% non-blocking configuration for 128 nodes using (11) 24-port switches. Figure 5-3 128 Node 50% non-Blocking Configuration (3) Spline-level Switches Connect to 16 Nodes per Switch (8) Leaf-level Switches Connect to 16 Nodes per Switch Total (11) 24-Port Switches, 640 Gbps full duplicate fabric bandwidth Configuration results in 128 Nodes The following example yields a fully non-blocking configuration for 132 nodes using (17) 24-port switches.
6 Administration and Management The HP-UX Host and 4x Fabric Copper Switch each have a unique set of tools for administration and management of their respective components within the HP Fabric Clustering System.
◦ ◦ ◦ ◦ ◦ ◦ ◦ ◦ ◦ ◦ ◦ ◦ — “Viewing Configuration Files” “Viewing Log Files” “Saving Configuration Files” “Saving for System Reboot ” “Saving the Backup Configuration” “Specifying the Configuration to Use at System Reboot ” “Saving and Copying Files” “Downloading Files to the System ” “Deleting Configuration, Image, and Log Files” “Managing Log Files” “Understanding the Log Format” “Uploading Log Files” “Administering the System” ◦ “Switching User Identity” ◦ “Notifying Users” ◦ “Creating User Accounts” ◦
Summary of Itutil Command Options Optional parameters are available so you can filter itutil output. The following table describes the different command options: Table 6-1 Itutil Command Options itutil Description Displays basic details about all interfaces on a given host. To filter results, specify an interface name with the -i option or the transport type with the -t option, or both. -c Displays Reliable Connection details for specified interface adapters.
Output Example: itutil -h Usage: itutil [-srcT] [-i "interface_name"][-t "transport_type"] itutil -d trace/notrace "interface_name" itutil [-n count] -l "network_addr" "interface_name" "spigot_id" -h Display this message -R Reset Interface Adapter -s Display detailed Interface Adapter Statistics -c Display detailed IT Reliable Connection Information -T Display Topology -d Download firmware or dump the firmware trace buffer -l Send linkloop equivalent packet to Network Address specified -n Number of linkloop
Num Network Addresses : 1 Primary Network Address : fe80::2:c902:22:7f2 ======================================================================== General Information: ======================================================================== Interface Adapter Name : ib1 IA Type : IB (Low Profile) H/W Path : 0/4/1/0/0/0 Transport Type : IT_IB_TRANSPORT IT API Version Number : 1.0 IA Software Version Number : 1.0 IA Firmware Version Number : 3.5.
======================================================================== Number of Interface Adapters on this node: 1 ======================================================================== Interface Adapter Name : ib0 IA Type : IB (Low Profile) H/W Path : 0/4/1/0/0/0 Transport Type : IT_IB_TRANSPORT IT API Version Number : 1.0 IA Software Version Number : 1.0 IA Firmware Version Number : 3.1.
Displaying Interfaces with Specified Transport Type Description: This parameter only displays interfaces of a specific transport type. The only supported transport type with this version of the product is IB.
Number of Spigots(Ports) on IA : 2 Spigot specific Information Spigot identifer Spigot online Num Network Addresses Primary Network Address : : : : 1 YES 1 fe80::ca07:2001 Spigot identifer : 2 Spigot online : NO Num Network Addresses : ======================================================================== Adapter Statistics : ======================================================================== Transport Statistics -----------------------------------------------------------------------R
Receive Packets : 0 ======================================================================== Resetting Statistics Description: This parameter resets statistics for all specified adapters. If an adapter is not specified using the -i parameter, the -r command resets statistics for every HP Fabric interface configured on the host. NOTE: You must be logged in as super user to execute this command.
======================================================================== Connection State : TIMEWAIT Adapter Name : ib0 Process ID : Process Exited Connection EVD : <0x1, 0x1> Connection Type : Active Service ID : 0x10000ce10000c017 Local Communication ID : 0x1 Remote Communication ID : 0x2 Local QPN : 0x40d Remote QPN : 0x40e Local Start PSN : 0x21 Remote Start PSN : 0x21 ======================================================================== NOTE: This is a partial view of the itutil -ccommand
Viewing the Itutil Manpage If you want to view the itutil man page, you must first add /opt/rdma/share/man to your MANPATH environment variable. To view the man page for itutil, type this: # man itutil Using NetTL The Network Tracing and Logging facility (NetTL) is a troubleshooting tool used to gather information on network activity by logging events and tracing inbound and outbound packets.
NS_LS_ICMP FILTER NAME NS_LS_IGMP FORMATTER STREAMS PCI_FDDI GELAN BTLAN INTL100 NS_LS_IPV6 NS_LS_ICMPV6 DLPI NS_LS_LOOPBACK6 IGELAN IETHER SYSADMIN IB IPOIB ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR ERROR DISASTER DISASTER DISASTER DISASTER DISASTER DISASTER DISASTER DISASTER DISASTER DISASTER DISASTER DISASTER DISASTER DISASTER DISASTER DISASTER DISASTER DISASTER DISASTER Tracing Information: Trace Filename: Max Trace file size(Kbytes):
<4002> lan9001 has a new link attached to it with port number 2, P_key value 0xffff and HCA ib0 IB Tracing Enabling Packet Tracing for IB Description: This command enables packet tracing of specified packet type using the NetTL tracing facility. Syntax: nettl -tn all -e [subsystem] -f [trace_name] Syntax Example: nettl -tn all -e IB -f ib.TRC000 Disabling Packet Tracing for IB traffic.
Checking the IPoIB Interface Status To check the current status of the IPoIB interface. Syntax and example: ifconfig lan9000 Output Example: lan9000: flags=842 inet 192.32.32.255 netmask ffffff00 broadcast 192.32.32.255 Enable the IPoIB Interface To enable the IPoIB interface. Syntax: ifconfig [address] [netmask] up Example: ifconfig lan9000 192.32.32.255 up There is no direct output from this command.
Syntax: lanadmin -x all_if_info [any_ipoib_ppa] Syntax Example: lanadmin -x all_if_info 9000 Output Example: PPA 9000 9001 PKey 0xffff 0xffff Port 1 2 HCA ib0 ib0 Hardware path 0/4/1/0/0/0 0/4/1/0/0/0 Displaying IPoIB Interface MAC Address of a given ipoib_ppa. Description: This command displays the MAC address Syntax: lanadmin -a [ipoib_ppa] Syntax Example: lanadmin -a 9000 Output Example: Station Address = 0x0000040cfe8000000000000000000000ca025001 Displaying IPoIB Interface Speed ipoib_ppa.
Output Example: LAN INTERFACE EXTENDED MIB STATISTICS DISPLAY Wed, May 19,2004 12:33:42 Interface Name PPA Number Description Interface Type(value) MTU Size Speed Station Address Administration Status Operation Status Last Change Inbound Octets Inbound Unicast Packets Inbound Multicast Packets Inbound Broadcast Packets Inbound Discards Inbound Errors Inbound Unknown Protocols Outbound Octets Outbound Unicast Packets Outbound Multicast Packets Outbound Broadcast Packets Outbound Discards Outbound Errors Coun
lanadmin Options Not Supported The following lanadmin options are examples for options not supported by IPoIB interfaces and the errors displayed.
NOTE: Please refer to the Serviceguard Configuration Guide for complete details of the supported SGeRAC configurations. NOTE: Oracle RAC uses IPoIB for cache fusion traffic. NOTE: IPV6 failover is not supported with ServiceGuard. IPoIB can run over IPV6, but the InfiniBand switch does not support IPV6 address failover.
Configuring and running Serviceguard or Serviceguard Extension for RAC with IPoIB interfaces The following procedure assumes that a specific set of IPoIB interfaces (i.e., HCA ports) has been preconfigured for applications. 1. 2. 3. 4. 5. Identify all IPoIB ports that are configured for the application on each node. Configure IP addresses for these interfaces using /etc/rc.config.d/netconf file. Issue cmquerycl -v [-n ] [-q ] -C on the cmclconfig.
• • “Configuration, Image, and Log Files” “Administering the System” CLI Overview The HP Fabric Switch can be used without being managed. If necessary, you can manage the switch using its Command Line Interface (CLI) - a text-based interface accessible through a direct serial connection, Telnet over IP, or SSH over IP. Refer to “Manage the System” on page 63. Using the CLI This section provides a general overview of using the CLI.
Table 6-3 Administrator Roles Role Description ib-ro InfiniBand read-only access. ib-rw InfiniBand read-write access. unrestricted-rw Read-write access to all network configuration commands. For information about configuring user accounts and roles, refer to “Creating User Accounts” (page 100). NOTE: The CLI is case-sensitive. Be sure to enter all text in the case shown. At the CLI prompt, enter the appropriate user name and password at the CLI prompt to log in as the admin user.
You enter the global-configuration mode from the privileged-execute mode. The global-configuration mode is used to configure everything except system interface cards and their ports. The global-configuration mode configures system-level attributes, such as SNMP, SNMP agents, and the networks. To enter the global-execute mode, enter the config keyword while in the privileged-execute mode.
cli ospf rip snmp-agent stp vlan vrrp ib fc chas-mgr port-mgr tcp notifier ip-mgr fib-mgr srp-mgr srp-agent watchd-mgr watchd-agent port-agent ip-agent fib-agent card-agent ib-sm diag-mgr diag-agent NOTE: = = = = = = = = = = = = = = = = = = = = = = = = = = 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 19 20 21 22 23 25 26 27 28 Command completion only works for commands; it is not effective for keywords.
NOTE: Information displayed depends upon if you log in as a guest, administrative, or unrestricted user. All choices and information are displayed to the unrestricted user, whereas less information is displayed to the administrative user because the administrative user is not allowed to perform certain tasks, like configuring the Ethernet Management or management-IB ports. The guest user is shown the least information because the guest user is only allowed to view a small portion of the configuration.
Table 6-4 Key Stroke Shortcuts key description a Move to beginning of line. b Move cursor left one character. d Delete current character. e Move to end of line. f Move cursor right one character. k Delete from cursor to the end of the line. l Refresh input line. n Get next command from history. p Get previous command from history. q Return to use-execute mode.
Figure 6-1 Slot/Port Notation for the HP Fabric Switch Power Plug (24) Switch Cluster Connections Power Plug Management Port Console Port Many CLI commands allow you to enter • • • • a card (or slot)#/port# pair a range of pairs a list of pairs or the keyword, “ all”. Card/Port pairs A card#/port# (sometimes referred to as the slot#/port#) pair is a slash-separated (/) pair of numbers. The first number indicates the interface card and the second number is a port on that interface.
Advanced Switch Setup • • • • • “Configuring the System Hostname” “Testing Network Connectivity ” “Setting User Levels and Passwords” “Logging Onto the System ” “Managing the Switch” Configuring the System Hostname The system allows you to assign a hostname to the system for management purposes. To assign a hostname to the management port: 1. 2. Start a CLI session. Enter the privileged-user mode. HP-IB> enable HP-IB# 3. Enter the global-configuration mode. HP-IB# configure HP-IB(config)# 4.
Setting User Levels and Passwords HP Fabric Switch devices support multiple users with granular levels of access control. An administrator is assigned a user name and password, which is also associated with a unique SNMP community string. User names and passwords are used for CLI access. For initial configuration, log in as the unrestricted user. The default unrestricted username for the CLI is super and the default password is super.
Management Methods Use the following methods to manage the switch system: • Run the Command Line Interface (CLI) from a terminal or workstation using one of two options: — Direct serial-console connection or Telnet or SSH session over a TCP/IP network — Run an SNMP Network Manager over a TCP/IP network. • Manage the system out-of-band through the serial console or Ethernet management port, or in-band through the HP Fabric ports.
Configuration, Image, and Log Files This section provides the required information to manage the Configuration, Image, and Log files on the system.
The system only has enough flash memory to store: • • • one image file (active) one system image (inactive) one recovery image Occasionally, the user will have to manually delete either an image file or a system image from the system to make room for new software. Detailed information on the delete command can be found at “delete” (page 194). • Active Image The term “Active Image” refers to the current System Image. An installed, or “active” image has gone through the entire upgrade process.
There are two types of hardware connections that can be used to download a new image to the system. • Out-of-Band connection Connect the server to the switch ethernet management port, if a connection does not already exist. • In-Band connection Use a 4x copper cable to connect from an HP Fabric-enabled host to a fabric port on the HP Fabric Switch system. 2. Check the Image Version This section describes how to use the Command Line Interface (CLI) to copy the software that runs the system.
last-image-source primary-image-source image cpu-descr fpga-firmware-rev ib-firmware-rev : : : : : : Release-1.1.3hp/build025 Release-1.1.3hp/build025 Release-1.1.3hp/build025 PPC 440GP Rev. C - Rev 4.129 (pvr 4012 0481) 6 5.1.0 HP-IB# 5. (Optional) The system can only hold one installed image, and one uninstalled image. If there are more than two images on your system, delete any extraneous images before proceeding with an installation. 3.
1. (optional) If you are using In-Band Management, configure the IP management interface (if you have not already done so). HP-IB> enable HP-IB# config HP-IB(config)# interface mgmt-ether HP-IB(config-if-mgmt-ethernet)#ip address 10.3.102.8. 255.255.0.0 HP-IB(config-if-mgmt-ethernet)#gateway 10.3.0.1 HP-IB(config-if-mgmt-ethernet)#no shutdown HP-IB(config-if-mgmt-ethernet)# exit HP-IB (config) # exit 2. In the privileged-execute mode, enter the copy command with the remote system and path information.
• In the privileged-execute mode, enter install image:file. image specifies the file resides in the image file-system. file is the name of the image file to install. Image files must reside in the image file-system and the file name must have the .img extension. Syntax: HP-IB#install image:image-file-name HP-IB# install image:HP-AB291A-Release-1.1.3hp-build020.
6. Reboot the System 1. Once the system is configured to use the new image, reboot the system. Once the reboot process is initiated, the system checks for unsaved changes to the configuration. If the configuration has been modified but not saved, you will be prompted to save the configuration. If you enter yes, the changes made during the current CLI session are saved to startup-config and used when the system comes back up.
File Management The management of these files is performed automatically. Each file type is stored separately, in separate file systems. All files share the 128 MB of flash memory. The names of the file systems are: • • • syslog files image files config files Listing Configuration, Image, and Log Files To list the configuration files currently stored on the system: Enter the dir command with the config keyword.
enter the show command with the logging and end keywords. HP-IB# show logging end Feb 24 07:35:45 hp-lt ib_sm.x[668]: [INFO]: Successfully add pgid fe8000000000000000000000ca001002 to mgid ff12401bffff00000000000000000001, mlid 0xc002 Feb 24 07:35:46 hp-lt ib_sm.x[665]: [INFO]: Configuration caused by multicast membership change The show logging command with the end argument locks the terminal window to display log data much like the UNIX tail -f command.
boot-config primary-image-source image-directory-name Example: HP-IB# configure HP-IB(config)# boot-config primary-image-source Release-1.1.3hp/build023 HP-IB(config)# exit 4. Show the new system image. HP-IB# show boot-config ========================================================================= System Boot Configuration ========================================================================= slot-id : 1 sw-version : Release-1.1.3hp/build023 last-image-source : Release-1.1.
Table 6-5 Copy Command Descriptions (continued) argument description fs HP Fabric Switch file-system. This is an internal directory that is identified by name only. The file-systems are config, images, and syslog. The specified file-system must be appropriate for the type of file being copied. For example, if an attempt is made to copy a configuration file from the syslog file-system, an error is returned because the name of the file is not appropriate for the file-system.
Deleting Configuration Files To remove a configuration file: 1. 2. Log in as the unrestricted user. Enter the privileged-user mode. HP-IB> enable HP-IB# 3. Determine the configuration files in memory.
HP-IB# dir syslog ======================================================== Existing Syslog-files on System ======================================================== slot date-created size file-name -------------------------------------------------------1 Wed Nov 26 11:19:25 2003 849964 ts_log 1 Tue Oct 21 16:00:03 2003 50373 ts_log.1.gz 1 Tue Sep 23 13:00:04 2003 54514 ts_log.2.gz 1 Fri Sep 12 17:00:03 2003 45265 ts_log.3.gz 4. Enter the delete command to remove a log file.
HP-IB# delete image:HP-AB291A-Release-1.1.3hp-build019.img <- image file Delete file HP-AB291A-Release-1.1.3hp-build019.img? [yes/no] y ****** HP-IB# 5. Verify that you had successfully removed the system-image or image file.
1. Enter enable command to change to the privileged-execute mode. HP-IB> enable HP-IB# 2. Enter the dir command with the appropriate keyword to display the existing files of the desired type. Keywords are config, image, syslog. In this case, include the syslog keyword.
To change your user identity: 1. 2. Enter the user-execute or privileged-execute mode. Enter the login command with the name of a system user. HP-IB# login admin 3. Enter the user password. After you enter the password, you are logged in as the specified user in the user-execute mode. Password: xxxxx HP-IB> Notifying Users User notification commands send text messages to the terminal screens of all CLI users or to individual users.
Creating User Accounts About User Accounts A user account is used to control who gains access to the system. Access can be achieved through the CLI (console, telnet, SSH) and SNMP. CLI access is authorized through a password validation. SNMP access is authorized through a community-string validation. User accounts can be added, deleted, and modified as needed. Up to 15 user accounts are supported. Only user(s) that have the unrestricted ReadWrite permission level can add, delete, and modify user accounts.
4. Enter the username command and the password keyword to change the user account and user password. Use the default user name and password if they have not already been changed (refer to (page 100)). The user name and password are alphanumeric strings of up to 34 characters each. 5. 6. 7. Repeat step 4 to change additional usernames and passwords. Exit the global-configuration mode. Use the show user command to verify changes.
HP-IB> enable HP-IB# 3. Enter the global-configuration mode. HP-IB# configure HP-IB(config)# 4. Create the user account and user password. The user name and password are alphanumeric strings up to 34 characters each. HP-IB(config)# username ib-admin password ib-passwd where ib-admin is the name assigned to this user account, password is a mandatory keyword, and ib-passwd is the password for this user account. 5. Assign an SNMP community string to the new user account.
3. Enter the global-configuration mode. HP-IB# configure HP-IB(config)# 4. Enter the username command with the name of the user, and the no keyword. For example: HP-IB(config)# username ib-admin no User Account Configuration Commands Use the following commands and keywords to administer User Accounts: Table 6-7 User Account Administrative Commands Command Task username user password passwd Creates a new user account. username user no Deletes a user account.
4. Enter the username command with the name of the user, the community-string keyword, and the new community string to assign this user. HP-IB(config)# username ib-admin community-string ib-commStr In the example above, ib-admin is the name of the user, community-string is a mandatory keyword. ib-commStr is the SNMP community string the user will have to use to execute other SNMP functions.
HP-IB> enable HP-IB# 3. Enter the global-configuration mode. HP-IB# configure HP-IB(config)# 4. Enter the username command with the name of the user, the privilege keyword, and the privileges to assign this user. For example: HP-IB(config)# username ib-admin privilege ib-rw ip-ethernet-ro fc-rw In the example above, ib-admin is the name of the user account, privilege is a mandatory keyword, and ib-rw, ip-ethernet-ro, and fc-rw are access privileges.
Setting Time Through the CLI Note: If you have an NTP server configured, it is recommended that you use the process described in: “Setting the NTP Servers to Maintain the System Clock” (page 106). To set the system clock in the CLI: 1. 2. Login to the CLI as the super user. Enter enable to enter the privileged-execute mode. HP-IB> enable HP-IB# 3. Enter the clock command, followed by the set keyword and the time and date in the format hh : mm : ss dd mm yy.
NOTE: Do not remove the power cord to reboot the system. Reboot the System Through the CLI • Enter the CLI reload command in privilege EXEC mode. For example HP-IB> enable HP-IB# reload System configuration has been modified. Save? [yes(default)/no/*.cfg] yes Proceed with reload? [confirm] HP-IB# Connection to host lost. NOTE: If you have dual-controllers in your chassis, you can use the reload no-failover option.
7 Monitoring and Troubleshooting This chapter discusses monitoring and troubleshooting your HP Fabric Clustering System. The HP-UX Host and HP Fabric Switch each have a unique set of tools for monitoring and troubleshooting their respective components within the HP Fabric Clustering System.
Figure 7-1 Switch LED Locations Rear System Status LEDs Ethernet Management Port Status LEDs Console Port HP Fabric Switch Cluster Connection LEDs Power Plug powers Power Supply 1 Power Plug powers Power Supply 2 Front System Status LED Power Supply 1 LED Power Supply 2 LED LED Color, Behavior, and Meaning The following sections explain the possible colors and the corresponding meaning of the various LEDs on the HP Fabric HCA and switches.
System status LED is on the front left side of the switch. On the back of the switch on the left side is a System Status LED. The system status LEDs indicates overall system health. It indicates the overall system status for power, fans, temperature, and electronics. Check these LEDs first in the event of a suspected system fault. Table 7-2 Front System Status LED Indicator Color Function Green / Yellow Overall system status indicator: Power, Fans, Temp, Electronics.
Power Supply Troubleshooting Both power supply modules connect internally to the same power bus. If one power supply module fails, the other immediately takes over. A power supply module may be hot-swapped without any disruption in power. Check the status indicators of both power supply modules. Power Supply 1 is on the left of the switch, Power Supply 2 is on the right, and they are both labeled.
The following command example can be used on the switch to determine individual fan status from the CLI.
The bottom LED indicates a physical link has occurred. A physical link requires that the drivers on the attached HP Fabric host have been installed and are running. If the HCA is not operational and needs to be replaced, see “Install HP Fabric Clustering System Adapters” (page 36).
Table 7-6 HCA Connection LED Colors and Meanings (continued) LED Color Meaning Physical Link Status Flashing green Data is flowing Note that data does not start to flow until HP Fabric initialization has from HCA to occurred. switch port or remote HCA. (bottom) Notes Solid green Connection from HCA to switch port or remote HCA is operational. None HCA is not operational. • The drivers on the attached HP Fabric host are not installed or not running. • The HP-UX host machine is not operational.
Next Steps If you’ve determined that a hardware component is not at fault and you are still having problems, it is most likely a software configuration or communication issue. Proceed to the appropriate advanced troubleshooting section for either the HP-UX Host or the HP Fabric Switch. If you’ve configured your HP Fabric system to use IPoIB, refer to “Monitoring and Troubleshooting IPoIB” (page 121).
NOTE: The example below shows two ports, or spigots. Spigot 1 is a properly connected port because the “Spigot Online” is set to “YES” and the “Primary Network Address’ is displayed. Spigot 2 is not properly connected because the “Spigot Online” is set to “NO” and the “Primary Network Address’ is not displayed.
======================================================================== Adapter Statistics : ======================================================================== Transport Statistics -----------------------------------------------------------------------Responder - number of local length errors Requester - number of local length errors Responder - number of local QP operation errors Requester - number of local QP operation errors Responder - number of local protection errors Requester - number of local
NOTE: For more information on the Communication Management States (Connection States), refer to Chapter 12 in the IBA Volume I specification http://www.infinibandta.org/specs.
Connection Type Service ID Local Communication ID Remote Communication ID Local QPN Remote QPN Local Start PSN Remote Start PSN QP State Remote LID Remote Network Address Next PSN Last Acked PSN Expected PSN Last Sent MSN Expected MSN Send CQN Recv CQN : : : : : : : : : : : : : : : : : : Active 0x3e9 0x5 0x5 0x411 0x411 0x21 0x21 READY_TO_SEND 0xb 0x 0x93171 0x9316d 0x31090 0x31071 0x3106f 0x90 = <0x8, 0x8> 0x91 = <0x1, 0x1> =======================================
Device ID : -1 Path ID : 0 Connection ID : 0 Log Instance : 65535 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ File ib_common_api.c: Line 714: -- ib_tvr attach: existing HCAs are more than 8 There is an attempt to add more devices than supported Do not add any more devices to the system 9. If none of the previous steps helped to resolve your problem, contact your HP Support Representative.
Timestamp : Tue Mar 23 PST 2004 12:06:32.966548 Process ID : 2343 Subsystem : IB_T User ID ( UID ) : 0 Log Class : ERROR Device ID : -1 Path ID : 0 Connection ID : 0 Log Instance : 65535 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ File ib_common_api.c: Line 715: QP corruption detected..
Syntax Example: netfmt -N ipoib.TRC000 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^IPoIB Driver^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^@#% Timestamp : Tue Feb 24 MST 2004 16:03:55.
• Description: IPoIB PPA instance numbers start at 9000, but the current NetTL tool does not support interfaces whose PPA instance numbers are greater than 255. When running a trace on the system, the correct PPA number is provided, but when formatting trace packets for a specific PPA (known as filtering), you need to make an adjustment in the request to obtain the proper information.
the port. If there is no traffic going across what should otherwise be a busy port, refer to status LEDs next to the port or check the physical connections. Traffic can be analyzed across individual ports or aggregated total across interface cards. About Logging and Tracing In general, two types of messages are generated: Events and Traces. About HP Fabric Events Event messages are generated whenever a significant event occurs in the system, and cannot be turned-off or configured by the user.
Table 7-7 Trace Level Descriptions (continued) Trace Level Description TERSE This level is used to generate the basic flow of MAD packet as it goes through the Subnet Manager state machine. Verbose description will be made to the success or failure of the MAD packet.
Setting Trace Levels Enabling Tracing Tracing is disabled by default. To set a trace level for the purpose of debugging or troubleshooting, perform the following steps: 1. Enter global-configuration mode. HB-IB> enable HB-IB configure HB-IB(config) 2. View the trace help output, as the number of applications and modules may have changed.
mtu auto-negotiate-supported auto-negotiate admin-status oper-status admin-speed oper-speed link-trap : : : : : : : : 2048 yes enabled up up 10gbps 10gbps enabled Replacing Individual Components This chapter describes how to remove and replace the Field Replaceable Units (FRUs) in the system. Replacing a Power Supply Module HP Fabric Switch power supplies are hot-swappable. You have two power supplies installed, you can remove one of them without removing power from the chassis.
A Specifications Physical and Environmental Specifications HCA Physical Specifications (AB286C) Specification Measurement Height .54 inches (1.38 cm) Width 3.87 inches (9.83 cm) Length 6.57 inches (16.7 cm) Weight 5.92 ounces (167.
B Switch Command Line Interface This chapter details some of the commands available to manage the switch and are grouped into: • “Using the Documentation” • “Show Commands” • “IP Commands” • “InfiniBand Commands” • “Administrative Commands” Using the Documentation The command descriptions in the following chapters are structured in a way we hope provides quick access to the information you seek. Each command description is broken into subsections so you can go directly to the desired information.
Examples The examples section shows actual command entry and the results of executing it. For example: HP-IB# show interface gateway 5 =============================Gateway Information============================ gateway : 5 name : 5/0 type : fc-gateway desc : 5/0 (320) last-change : none mtu : 0 admin-status : up oper-status : up HP-IB# Defaults The Defaults subsection lists command defaults. Related Commands Provides hypertext links to other related commands.
Table B-1 Show Commands (continued) Command Description show location Display the system location. See “show location” (page 169). show logging Displays the active system log file. See “show logging>” (page 169). show ntp Displays the Network Time Protocol (NTP) servers used to maintain and synchronize the system clock. See “show ntp” (page 170). show power-supply Show power-supply status. See “show power-supply” (page 171). show running-status Show the running status of the system.
Examples: To display the InfiniBand ARP table: HP-IB# show arp ib =========================ARP Information==================================== ============================================================================ port physical-address net-address type ---------------------------------------------------------------------------4/0 fe:80:00:00:00:00:00:00:00:02:c9:00:00:13:68:c3:00:00:02 192.168.2.2 static 4/0 fe:80:00:00:00:00:00:00:00:02:c9:00:00:16:af:d3:00:00:02 192.168.2.
================================================================================ Backplane Seeprom ================================================================================ base-mac-addr chassis-id chassis-guid -------------------------------------------------------------------------------0:d:9d:fe:1a:2e 0xd9dfffffe1a2e 0xd9dfffffe1a2e ================================================================================ Backplane Seeprom ===================================================================
primary-image-source primary-config-source secondary-image-source secondary-config-source : HP-IB-1.1.3/build255 : : : HP-IB# Defaults: This command has no defaults. Related Commands: “show boot-config” (page 135) “show version” (page 176) show card Synopsis: The show card command displays the configuration, status, and SEEPROM (Serial Electrically Erasable and Programmable Read Only Memory) information for system interface cards. Syntax: show card {card# |card#-card# | card#,card#,card#...
Table B-5 show card Command Field Descriptions (continued) Field Description oper status Operational status, as detected by the controller. This is the true status of the interface card based upon self-detection. The value of this read-only field is unknown, up, down, or failure. up indicates the card is ready to be configured. There may be situations when the admin status is up, but the oper status is something else. Both admin status and oper status must be up for you to configure the card.
show card-inventory Synopsis: The show card-inventory command polls individual system interface cards for their system resources and the image data residing on the interface card. Syntax: show card-inventory {card# | card#-card# | card#,card#,card#... | all} This command has the following arguments: show card-inventory Syntax Description Table B-6 show card-inventory Command Syntax Descriptions Syntax Description card# Refers to an individual slot number. card#-card# Refers to a range of slot numbers.
HP-IB# show card-inventory ================================================================================ Card Resource/Inventory Information ================================================================================ slot-id : 1 used-memory : 52652 (kbytes) free-memory : 75172 (kbytes) used-disk-space : 66930 (kbytes) free-disk-space : 35449 (kbytes) last-image-source : Release-1.1.3hp/build020 primary-image-source : Release-1.1.3hp/build020 image : Release-1.1.
gateway 15.13.112.1 no shutdown ! HP-IB# Defaults: This command has no defaults. Related Commands: “copy” (page 193) “history” (page 199) show fan Synopsis: The show fan command displays the status of the two fans that cool the system chassis. Syntax: show fan Command Modes: User-execute and privileged-execute modes. Privilege Level: General read-only user. Usage Guidelines: Both fans should be operational while the system is powered-up.
Related Commands: “show power-supply” (page 171) “show sensor” (page 172) show host Synopsis: The show host command displays the Domain Name System configuration of the chassis. Syntax: show host Command Modes: User-execute and privileged-execute modes. Privilege Level: Fibre Channel read-only user. Usage Guidelines: The information displayed is the network domain of the chassis, and the DNS servers that are used to resolve network names to IP addresses.
Syntax: show ib sm configuration {subnet-prefix subnet prefix | all [summary]} The arguments associated with this command are described below: Table B-10 show ib Command Syntax Descriptions Syntax Description subnet prefix Refers to the subnet prefix of the subnet manager that you want to display. all Shows all the subnet managers that are currently configured and running on the InfiniBand fabric.
Subnet Manager Configuration Summary ============================================================================ subnet-prefix guid priority sm-key ---------------------------------------------------------------------------fe:80:00:00:00:00:00:00 00:05:ad:00:00:00:13:f5 10 00:00:00:00:00:00:00:00 HP-IB# Defaults: This command has no defaults.
Table B-13 show ib sm neighbor Command Field Descriptions Field Description subnet-prefix 64-bit value that identifies the InfiniBand subnet to which this node belongs. local-node-guid 64-bit GUID of the InfiniBand node. local-port-id Port ID of the InfiniBand node. The value is an integer between 0 and 255. local-node-type Type of the InfiniBand node. The value is channel-adapter, switch, or router.
Table B-14 show ib sm node subnet-prefix Command Syntax Descriptions (continued) Syntax Description node guid Use with the all keyword. summary Displays a Subnet Manager node summary. Command Modes: User-execute and privileged-execute modes. Privilege Level: InfiniBand read-only user. Usage Guidelines: Use this command to display the configuration of all the nodes on a subnet, or to display the configuration of an individual node. The output may also be displayed in summary form.
local-portnum vendor-id subnet-prefix node-guid base-version class-version type num-ports port-guid partition-cap device-id revision local-portnum vendor-id : : : : : : : : : : : : : : 2 00:05:ad fe:80:00:00:00:00:00:00 00:05:ad:00:00:00:13:da 1 1 switch 9 00:05:ad:00:00:00:13:da 1 0 0 1 00:05:ad… The following example displays a node configuration in summary form.
show ib sm port Synopsis: The show ib sm port command identifies subnet management ports, the nodes they belong to, their capabilities, and their link statistics. Syntax: show ib sm port subnet-prefix subnet prefix | all [node-guid guid] [summary] The arguments associated with this command are described below: Table B-16 show ib sm port Command Syntax Descriptions Syntax Description subnet prefix Enter the subnet prefix of the subnet managers that you want to display.
Table B-17 show ib sm port Command Field Descriptions (continued) Field Description link-width-enabled Enabled link width. The value is an integer that indicates the enabled link-width sets for this port. The value may be, 0 (no state change), 1 (1x), 2 (4x), 3 (1x or 4x), 8 (12x), 9 (1x or 12x), 10 (4x or 12x), 11 (1x, 4x or 12x), 255 (set this parameter to the LinkWidthSupported value). link-width-supported Supported link width. The value is 1 (1x), 3 (1x or 4x), or 11 (1x, 4x, or 12x).
Table B-17 show ib sm port Command Field Descriptions (continued) Field Description VL-arb-high-cap Highest arbitration value allowed by the arbiter in determining the next packet in a set of packets to send across the link. Used with the virtual-lane arbitration table and specified as a VL/Weight pair. See section 14.2.5.9, VL Arbitration Table, “InfiniBand® Architecture, Vol. 1, Release 1.0”, for more information.
Table B-17 show ib sm port Command Field Descriptions (continued) Field Description local-phy-error Threshold at which ICRC, VCRC, FCCRC, and all physical errors result in an entry into the BAD PACKET or BAD PACKET DISCARD states of the local packet receiver. See section 7.12.2, Error Recovery Procedures, “InfiniBand® Architecture, Vol. 1, Release 1.0”, for more information.
Related Commands: “ib sm subnet-prefix” (page 182) “show ib sm configuration” (page 141) “show ib sm multicast” (page 143) “show ib sm neighbor” (page 143) “show ib sm partition” (page 146) “show ib sm port” (page 147) show ib sm service Synopsis: The show ib sm service command identifies subnet management switches, the nodes they belong to, their capabilities, and their link statistics.
“show ib sm neighbor” (page 143) “show ib sm partition” (page 146) “show ib sm port” (page 147) show ib sm switch Synopsis: The show ib sm switch command identifies subnet management switches, the nodes they belong to, their capabilities, and their link statistics.
Table B-20 show ib sm switch Command Field Descriptions (continued) Field Description life-time-value Specifies the duration a packet can live in the switch. Time units are in milliseconds. See section 18.2.5.4, Transmitter Queueing, “InfiniBand® Architecture, Vol. 1, Release 1.0”, for more information. port-state-change Indicates a change in port state.
fe:80:00:00:00:00:00:00 00:05:ad:00:00:00:13:87 fe:80:00:00:00:00:00:00 00:05:ad:00:00:00:13:89 HP-IB# Defaults: This command has no defaults.
SMA Node Information ============================================================================ guid : 00:05:ad:00:00:00:13:17 type : adapter lid : 14 base-version : 1 class-version : 1 port-guid : 00:05:ad:00:00:00:13:18 partition-cap : 64 device-id : 5a:44 revision : 00:00:00:a0 local-port-num : 1 vendor-id : 00:05:ad trap-buffer : num-ports : 2 string : slot 7: /dev/ts_ua0 guid : 00:05:ad:00:00:00:13:17 type : adapter lid : 0 base-version : 1 class-version : 1 port-guid : 00:05:ad:00:00:00:13:18 partit
Table B-22 show ib-agent summary Command Field Descriptions (continued) Field Description string Node description string. The string identifies the system chassis slot and OS device used by the agent. lid Decimal-base LID of this port. Examples: The following example displays a summary of all the SMA nodes.
switch-guid : 00:05:ad:00:00:00:02:44 lid 0 1 2 3 4 5 6 7 ------- ----- ----- ----- ----- ----- ----- ----0 0 switch-guid : 00:05:ad:00:00:00:02:46 lid 0 1 2 3 4 5 6 7 ------- ----- ----- ----- ----- ----- ----- ----0 0 Defaults: This command has no defaults.
0 HP-IB# 0 Defaults: This command has no defaults. Related Commands: “ib sm subnet-prefix” (page 182) “show ib sm configuration” (page 141) “show ib-agent switch” (page 156) show ib-agent switch all mcast-info lid Synopsis: The show ib-agent switch all mcast-info lid command displays the multicast forwarding tables of the specified switches.
Command Modes: User-execute and privileged-execute modes. Privilege Level: InfiniBand read-only user. Usage Guidelines: Internally, each node connection is implemented by 6 switch chips. Each switch chip runs its own subnet management agent. Externally, they are viewed by a subnet manager as interconnected switches and, therefore, each is listed by the node-info command. The fields in the show ib-agent switch node-info output are described in the table below.
show ib-agent switch all pkey-info Synopsis: The show ib-agent switch all pkey-info command displays the index of the partition key table. Syntax: show ib-agent all pkey-info| Command Modes: User-execute and privileged-execute modes. Privilege Level: InfiniBand read-only user. Usage Guidelines: A 16-bit partition key value is carried in packets and stored in the Channel Adapters. The value is used to determine membership in a partition.
VL-cap VL-high-limit VL-arbitration-high-cap VL-arbitration-low-cap MTU-cap VL-stall-count HOQ-life op-VLs pkey-enf-in pkey-enf-out filter-raw-pkt-in filter-raw-pkt-out mkey-violations pkey-violations qkey-violations guid-cap subnet-timeout resp-time-value local-phys-err overrun-err : : : : : : : : : : : : : : : : : : : : VL0 - VL7 0 8 8 1024 0 7 VL0 - VL7 0 0 0 0 0 0 0 1 31 8 4 0 Defaults: This command has no defaults.
sl8toVl sl9toVl sl10toVl sl11toVl sl12toVl sl13toVl sl14toVl sl15toVl : : : : : : : : 0 0 0 0 0 0 0 0 … Defaults: This command has no defaults. Related Commands: “ib sm subnet-prefix” (page 182) “show ib sm configuration” (page 141) “show ib-agent switch” (page 156) show ib-agent switch switch-info Synopsis: The show ib-agent switch switch-info keyword shows the service level (SL) to virtual lane (VL) mapping table for the nodes on switch devices.
def-mcast-pri-port def-mcast-NP-port life-time-value port-state-change lids-per-port partition-enf-cap : : : : : : 255 255 11 0 0 64 Defaults: This command has no defaults. Related Commands: “ib sm subnet-prefix” (page 182) “show ib sm configuration” (page 141) “show ib-agent switch” (page 156) show interface ib Synopsis: The show interface ib command displays the IP parameters and statistics for ports on InfiniBand interface cards.
Table B-31 show interface ib Output Descriptions (continued) Field Description oper-status Indicates if the port is physically ready for configuration and use. The value of this field may be up or down. If this field is down but the admin-status is up, check that the InfiniBand interface card is securely seated in the slot and a cable is attached between the port and the target InfiniBand host. link-trap Indicates if connection link errors are to be captured and sent to trap recipients.
show interface ib sm Synopsis: The show interface ib sm command displays the attributes and table data for subnet management agents that access InfiniBand ports. Syntax: show interface ib sm sma node-info show interface ib sm sma node-info The syntax is described in the table below: Table B-32 show interface sma ib Command Syntax Descriptions Syntax Description node-info Lists each node used by the subnet management agents, its type, GUID, and capabilities.
lid master-sm-lid capability-mask diag-code mkey-lease-period local-port-num link-width-enabled link-width-supported link-width-active link-speed-supported state port-phys link-down-def mkey-protect-bits lmc ls-active ls-active-enabled neighbor-mtu master-sm-sl vl-cap vl-high-limit vl-arbitration-high-cap vl-arbitration-low-cap mtu-cap vl-stall-count hoq-life op-vls pkey-enf-in pkey-enf-out filter-raw-pkt-in filter-raw-pkt-out mkey-violations pkey-violations ...
out-ucast-pkts out-multicast-pkts out-broadcast-pkts out-discards out-errors : : : : : 39 0 0 0 0 HP-IB> Defaults: This command has no defaults. Related Commands: “show interface ib” (page 163) “show interface ib sm” (page 165) show interface mgmt-ethernet Synopsis: The show interface mgmt-ethernet command shows the configuration of the Ethernet Management port on the system controller. Syntax: show interface mgmt-ethernet This command takes no card or port designation.
Mgmt-InfiniBand Information =============================================================== descr : Inband Management Port admin-status : up ip-addr : 192.168.2.200 mask : 255.255.255.0 gateway-addr : 0.0.0.0 HP-IB# Defaults: This command has no defaults. Related Commands: “interface mgmt-ib” (page 203) show interface mgmt-serial Synopsis: The show interface mgmt-serial command displays the configuration of the Serial-Console port on the system controller card.
Table B-33 show ip Command Syntax Descriptions Syntax Description address-table This keyword displays the address information of Ethernet interface ports, Ethernet interface cards, and InfiniBand interface cards. It lists the IP addresses, netmasks, broadcast formats, reassembly sizes, and whether or not the IP address is a primary or backup. ip-over-ib-mtu This keyword displays the maximum size of the packet payload of IP-over-IB traffic along a path from the source to its destination on the subnet.
The syntax is described in the table below: Table B-34 show logging Command Syntax Description Syntax Description show logging without the end argument displays the entire active log-file. end Displays approximately the last 10 entries in the system log and then continues to display log entries as they occur. Command Modes: User-execute and privileged-execute modes. Privilege Level: General read-only user.
Server One : 10.3.120.55 Server Two : 10.3.120.56 Server Three : 10.3.120.57 HP-IB> Defaults: This command has no defaults. Related Commands: “ntp” (page 206) “clock” (page 192) show power-supply Synopsis: The show power-supply command displays the status of the system power supplies. Syntax: show power-supply Command Modes: User-execute and privileged-execute modes. Privilege Level: General read-only user.
Usage Guidelines: This command can generate a large amount of data. Data is displayed per terminal length command settings. When executed, this command first prompts you to verify your desire to generate the data. Enter y to continue or n to cancel. The default output file is syslog:igr_interface_runningstatus, where interface may be ib or all. If the file already exists, it will be overwritten. This text file may be uploaded to another system using the copy command or viewed using the more command.
show snmp Synopsis: The show snmp command lists the SNMP receivers for switch link-traps, as well as contact and location information. Syntax: show snmp Command Modes: User-execute and privileged-execute modes. Privilege Level: Unrestricted read-write user. Usage Guidelines: None. Examples: HP-IB# show snmp ============================================================================ SNMP Information ============================================================================ contact : support@hp.
“snmp-server” (page 209) “ntp” (page 206) “hostname” (page 200) “ip name-server-one” (page 180) “ip name-server-two” (page 181) show terminal Synopsis: The show terminal command shows the terminal parameters and configurations, such as time-outs and maximum allowable command length. Syntax: show terminal Command Modes: User-execute and privileged-execute modes. Privilege Level: General read-only user.
Usage Guidelines: This command is intended primarily for program debug under the direction of Support personnel. The number of applications and modules may change between releases. The numbers assigned to applications and modules may also change. Check application and module number assignments using CLI help (i.e.,?) for entering command arguments. Examples: HP-IB# show trace app 14 module 20 card 1 IB_CM 20 0x0 0x0 HP-IB# Defaults: This command has no defaults.
snmp-community permission-level admin-status num-logins num-unsuccessful-logins last-login last-unsuccessful-login HP-IB> : : : : : : : private ib-rw enabled 1 0 Thu Apr 10 22:06:48 2003 The following example shows the login information of the current user. HP-IB> show user =============================================================== User Information =============================================================== username : super password : $1$IJ5..U6.$ES3pIhx/ccUaCKgM65vp6.
IP Commands IP Commands (Table) The commands described in this chapter are listed in the table below. This chapter describes the commands used to configure Ethernet and InfiniBand Internet Protocol connections. The first part of this chapter contains tables that list each IP command and cross-references command descriptions. The second part is comprised of descriptions of the commands in alphabetical order.
Table B-39 auto-negotiate Syntax Description Syntax Description ip Enter the IP address of the target host. gid Refers to the Global ID of the host HCA. ext Refers to the GID extension qpn Refers to the Queue-Pair number of the host. port#/slot# identifies the chassis port being accessed by the target host. Command Modes: Global-configuration mode. Privilege Level: InfiniBand read-write user.
degraded performance because there are more headers and acknowledgements required to transmit the same amount of data. Examples: HP-IB(config)# default ip ip-over-ib-mtu Defaults: NOTE: The default ip-over-ib-mtu is 2048. This command should not be used as change in MTU is not supported. Related Commands: “ip ip-over-ib-mtu” (page 179) “show ip” (page 168) ip domain-name Synopsis: The ip domain-name command configures the network DNS domain for the system chassis.
Table B-41 Command Syntax Description (continued) Command Description mtu Enter the Maximum Transmission Unit (MTU) to apply. The MTU value may be 256, 512, 1024, 2048, or 4096. MTU is specified in octets (8-bit bytes). Refer to Usage Guidelines for more information. no Sets the MTU to the default. Command Modes: Global configuration (config) mode. Privilege Level: Ethernet and InfiniBand read-write user. Usage Guidelines: The maximum transmission unit is described in terms of payload size.
ip name-server-two Synopsis: The name-server-two command specifies the IP address of the backup DNS server. Syntax: ip name-server-two ip no ip name-server-two The syntax is described in the table below: Table B-43 Command Syntax Description Command Description ip Enter the main ip command. name-server-two Specify the IP address of the backup DNS server. ip Enter the IP address of the backup DNS server. no Use this keyword to return the backup DNS server to the default name.
local routes are automatically created when you assign an IP address to a system card or port. Some gateway functions are not supported by HP InfiniBand.. Examples: HP-IB# configure HP-IB(config)# ip route 192.168.3.0 255.255.255.0 10.10.1.0 Defaults: The default is an empty string. Related Commands: “show ip” (page 168) InfiniBand Commands This chapter describes InfiniBand CLI configuration commands, which are used to administer the system chassis.
no ib sm subnet-prefix guid [no priority] [no sm-key] [no response-timeout] [no sweep-interval] ib sm subnet-prefixsubnet-prefix p_keypartiton key partition-member node guid | port-number | membership type no ib sm subnet-prefixsubnet-prefix p_keypartiton key partition-member node guid | port-number | membership type The syntax and arguments are described in the table below: Table B-46 ib sm subnet-prefix Syntax Description Syntax Description guid Globally Unique Identifier (GUID) of this subnet manager.
the subnet management agent is done using the common management datagram (MAD) message structure. This structure entails the passing of subnet management packets (SMP). There is a limit to the number of MAD packets that may be queued for a single file descriptor. Once the queue reaches its maximum length (currently set to 8), new packets are dropped. This prevents “livelock” in the situation where new MADs arrive faster than they can be processed.
response-timeout is 2,000 microseconds. Related Commands: “ib-agent channel-adapter” (page 185) “show ib sm configuration” (page 141) ib-agent channel-adapter Synopsis: The ib-agent channel-adapter command and its arguments are used to configure the Subnet-Management Agent (SMA) node strings for channel adapters. A node string is a descriptive string used to identify an object.
Command Modes: Global-configuration mode. Privilege Level: Unrestricted and InfiniBand read-write users. Usage Guidelines: A subnet-management agent (SMA) is the intermediary between a network manager and the network entities it manages, such as the internal InfiniBand switches and host channel adapters.
Syntax: link-trap no link trap The commands syntax is described in the table below: Table B-51 link-trap Command Syntax Descriptions Syntax Description no The no keyword disables link-trap generation. Command Modes: Configuration Interface (config-if) mode. Privilege Level: InfiniBand read-write user. Usage Guidelines: A link-up trap is generated when the operation status (oper-status) changes to up. A link-down trap is generated when the operation status changes to down.
no shutdown The commands stoats is described in the table below: Table B-53 shutdown Command Syntax Description Syntax Description shutdown Disables the specified InfiniBand cards and ports. no The no keyword disables the specified InfiniBand cards and ports. Command Modes: Configuration interface (config-if) mode. Privilege Level: InfiniBand read-write user. Usage Guidelines: InfiniBand ports must be enabled before they can be configured.
Table B-54 Administrative Commands (continued) Command Description exit Used to leave the current mode for the previous mode or the user-execute mode. See “exit” (page 197) ftp-server enable Use to enable or disable ftp-services. See “ftp-server enable” (page 197) gateway Gateway functions are not supported by HP InfiniBand help Describes the types of help information available and ways to display specific command-line information. See “help” (page 199) history Shows command history.
Table B-54 Administrative Commands (continued) Command Description terminal time-out Sets a limit for inactivity allowed during a CLI session. See “terminal time-out” (page 211) trace Tracks internal system program modules that are called for a specific interface card. See “trace” (page 211) type Defines the type of gateway or switch cluster connection being configured (some gateway functions are not supported by HP InfiniBand).
Table B-57 boot-config Arguments Argument Description dir Enter the actual file name. Command Modes: Global-configuration mode. Privilege Level: Unrestricted read-write user. Usage Guidelines: Enter the primary-image-source keyword, followed by the system-image directory. Specify an image directory as an image source. Do not specify image files that end in.img since these are compressed archives that must be installed first. Examples: HP-IB(config)# boot-config primary-image-source Release-1.1.
card Synopsis: The card command enters Configuration Card (config-card) spumed. Commands in this submode enable/disable, set type, and reinitialize cards. Syntax: card card-identifier Command Modes: Global-configuration mode. Privilege Level: read-write user Usage Guidelines Examples: HP-IB> enable HP-IB# config HP-IB(config)# card all HP-IB(config-card-1,6,11,15-16)# no shutdown HP-IB(config-card-1,6,11,15-16)# Defaults: This command has no defaults.
Syntax: configure Command Modes: User-execute mode. Privilege Level: Unrestricted and general read-write user. Usage Guidelines: The configure command is used to enter the global-configuration mode. In this mode, you may configure gateway and switch cluster connections, subnet management, IP addressing, and the system (some gateway functions are not supported by HP InfiniBand). Examples: HP-IB# configure HP-IB(config)# Defaults: This command has no defaults.
Image files require additional processing. After they have been copied onto the system chassis, image files must be installed before they can be used to initialize the system. After configuration files are downloaded to the system chassis, they may be specified in the configure boot-config command and used the next time the system is booted. The File Transfer Protocol (FTP is used to copy data to and from a remote host.
Usage Guidelines: Active images cannot be deleted. Refer to “Deleting Configuration, Image, and Log Files” (page 94) for directions about how to make a system-image inactive in order to delete it. To delete a system-image from an individual gateway or switch cluster connection, use the card action command (some gateway functions are not supported by HP InfiniBand). Examples: HP-IB# delete config:ip-back.cfg******HP-IB# Defaults: This command has no defaults.
================================================================================ Existing Boot-Images on System ================================================================================ slot date-created size file-name -------------------------------------------------------------------------------1 Tue Jan 13 10:24:35 2004 18905824 HP-AB291A-Release-1.1.3hp-build023.img 1 Sun Feb 22 10:24:44 2004 18932637 HP-AB291A-Release-1.1.3hp-build025.img 1 Sun Feb 22 10:29:45 2004 13085184 Release-1.1.
exec Synopsis: The exec command is used to execute a file. Syntax: exec file Table B-64 exit Command Keyword Description Keyword Description file Name of the file that you want to execute. Command Modes: All modes. Privilege Level: Privileged-execute modes. Usage Guidelines: None. Examples: HP-IB> enable HP-IB# config HP-IB(config)# exec config:test.cfg Defaults: This command has no defaults.
Table B-66 ftp -server Command Keyword Description Keyword Description no Use the no keyword to disable an ftp server in the system. Command Modes: Privileged-execute modes. Privilege Level: All users. Usage Guidelines: Files can be uploaded and downloaded over FTP or over TFTP. Examples: The following example shows ftp services being disabled in the system. HP-IB(config)# no ftp-server enable HP-IB(config)# Defaults: This command has no defaults.
The Management-InfiniBand gateway does not have to be specifically identified, like the gateways of expansion modules. This is because there is only one active Management-InfiniBand port on the chassis. You must configure the Management-InfiniBand port through the serial-console terminal. Examples: The following example shows the gateway command for the Ethernet management interface. HP-IB# configure HP-IB(config)# interface mgmt-ethernet HP-IB(config-if-mgmt-ethernet)# gateway 10.3.0.
This is a global command that may be executed in any mode. To display just one screen of history data at a time, set the terminal display length. Examples: HP-IB(config)# history 1 history 2 enable 3 config 4 arp 5 boot-conf 6 boot-config 7 diagn 8 interface ib all 9 exit 10 interface ethernet all 11 ip 12 history HP-IB(config)# Defaults: This command has no defaults.
Table B-70 install Command Argument Descriptions Argument Description image Specifies the file resides in the image file-system. file The name of the image file to install. Image files must reside in the image file-system and the file name must have the .img extension. Command Modes: Privileged-execute mode. Privilege Level: Unrestricted read-write user. Usage Guidelines: After downloading the image file to the chassis controller, it must be installed.
Usage Guidelines: Theno gateway ipcommand configures the default gateway IP address of the out-of-band Ethernet Management port. Using the no keyword disables the gateway indicated by ip and resets the gateway IP address to all zeros (0.0.0.0.0). Thehelpcommand displays the command help. See “gateway” (page 198) Thehistorycommand displays all the commands executed during the current CLI session. See “history” (page 199) no ip address ip configures the IP address of the out-of-band Ethernet port.
Related Commands: “ip ” (page 203) “shutdown” (page 187) “show interface mgmt-ethernet” (page 167) “show interface mgmt-ib” (page 167) interface mgmt-ib Synopsis: The interface mgmt-ib command is used to enable and configure the IP addresses for the virtual port and gateway on the InfiniBand fabric. Once configured, hosts connected to any InfiniBand switch port that run IPoIB may use the port and gateway to administer the chassis. Syntax: interface mgmt-ib Command Modes: Privileged-execute mode.
mask is the subnet mask for the IP address (Element Manager GUI is not supported in initial release of HP InfiniBand). no ip address disables the management port indicated by ip and resets its IP address to all zeros (0.0.0.0.0). Command Modes: Interface Configuration (config) mode. Configuration Interface Management IB mode (config-if-mgmt-ib). Configuration Interface Ethernet Management mode (config-if-mgmt-ether). Privilege Level: Unrestricted read-write user.
Defaults: This command has no defaults. Related Commands: “snmp-server” (page 209) “show location” (page 169) “show version” (page 176) login Synopsis: The login command is used to change user identity during a CLI session. Syntax: login user Command Modes: User-execute and privileged-execute modes. Privilege Level: All users. Usage Guidelines: The login command allows you to assume the identity of another user without having to exit the CLI.
HP-IB# logout HP-IB#Connection to host lost. Defaults: This command has no defaults. Related Commands: “exit” (page 197) “login” (page 205) more Synopsis: The more command displays text data on the terminal screen for a stored log or configuration file. Syntax: more fs:file fs is the file-system that contains the file. The file-system may be config or syslog. You cannot display image file data or compressed system log files. Only the currently active log file, ts_log, may be viewed.
HP-IB(config)# ntp server-one 10.0.3.110 HP-IB(config)# ntp server-two 10.0.3.111 HP-IB(config)# ntp server-three 10.0.3.112 Defaults: This command has no defaults. Related Commands: “clock” (page 192) “show clock” (page 139) “show ntp” (page 170) ping Synopsis: Use the ping command to verify if a host can be reached from the system. Syntax: ping dest dest is the IP address or DNS name of the host, port, or expansion module you wish to ping. Command Modes: User-execute and privileged-execute modes.
reload Synopsis: The reload command reboots the chassis. Syntax: reload Command Modes: Privileged-execute mode. Privilege Level: General read-write user. Usage Guidelines: At stages of chassis and interface setup you need to reinitialize chassis firmware or restore interface card configurations. You may power-cycle by unplugging and replugging the electrical cord to the system chassis but this approach is not recommended.
Note: The Ethernet Management port must be enabled, or brought up, before it can be configured. Enter this command before assigning the port IP and gateway addresses (some gateway functions are not supported by HP InfiniBand). The Ethernet Management port does not have to be specifically identified, like the ports of expansion modules. This is because there is only one active Ethernet Management port on the chassis. When the Ethernet Management port is disabled, its current configuration remains intact.
Table B-74 snmp-server Command Keyword Descriptions Keyword Description contact The snmp-server contact command sets the contact information for this managed node. Specifies contact information that is included when displaying the chassis version information. host Configures the SNMP server to receive linkUp/linkDown SNMP traps. location Specifies the location of the chassis that is included when displaying the chassis version information.
terminal length Synopsis: The terminal length command sets the number of lines displayed at one time by commands like more so that data does not scroll quickly out of view. Syntax: terminal length int terminal no length int is a number between 0 and 512 that indicates the number of lines to display at one time. 0 turns off paging and displays data on the screen without stopping until completed. It is recommended you set the terminal page length to 0 when using the tail command with the end argument.
mod is the program module in side the application. lev is the verbosity of the trace information returned. val is a decimal or hex value. card is the slot number of the card being traced. Command Modes: Global-configuration mode. Privilege Level: General read-write user. Usage Guidelines: The number of applications and modules may change between releases. The numbers assigned to applications and modules may also change. Check application and module number assignments using CLI help (i.e.
username Synopsis: The username command is used to create and manage administrative access to both CLI, GUI, and SNMP (Element Manager GUI is not supported in initial release of HP InfiniBand). Syntax: username user password passwd <-- must be executed 1st username user no username user disable username user enable username user community-string string username user no-community-string username user privilege priv1 [priv2] [priv3] user and passwd are alphanumeric strings up to 34 characters each.
For security purposes, since multiple users exist on the system, it is highly recommended that you change the default passwords after initial configuration. The default user accounts are listed in the table below. Table B-77 Default User Accounts User Name Password Privilege super By default, the password is “super”. The default community string is “secret”. The super user has unrestricted privileges. Use this account to manage any part of the system.
super HP-IB# 10.10.253.47admin 10.10.196.8 Defaults: This command has no defaults. Related Commands: “broadcast” (page 191) “write” (page 215) write Synopsis: The write command writes a text message to the terminal of a specified user. Syntax: write user string user is the name string is the SNMP community-string that will be used to authenticate the chassis to the SNMP server. Enclose multi-word community strings within double-quotes (“ “). Command Modes: User-execute and privileged-execute modes.
C How to Use Windows HyperTerminal Attaching through Windows HyperTerminal You can use Windows HyperTerminal (HyperTerminal) to make an initial connection to the HP Fabric switch to configure TCPIP. This allows you to remotely administer and manage your HP Fabric switch. HP recommends configuring TCPIP on the switch so you can more easily perform firmware updates and to allow for remote HP Support connections to your HP Fabric switch.
Figure C-1 Run Program Dialog Box Configuring the HyperTerminal Connection When HyperTerminal starts, you are presented with a Connection Description dialog box. 1. Enter a Connection Description. 1. Type a name for the connection. 2. Choose the appropriate icon for your connection type. 3. Click OK. Figure C-2 Connection Description Dialog Box 2. 218 Enter Connection Details. You will be presented a Connect To dialog box. 1. Specify your COM Port in the Connect Using section of the dialog box. 2.
Figure C-3 Connect To Dialog Box Attaching through Windows HyperTerminal 219
3. Enter COM Port Property Information. The COM Port Properties dialog box displays. 1. Enter Bits per second: 9600 2. Enter Data bits: 8 3. Enter Parity bits: None 4. Enter Stop bits: 1 5. Enter Flow control: None 6. Click OK. Figure C-4 COM Port Properties Dialog Box Verifying the HyperTerminal Connection A blank terminal window will open. You should now be communicating directly between the COMPORT and the switch. To confirm this, press Return. You should see the CLI login prompt.
Figure C-5 HyperTerminal Login Attaching through Windows HyperTerminal 221
Glossary 12X link – An InfiniBand link capable of 30 Gb/s in each direction simultaneously. It consists of 12 signal pairs, each running at 2.5 Gb/s. 30 Gb/s technology and is downward compatible with 10 Gb/s (4X). 12x links will become available at the end of 2003 1X link – An InfiniBand link capable of 2.5 Gb/s in each direction simultaneously. 1X technology is upward compatible with 4X (10Gb/s) and 12X (30 Gb/s) links. 4X link - An InfiniBand link capable of 10 Gb/s in each direction simultaneously.
IETF Internet Engineering Task Force (IETF) is a large international community of network designers, operators, vendors, and researchers guiding the evolution of Internet architecture. See http://www.ietf.org/overview.html. IOC An I/O Controller (IOC) and Target Channel Adapter (TCA) are the parts of an I/O unit. IOCs provide I/O services and TCAs (Target Channel Adapter) provide the transport services. The I/O interface of the TCA is implemented by an I/O Controller. IP Internet Protocol.
SM The Subnet Manager (SM) configures and manages routers, switches, and channel adapters. Multiple subnet managers per subnet are supported. SMP Subnet Management Packet (SMP) on the fabric. SNMP Simple Network Management Protocol (SMNP) lets a user define management information base (MIB) extensions. SNMP agents access MIB objects when requested by an SNMP Manager. Target Channel Adapter The Target Channel Adapter (TCA) is the complement to HCA.
Index A abbreviation of commands function, 77 about user accounts, 104 access changing access levels, 104 community strings, 103 ib-ro, 104 ib-rw, 104 setting levels, 104 unrestricted-rw, 104 access levels, 104 action, 190 action delete-inactive image command, 188, 190 active image, 85 adapters, function of, 225 (see also Ethernet NICs) adding new users, 101 admin user account commands, 103 admin user privileges, 74, 100 administering, 98 administrative commands action delete-inactive image command, 188, 19
cards, interface, 225 (see also interface cards) changing user access-levels, 104 user identity, 98 chassis booting and configuration files, 92 chassis, InfiniBand configuration commands for, 182–187 reload command, 208 show host command, 132, 141 shutdown command, 208–209 temperature information, 133, 172 clear ib, 178 clear ib arp-cache command, 177, 178 CLI command completion, 76 CLI (Command Line Interface) sessions, 74–98, 225 (see also switches) clock, 105 setting time (CLI), 106 setting time (GUI), 1
delete, 194 command, 95 delete command, 188, 194–195 deleting a user account, 102 configuration files, 95 image Files, 96 image files, 90 log files, 95 system images, 90 diagnostics, 51, 109–116 dir, 195 dir command, 188, 195–196 disable, 196 disable command, 188, 196 displaying configuration, image, and log files, 91 log files, 91 user information, 101 DMA (Direct Memory Access), definition, 223 DNS services about, 104 DNSs (Domain Name Servers) overview, 104 setting up, 177, 179–181 domain name servers ab
CLI sessions, 77–78 itutil (-h) command, 57 lanadmin command, 70 High Availability (HA), 52 High-Performance Computing, 19 history, 199 history command, 177, 182, 189, 199–200 Host Channel Adapters (HCAs), 225 (see also HCAs) hostname, 200 hostname command, 81, 189, 200 hostname, customizing, 81 HP Fabric Clustering System, 225 (see also installation) hardware overview, 23–32 host adapter management, 56–71 overview, 19–21 specifications, 129 HP-MPI (HP Message Passing Interface) protocol, 34 HyperTerminal,
ip name-server-one command, 177, 180 ip name-server-two, 181 ip name-server-two command, 177, 181 ip route, 181 ip route command, 177, 181–182 IPoIB, 20 check status, 68 IPoIB standard default ip-over-ib-mtu, 177, 178–179 definition, 33 IP commands, 177–182 ip ip-over-ib-mtu command, 177, 179–180 management of, 67–71 monitoring and troubleshooting, 121–124 overview, 20 IT-API (Internet Transport API), 20 IT-API (Internet Transport API), definition, 224 itutil tool, 20 adapter reset option (-R), 58 basic syn
more, 206 command, 91 more command, 189, 206 MPI (Message Passing Interface) protocol, 20 definition, 224 overview, 34 MTU (maximum transmission unit), 177, 178–180 multicast (MCAST) message forwarding definition, 224 show ib sm multicast command, 143 show ib-agent switch all mcast-info lid command, 158 card, 89 OSI (Open System Interconnection), definition, 224 OSPF (Open Shortest Path First), definition, 224 out-of-band connection, 86 out-of-band Ethernet management IP address, 48–49 P name, 187 names
(see also ports) R radius-server command, 189, 207 Random Early Detection (RED), definition, 224 ranges of NICs, CLI designations for, 80 RARP (Reverse Address Resolution Protocol), definition, 224 RDMA (Remote Direct Memory Access), 19, 224 overview, 19 read-only access, setting up, 104 read-write access, setting up, 104 read/write access, 104 reboot saving system, 92 reboot image, 92 rebooting about, 106 CLI step procedure, 106 configuration files, 92 reload command, 189, 208 system, 90 through the CLI,
show ib-agent switch linear-frd-info, 157 show ib-agent switch linear-frd-info command, 157–158 show ib-agent switch port-info command, 160–161 show ib-agent switch sl-vl-map command, 161–162 show ib-agent switch switch-info command, 162–163 show interface ib, 163 show interface ib command, 132, 163–167 show interface ib sm command, 165–166 show interface ib sm statistics command, 166–167 show interface ib sma, 165 show interface mgmt-ethernet, 167 show interface mgmt-ethernet command, 167 show interface mg
system hostname, 81 system image install, 88 system images, 225 (see also image files) boot-config command, 188, 190–191 deleting inactive image connections, 96–97, 188, 190 install command, 200 listing, 132, 135–136 overview, 84 specifying, 89–93, 135–136 system interface card, 225 (see also interface cards) system reboot specifying the configuration to use (Element Manager), 92 system services, displaying data on, 133, 173 system status LED, switches, 115 T TCA (Target Channel Adapter), definition, 225 T
RDMA Library, 21 username, 213 username command, 190, 213–214 usernames and passwords, understanding, 100 V VERBOSE trace level, 126 version information, 133, 176 VERY_TERSE trace level, 125 VERY_VERBOSE trace level, 126 viewing configuration files, 91 virtual lane (VL) vs.
