QLogic 3000 and 3100 Series Intelligent Ethernet Adapters Users Guide NE0154601-00 A
QLogic 3000 and 3100 Series Intelligent Ethernet Adapters Users Guide Version 4.6 Information furnished in this manual is believed to be accurate and reliable. However, QLogic Corporation assumes no responsibility for its use, nor for any infringements of patents or other rights of third parties which may result from its use. QLogic Corporation reserves the right to change product specifications at any time without notice.
Table of Contents Preface Intended Audience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Related Materials . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Documentation Conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Technical Support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Availability . . . . . . . . . . . . . . . . . . . . . . . . . . .
QLogic 3000 and 3100 Series Intelligent Ethernet Adapters Users Guide Version 4.6 Linux Driver Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Verify and Remove Existing QLogic Adapter Driver and Tools Package Install the Driver (RPM) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Red Hat® . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SUSE®. . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
QLogic 3000 and 3100 Series Intelligent Ethernet Adapters Users Guide Version 4.6 Tcp1323Opts Parameter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Modifying the Tcp1323Opts Parameter . . . . . . . . . . . . . . . . . . Creating the Tcp1323Opts Parameter . . . . . . . . . . . . . . . . . . . Setting the TcpWindowSize Parameter . . . . . . . . . . . . . . . . . . . . . . 6 Linux Driver Installation and Configuration Linux Driver Checklist. . . . . . . . . . . . . . . . . . . . . .
QLogic 3000 and 3100 Series Intelligent Ethernet Adapters Users Guide Version 4.6 Bonding Driver Parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . arp_interval . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . arp_ip_target . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . downdelay . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . lacp_rate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
QLogic 3000 and 3100 Series Intelligent Ethernet Adapters Users Guide Version 4.6 QLogic Adapter Flash Update — Windows Server . . . . . . . . . . . . . . . . . . . Using the Flash Utility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Flash Update Procedure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Updating the Flash on Multiple Standalone Adapters . . . . . . . . . . . . . QLogic Adapter Flash Update — Linux . . . . . . . . . . . . . . . . . . . . .
QLogic 3000 and 3100 Series Intelligent Ethernet Adapters Users Guide Version 4.6 5-25 5-26 5-27 5-28 5-29 New Key — DWORD . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Creating Tcp1323Opts. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Edit DWORD Value Window — Tcp1323Opts Parameter . . . . . . . . . . . . . . . . . . . Modifying the TcpWindowSize Parameter . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Preface Intended Audience This guide is for system administrators and end-users of the QLogic 3000 and 3100 Series Intelligent Ethernet adapters. Related Materials Release Notes included in the software release. Linux® man page % man nx_nic nxudiag utility help (diagnostics) nxudiag -h or nxudiag --help (Windows®) % ./nxudiag -h or nxudiag --help (Linux) Check the QLogic Web site for updates.
Preface Technical Support Text in Courier font indicates a file name, directory path, command, or screen text. For example: nx3fwct.bin C:\WINDOWS\system32\drivers Text in Bold Courier font indicates a command to enter that performs a specific task. For example: rpm -iv nx_nic-[version].src.rpm The italic text (version) indicates a variable. A percent sign (%) is the cursor prompt when executing Linux commands.
Preface Technical Support Training QLogic offers training for technical professionals for all iSCSI, InfiniBand, Fibre Channel, and Intelligent Ethernet products. From the main QLogic Web page at www.qlogic.com, click the Education and Resources tab at the top, then click the Education & Training tab on the left. The QLogic Global Training Portal offers online courses, certification exams, and scheduling of in-person training.
Preface Technical Support Notes xii NE0154601-00 A
1 Overview This guide describes the system requirements, installation, and setup required for the QLogic 3000 and 3100 Series Intelligent Ethernet adapters listed in Table 1-1. This guide should be used in conjunction with the Release Notes. Obtaining the Latest Software Release Information Refer to the Release Notes for more information on the software release package contents.
1–Overview Supported QLogic 3000 and 3100 Series Intelligent Ethernet Adapters Supported QLogic 3000 and 3100 Series Intelligent Ethernet Adapters The products in Table 1-1 are supported in this document. Table 1-1.
2 System Requirements Before installing the QLogic adapter, make sure your system meets the requirements listed in this section: “Hardware Requirements” on page 2-1 “System and Software Requirements” on page 2-2 “Supported QLogic Adapters” on page 2-2 Hardware Requirements Cable Specifications Make sure the cables you are using meet the specifications listed in Tables 2-1 and 2-2. Table 2-1.
2–System Requirements System and Software Requirements Table 2-2. Cable Specifications — Copper Product Cable Type Network Type Cable Length (meters) QLE3044-RJ Cat5 LAN 100 QLE3142-CU Copper direct attach twinax LAN 10 SFP+ Optical Module Requirements Use only the optical modules validated and shipped with the QLogic adapter. System and Software Requirements See the Release Notes for more information on the particular system and software requirements for the current software release.
3 Installation Instructions This section provides instructions for advanced users who are already familiar with hardware and software installation procedures. See the appropriate section, as applicable: “QLogic Adapter Installation and Verification” on page 3-1 “Windows Server Driver Installation” on page 3-2 “Linux Driver Installation” on page 3-4 QLogic Adapter Installation and Verification The following sections provide high-level instructions for installing the QLogic adapter.
3–Installation Instructions Windows Server Driver Installation Windows Server On Windows Server systems, perform the following steps: 1. Open the Start menu. 2. Highlight My Computer, then right-click the mouse button. On the shortcut menu, select Manage. The Computer Management window opens. 3. Select Device Manager under Computer Management. 4. Check under Other devices for an Unknown Device. The QLogic adapter will be listed as an Unknown Device.
3–Installation Instructions Windows Server Driver Installation 9. Locate the following files in the driver directory: nx3fwct.bin nx3fwmn.bin nxnd5x86.sys (Windows 2003, 32 bit) or nxnd5x64.sys (Windows 2003, 64 bit) Click OK in the Browse for Folder window. 10. Click the Next button from the Hardware Update Wizard window. To configure the QLogic adapter: 1. On the Start menu, select Control Panel. 2. Select Network Connections. 3. Verify that Ethernet adapter icon says Connected. 4.
3–Installation Instructions Linux Driver Installation Linux Driver Installation Before installing the driver, download the driver package and the Release Notes from the QLogic Web site, www.qlogic.com. See “Linux Driver Checklist” on page 6-1 for more information. Verify and Remove Existing QLogic Adapter Driver and Tools Package If you have a previous version of the QLogic adapter driver, perform the following steps to remove the driver and tools package: 1. Type: rpm -qa | grep nx_ 2.
3–Installation Instructions Linux Driver Installation 4. Type the following command to install the tools RPM: rpm -ivh nx_tools-[version].rpm 5. Type the following command to load the driver: modprobe -v nx_nic SUSE® To install the driver on a SUSE system: 1. Type the following command to install the RPM source: rpm -iv nx_nic-[version].src.rpm 2. Type the following command to build the binary RPM: rpmbuild -bb /usr/src/packages/SPECS/nx_nic-[version].spec 3.
3–Installation Instructions Linux Driver Installation Notes 3-6 NE0154601-00 A
4 Hardware Installation This section provides installation instructions for the QLogic adapters. Please follow all applicable ESD precautions when handling the QLogic adapter. QLE3044 Installation To install the QLE3044: 1. Verify that the system is powered off and unplug the power cord. 2. Remove the system cover. 3. Locate an empty x4 or higher PCIe® slot. 4. Insert the QLE3044 into the PCIe slot. Apply uniform pressure on top of the QLE3044 until it is firmly seated in the PCIe bus connector.
4–Hardware Installation QLE3044 Installation Ethernet Port Mapping The mapping of port numbers on the QLE3044 is shown in Table 4-1. Table 4-1. Mapping of Port Number, PCI Function, and Ethernet Interface Port Number PCI Function 1 0 2 1 3 2 4 3 Ethernet Interface Ethernet interface numbers are dynamically allocated by the host. As such, any eth[n] interface can be connected to any port. QLE3044 Status LEDs The QLE3044 has two status LEDs per port.
4–Hardware Installation QLE3044 Installation QLE3044 Bracket Removal and Replacement Depending on the type of system, installation of the QLE3044 requires either a long bracket or a short bracket. QLogic provides both of these brackets with the product. The brackets for the QLE3044 are different from previous brackets in that they slide over the top of the four RJ45 Ethernet jacks. To remove and replace the bracket: 1. Remove the screw at the top of the QLE3044 that holds the bracket in place. 2.
4–Hardware Installation QLE3142 Installation QLE3142 Installation To install the QLE3142: 1. Verify that the system is powered down and unplug the power cord. 2. Remove the system cover. 3. Locate an empty x8 PCIe slot. 4. Remove the SFP+ optical modules from the QLE3142 if they are already inserted (see Figure 4-5). 5. Insert the QLE3142 into the x8 PCIe slot. Apply uniform pressure on top of the QLE3142 until it is firmly seated in the bus connector. 6.
4–Hardware Installation QLE3142 Installation Bracket Ensure hinge is in upright position when inserting module. When the module is inserted correctly, an audible ‘clicking’ sound will be heard. QLE3142 SFP+ module slides into housing on the board SFP+ Optical Module Housing SFP+ Optical Module Housing To remove optical module, flip the hinge downward. Pull on the hinge to remove the module from the housing. Figure 4-5.
4–Hardware Installation QLE3142 Installation 3. Gently pull the bracket away from the QLE3142 until it disconnects from the optical module housings. 4. To replace with a different bracket, reverse the process, sliding the new bracket over the module housings (see Figure 4-8). Note that the screw mounting tabs on the bracket go on the solder side of the QLE3142. Fasten the bracket in place with the two screws. Mounting Bracket QLE3142 Housing Housing 1. Remove the two mounting screws. 2.
5 Windows Server 2003 and 2008 Driver Installation and Configuration This section describes the installation and configuration procedure for Windows Server 2003 and 2008 operating systems (OSes), collectively referred to as Windows Server unless otherwise noted. For Linux driver installation instructions, see Section 6. Throughout this section, some screen shots show both the Windows Server 2003 and the Windows Server 2008 versions.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Driver Installation and Verification Windows Server Driver Installation and Verification Note that the following procedure is for a new driver installation. 1. Copy the QLogic adapter release package to a directory on the host. 2. After the server system is powered up, Windows detects the QLogic adapter, and the Found New Hardware Wizard dialog box opens (Figure 5-1). Figure 5-1.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Driver Installation and Verification 3. Do one of the following: Windows Server 2003: select Install from a list or specific location (Advanced), and then click the Next button (Figure 5-2). Windows Server 2008: select Browse my computer for driver software (Figure 5-2). Windows Server 2003 Windows Server 2008 Figure 5-2.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Driver Installation and Verification 4. Do one of the following: Windows Server 2003: select Search for the best driver in these locations, and then select Include this location in the search (Figure 5-3). Windows Server 2008: in the Update Driver Software dialog box, select Browse for driver software on your computer.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Driver Installation and Verification Select the appropriate directory (x86 or x64), and then click the OK button (Figure 5-4). The QLogic adapter supports both 32-bit and 64-bit OSes (see the Release Notes for more information). The x86 directory contains the 32-bit driver. The x64 directory contains the 64-bit driver. Windows Server 2003 Windows Server 2008 Figure 5-4. Browse for Folder 5.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Driver Installation and Verification 6. Click the Finish button on the final dialog box (Figure 5-6). Windows Server 2003 Windows Server 2008 Figure 5-6. Software Installation Complete To verify that the driver was properly installed: 1. On the Start menu, right-click My Computer, and then select Device Manager. A list of devices appears in right side of the window. 2.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Driver Configuration Windows Server Driver Configuration The QLogic adapter driver can be configured through the adapter properties in Device Manager. To access the Device Manager: 1. On the Start menu, right-click My Computer, and then select Device Manager. A list of devices appears in right side of the window. 2. Under Network Adapters, right-click the QLogic adapter (see Figure 5-7), and then select Properties.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Driver Configuration Advanced Tab Click the Advanced tab to display the driver properties (Figure 5-9). Windows Server 2003 Windows Server 2008 Figure 5-9.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Driver Configuration Table 5-1 describes the Advanced tab selections. Table 5-1. Advanced Properties Parameters Parameter Completion Queue Size Description This parameter indicates the size of the completion queue. Registry Key: CompletionQueueSize Default: 4 (16,384 entries). Values (entries): 0 (1024), 1 (2048), 2 (4096), 3 (8192), 4 (16,384), 5 (32,768) Flow Control This parameter sets flow control parameters.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Driver Configuration Table 5-1. Advanced Properties Parameters (Continued) Parameter Large Receive Offload (LRO) Description This parameter specifies the large receive offload — enable/disable options. Registry Key: LRO Default: Enabled Values: Enabled/Disabled Large Send Offload V1 IPv4 This parameter specifies the large send offload — enable/disable options.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Driver Configuration Table 5-1. Advanced Properties Parameters (Continued) Parameter Max Ethernet Frame Size Description This parameter specifies the Ethernet frame size for packet transmission and receive (it does not include the MAC header).
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Driver Configuration Table 5-1. Advanced Properties Parameters (Continued) Parameter Number of Transmit Buffers Description This parameter specifies the packet buffers used by the driver for transmit operations (DMA memory and indicated to stack). Each buffer is 1536 bytes.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Driver Configuration Table 5-1. Advanced Properties Parameters (Continued) Parameter Receive Side Scaling Rings Description This parameter controls the number of rings used. The total is calculated by 1KB ×2n with a value of 5 for a maximum of 32KB. Registry Key: MaxStatusRings Default: 2 Max: 4 Min: 1 Step: 1 TCP Checksum Offload IPv4 This parameter enables/disables the TCP checksum offload for IPv4.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Driver Configuration Table 5-1. Advanced Properties Parameters (Continued) Parameter Description UDP Checksum Offload IPv6 a This parameter enables/disables the UDP checksum offload. There are four UDP checksum options: 0 (off), 1 (transmit), 2 (receive), and 3 (transmit/receive).
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Driver Configuration Information Tab Click the Information tab for information about the firmware version, BIOS version, driver version, and other QLogic adapter properties (Figure 5-10). Windows Server 2003 Windows Server 2008 Figure 5-10.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Driver Configuration Diagnostics Tab Click the Diagnostics tab to test the QLogic adapter’s Flash, LED, and other functions (Figure 5-11). Windows Server 2003 Windows Server 2008 Figure 5-11.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Driver Configuration Statistics Tab Click the Statistics tab to view information about the QLogic adapter (Figure 5-12). Windows Server 2003 Windows Server 2008 Figure 5-12.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Driver Configuration Flash Update Tab Click the Flash update tab to view the current firmware version on the QLogic adapter and update the firmware if required (Figure 5-13). Windows Server 2003 Windows Server 2008 Figure 5-13.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Driver Configuration Driver Tab Click the Driver tab to view driver information and update, uninstall, or restore a previous version of the QLogic adapter driver (Figure 5-14). Windows Server 2003 Windows Server 2008 Figure 5-14.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Driver Configuration Resources Tab Click the Resources tab to view the resource settings for the QLogic adapter (Figure 5-15). Windows Server 2003 Windows Server 2008 Figure 5-15.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Configure the QLogic Adapter in Windows Server Configure the QLogic Adapter in Windows Server To enable the connections to the QLogic adapter: 1. Open the Network Connections window in the Control Panel, or directly from the desktop if the icon exists (Figure 5-16). Figure 5-16. Network Connections Window Note that if an IP address has not been assigned, the QLogic adapter entry says Limited or no connectivity.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Configure the QLogic Adapter in Windows Server 2. Assign an IP address manually by selecting the Internet Protocol (TCP/IP) entry, and then clicking the Properties button (Figure 5-17). Figure 5-17. Local Area Connection Properties Dialog Box The Internet Protocol (TCP/IP) Properties dialog box opens.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Uninstall the QLogic Adapter Driver in Windows Server 3. Assign the appropriate IP, subnet mask, and default gateway values In the Internet Protocol (TCP/IP) Properties dialog box (Figure 5-18), and then click the OK button. Figure 5-18. Internet Protocol (TCP/IP) Properties Dialog Box 4. Verify connectivity with another card or switch using the ping utility.
5–Windows Server 2003 and 2008 Driver Installation and Configuration QLogic Adapter Diagnostic Tests — Windows Server 5. Delete the following files for the corresponding directory. Windows Server 2003: nxcoinst.dll C:\WINDOWS\system32 nx3fwct.bin C:\WINDOWS\system32\drivers nx3fwmn.bin C:\WINDOWS\system32\drivers nxnd5x64.sys C:\WINDOWS\system32\drivers Windows Server 2008: a. Double-click Computer, navigate to the local disk (C:), and then to the Windows directory. b.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Performance Alternately, there is a Diagnostics tab in the QLogic adapter property sheet that can perform the same tests (Figure 5-19). Windows Server 2003 Windows Server 2008 Figure 5-19. Adapter Properties — Diagnostics Tab Windows Server Performance This section describes Windows performance tuning. NOTE: The tunable performance parameters are system and application specific.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Performance Performance Testing the QLogic Adapter with ntttcp To enhance Windows Server performance, change these parameters in the order listed. 1. Enable Windows Server scaling. Set the TCp1323Opts parameter value to 1. Note that this parameter is not created by default. For more information about modifying a previously created parameter, or creating a new parameter, see “Tcp1323Opts Parameter” on page 5-29. 2.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Performance c. Change the directory path to the location to where ntttcp was downloaded or copied. An example directory tree is shown in Figure 5-21. Figure 5-21. Location of ntttcp For scripts, see the tools package included with the release. ntttcp Overview There are two switches on ntttcp that boost performance: -a and -rb.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Performance ntttcps and ntttcpr Command Line Options The ntttcps and ntttcpr command line options are listed in Table 5-2. Table 5-2.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Performance Tcp1323Opts Parameter This parameter determines whether TCP uses the time-stamping and window scaling features described in RFC 1323, TCP Extensions for High Performance. For more efficient use of high bandwidth networks, use a larger TCP window size. The TCP window size field controls the flow of data and is limited to 2 bytes, or a window size of 65,535 bytes.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Performance Modifying the Tcp1323Opts Parameter If the parameter was created previously, it can be modified as follows: 1. On the Start menu, click Run. The Run dialog box opens. 2. Type regedit in Open: box (Figure 5-22), and then click the OK button. Figure 5-22. Run Window The Registry Editor window opens. 3. Click the HKEY_LOCAL_MACHINE directory (Figure 5-23). Figure 5-23.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Performance Creating the Tcp1323Opts Parameter If the TCp1323Opts parameter does not exist, it can be created as follows: 1. On the Start menu, click Run. The Run dialog box opens. 2. Type regedit in the Open: box, and then click the OK button (Figure 5-22). The Registry Editor window opens. 3. Click the HKEY_LOCAL_MACHINE directory (Figure 5-23). 4.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Performance 5. Right-click anywhere in the right side of the window and create a new key with a DWORD value (Figure 5-25). Figure 5-25. New Key — DWORD 6. Rename New Value #1 to TCp1323Opts (Figure 5-26). Figure 5-26. Creating Tcp1323Opts 7. Right-click TCp1323Opts, and then select Modify. In the Value data box, type 1 (the default value is 0), and then click the OK button. (Figure 5-27). Figure 5-27.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Performance 4. Navigate to the following directory path from the HKEY_LOCAL_MACHINE directory: HKEY_LOCAL_MACHINE SYSTEM CurrentControlSet Services Tcpip Parameters The Registry Editor window displays the parameters on the right side (Figure 5-24). 5. Right-click anywhere in the right side of the window and create a new key with a DWORD value (Figure 5-25). 6. Rename New Value #1 to TCpWindowSize. 7.
5–Windows Server 2003 and 2008 Driver Installation and Configuration Windows Server Performance Notes 5-34 NE0154601-00 A
6 Linux Driver Installation and Configuration This section describes the Linux driver installation and configuration procedure. For the Windows Server driver installation procedure, see Section 5.
6–Linux Driver Installation and Configuration Linux Driver Checklist Locate the Driver File The QLogic adapter driver is located at: SUSE: /lib/modules/[kernel version]/update/drivers/net Red Hat 5: /lib/modules/[kernel version]/update Red Hat 4: /lib/modules/[kernel version]/kernel/drivers/net Verify the Firmware Version Type the following commands to view the firmware version, where n is the port number: % ethtool -i eth[n] % dmesg | grep nx Verify the Driver Version and Module Informatio
6–Linux Driver Installation and Configuration Linux Driver Checklist NOTE: The commercial GPL version of the driver (nx_nic.ko) contains the most recent updates. To determine which driver to use: 1. See the Release Notes for more information about which Linux distributions contain the inbox kernel GPL driver. The driver name is: netxen_nic.ko 2. Type the following command to identify the netxen_nic.ko driver: % lsmod | grep netxen_nic Note that the netxen_nic.
6–Linux Driver Installation and Configuration Inbox Kernel GPL Driver and Blacklisting The output of this command is similar to the following: [root@apps4242 ~]# cat /proc/interrupts CPU0 CPU1 58: 164 7 PCI-MSI-X eth2 66: 0 0 PCI-MSI-X eth2:1 74: 6 0 PCI-MSI-X eth2:2 82: 0 0 PCI-MSI-X eth2:3 122: 3195 0 PCI-MSI-X eth3 130: 0 0 PCI-MSI-X eth3:1 138: 0 0 PCI-MSI-X eth3:2 146: 0 0 PCI-MSI-X eth3:3 NOTE: Some older Linux kernel versions may not support MSI-X.
6–Linux Driver Installation and Configuration Preparing for QLogic Adapter Driver Installation When the QLogic RPM binary package is installed, the inbox kernel GPL driver (netxen_nic.ko) is blacklisted. Consequently, when the system is powered up, the netxen_nic.ko driver will not load.
6–Linux Driver Installation and Configuration Linux QLogic Adapter Driver Options Create the Binary Type the following command to create the binary RPM for Red Hat systems: % rpmbuild -bb usr/src/redhat/SPECS/nx_nic-[version].spec Type the following command to create the binary RPM for SUSE systems: % rpmbuild -bb usr/src/packages/SPECS/nx_nic-[version].spec Install the Binary Type the following command to install the binary RPM for Red Hat systems: % rpm -i usr/src/redhat/RPMS/[arch]/nx_nic-[version].
6–Linux Driver Installation and Configuration Linux QLogic Adapter Driver Options The parameters are listed in Table 6-1. Table 6-1. modprobe Command Optional Parameters Parameter Description Default Range tx_desc Sets the size of the command descriptor rings (transmit). 1024 256–1024 (must be power of two) 1024 (x86 64 bit) 64–1024 (must be power of two) jumbo_desc_1g Sets the size of the receive ring for jumbo frames (1GbE ports).
6–Linux Driver Installation and Configuration Configure the QLogic Adapter on Linux Configure the QLogic Adapter on Linux To configure the QLogic adapter: 1. Type one of the following commands to identify the Ethernet interface (eth1, eth2, etc.) and the nx_nic driver from the command line: % cat /proc/net/nx_nic/dev0/stats | grep eth or % ifconfig -a Look for the interface with a MAC address (HWaddr) prefix of 00:0E:1E:XX:XX:XX 2.
6–Linux Driver Installation and Configuration Linux Performance Tuning NOTE: While running these tests, the network traffic will be interrupted. Linux Performance Tuning This section describes Linux performance tuning. NOTE: The tunable performance parameters are system and application specific.
6–Linux Driver Installation and Configuration Linux Performance Tuning Here is an example of iperf from the server side: % iperf -s -w lM -1 16k Here is an example of iperf from the client side: % iperf -c -w 1M -P12 -l 16k -P Optimization Note the following: 6-10 PCIe x8 provides optimal performance for 10GbE. MSI and MSI-X interrupts perform better than legacy interrupts. Linux kernel versions 2.6.15 or later provide better performance optimization.
7 Linux Configuration for Bonding Mode and Virtual LAN (VLAN) Linux Bonding Mode Ensure that the steps required for installing the RPM source, creating the binary, and installing the binary have been performed as described in “QLogic Adapter Driver Installation (RPM Format)” on page 6-5 before setting up Linux bonding mode.
7–Linux Configuration for Bonding Mode and Virtual LAN (VLAN) Linux Bonding Mode After bonding, the MAC addresses for the two ports that were bonded appear to be the same when running the ifconfig command. This is due to the formation of a bond to permit traffic to be passed between the ports. After the bond has been brought down and the bonding driver removed, the QLogic adapter’s original MAC addresses will resume on the ports.
7–Linux Configuration for Bonding Mode and Virtual LAN (VLAN) Linux Bonding Mode The output for this command is: MII Status: up (for eth15) Round-Robin or Mode=0 This mode implements a round-robin scheme between the two Ethernet ports. To set the round-robin mode, type the following command: % modprobe bonding mode=0 miimon=100 updelay=50000 primary=eth16 After the command is executed, both links delay for 50 seconds before their states are set to BOND_LINK_UP.
7–Linux Configuration for Bonding Mode and Virtual LAN (VLAN) Linux Bonding Mode The output for this command is: Ethernet Channel Bonding Driver: v3.0.
7–Linux Configuration for Bonding Mode and Virtual LAN (VLAN) Linux Bonding Mode arp_interval This parameter specifies the ARP link monitoring frequency in milliseconds. When ARP monitoring is used in an etherchannel compatible mode (modes 0 and 2), the switch must be configured in a mode that evenly distributes packets across all links.
7–Linux Configuration for Bonding Mode and Virtual LAN (VLAN) Linux Bonding Mode The bonding modes are described in Table 7-1. Table 7-1. Bonding Modes Mode Number Mode Name Description 0 balance-rr This mode uses a round-robin policy; it transmits packets in sequential order from the first available slave through the last. This mode provides load balancing and fault tolerance. 1 active-backup In this mode, one slave interface is active at any time.
7–Linux Configuration for Bonding Mode and Virtual LAN (VLAN) Configuring Virtual LAN (VLAN) Under Linux Configuring Virtual LAN (VLAN) Under Linux To configure the VLAN function: 1. Type the following command to see if the 8021q.ko driver has been loaded: % lsmod | grep 8021q Type the following command if the driver has not been loaded: % modprobe -v 8021q 2. The vconfig add command creates a VLAN device on eth0 and will, in turn, create an eth0.5 interface.
7–Linux Configuration for Bonding Mode and Virtual LAN (VLAN) Configuring Virtual LAN (VLAN) Under Linux Notes 7-8 NE0154601-00 A
8 Firmware Management This section describes the firmware download process. When the driver package is installed, the firmware files are installed onto the host operating system (OS). The dynamic firmware download takes place when the driver module is loaded. As the driver module is loaded, the firmware file downloaded from the host OS becomes the active firmware version on the QLogic adapter.
8–Firmware Management Linux Dynamic Firmware Download Check for the following entry: Active Firmware version: 4.0.
9 Troubleshooting Guidelines Unable to Boot the Host System with the QLogic Adapter Installed If the system does not boot after installing the QLogic adapter: 1. Remove the QLogic adapter and power up the system. Does the system boot without the QLogic adapter? If so, power down the system, insert the QLogic adapter into a different PCIe slot, and power up the system. 2. Ensure that the system BIOS configuration is up to date during the system boot up process. 3.
9–Troubleshooting Guidelines Troubleshooting Tools 5. 6. Check if the driver is loaded correctly and the card is initialized. Windows event viewer dmesg (display system messages on Linux) Check the network configuration. a. Check for a valid IP address and subnet. b. Check for duplicate IP address and subnet numbers. c. Check the gateway address and network path (if connected through a gateway). d. Check the QLogic adapter MAC address values. e.
9–Troubleshooting Guidelines Check for System Errors Table 9-1. Troubleshooting Tools in Windows Server (Continued) Tool What it Provides ipconfig ipconfig shows IP network settings; it also releases and renews by adapter or connection. Windows event log The Windows event log is the main source of information for device driver problems and events. The QLogic adapter ’s device drivers indicate status by logging events in the system event log.
9–Troubleshooting Guidelines Caveats Check network interface transmit and receive counts during pings using the following command: % ifconfig Use the wireshark, ethereal, tethereal, or tcpdump utilities to capture packets. Windows Server The following paragraphs describe how to check for system errors in Windows Server: Use the wireshark or ethereal utilities to capture packets. Check for system error messages using the Windows event viewer.
9–Troubleshooting Guidelines Caveats The QLogic vendor ID is 0x4040. A list of QLogic adapter device IDs is listed in Table 9-3. Table 9-3. QLogic Adapter Device IDs Product Device ID Description QLE3044 0124 Quad-port 1GbE copper interface QLE3142-CU 0126 Dual-port 10GbE with twinax interface QLE3142-SR 0126 Dual-port 10GbE with short range fiber interface QLE3142-LR 0126 Dual-port 10GbE with long range fiber interface Determine the interface attributes.
9–Troubleshooting Guidelines Windows Server 2003 RSS and SNP Support From the lspci hex output: c0: 10 00 02 00 02 80 00 00 00 10 0b 00 82 04 00 00 ||_________ capability. “82 04" = x8 PCIe Gen2 Note that some PCIe chip sets with a x16 link may not support a x8 PCI Express link width. A link is required to support only its maximum width and x1. Check the motherboard specification to determine if its PCIe x16 slot can autonegotiate to x8.
A Diagnostic Utility Commands Table A-1 lists user-level diagnostic utility commands for the Linux and Windows Server OSes. Table A-1. Diagnostic Utility Commands Command Description -i This command specifies the interface type (Local Area Connection 1, Local Area Connection 2, etc.). --interface -a This command performs all tests, regardless of the default. --all -D This command performs only the default test. --default -R This command tests all control registers (default).
A–Diagnostic Utility Commands Table A-1. Diagnostic Utility Commands (Continued) Command -nR --noCRegs -nF Description This command disables control register testing (use with -D or -a). This command disables Flash testing (use with -D or -a). --noFLASH -nl This command disables interrupt testing (use with -D or -a). --noIRQS -nL --noIntLB -nH This command disables internal loopback testing (use with -D or -a). This command disables hardware testing (use with -D or -a).
B Solaris Driver, nxflash Utility, and Firmware Installation QLogic Adapter Driver Installation To extract and install the Solaris QLogic adapter driver using the Sol_ntxn_1.7.tar.gz package: 1. Unzip the driver package file using the gunzip command. 2. Untar the driver package file using the tar xfp command. 3. Remove any previous driver version. a.
B–Solaris Driver, nxflash Utility, and Firmware Installation nxflash Utility and Firmware Files Installation nxflash Utility and Firmware Files Installation To extract and utilize the Solaris nxflash utility and firmware files using the Sol_ntxn__tools.tar.gz and Sol_nxtn__firmware_files.gz packages: 1. Unzip the firmware package using the gunzip command. 2. Untar the firmware package using the tar xfp command. 3. Unzip the tools package using the gunzip command. 4.
C Flash Update Under rare circumstances, it may be necessary update the Flash on the QLogic adapter. Read the Release Notes to see if a Flash update is required. If so, follow the instructions in this appendix. Flash Update and Tool Guidelines Consider the following before updating the Flash: During the Flash update process, do not reboot or stop the update process. A backup image of the existing Flash will be created at the start of the Flash update process.
C–Flash Update Flash Update Options You are prompted to answer Y(es) or N(o) to allow the upgrading of the Flash to continue. Press the Y key to continue. See “QLogic Adapter Flash Update — Windows Server” on page C-3 for more information. Linux Type the following command, where [n] indicates the number of the Ethernet device (0, 1, 2, etc.): ./nxflash -i [n] --all See “QLogic Adapter Flash Update — Linux” on page C-8 for more information. NX Live CD To install the NX Live CD: 1.
C–Flash Update QLogic Adapter Flash Update — Windows Server 3. 4. Format the USB flash device to a FAT file system (if required): a. Right-click the Start menu, and then click Explore. b. Right-click the USB flash drive, and then click Format. c. Format the USB flash drive to a FAT file system. Unzip the NX Live USB file into its own directory. a. Right-click the file and click Open With, and then click Compressed (zipped) Folders. b. Copy the two folders boot and slax onto the USB flash drive.
C–Flash Update QLogic Adapter Flash Update — Windows Server Using the Flash Utility When invoking the nxflash.exe utility, use the following syntax: nxflash -i “Local Area Connection n” --all In this command, the -i indicates the interface command and the “Local Area Connection n” specifies the adapter being flashed. (The quotation marks are required.) To determine the adapter number: 1. On the Start menu, right-click My Network Places. 2. Click Properties. The Network Connections window opens.
C–Flash Update QLogic Adapter Flash Update — Windows Server Table C-1. Flash Utility Commands — Windows Server (Continued) Command Definition --pxe-off PXE This command disables PXE. --wol-on WOL This command enables wake on LAN. --wol-off WOL This command disables wake on LAN (default). Create XML This command creates an XML file that contains QLogic adapter/firmware information. For Windows Server, the XML file will be in the current directory. Help This command displays the help menu.
C–Flash Update QLogic Adapter Flash Update — Windows Server Here is an example of the Windows Server nxflash --all output for local area connection 8: C:\netxen\4.0.223\utils>nxflash -i "Local Area Connection 8" --all NETXEN Port is Port 0 Verifying flash...Done. 0/9 - Init *** Currently in flash *** Board Type : Quad Gig LP Firmware Version : 4.0.
C–Flash Update QLogic Adapter Flash Update — Windows Server Here is an example of a Windows Server nxflash --info output for local area connection 0: C:\Users\Administrator\Desktop\4.0.223\utils>nxflash.exe -i “Local Area Connection 0” --info NETXEN Port is Port 0 Verifying flash...Done. Board Type : 0x24 (Quad Gig LP) Board Chip Rev : B1 Serial Id : QG87BK0092 Efuse ID : 0x4e36343633340f08 Firmware version (on Flash) : 4.0.228 Active Firmware version : 4.0.
C–Flash Update QLogic Adapter Flash Update — Linux To perform updates simultaneously from two different directory trees, type the following commands from two separate directory trees. In these commands, n represents two different port numbers, for example, “Local Area Connection 4” and “Local Area Connection 5” (the quotation marks are required). c:\[version]-a\utils\ nxflash.exe -i “Local Area Connection n” --all (first QLogic adapter) c:\[version]-b\utils\ nxflash.
C–Flash Update QLogic Adapter Flash Update — Linux Table C-2. Flash Utility Commands — Linux (Continued) Command Definition -a Flash update This command performs a complete update of the BIOS and Flash using a user-renamed ROM image. See the Release Notes for a listing of image files and their proper syntax. Restore When an update is performed, the previous firmware version is stored to a file in the current working directory.
C–Flash Update QLogic Adapter Flash Update — Linux Flash Update Procedure To update the Linux OS Flash: 1. Ensure that the steps required for installing the RPM source, creating the binary, and installing the binary to the file system have been performed. If not, follow the instructions in “QLogic Adapter Driver Installation (RPM Format)” on page 6-5 before proceeding. The new driver is now ready to be loaded automatically the next time the system is powered up. 2. Update the Flash. a.
C–Flash Update QLogic Adapter Flash Update — Linux Here is an example of a Linux nxflash output: # ./nxflash -i 0 --info NIC driver will be temporarily unloaded Closing interfaces: eth2 eth3 PCIE Function Number is 0 Verifying flash...Done. Board Type Server Adapter) : 0x26 (NetXen NX3031 Dual Port SFP+ 10GbE Board Chip Rev : B1 Serial Id : SF8DBK0145 Efuse ID : 0x0000000000000000 Firmware version(on Flash) : 4.0.304 BIOS version : 2.1.
C–Flash Update QLogic Adapter Flash Update — Linux Notes C-12 NE0154601-00 A
Glossary dbgview.exe Debug viewer for Windows Server dmesg Linux system messages Ethtool utility Linux Ethernet tool for card settings; See man ethtool in Linux iperf Linux performance tool iSCSI Internet small computer system interface. Protocol that encapsulates data into IP packets to send over Ethernet connections. An alternative to FCIP. LED Light emitting diode Status indicator on a device.
QLogic 3000 and 3100 Series Intelligent Ethernet Adapters Users Guide Version 4.6 romimage QLogic firmware image for a QLogic 3000 or 3100 Series Intelligent Ethernet adapter RPM Software package file format RSS Receive side scaling SFP+ Small form factor pluggable + A 1-/10-Gbps transceiver device (smaller than a gigabit interface converter) that plugs into the Ethernet port.
Index A -a A-1, C-4, C-8 -a C-4, C-9 Active-backup mode 7-2 Adapter properties Advanced tab 5-8 Diagnostics tab 5-16 Driver tab 5-19, 9-2 Flash update tab 5-18 General tab 5-7 Information tab 5-15 Resources tab 5-20 Statistics tab 5-17 Adapters supported 1-2 Advanced tab, adapter properties 5-8 --all A-1, C-4, C-8 --all C-4, C-9 Application notes 1-2 arp_interval 7-5 arp_ip_target 7-5 Audience ix B Binary RPM in Linux 6-6 Bonding driver options 7-4 driver parameters 7-4 mode, Linu
QLogic 3000 and 3100 Series Intelligent Ethernet Adapters Users Guide Version 4.
QLogic 3000 and 3100 Series Intelligent Ethernet Adapters Users Guide Version 4.
QLogic 3000 and 3100 Series Intelligent Ethernet Adapters Users Guide Version 4.
QLogic 3000 and 3100 Series Intelligent Ethernet Adapters Users Guide Version 4.
QLogic 3000 and 3100 Series Intelligent Ethernet Adapters Users Guide Version 4.
Corporate Headquarters QLogic Corporation 26650 Aliso Viejo Parkway Aliso Viejo, CA 92656 949.389.6000 Europe Headquarters QLogic (UK) LTD. Quatro House Lyon Way, Frimley Camberley Surrey, GU16 7ER UK www.qlogic.com +44 (0) 1276 804 670 © 2009 QLogic Corporation. Specifications are subject to change without notice. All rights reserved worldwide. QLogic and the QLogic logo are registered trademarks of QLogic Corporation. Finisar is a registered trademark of Finisar Corporation.
