user manual

ManualsBrandsQ-Logic ManualsNetwork HardwareQLogic Network Hardware 3000

NE0154601-00 C

User’s Guide

Networking

3000/3100 Series

Summary of content (120 pages)

PAGE 1
User’s Guide Networking 3000/3100 Series NE0154601-00 C
PAGE 2
User’s Guide—Networking 3000/3100 Series Information furnished in this manual is believed to be accurate and reliable. However, QLogic Corporation assumes no responsibility for its use, nor for any infringements of patents or other rights of third parties which may result from its use. QLogic Corporation reserves the right to change product specifications at any time without notice. Applications described in this document for any of these products are for illustrative purposes only.
PAGE 3
Table of Contents Preface Intended Audience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Related Materials . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Documentation Conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Technical Support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Availability . . . . . . . . . . . . . . . . . . . . . . . . . . .
PAGE 4
User’s Guide—Networking 3000/3100 Series Install the Driver (RPM) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Red Hat® . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . SUSE®. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . QLogic Adapter Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 Hardware Installation QLE3044 Installation . . . . . . . . . . . . . . . . . . . . . . .
PAGE 5
User’s Guide—Networking 3000/3100 Series ntttcp Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ntttcps and ntttcpr Command Line Options . . . . . . . . . . . . . . . . Tcp1323Opts Parameter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Modifying the Tcp1323Opts Parameter . . . . . . . . . . . . . . . . . . Creating the Tcp1323Opts Parameter . . . . . . . . . . . . . . . . . . . Setting the TcpWindowSize Parameter . . . . . . . . . . . . . . .
PAGE 6
User’s Guide—Networking 3000/3100 Series Bonding Driver Parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . arp_interval . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . arp_ip_target . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . downdelay . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . lacp_rate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
PAGE 7
User’s Guide—Networking 3000/3100 Series QLogic Adapter Flash Update—Linux . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Using the Flash Utility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Flash Update Procedure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . B-8 B-8 B-10 Glossary Index List of Figures Figure Page 4-1 QLE3044 Port Assignments. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
PAGE 8
User’s Guide—Networking 3000/3100 Series 7-5 7-6 7-7 7-8 7-9 7-10 7-11 7-12 7-13 7-14 7-15 Adapter Properties—Diagnostics Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Run Dialog Box . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Location of ntttcp . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Run Window. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
PAGE 9
Preface Intended Audience This guide is for system administrators and end-users of the QLogic 3000 and 3100 Series Intelligent Ethernet adapters. Related Materials  Linux® man page % man nx_nic  nxudiag utility help (diagnostics)   nxudiag -h or nxudiag --help (Windows®)  % ./nxudiag -h or nxudiag --help (Linux®) Check the QLogic Web site for updates. Documentation Conventions This guide uses the following documentation conventions:  NOTE: provides additional information.
PAGE 10
Preface Technical Support   Text in Courier font indicates a file name, directory path, command, or screen text. For example:  nx3fwct.bin  C:\WINDOWS\system32\drivers Text in Bold Courier font indicates a command to enter that performs a specific task. For example:  rpm -iv nx_nic-[version].src.rpm The italic text (version) indicates a variable.  A percent sign (%) is the cursor prompt when executing Linux commands.
PAGE 11
Preface Technical Support Training QLogic offers training for technical professionals for all iSCSI, InfiniBand, Fibre Channel, and Intelligent Ethernet products. From the main QLogic Web page at www.qlogic.com, click the Education and Resources tab at the top, then click the Education & Training tab on the left. The QLogic Global Training Portal offers online courses, certification exams, and scheduling of in-person training.
PAGE 12
Preface Technical Support xii NE0154601-00 C
PAGE 13
1 Overview This guide describes the system requirements, installation, and setup required for the QLogic 3000 and 3100 Series Intelligent Ethernet adapters listed in Table 1-1. Obtaining the Latest Software Release Information To download the latest version of the drivers for this product, see the QLogic Web site Downloads section: http://driverdownloads.qlogic.com. QLogic 3000 and 3100 Series Intelligent Ethernet Adapters The products in Table 1-1 are supported in this document. Table 1-1.
PAGE 14
1–Overview QLogic 3000 and 3100 Series Intelligent Ethernet Adapters 1-2 NE0154601-00 C
PAGE 15
2 System Requirements Before installing the QLogic adapter, make sure your system meets the requirements listed in this section:  “Hardware Requirements” on page 2-1  “Supported QLogic Adapters” on page 2-2 Hardware Requirements Cable Specifications Make sure the cables you are using meet the specifications listed in Tables 2-1 and 2-2. Table 2-1.
PAGE 16
2–System Requirements Supported QLogic Adapters Table 2-2. Cable Specifications—Copper Product Cable Type Network Type Cable Length (meters) QLE3044-RJ Cat5 LAN 100 QLE3142-CU Copper direct attach twinax LAN 10 SFP+ Optical Module Requirements Use only the optical modules validated and shipped with the QLogic adapter. Supported QLogic Adapters Make sure you have one of the adapters listed in Table 1-1.
PAGE 17
3 Quick Start This section provides instructions for advanced users who are already familiar with hardware and software installation procedures. See the appropriate section, as applicable:  “QLogic Adapter Installation and Verification” on page 3-1  “Windows Server Driver Installation” on page 3-2  “Linux Driver Installation” on page 3-4 QLogic Adapter Installation and Verification The following sections provide high-level instructions for installing the QLogic adapter.
PAGE 18
3–Quick Start Windows Server Driver Installation Verify the QLogic Adapter Installation To verify that the QLogic adapter has been installed correctly, perform the steps in the appropriate section. Linux On Linux systems, execute the following command: # lspci -vvv -d 4040: Windows Server® On Windows Server systems, perform the following steps: 1. 2. Do one of the following:  For Windows 2003, right-click My Computer, and then click Manage. The Computer Management window opens.
PAGE 19
3–Quick Start Windows Server Driver Installation Windows Server 2003 To install the QLogic adapter driver: 1. From the Windows desktop, right-click My Computer. On the shortcut menu, select Manage. The Computer Management window opens. 2. Select Computer Management, select System Tools, and then select Device Manager. 3. Right-click the server’s host name and select Scan for hardware changes. 4. When prompted to connect to Windows Update, Click No, not at this time, and then click Next. 5.
PAGE 20
3–Quick Start Linux Driver Installation 4. Follow the instructions on the screen to complete the installation. For more details on the Windows Server 2008 driver installation, refer to “Windows Server 2008 NIC Driver Installation” on page 6-2. To configure the QLogic adapter: 1. Click the Start button, and then select Network Connections. 2. Verify that QLogic adapter icon says Connected. 3. Assign an IP address to the network interface.
PAGE 21
3–Quick Start Linux Driver Installation 2. Type the following command to install the RPM source: rpm -iv nx_nic-[version].src.rpm 3. Type the following command to build the binary RPM: rpmbuild -bb /usr/src/redhat/SPECS/nx_nic-[version].spec 4. Type the following command to install the binary RPM: rpm -ivh /usr/src/redhat/RPMS/[arch]/nx_nic-[version].[arch].rpm The [arch] variable designates the system architecture. Some [arch] variables are i386, i586, i686, x86_64, depending on the system. 5.
PAGE 22
3–Quick Start Linux Driver Installation QLogic Adapter Configuration To configure the QLogic adapter: 1. Type the following command to identify the Ethernet interface: cat /proc/net/nx_nic/dev0/stats 2.
PAGE 23
4 Hardware Installation This section provides installation instructions for the QLogic adapters. Please follow all applicable ESD precautions when handling the QLogic adapter. QLE3044 Installation To install the QLE3044: 1. Verify that the system is powered off and unplug the power cord. 2. Remove the system cover. 3. Locate an empty x4 or higher PCIe® slot. 4. Insert the QLE3044 into the PCIe slot. Apply uniform pressure on top of the QLE3044 until it is firmly seated in the PCIe bus connector.
PAGE 24
4–Hardware Installation QLE3044 Installation Ethernet Port Mapping The mapping of port numbers on the QLE3044 is shown in Table 4-1. Table 4-1. Mapping of Port Number, PCI Function, and Ethernet Interface Port Number PCI Function 1 0 2 1 3 2 4 3 Ethernet Interface Ethernet interface numbers are dynamically allocated by the host. As such, any eth[n] interface can be connected to any port. QLE3044 Status LEDs The QLE3044 has two status LEDs per port.
PAGE 25
4–Hardware Installation QLE3044 Installation QLE3044 Bracket Removal and Replacement Depending on the type of system, installation of the QLE3044 requires either a long bracket or a short bracket. QLogic provides both of these brackets with the product. The brackets for the QLE3044 are different from previous brackets in that they slide over the top of the four RJ45 Ethernet jacks. To remove and replace the bracket: 1. Remove the screw at the top of the QLE3044 that holds the bracket in place. 2.
PAGE 26
4–Hardware Installation QLE3142 Installation QLE3142 Installation To install the QLE3142: 1. Verify that the system is powered down and unplug the power cord. 2. Remove the system cover. 3. Locate an empty PCIe x8 slot. 4. Remove the SFP+ optical modules from the QLE3142 if they are already inserted (see Figure 4-5). Bracket Ensure hinge is in upright position when inserting module. When the module is inserted correctly, an audible ‘clicking’ sound will be heard.
PAGE 27
4–Hardware Installation QLE3142 Installation NOTE: The optical module must be seated correctly in the housing to ensure proper operation. QLE3142 Status LEDs The QLE3142 has two status LEDs per port, one for link status and one for activity. These LEDs are located next to the ports as shown in Figure 4-6. Both SFP+ ports operate at 10Gbps. Mounting bracket Port 2 Port 1 Top of card Link Activity Link Activity PCIe connector end Figure 4-6.
PAGE 28
4–Hardware Installation QLE3142 Installation 2. Remove the two screws at the top and bottom of the QLE3142 that hold the bracket in place. 3. Gently pull the bracket away from the QLE3142 until it disconnects from the optical module housings. 4. To replace with a different bracket, reverse the process, sliding the new bracket over the module housings (see Figure 4-8). Note that the screw mounting tabs on the bracket go on the solder side of the QLE3142. Fasten the bracket in place with the two screws.
PAGE 29
5 Windows Server 2003 Driver Installation This section describes the installation and configuration procedure for the QLogic adapter NIC driver on a Windows Server 2003 operating system (OS). For Windows Server 2008 driver installation instructions, see Section 6. For Linux driver installation instructions, see Section 8. Driver Checklist Before installing the QLogic adapter NIC driver on a Windows Server 2003 OS: 1. Download the driver package from the QLogic Web site, http://driverdownloads.qlogic.
PAGE 30
5–Windows Server 2003 Driver Installation Windows Server NIC Driver Installation and Verification Windows Server NIC Driver Installation and Verification The following subsections describe the installation and verification procedures for Windows Server 2003. Windows Server 2003 NIC Driver Installation The following procedure is for a new NIC driver installation. 1. Extract the QLogic adapter NIC driver release package to a directory on the host.
PAGE 31
5–Windows Server 2003 Driver Installation Windows Server NIC Driver Installation and Verification 2. Click No, not at this time, and then click Next. The wizard opens another dialog box prompting for NIC driver location information (Figure 5-2). Figure 5-2. Windows Server 2003—NIC Driver Location Information 3. Click Install from a list or specific location (Advanced), and then click Next. A dialog box opens, prompting for more information about the NIC driver location (Figure 5-3). Figure 5-3.
PAGE 32
5–Windows Server 2003 Driver Installation Windows Server NIC Driver Installation and Verification  If the exact directory path is not known, click Browse. The Browse for Folder dialog box opens (Figure 5-4). Figure 5-4. Windows Server 2003—Browse for Folder a. Select the QLogic adapter NIC driver directory. b. Select the appropriate directory (x86 or x64), and then click OK. The QLogic adapter supports both 32-bit and 64-bit OSs. The x86 directory contains the 32-bit NIC driver.
PAGE 33
5–Windows Server 2003 Driver Installation Windows Server NIC Driver Installation and Verification When the installation completes, the Completing the Hardware Update Wizard dialog box opens (Figure 5-6). Figure 5-6. Windows Server 2003—Software Installation Complete 7. Click Finish. Windows Server 2003 NIC Driver Installation Verification To verify that the NIC driver was properly installed: 1. Click the Start button, right-click My Computer, and then select Device Manager.
PAGE 34
5–Windows Server 2003 Driver Installation Uninstall the NIC Driver Uninstall the NIC Driver To uninstall the QLogic adapter NIC driver in Windows Server 2003: 1. Right-click My Computer, and then click Manage. 2. Double-click Device Manager. Under Network Adapters, a list of devices in the computer is displayed. 3. Locate and right-click the QLogic adapter. 4. Click Uninstall. The Confirm Device Removal dialog box opens. 5. Click OK. 6.
PAGE 35
6 Windows Server 2008 and 2008 R2 Driver Installation This section describes the installation and configuration procedure for the QLogic adapter NIC driver and Teaming driver on Windows Server 2008 and 2008 R2 operating systems (OSs). For Windows Server 2003 NIC driver installation instructions, see Section 5. For Linux NIC driver installation instructions, see Section 8. Driver Checklist Before installing the QLogic adapter NIC or Teaming driver on a Windows Server 2008 OS: 1.
PAGE 36
6–Windows Server 2008 and 2008 R2 Driver Installation Windows Server 2008 NIC Driver Installation and Verification Windows Server 2008 NIC Driver Installation and Verification Windows Server 2008 NIC Driver Installation To install the NIC driver: 1. Navigate to the Install_Packages directory in the new NIC driver package. 2. Extract the driver by running the appropriate self-extracting executable: 3.  q3w32n6[version].exe  q3wx64n6[version].exe  q3ws8R2x64n6[version].
PAGE 37
6–Windows Server 2008 and 2008 R2 Driver Installation Windows Server 2008 NIC Driver Installation and Verification The License Agreement dialog box opens (see Figure 6-2). Figure 6-2. Windows Server 2008—License Agreement 5. Read the License Agreement. Click I Agree, and then click Next. The QLogic Advanced Network Config Service dialog box opens (see Figure 6-3). Figure 6-3. Windows Server 2008 — Installation Options 6.
PAGE 38
6–Windows Server 2008 and 2008 R2 Driver Installation Windows Server 2008 NIC Driver Installation and Verification The Select Installation Folder dialog box opens (see Figure 6-4). Figure 6-4. Windows Server 2008—Select Installation Folder 7. Change the installation folder (if required), and then click Next. The Confirm Installation dialog box opens (see Figure 6-5). Figure 6-5. Windows Server 2008—Confirm Installation 8. 6-4 Click Next to begin the installation.
PAGE 39
6–Windows Server 2008 and 2008 R2 Driver Installation Windows Server 2008 NIC Driver Installation and Verification At the end of the installation process, the Installation Complete dialog box opens (Figure 6-6). Figure 6-6. Windows Server 2008—Installation Complete 9. Click Close to complete the installation. Windows Server 2008 NIC Driver Installation Verification To verify that the NIC driver was properly installed: 1. Click the Start button, right-click My Computer, and then select Device Manager.
PAGE 40
6–Windows Server 2008 and 2008 R2 Driver Installation Windows Server 2008 and 2008 R2 Teaming Driver Installation and Configuration Windows Server 2008 and 2008 R2 Teaming Driver Installation and Configuration The following subsections describe how to install and configure the Windows Server 2008 intermediate (Teaming) driver.
PAGE 41
6–Windows Server 2008 and 2008 R2 Driver Installation Windows Server 2008 and 2008 R2 Teaming Driver Installation and Configuration If the base NIC driver was installed the first time the driver package was installed (see the Typical Installation option in Figure 6-3), then you need to re-install the driver to include Teaming: 1. Repeat Steps 1 through 5 from “Windows Server 2008 NIC Driver Installation and Verification” on page 6-2.
PAGE 42
6–Windows Server 2008 and 2008 R2 Driver Installation Windows Server 2008 and 2008 R2 Teaming Driver Installation and Configuration Windows Server 2008 and 2008 R2 Teaming Driver Configuration After the Teaming driver is installed, the Local Area Connection Properties dialog box includes the QLogic Advanced Network Configuration Service option, as shown in Figure 6-10. Figure 6-10.
PAGE 43
6–Windows Server 2008 and 2008 R2 Driver Installation Windows Server 2008 and 2008 R2 Teaming Driver Installation and Configuration Follow these steps to configure Teaming for the QLogic adapter: 1. Click the Start button, point to Programs, point to QLOGIC Corporation, and then select NxTeamingUI. The QLogic Advanced Networking Config Service Window opens (see Figure 6-11). Figure 6-11.
PAGE 44
6–Windows Server 2008 and 2008 R2 Driver Installation Windows Server 2008 and 2008 R2 Teaming Driver Installation and Configuration 2. Right-click Teams, and then click Create Team (Figure 6-12). Figure 6-12. Windows Server 2008 Teaming—Creating a Team NOTE: For more help, see the information in the Status box.
PAGE 45
6–Windows Server 2008 and 2008 R2 Driver Installation Windows Server 2008 and 2008 R2 Teaming Driver Installation and Configuration After selecting Create Team, the Create Team dialog box opens (Figure 6-12). Figure 6-13. Windows Server 2008 Teaming—Create Team Window NOTE: For more help, see the information in the Message box. 3. Select the check boxes for the QLogic adapter ports to be Teamed, and then click OK (Figure 6-13). A progress bar appears as the Team is being created (Figure 6-14).
PAGE 46
6–Windows Server 2008 and 2008 R2 Driver Installation Windows Server 2008 NIC Driver Uninstall (Previous Version) 4. Verify the Team creation. When the Team creation is complete, the Teaming Management tab in the QLogic Advanced Network Configuration Service dialog box shows the formed Team (Figure 6-15). Figure 6-15. Windows Server 2008 Teaming—Team Management Window NOTE: For more help, see the information in the How-to box.
PAGE 47
6–Windows Server 2008 and 2008 R2 Driver Installation Windows Server 2008 NIC and Teaming Driver Uninstall Under Network adapters, locate the QLogic adapters. 3. Right-click the adapters to be uninstalled, and then select the Uninstall option for each device to be uninstalled. 4. If prompted, select Delete the driver software from this device. 5. In the Confirm Device Uninstall dialog box, click OK. 6.
PAGE 48
6–Windows Server 2008 and 2008 R2 Driver Installation Windows Server 2008 NIC and Teaming Driver Uninstall 6-14 NE0154601-00 C
PAGE 49
7 Windows Server 2003, 2008, and 2008 R2 Driver Configuration This section describes how to program your QLogic adapter and maximize its performance in the Windows Server 2003, 2008, and 2008 R2 OSs.
PAGE 50
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration NIC Driver Properties and Configuration The advanced properties window has the following tabs:  The General tab is in front (Figure 7-1). Windows Server 2003 Windows Server 2008 Figure 7-1.
PAGE 51
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration NIC Driver Properties and Configuration  The Advanced tab displays the driver properties. Table 7-1 describes the Advanced tab selections. Table 7-1. Advanced Properties Parameters Parameter Completion Queue Size Description This parameter indicates the size of the completion queue.  Registry Key: CompletionQueueSize  Default: 4 (16,384 entries).
PAGE 52
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration NIC Driver Properties and Configuration Table 7-1. Advanced Properties Parameters (Continued) Parameter Large Receive Offload (LRO) Description This parameter specifies the large receive offload—enable/disable options.  Registry Key: LRO  Default: Enabled  Values: Enabled/Disabled Large Send Offload V1 IPv4 This parameter specifies the large send offload—enable/disable options.
PAGE 53
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration NIC Driver Properties and Configuration Table 7-1. Advanced Properties Parameters (Continued) Parameter Max Ethernet Frame Size Description This parameter specifies the Ethernet frame size for packet transmission and receive (it does not include the MAC header).
PAGE 54
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration NIC Driver Properties and Configuration Table 7-1. Advanced Properties Parameters (Continued) Parameter Number of Transmit Buffers Description This parameter specifies the packet buffers used by the driver for transmit operations (DMA memory and indicated to stack). Each buffer is 1536 bytes.
PAGE 55
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration NIC Driver Properties and Configuration Table 7-1. Advanced Properties Parameters (Continued) Parameter Receive Side Scaling Rings Description This parameter controls the number of rings used. The total is calculated by 1KB 2n with a value of 5 for a maximum of 32KB.  Registry Key: MaxStatusRings  Default: 2  Max: 4  Min: 1  Step: 1 TCP Checksum Offload IPv4 This parameter enables/disables the TCP checksum offload for IPv4.
PAGE 56
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration NIC Driver Properties and Configuration Table 7-1. Advanced Properties Parameters (Continued) Parameter UDP Checksum Offload IPv4 Description This parameter enables/disables the UDP checksum offload.
PAGE 57
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration QLogic Adapter Configuration  The Information tab contains information about the firmware version, BIOS version, driver version, and other QLogic adapter properties.  The Diagnostics tab tests the QLogic adapter’s Flash, LED, and other functions.  The Statistics tab displays information about the QLogic adapter.  The Flash update tab displays the current firmware version on the QLogic adapter.
PAGE 58
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration QLogic Adapter Configuration If there is a red X next to QLogic adapter icon, the link is down. In this case, do the following: a. Verify that the card is seated properly in the PCI slot. b. Make sure that the network cable is connected properly at both ends. c. Make sure that the cable is good. d. Assign an IP address to the interface if you have not already. e. Verify that the SFP+ module is installed correctly (QLE3142).
PAGE 59
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration QLogic Adapter Diagnostic Tests The Internet Protocol (TCP/IP) Properties dialog box opens (Figure 7-4). Figure 7-4. Internet Protocol (TCP/IP) Properties Dialog Box 4. Assign the appropriate IP, subnet mask, and default gateway values in the Internet Protocol (TCP/IP) Properties dialog box, and then click OK. 5. Verify connectivity with another card or switch using the ping utility.
PAGE 60
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration QLogic Adapter Diagnostic Tests Alternately, there is a Diagnostics tab in the QLogic adapter property sheet that can perform the same tests (Figure 7-5). Windows Server 2003 Windows Server 2008 Figure 7-5.
PAGE 61
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration Windows Server 2003 Performance Windows Server 2003 Performance This section describes Windows performance tuning. NOTE: The tunable performance parameters are system and application specific. Understanding the relationship between the parameter values, target workload, performance applications, operating system, and system configuration provides a better understanding of performance optimization and bottlenecks.
PAGE 62
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration Windows Server 2003 Performance 3. Run ntttcp. a. Click the Start button, and then click Run. The Run dialog box opens. b. Type cmd in the Open: box, and then click OK (Figure 7-6). Figure 7-6. Run Dialog Box c. Change the directory path to the location where ntttcp was downloaded or copied. An example directory tree is shown in Figure 7-7. Figure 7-7. Location of ntttcp For scripts, see the tools package included with the release.
PAGE 63
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration Windows Server 2003 Performance For the receive side, the optimal value is 16 for -a and 512,000 for -rb (or something similar). With these values, a single thread should perform closer to a multi-thread configuration. From a DOS command prompt, type the following command. Note that the command must be executed from the same directory in which the executable files are located.
PAGE 64
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration Windows Server 2003 Performance Table 7-2. ntttcps and ntttcpr Command Line Options (Continued) Command Default Notes -fr — Full buffers posted on read operations. -mb — Multiple buffer post mode -m — mapping is a session or sessions, processor, receiver, and IP set. The following example sets up four sessions on processor 0 to test a network on 1.2.3.4: -m 4,0,1.2.3.
PAGE 65
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration Windows Server 2003 Performance Table 7-4. Range Hex Value Meaning 0 Timestamps and window scaling are disabled. 1 Window scaling is enabled. 2 Timestamps are enabled. 3 Timestamps and window scaling are enabled. To modify the scale factor, set Tcp1323Opts to 1. Note that this parameter is not created by default. To modify a previously created parameter, see “Modifying the Tcp1323Opts Parameter” on page 7-17.
PAGE 66
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration Windows Server 2003 Performance 4. Navigate to the following directory path from the HKEY_LOCAL_MACHINE directory: HKEY_LOCAL_MACHINE SYSTEM CurrentControlSet Services Tcpip Parameters 5. Locate the TCp1323Opts entry and change the value to 1. Creating the Tcp1323Opts Parameter If the TCp1323Opts parameter does not exist, it can be created as follows: 1. Click the Start button, and then click Run. The Run dialog box opens. 2.
PAGE 67
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration Windows Server 2003 Performance The Registry Editor window displays the parameters on the right side (Figure 7-10). Figure 7-10. Registry Editor—Parameter Directory 5. Right-click anywhere in the right side of the window and create a new key with a DWORD value (Figure 7-11). Figure 7-11. New Key—DWORD 6. Rename New Value #1 to TCp1323Opts (Figure 7-12). Figure 7-12.
PAGE 68
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration Windows Server 2003 Performance 7. Right-click TCp1323Opts, and then click Modify. In the Value data box, type 1 (the default value is 0), and then click OK. (Figure 7-13). Figure 7-13. Edit DWORD Value Window—Tcp1323Opts Parameter Setting the TcpWindowSize Parameter NOTE: This parameter is only for Windows Server 2003. To set the TcpWindowSize parameter: 1. Click the Start button, and then click Run. The Run dialog box opens. 2.
PAGE 69
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration Windows Server 2003 Performance 7. Right-click TcpWindowSize, and then click Modify (Figure 7-14). Figure 7-14. Modifying the TcpWindowSize Parameter The Edit DWORD Value dialog box opens. 8. Type a the value in the Value data: box: either 200000 hexadecimal or 2,097,152 decimal. Be sure to select either the Hexadecimal or Decimal button in the Base section depending on the value entered (Figure 7-15). Figure 7-15.
PAGE 70
7–Windows Server 2003, 2008, and 2008 R2 Driver Configuration Windows Server 2003 Performance 7-22 NE0154601-00 C
PAGE 71
8 Linux Driver Installation and Configuration This section describes the Linux driver installation and configuration procedure. For the Windows Server 2003 driver installation procedure, see Section 5. For the Windows Server 2008 driver installation procedure, see Section 6.
PAGE 72
8–Linux Driver Installation and Configuration Linux Driver Checklist Locate the Driver File The QLogic adapter driver is located at:  SUSE: /lib/modules/[kernel version]/update/drivers/net  Red Hat 5: /lib/modules/[kernel version]/update  Red Hat 4: /lib/modules/[kernel version]/kernel/drivers/net Verify the Firmware Version Type the following commands to view the firmware version, where n is the port number: % ethtool -i eth[n] % dmesg | grep nx Verify the Driver Version and Module Informatio
PAGE 73
8–Linux Driver Installation and Configuration Linux Driver Checklist NOTE: The commercial GPL version of the driver (nx_nic.ko) contains the most recent updates. To determine which driver to use: 1. The driver name is: netxen_nic.ko 2. Type the following command to identify the netxen_nic.ko driver: % lsmod | grep netxen_nic NOTE: The netxen_nic.ko file is automatically blacklisted when the Linux commercial GPL driver RPM is installed. 3. To disable the inbox kernel GPL driver (netxen_nic.ko): a.
PAGE 74
8–Linux Driver Installation and Configuration Inbox Kernel GPL Driver and Blacklisting The output of this command is similar to the following: [root@apps4242 ~]# cat /proc/interrupts CPU0 CPU1 58: 164 7 PCI-MSI-X eth2 66: 0 0 PCI-MSI-X eth2:1 74: 6 0 PCI-MSI-X eth2:2 82: 0 0 PCI-MSI-X eth2:3 122: 3195 0 PCI-MSI-X eth3 130: 0 0 PCI-MSI-X eth3:1 138: 0 0 PCI-MSI-X eth3:2 146: 0 0 PCI-MSI-X eth3:3 NOTE: Some older Linux kernel versions may not support MSI-X.
PAGE 75
8–Linux Driver Installation and Configuration Preparing for QLogic Adapter Driver Installation The following sections describe how to install a new driver. Preparing for QLogic Adapter Driver Installation Check for prior versions of the QLogic adapter driver and tools. Remove the packages from the system to prepare for installing the new release. Use RPM to check for prior packages.
PAGE 76
8–Linux Driver Installation and Configuration Linux QLogic Adapter Driver Options Type the following command to install the binary RPM for SUSE systems: % rpm -i usr/src/packages/RPMS/[arch]/nx_nic-[version].[arch].rpm In these commands, the [arch] variable designates the system architecture. Some [arch] variables include i386, i586, i686, x86_64, depending on the system.
PAGE 77
8–Linux Driver Installation and Configuration Linux QLogic Adapter Driver Options The parameters are listed in Table 8-1. Table 8-1. modprobe Command Optional Parameters Parameter Description Default Range tx_desc Sets the size of the command descriptor rings (transmit). 1024 256–1024 (must be power of two) 1024 (x86 64-bit) 64–1024 (must be power of two) jumbo_desc_1g Sets the size of the receive ring for jumbo frames (1GbE ports).
PAGE 78
8–Linux Driver Installation and Configuration Configure the QLogic Adapter on Linux Configure the QLogic Adapter on Linux To configure the QLogic adapter: 1. Type one of the following commands to identify the Ethernet interface (eth1, eth2, etc.) and the nx_nic driver from the command line: % cat /proc/net/nx_nic/dev0/stats | grep eth or % ifconfig -a Look for the interface with a MAC address (HWaddr) prefix of 00:0E:1E:XX:XX:XX 2.
PAGE 79
8–Linux Driver Installation and Configuration Linux Performance Tuning NOTE: While running these tests, the network traffic will be interrupted. Linux Performance Tuning This section describes Linux performance tuning. NOTE: The tunable performance parameters are system and application specific.
PAGE 80
8–Linux Driver Installation and Configuration Linux Performance Tuning Here is an example of iperf from the server side: % iperf -s -w lM -1 16k Here is an example of iperf from the client side: % iperf -c -w 1M -P12 -l 16k -P Optimization Note the following: 8-10  PCIe x8 provides optimal performance for 10GbE.  MSI and MSI-X interrupts perform better than legacy interrupts.  Linux kernel version 2.6.15 and higher provide better performance optimization.
PAGE 81
9 Linux Configuration for Bonding Mode and Virtual LAN (VLAN) Linux Bonding Mode Ensure that the steps required for installing the RPM source, creating the binary, and installing the binary have been performed as described in “QLogic Adapter Driver Installation (RPM Format)” on page 8-5 before setting up Linux bonding mode.
PAGE 82
9–Linux Configuration for Bonding Mode and Virtual LAN (VLAN) Linux Bonding Mode After bonding, the MAC addresses for the two ports that were bonded appear to be the same when running the ifconfig command. This similarity is due to the formation of a bond to permit traffic to be passed between the ports. After the bond has been brought down and the bonding driver removed, the QLogic adapter’s original MAC addresses will resume on the ports.
PAGE 83
9–Linux Configuration for Bonding Mode and Virtual LAN (VLAN) Linux Bonding Mode The output for this command is: MII Status: up (for eth15) Round-Robin or Mode=0 This mode implements a round-robin scheme between the two Ethernet ports. To set the round-robin mode, type the following command: % modprobe bonding mode=0 miimon=100 updelay=50000 primary=eth16 After the command is executed, both links delay for 50 seconds before their states are set to BOND_LINK_UP.
PAGE 84
9–Linux Configuration for Bonding Mode and Virtual LAN (VLAN) Linux Bonding Mode The output for this command is: Ethernet Channel Bonding Driver: v3.0.
PAGE 85
9–Linux Configuration for Bonding Mode and Virtual LAN (VLAN) Linux Bonding Mode arp_interval This parameter specifies the ARP link monitoring frequency in milliseconds. When ARP monitoring is used in an etherchannel compatible mode (modes 0 and 2), the switch must be configured in a mode that evenly distributes packets across all links.
PAGE 86
9–Linux Configuration for Bonding Mode and Virtual LAN (VLAN) Linux Bonding Mode The bonding modes are described in Table 9-1. Table 9-1. Bonding Modes Mode Number Mode Name Description 0 balance-rr This mode uses a round-robin policy; it transmits packets in sequential order, from the first available slave through the last. This mode provides load balancing and fault tolerance. 1 active-backup In this mode, one slave interface is active at all times.
PAGE 87
9–Linux Configuration for Bonding Mode and Virtual LAN (VLAN) Configuring Virtual LAN (VLAN) Under Linux Configuring Virtual LAN (VLAN) Under Linux To configure the VLAN function: 1. Type the following command to see if the 8021q.ko driver has been loaded: % lsmod | grep 8021q Type the following command if the driver has not been loaded: % modprobe -v 8021q The vconfig add command creates a VLAN device on eth0 and will, in turn, create an eth0.5 interface. 2.
PAGE 88
9–Linux Configuration for Bonding Mode and Virtual LAN (VLAN) Configuring Virtual LAN (VLAN) Under Linux 9-8 NE0154601-00 C
PAGE 89
10 Firmware Management This section describes the firmware download process. When the driver package is installed, the firmware files are installed onto the host operating system (OS). The dynamic firmware download takes place when the driver module is loaded. As the driver module is loaded, the firmware file downloaded from the host OS becomes the active firmware version on the QLogic adapter.
PAGE 90
10–Firmware Management Linux Dynamic Firmware Download Check for the following entry: Active Firmware version: 4.0.
PAGE 91
11 Troubleshooting Guidelines Unable to Boot the Host System with the QLogic Adapter Installed If the system does not boot after installing the QLogic adapter: 1. Remove the QLogic adapter and power up the system. Does the system boot without the QLogic adapter? If so, power down the system, insert the QLogic adapter into a different PCIe slot, and power up the system. 2. Ensure that the system BIOS configuration is up-to-date during the system boot up process. 3.
PAGE 92
11–Troubleshooting Guidelines Additional Configuration for Windows Server 2008 Teaming 4. 5. 6. Type lspci -v and look for vendor ID 4040. a. Check to see if the QLogic adapter is visible on the PCI bus. b. Check to see if the QLogic adapter is plugged into the appropriate PCIe slot. Check if the driver is loaded correctly and the card is initialized.  Windows event viewer  dmesg (display system messages on Linux) Check the network configuration. a. Check for a valid IP address and subnet.
PAGE 93
11–Troubleshooting Guidelines Troubleshooting Tools Windows Server Tools The troubleshooting tools available in Windows Server are described in Table 11-1. Table 11-1. Troubleshooting Tools in Windows Server Tool What it Provides systeminfo The systeminfo tool provides detailed information about the operating system version, CPU, system manufacturer and model, memory configuration, hot fixes, and network cards. Device manager The device manager shows the hardware configured on the system.
PAGE 94
11–Troubleshooting Guidelines Check for System Errors Check for System Errors Linux To check for system errors in Linux.
PAGE 95
11–Troubleshooting Guidelines Caveats PCI Express Slot The QLogic adapter can be located on the PCI Express bus using the following Linux procedures.  Determine the vendor and device ID. To check if the PCIe slot has a x8 link for optimal PCIe performance, first determine the PCI vendor ID and device ID code by typing the following command: % lspci -n You should see a message similar to: 06:00.0 0200: 4040:0100 (rev 42) The QLogic vendor ID is 0x4040.
PAGE 96
11–Troubleshooting Guidelines Caveats Examine the following hex output: ...... 82 04 00 00 01 00 82 Supported link width Negotiated link width From the lspci hex output: c0: 10 00 02 00 02 80 00 00 00 10 0b 00 82 04 00 00 ||_________ capability. “82 04" = x8 PCIe Gen2 Note that some PCIe chip sets with a x16 link may not support a PCI Express x8 link width. A link is required to support only its maximum width and x1.
PAGE 97
A Diagnostic Utility Commands Table A-1 lists user-level diagnostic utility commands for the Linux and Windows Server OSs. Table A-1. Diagnostic Utility Commands Command Description -i This command specifies the interface type (Local Area Connection 1, Local Area Connection 2, etc.). --interface -a This command performs all tests, regardless of the default. --all -D This command performs only the default test. --default -R This command tests all control registers (default).
PAGE 98
A–Diagnostic Utility Commands Table A-1. Diagnostic Utility Commands (Continued) Command -nR --noCRegs -nF Description This command disables control register testing (use with -D or -a). This command disables Flash testing (use with -D or -a). --noFLASH -nl This command disables interrupt testing (use with -D or -a). --noIRQS -nL --noIntLB -nH This command disables internal loopback testing (use with -D or -a). This command disables hardware testing (use with -D or -a).
PAGE 99
B Flash Update Under rare circumstances, it may be necessary update the Flash on the QLogic adapter. Contact Technical Support to see if a Flash update is required. If so, follow the instructions in this appendix. Flash Update and Tool Guidelines Consider the following before updating the Flash:  The update process should not be interrupted (do not reboot or stop the update process).  A backup image of the existing Flash will be created at the start of the Flash update process.
PAGE 100
B–Flash Update Flash Update Options Windows Server Type the following command, where “Local Area Connection n” specifies the adapter being Flashed: nxflash -i “Local Area Connection n” --all (the quotes are required) You are prompted to answer Y(es) or N(o) to allow the upgrading of the Flash to continue. Press the Y key to continue. See “QLogic Adapter Flash Update—Windows Server” on page B-3 for more information.
PAGE 101
B–Flash Update QLogic Adapter Flash Update—Windows Server 3. 4. Format the USB Flash device to a FAT file system (if required): a. Right-click the Start button, and then click Explore. b. Right-click the USB Flash drive, and then click Format. c. Format the USB Flash drive to a FAT file system. Unzip the NX Live USB file into its own directory. a. Right-click the file, click Open With, and then click Compressed (zipped) Folders. b. Copy the two folders boot and slax onto the USB Flash drive. 5.
PAGE 102
B–Flash Update QLogic Adapter Flash Update—Windows Server Using the Flash Utility When invoking the nxflash.exe utility, use the following syntax: nxflash -i “Local Area Connection n” --all In this command, the -i indicates the interface command and the “Local Area Connection n” specifies the adapter being Flashed. (The quotation marks are required.) To determine the adapter number: 1. Click the Start button, and then right-click My Network Places. 2. Click Properties.
PAGE 103
B–Flash Update QLogic Adapter Flash Update—Windows Server Table B-1. Flash Utility Commands—Windows Server (Continued) Command Definition --pxe-off PXE This command disables PXE. --wol-on WOL This command enables wake on LAN. --wol-off WOL This command disables wake on LAN (default). Create XML This command creates an XML file that contains QLogic adapter/firmware information. For Windows Server, the XML file will be in the current directory. Help This command displays the help menu.
PAGE 104
B–Flash Update QLogic Adapter Flash Update—Windows Server Here is an example of the Windows Server nxflash --all output for local area connection 8: C:\netxen\4.0.223\utils>nxflash -i "Local Area Connection 8" --all NETXEN Port is Port 0 Verifying flash...Done. 0/9 - Init *** Currently in flash *** Board Type : Quad Gig LP Firmware Version : 4.0.
PAGE 105
B–Flash Update QLogic Adapter Flash Update—Windows Server Here is an example of a Windows Server nxflash --info output for local area connection 0: C:\Users\Administrator\Desktop\4.0.223\utils>nxflash.exe -i “Local Area Connection 0” --info NETXEN Port is Port 0 Verifying flash...Done. Board Type : 0x24 (Quad Gig LP) Board Chip Rev : B1 Serial Id : QG87BK0092 Efuse ID : 0x4e36343633340f08 Firmware version (on Flash) : 4.0.228 Active Firmware version : 4.0.
PAGE 106
B–Flash Update QLogic Adapter Flash Update—Linux  To perform updates simultaneously from two different directory trees, type the following commands from two separate directory trees. In these commands, n represents two different port numbers, for example, “Local Area Connection 4” and “Local Area Connection 5” (the quotation marks are required).  c:\[version]-a\utils\ nxflash.exe -i “Local Area Connection n” --all (first QLogic adapter)  c:\[version]-b\utils\ nxflash.
PAGE 107
B–Flash Update QLogic Adapter Flash Update—Linux Table B-2. Flash Utility Commands—Linux (Continued) Command Definition Description -a Flash update This command performs a complete update of the BIOS and the Flash using a user-renamed ROM image. Restore When an update is performed, the previous firmware version is stored to a file in the current working directory. Executing this command restores the specified backup Flash version to the QLogic adapter.
PAGE 108
B–Flash Update QLogic Adapter Flash Update—Linux Flash Update Procedure To update the Linux OS Flash: 1. Ensure that the steps required for installing the RPM source, creating the binary, and installing the binary to the file system have been performed. If not, follow the instructions in “QLogic Adapter Driver Installation (RPM Format)” on page 8-5 before proceeding. The new driver is now ready to be loaded automatically the next time the system is powered up. 2. Update the Flash. a.
PAGE 109
B–Flash Update QLogic Adapter Flash Update—Linux Here is an example of a Linux nxflash output: # ./nxflash -i 0 --info NIC driver will be temporarily unloaded Closing interfaces: eth2 eth3 PCIE Function Number is 0 Verifying flash...Done. Board Type Server Adapter) : 0x26 (NetXen NX3031 Dual Port SFP+ 10GbE Board Chip Rev : B1 Serial Id : SF8DBK0145 Efuse ID : 0x0000000000000000 Firmware version(on Flash) : 4.0.304 BIOS version : 2.1.
PAGE 110
B–Flash Update QLogic Adapter Flash Update—Linux B-12 NE0154601-00 C
PAGE 111
Glossary dbgview.exe Debug viewer for Windows Server dmesg Linux system messages Ethtool utility Linux Ethernet tool for card settings; See man ethtool in Linux. FlexLOM™ QLogic's FlexLOM feature in the Intelligent Ethernet Adapter enables 1GbE and 10GbE connectivity with the end user's choice of interface on a single device. iperf Linux performance tool iSCSI Internet small computer system interface. Protocol that encapsulates data into IP packets to send over Ethernet connections. An alternative to FCIP.
PAGE 112
QLogic 3000 and 3100 Series Intelligent Ethernet Adapters Users Guide Version 4.7 PCIe and PCI Express A third-generation input/output (I/O) standard that allows enhanced Ethernet network performance beyond that of the older peripheral component interconnect (PCI) and PCI extended (PCI-X) desktop and server slots.
PAGE 113
Index Symbols %systemRoot%\windows\stnf\ QLsetup.
PAGE 114
User’s Guide—Networking 3000/3100 Series Driver see also Driver installation, Driver installation verification bonding driver options 9-4 bonding driver parameters 9-4 configuration, Windows Server 2003, 2008 7-1 configuration, Windows Server 2008 Teaming 6-8 file location, Linux 8-2 inbox kernel GPL and commercial, enable 8-2 options 8-6 tab, adapter properties 7-9, 11-3 version 8-2 Driver installation see also Inbox kernel GPL driver, Commercial GPL driver Linux 3-4 Linux (RPM format) 8-5 Linux driver so
PAGE 115
User’s Guide—Networking 3000/3100 Series Installation see also Driver installation, Driver installation verification hardware 3-1 hardware verification of 3-2 Linux driver 3-4 Windows Server 2003 NIC driver 3-3, 5-2 Windows Server 2008 NIC driver 3-3, 6-2 Windows Server 2008 Teaming driver 6-6 --interface A-1, B-4, B-8 --IntLB A-1 ipconfig 11-3 iperf 8-9, Glossary-1 --IRQS A-1 iSCSI Glossary-1 L -L A-1 -l A-1, B-8 lacp_rate parameter 9-5 --LED A-1 LEDs 4-2, 4-5, Glossary-1 --LinkST A-1 Linux bonding mode
PAGE 116
User’s Guide—Networking 3000/3100 Series P PCI Express Glossary-2 PCI Express bus, finding QLogic adapter on 11-5 PCIe Glossary-2 Performance tuning 7-13, 8-9 Port mapping 4-2 PXE Glossary-2 --pxe-off B-5, B-9 --pxe-on B-4, B-9 Q QLE3044 see also QLogic adapter bracket removal and replacement 4-3 hardware installation 4-1 LEDs 4-2 port mapping 4-2 QLE3142 see also QLogic adapter bracket removal and replacement 4-5 hardware installation 4-4 LEDs 4-5 QLogic adapter see also QLE3044‚ QLE3142 bonding modes 9-
PAGE 117
User’s Guide—Networking 3000/3100 Series U Uninstall commercial GPL driver 8-8 tools 8-8 Windows Server 2003 NIC driver 5-6 Windows Server 2008 NIC driver 6-12 Windows Server 2008 Teaming driver 6-13 V -v A-2, B-5, B-9 --version A-2, B-5, B-9 VLAN Glossary-2 VLAN configuration 9-7 Windows Server 2008 and 2008 R2 configuring the QLogic adapter in 7-9 diagnostics 7-11 driver configuration 7-1 driver installation overview 3-3 event log 11-3 Flash update B-5 NIC driver installation 6-2 NIC driver installatio
PAGE 118
User’s Guide—Networking 3000/3100 Series Index-6 NE0154601-00 C
PAGE 119
PAGE 120
Corporate Headquarters QLogic Corporation 26650 Aliso Viejo Parkway Aliso Viejo, CA 92656 949.389.6000 www.qlogic.com International Offices UK | Ireland | Germany | France | India | Japan | China | Hong Kong | Singapore | Taiwan © 2009–2011 QLogic Corporation. Specifications are subject to change without notice. All rights reserved worldwide. QLogic, QLogic logo, and FlexLOM are registered trademarks of QLogic Corporation. Finisar is a registered trademark of Finisar Corporation.