NetExtreme II Family Adapters AT-2973SX AT-2973T Installation and User’s Guide 613-001183 Rev.
Copyright 2009 Allied Telesis, Inc. All rights reserved. No part of this publication may be reproduced without prior written permission from Allied Telesis, Inc. Microsoft and Internet Explorer are registered trademarks of Microsoft Corporation. Netscape Navigator is a registered trademark of Netscape Communications Corporation. All other product names, company names, logos or other designations mentioned herein are trademarks or registered trademarks of their respective owners. Allied Telesis, Inc.
Contents Preface ..................................................................................................................................................................................9 Safety Symbols Used in this Document................................................................................................................................10 Where to Find Web-based Guides ....................................................................................................................
Contents Installing the DOS NDIS2 Driver Software ....................................................................................................................47 Using Keywords for the Drivers ............................................................................................................................................49 Chapter 5: Installing the Linux Drivers ............................................................................................................................
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Appendix A: Specifications ............................................................................................................................................127 Physical Specifications .......................................................................................................................................................127 Environmental Specifications...................................................
Contents 6
Figures Figure 1. AT-2973SX Adapter .............................................................................................................................................15 Figure 2. AT-2973T Adapter ................................................................................................................................................16 Figure 3. AT-2973SX Faceplate ...............................................................................................................................
Figures 8
Preface This guide contains instructions on how to install the AT-2973SX and AT-2973T adapters and configure the adapters using the driver software.
Preface Safety Symbols Used in this Document This document uses the safety symbols defined in Table 1. Table 1. Safety Symbols Symbol 10 Meaning Description Caution Performing or omitting a specific action may result in equipment damage or loss of data. Warning Performing or omitting a specific action may result in electrical shock.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Where to Find Web-based Guides The installation and user guides for all Allied Telesis products are available in portable document format (PDF) on our web site at www.alliedtelesis.com. You can view the documents online or download them onto a local workstation or server.
Preface Contacting Allied Telesis This section provides Allied Telesis contact information for technical support as well as sales or corporate information. Online Support You can request technical support online by accessing the Allied Telesis Knowledge Base: www.alliedtelesis.com/support/kb.aspx. You can use the Knowledge Base to submit questions to our technical support staff and review answers to previously asked questions.
Chapter 1 Introducing the AT-2973SX and AT-2973T Adapters This chapter provides an introduction to the Allied Telesis AT-2973SX and AT-2973T NetExtreme II Family Adapters and contains the following sections: “Functional Descriptions” on page 14 “Features” on page 17 “Physical Descriptions” on page 21 13
Chapter 1: Introducing the AT-2973SX and AT-2973T Adapters Functional Descriptions The AT-2973SX and AT-2973T Broadcom NetXtreme II adapters are in a new class of Gigabit Ethernet (GbE) converged network interface controller (C-NIC) that can simultaneously perform accelerated data networking and storage networking on a standard Ethernet network. The C-NIC offers acceleration for all popular protocols used in the data center, such as: TCP Offload Engine (TOE) for accelerating TCP over 1 GbE, 2.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide The AT-2973SX adapter connects a PCI-E compliant server or workstation to a Gigabit Ethernet network using fiber optic cabling and a connector that meets 62.5/125 µm or 50/125 µm multimode specifications. This adapter operates at speeds of 1000 Mbps in full-duplex mode. The AT-2973SX adapter is show in Figure 1. 10 0 ATI ACT LNK AT-2973SX Adapter 1696 Figure 1.
Chapter 1: Introducing the AT-2973SX and AT-2973T Adapters AT-2973T Adapter The AT-2973T adapter operates at speeds of 10/100/1000T Mbps in both full-duplex and half-duplex modes. This adapter has two twisted-pair connectors and two LEDs, as show in Figure 2. L/A 101 0 2 ATI L/A 1700 Figure 2. AT-2973T Adapter Contents of Your Shipment The following items are included with your adapter: Antistatic bag (used for protecting the adapter when stored or shipped).
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Features The following list of features for the AT-2973SX and AT-AT-2973T adapters applies to all of the supported operating systems: TCP Offload Engine (TOE) Internet Small Computer Systems Interface (iSCSI) offload Single-chip solution – Integrated 10/100/1000BASE-T transceivers – 10/100/1000 triple-speed MAC – Host interfaces – SerDes interface for optical transceiver connection – PCI Express v1
Chapter 1: Introducing the AT-2973SX and AT-2973T Adapters TCP Offload Engine (TOE) – SMBus controller – ACPI 1.1a compliant (multiple power modes) – IPMI support Advanced network features – Jumbo frames (up to 9 KB). The OS and the link partner must support jumbo frames. – Virtual LANs – IEEE Std 802.3ad Teaming – Smart Load Balancing Teaming – Smart Load Balancing TOE Teaming (with the correct configuration) – Flow Control (IEEE Std 802.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide adapter, the TCP/IP processing can be moved to hardware, freeing the CPU for more important tasks such as application processing. The Broadcom NetXtreme II adapter's TOE functionality allows simultaneous operation of up to 1024 fully offloaded TCP connections for 1-Gbps network adapters.
Chapter 1: Introducing the AT-2973SX and AT-2973T Adapters Note For specific systems, see your system documentation for information about support of the WOL feature. Adaptive Interrupt Frequency The adapter driver intelligently adjusts host interrupt frequency based on traffic conditions to increase overall application throughput. When traffic is light, the adapter driver interrupts the host for each received packet, minimizing latency.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Physical Descriptions This section provides descriptions of the AT-2973SX and AT-2973T faceplates and LEDs. The faceplate on the AT-2973SX adapter provides two fiber optic connectors for attaching the adapter to a compatible link partner. See Figure 3 for an illustration of the adapter’s faceplate. The AT-2973SX adapter has two fiber ports and two LEDs per port, as shown in Figure 3 and described in Table 1.
Chapter 1: Introducing the AT-2973SX and AT-2973T Adapters AT-2973T Adapter Physical Description The faceplate on the AT-2973T adapter provides two twisted-pair connectors for attaching the adapter to a compatible link partner. See Figure 4 for an illustration of the adapter’s faceplate. L/A 101 L/A 0 2 1701 Figure 4. AT-2973T Faceplate For copper-wire Ethernet connections, the state of the network link and activity is indicated by the LEDs on the RJ-45 connector, as described in Table 2. Table 2.
Chapter 2 Installing the Hardware This chapter contains the following sections: “Reviewing Safety Precautions” on page 24 “Pre-Installation Checklist” on page 26 “Replacing the Bracket” on page 27 “Installing a Network Adapter Card” on page 29 “Connecting the Network Cables” on page 33 23
Chapter 2: Installing the Hardware Reviewing Safety Precautions Please review the following safety precautions before you begin to install a network adapter card. Note The indicates that a translation of the safety statement is available in a PDF document titled “Translated Safety Statements” on the Allied Telesis website at www.alliedtelesis.com. Warning This is a “Class 1 LED product”. L1 Warning Do not stare into the laser beam.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide - Make sure to use only insulated or nonconducting tools. - Verify that the system is powered OFF and unplugged before accessing internal components. - Installation or removal of adapters must be performed in a staticfree environment. The use of a properly grounded wrist strap or other personal antistatic devices and an antistatic mat is strongly recommended.
Chapter 2: Installing the Hardware Pre-Installation Checklist Before you install an adapter card, check the following list: 1. Verify that your system is using the latest BIOS. Note If you acquired the adapter software from the Allied Telesis support website, enter the path to where the adapter driver files reside on your system. 2. If your system is active, shut it down. 3. When the system shut down is complete, power OFF and unplug your system. 4.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Replacing the Bracket Both the AT-2973SX and AT-2973T adapters are shipped with the lowprofile bracket attached to the adapter. Depending on your PC, you may need to replace the bracket attached to your adapter. The following procedure describes how to remove the low-profile bracket from the adapter and replace it with the standard bracket.
Chapter 2: Installing the Hardware ATI ACT LNK 2. Align the tabs of the standard bracket with the holes on the adapter and fasten the screws onto the adapter. See Figure 6. 1698 Figure 6.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Installing a Network Adapter Card The following instructions apply to installing both the AT-2973SX and AT2973T adapters in most systems. For details about performing these tasks on your particular system, refer to the manuals that were supplied with your system. Note To perform this procedure, you need to supply a Phillips-head screw. To install an AT-2973SX or AT-2973T adapter, perform the following procedure: 1.
Chapter 2: Installing the Hardware Figure 7. Removing the PC Cover 3. Select an empty, non-shared PCI slot and remove the faceplate. Keep the faceplate in a safe place. You may need it for future use. See Figure 8. Figure 8. Removing the Faceplate From PCI Slot Note If you cannot locate or do not know how to find an appropriate PCI slot, refer to the documentation that came with your system.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide 4. Remove the network adapter card from the shipping package and store the packaging material in a safe location. Caution Wear a grounding device and observe electrostatic discharge precautions when installing the network adapter card in a system. Failure to observe this caution could result in damage to the card. 5.
Chapter 2: Installing the Hardware Figure 10. Securing the Adapter with a High-profile Bracket 7. Replace the system’s cover and secure it with the screws removed in Step 2. 8. Disconnect any personal antistatic devices. 9. Power the system on. Once the system returns to proper operation, the adapter hardware is fully installed. Next, connect the network cables. See “Connecting the Network Cables” on page 33.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Connecting the Network Cables The AT-2973SX adapter has two fiber optic connectors (each with a transmit and receive) for attaching the system to a compatible link partner, or an IEEE 802.3z compliant Gigabit Ethernet switch. The AT-2973T adapter has two twisted-pair connectors. For the AT-2973SX adapter you need a fiber optic cable. For specifications for this cable, see the AT-2973SX adapter data sheet.
Chapter 2: Installing the Hardware 34
Chapter 3 Installing Broadcom Boot Agent Driver Software This chapter provides information about how to install the Broadcom Boot Agent Driver Software: “Overview” on page 36 “Setting Up MBA in a Client Environment” on page 38 “Setting Up MBA in a Server Environment” on page 40 35
Chapter 3: Installing Broadcom Boot Agent Driver Software Overview Both the AT-2973SX and AT-2973T Broadcom NetXtreme II adapters support Preboot Execution Environment (PXE). Multi-Boot Agent (MBA) is a software module that allows your network computer to boot with the images provided by remote servers across the network. The Broadcom MBA driver complies with the PXE 2.1 specification and is released with both monolithic and split binary images.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide To extend functionalities beyond basic network connectivity when loading an operating system through ADS, see “Using the NetXtreme II Monolithic Driver” on page 83.
Chapter 3: Installing Broadcom Boot Agent Driver Software Setting Up MBA in a Client Environment Setting up a Multiple Book Agent (MBA) in a client environment involves the following: Enabling the MBA Driver “Enabling the MBA Driver” on page 38 “Configuring the MBA Driver” on page 38 “Setting Up the BIOS” on page 39 To enable or disable the MBA driver, do the following: 1. Boot up your system in DOS mode. Note The uxdiag.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Note The message prompting you to press CTRL+S is displayed once for each Broadcom NetXtreme II adapter you have in your system that has MBA enabled. The messages are displayed in the same order as the assigned adapter device number. 3. Use the UP ARROW and DOWN ARROW keys to move to the Boot Protocol menu item.
Chapter 3: Installing Broadcom Boot Agent Driver Software Setting Up MBA in a Server Environment Red Hat Linux PXE Server The Red Hat Enterprise Linux distribution has PXE Server support. It allows users to remotely perform a complete Linux installation over the network. The distribution comes with the boot images boot kernel (vmlinuz) and initial ram disk (initrd), which are located on the Red Hat disk#1: /images/pxeboot/vmlinuz /images/pxeboot/initrd.
Chapter 4 Installing the NDIS2 Driver Software This chapter provides procedures to install the NDIS2 driver on the Microsoft Network Client and DOS NDIS platforms.
Chapter 4: Installing the NDIS2 Driver Software Overview The BXND20X Broadcom NetXtreme II Gigabit Ethernet driver is described in this chapter.This driver can be installed on AT-2973SX and AT-2973T adapters that are installed in systems running an MS-DOS platform.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Pre-installation Requirements Before you can successfully install the NDIS2 driver software, you must do the following: Physically install the network adapter in the server. Install the networking software that is appropriate to the operating system (such as Microsoft LAN Manager 2.2 for MS-DOS). The networking software must be running on your server.
Chapter 4: Installing the NDIS2 Driver Software Installing the NDIS2 Driver Software on MS-DOS Platforms The NDIS2 driver software can be run from an MS-DOS startup disk using Microsoft Network Client 3.0 or from the hard disk using Microsoft LAN Manager 2.2. This section describes how to create a startup disk and modify it.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide 8. Follow the on-screen instructions to make the network startup disk (choose NE2000 Compatible from the list of adapters). Modifying the Startup Disk To modify the startup disk, do the following: 1. Edit A:\Net\Protocol.ini with Notepad or a similar text editor. a. Change DriverName=$ to DriverName=BXND20X$. b.
Chapter 4: Installing the NDIS2 Driver Software DriverName=PROTMAN$ PRIORITY=MS$NDISHLP [MS$NDISHLP] DriverName=ndishlp$ BINDINGS=MS$NE2CLONE [MS$NETBEUI] DriverName=netbeui$ SESSIONS=10 NCBS=12 BINDINGS=MS$NE2CLONE LANABASE=0 2. Edit A:\Net\System.ini. 3. Change netcard= to netcard=BXND20X.dos. 4. Check for references to C:\NET and change C:\NET to A:\NET if necessary. Example system.ini file The following is an example of a system.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide 6. Create the appropriate Autoexec.bat file in drive A for the chosen protocol as shown: TCP/IP Here is an example of the TCP/IP autoexec.bat file: path=a:\net a:\net\net initialize a:\net\netbind.com a:\net\umb.com a:\net\tcptsr.exe a:\net\tinyrfc.exe a:\net\nmtsr.exe a:\net\emsbfr.exe a:\net\net start basic net use z: \\SERVERNAME\SHARENAME NetBEUI Here is an example of the NetBEUI autoexec.
Chapter 4: Installing the NDIS2 Driver Software 5. Edit the Autoexec.bat file by adding the following lines: C:\ LANMAN\NETBIND.EXE C:\LANMAN\NET START WORKSTATION C:\LANMAN\NET USE drive letter: \\server name\resource name 6. Edit the Protocol.ini file (located in C:\LANMAN) to configure the driver to bind with NetBEUI or any other protocols. Here is an example: [PROTOCOL MANAGER] DriverName = PROTMAN$ [NETBEUI_XIF] DriverName = netbeui$ BINDINGS = BXND20X [BXND20X] DriverName = "BXND20X$" 7.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Using Keywords for the Drivers The Protocol.ini file contains certain keywords that are used by the BXND20X.dos driver. These keywords are listed below: BusNum. Specifies the number of the PCI bus on which the network adapter is located. This keyword requires a value ranging from 0 to 255. DevNum. Specifies the device number assigned to the network adapter when it is configured by the PCI BIOS.
Chapter 4: Installing the NDIS2 Driver Software Here is an example of the keywords: [BXND20X] DriverName = "BXND20X$" BusNum = 3 DevNum = 14 PortNum = 2 LineSpeed = 1000 Duplex = Full NodeAddress = 001020304050 50
Chapter 5 Installing the Linux Drivers This chapter provides procedures to install the Linux drivers for the AT2973SX and AT-2973T adapters.
Chapter 5: Installing the Linux Drivers Introduction This chapter discusses the Linux drivers for the Broadcom NetXtreme II network adapters and describes how to install them. For a description of the drivers, see Table 3. Table 3. Broadcom NetXtreme II Linux Drivers Linux Driver Limitations Description bnx2 cnic Indicates the Linux drivers for the AT-2973SX and AT-2973T network adapters.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide bnx2i Driver The current version of the driver has been tested on 2.6.x kernels, starting from 2.6.18 kernel. The driver may not compile on older kernels with the exception of SLES 10 SP1, which runs 2.6.16.46 kernel. SUSE upgraded the iscsi_transport kernel module in SLES 10 SP1. In addition, Broadcom iSCSI offload initiators is supported on SLES 10 SP1.
Chapter 5: Installing the Linux Drivers Installing Linux Driver Software There are two ways to install the Linux driver software— from the Source RPM Package or build the driver from the source TAR file.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide 3. Install the newly built package which includes the driver and man page: rpm -ivh RPMS/i386/bnx2-version.arch.rpm If you are installing over an existing distribution that may already contain an older version of the driver, the --force option is needed. Depending on the kernel, the driver is installed to one of the following paths: 2.4.x kernels /lib/modules/kernel_version/kernel/drivers/net/ bnx2.o 2.6.
Chapter 5: Installing the Linux Drivers To configure the network protocol and address, refer to the documentation provided with your operating system. Building the Driver from the Source TAR File This procedure describes how to build the bnx2 and bnx2i Linux drivers from the Source TAR file. See the following sections: “Building the bnx2 Driver” on page 56 “Building the bnx2i Driver” on page 57 Building the bnx2 Driver To build the bnx2 Linux driver from the Source TAR file, do the following: 1.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide To configure the network protocol and address after building the driver, refer to the manuals supplied with your operating system. Building the bnx2i Driver The following procedure describes how to build the bnx2i Linux driver from the Source TAR file. 1. Create a directory and extract the TAR files to the directory by entering the following command: tar xvzf bnx2-version.tar.gz 2. Build the driver bnx2.
Chapter 5: Installing the Linux Drivers Load and Run Necessary iSCSI Software Components Broadcom iSCSI Offload software suite consists of 3 kernel modules and a user daemon. You can load the required software components either manually or through system services. 1. Unload existing driver & kill the user daemon if necessary. Do the following: Manual: rmmod bnx2i pkill -9 bnx2id Using system service: service bnx2id stop 2. Load the iSCSI driver and the user daemon.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Note On 2.6 kernels, it is not necessary to bring down the eth# interfaces before unloading the driver module. Note If the cnic driver is loaded, unload the cnic driver before unloading the bnx2 driver. Note Before unloading the bnx2i driver, disconnect all active iSCSI sessions to targets.
Chapter 5: Installing the Linux Drivers Apply the updates by running the scripts provided in the supplemental tar file. For example, on Red Hat Enterprise Linux, apply the updates by entering the following commands: ./patch_pcitbl.sh /usr/share/hwdata/pcitable pci.updates /usr/share/hwdata/pcitable.new bnx2 ./patch_pciids.sh /usr/share/hwdata/pci.ids pci.updates /usr/share/hwdata/pci.ids.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Note Some combinations of property values may conflict and result in failures. The driver cannot detect all conflicting combinations. This property is used to disable Message Signal Interrupts (MSI). The property is valid only on 2.6 kernels that support MSI. However, this property cannot be used on 2.4 kernels. By default, the driver enables MSI if it is supported by the kernel.
Chapter 5: Installing the Linux Drivers modprobe bnx2i en_tcp_dack=0 Default: ENABLED sq_size Use the "Configure SQ size" parameter to select the send-queue size for offloaded connections. The SQ size determines the maximum SCSI commands that can be queued. Also, SQ size has a bearing on the number of connections that can be offloaded; as QP size increases, the number of connections supported decreases. With the default values, the AT-2973SX and AT-2973T adapters can offload 28 connections.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide session recoveries induced by some older targets when iSCSI NOP-OUT and iSCSI CMD pdus are intermixed. Newer iSCSI target systems are immune to this condition and this parameter is turned ON for quite some time. Defaults: 1 Values: Binary parameter, 0/1 The parameters can also be set in the modprobe.conf command. See the man page for more information.
Chapter 5: Installing the Linux Drivers TSO: Enabled (on 2.6 kernels) WoL: Initial setting based on NVRAM's setting Checking Driver Messages The following are the most common sample messages that may be logged in the /var/log/messages file for the bnx2 and bnx2i drivers. Use dmesg n command to control the level at which messages appear on the console. Most systems are set to level 6 by default. To see all messages, set the level higher.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Checking bnx2i Driver Messages The following are the most common bnx2i driver messages: BNX2I Driver signon Broadcom NetXtreme II iSCSI Driver bnx2i v1.0.30 (Sep 29, 2007) Network port to iSCSI transport name binding bnx2i: netif=eth2, iscsi=bcm570x-050000 bnx2i: netif=eth1, iscsi=bcm570x-030c00 Driver completes handshake with iSCSI offload-enabled CNIC device bnx2i [05:00.
Chapter 5: Installing the Linux Drivers Target cannot be reached on any of the CNIC devices bnx2i: check route, cannot connect using cnic Network route is assigned to network interface, which is down bnx2i: check route, hba not found Attempting to offload iSCSI connection onto a Jumbo Frame-enabled device bnx2i: eth# network i/f mtu is set to #mtu bnx2i: iSCSI HBA can support mtu of 1500 Note Change mtu to 1500 using ifconfig and restart the interface in order to offload iSCSI connections.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide bnx2i: iscsi_error - invalid R2TSN field bnx2i: iscsi_error - invalid cmd len1 bnx2i: iscsi_error - invalid cmd len2 bnx2i: iscsi_error - pend r2t exceeds MaxOutstandingR2T value bnx2i: iscsi_error - TTT is rsvd bnx2i: iscsi_error - MBL violation bnx2i: iscsi_error - data seg len != 0 bnx2i: iscsi_error - reject pdu len error bnx2i: iscsi_error - async pdu len error bnx2i: iscsi_error - nopin pdu len error bnx2i: iscsi_error
Chapter 5: Installing the Linux Drivers Teaming with Channel Bonding Statistics Linux iSCSI Offload With the Linux drivers, you can team adapters together using the bonding kernel module and a channel bonding interface. For more information, see the Channel Bonding information in your operating system documentation. Detailed statistics and configuration information can be viewed using the ethtool utility. See the ethtool man page for more information.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Installing Open iSCSI User Applications Install and run the open-iscsi programs, iscsid and iscsiadm, from the Broadcom distributed open-iscsi packages. See “Packaging” on page 53 for details. All pre-installed open-iscsi packages need to be removed before the Broadcom iSCSI-supported packages can be installed. To install and run the iscsid and iscsiadm programs, do the following: 1. Remove all existing open-iscsi packages.
Chapter 5: Installing the Linux Drivers Binding iSCSI Target to Broadcom NX2 iSCSI Transport Name By default, the open-iscsi daemon connects to discovered targets using software initiator (transport name = 'tcp'). Users who wish to offload an iSCSI connection onto CNIC device should explicitly change the transport binding of the iSCSI node. This can be done using iscsiadm cli utility as follows: iscsiadm --mode node --targetname iqn.200406.com.broadcom:tg1 \ --portal 192.168.1.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide iSCSI target discovery using 'SendTargets' iscsiadm -m discovery --type sendtargets -p Login to target using 'iscsiadm' command iscsiadm --mode node --targetname
Chapter 5: Installing the Linux Drivers 72
Chapter 6 Installing the Windows Drivers This chapter provides procedures to install and remove the driver software for all of the Windows Operating Systems supported by the AT-2973SX and AT-2973T adapters. In addition, it describes how to display and change adapter properties including power management options.
Chapter 6: Installing the Windows Drivers Installing the Windows Driver Software This chapter describes how to install all of the following Windows Operating Systems: Microsoft® Windows® (32-bit and 64-bit extended) Microsoft Windows Vista™ (32-bit and 64-bit extended) Microsoft Windows XP™ (32-bit and 64-bit extended) Microsoft Windows 7™ (32-bit and 64-bit extended) The Windows driver software for all of the Windows Operating Systems is available for download from the Allied Telesis websi
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Note To use the TCP/IP Offload Engine (TOE), you must have Windows Server 2003 with Service Pack 2 (SP2) and a license key preprogrammed in the hardware. If supported, for iSCSI and RDMA, you only need a license key. Using the Installer The Installer is a graphical interactive installation mode. To install the AT2973SX and AT-2973T drivers on a Windows Operating System, do the following: 1.
Chapter 6: Installing the Windows Drivers Figure 12. Broadcom NetXtreme II Driver Installer - InstallShield Wizard Page 3. Click Next to continue. The License Agreement Page is displayed. See Figure 13 on page 77.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Figure 13. License Agreement Page 4. After you review the license agreement, click I accept the terms in the license agreement and then click Next to continue. The Ready to Install the Program Page is displayed. See Figure 14 on page 78.
Chapter 6: Installing the Windows Drivers Figure 14. Ready to Install the Program Page 5. Click Install. The InstallShield Wizard Completed Page is displayed. See Figure 15 on page 79.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Figure 15. InstallShield Wizard Completed Page 6. Click Finish to close the wizard. 7. The installer determines if a system restart is necessary. Follow the on-screen instructions. Using Silent Installation Silent installation provides a command-line silent mode which allows for unattended installation.
Chapter 6: Installing the Windows Drivers Note All commands are case sensitive. Note User must "Run as Administrator" for Vista when using "msiexec" for "silent" install or uninstall procedures. Note For detailed instructions and information about unattended installs, refer to the Silent.txt file in the DrvInst folder. Performing a Silent Install To perform a silent install from within the installer source folder, type the following: setup /s /v/qn or msiexec /i "BDrv5706.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide To perform a silent uninstall from within the installer source folder, type the following: msiexec /x "BDrv5706.msi" /qn To perform a silent uninstall from any folder, type the following: msiexec /x "{F0DA8A3F-1457-419E-96F4-235DD3EF41E1}" / qn Note The hexidecimal number above may differ from your current installer.
Chapter 6: Installing the Windows Drivers Removing the Device Drivers This section discusses how to remove the device drivers. Note Windows Server 2003 and Windows Server 2008 provide the Device Driver Rollback feature to replace a device driver with one that was previously installed. However, the complex software architecture of the NetXtreme II device may present problems if the rollback feature is used on one of the individual components.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Using the NetXtreme II Monolithic Driver The NetXtreme II, based on its advanced functionalities, uses a software architecture that includes a Virtual Bus Device (VBD) to extend functionalities beyond basic network connectivity.
Chapter 6: Installing the Windows Drivers In cases where adding the Windows 2000 monolithic driver still does not work, apply the following modification to the b06nd.inf file located in the I386 directory as follows: 1. Locate [Manufacturer] header within the file. 2. Review the line below it which reads: %brcm% = broadcom, ntx86, ntamd64, ntia64 or equivalent. 3. Modify that line to read: %brcm% = broadcom.ntx86, ntamd64, ntia64. The change made replaces the comma and space after "broadcom" with a period.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Inserting the NetXtreme II Monolithic Driver in a WinPE 2.0 Image By default, the monolithic driver is not included in the boot.wim and install.wim files that come with the Microsoft Windows Server 2008/Vista CD. Microsoft's Windows Automated Installation Kit (AIK) allows you to modify the default boot.wim and install.wim files, and create WinPE 2.
Chapter 6: Installing the Windows Drivers 5. To complete the customization of the image, prepare the image for deployment, type: peimg /prep c:\VistaPEx86\mount\windows 6. When asked to continue and have the program prepare the image for deployment, type: yes 7. To commit the changes to the original image file (Winpe.wim), type: imagex /unmount c:\VistaPEx86\mount /commit 8. To replace the default Boot.wim file in the \ISO directory with your new custom image, type: copy c:\VistaPex86\winpe.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Once located, notice the following information: [params_utp] hkr, , req_medium, 2, "0" [params_fiber] hkr, , req_medium, 2, "65283" These make up two separate sections that can be configured: one for standard RJ-45 copper interfaces (params_utp) and one for fiber devices (params_fiber). 3.
Chapter 6: Installing the Windows Drivers Displaying or Changing the Properties of the Adapter To display or change the properties of the Broadcom network adapter, do the following: 1. In Control Panel, click Broadcom Control Suite 3. 2. Click the Advanced section of the Configurations tab. 3.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Setting Power Management Options You can set power management options to allow the operating system to turn off the controller to save power or to allow the controller to wake up the computer. If the device is busy doing something such as servicing a call, the operating system does not shut down the device.
Chapter 6: Installing the Windows Drivers Note The Power Management tab is available only for servers that support power management. Note To enable Wake on LAN (WOL) when the computer is on standby, click Allow the device to bring the computer out of standby box. Note If you select Only allow management stations to bring the computer out of standby, the computer can be brought out of standby only by Magic Packet.
Chapter 7 Installing Management Applications This chapter provides information about prerequisites for installing management applications as well as procedures instructions.
Chapter 7: Installing Management Applications Installing Broadcom Advanced Control Suite 3 and Related Management Applications The Broadcom Advanced Control Suite 3 (BACS 3) software and related management applications can be installed from the source-file directory or by using the silent install option. See the following: “Checking .
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Checking .NET Framework Requirements Before you use either the source-file directory or the silent install option, you must make sure that your system meets the minimum installation requirements. Microsoft .NET Framework 2.0 includes the runtime and associated files needed to run BACS 3, and must be installed on your system in order for BACS 3 to operate. For information on the minimum and recommended .
Chapter 7: Installing Management Applications Using the Installer The driver software is available for download from the Allied Telesis web site. To install the management applications, do the following: Note Before starting the installation, verify that .NET Framework 2.0 or above is installed. This ensures optimal performance of BACS 3. 1. Open the MgmtApps folder, select IA32 or x64, and then double-click Setup.exe to open the InstallShield Wizard. 2. Click Next to continue. 3.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Performing a Silent Install from the Installer Source Folder To perform a silent install (or upgrade) from within the installer source folder, do the following: Note All commands are case sensitive. Note User must "Run as Administrator" for Vista when using "msiexec" for "silent" install/uninstall(s). Note For detailed instructions and information about unattended installs, refer to the Silent.
Chapter 7: Installing Management Applications Note After performing a silent uninstall, it is necessary to reboot the system before reinstalling this installer. If a reboot is not performed, BASP will not install correctly. Performing a Silent Install by Feature on IA32 Platforms To perform a silent install by feature on IA32 platforms, do the following: Note CHM32 or CHM64 installs the BACS help file and must be included when installing the BACS feature.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Modifying Management Applications To modify the management applications, do the following: 1. In Control Panel, double-click Add or Remove Programs. 2. Click Broadcom Management Programs and then click Change. 3. Click Next to continue. 4. Click Modify to change program features. 5. Click Next to continue. 6. Click on an icon to change how a feature is installed. 7. Click Next. 8. Click Install. 9.
Chapter 7: Installing Management Applications Repairing Management Applications To repair or reinstall the management applications, do the following: 1. In Control Panel, double-click Add or Remove Programs. 2. Click Broadcom Management Programs, and then click Change. 3. Click Next to continue. 4. Click Repair to repair errors in installed applications. 5. Click Next to continue. 6. Click Install. 7. Click Finish to close the wizard.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Removing Management Applications To remove all management applications, do the following: 1. In Control panel, double-click Add or Remove Programs. 2. Click Broadcom Management Programs, and then click Remove. 3. Reboot your system to complete the removal of management applications.
Chapter 7: Installing Management Applications 100
Chapter 8 Troubleshooting This chapter provides troubleshooting information.
Chapter 8: Troubleshooting Hardware Diagnostics Loopback diagnostic tests are available for testing the adapter hardware. These tests provide access to the adapter internal/external diagnostics, where packet information is transmitted across the physical link. For instructions and information on running tests in an MS-DOS environment, see Chapter 9, “User Diagnostics” on page 115; for Windows environments, see “Running Diagnostic Tests” in the Broadcom Advanced Control Suite 3 User Guide.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Checking Port LEDs See “Physical Descriptions” on page 21 to check the state of the network link and activity.
Chapter 8: Troubleshooting Troubleshooting Checklist Caution Before you open the cabinet of your server to add or remove the adapter, see “Reviewing Safety Precautions” on page 24. The following checklist provides recommended actions to resolve problems installing or running either the AT-2973SX or AT-2973T adapter in your system. Checking Current Drivers Inspect all cables and connections. Verify that the cable connections at the network adapter and the switch are attached properly.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Linux To verify that the bnx2.o driver is loaded properly, enter the following command: lsmod If the driver is loaded, a line similar to one Table 6 is displayed, where size is the size of the driver in bytes, and n is the number of adapters configured. Table 6.
Chapter 8: Troubleshooting The ping statistics that are displayed indicate whether the network connection is working or not. Linux To verify that the Ethernet interface is up and running on a Linux platform, run ifconfig to check the status of the Ethernet interface. In addition, it is possible to use the netstat -i command to check the statistics on the Ethernet interface. See “Installing Linux Driver Software” on page 54 for information on ifconfig and netstat.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide network, a team that supports CO or LSO and is bound to a Hyper-V virtual network reports CO or LSO as an offload capability in BACS. However, in both instances CO and LSO do not work. This is a limitation of Hyper-V because this system does not support CO and LSO in an IPv6 network.
Chapter 8: Troubleshooting Upgrading from Windows 2000 Server to Windows Server 2003 Preparing an Answer File When a Broadcom NetXtreme II adapter is installed in your system, Broadcom recommends that you uninstall the adapter's driver before performing an OS upgrade from Windows 2000 Server to Windows Server 2003. This ensures that no errors are encountered in the installation of the Windows Server 2003 drivers for the NetXtreme II adapters.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide For a BCM5709S Netxtreme II GigE - InfId = "b06bdrv\l2nd&pci_163a14e4" Currently, the PCI location (PCI bus, device, and function numbers) method is not supported for the NetXtreme II device as an identifier or the adapter in the answer file due to a limitation with the Windows operating system.
Chapter 8: Troubleshooting Solving Broadcom Boot Agent and Broadcom Advanced Server Program (BASP) Issues This section discusses issues with the Broadcom Boot Agent and Broadcom Advanced Server (BASP) as well as provides solutions. Problem: Unable to obtain network settings through DHCP using PXE. Solution: For proper operation make sure that the Spanning Tree Protocol (STP) is disabled or that portfast mode (for Cisco) is enabled on the port to which the PXE client is connected.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Problem: A Generic Trunking (GEC/FEC) 802.3ad-Draft Static type of team may lose some network connectivity if the driver to a team member is disabled. Solution: If a team member supports underlying management software (ASF/IPMI/UMP) or Wake-On-LAN, the link may be maintained on the switch for the adapter despite its driver being disabled.
Chapter 8: Troubleshooting Solving Miscellaneous Issues This section presents issues and provides solutions for a variety of driver software issues. Problem: Although installed, the Broadcom Advanced Control Suite 3 (BACS) application does not start and an error message appears. Solution: NET Framework 2.0 is required for BACS 3 to operate. Install .NET Framework 2.0. Problem: Broadcom Advanced Control Suite 3 takes a long time to start up. Solution: This is a limitation of .NET Framework 2.0. Apply .
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Solution: This is a Microsoft issue. For more information, see Microsoft knowledge base KB913119 at http://support.microsoft.com/kb/913119. Problem: Performance is degraded when multiple BCM57710 network adapters are used in a system. Solution: Ensure that the system has at least 2 GB of main memory when using up to four network adapters and 4 GB of main memory when using four or more network adapters.
Chapter 8: Troubleshooting 114
Chapter 9 User Diagnostics This chapter provides user diagnostic information for the following platforms.
Chapter 9: User Diagnostics Introduction Broadcom NetXtreme II User Diagnostics is an MS-DOS based application that runs a series of diagnostic tests. These tests allow you to update device firmware as well as to view and change settings for available adapter properties. To run Broadcom NetXtreme II User Diagnostics, you must create an MSDOS 6.22 bootable disk containing the uxdiag.exe file. Next, start the system with the boot disk in drive A.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide System Requirements The following system requirements are needed to run user diagnostics: MS-DOS 6.22 Operating System uxdiag.
Chapter 9: User Diagnostics Performing Diagnostics At the MS-DOS prompt, type uxdiag followed by the command options. The uxdiag command options are shown in Table 7. For example, to run all diagnostic tests except Group B tests on adapter #1, enter the following command: C:\>uxdiag -c 1 -t b Note You must include uxdiag at the beginning of the command string each time you type a command. Table 7.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Table 7. uxdiag Command Options (Continued) Command Options Description uxdiag -fnvm Programs the raw image into NVM. uxdiag -fump Specifies the bin file to update UMP firmware. uxdiag -help Displays the Broadcom NetXtreme II User Diagnostics (uxdiag) command options. uxdiag -I Specifies the number of iterations to run on the selected tests.
Chapter 9: User Diagnostics Table 7. uxdiag Command Options (Continued) Command Options 120 Description uxdiag -t Disables certain groups or tests. uxdiag -T Enables certain groups or tests. uxdiag -ver Displays the version of Broadcom NetXtreme II User Diagnostics (uxdiag) and all installed adapters.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Diagnostic Test Descriptions The diagnostic tests are divided into four groups: Basic Functional Tests (Group A) Memory Tests (Group B) Block Tests (Group C) Ethernet Traffic Tests (Group D). The diagnostic tests are listed and described in Table 8 Table 8.
Chapter 9: User Diagnostics Table 8.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Table 8. Diagnostic Tests (Continued) Test Description Number Name C2 RBUF Allocation Verifies the RX buffer (RBUF) allocation interface by allocating and releasing buffers and checking that the RBUF block maintains an accurate count of the allocated and free buffers.
Chapter 9: User Diagnostics Table 8. Diagnostic Tests (Continued) Test Description Number Name C8 DMA Engine Verifies the functionality of the DMA engine block by performing numerous DMA read and write operations to various system and internal memory locations (and byte boundaries) with varying lengths (from 1 byte to over 4 KB, crossing the physical page boundary) and different data patterns (incremental, fixed, and random). CRC checks are performed to ensure data integrity.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Table 8. Diagnostic Tests (Continued) Test Description Number Name D2 PHY Loopback Enables PHY loopback mode in the adapter and transmits 5000 Layer 2 packets of various sizes. As the packets are received by Broadcom NetXtreme II User Diagnostics, they are checked for errors. Packets are returned through the PHY receive path and never reach the wire. The adapter should not be connected to a network.
Chapter 9: User Diagnostics 126
Appendix A Specifications Physical Specifications This section provides the dimensions and weight of the adapters. Dimensions: AT-2973SX: 14.47 cm x 5.61 cm (5.7 in. x 2.2 in.) AT-2973T: 14.47 cm x 5.61 cm (5.7 in. x 2.2 in.) Weight: AT-2973SX: 68.0 g (.15 lbs.) AT-2973T: 68.0 g (.15 lbs.
Appendix A: Specifications Performance Specifications The following performance specifications apply to both the AT-2973SX and AT-2973T adapters: x4 PCIe v2.0 and v1.1 compliant Operating Specifications The following operating specifications apply to the AT-2973SX adapter: Output Optical Power: -9.5 dBm minimum to -1.5 dBm maximum Input Optical Power: -17 dBm Receive Sensitivity: -12.5 dBm with 62.5 um fiber or -13.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Table 9 lists the RJ-45 pin signals when a twisted-pair port is operating in the MDI configuration. Table 9. MDI Pin Signals (10Base-T or 100Base-TX) Pin Signal 1 TX+ 2 TX- 3 RX+ 6 RX- Table 10 lists the RJ-45 port pin signals when a twisted-pair port is operating in the MDI-X configuration. Table 10.
Appendix A: Specifications Console Port Pinouts Table 12 lists the pin signals on the RJ-45 style serial terminal port for the AT-2973T adapter. Table 12.
Appendix B Cleaning Fiber Optic Connectors The fiber optic connector consists of a fiber optic plug and its adapter. The end of the fiber optic cable is held in the core of the ferrule in the plug. Light signals are transmitted through the core of the fiber. Even minor smudges or dirt on the end face of the fiber, completely invisible to the naked eye, can disrupt light transmission and lead to failure of the component or of the entire system.
Appendix B: Cleaning Fiber Optic Connectors Using a Cartridge-Type Cleaner PUSH OPEN Di re c A PEng TAWipi tion Fiber optic cartridge cleaners are available from many vendors and are typically called “cartridge cleaners,” as shown in Figure 20. Figure 20. Cartridge Cleaner Note Do not use compressed air or aerosol air to clean a fiber optic connector. To clean a fiber optic connector using a cartridge cleaner, perform the following procedure. 5.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide Note Rub the ferrule tip on the cleaning surface in one direction only. 7. When you reach the end of the cleaning surface, pick up the ferrule tip, rotate and place it at the top and rub downwards at least 2 times. Caution Failing to pick up the ferrule tip when you reach the bottom of the cleaning surface can result in static electricity that can damage the fiber optic cable. 8. If desired, repeat steps 3 and 4. 9.
Appendix B: Cleaning Fiber Optic Connectors Using a Swab Specially treated swabs (stick cleaners) are available for cleaning inside connector adapters or hard-to-reach ferrule tips. These swabs, often referred to as “lint free” or “alcohol free” swabs, are available from many vendors, as shown in Figure 22. Stick cleaners are available in both 2.5 mm and 1.25 mm sizes for use on SC and MU connectors respectively. Note NEVER use a household cotton swab and/or alcohol to clean a fiber optic connector.
AT-2973SX and AT-2973T NetExtreme II Family Adapters Installation and User’s Guide 3. If a fiber inspection scope is available, use the scope to inspect the connector to make sure that it is clean and to check for scratches, pits, or other problems that may affect performance. Note Always keep a dust cap on a fiber optic cable when it is not in use. Warning Do not stare into the laser beam. 2 Warning Do not look directly at the cable ends or inspect the cable ends with an optical lens.
Appendix B: Cleaning Fiber Optic Connectors 136
