Dell PowerEdge M I/O Aggregator Getting Started Guide Regulatory Model: PEMIOAggregatr
Notes, Cautions, and Warnings NOTE: A NOTE indicates important information that helps you make better use of your computer. CAUTION: A CAUTION indicates potential damage to hardware or loss of data if instructions are not followed. WARNING: A WARNING indicates a potential for property damage, personal injury, or death. ____________________ Information in this publication is subject to change without notice. © 2012 Dell Inc. All rights reserved.
Contents 1 Introduction . 2 Product Description . . . . . . . . . . . . . . . . . 7 3 Hardware Overview . . . . . . . . . . . . . . . . . . 8 . . . . . . . . . . . . . . . . . . . . . . . 8 . . . . . . . . . . . . . . . . . . . . . . . . 8 Internal Ports. Front Panel . . . . . . . . . . . . . . . . . . . . . . . . Base Module with 40GbE Ports . . . . . . . . . . . . . . FlexIOTM Modules with Uplink Ports Port Numbering . . . . . . . . . . . . . . . . . . . . . USB Console Port . . . . .
Installing and Configuring the Aggregator 16 Installing the Aggregator in a PowerEdge Chassis . Connecting a Console Terminal . . 18 . . . . . . . . . . . . . 20 . . . . . . . . 21 . . . . . . . . . . . . . 21 . . . . . . . . . . . . . . . . . . 22 Invoking the X-Loader and U-Boot CLIs . Reconfiguring Default Settings Before You Start. Reconfiguration Using the CMC Interface . . . . . 22 . . . . . . . . . . . 22 . . . . . . . . . . . . . 25 . . . . . . . . . . . . . . . . . . . .
6 Next Steps . 7 Technical Specifications . . . . . . . . . . . . . . . . . . . . . . . . Chassis Physical Design . . . . . . . . . . . . 35 . . . . . . . . . . . . . . . . 35 Environmental Parameters . . . . . . . . . . . . . . . 35 . . . . . . . . . . . . . . . . . . 36 . . . . . . . . . . . . . . . . . . . . . 36 Power Requirements IEEE Standards .
Contents
Introduction This document provides basic information about the Dell PowerEdge M I/O Aggregator, including how to install the switch in the Dell PowerEdge M1000e Enclosure and perform the initial configuration. For more detailed information about any of the basic installation steps, refer to the Dell PowerEdge M1000e Enclosure Owner's Manual on the Dell Support website at http://support.dell.com/manuals.
Hardware Overview This section contains information about device characteristics and modular hardware configurations for the Aggregator. Internal Ports The Aggregator provides thirty-two 1/10-Gigabit Ethernet internal ports. The internal ports are connected to server blades through the M1000e chassis midplane. Each port can operate in either 1GbE or 10GbE mode. The Aggregator also provides an internal Ethernet interface—the out-of-band (OOB) interface—which is dedicated to switch management.
FlexIOTM Modules with Uplink Ports On the Aggregator, FlexIO plug-in modules (Figure 1-2) operate only as uplinks; stacking is not supported. The following modules are supported in the two expansion slots: • 4-Port 10-Gigabit Ethernet module using SFP+ optics or direct-attach cables (1m, 3m, or 5m DAC) 4-Port 10GBASE-T module using RJ-45 connector (copper) cables NOTE: Only one 4-Port 10GBASE-T module is supported in an Aggregator. NOTE: The 10M speed is not supported on the 4-Port 10GBASE-T module.
Use the FlexIO modules in an Aggregator that operates in standalone or stacking mode: • In standalone mode, you can install any of the supported FlexIO modules in two expansion slots. All ports operate at 10GbE to provide increased bandwidth of up to 160Gbps for uplinks. Stacking is not supported. • In stacking mode, only the 40GbE ports on the base module are used for stacking. FlexIO modules are required for uplink connections.
Port Numbering When installed in a PowerEdge M1000e Enclosure, Aggregator ports are numbered 1 to 56. Ports 1 to 32 are internal server-facing ports. Ports 33 to 56 are external ports numbered from the bottom to the top of the switch as follows: • • • The 40GbE base-module ports operate: • In standalone 4x10GbE mode (default); ports are numbered 33 to 36 and 37 to 40. • In stacking mode; ports are numbered 33 and 37, and cannot be used for uplinks.
USB Console Port Figure 1-3. USB Ports on Front Panel USB Storage Port USB Console Port Use the lower USB console port (Figure 1-3) to manage the switch through an RS-232 serial interface. This port provides a direct connection to the switch and allows you to access the command-line interface (CLI) from a console terminal connected to the port through the provided serial cable (with USB type-A to female DB-9 connectors).
System and Port LEDs The front panel of the Aggregator contains light emitting diodes (LEDs) that provide information about the status of the switch (Figure 1-4). Figure 1-4. System LEDs on Front Panel Standalone 4x10GbE Uplink Ports or 40GbE Stacking Ports System Status LED System Power LED Table 1-1 describes system LED conditions. Ta b l e 1 - 1 . System LEDs System LED Color Meaning Green Power is being supplied to the switch. Off The switch does not have power.
Plug-in modules and the base module (Figure 1-1) also contains LEDs that provide information about the link status and traffic activity on a port. Figure 1-5. Port LEDs Link Status Activity Link Status Activity Link Status Activity Table 1-2 describes the LED status of 10GbE BASE-T, 10GbE SFP+, and 40GbE QSFP+ ports used in stacking mode on the base module. Ta b l e 1 - 2 . Port LED Status Port LED Color Meaning Off The port is down.
Table 1-3 describes the LED status of a 40GbE QSFP+ port that is split into four 10GbE SFP+ ports using a 4x10GbE breakout cable. Ta b l e 1 - 3 . LED Status of 4x10GbE Port Port LED Color Meaning Off All four 10GbE ports on a breakout cable are down. Yellow At least one of the four 10GbE ports on a breakout cable is up. Off No traffic is being transmitted on any 10GbE port on the breakout cable.
Unpacking the Aggregator Package Contents When unpacking each switch, ensure that the following items are included: • One PowerEdge M I/O Aggregator switch blade • One USB type A-to-DB-9 female cable • Getting Started Guide • Safety and Regulatory Information • Warranty and Support Information • Software License Agreement Unpacking Steps NOTE: Before unpacking the switch, inspect the container and immediately report any evidence of damage.
Figure 1-6.
Installing the Aggregator in a PowerEdge Chassis After you unpack the Aggregator, install FlexIO modules in the base module and slide the Aggregator into one of the open I/O module slots in the back of a PowerEdge M1000e chassis. NOTE: If you plug a FlexIO module into an Aggregator that is already powered on and inserted in an M1000e chassis, you must reboot the Aggregator for the plugin module to be activated.
Figure 1-8. PowerEdge M1000e: Back View with Six Aggregator Blades CMC 2 CMC 1 Six I/O Aggregator blades After you slide the Aggregator in so that the connectors on the back of the blade are inserted into the chassis midplane, the switch receives power from the chassis and automatically powers on. The chassis management controller (CMC) in the chassis validates that the switch blade is a supported I/O module before powering it on.
Connecting a Console Terminal After the I/O Aggregator powers on, complete all external cabling connections and connect a terminal to the blade to configure the switch. To monitor and configure the Aggregator using the serial console, use the USB console port on the front panel of the switch ( Figure 1-3) to connect it to a VT100 terminal or to a computer running VT100 terminal emulation software. The console port is implemented as a data terminal equipment (DTE) connector.
Invoking the X-Loader and U-Boot CLIs During the boot process, you can perform various configuration tasks by accessing the X-Loader and U-Boot CLIs, such as running memory tests (X-Loader) and activating the backup image or recovering a password (U-Boot). You are first prompted to enter the X-Loader CLI by pressing any key when the following message is displayed: Hit any key to stop autoboot.
Before You Start Before you reconfigure default settings, ensure that: • The Aggregator booted successfully when it powered on. • The console connection is established and the login prompt appears on the screen of a VT100 terminal or terminal equivalent. By default, the Aggregator receives the following IP addresses from a DHCP server in the network.
2 At the EXEC mode prompt, enter enable. At the EXEC Privilege prompt, enter configure to reach the configuration command mode. FTOS> enable FTOS# configure FTOS(conf)# 3 (CLI only) At the configuration mode prompt, enter the hostname name command to configure a hostname for the Aggregator, where name is a text string of up to 20 alphanumeric characters. Host names must start with a letter and end with a letter or number. Characters within the string can be letters, numbers, and hyphens.
For example: FTOS(conf)# interface ManagementEthernet 1/0 FTOS(conf-if-ma-1/0)# ip address 128.0.0.1/24 FTOS(conf-if-ma-1/0)# no shutdown 8 (CMC-supported) To reconfigure the default route used by the out-ofband interface to access the Aggregator from a remote network, enter the management route subnet/mask managementethernet command, where subnet/mask is an IP address in dotted decimal format (A.B.C.D) and a subnet mask that defines the out-of-band management network. FTOS(conf)# management route 10.0.0.
13 (CLI only) To verify the reconfigured settings, enter the show runningconfig command. FTOS(conf)# show running-config 14 (CMC-supported) To save reconfigured settings to the startup configuration, enter the write memory command. FTOS(conf)# write memory For more information about Aggregator configuration using the CLI, refer to the Dell Force10 FTOS Configuration Guide for the PowerEdge M I/O Aggregator.
DCB Support DCB enhancements for data center networks are supported to eliminate packet loss and provision links with required bandwidth. The Aggregator provides zero-touch configuration for DCB. The Aggregator auto-configures DCBX port roles to match the DCBX configuration in the ToR switches to which it connects through its uplink ports. FCoE Connectivity Many data centers use Fiber Channel (FC) in storage area networks (SANs).
Link Aggregation All uplink ports are configured in a single LAG (LAG 128). Server-facing ports are auto-configured as part of link aggregation groups if the corresponding server is configured for LACP-based NIC teaming. Static LAGs are not supported. Tip: The recommended LACP timeout is long-timeout mode. Link Tracking By default, all server-facing ports are tracked by the operational status of the uplink LAG.
Uplink LAG The tagged VLAN membership of the uplink LAG is automatically configured based on the VLAN configuration of all server-facing ports (ports 1 to 32). The untagged VLAN used for the uplink LAG is always the default VLAN. Server-Facing LAGs The tagged VLAN membership of a server-facing LAG is automatically configured based on the server-facing ports that are members of the LAG.
Assembling a Switch Stack After you complete the initial configuration, the Aggregator is powered up and operational. Stacking is supported only on the 40GbE ports on the base module. Stacking is limited to two Aggregators in the same chassis in a single stack. Up to three stacks are supported in an M1000e chassis. To configure a switch stack, you must use the CLI. Cabling the Switch Stack Figure 1-9 shows a stacking example using two Aggregators in a chassis.
Figure 1-9. Switch Stack Using 40GbE Ports on Two Aggregators Use only QSFP transceivers and QSFP cables (separately purchased) to connect stacking ports; for example: 1 Insert a QSFP cable in the bottom base-module port on the rightmost Aggregator. 2 Connect the cable to the bottom base-module port on the next Aggregator to the left. 3 On the leftmost Aggregator, connect the top base-module port to the top base-module port on the rightmost Aggregator to create a loop.
Configuring and Bringing Up a Stack After you attach the cables in a stack of Aggregators, follow these steps to configure and bring up the stack: 1 Connect the terminal to the console port on an Aggregator. Enter the following commands to access the CLI and configure the base-module ports for stacking mode: Login: username Password: ***** FTOS> enable FTOS# configure FTOS(conf)# stack-unit 0 iom-mode stack Where stack-unit 0 defines the default stack-unit number in the initial configuration of a switch.
To remove an Aggregator from the stack, enter the stack-unit 0 iom-mode standalone command in global configuration mode. After entering the command, save the configuration and reload the Aggregator for the change to take effect. Managing a Stack Master and Member Switches You can manage a stack of Aggregators as a single entity when they are connected together. Manage the stack from the CLI through the serial console connection or a remote Telnet session over the OOB management IP address.
FTOS Version Checking Following the stack-unit number assignment, the master switch performs a consistency check to ensure both switches in the stack are running the same FTOS version. If the master switch determines that both switches are not running the same FTOS version, the ports on the non-master switch with the incorrect version are disabled.
Next Steps • You can customize the Aggregator for use in your data center network as necessary. To perform additional switch configuration, do one of the following: • For remote out-of-band management, enter the OOB management interface IP address into a Telnet or SSH client and log in to the switch using the user ID and password to access the CLI. • For local management using the CLI, use the attached console connection.
Technical Specifications The Aggregator is an I/O module and installed with the Server (model: PowerEdge M1000e) for communication. CAUTION: Lithium Battery Caution: There is a danger of explosion if the battery is incorrectly replaced. Replace batteries only with same or equivalent type. Dispose of the batteries according to the manufacturer's instructions. Chassis Physical Design Parameter Specifications Height 1.32 inches (33.45 mm) Width 10.81 inches (274.75 mm) Depth 12.17 inches (309.
Power Requirements Parameter Specifications Power supply 100–240 VAC 50/60 Hz Maximum current draw per system 2 A @ 100/120 VAC 1 A @ 200/40 VAC Maximum power consumption 123 Watts Reliability MTBF 355,178 hours IEEE Standards The Aggregator complies with the following IEEE standards: 36 • 802.1AB LLDP • 802.1p L2 Prioritization • 802.1Q VLAN Tagging • 802.3ab Gigabit Ethernet (1000BASE-T) • 802.3ac Frame Extensions for VLAN Tagging • 802.3ad Link Aggregation with LACP • 802.
Printed in the U.S.A. ww w.d el l .c o m | s up p or t . de l l.
