Users’ Guide for the Programmable MUX (PMUX) on the M I/O Aggregator Dell Networking OS version 9.3(0.
Copyright © 2014 Dell Inc. All rights reserved. This product is protected by U.S. and international copyright and intellectual property laws. Dell and the Dell logo are trademarks of Dell Inc. in the United States and/or other jurisdictions. All other marks and names mentioned herein may be trademarks of their respective companies.
Introduction This document provides configuration instructions and examples for the Programmable MUX (PMUX mode) for the Dell Networking M I/O Aggregator using Dell Networking OS version 9.3(0.0).
Unit Boot-Mode Next-Boot -----------------------------------------------0 standalone standalone Dell# 2. Change IOA mode to PMUX mode. Dell(conf)# stack-unit 0 iom-mode programmable-mux Where stack-unit 0 defines the default stack-unit number. 3. Delete the startup configuration file. Dell# delete startup-config 4. Reboot the IOA by entering the reload command. Dell# reload 5. Repeat the above steps for each member of the IOA in PMUX mode.
Multiple Uplink LAGs Unlike IOA Automated modes (Standalone, VLT, and Stacking Modes), the IOA Programmable MUX can support multiple uplink LAGs. You can provision multiple uplink LAGs. Note: In order to avoid loops, only disjoint VLANs are allowed between the uplink ports/uplink LAGs and uplink-to-uplink switching is disabled. Multiple Uplink LAGs with 10G Member Ports The following sample commands configure multiple dynamic uplink LAGs with 10G member ports based on LACP. 1. Bring up all the ports.
4. Configure the port mode, VLAN, and so forth on the port-channel. Dell#configure Dell(conf)#int port-channel 10 Dell(conf-if-po-10)#portmode hybrid Dell(conf-if-po-10)#switchport Dell(conf-if-po-10)#vlan tagged 1000 Dell(conf-if-po-10)#link-bundle-monitor enable Dell#configure Dell(conf)#int port-channel 11 Dell(conf-if-po-11)#portmode hybrid Dell(conf-if-po-11)#switchport Dell(conf-if-po-11)#vlan tagged 1000 % Error: Same VLAN cannot be added to more than one uplink port/LAG.
Te 0/41 Te 0/42 Up Up LAG bundle - 11 - Inactive Interface Te 0/43 Dell# 0 0 Utilization[In Percent] - 0 Line Protocol Up Alarm State Utilization[In Percent] 0 Multiple Uplink LAGs with 40G Member Ports By default in IOA, native 40G QSFP+ optional module ports are used in Quad (4x10G) mode, to convert Quad mode to Native 40G mode, refer to the sample configuration.
Please save and reset unit 0 for the changes to take effect. Dell(conf)# 2. Save the configuration. Dell#write memory ! 01:05:48: %STKUNIT0-M:CP %FILEMGR-5-FILESAVED: config to startup-config in flash by default Copied running- Dell#reload Proceed with reload [confirm yes/no]: yes 3. Configure the port-channel with 40G member ports.
5. Show the port channel status. Dell#sh int port-channel br Codes: L - LACP Port-channel O - OpenFlow Controller Port-channel L LAG 20 L 21 Dell# Mode L2 Status up Uptime 00:00:53 L2 up 00:00:02 Ports Fo 0/33 Fo 0/37 Fo 0/49 (Up) (Up) (Up) Dell(conf)#int port-channel 20 Dell(conf-if-po-20)#vlan tagged 1000 Dell(conf-if-po-20)# Dell(conf-if-po-21)#vlan tagged 1000 % Error: Same VLAN cannot be added to more than port/LAG. Dell(conf-if-po-21)#vlan tagged 1001 Dell(conf-if-po-21)# one uplink 6.
Uplink Failure Detection (UFD) UFD provides detection of the upstream connectivity loss and, if used with network interface controller (NIC) teaming, automatic recovery from a failed link. 1. Create the UFD group and associate the downstream and upstream ports. Dell#configure Dell(conf)#uplink-state-group 1 Dell(conf-uplink-state-group-1)# Dell(conf-uplink-state-group-1)#upstream port-channel 128 Dell(conf-uplink-state-group-1)#downstream tengigabitethernet 0/1-32 2.
NOTE: In this example, if port-channel 128 goes down, the downstream interfaces are brought operationally down (set to UFD error-disabled). Similarly, if the upstream port-channel goes up, the downstream ports are brought up (cleared from UFD error-disabled). VLAN Configuration on Physical Ports and Port-Channels Unlike other Dell Networking OS platforms, IOA allows VLAN configurations on port and portchannel levels. This allows you to assign VLANs to a port/port-channel.
4. Initialize the port-channel with configurations such as admin up, portmode, and switchport. Dell#configure Dell(conf)#int port-channel 128 Dell(conf-if-po-128)#portmode hybrid Dell(conf-if-po-128)#switchport 5. Configure the tagged VLANs 10 through 15 and untagged VLAN 20 on this port-channel. Dell(conf-if-po-128)#vlan tagged 10-15 Dell(conf-if-po-128)# Dell(conf-if-po-128)#vlan untagged 20 6. Show the running configurations on this port-channel.
12 Active 13 Active 14 Active 15 Active 20 Active T T T T T T T T T U U Te 0/1 Po128(Te Te 0/1 Po128(Te Te 0/1 Po128(Te Te 0/1 Po128(Te Te 0/1 Po128(Te Te 0/1 0/41-42) 0/41-42) 0/41-42) 0/41-42) 0/41-42) Dell# You can remove the inactive VLANs that have no member ports using the following command: Dell#configure Dell(conf)#no interface vlan ->vlan-id - Inactive VLAN with no member ports You can remove the tagged VLANs using the no vlan tagged command.
2. Configure the VLT domain. Dell#configure Dell(conf)#vlt domain 1 Dell(conf-vlt-domain)# peer-link port-channel 127 -> VLT peer destination Dell(conf-vlt-domain)# back-up destination 169.254.31.23 Dell(conf-vlt-domain)#system-mac mac-address 00:01:09:06:06:06 -> unit-id 0 – VLT Primary, unit-id 1 – VLT Secondary Dell(conf-vlt-domain)# unit-id 0 Dell(conf-vlt-domain)#end 3. Configure the VLT port channel.
Dell# 5. Configure the secondary VLT. NOTE: Repeat steps from 1 through 4 on the secondary VLT, ensuring you use the different backup destination and unit-id.
1. Configure stack groups on all stack units. Dell# Dell#configure Dell(conf)#stack-unit 0 stack-group 0 Dell(conf)#00:37:46: %STKUNIT0-M:CP %IFMGR-6STACK_PORTS_ADDED: Ports Fo 0/33 have been configured as stacking ports. Please save and reset stack-unit 0 for config to take effect Dell(conf)#stack-unit 0 stack-group 1 Dell(conf)#00:37:57: %STKUNIT0-M:CP %IFMGR-6STACK_PORTS_ADDED: Ports Fo 0/37 have been configured as stacking ports.
N-Port Identifier Virtualization (NPIV) Proxy Gateway (NPG) NPIV NPG feature provides Fibre Channel over Ethernet (FCoE)-FC bridging on the IOA and MXL 10/40GbE switch with the FC Flex IO module, allowing server-converged network access (CNA) to communicate with storage area network (SAN) fabrics. In NPIV mode, the FC/Ethernet split happens at the chassis edge, thus removing the need for an explicit external Fibre Channel forwarder (FCF).
Related Commands • • fcoe-map show fcoe-map fabric Apply an FCoE map on a fabric-facing Fibre Channel (FC) port. Fabric map-name Syntax Parameters map-name = Enter a maximum of 32 alphanumeric characters. To remove an FCoE map from an FC interface, enter the no fabric map-name command in Interface Configuration mode. Defaults None Command Modes INTERFACE FIBRE_CHANNEL Command History Version 9.3(0.
Related Commands • • fcoe-map show fcoe-map fcf-priority Configure the priority to select an upstream FCoE forwarder (FCF). fcf—priority priority Syntax To remove a configured FCF priority from an FCoE map, enter the no fcf-priority command. Parameters priority = Enter the fcf priority. The range is from 0 to 128. Defaults 128 Command Modes FCOE MAP Command History Version 9.3(0.0) Usage Information The FCF priority is used by the server CNAs to select an upstream FCF to use for a fabric login (FLOGI).
Parameters Defaults Command Modes Command History priority-bitmap = Enter the priority-bitmap range. The range is from 1 to FF. 0x8 PROTOCOL LLDP Version 9.3(0.0) fcoe-map Configure the links between the server CNAs and a SAN fabric. Apply the FCoE map on a serverfacing Ethernet port. fcoe-map map-name Syntax To remove an FCoE map from an Ethernet interface, enter the no fcoe-map map-name command in Interface configuration mode. Parameters map-name = Enter a maximum of 32 alphanumeric characters.
Defaults Command Modes Command History Related Commands 8 seconds FCOE MAP Version 9.3(0.0) • fcoe-map • show fcoe-map interface vlan Create a dedicated VLAN to be used to send and receive Fibre Channel traffic over FCoE links. interface vlan vlan-id Syntax Parameters vlan-id = Enter a number as the VLAN Identifier. The range is 1 to 4094. Defaults Not configured. Command Modes CONFIGURATION Command History Version 9.3(0.
Priority-pgid Assign 802.1 priority traffic to a priority group in a DCB map. priority-pgid dot1p0_group-num dot1p1_groupSyntax num dot1p2_group-num dot1p3_group-num dot1p4_group-num dot1p5_group-num dot1p6_group-num dot1p7_group-num To remove a priority-pgid configuration from a DCB map, enter the no priority-pgid command. Parameters • dotp0_group-num = Enter the priority group number for each 802.1p class of traffic in a DCB map.
• • Defaults Command Modes Command History Usage Information Related Command priority group. The range is 1 to 100. The sum of all allocated bandwidth percentages in priority groups in a DCB map must be 100%. strict-priority = Configure the priority-group traffic to be handled with strict priority scheduling. Strict-priority traffic is serviced first, before bandwidth allocated to other priority groups is made available.
Command History Usage Information Example • EXEC Privilege Version 9.3(0.0) Use this command to display the FC and FCoE parameters used to configure server-facing Ethernet (FCoE) and fabric-facing FC ports in all FCoE maps. In each FCoE map, the values for the fabric ID, FC-MAP, and FCoE VLAN must be unique.
Oper-State Active (all mandatory FCoE and FC parameters are correctly configured) Incomplete (either the FC-MAP value, fabric ID, or VLAN ID are not correctly configured). Operational status of link to the fabric: Up (link is up and transmitting FC traffic) Down (link is down and not transmitting FC traffic) Link-wait (link is up and waiting for FLOGI to complete on peer FC port) Removed (port has been shut down). The following table describes the show fcoe-map map-name output.
show npiv devices Display the FCoE and FC devices currently logged in to an IOA and MXL switch with the FC Flex IO module NPIV proxy gateway. show npiv devices [brief] Syntax Parameters Brief = Displays an overview of current server CNA-fabric connections. Command Modes • EXEC • EXEC Privilege Command History Version 9.3(0.
ENode WWPN ENode WWNN FCoE MAC FC-ID LoginMethod Secs Status Related Command : : : : : : : 10:00:00:00:c9:d9:9c:cb 10:00:00:00:c9:d9:9c:cd 0e:fc:03:01:02:02 01:02:01 FDISC 5593 LOGGED_IN See the following tables for field descriptions. • dcb-map • fcoe-map The following table describes the show npiv devices brief output. Field Description ENode-Intf IOA and MXL switch with the FC Flex IO module Ethernet interface (slot/port) to which a server CNA is connected.
FCoE VLAN Fabric Map Enode WWPN Enode WWNN FCoE MAC FC-ID LoginMethod Secs State ID of the dedicated VLAN used to transmit FCoE traffic from a server CNA to a fabric and configured on both the server-facing IOA and MXL switch with the FC Flex IO module port and server CNA port. Name of the FCoE map containing the FCoE/FC configuration parameters for the server CNA-fabric connection. Worldwide port name of the server CNA port. Worldwide node name of the server CNA. Fabric-provided MAC address (FPMA).
Enabling Fibre Channel Capability on the Switch You must first enable an IOA and MXL switch with the FC Flex IO module that you want to configure as an NPG for the FC protocol. Task Command Enable an IOA and MXL switch feature fc with the FC Flex IO module for the FC protocol. Command Mode CONFIGURATION Creating a DCB Map Configure the priority-based flow control (PFC) and enhanced traffic selection (ETS) settings in a DCB map before you can apply them on downstream server-facing ports.
Important Points to Remember • • If you remove a dot1p priority-to-priority group mapping from a DCB map (the no priority pgid command), the PFC and ETS parameters revert to their default values on the interfaces on which the DCB map is applied. By default, PFC is not applied on specific 802.1p priorities; ETS assigns equal bandwidth to each 802.1p priority. To change the ETS bandwidth allocation configured for a priority group in a DCB map, do not modify the existing DCB map configuration.
to transmit FCoE traffic. Creating an FCoE Map The values for the FCoE VLAN, fabric ID, and FC-MAP must be unique. Apply an FCoE map on downstream server-facing Ethernet ports and upstream fabric-facing Fibre Channel ports. Task Create an FCoE map. Configure the association between the dedicated VLAN and the fabric where the desired storage arrays are installed. The fabric and VLAN ID numbers must be the same. The range is from 2 to 4094. Add a text description. The maximum is 32 characters.
The default is 8 seconds. Applying an FCoE Map on Server-Facing Ethernet Ports You can apply multiple FCoE maps on an Ethernet port or port channel. When you apply an FCoE map on a server-facing port or port channel: • • The port is configured to operate in hybrid mode (accept both tagged and untagged VLAN frames). The associated FCoE VLAN is enabled on the port or port channel.
Task Configure a fabric-facing FC port. Command interface fibrechannel slot/port fabric map-name Apply the FCoE and FC fabric configurations in an FCoE map to the port. Repeat this step to apply an FCoE map to more than one FC port. no shutdown Enable the port for FC transmission.
3. Create the dedicated VLAN to be used for FCoE traffic. Dell(conf)#interface vlan 1002 4. Configure an FCoE map to be applied to the downstream (server-facing) Ethernet and upstream (core-facing) FC ports. Dell(config)# fcoe-map SAN_FABRIC_A Dell(config-fcoe-name)# fabric-id 1002 vlan 1002 Dell(config-fcoe-name)# description "SAN_FABRIC_A" Dell(config-fcoe-name)# fc-map 0efc00 Dell(config-fcoe-name)# keepalive Dell(config-fcoe-name)# fcf-priority 128 Dell(config-fcoe-name)# fka-adv-period 8 5.
For more information about NPIV Proxy Gateway information, refer to the 9.3(0.0) Addendum. IOA PMUX Mode CLI Commands The following tables list the IOA PMUX mode CLI commands that you can access without a separate user profile. For more information about these commands, refer to the Addendum for Dell Networking OS 9.3(0.0) or the PowerEdge M IO Aggregator Command Line Interface for Dell Networking OS version 9.2(0.2)/9.2(0.0).
iscsi target port Interfaces CLI Commands clear counters flowcontrol interface ManagementEthernet interface vlan negotiation auto interface port-channel Vlan tagged description interface interface range mtu portmode hybrid channel-member minimum-links Vlan untagged Internet Group Management Protocol (IGMP) CLI Commands ip igmp group-join-limit ip igmp querier-timeout ip igmp query-max-resp-time ip igmp snooping enable ip igmp snooping last-memberquery-interval ip igmp snooping querier ip igmp last-membe
percentage clear qos statistics policy-aggregate qos-policy-output rate shape service-queue show qos policy-map wred-profile description policy-map-output rate police service-policy output set wred Simple Network Management Protocol (SNMP) CLI Commands snmp-server enable traps clear logging logging buffered logging monitor show logging snmp-server host logging logging console logging source-interface show logging driverlog stackunit terminal monitor Storm Control CLI Commands show storm-control unknown
