Users Guide

MX Scalable Fabric architecture
The scalable fabric architecture ties multiple MX7000 chassis into a single network domain to behave like a single logical chassis
from a networking perspective. The MX scalable fabric architecture provides multichassis Ethernet with:
● Multiple 25 Gb Ethernet connections to each server sled
● No east-west oversubscription
● Low “any-any” latency
● Scale up to 10 MX7000 chassis
● Flexible uplink speeds
● Support for non-PowerEdge MX devices such as rack servers
For more information, see the PowerEdge MX I/O Guide available at www.dellemc.com.
Architectural Overview
A scalable fabric consists of two main components – a pair of MX9116n Fabric Switching Engines (FSE) and additional pairs of
MX7116n Fabric Expander Modules (FEM) used to connect remote chassis to the FSEs. This is a hardware enabled architecture,
and it applies irrespective of whether the switch is running in Full Switch or Fabric modes. A total of ten MX7000 chassis are
supported in a scalable fabric.
Fabric Switching Engine
The FSE contains the switching ASIC and network operating system. Traffic that is received from a FEM is mapped to the
correct switch interface automatically. Each NIC port has a dedicated 25 GbE lane from the NIC through the FEM and into the
FSE so there is no port to port oversubscription.
Fabric Expander Module
An FEM takes Ethernet frames from a compute node and sends them to the FSE and from the FSE to the compute node. There
is no switching ASIC or operating system running on the FEM, which allows for low latency. The FEM is invisible to the FSE and
is not managed in any way.
When using dual-port NICs, only the first port on the FEM must be connected to the FSE. The second port is not used.
When connecting a FEM to an FSE, the general rules to remember are:
● FEM in Slot A1 connects to FSE in Slot A1 or Slot B1
● FEM in Slot A2 connects to FSE in Slot A2 or Slot B2
● FEM in Slot B1 connects to FSE in Slot A1 or Slot B1
● FEM in Slot B2 connects to FSE in Slot A2 or Slot B2
NOTE: For Quad Port NICs, you must connect two cables from the MX7116n FEM to the MX9116n FSE.
Topics:
• Recommended physical topology
• Restrictions and guidelines
• Recommended connection order
9
MX Scalable Fabric architecture 81