User Manual

Rev 2.2-1.0.1

Mellanox Technologies

1.5.2 A Detailed Example

This section provides information of how to use InfiniBand over Ethernet (RoCE).

1.5.2.1 Installing and Loading the Driver

 To install and load the driver:

Step 1. Install MLNX_OFED (See section Section 2.3, “Installing Mellanox OFED”, on page 35

for details on installation.)

RoCE is installed as part of mlx4 and mlx4_en and other modules upon driver’s installa-

tion.

The list of the modules that will be loaded automatically upon boot can be found in the

configuration file /etc/infiniband/openib.conf.

Step 2. Display the existing MLNX_OFED version.

# ibv_devinfo

hca_id: mlx4_0

transport: InfiniBand (0)

fw_ver: 2.31.5050

node_guid: 0002:c903:0008:e810

sys_image_guid: 0002:c903:0008:e813

vendor_id: 0x02c9

vendor_part_id: 4099

hw_ver: 0xB0

board_id: MT_1060110019

phys_port_cnt: 2

port: 1

state: PORT_INIT (2)

max_mtu: 2048 (4)

active_mtu: 2048 (4)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: IB

port: 2

state: PORT_ACTIVE (4)

max_mtu: 2048 (4)

active_mtu: 1024 (3)

sm_lid: 0

port_lid: 0

port_lmc: 0x00

link_layer: Ethernet