User Manual

ManualsBrandsAsus ManualsServer AccessoriesPEM-FDR

121

122

123

124

125

126

127

128

129

130

Driver FeaturesRev 2.2-1.0.1

Mellanox Technologies

126

Step b. Assuming that on Host1, the physical function displayed by lspci is "0000:02:00.0", and that

on Host2 it is "0000:03:00.0"

On Host1 do the following.

cd /sys/class/infiniband/mlx4_0/iov

0000:02:00.0 0000:02:00.1 0000:02:00.2 ...

1. 0000:02:00.0 contains the virtual-to-physical mapping tables for the physical func-

tion.

0000:02:00.X contain the virt-to-phys mapping tables for the virtual functions.

Do not touch the Dom0 mapping table (under <nnnn>:<nn>:00.0). Modify only

tables under 0000:02:00.1 and/or 0000:02:00.2. We assume that vm1 uses VF

0000:02:00.1 and vm2 uses VF 0000:02:00.2

Step c. Configure the virtual-to-physical PKey mapping for the VMs.

echo 0 > 0000:02:00.1/ports/1/pkey_idx/1

echo 1 > 0000:02:00.1/ports/1/pkey_idx/0

echo 0 > 0000:02:00.2/ports/1/pkey_idx/1

echo 2 > 0000:02:00.2/ports/1/pkey_idx/0

vm1 pkey index 0 will be mapped to physical pkey-index 1, and vm2 pkey index

0 will be mapped to physical pkey index 2. Both vm1 and vm2 will have their

pkey index 1 mapped to the default pkey.

Step d. On Host2 do the following.

cd /sys/class/infiniband/mlx4_0/iov

echo 0 > 0000:03:00.1/ports/1/pkey_idx/1

echo 1 > 0000:03:00.1/ports/1/pkey_idx/0

echo 0 > 0000:03:00.2/ports/1/pkey_idx/1

echo 2 > 0000:03:00.2/ports/1/pkey_idx/0

Step e. Once the VMs are running, you can check the VM's virtualized PKey table by doing (on the

vm).

cat /sys/class/infiniband/mlx4_0/ports/[1,2]/pkeys/[0,1]

Step 3. Start up the VMs (and bind VFs to them).

Step 4. Configure IP addresses for ib0 on the host and on the guests.

4.15.6.3 Ethernet Virtual Function Configuration when Running SR-IOV

4.15.6.3.1VLAN Guest Tagging (VGT) and VLAN Switch Tagging (VST)

When running ETH ports on VGT, the ports may be configured to simply pass through packets as

is from VFs (Vlan Guest Tagging), or the administrator may configure the Hypervisor to silently

force packets to be associated with a VLan/Qos (Vlan Switch Tagging).

In the latter case, untagged or priority-tagged outgoing packets from the guest will have the

VLAN tag inserted, and incoming packets will have the

VLAN tag removed. Any vlan-tagged

packets sent by the VF are silently dropped. The default behavior is VGT.