User Manual

Driver FeaturesRev 2.0-3.0.0
Mellanox Technologies
90
4.13.7 Configuring Pkeys and GUIDs under SR-IOV
4.13.7.1 Port Type Management
Port Type management is static when enabling SR-IOV (the connectx_port_config script will
not work). The port type is set on the Host via a module parameter,
port_type_array, in
mlx4_core. This parameter may be used to set the port type uniformly for all installed Con-
nectX® HCAs, or it may specify an individual configuration for each HCA.
This parameter should be specified as an options line in the file
/etc/modprobe.d/
mlx4_core.conf
.
For example, to configure all HCAs to have Port1 as ETH and Port2 as IB, insert the following
line:
To set HCAs individually, you may use a string of
Domain:bus:device.function=x;y
For example, if you have a pair of HCAs, whose PFs are 0000:04:00.0 and 0000:05:00.0, you
may specify that the first will have both ports as IB, and the second will have both ports as ETH
as follows:
4.13.7.2 Virtual Function InfiniBand Ports
Each VF presents itself as an independent vHCA to the host, while a single HCA is observable
by the network which is unaware of the vHCAs. No changes are required by the InfiniBand sub-
system, ULPs, and applications to support SR-IOV, and vHCAs are interoperable with any exist-
ing (non-virtualized) IB deployments.
Sharing the same physical port(s) among multiple vHCAs is achieved as follows:
• Each vHCA port presents its own virtual GID table
The virtual GID table for the InfiniBand ports consists of a single entry (at index 0) that maps to a
unique index in the physical GID table. The vHCA of the PF maps to physical GID index 0. To obtain
GIDs for other vHCAs, alias GUIDs are requested from the SM. These GIDs are mapped to vHCAs
as follows:
• vHCA number x is assigned the GID/GUID at index x of the physical GID table.
• Each vHCA port presents its own virtual PKey table
The virtual PKey table (presented to a VF) is a mapping of selected indexes of the physical PKey
table. The host admin can control which PKey indexes are mapped to which virtual indexes using a
sysfs interface (see Section , on page 89). The physical PKey table may contain both full and partial
memberships of the same PKey to allow different membership types in different virtual tables.
options mlx4_core port_type_array=1,2
options mlx4_core port_type_array='0000:04:00.0-1;1,0000:05:00.0-2;2
Only the PFs are set via this mechanism. The VFs inherit their port types from their asso-
ciated PF.