User Manual

Features Overview and ConfigurationRev 2.3-1.0.1
Mellanox Technologies
170
3.3.2 iSCSI Extensions for RDMA (iSER)
iSCSI Extensions for RDMA (iSER) extends the iSCSI protocol to RDMA. It permits data to be
transferred directly into and out of SCSI buffers without intermediate data copies.
3.3.2.1 iSER Initiator
Setting the iSER target is out of scope of this manual. For guidelines of how to do so,
please refer to the relevant target documentation (e.g. stgt, clitarget).
The iSER initiator is controlled through the iSCSI interface available from the iscsi-initiator-utils
package.
Make sure iSCSI is enabled and properly configured on your system before proceeding with
iSER. Additionally
, make sure you have RDMA connectivity between the initiator and the target.
rping -s [-vVd] [-S size] [-C count] [-a addr] [-p port]
Targets settings such as timeouts and retries are set the same as any other iSCSI targets.
If targets are set to auto connect on boot, and targets are unreachable, it may take a long
time to continue the boot process if timeouts and max retries are set too high.
Example for discovering and connecting targets over iSER:
iscsiadm -m discovery -o new -o old -t st -I iser -p <ip:port> -l
iSER also supports RoCE without any additional configuration required. To bond the RoCE
interfaces, set the
fail_over_mac option in the bonding driver (see Section 3.2.5.1.5, “Bond-
ing IPoIB”, on page 131).
For further information, please refer to Mellanox Community (http://community.mellanox.com/
community/solutions/content --> iSER).
3.3.3 Lustre
Lustre Compilation for MLNX_OFED:
This procedure applies to RHEL/SLES OSs supported by Lustre. For further information,
please refer to Lustre Release Notes.
 To compile Lustre version 2.4.0 and higher:
$ ./configure --with-o2ib=/usr/src/ofa_kernel/default/
$ make rpms
 To compile older Lustre versions:
$ EXTRA_LNET_INCLUDE="-I/usr/src/ofa_kernel/default/include/ -include /usr/src/
ofa_kernel/default/include/linux/compat-2.6.h" ./configure --with-o2ib=/usr/src/
ofa_kernel/default/
$ EXTRA_LNET_INCLUDE="-I/usr/src/ofa_kernel/default/include/ -include /usr/src/
ofa_kernel/default/include/linux/compat-2.6.h" make rpms