User guide

Preface

InfiniBand® networking offers a high speed, low latency interconnect that is often a

requirement for High Performance Computing (HPC) networks. Combined with various

Ethernet and Fibre Channel gateways, this technology also offers a simplified multifabric I/O

to permit InfiniBand clients to access more traditional interconnects, using InfiniBand as the

single unifying infrastructure.

This paper introduces the various IBM®, Cisco, and QLogic InfiniBand components that are

available for IBM BladeCenter. These components include the internal 4X InfiniBand switch

and pass-thru modules, 4X host channel adapters, and Ethernet and Fibre Channel bridge

modules. We also introduce the external Cisco SFS 3012 Multifabric Server switch, which

provides scalable and robust Ethernet and Fibre Channel gateway connectivity to InfiniBand

clients. Lastly, we introduce general InfiniBand technology concepts.

Beyond product and general InfiniBand introductions, the paper provides a number of

step-by-step examples that show how to deploy these products, including how to install the

InfiniBand client software and configure the various switches and gateways to demonstrate

some of the many connection options that these solutions offer.

This paper is targeted at audiences that need an introduction to the available InfiniBand

connectivity options for the IBM BladeCenter H and a basic introduction to InfiniBand, as well

as for those who need specific information about how to implement these products.

The team that wrote this paper

This paper was produced by a team of specialists from around the world working at the

International Technical Support Organization (ITSO), Raleigh Center.

Khalid M Ansari is a member of the System x™ Advanced Technical Support team and the

technical team lead for the IBM Blade Infrastructure Solution Center in Research Triangle

Park, N.C. His responsibilities include assisting BladeCenter pre-sale customers with new

proof of concepts, solution assurance reviews, solution implementation and pilot testing. He

has extensive experience with BladeCenter SAN solutions and was a participant in

developing the IBM Storage Networking Solutions V1 Certification. Khalid started with IBM in

August 1998 as an ATM Networking Specialist in Level 2 support and later worked in SAN

solutions support. He is co-author of the IBM Redbooks® publications IBM BladeCenter 4Gb

SAN Solution and IBM BladeCenter iSCSI SAN Solution.

Robyn McGlotten is a development support engineer in the IBM BladeCenter Development

group in RTP, NC, and has six years of experience with IBM. She provides technical support

for IBM BladeCenter network products development and implementation. She is co-author of

the IBM Redpaper IBM eServer BladeCenter and TopSpin InfiniBand Switch Technology.

Robyn has a degree in electrical engineering from Florida A&M University.

Matt Slavin is a Consulting Engineer with Cisco Systems Strategic Alliances. He has been in

the computer and networking industry for more than 25 years, operating in numerous

high-level technical support capacities, and is the co-author of several IBM Redbooks

publications on deploying IBM BladeCenter® in Cisco-based infrastructures. His industry

certifications include MCSE, MCNE, CCNA, and CCIP. Matt’s current professional interests