6. Install OFED for Windows
1) DownloadMLNX_OFED from Mellanox Web page.
2) Install MLNX_OFED Package.
7. IB Fabric Example
VM VM VM VM
VMware VMware
Windows Linux
Windows Linux
Windows Linux
40/56Gbit/s
Windows Linux
IP over Infiniband Network
High Speed Server Interconnect Fabric for Mixed PHYSICAL and VIRTUAL.
8. 10/40/56Gbit/s Benchmarks
RAMDISK SERVER SERVER RAMDISK
5.58 Gbit/sec
using
8.00 Gbit/sec THTTPD
13.68 Gbit/sec
RCOPY
18.23 Gbit/sec
SOURCE: SAKURA Internet Research Center. 12/2012 rev2 Project THORN.
9. IB Diagnostic Commands
# ibhosts *show InfiniBand host nodes in topology
Ca : 0x0002c9030010c36c ports 2 "hostname HCA-2"
Ca : 0x0002c9030010c360 ports 2 "hostname HCA-2"
Ca : 0x0002c9030010c328 ports 2 "sl6 HCA-1
# iblinkinfo *report link info for all links in the fabric
Switch 0x000b8cffff006f38 MT43132 Mellanox Technologies:
:
2 6[ ] ==( 4X 2.5 Gbps Active/ LinkUp)==> 8 1[ ] "sl6 HCA-1" ( )
2 7[ ] ==( 4X 2.5 Gbps Active/ LinkUp)==> 9 1[ ] "hostname HCA-2" ( )
2 8[ ] ==( 4X 2.5 Gbps Active/ LinkUp)==> 10 1[ ] "hostname HCA-2" ( )
# ibtracert 9 10 *trace InfiniBand path
From ca {0x0002c9030010c360} portnum 1 lid 9-9 "hostname HCA-2"
[1] -> switch port {0x000b8cffff006f38}[7] lid 2-2 "MT43132 Mellanox Technologies"
[8] -> ca port {0x0002c9030010c36d}[1] lid 10-10 "hostname HCA-2"
To ca {0x0002c9030010c36c} portnum 1 lid 10-10 "hostname HCA-2"