This writeup is taken from the ChelsioT4 UnifiedWire Linux UserGuide (pdf) and trimmed for installation on RHEL5.4 or CentOS 5.4. But it should apply for other RHEL / CentOS versions
Installing Chelsio Software
1. Download the tarball specific to your operating system and architecture from our Software download site http://service.chelsio.com/
2. For RHEL 5.4, untar using the following command:
# tar -zxvf ChelsioUwire-1.1.0.10-RHEL-5.4-x86_64.tar.gz
3. Navigate to “ChelsioUwire-x.x.x.x” directory. Run the following command
# ./install.sh
4. Select „1‟ to install all Chelsio modules built against inbox OFED or select „2‟ to install OFED-1.5.3 and all Chelsio modules built against OFED-1.5.3.
5. Reboot system for changes to take effect.
6. Configure the network interface at /etc/sysconfig/network-scripts/ifcfg-ethx
Compiling and Loading of iWARP (RDMA) driver
To use the iWARP functionality with Chelsio adapters, user needs to install the iWARP drivers as well as the libcxgb4, libibverbs, and librdmacm libraries. Chelsio provides the iWARP drivers and libcxgb4 library as part of the driver package. The other libraries are provided as part of the Open Fabrics Enterprise Distribution (OFED) package.
# modprobe cxgb4 # modprobe iw_cxgb4 # modprobe rdma_ucm
# echo 1 >/sys/module/iw_cxgb4/parameters/peer2peer
Testing connectivity with ping and rping.
On the Server,
# rping -s -a server_ip_addr -p 9999
On the Client Server,
# rping -c –Vv -C10 -a server_ip_addr -p 9999
You should see ping data like this
ping data: rdma-ping-0: ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqr ping data: rdma-ping-1: BCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrs ping data: rdma-ping-2: CDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrst ping data: rdma-ping-3: DEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstu ping data: rdma-ping-4: EFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuv ping data: rdma-ping-5: FGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvw ping data: rdma-ping-6: GHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwx ping data: rdma-ping-7: HIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxy ping data: rdma-ping-8: IJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz ping data: rdma-ping-9: JKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyzA client DISCONNECT EVENT...