topic Dear Chulho K in Intel® MPI Library

Problem with NFS Over RDMA on OmniPath

Chulho_K_1 — Fri, 06 Apr 2018 05:21:03 GMT

I have been trying to setup NFS over RDMA on OmniPath following instruction in official document. IPoIB works fine, but I cannot get NFS over RDMA working. I have modified /etc/rdma/rdma.conf and added NFSoRDMA_LOAD=yes NFSoRDMA_PORT=2050 I have also loaded appropriate modules ( sunrpc on the client, xprtrdma on the server). However, the NFS mount fails (connection refused) when using RDMA to mount, note that it works fine if I do not specify rdma. It appears that the 2050 port for NFSoRDMA does not get created, when I do rpcinfo from the client to examine the server I see ports 2049 for nfs, but nothing for 2050. This is on CentOS 7.4. Any ideas/suggestions what may be wrong?

I think I have solved the

Chulho_K_1 — Sat, 07 Apr 2018 06:04:08 GMT

I think I have solved the problem:

I had to execute the following (in addition to the official instructions) to make this work:

rdma 2050 > /proc/fs/nfsd/portlist

This is on CentOS 7.4

Dear Chulho K

Kumar__Amit — Sat, 15 Sep 2018 14:14:33 GMT

Dear Chulho K

Can You Guide me how to configure omnipath nfs setup on both server and on client side with step by step i am new to this technology and what type of software requirement on both side..

One more question what is the correct way to configure openmpi and mvapich2 with omnipath

Please provide me suggestion

i will be gladful to you and intel Team

Regards

Amit