Intel® HPC Toolkit
Get help with building, analyzing, optimizing, and scaling high-performance computing (HPC) applications.
2153 Discussions

selecting network interface to be used for mpirun

psing51
New Contributor I
6,067 Views

Hi,
I am trying to run an mpi application using paralle studio 2018 and centos 7. I have following 2 interfaces - 
eth0, ib0
I would like to use the eth0 interface. Is there a way to force the mpirun to use eth0 only ( or exclude ib0)?
Here is what i am using (an hoping eth0 is being used) -
export I_MPI_FALLBACK=0
export I_MPI_FABRICS=shm:tcp

Please let me know if more information is required from my end.





0 Kudos
1 Solution
AbhishekD_Intel
Moderator
6,045 Views

Hi Puneet,

 

To select a particular network interface you have to use -iface <net_interface> with mpirun.

So if you want to use TCP/IP capable network fabrics you have to set the environment variable I_MPI_OFI_PROVIDER=tcp and then I_MPI_FABRICS=<shm/ofi>.

 

If you want to launch mpirun job over different nodes then make sure that the network interface you are using should be in the same network as that of nodes you specified otherwise, it will give an error like "unable to find interface <name>".

 

So for selecting the network interface you can use the following command:

$ I_MPI_OFI_PROVIDER=tcp I_MPI_DEBUG=4 mpirun -genv I_MPI_FABRICS=shm:ofi -iface eth0 -n <no> -ppn <no> -f hostfile ./executable 

 

For more details please refer below links.

https://software.intel.com/content/www/us/en/develop/documentation/mpi-developer-guide-linux/top/running-applications/fabrics-control/selecting-fabrics.html

https://software.intel.com/content/www/us/en/develop/articles/tuning-the-intel-mpi-library-basic-techniques.html

 

 

Warm Regards,

Abhishek

 

View solution in original post

0 Kudos
7 Replies
psing51
New Contributor I
6,050 Views

I tried using following variables -
export I_MPI_FALLBACK=0
#export I_MPI_FABRICS=shm:tcp
export FI_SOCKETS_IFACE=eth0
export I_MPI_HYDRA_IFACE=eth0
export I_MPI_DEBUG=4
along with -
mpirun -iface eth0 -np $NTASKS -ppn $NTASKS_PER_NODE ./app.sh

but i saw message - 
[51] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[50] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[50] MPI startup(): shm and dapl data transfer modes

i guess this means that the eth0 was not used.

0 Kudos
AbhishekD_Intel
Moderator
6,046 Views

Hi Puneet,

 

To select a particular network interface you have to use -iface <net_interface> with mpirun.

So if you want to use TCP/IP capable network fabrics you have to set the environment variable I_MPI_OFI_PROVIDER=tcp and then I_MPI_FABRICS=<shm/ofi>.

 

If you want to launch mpirun job over different nodes then make sure that the network interface you are using should be in the same network as that of nodes you specified otherwise, it will give an error like "unable to find interface <name>".

 

So for selecting the network interface you can use the following command:

$ I_MPI_OFI_PROVIDER=tcp I_MPI_DEBUG=4 mpirun -genv I_MPI_FABRICS=shm:ofi -iface eth0 -n <no> -ppn <no> -f hostfile ./executable 

 

For more details please refer below links.

https://software.intel.com/content/www/us/en/develop/documentation/mpi-developer-guide-linux/top/running-applications/fabrics-control/selecting-fabrics.html

https://software.intel.com/content/www/us/en/develop/articles/tuning-the-intel-mpi-library-basic-techniques.html

 

 

Warm Regards,

Abhishek

 

0 Kudos
AbhishekD_Intel
Moderator
6,008 Views

Hi,


We have not heard back from you. Please give us an update if the provided details have helped you in solving your issue.


Warm Regards,

Abhishek


0 Kudos
psing51
New Contributor I
6,008 Views

Thank you for the reply.
I am in process of testing the suggestion.
I will test & update soon.

0 Kudos
AbhishekD_Intel
Moderator
6,003 Views

Thank you, Puneet,


Update us as soon as you will try it.



Warm Regards,

Abhishek


0 Kudos
AbhishekD_Intel
Moderator
5,979 Views

Hi,

Please give us an update on your issue. Let us know if the provided solution helped you.



Warm Regards,

Abhishek


0 Kudos
AbhishekD_Intel
Moderator
5,954 Views

Hi Puneet,


We are assuming that the solution provided helped and would no longer be monitoring this issue. Please raise a new thread if you have further issues.



Warm Regards,

Abhishek


0 Kudos
Reply