Intel® oneAPI HPC Toolkit
Get help with building, analyzing, optimizing, and scaling high-performance computing (HPC) applications.
Announcements
Welcome to the Intel Community. If you get an answer you like, please mark it as an Accepted Solution to help others. Thank you!
1828 Discussions

How can I specify IB Adapter when using mpirun?

youn__kihang
Novice
404 Views

Hello everyone,

I have one question to ask, so I'm writing a post.
I would like to choose and use one of the Infiniband adapters.

In previous versions, it could be specified as follows,
I_MPI_OFA_ADAPTER_NAME mlx5_0
That option seems to have disappeared as it has been incorporated into OFI in recent versions.
What environment variable should I set in order to use mlx5_1?

If you have any comments, please tell us.

Thank you.

0 Kudos
1 Solution
PrasanthD_intel
Moderator
362 Views

Hi Kihang,


You can use the variable UCX_NET_DEVICES to select from available adapters.

For example: mpirun -np 2  -env UCX_NET_DEVICES=mlx5_1:1

Let us know if you face any issues.


Regards

Prasanth


View solution in original post

6 Replies
youn__kihang
Novice
377 Views

Here is ibstat result.

> ibstat
CA 'mlx5_0'
    CA type: MT4117
    Number of ports: 1
    Firmware version: 14.28.1002
    Port 1:
      State: Active
      Physical state: LinkUp
      Link layer: Ethernet
CA 'mlx5_1'
    CA type: MT4123
    Number of ports: 1
    Firmware version: 20.28.1002
    Port 1:
      State: Active
      Physical state: LinkUp
      Link layer: InfiniBand
CA 'mlx5_2'
    CA type: MT4117
    Number of ports: 1
    Firmware version: 14.28.1002
    Port 1:
      State: Active
      Physical state: LinkUp
      Link layer: Ethernet

PrasanthD_intel
Moderator
363 Views

Hi Kihang,


You can use the variable UCX_NET_DEVICES to select from available adapters.

For example: mpirun -np 2  -env UCX_NET_DEVICES=mlx5_1:1

Let us know if you face any issues.


Regards

Prasanth


View solution in original post

youn__kihang
Novice
332 Views

Using the environment variable you mentioned, I was able to use the adapter I wanted !!

One more thing, are there any Intel MPI options to check the name of the adapter in use?
I tried I_MPI_DEBUG=6 and I_MPI_HYBDA_DEBUG=ON, but the adapter name did not appear.

Thank you!

PrasanthD_intel
Moderator
329 Views

Hi Kihang,

You can set the variable UCX_LOG_LEVEL=info to check which adapter is being used.

eg:  UCX_LOG_LEVEL=info UCX_NET_DEVICES=mlx5_1:1 mpiexec.hydra -n 2 ./a.out

 

Let us know if you any other queries else we can close the thread.

Regards

Prasanth

youn__kihang
Novice
312 Views

All questions have been resolved.

Thank you!

PrasanthD_intel
Moderator
292 Views

Hi Kihang,


Thanks for the confirmation.

As the issue has been resolved, we will no longer respond to this thread. If you require additional assistance from Intel, please start a new thread. Any further interaction in this thread will be considered community only.


Regards

Prasanth


Reply