Intel® oneAPI HPC Toolkit
Get help with building, analyzing, optimizing, and scaling high-performance computing (HPC) applications.
1962 Discussions

How can I specify IB Adapter when using mpirun?

youn__kihang
Novice
686 Views

Hello everyone,

I have one question to ask, so I'm writing a post.
I would like to choose and use one of the Infiniband adapters.

In previous versions, it could be specified as follows,
I_MPI_OFA_ADAPTER_NAME mlx5_0
That option seems to have disappeared as it has been incorporated into OFI in recent versions.
What environment variable should I set in order to use mlx5_1?

If you have any comments, please tell us.

Thank you.

0 Kudos
1 Solution
PrasanthD_intel
Moderator
644 Views

Hi Kihang,


You can use the variable UCX_NET_DEVICES to select from available adapters.

For example: mpirun -np 2  -env UCX_NET_DEVICES=mlx5_1:1

Let us know if you face any issues.


Regards

Prasanth


View solution in original post

6 Replies
youn__kihang
Novice
659 Views

Here is ibstat result.

> ibstat
CA 'mlx5_0'
    CA type: MT4117
    Number of ports: 1
    Firmware version: 14.28.1002
    Port 1:
      State: Active
      Physical state: LinkUp
      Link layer: Ethernet
CA 'mlx5_1'
    CA type: MT4123
    Number of ports: 1
    Firmware version: 20.28.1002
    Port 1:
      State: Active
      Physical state: LinkUp
      Link layer: InfiniBand
CA 'mlx5_2'
    CA type: MT4117
    Number of ports: 1
    Firmware version: 14.28.1002
    Port 1:
      State: Active
      Physical state: LinkUp
      Link layer: Ethernet

PrasanthD_intel
Moderator
645 Views

Hi Kihang,


You can use the variable UCX_NET_DEVICES to select from available adapters.

For example: mpirun -np 2  -env UCX_NET_DEVICES=mlx5_1:1

Let us know if you face any issues.


Regards

Prasanth


youn__kihang
Novice
614 Views

Using the environment variable you mentioned, I was able to use the adapter I wanted !!

One more thing, are there any Intel MPI options to check the name of the adapter in use?
I tried I_MPI_DEBUG=6 and I_MPI_HYBDA_DEBUG=ON, but the adapter name did not appear.

Thank you!

PrasanthD_intel
Moderator
611 Views

Hi Kihang,

You can set the variable UCX_LOG_LEVEL=info to check which adapter is being used.

eg:  UCX_LOG_LEVEL=info UCX_NET_DEVICES=mlx5_1:1 mpiexec.hydra -n 2 ./a.out

 

Let us know if you any other queries else we can close the thread.

Regards

Prasanth

youn__kihang
Novice
594 Views

All questions have been resolved.

Thank you!

PrasanthD_intel
Moderator
574 Views

Hi Kihang,


Thanks for the confirmation.

As the issue has been resolved, we will no longer respond to this thread. If you require additional assistance from Intel, please start a new thread. Any further interaction in this thread will be considered community only.


Regards

Prasanth


Reply