External library (Mellanox Infiniband SHARP)

[youn__kihang]

Hi All,

I have a question to ask about external library.
While looking at various materials, I found out about the communication method called the SHARP(Scalable Hierarchical Aggregation and Reduction Protocol), so I'd like to ask if Intel MPI supports this external library.
I found the option to use the UCX HCOLL library in the following posting, and I would like to know if SHARP is supported similarly.

https://www.intel.com/content/www/us/en/develop/articles/improve-performance-and-stability-with-intel-mpi-library-on-infiniband.html

If not, could you tell me if you are planning to apply in the future?

Best Regards,
Kihang

[PrasanthD_intel · Accepted solution]

Hi Kihang,

Based on the documentation of Intel MPI we didn't find any references of SHARP as of now.

We are transferring your request to the concerned team.

Regards

Prasanth

[youn__kihang]

Hi Prasanth,

Thank you for your response.
Please close the case. :-)

Best Regards,
Kihang

[Michael_Intel]

Hi Kihang,

We do implicitly leverage SHARP via HCOLL.

Therefore setting I_MPI_COLL_EXTERNAL as described in the article you mentioned is sufficient.

Best regards,

Michael

[youn__kihang]

Hi Michael,

Thank you for your response.
I don't intend to advertise SHARP here (because I haven't experienced the exact functionality), but mellanox says that HCOLL and SHARP are different.
For example, SHARP has the difference of using a specific daemon (sharpd), and their material promotes the performance difference between regular HPCX and HPCX+SHARP.
as you said, we will proceed with the test using HCOLL.

Thank you.

Best Regards,
Kihang