Analyzers
Talk to fellow users of Intel Analyzer tools (Intel VTune™ Profiler, Intel Advisor)

Is Intel MPI CUDA-aware?

SPAstef
Beginner
2,133 Views

Hello,

I am developing an MPI program where each processor will offload computation on GPUs. I am using  latest version of Intel Parallel Studio 2019 (Update 3 I think), and cuda unified memory system to have a more maintainable code. Unfortunately, results get quite non-deterministic, even with all the synchronizations mechanism active. After some search, I found it might be that Intel MPI doesen't recognize unified memory, so I should fallback to duplicate variables/allocations/tedious copies...

0 Kudos
3 Replies
Gamer__Nathan
Beginner
2,133 Views

I'm interested in the same thing! I'd like to hear some useful advise, thank You!

0 Kudos
SPAstef
Beginner
2,133 Views

Well, I personally ended up making 2 separate functions, the right one being selected at compile time with a flag... I don't know whether Parallel Studio 2020 MPI library supports this, I have not tried, but after making lots of tests, there would really be no point in using "legacy" allocation instead of UVA. In my specific case, it happened to actually be faster for smaller problem sizes, but then got closer and closer as the size grew, being at some point even surpassed. So: easier to write and similar/better when running!

0 Kudos
Shihab
Beginner
882 Views

still can't find this info

0 Kudos
Reply