Intel® oneAPI HPC Toolkit
Get help with building, analyzing, optimizing, and scaling high-performance computing (HPC) applications.
Announcements
Welcome to the Intel Community. If you get an answer you like, please mark it as an Accepted Solution to help others. Thank you!

Comparing NUMA and MPI model

octogone
Beginner
233 Views

Hello!

Are MPI model and NUMA  [non-uniform memory architecture] mutually exclusive models? Can't MPI be used for a cluster with NUMA? What approach is the current trend?

Many thanks!

0 Kudos
2 Replies
TimP
Black Belt
233 Views

MPI is often run on multiple nodes, each node having NUMA architecture, but there's no necessary connection.  On a NUMA node, there is a possibility of aligning MPI ranks with NUMA partitions in hope of avoiding remote memory access, but it's not necessarily the best way.

Gergana_S_Intel
Employee
233 Views

Just to add to Tim's response slightly: we would recommend running a couple of MPI ranks on a single NUMA machine but the majority of MPI communication will be happening across multiple nodes.  On a single NUMA machine, it might be better to do OpenMP or some other threading methodology as that has less memory overhead/requirements.

This is, of course, all dependent on your application and how it best uses the resources it has available.  Any MPI library should be able to run in a single NUMA machine out of the box.

Regards,
~Gergana

Reply