I am using MKL (version 2024.2) for efficient C++ SGEMM functionality. During my testing, I have found that sometimes the SGEMM processing seems to dynamically allocate memory during its execution. The thing that seems strange is that things seem to perform as expected whether the dynamic allocation was successful or whether it failed. In fact, it seems that if the dynamic allocation fails and a NULL pointer is returned, the SGEMM still functions nearly identically.
After some discussion about how this could be, we thought maybe there was an internal "fallback" - so perhaps it tries to do the dynamic allocation, and if it succeeds, it performs a more efficient SGEMM, but if the allocation fails, it just falls back to a less efficient version that doesn't rely on the extra memory.
Of course, this is just a guess, but we were hoping to get some confirmation about the internal workings if possible. Mainly, we want to be sure that we don't just erroneously conclude that it is acceptable for the dynamic allocation to fail if there are ramifications beyond efficiency.
If there was any information about how failed dynamic allocations are handled within the SGEMM functionality, that would be nice to know too, if possible.
Thanks for your help!
