Community
cancel
Showing results for 
Search instead for 
Did you mean: 
Mingfei_M_Intel
Employee
55 Views

Parallel two medium size GEMM?

Hi, 

i have a special use case which needs to compute two independent GEMMs.

each one with a MNK in the range of [20~4000], on Xeon skylake 8180, only reaching 600~700 GFlops/sec.

from the algorithm level, the two GEMMs has no denpendency, so they can be launched in parallel.

how can i parallel these two GEMMs? say one socket for each one, perhaps. i suppose i can't use batch GEMM for this.

0 Kudos
1 Reply
Gennady_F_Intel
Moderator
55 Views

Hi, in that case you may try to explicitly set MKL_NUM_THREADS=#of physical treads/2 and try to call gemm at the same time. You need also properly set the affinity mask to avoid threads migration: export KMP_AFFINITY=compact,1,0,granularity=fine