I am suffering from a problem about pdgesv function in scalapack(C++).I have two computing nodes,each with 16 cores.The time spent solveing the linear Equation with pdgesv in two noodes is almost fifth times larger than running in single node using the same number of processes.
For example,A matrix is 1165*1165,and b matrix is 1165*30000.The job on single node with two processes takes almost 16 seconds while the job on two nodes each with one process takes more than 70 seconds.
I know the reason should be the communication between these two nodes,but why the gap is so big and how to narrow the gap?Could someone give me some suggestions?
