help run Fortran coarray programs with SLURM

AShte · ‎09-06-2017

I'm using ifort and mpiifort 17.0.1. Previously I was able to run Fortran coarray programs with PBS. Now I need to use SLURM, and I cannot adjust my old PBS scripts for this to work. I get lots of errors like this:

Error in system call pthread_mutex_unlock: Operation not permitted
    ../../src/mpid/ch3/channels/nemesis/netmod/tmi/tmi_poll.c:629

My coarray SLURM script is:

#!/bin/bash

#SBATCH --nodes=2
#SBATCH --tasks-per-node=28
#SBATCH --time=00:30:00
#SBATCH -p test

EXE=testABW.x
export I_MPI_COLL_INTRANODE=pt2pt
module load intel/2017.01
cd $SLURM_SUBMIT_DIR
echo -genvall -genv -np ${SLURM_NTASKS} ./$EXE > xx14.conf
srun -N ${SLURM_NNODES} --nodelist=${SLURM_NODELIST} /bin/hostname > nodes
./$EXE

The executable and the Intel coarray distributed memory config file are created according to Intel's instructions:

https://software.intel.com/en-us/articles/distributed-memory-coarray-fortran-with-the-intel-fortran-compiler-for-linux-essential

Again, all that's changed is that I need to use SLURM instead of PBS. The executable hasn't changed.

Thanks