how to run coarray programs with SLURM

AShte · ‎08-21-2017

I'm trying to port old (working) PBS scripts to SLURM, but not succeeding.

Can anybody share a working SLURM subscription script for coarray distributed memory please.

The best I can do is:

#!/bin/bash

#SBATCH --nodes=2
#SBATCH --tasks-per-node=28
#SBATCH --time=00:30:00
#SBATCH -p test

EXE=testABW.x
export I_MPI_COLL_INTRANODE=pt2pt
module load intel/2017.01
cd $SLURM_SUBMIT_DIR
echo -genvall -genv -np ${SLURM_NTASKS} ./$EXE > xx14.conf
srun -N ${SLURM_NNODES} --nodelist=${SLURM_NODELIST} /bin/hostname > nodes
./$EXE

which gives me:

Lmod has detected the following error: The following module(s) are unknown:
"languages/intel/2017.01"

Please check the spelling or version number. Also try "module spider ..."

Error in system call pthread_mutex_unlock: Operation not permitted
    ../../src/mpid/ch3/channels/nemesis/netmod/tmi/tmi_poll.c:629
Error in system call pthread_mutex_unlock: Operation not permitted
    ../../src/mpid/ch3/channels/nemesis/netmod/tmi/tmi_poll.c:629
Error in system call pthread_mutex_unlock: Operation not permitted
    ../../src/mpid/ch3/channels/nemesis/netmod/tmi/tmi_poll.c:629
Error in system call pthread_mutex_unlock: Operation not permitted
    ../../src/mpid/ch3/channels/nemesis/netmod/tmi/tmi_poll.c:629

Thanks!

Johannes_Rieke · ‎08-24-2017

Hi Anton, you might find help here: https://software.intel.com/en-us/forums/intel-clusters-and-hpc-technology/

At least, there is one thread related to SLURM (https://software.intel.com/en-us/forums/intel-clusters-and-hpc-technology/topic/737623), but not related to your special problem. A forum admin could push your thread there.

Regards, Johannes