mpirun : [Errno 2] No such file or directory

[glockner2]

Hello,

I use impi 3.0 on a Linu 64b Xeon cluster. On the service node, I am not able to run any program with mpirun :

mpirun -np 2 -v ./myprogram
running mpdallexit on service0
LAUNCHED mpd on service0 via
RUNNING: mpd on service0
problem with execution of ./myprogram on service0: [Errno 2] No such file or directory

Same error if I put the whole path to my program or a system program (for instance /bin/hostname).

It works on compute node perfectly.

$PATH seems fine :

/home/glockner/bin:/home/glockner/bin:/mnt/work/intel/impi/3.0/bin64:/mnt/work/intel/idbe/10.1.015/bin:/mnt/work/intel/cce/10.1.015/bin:/mnt/work/intel/fce/10.1.015/bin:.:/home/glockner/bin:/usr/pbs/bin:/usr/pbs/bin:/home/glockner/bin:/usr/local/bin:/usr/bin:/usr/X11R6/bin:/bin:/usr/games:/opt/gnome/bin:/opt/kde3/bin:/opt/c3/bin:/usr/lib/mit/bin:/usr/lib/mit/sbin:.:/opt/sgi/sbin:/opt/sgi/bin

as well as $LD_LIBRARY_PATH :

/mnt/work/intel/mkl/10.0.3.020/lib/em64t:/mnt/work/intel/impi/3.0/lib64:/mnt/work/intel/idbe/10.1.015/lib:/mnt/work/intel/cce/10.1.015/lib:/mnt/work/intel/fce/10.1.015/lib

Any help is welcome.
Thanks

Stphane

[Andrey_D_Intel]

Hi,

Could you provide content of your mpd.hosts file and output from the following commands:

$ mpdboot -n 2 -v -d

$ mpiexec -n 2 /bin/hostname

By the way, the Intel MPI Library 3.2 is available. Probably you may consider an upgrade.

Best regards,

Andrey

[glockner2]

Hi,

It seems that mpd.hosts file is not correct :

glockner@service0:/work/glockner/aqui0807c_elanion> cat mpd.hosts
service0
glockner@service0:/work/glockner/aqui0807c_elanion> hostname
service0

glockner@service0:~/aqui0807c_elanion> mpdboot -n 2 -v -d
debug: starting
totalnum=2 numhosts=1
there are not enough hosts on which to start all processes

glockner@service0:~/aqui0807c_elanion> mpiexec -n 2 /bin/hostname
mpiexec_service0: cannot connect to local mpd (/tmp/mpd2.console_glockner); possible causes:
1. no mpd is running on this host
2. an mpd is running but was started without a "console" (-n option)

OK to try version 3.2 (but we had problem with version 3.1 and PBSpro, and we had to use version 3.0)

Thanks
Stphane

Quoting - Andrey Derbunovich (Intel)

Hi,

Could you provide content of your mpd.hosts file and output from the following commands:

$ mpdboot -n 2 -v -d

$ mpiexec -n 2 /bin/hostname

By the way, the Intel MPI Library 3.2 is available. Probably you may consider an upgrade.

Best regards,

Andrey

[glockner2]

Another test :

glockner@service0:/work/glockner/aqui0807c_elanion> mpdboot -n 1 -v -d
debug: starting
running mpdallexit on service0
LAUNCHED mpd on service0 via
debug: launch cmd= /mnt/work/intel/impi/3.0/bin64/mpd.py --ncpus=1 --myhost=service0 -e -d
debug: mpd on service0 on port 57561
RUNNING: mpd on service0
debug: info for running mpd: {'ip': '10.148.0.66', 'ncpus': 1, 'list_port': 57561, 'entry_port': '', 'host': 'service0', 'entry_host': '', 'ifhn': ''}

glockner@service0:/work/glockner/aqui0807c_elanion> mpiexec -n 2 /bin/hostname
problem with execution of /bin/hostname on service0: [Errno 2] No such file or directory
problem with execution of /bin/hostname on service0: [Errno 2] No such file or directory

Quoting - Andrey Derbunovich (Intel)

Hi,

Could you provide content of your mpd.hosts file and output from the following commands:

$ mpdboot -n 2 -v -d

$ mpiexec -n 2 /bin/hostname

By the way, the Intel MPI Library 3.2 is available. Probably you may consider an upgrade.

Best regards,

Andrey