host: cn003 host: cn171 ================================================================================================== mpiexec options: ---------------- Base path: /home/soft/intel2015//impi/5.0.3.048/intel64/bin/ Launcher: ssh Debug level: 1 Enable X: -1 Global environment: ------------------- I_MPI_PERHOST=allcores LD_LIBRARY_PATH=/home/soft/intel2015//impi/5.0.3.048/intel64/lib:/home/soft/intel2015//itac/9.0.3.051/mic/slib:/home/soft/intel2015//itac/9.0.3.051/intel64/slib:/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/mpirt/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/ipp/../compiler/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/ipp/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/ipp/tools/intel64/perfsys:/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/mkl/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/tbb/lib/intel64/gcc4.4:/home/soft/intel2015/composer_xe_2015.3.187/debugger/libipt/intel64/lib:/home/soft/intel2015//impi/5.0.3.048/intel64/lib:/home/soft/intel2015//impi/5.0.3.048/mic/lib MKLROOT=/home/soft/intel2015/composer_xe_2015.3.187/mkl MANPATH=/home/soft/intel2015//impi/5.0.3.048/man:/home/soft/intel2015//itac/9.0.3.051/man:/home/soft/intel2015/composer_xe_2015.3.187/man/en_US:/home/soft/intel2015/composer_xe_2015.3.187/man/en_US:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64/share/man/:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/man/:/usr/share/man INSPECTOR_2015_DIR=/home/soft/intel2015/inspector_xe_2015.1.2.379161 GDB_HOST=/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin/gdb-ia-mic VT_MPI=impi4 HOSTNAME=cn003 IPPROOT=/home/soft/intel2015/composer_xe_2015.3.187/ipp INTEL_LICENSE_FILE=28518@licmngr2.org.in:/home/soft/intel2015/licenses:/opt/intel/licenses:/root/intel/licenses:/home/soft/intel2015/composer_xe_2015.3.187/licenses:/opt/intel/licenses:/root/intel/licenses SHELL=/bin/bash HISTSIZE=1000 GDBSERVER_MIC=/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/target/mic/bin/gdbserver TMPDIR=/var/tmp/pbs.268890.hn1 PBS_JOBNAME=NPB_N4_TPP24 LIBRARY_PATH=/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/ipp/../compiler/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/ipp/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/mkl/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/tbb/lib/intel64/gcc4.4 PBS_ENVIRONMENT=PBS_BATCH QTDIR=/usr/lib64/qt-3.3 QTINC=/usr/lib64/qt-3.3/include MIC_LD_LIBRARY_PATH=/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/mic:/home/soft/intel2015/composer_xe_2015.3.187/mpirt/lib/mic:/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/mic:/home/soft/intel2015/composer_xe_2015.3.187/mkl/lib/mic:/home/soft/intel2015/composer_xe_2015.3.187/tbb/lib/mic PBS_O_WORKDIR=/home/puneets/AppBench/NPB/NPB3.3.1/NPB3.3-MPI/bin NCPUS=24 PBS_TASKNUM=1 USER=puneets PBS_O_HOME=/home/puneets I_MPI_MPIRUN=mpirun VTUNE_AMPLIFIER_XE_2015_DIR=/home/soft/intel2015/vtune_amplifier_xe_2015.3.0.403110 MIC_LIBRARY_PATH=/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/mic:/home/soft/intel2015/composer_xe_2015.3.187/mpirt/lib/mic:/home/soft/intel2015/composer_xe_2015.3.187/tbb/lib/mic CPATH=/home/soft/intel2015/composer_xe_2015.3.187/ipp/include:/home/soft/intel2015/composer_xe_2015.3.187/mkl/include:/home/soft/intel2015/composer_xe_2015.3.187/tbb/include PBS_MOMPORT=15003 PBS_O_QUEUE=test NLSPATH=/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/intel64/locale/%l_%t/%N:/home/soft/intel2015/composer_xe_2015.3.187/ipp/lib/intel64/locale/%l_%t/%N:/home/soft/intel2015/composer_xe_2015.3.187/mkl/lib/intel64/locale/%l_%t/%N:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/locale/%l_%t/%N:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64/share/locale/%l_%t/%N VT_ADD_LIBS=-ldwarf -lelf -lvtunwind -lnsl -lm -ldl -lpthread MAIL=/var/spool/mail/puneets PATH=/home/soft/intel2015/bin:/home/soft/intel2015/advisor_xe_2015.1.10.380555/bin64:/home/soft/intel2015/vtune_amplifier_xe_2015.3.0.403110/bin64:/home/soft/intel2015/inspector_xe_2015.1.2.379161/bin64:/home/soft/intel2015//impi/5.0.3.048/intel64/bin:/home/soft/intel2015//itac/9.0.3.051/intel64/bin:/home/soft/intel2015/composer_xe_2015.3.187/bin/intel64:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin:/usr/lib64/qt-3.3/bin:/usr/kerberos/sbin:/usr/kerberos/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/opt/pbs/default/bin/:/home/puneets/bin PBS_O_LOGNAME=puneets PBS_O_LANG=en_IN PBS_JOBCOOKIE=000000001D40A11D000000001766A208 TBBROOT=/home/soft/intel2015/composer_xe_2015.3.187/tbb MLM_LICENSE_FILE=27000@licmngr1.org.in,27000@licmngr2.org.in,27000@licmanager.cse.org.in PWD=/home/puneets/AppBench/NPB/NPB3.3.1/NPB3.3-MPI/bin _LMFILES_=/home/soft/modules/suite/intel/parallelStudio GDB_CROSS=/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin/gdb-mic LANG=en_US.UTF-8 PBS_NODENUM=0 ADVISOR_XE_2015_DIR=/home/soft/intel2015/advisor_xe_2015.1.10.380555 MODULEPATH=/usr/share/Modules/modulefiles:/etc/modulefiles:/opt/mellanox/bupc/2.18.0/modules:/home/soft/modules I_MPI_HYDRA_RMK=pbs VT_LIB_DIR=/home/soft/intel2015//itac/9.0.3.051/intel64/lib LOADEDMODULES=suite/intel/parallelStudio PBS_JOBDIR=/home/pbs/pbs.268890.hn1.x8z TZ=Asia/Kolkata PBS_O_SHELL=/bin/bash VT_ROOT=/home/soft/intel2015//itac/9.0.3.051 PBS_JOBID=268890.hn1 MPM_LAUNCHER=/home/soft/intel2015/composer_xe_2015.3.187/debugger/mpm/bin/start_mpm.sh HISTCONTROL=ignoredups ENVIRONMENT=BATCH INTEL_PYTHONHOME=/home/soft/intel2015/composer_xe_2015.3.187/debugger/python/intel64/ SHLVL=3 HOME=/home/puneets PBS_NCPUS=24 PBS_O_HOST=miclogin02 VT_SLIB_DIR=/home/soft/intel2015//itac/9.0.3.051/intel64/slib VT_ARCH=intel64 MPI_ROOT=/home/soft/intel2015/impi/5.0.3.048 LOGNAME=puneets QTLIB=/usr/lib64/qt-3.3/lib CVS_RSH=ssh PBS_NTASKS=48 CLASSPATH=/home/soft/intel2015//itac/9.0.3.051/intel64/lib PBS_QUEUE=test MODULESHOME=/usr/share/Modules LESSOPEN=||/usr/bin/lesspipe.sh %s OMP_NUM_THREADS=12 PBS_O_MAIL=/var/spool/mail/puneets INFOPATH=/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64/share/info/:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/info/ PBS_NCHUNKS=2 Mail_Pt=n PBS_O_SYSTEM=Linux SCRATCH=/home/puneets G_BROKEN_FILENAMES=1 PBS_NODEFILE=/var/spool/PBS/aux/268890.hn1 I_MPI_ROOT=/home/soft/intel2015//impi/5.0.3.048 PBS_O_PATH=/home/soft/intel2015/bin:/home/soft/intel2015/advisor_xe_2015.1.10.380555/bin64:/home/soft/intel2015/vtune_amplifier_xe_2015.3.0.403110/bin64:/home/soft/intel2015/inspector_xe_2015.1.2.379161/bin64:/home/soft/intel2015//impi/5.0.3.048/intel64/bin:/home/soft/intel2015//itac/9.0.3.051/intel64/bin:/home/soft/intel2015/composer_xe_2015.3.187/bin/intel64:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin:/usr/lib64/qt-3.3/bin:/opt/pbs/default/bin:/opt/pbs/default/sbin:/usr/kerberos/sbin:/usr/kerberos/bin:/opt/pbs/default/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/opt/pbs/default/bin/:/home/puneets/bin BASH_FUNC_module()=() { eval `/usr/bin/modulecmd bash $*` } _=/home/soft/intel2015//impi/5.0.3.048/intel64/bin/mpiexec.hydra Hydra internal environment: --------------------------- MPIR_CVAR_NEMESIS_ENABLE_CKPOINT=1 GFORTRAN_UNBUFFERED_PRECONNECTED=y User set environment: --------------------- I_MPI_HYDRA_DEBUG=1 OMP_NUM_THREADS=12 I_MPI_DEBUG=5 Proxy information: ********************* [1] proxy: cn003 (2 cores) Exec list: ./bt.E.4.mpi_io_full (2 processes); [2] proxy: cn171 (2 cores) Exec list: ./bt.E.4.mpi_io_full (2 processes); ================================================================================================== [mpiexec@cn003] Timeout set to -1 (-1 means infinite) [mpiexec@cn003] Got a control port string of cn003:39349 Proxy launch args: /home/soft/intel2015//impi/5.0.3.048/intel64/bin/pmi_proxy --control-port cn003:39349 --debug --pmi-connect lazy-cache --pmi-aggregate -s 0 --rmk user --launcher ssh --demux poll --pgid 0 --enable-stdin 1 --retries 10 --control-code 14548498 --usize -2 --proxy-id Arguments being passed to proxy 0: --version 3.1.2 --iface-ip-env-name MPIR_CVAR_CH3_INTERFACE_HOSTNAME --hostname cn003 --global-core-map 0,2,4 --pmi-id-map 0,0 --global-process-count 4 --auto-cleanup 1 --pmi-kvsname kvs_16929_0 --pmi-process-mapping (vector,(0,2,2)) --binding omp=12 --topolib ipl --ckpointlib blcr --ckpoint-prefix /tmp --ckpoint-preserve 1 --ckpoint off --ckpoint-num -1 --global-inherited-env 87 'I_MPI_PERHOST=allcores' 'LD_LIBRARY_PATH=/home/soft/intel2015//impi/5.0.3.048/intel64/lib:/home/soft/intel2015//itac/9.0.3.051/mic/slib:/home/soft/intel2015//itac/9.0.3.051/intel64/slib:/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/mpirt/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/ipp/../compiler/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/ipp/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/ipp/tools/intel64/perfsys:/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/mkl/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/tbb/lib/intel64/gcc4.4:/home/soft/intel2015/composer_xe_2015.3.187/debugger/libipt/intel64/lib:/home/soft/intel2015//impi/5.0.3.048/intel64/lib:/home/soft/intel2015//impi/5.0.3.048/mic/lib' 'MKLROOT=/home/soft/intel2015/composer_xe_2015.3.187/mkl' 'MANPATH=/home/soft/intel2015//impi/5.0.3.048/man:/home/soft/intel2015//itac/9.0.3.051/man:/home/soft/intel2015/composer_xe_2015.3.187/man/en_US:/home/soft/intel2015/composer_xe_2015.3.187/man/en_US:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64/share/man/:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/man/:/usr/share/man' 'INSPECTOR_2015_DIR=/home/soft/intel2015/inspector_xe_2015.1.2.379161' 'GDB_HOST=/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin/gdb-ia-mic' 'VT_MPI=impi4' 'HOSTNAME=cn003' 'IPPROOT=/home/soft/intel2015/composer_xe_2015.3.187/ipp' 'INTEL_LICENSE_FILE=28518@licmngr2.org.in:/home/soft/intel2015/licenses:/opt/intel/licenses:/root/intel/licenses:/home/soft/intel2015/composer_xe_2015.3.187/licenses:/opt/intel/licenses:/root/intel/licenses' 'SHELL=/bin/bash' 'HISTSIZE=1000' 'GDBSERVER_MIC=/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/target/mic/bin/gdbserver' 'TMPDIR=/var/tmp/pbs.268890.hn1' 'PBS_JOBNAME=NPB_N4_TPP24' 'LIBRARY_PATH=/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/ipp/../compiler/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/ipp/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/mkl/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/tbb/lib/intel64/gcc4.4' 'PBS_ENVIRONMENT=PBS_BATCH' 'QTDIR=/usr/lib64/qt-3.3' 'QTINC=/usr/lib64/qt-3.3/include' 'MIC_LD_LIBRARY_PATH=/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/mic:/home/soft/intel2015/composer_xe_2015.3.187/mpirt/lib/mic:/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/mic:/home/soft/intel2015/composer_xe_2015.3.187/mkl/lib/mic:/home/soft/intel2015/composer_xe_2015.3.187/tbb/lib/mic' 'PBS_O_WORKDIR=/home/puneets/AppBench/NPB/NPB3.3.1/NPB3.3-MPI/bin' 'NCPUS=24' 'PBS_TASKNUM=1' 'USER=puneets' 'PBS_O_HOME=/home/puneets' 'I_MPI_MPIRUN=mpirun' 'VTUNE_AMPLIFIER_XE_2015_DIR=/home/soft/intel2015/vtune_amplifier_xe_2015.3.0.403110' 'MIC_LIBRARY_PATH=/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/mic:/home/soft/intel2015/composer_xe_2015.3.187/mpirt/lib/mic:/home/soft/intel2015/composer_xe_2015.3.187/tbb/lib/mic' 'CPATH=/home/soft/intel2015/composer_xe_2015.3.187/ipp/include:/home/soft/intel2015/composer_xe_2015.3.187/mkl/include:/home/soft/intel2015/composer_xe_2015.3.187/tbb/include' 'PBS_MOMPORT=15003' 'PBS_O_QUEUE=test' 'NLSPATH=/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/intel64/locale/%l_%t/%N:/home/soft/intel2015/composer_xe_2015.3.187/ipp/lib/intel64/locale/%l_%t/%N:/home/soft/intel2015/composer_xe_2015.3.187/mkl/lib/intel64/locale/%l_%t/%N:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/locale/%l_%t/%N:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64/share/locale/%l_%t/%N' 'VT_ADD_LIBS=-ldwarf -lelf -lvtunwind -lnsl -lm -ldl -lpthread' 'MAIL=/var/spool/mail/puneets' 'PATH=/home/soft/intel2015/bin:/home/soft/intel2015/advisor_xe_2015.1.10.380555/bin64:/home/soft/intel2015/vtune_amplifier_xe_2015.3.0.403110/bin64:/home/soft/intel2015/inspector_xe_2015.1.2.379161/bin64:/home/soft/intel2015//impi/5.0.3.048/intel64/bin:/home/soft/intel2015//itac/9.0.3.051/intel64/bin:/home/soft/intel2015/composer_xe_2015.3.187/bin/intel64:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin:/usr/lib64/qt-3.3/bin:/usr/kerberos/sbin:/usr/kerberos/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/opt/pbs/default/bin/:/home/puneets/bin' 'PBS_O_LOGNAME=puneets' 'PBS_O_LANG=en_IN' 'PBS_JOBCOOKIE=000000001D40A11D000000001766A208' 'TBBROOT=/home/soft/intel2015/composer_xe_2015.3.187/tbb' 'MLM_LICENSE_FILE=27000@licmngr1.org.in,27000@licmngr2.org.in,27000@licmanager.cse.org.in' 'PWD=/home/puneets/AppBench/NPB/NPB3.3.1/NPB3.3-MPI/bin' '_LMFILES_=/home/soft/modules/suite/intel/parallelStudio' 'GDB_CROSS=/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin/gdb-mic' 'LANG=en_US.UTF-8' 'PBS_NODENUM=0' 'ADVISOR_XE_2015_DIR=/home/soft/intel2015/advisor_xe_2015.1.10.380555' 'MODULEPATH=/usr/share/Modules/modulefiles:/etc/modulefiles:/opt/mellanox/bupc/2.18.0/modules:/home/soft/modules' 'I_MPI_HYDRA_RMK=pbs' 'VT_LIB_DIR=/home/soft/intel2015//itac/9.0.3.051/intel64/lib' 'LOADEDMODULES=suite/intel/parallelStudio' 'PBS_JOBDIR=/home/pbs/pbs.268890.hn1.x8z' 'TZ=Asia/Kolkata' 'PBS_O_SHELL=/bin/bash' 'VT_ROOT=/home/soft/intel2015//itac/9.0.3.051' 'PBS_JOBID=268890.hn1' 'MPM_LAUNCHER=/home/soft/intel2015/composer_xe_2015.3.187/debugger/mpm/bin/start_mpm.sh' 'HISTCONTROL=ignoredups' 'ENVIRONMENT=BATCH' 'INTEL_PYTHONHOME=/home/soft/intel2015/composer_xe_2015.3.187/debugger/python/intel64/' 'SHLVL=3' 'HOME=/home/puneets' 'PBS_NCPUS=24' 'PBS_O_HOST=miclogin02' 'VT_SLIB_DIR=/home/soft/intel2015//itac/9.0.3.051/intel64/slib' 'VT_ARCH=intel64' 'MPI_ROOT=/home/soft/intel2015/impi/5.0.3.048' 'LOGNAME=puneets' 'QTLIB=/usr/lib64/qt-3.3/lib' 'CVS_RSH=ssh' 'PBS_NTASKS=48' 'CLASSPATH=/home/soft/intel2015//itac/9.0.3.051/intel64/lib' 'PBS_QUEUE=test' 'MODULESHOME=/usr/share/Modules' 'LESSOPEN=||/usr/bin/lesspipe.sh %s' 'OMP_NUM_THREADS=12' 'PBS_O_MAIL=/var/spool/mail/puneets' 'INFOPATH=/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64/share/info/:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/info/' 'PBS_NCHUNKS=2' 'Mail_Pt=n' 'PBS_O_SYSTEM=Linux' 'SCRATCH=/home/puneets' 'G_BROKEN_FILENAMES=1' 'PBS_NODEFILE=/var/spool/PBS/aux/268890.hn1' 'I_MPI_ROOT=/home/soft/intel2015//impi/5.0.3.048' 'PBS_O_PATH=/home/soft/intel2015/bin:/home/soft/intel2015/advisor_xe_2015.1.10.380555/bin64:/home/soft/intel2015/vtune_amplifier_xe_2015.3.0.403110/bin64:/home/soft/intel2015/inspector_xe_2015.1.2.379161/bin64:/home/soft/intel2015//impi/5.0.3.048/intel64/bin:/home/soft/intel2015//itac/9.0.3.051/intel64/bin:/home/soft/intel2015/composer_xe_2015.3.187/bin/intel64:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin:/usr/lib64/qt-3.3/bin:/opt/pbs/default/bin:/opt/pbs/default/sbin:/usr/kerberos/sbin:/usr/kerberos/bin:/opt/pbs/default/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/opt/pbs/default/bin/:/home/puneets/bin' 'BASH_FUNC_module()=() { eval `/usr/bin/modulecmd bash $*` }' '_=/home/soft/intel2015//impi/5.0.3.048/intel64/bin/mpiexec.hydra' --global-user-env 3 'I_MPI_HYDRA_DEBUG=1' 'OMP_NUM_THREADS=12' 'I_MPI_DEBUG=5' --global-system-env 2 'MPIR_CVAR_NEMESIS_ENABLE_CKPOINT=1' 'GFORTRAN_UNBUFFERED_PRECONNECTED=y' --proxy-core-count 2 --mpi-cmd-env mpirun -np 4 -hostfile /var/spool/PBS/aux/268890.hn1 -genv I_MPI_HYDRA_DEBUG=1 -genv OMP_NUM_THREADS=12 -genv I_MPI_DEBUG=5 -ppn 2 ./bt.E.4.mpi_io_full --exec --exec-appnum 0 --exec-proc-count 2 --exec-local-env 0 --exec-wdir /home/puneets/AppBench/NPB/NPB3.3.1/NPB3.3-MPI/bin --exec-args 1 ./bt.E.4.mpi_io_full Arguments being passed to proxy 1: --version 3.1.2 --iface-ip-env-name MPIR_CVAR_CH3_INTERFACE_HOSTNAME --hostname cn171 --global-core-map 0,2,4 --pmi-id-map 0,2 --global-process-count 4 --auto-cleanup 1 --pmi-kvsname kvs_16929_0 --pmi-process-mapping (vector,(0,2,2)) --binding omp=12 --topolib ipl --ckpointlib blcr --ckpoint-prefix /tmp --ckpoint-preserve 1 --ckpoint off --ckpoint-num -1 --global-inherited-env 87 'I_MPI_PERHOST=allcores' 'LD_LIBRARY_PATH=/home/soft/intel2015//impi/5.0.3.048/intel64/lib:/home/soft/intel2015//itac/9.0.3.051/mic/slib:/home/soft/intel2015//itac/9.0.3.051/intel64/slib:/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/mpirt/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/ipp/../compiler/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/ipp/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/ipp/tools/intel64/perfsys:/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/mkl/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/tbb/lib/intel64/gcc4.4:/home/soft/intel2015/composer_xe_2015.3.187/debugger/libipt/intel64/lib:/home/soft/intel2015//impi/5.0.3.048/intel64/lib:/home/soft/intel2015//impi/5.0.3.048/mic/lib' 'MKLROOT=/home/soft/intel2015/composer_xe_2015.3.187/mkl' 'MANPATH=/home/soft/intel2015//impi/5.0.3.048/man:/home/soft/intel2015//itac/9.0.3.051/man:/home/soft/intel2015/composer_xe_2015.3.187/man/en_US:/home/soft/intel2015/composer_xe_2015.3.187/man/en_US:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64/share/man/:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/man/:/usr/share/man' 'INSPECTOR_2015_DIR=/home/soft/intel2015/inspector_xe_2015.1.2.379161' 'GDB_HOST=/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin/gdb-ia-mic' 'VT_MPI=impi4' 'HOSTNAME=cn003' 'IPPROOT=/home/soft/intel2015/composer_xe_2015.3.187/ipp' 'INTEL_LICENSE_FILE=28518@licmngr2.org.in:/home/soft/intel2015/licenses:/opt/intel/licenses:/root/intel/licenses:/home/soft/intel2015/composer_xe_2015.3.187/licenses:/opt/intel/licenses:/root/intel/licenses' 'SHELL=/bin/bash' 'HISTSIZE=1000' 'GDBSERVER_MIC=/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/target/mic/bin/gdbserver' 'TMPDIR=/var/tmp/pbs.268890.hn1' 'PBS_JOBNAME=NPB_N4_TPP24' 'LIBRARY_PATH=/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/ipp/../compiler/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/ipp/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/mkl/lib/intel64:/home/soft/intel2015/composer_xe_2015.3.187/tbb/lib/intel64/gcc4.4' 'PBS_ENVIRONMENT=PBS_BATCH' 'QTDIR=/usr/lib64/qt-3.3' 'QTINC=/usr/lib64/qt-3.3/include' 'MIC_LD_LIBRARY_PATH=/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/mic:/home/soft/intel2015/composer_xe_2015.3.187/mpirt/lib/mic:/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/mic:/home/soft/intel2015/composer_xe_2015.3.187/mkl/lib/mic:/home/soft/intel2015/composer_xe_2015.3.187/tbb/lib/mic' 'PBS_O_WORKDIR=/home/puneets/AppBench/NPB/NPB3.3.1/NPB3.3-MPI/bin' 'NCPUS=24' 'PBS_TASKNUM=1' 'USER=puneets' 'PBS_O_HOME=/home/puneets' 'I_MPI_MPIRUN=mpirun' 'VTUNE_AMPLIFIER_XE_2015_DIR=/home/soft/intel2015/vtune_amplifier_xe_2015.3.0.403110' 'MIC_LIBRARY_PATH=/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/mic:/home/soft/intel2015/composer_xe_2015.3.187/mpirt/lib/mic:/home/soft/intel2015/composer_xe_2015.3.187/tbb/lib/mic' 'CPATH=/home/soft/intel2015/composer_xe_2015.3.187/ipp/include:/home/soft/intel2015/composer_xe_2015.3.187/mkl/include:/home/soft/intel2015/composer_xe_2015.3.187/tbb/include' 'PBS_MOMPORT=15003' 'PBS_O_QUEUE=test' 'NLSPATH=/home/soft/intel2015/composer_xe_2015.3.187/compiler/lib/intel64/locale/%l_%t/%N:/home/soft/intel2015/composer_xe_2015.3.187/ipp/lib/intel64/locale/%l_%t/%N:/home/soft/intel2015/composer_xe_2015.3.187/mkl/lib/intel64/locale/%l_%t/%N:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/locale/%l_%t/%N:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64/share/locale/%l_%t/%N' 'VT_ADD_LIBS=-ldwarf -lelf -lvtunwind -lnsl -lm -ldl -lpthread' 'MAIL=/var/spool/mail/puneets' 'PATH=/home/soft/intel2015/bin:/home/soft/intel2015/advisor_xe_2015.1.10.380555/bin64:/home/soft/intel2015/vtune_amplifier_xe_2015.3.0.403110/bin64:/home/soft/intel2015/inspector_xe_2015.1.2.379161/bin64:/home/soft/intel2015//impi/5.0.3.048/intel64/bin:/home/soft/intel2015//itac/9.0.3.051/intel64/bin:/home/soft/intel2015/composer_xe_2015.3.187/bin/intel64:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin:/usr/lib64/qt-3.3/bin:/usr/kerberos/sbin:/usr/kerberos/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/opt/pbs/default/bin/:/home/puneets/bin' 'PBS_O_LOGNAME=puneets' 'PBS_O_LANG=en_IN' 'PBS_JOBCOOKIE=000000001D40A11D000000001766A208' 'TBBROOT=/home/soft/intel2015/composer_xe_2015.3.187/tbb' 'MLM_LICENSE_FILE=27000@licmngr1.org.in,27000@licmngr2.org.in,27000@licmanager.cse.org.in' 'PWD=/home/puneets/AppBench/NPB/NPB3.3.1/NPB3.3-MPI/bin' '_LMFILES_=/home/soft/modules/suite/intel/parallelStudio' 'GDB_CROSS=/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin/gdb-mic' 'LANG=en_US.UTF-8' 'PBS_NODENUM=0' 'ADVISOR_XE_2015_DIR=/home/soft/intel2015/advisor_xe_2015.1.10.380555' 'MODULEPATH=/usr/share/Modules/modulefiles:/etc/modulefiles:/opt/mellanox/bupc/2.18.0/modules:/home/soft/modules' 'I_MPI_HYDRA_RMK=pbs' 'VT_LIB_DIR=/home/soft/intel2015//itac/9.0.3.051/intel64/lib' 'LOADEDMODULES=suite/intel/parallelStudio' 'PBS_JOBDIR=/home/pbs/pbs.268890.hn1.x8z' 'TZ=Asia/Kolkata' 'PBS_O_SHELL=/bin/bash' 'VT_ROOT=/home/soft/intel2015//itac/9.0.3.051' 'PBS_JOBID=268890.hn1' 'MPM_LAUNCHER=/home/soft/intel2015/composer_xe_2015.3.187/debugger/mpm/bin/start_mpm.sh' 'HISTCONTROL=ignoredups' 'ENVIRONMENT=BATCH' 'INTEL_PYTHONHOME=/home/soft/intel2015/composer_xe_2015.3.187/debugger/python/intel64/' 'SHLVL=3' 'HOME=/home/puneets' 'PBS_NCPUS=24' 'PBS_O_HOST=miclogin02' 'VT_SLIB_DIR=/home/soft/intel2015//itac/9.0.3.051/intel64/slib' 'VT_ARCH=intel64' 'MPI_ROOT=/home/soft/intel2015/impi/5.0.3.048' 'LOGNAME=puneets' 'QTLIB=/usr/lib64/qt-3.3/lib' 'CVS_RSH=ssh' 'PBS_NTASKS=48' 'CLASSPATH=/home/soft/intel2015//itac/9.0.3.051/intel64/lib' 'PBS_QUEUE=test' 'MODULESHOME=/usr/share/Modules' 'LESSOPEN=||/usr/bin/lesspipe.sh %s' 'OMP_NUM_THREADS=12' 'PBS_O_MAIL=/var/spool/mail/puneets' 'INFOPATH=/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64/share/info/:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/share/info/' 'PBS_NCHUNKS=2' 'Mail_Pt=n' 'PBS_O_SYSTEM=Linux' 'SCRATCH=/home/puneets' 'G_BROKEN_FILENAMES=1' 'PBS_NODEFILE=/var/spool/PBS/aux/268890.hn1' 'I_MPI_ROOT=/home/soft/intel2015//impi/5.0.3.048' 'PBS_O_PATH=/home/soft/intel2015/bin:/home/soft/intel2015/advisor_xe_2015.1.10.380555/bin64:/home/soft/intel2015/vtune_amplifier_xe_2015.3.0.403110/bin64:/home/soft/intel2015/inspector_xe_2015.1.2.379161/bin64:/home/soft/intel2015//impi/5.0.3.048/intel64/bin:/home/soft/intel2015//itac/9.0.3.051/intel64/bin:/home/soft/intel2015/composer_xe_2015.3.187/bin/intel64:/home/soft/intel2015/composer_xe_2015.3.187/debugger/gdb/intel64_mic/bin:/usr/lib64/qt-3.3/bin:/opt/pbs/default/bin:/opt/pbs/default/sbin:/usr/kerberos/sbin:/usr/kerberos/bin:/opt/pbs/default/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/opt/ibutils/bin:/opt/pbs/default/bin/:/home/puneets/bin' 'BASH_FUNC_module()=() { eval `/usr/bin/modulecmd bash $*` }' '_=/home/soft/intel2015//impi/5.0.3.048/intel64/bin/mpiexec.hydra' --global-user-env 3 'I_MPI_HYDRA_DEBUG=1' 'OMP_NUM_THREADS=12' 'I_MPI_DEBUG=5' --global-system-env 2 'MPIR_CVAR_NEMESIS_ENABLE_CKPOINT=1' 'GFORTRAN_UNBUFFERED_PRECONNECTED=y' --proxy-core-count 2 --mpi-cmd-env mpirun -np 4 -hostfile /var/spool/PBS/aux/268890.hn1 -genv I_MPI_HYDRA_DEBUG=1 -genv OMP_NUM_THREADS=12 -genv I_MPI_DEBUG=5 -ppn 2 ./bt.E.4.mpi_io_full --exec --exec-appnum 0 --exec-proc-count 2 --exec-local-env 0 --exec-wdir /home/puneets/AppBench/NPB/NPB3.3.1/NPB3.3-MPI/bin --exec-args 1 ./bt.E.4.mpi_io_full [mpiexec@cn003] Launch arguments: /home/soft/intel2015//impi/5.0.3.048/intel64/bin/pmi_proxy --control-port cn003:39349 --debug --pmi-connect lazy-cache --pmi-aggregate -s 0 --rmk user --launcher ssh --demux poll --pgid 0 --enable-stdin 1 --retries 10 --control-code 14548498 --usize -2 --proxy-id 0 [mpiexec@cn003] Launch arguments: /usr/bin/ssh -x -q cn171 /home/soft/intel2015//impi/5.0.3.048/intel64/bin/pmi_proxy --control-port cn003:39349 --debug --pmi-connect lazy-cache --pmi-aggregate -s 0 --rmk user --launcher ssh --demux poll --pgid 0 --enable-stdin 1 --retries 10 --control-code 14548498 --usize -2 --proxy-id 1 [mpiexec@cn003] STDIN will be redirected to 1 fd(s): 11 [proxy:0:0@cn003] Start PMI_proxy 0 [proxy:0:0@cn003] STDIN will be redirected to 1 fd(s): 19 =================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = PID 16935 RUNNING AT cn003 = EXIT CODE: 9 = CLEANING UP REMAINING PROCESSES = YOU CAN IGNORE THE BELOW CLEANUP MESSAGES =================================================================================== [proxy:0:1@cn171] Start PMI_proxy 1 APPLICATION TERMINATED WITH THE EXIT STRING: Killed (signal 9)