https://community.intel.com/t5/Intel-MPI-Library/Intel-MPI-fatal-error/m-p/835267#M1369 Hi,<BR /><BR />We compiled a code which is able to performe atomistic simulations.<BR />The code fail with the folowing error.<BR />I'll be thankful ifyou can help me in fixing this prolem.<BR /><BR />Thank you in advance,<BR />Fouad<BR /><BR /><BR /><P>[0:node44][../../dapl_module_poll.c:3972] Intel MPI fatal error: OpenIB-cma DTO operation posted for [2:node58] completed with error. status=0x1. cookie=0x40002</P><P>Assertion failed in file ../../dapl_module_poll.c at line 3973: 0</P><P>internal ABORT - process 0</P><P>[2:node58][../../dapl_module_poll.c:3972] Intel MPI fatal error: OpenIB-cma DTO operation posted for [0:node44] completed with error. status=0x6. cookie=0x40000</P><P>Assertion failed in file ../../dapl_module_poll.c at line 3973: 0</P><P>internal ABORT - process 2</P><P>[1:node44] unexpected disconnect completion event from [2:node58]</P><P>Assertion failed in file ../../dapl_module_util.c at line 1593: 0</P><P>internal ABORT - process 1</P><P>[3:node58] unexpected disconnect completion event from [0:node44]</P><P>Assertion failed in file ../../dapl_module_util.c at line 1593: 0</P><P>internal ABORT - process 3</P><P>[6:node28] unexpected disconnect completion event from [0:node44]</P><P>[7:node28] unexpected disconnect completion event from [0:node44]</P><P>Assertion failed in file ../../dapl_module_util.c at line 1593: 0</P><P>internal ABORT - process 7</P><P>Assertion failed in file ../../dapl_module_util.c at line 1593: 0</P><P>internal ABORT - process 6</P><P>[5:node59] unexpected disconnect completion event from [0:node44]</P><P>Assertion failed in file ../../dapl_module_util.c at line 1593: 0</P><P>[4:node59] unexpected disconnect completion event from [0:node44]</P><P>Assertion failed in file ../../dapl_module_util.c at line 1593: 0</P><P>internal ABORT - process 4</P><P>internal ABORT - process 5</P><P>rank 0 in job 1 node44_33470 caused collective abort of all ranks</P><P>exit status of rank 0: return code 1</P><P>[Ending Job 36715]</P> Thu, 23 Dec 2010 10:13:53 GMT atrash 2010-12-23T10:13:53Z https://community.intel.com/t5/Intel-MPI-Library/Intel-MPI-fatal-error/m-p/835267#M1369 Hi,<BR /><BR />We compiled a code which is able to performe atomistic simulations.<BR />The code fail with the folowing error.<BR />I'll be thankful ifyou can help me in fixing this prolem.<BR /><BR />Thank you in advance,<BR />Fouad<BR /><BR /><BR /><P>[0:node44][../../dapl_module_poll.c:3972] Intel MPI fatal error: OpenIB-cma DTO operation posted for [2:node58] completed with error. status=0x1. cookie=0x40002</P><P>Assertion failed in file ../../dapl_module_poll.c at line 3973: 0</P><P>internal ABORT - process 0</P><P>[2:node58][../../dapl_module_poll.c:3972] Intel MPI fatal error: OpenIB-cma DTO operation posted for [0:node44] completed with error. status=0x6. cookie=0x40000</P><P>Assertion failed in file ../../dapl_module_poll.c at line 3973: 0</P><P>internal ABORT - process 2</P><P>[1:node44] unexpected disconnect completion event from [2:node58]</P><P>Assertion failed in file ../../dapl_module_util.c at line 1593: 0</P><P>internal ABORT - process 1</P><P>[3:node58] unexpected disconnect completion event from [0:node44]</P><P>Assertion failed in file ../../dapl_module_util.c at line 1593: 0</P><P>internal ABORT - process 3</P><P>[6:node28] unexpected disconnect completion event from [0:node44]</P><P>[7:node28] unexpected disconnect completion event from [0:node44]</P><P>Assertion failed in file ../../dapl_module_util.c at line 1593: 0</P><P>internal ABORT - process 7</P><P>Assertion failed in file ../../dapl_module_util.c at line 1593: 0</P><P>internal ABORT - process 6</P><P>[5:node59] unexpected disconnect completion event from [0:node44]</P><P>Assertion failed in file ../../dapl_module_util.c at line 1593: 0</P><P>[4:node59] unexpected disconnect completion event from [0:node44]</P><P>Assertion failed in file ../../dapl_module_util.c at line 1593: 0</P><P>internal ABORT - process 4</P><P>internal ABORT - process 5</P><P>rank 0 in job 1 node44_33470 caused collective abort of all ranks</P><P>exit status of rank 0: return code 1</P><P>[Ending Job 36715]</P> Thu, 23 Dec 2010 10:13:53 GMT https://community.intel.com/t5/Intel-MPI-Library/Intel-MPI-fatal-error/m-p/835267#M1369 atrash 2010-12-23T10:13:53Z https://community.intel.com/t5/Intel-MPI-Library/Intel-MPI-fatal-error/m-p/835268#M1370 Hi Fouad,<BR /><BR />It can be useful to know Intel MPI version, DAPL version, Fabric (or Device) used in that run, the whole command line. What fast fabric do use (Infiniband)?<BR /><BR />Regards!<BR /> Dmitry<BR /> Wed, 12 Jan 2011 11:38:05 GMT https://community.intel.com/t5/Intel-MPI-Library/Intel-MPI-fatal-error/m-p/835268#M1370 Dmitry_K_Intel2 2011-01-12T11:38:05Z