idb with mpirun error

[zhdanov]

Hello,

I've got error while trying to run idb debugger with mpirun.

idb -parallel /common/mpich/bin/mpirun
Intel Debugger for Itanium -based Applications, Version 9.0-16 , Build 20051202
Reading symbolic information from /bin/bash...No debugging symbols found
Warning: expected to attach to loader, but couldn't: Invalid argument
Assertion failed: falsesrc/appl/procs/parallel/parallelSupport.C336
This is an unexpected condition and may indicate the presence of a defect.
If you wish to report this, please include the stack trace that follows.
1 : 0x4000000001754330
2 : 0x40000000020462f0
3 : 0x4000000001d427d0
4 : 0x400000000174ac50
5 : 0x400000000174f2b0
6 : 0x40000000013e9e30
7 : 0x200000000054a9f0
--------------

Intel Debugger for Itanium -based Applications, Version 9.0-16 caught signal "Aborted" (6).
This is an unexpected condition and may indicate the presence of a defect.
If you wish to report this, please include the stack trace that follows.
1 : 0xa0000000000040c0
2 : 0x20000000005724c1
3 : 0x2000000000574ea0
4 : 0x4000000002d675e0
5 : 0x4000000002d67460
6 : 0x4000000002d69370
7 : 0x4000000002d68320
8 : 0x40000000017bf1d0
9 : 0x4000000001754330
10 : 0x40000000020462f0
11 : 0x4000000001d427d0
12 : 0x400000000174ac50
13 : 0x400000000174f2b0
14 : 0x40000000013e9e30
15 : 0x200000000054a9f0
--------------

Intel Debugger for Itanium -based Applications, Version 9.0-16 caught signal "Segmentation fault" (11).
This is an unexpected condition and may indicate the presence of a defect.
If you wish to report this, please include the stack trace that follows.
1 : 0xa0000000000040c0
2 : 0x4000000002d6d050
3 : 0x4000000002d6c1b0
4 : 0x4000000002d68310
5 : 0x4000000001747b60
6 : 0xa0000000000040c0
7 : 0x20000000005724c1
8 : 0x2000000000574ea0
9 : 0x4000000002d675e0
10 : 0x4000000002d67460
11 : 0x4000000002d69370
12 : 0x4000000002d68320
13 : 0x40000000017bf1d0
14 : 0x4000000001754330
15 : 0x40000000020462f0
16 : 0x4000000001d427d0
17 : 0x400000000174ac50
18 : 0x400000000174f2b0
19 : 0x40000000013e9e30
20 : 0x200000000054a9f0
--------------
Aborted

Mpich_gm is installed on the Itanium2 cluster and there is no mpirun_dbg.idb script.

Thanks, Andrew.

[TimP]

If you didn't build mpich with icc/icpc/ifort -g, it doesn't make much sense to try to debug it. If you want to debug the application you are running under mpich, and you built it with -g, use mpirun -np 1 idb yourapplication (to debug a single process).

[zhdanov]

Hello,

Can i use idb to debug parallel MPI application on several proccesors? I try to use option -parallel as described in Intel manual and get above-mentioned error with or without program name added to command line:

idb -parallel /common/mpich/bin/mpirun -np 2 program_name.

Thanks, Andrew.

[TimP]

The document appears to imply that idb parallel debugging would be supported only for an mpich which provides the mpirun_dbg.idb script. In my mind, this raises also the question why Intel MPI doesn't provide such a script, and why there are no instructions specific to Intel MPI.
In any case, the instructions in the html documents don't match the way you said you tried to invoke idb. They look more like
mpirun -dbg=idb -np 2 program_name
If you are in a situation where the parallel debugging option is not supported, you can still request mpirun to start an idb session for each process. Then, you don't have such a convenient method for controlling multiple processes.
As I said previously, your command requests debugging of mpich, not of the application.

[Intel_C_Intel]

Hi,

Sorry for the delay in getting back to you on this (life got away from me for a few days here,however - I managed to catch it again!).

Yes, MPICH itself must be built as indicated here

And yes, the target binary must be compiled with debug info (i.e. "-g" at the very least, "-debug extended" for optimized code).

There's an mpirun_dbg.idb provided with IDB in case your version of MPICH doesn't provide one. You can also copy/paste one from the manual and place it in the directory in which mpirun resides.

The prefered method for invoking an MPI application under debugger control is:

mpirun -dbg=idb -np N [other mpich options] application [application arguments] [-idb idb options]

Please also note that we currently support MPI 1.2.6 (and earlier) but not MPICH 2.0.* (although it's in the works).

The latest IDB can be installed from the latest Intel compiler update package available via Premier (or from an Intelcompiler evaluation package). IDB does not currently enforce a license key and so it can be used without concern for expiration. You'll want to be using IDB 9.1.21 or later (which does work with the earlier compilers).

Please let me know if there's something more you need in this regard.

Thanks,

-- G

[Intel_C_Intel]

By the way, we've also tested IDB with applications built using MPICH 1.2.7 and it works fine.

-- G