topic Re:ITAC: STF header in Intel® MPI Library

ITAC: STF header

mmakni — Fri, 04 Nov 2022 14:05:42 GMT

Hi,

I would like to profile and analyze the MPI behavior of my applciation using ITAC and for all the processors.

I want to generate a dump file like this:

<name of MPI function> ; <source location in application> ; <number of calls>

example: <MPI_send>; </home/makni/rep/application/file.c>;<2>

This is my scripts.

export VT_CHECKING_TRACING=ON
export VT_STATISTICS=OFF
export VT_LOGFILE_FORMAT=SINGLESTF
export VT_PROCESS="0:N ON"
export VT_PCTRACE=5

mpiexec.hydra -trace -n 2 -genvall ./exec_file

In the itac GUI, in "tracefile info", I found "STF header", you can find attached the STF header generated for my mpiexec command for n=2.

The problem that I cannot see the name of my MPI function,. It generates DEFSCL instead of the name of MPI function (MPI_send, MPI_recv, etc). Also, I think that it doesn't collect trace from all the processors, so I think that export VT_PROCESS="0:N ON" is not working correctly..

Also I don't know how to extract the number of calls for each MPI function.

Could you please help me.

Thank you in advance,

Mariem

Re: ITAC: STF header

VarshaS_Intel — Tue, 15 Nov 2022 08:26:47 GMT

Hi,

Thanks for posting in Intel Communities.

Could you please let us know the OS details, CPU, and Intel MPI version you are using?

Could you please provide us with the sample reproducer code you are using?

>>I think that it doesn't collect trace from all the processors

If we use the VT_LOGFILE_FORMAT=SINGLESTF, it groups all the .stf files into a single file(.single.stf). By default, it will be .stf which consists of several different files which are referenced by one index file (.stf). For more information, please find this Intel® Trace Analyzer and Collector User and Reference Guide

Thanks & Regards,

Varsha

Re: ITAC: STF header

mmakni — Wed, 09 Nov 2022 08:49:32 GMT

Hi,

Thank you for your response.

In fact, I'm working on a cluster machine with 2x 18-core Intel CascadeLake on Linux and using the version 2021.7.0 of mpi.

Here my command:

$ mpiexec.hydra -trace -n 2 -genvall python3 ./run.py

and you can find attached the generated single stf file for n=2.

I use the VT_LOGFILE_FORMAT=SINGLESTF, it generates one single file but when I change the number of processors (n=6 for example), I obtain the same file "STF header" ! So, I think that it turns the trace only on one processor ..

Also, for the names of the MPI fuctions, I obtained "DEFSCL" instead of "the name of function", I don't know how to get the name of MPI in the STF header.

Thank you in advance,

Best regards,

Mariem

Re: ITAC: STF header

VarshaS_Intel — Wed, 16 Nov 2022 07:34:10 GMT

Hi,

>> you can find attached the generated single stf file for n=2.

We could not find any attached file. Could you please resend the file?

And also, could you please provide us the sample reproducer code you are using?

Thanks & Regards,

Varsha

Re:ITAC: STF header

VarshaS_Intel — Tue, 22 Nov 2022 09:17:38 GMT

Hi,

We have not heard back from you. Could you please provide us with the file?

Thanks & Regards,

Varsha

Re:ITAC: STF header

VarshaS_Intel — Wed, 30 Nov 2022 12:13:28 GMT

Hi,

We have not heard back from you. This thread will no longer be monitored by Intel. If you need further assistance, please post a new question.

Thanks & Regards,

Varsha