Intel® oneAPI HPC Toolkit
Get help with building, analyzing, optimizing, and scaling high-performance computing (HPC) applications.
Announcements
The Intel sign-in experience is changing in February to support enhanced security controls. If you sign in, click here for more information.

ITAC: STF header

mmakni
Beginner
250 Views

Hi,

 

I would like to profile and analyze the MPI behavior of my applciation using ITAC and for all the processors.

 

I want to generate a dump file like this:

<name of MPI function> ; <source location in application> ; <number of calls>

example: <MPI_send>; </home/makni/rep/application/file.c>;<2>

 

This is my scripts.

export VT_CHECKING_TRACING=ON
export VT_STATISTICS=OFF
export VT_LOGFILE_FORMAT=SINGLESTF
export VT_PROCESS="0:N ON"
export VT_PCTRACE=5

mpiexec.hydra -trace  -n 2 -genvall ./exec_file

 

In the itac GUI, in "tracefile info", I found "STF header",  you can find attached the STF header generated for my mpiexec command for n=2.

The problem that I cannot see the name of my MPI function,. It generates DEFSCL instead of the name of MPI function (MPI_send, MPI_recv, etc). Also, I think that it doesn't collect trace from all the processors, so I think that export VT_PROCESS="0:N ON" is not working correctly.. 

Also I don't know how to extract the number of calls for each MPI function.

Could you please help me.

 

Thank you in advance,

Mariem

 

 

Labels (1)
0 Kudos
5 Replies
VarshaS_Intel
Moderator
206 Views

Hi,

 

Thanks for posting in Intel Communities.

 

Could you please let us know the OS details, CPU, and Intel MPI version you are using?

 

Could you please provide us with the sample reproducer code you are using?

 

>>I think that it doesn't collect trace from all the processors

If we use the VT_LOGFILE_FORMAT=SINGLESTF, it groups all the .stf files into a single file(.single.stf). By default, it will be .stf which consists of several different files which are referenced by one index file (.stf). For more information, please find this Intel® Trace Analyzer and Collector User and Reference Guide

 

Thanks & Regards,

Varsha

 

 

 

mmakni
Beginner
192 Views

Hi,

 

Thank you for your response.

 

In fact, I'm working on a cluster machine with 2x 18-core Intel CascadeLake on Linux and using the version  2021.7.0 of mpi.

Here my command:

$ mpiexec.hydra -trace -n 2 -genvall python3 ./run.py

and you can find attached the generated single stf file for n=2.

 

I use the VT_LOGFILE_FORMAT=SINGLESTF, it generates one single file but when I change the number of processors (n=6 for example), I obtain the same file "STF header" ! So, I think that it turns the trace only on one processor ..

Also, for the names of the MPI fuctions, I obtained "DEFSCL" instead of "the name of function", I don't know how to get the name of MPI in the STF header.

 

Thank you in advance,

 

Best regards,

Mariem

VarshaS_Intel
Moderator
169 Views

Hi,

 

>> you can find attached the generated single stf file for n=2.

We could not find any attached file. Could you please resend the file?

And also, could you please provide us the sample reproducer code you are using?

 

Thanks & Regards,

Varsha

 

VarshaS_Intel
Moderator
141 Views

Hi,


We have not heard back from you. Could you please provide us with the file?


Thanks & Regards,

Varsha


VarshaS_Intel
Moderator
120 Views

Hi,


We have not heard back from you. This thread will no longer be monitored by Intel. If you need further assistance, please post a new question.


Thanks & Regards,

Varsha


Reply