Analyzers
Talk to fellow users of Intel Analyzer tools (Intel VTune™ Profiler, Intel Advisor)
5041 Discussions

PMU counter in use but I cannot find vtune or aps processes.

oleotiger
Novice
4,758 Views
vtune: Warning: EMON Collector Message: Warning: PMU counter(s) [GP0 GP1 GP2 GP3 GP4 GP5 GP6 GP7 FP0 ] is/are already in use by other software and the data collected on these counter(s) may be incorrect
vtune: Error: EMON Collector Message: ERROR - A collection is already in progress - Abort current run.
aps Error: Cannot run the collection.

When I analysis an application with aps and  the application fails to run, I get errors as shown above after restarting the application with aps again.

 

I didn't find any processes with words like 'aps' or 'vtune'.  Why are there still some processes that occupy PMU counters?

How should I reset the PMU counter or find processes that occupy PMU counters?

0 Kudos
12 Replies
JananiC_Intel
Moderator
4,738 Views

Hi,


Thanks for posting in Intel forums.


Could you share your machine details?


Regards,

Janani Chandran


0 Kudos
oleotiger
Novice
4,730 Views
OS: centos 7.6 kernel 3.10
cpu: 2 sockets with each cascadelake 6248r 24core
512G memory
Any more information needed?
0 Kudos
JananiC_Intel
Moderator
4,713 Views

Hi,


We will check on this internally and let you know.


Regards,

Janani Chandran


0 Kudos
oleotiger
Novice
4,681 Views

Any ideas?

 

At the present stage, we have to reboot to reset the counter to avoid occupation of unknown processes.

 

It's really time consuming....

0 Kudos
Kirill_U_Intel
Employee
4,672 Views

Hi, you could check sep, emon or amplxe-perf processes too.

0 Kudos
oleotiger
Novice
4,658 Views

I checked all of them. There is no aps/perf/emon/sep-like processes.

 

More details:

When I killed my application, there are many processes `[aps] <defunct>` left. And I killed them all with `kill -9`. Will this be the reason?

0 Kudos
nicejunjie
Beginner
4,634 Views

I'm having exactly the same problem.  APS worked for many jobs, but suddenly all failed for similar error: 

 

>aps hostname 

vtune: Error: EMON Collector Message: ERROR - A collection is already in progress - Abort current run.

aps Error: Cannot run the collection. 

 

And I don't have any related process running at all. I run it on compute nodes of a big HPC, all the user processes got cleaned each time the job is finished.   

Any solution or trick to get around this?  

0 Kudos
oleotiger
Novice
4,554 Views
0 Kudos
Mariya_P_Intel
Moderator
4,422 Views

Sorry for a delay with response.

Please provide additional info:

Thanks, Mariya


0 Kudos
Mariya_P_Intel
Moderator
4,377 Views

Hi, we have not heard from you in a while. I assume the issue is solved or became unactual and closing this case.

Fell free to start a new thread in case of further assistance need.

Thanks, Mariya


0 Kudos
CornelisNetworks
Beginner
4,162 Views

Since this is the highest ranked answer on google but doesn't actually include the answer, 

# rmmod vtsspp

on each affected machine resolved the problem for me.

0 Kudos
vsol_ll
Novice
3,640 Views

Hi, I have a pretty similar one even when using the vtune-self-checker.sh .

 

1.Warning: PMU counter(s) [GP0 GP3 FP0 FP1 ] is/are already in use by other software and the data collected on these counter(s) may be incorrect
2. vtune: Error: 0x40000024 (No data) -- No data is collected
3. vtune: Error: Cannot load data file `/tmp/vtune-tmp-vsolontsov/self-checker-2022.02.12_10.40.36/result_ah_with_stacks/data.0/20522.perf' (Data file is corrupted).

 

Note `/tmp` has enough space.

The self-check log is attached (hopefully). Could you please suggest?

0 Kudos
Reply