Analyzers
Community support for Analyzers (Intel VTune™ Profiler, Intel Advisor, Intel Inspector)
4963 Discussions

Vtune and tcmalloc seem to have compatibility issue

Xingyuan
Employee
1,388 Views

I want to check the thread memory allocation of a python script, but when I call the script with LD_PRELOAD containing the tcmalloc path, Vtune throws an unexpected error.

When I set LD_PRELOAD to include the jemalloc path or not include the allocator, Vtune works fine.

The crash info is as follows.

 

Labels (1)
0 Kudos
1 Solution
VaradJ_Intel
Moderator
972 Views

Hi,


Good day to you.


It seems that the issue is with the libtcmalloc.so which comes with the BigDL library.


Also, we found that any version of BigDL library greater than 2.0.0 has this issue.


So as a workaround can you try downgrading the version of BigDL library to 2.0.0 and check if Vtune works.


Please let us know if you still face any issues.


If this resolves your issue, make sure to accept this as a solution. This would help others with similar issues.


Regards,

Varad


View solution in original post

8 Replies
VaradJ_Intel
Moderator
1,341 Views

Hi,


Good day to you.

                       

Thanks for posting in Intel Communities.


Kindly share the exact steps you followed and a sample reproducer so that we can reproduce the issue you are facing.


Thank You!


Regards

Varad


0 Kudos
VaradJ_Intel
Moderator
1,272 Views

Hi,


Good day to you.


We have not heard back from you.


Please can you share the exact steps you followed and a sample reproducer so that we can replicate the issue from our side?


Thank You!


Regards,

Varad


0 Kudos
Xingyuan
Employee
1,240 Views

Hi,

Sorry for the late reply.

You can refer to the following steps to reproduce.

  • any python file
  • fill python in the Application field
  • define PATH and LD_PRELOAD in environment variables field, LD_PRELOAD is the path of tcmalloc lib.

As the picture shows

Xingyuan_1-1677463650083.png

 

Best regards,

Xingyuan

 

0 Kudos
VaradJ_Intel
Moderator
1,168 Views

Hi,


Good day to you.


We tried reproducing the issue from our side and we need some more information. Can you give us the following information:


1. Please share the exact paths given to both the user environment variables(PATH,LD_PERLOAD).


2. Are you performing any specific kind of Analysis using VTune?


3. What method did you use to install tcmalloc? Is it using conda or apt?


Thank You!


Regards,

Varad


0 Kudos
Xingyuan
Employee
1,163 Views

Hi,

 

Thank you for your reply

1. My environment variables are set as follows:

PATH=/disk3/xingyuan/miniconda3/envs/nano-restormer/bin:/disk3/xingyuan/miniconda3/condabin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
LD_PRELOAD=/disk3/xingyuan/miniconda3/envs/nano-restormer/lib/python3.7/site-packages/bigdl/nano/libs/libtcmalloc.so

2. I want to locate why tcmalloc is making a DL model run slower, but as long as tcmalloc is specified in LD_PRELOAD, I cannot perform any analysis correctly.

3. I installed the bigdl-nano software package using pip, the link is as follows: Nano Installation — BigDL latest documentation, there is a libtcmalloc.so in the installation directory.

 

Thank you!

 

Best regards,

Xingyuan

0 Kudos
VaradJ_Intel
Moderator
1,061 Views

Hi,


Good day to you.


Thanks for reporting this issue. We were able to reproduce it and we have informed the development team about it.


Thank You!


Regards,

Varad


VaradJ_Intel
Moderator
973 Views

Hi,


Good day to you.


It seems that the issue is with the libtcmalloc.so which comes with the BigDL library.


Also, we found that any version of BigDL library greater than 2.0.0 has this issue.


So as a workaround can you try downgrading the version of BigDL library to 2.0.0 and check if Vtune works.


Please let us know if you still face any issues.


If this resolves your issue, make sure to accept this as a solution. This would help others with similar issues.


Regards,

Varad


VaradJ_Intel
Moderator
906 Views

Hi,

 

Good day to you.

 

Thanks for accepting our solution. 

 

If you need any additional information, please post a new question as this thread will no longer be monitored by Intel.

 

We could see that you are qualified for priority support and can open a support ticket in Online service center (https://supporttickets.intel.com/) for direct 1:1 support.

 

Regards,

Varad

 

Reply