topic Re:VTune hotspots analysis fails for Python 3.11 when importing NumPY in Analyzers https://community.intel.com/t5/Analyzers/VTune-hotspots-analysis-fails-for-Python-3-11-when-importing/m-p/1597645#M24696 <P>Thank you for your patience. We were able to reproduce this issue and concluded this will need deeper investigation from the development team. I have provided them the reproducer will provide an update as soon as they review.</P><BR /> Tue, 14 May 2024 19:43:18 GMT clevels 2024-05-14T19:43:18Z VTune hotspots analysis fails for Python 3.11 when importing NumPY https://community.intel.com/t5/Analyzers/VTune-hotspots-analysis-fails-for-Python-3-11-when-importing/m-p/1588390#M24554 <P>Operating System: Rocky Linux 8.7</P><P>VTune version:&nbsp;Intel(R) VTune(TM) Profiler 2024.0.0 (build 626834) Command Line Tool</P><P>&nbsp;</P><P>I am trying to run a VTune analysis of a C++ application which uses the Boost python interface and it crashes importing the NumPY module:</P><P>+++++++++++++++++++++++++++++++++++++++++++++++++++++++<BR />+++++++ Signal Handler Invoked +++++++<BR />+++++++ Signal : SIGSEGV +++++++<BR />+++++++ Meaning: Invalid memory reference +++++++<BR />+++++++++++++++++++++++++++++++++++++++++++++++++++++++</P><P>+++ Stack Trace:<BR />+++<BR />+++ [0x7ffff650e926]<BR />+++ [0x7ffff64fa42d]<BR />+++ [0x7ffff650d60e]<BR />+++ [0x7ffff650ee60]<BR />+++ [0x7ffff6ced9d8]<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: _PyCode_Validate()+0x113<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: PyCode_NewWithPosOnlyArgs()+0x209<BR />+++ [0x7ffff65b7db1]<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x2f5334<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x1ed826<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: PyObject_Call()+0x98<BR />+++ /thirdparty/linux64/python/lib/python3.11/site-packages/numpy/random/mtrand.cpython-311-x86_64-linux-gnu.so: ()+0xd201<BR />+++ /thirdparty/linux64/python/lib/python3.11/site-packages/numpy/random/mtrand.cpython-311-x86_64-linux-gnu.so: ()+0xe0df<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: PyModule_ExecDef()+0x6f<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x29d489<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x1f2ae1<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: _PyEval_EvalFrameDefault()+0x7e54<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: _PyFunction_Vectorcall()+0x191<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x1f3316<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: PyObject_CallMethodObjArgs()+0x102<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x125bfa<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: _PyEval_EvalFrameDefault()+0x58be<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x291f29<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: PyEval_EvalCode()+0x9a<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x2aa26e<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x1ed826<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: _PyEval_EvalFrameDefault()+0x7e54<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: _PyFunction_Vectorcall()+0x191<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x1f3316<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: PyObject_CallMethodObjArgs()+0x102<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x125bfa<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x23426b<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x1ed826<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: _PyEval_EvalFrameDefault()+0x7e54<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: _PyFunction_Vectorcall()+0x191<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x1f3316<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: PyObject_CallMethodObjArgs()+0x102<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x1267ba<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: _PyEval_EvalFrameDefault()+0x58be<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x291f29<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: PyEval_EvalCode()+0x9a<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x2aa26e<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x1ed826<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: _PyEval_EvalFrameDefault()+0x7e54<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: _PyFunction_Vectorcall()+0x191<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x1f3316<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: PyObject_CallMethodObjArgs()+0x102<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x125bfa<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x23426b<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x1ed826<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: _PyEval_EvalFrameDefault()+0x7e54<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: _PyFunction_Vectorcall()+0x191<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x1f3316<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: PyObject_CallMethodObjArgs()+0x102<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x1267ba<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: _PyEval_EvalFrameDefault()+0x58be<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x291f29<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: PyEval_EvalCode()+0x9a<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x2aa26e<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x1ed826<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: _PyEval_EvalFrameDefault()+0x7e54<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: _PyFunction_Vectorcall()+0x191<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x1f3316<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: PyObject_CallMethodObjArgs()+0x102<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x125bfa<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x23426b<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x1ed826<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: _PyEval_EvalFrameDefault()+0x7e54<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: _PyFunction_Vectorcall()+0x191<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x1f3316<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: PyObject_CallMethodObjArgs()+0x102<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x125bfa<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x23426b<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x1ed826<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: _PyEval_EvalFrameDefault()+0x7e54<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: _PyFunction_Vectorcall()+0x191<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x1f3316<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: PyObject_CallMethodObjArgs()+0x102<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x125bfa<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x23426b<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: ()+0x1ed826<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: PyObject_CallFunction()+0x12d<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: PyImport_Import()+0x190<BR />+++ /thirdparty/linux64/python/lib/libpython3.11.so.1.0: PyImport_ImportModule()+0x18<BR />+++ /thirdparty/linux64/lib/libboost_numpy311.so.1.84.0: boost::python::numpy::initialize(bool)+0x1c</P><P>&nbsp;</P><P>It works for python 3.10 &amp; 3.12 and only fails for Python 3.11. Unfortunately I cannot update the version of python used in the application due to depenency issues.</P><P>&nbsp;</P><P>I tested with different versions of NumPY and they all failed.</P><P>&nbsp;</P><P>I replicated a similar issue using Anaconda. Steps to reproduce:</P><P>mkdir -p ~/miniconda3<BR />wget <A href="https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh" target="_blank">https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh</A> -O ~/miniconda3/miniconda.sh<BR />bash ~/miniconda3/miniconda.sh -b -u -p ~/miniconda3<BR />~/miniconda3/bin/conda init bash<BR />source ~/.bashrc<BR />conda activate<BR />conda install -y python==3.11 numpy<BR />echo 'import numpy;print("OK")' &gt; numpy-test.py<BR />python numpy-test.py # OK<BR />vtune -collect hotspots python numpy-test.py # FAILS</P><P>&nbsp;</P><P>&nbsp;</P><P>&nbsp;</P><P>&nbsp;</P> Thu, 11 Apr 2024 14:27:08 GMT https://community.intel.com/t5/Analyzers/VTune-hotspots-analysis-fails-for-Python-3-11-when-importing/m-p/1588390#M24554 nickw1 2024-04-11T14:27:08Z Re: VTune hotspots analysis fails for Python 3.11 when importing NumPY https://community.intel.com/t5/Analyzers/VTune-hotspots-analysis-fails-for-Python-3-11-when-importing/m-p/1588510#M24557 <P>Thanks for reporting the issue.&nbsp; Let us investigate and give an update then.</P> Fri, 12 Apr 2024 02:09:04 GMT https://community.intel.com/t5/Analyzers/VTune-hotspots-analysis-fails-for-Python-3-11-when-importing/m-p/1588510#M24557 yuzhang3_intel 2024-04-12T02:09:04Z Re:VTune hotspots analysis fails for Python 3.11 when importing NumPY https://community.intel.com/t5/Analyzers/VTune-hotspots-analysis-fails-for-Python-3-11-when-importing/m-p/1597645#M24696 <P>Thank you for your patience. We were able to reproduce this issue and concluded this will need deeper investigation from the development team. I have provided them the reproducer will provide an update as soon as they review.</P><BR /> Tue, 14 May 2024 19:43:18 GMT https://community.intel.com/t5/Analyzers/VTune-hotspots-analysis-fails-for-Python-3-11-when-importing/m-p/1597645#M24696 clevels 2024-05-14T19:43:18Z Re:VTune hotspots analysis fails for Python 3.11 when importing NumPY https://community.intel.com/t5/Analyzers/VTune-hotspots-analysis-fails-for-Python-3-11-when-importing/m-p/1601680#M24778 <P>Hello- thank you for your patience. This issue has been reviewed by our development team and they have confirmed that Python 3.11 is not yet supported with the Intel VTune Profiler. Please let me know if you have any additional questions, otherwise this thread will no longer be monitored by Intel. </P><BR /> Tue, 28 May 2024 20:14:31 GMT https://community.intel.com/t5/Analyzers/VTune-hotspots-analysis-fails-for-Python-3-11-when-importing/m-p/1601680#M24778 clevels 2024-05-28T20:14:31Z Re: VTune hotspots analysis fails for Python 3.11 when importing NumPY https://community.intel.com/t5/Analyzers/VTune-hotspots-analysis-fails-for-Python-3-11-when-importing/m-p/1603653#M24801 <P>Thanks very much for the update.</P><P>Is there a plan to include support for Python 3.11 in later versions of VTune?<BR />Are there any patches or workarounds (other than upgrading to Python 3.12) which can help in this situation? We compile python from source so could consider patching the python we use (as long as it doesn't affect normal operation).<BR /><BR /></P> Tue, 04 Jun 2024 10:26:20 GMT https://community.intel.com/t5/Analyzers/VTune-hotspots-analysis-fails-for-Python-3-11-when-importing/m-p/1603653#M24801 nickw1 2024-06-04T10:26:20Z