DAAL installation via Parallel Studio XE error at system start-up

[n_k_]

I have installed Parallel Studios successfully and am trying to link Intel compilers to R, however I cannot get that far because I am first having issues with DAAL. When I start my system, it seems that the DAAL examples are all being run via:

/opt/intel/compilers_and_libraries/linux/daal/examples/python/run_examples.py*

From the error messages I am receiving (one for each of the ~160 examples!), I see the `daal` module is not able to be imported when running the examples. This is because the script is being run with the system Python3, so no DAAL or MKL etc is available to it. Here is the bug report, where I have marked the parts I found useful:

548591

Questions:

1. why is this script even being run at startup?
2. how can I prevent it from being run?
3. What other options do I have, apart from uninstalling everything?

I thought I might try a work around and simply set my PATH so that the Intel Python Distribution is the first found. I did this, so `echo $PATH` shows that folder first. This didn't work though, the error messages still show the Ubuntu system Python being used for the DAAL examples.

Environment Setup

I have included the setup file from Parallel Studios in my start-up script, i.e. i have a file "intel.sh" in `/etc/profile.d/`, which is run at start-up via the file `/etc/profile`. This `intel.sh` script simply contains:

source /opt/intel/parallel_studio_xe_2017.3.053/bin/psxevars.sh

I have also tried running the explicit `daalvars.sh` file in my startup bash, but that didn't change anything. It just meant environment variables were defined twice.

I am running Ubuntu 16.04. Here are the places where DAAL is found in my environment:

n1k31t4@n1k31t4:~$ env | grep daal | tr \: \\n
LIBRARY_PATH=/opt/intel/compilers_and_libraries_2017.3.191/linux/ipp/lib/intel64
/opt/intel/compilers_and_libraries_2017.3.191/linux/compiler/lib/intel64_lin
/opt/intel/compilers_and_libraries_2017.3.191/linux/mkl/lib/intel64_lin
/opt/intel/compilers_and_libraries_2017.3.191/linux/tbb/lib/intel64/gcc4.7
/opt/intel/compilers_and_libraries_2017.3.191/linux/daal/lib/intel64_lin
/opt/intel/compilers_and_libraries_2017.3.191/linux/daal/../tbb/lib/intel64_lin/gcc4.4
CPATH=/opt/intel/compilers_and_libraries_2017.3.191/linux/ipp/include
/opt/intel/compilers_and_libraries_2017.3.191/linux/mkl/include
/opt/intel/compilers_and_libraries_2017.3.191/linux/tbb/include
/opt/intel/compilers_and_libraries_2017.3.191/linux/daal/include
DAALROOT=/opt/intel/compilers_and_libraries_2017.3.191/linux/daal
CLASSPATH=/opt/intel/compilers_and_libraries_2017.3.191/linux/mpi/intel64/lib/mpi.jar
/opt/intel/compilers_and_libraries_2017.3.191/linux/daal/lib/daal.jar

[n_k_]

I couldn't get this to work and had to uninstall Parallel Studio XE. This also lead to problems as the uninstaller didn't remove everything and left some crash reports active and so in a loop in Apport. If anyone can provide an installation guide for the icc and ifort compilers, and how to link the to R for statistics, I would be very grateful. There is a guide here: https://software.intel.com/en-us/articles/build-r-301-with-intel-c-compiler-and-intel-mkl-on-linux - but is doesn't work anymore on up-to-date systems. It is also written rather confusingly, setting environment variables explicitly, then also defining them once again in the configure command.

[Ying_H_Intel]

Hi N K,

We are sorry for the situation.  Do you install the parallel studio xe package 2017 update 3 on Ubuntu ?  We will try it and get back to you later.

Regarding your questions Regarding DAAL: right, run_examples.py is python script. if it was run at start up. It should be called in some places.  But currently, you had uninstalled Parallel studio XE,  does it still run?  could you please try some system tools like >ps -aux to see all process.  I suppose it is gone.

Then let's consider your original question,  trying to link only Intel compilers and MKL to R.  So you only need Intel Compiler and MKL, right?

Then May you choose custom install Parallel studio XE, then select  only compiler and MKL.  Thus no DAAL component, not it's example.  

Best Regards,

Ying

[n_k_]

Hi Ying,

thanks for your reply. I had installed Parallel Studio XE - the latest update which I believe was Update 3 - on Ubuntu 16.04.

The problems I had at login with repeated warning about each of the Python test scripts was because they had failed once, and the error were recorded by Apport, which seemed to try resolving the errors by automatically running them again (I can't think of another cause). I found this to be true only after having uninstalled everything to do with Parallel Studios (and other Intel things such as the Python Distributions) because there was no way for the scripts to be run if they were not present. I removed all the crash reports stored by Apport, which solved the issue.

I installed Parallel Studios again, but only with the C/C++ and Fortran compilers selected (I think that was all, at least there was definitely no DAAL selected). I also installed the Intel Python Distributions (latest versions for both Python2 and Python3). They work fine now and I was also able to successfully compile and install R from CRAN (version 3.3.3) with links to the MKL libraries, using the Intel compilers: icc and ifort. I followed this great tutorial for that: https://blog.ajsuarez.com/posts/compiling-r-icc-mkl/

It is a shame because I did want to try out some of the advanced Intel toolkits for performance analysis and so on. For me as a standalone user, however, the time required to learn how to install everything in a stable way just isn't plausible.

Maybe I will try again in the future. Thanks gain for your reply,

N K