Analyzers
Community support for Analyzers (Intel VTune™ Profiler, Intel Advisor, Intel Inspector)
Announcements
The Intel sign-in experience has changed to support enhanced security controls. If you sign in, click here for more information.
4823 Discussions

Roofline analysis on remote machine does not find sources

Marcel_K_
Beginner
‎04-01-2019 07:59 AM
1,217 Views

Hello,

I'm currently trying to run a roofline analysis on a remote machine. My approach is to run first "advixe -collect roofline" on the remote machine and then create a snapshot with "advixe -snapshot" and transfer the snapshot to my work machine. If I create the snapshot with "-cache-binaries -cache-sources -no-pack" I expect to see some source files copied to "SNAPSHOT/source_cache/temporary_files", but that folder is empty. The most important sources are in the working directory, so "--search-dir all:=./" should be sufficient for the parts I'm interested in. Additionally, I observe the correct behaviour on my local machine.

To be clear, I used the following commands and got this output:

advixe-cl -collect roofline -project-dir /home/marckoch/advisor-results/unstructured/poisson --search-dir all:rp=./ -v -- poisson_block_16_novec poisson_block_16_novec.ini
advixe: Warning: The Roofline is a special batch mode of data collection. It runs two analyses one by one. There are Survey Analysis and Trip Counts Analysis with FLOP respectively.
advixe: Starting command line: advixe-cl --collect survey --project-dir /home/marckoch/advisor-results/unstructured/poisson --search-dir all:rp=./ -- poisson_block_16_novec poisson_block_16_novec.ini
Intel(R) Advisor Command Line Tool
Copyright (C) 2009-2018 Intel Corporation. All rights reserved.
advixe: Collection started. To stop the collection, either press CTRL-C or enter from another console window: advixe-cl -r /home/marckoch/advisor-results/unstructured/poisson/e000/hs000 -command stop.
__bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules!
Running without Marker API. Activate Marker API with -m on commandline.
gfs with 4024833 dofs generated  
cc with 0 dofs generated  
advixe: Collection stopped.
advixe: Opening result 21 % Resolving information for `bash'                   
advixe: Warning: Cannot locate debugging information for file `/usr/bin/tr'.
advixe: Warning: Cannot locate debugging information for file `/lib64/ld-linux-x86-64.so.2'.
advixe: Opening result 22 % Resolving information for `bash'                   
advixe: Warning: Cannot locate debugging information for file `/bin/bash'.
advixe: Opening result 23 % Resolving information for `libc.so.6'              
advixe: Warning: Cannot locate file `[stack]'.
advixe: Opening result 24 % Resolving information for `poisson_block_16_novec' 
advixe: Warning: Cannot locate debugging information for file `/home/marckoch/intel/advisor_2019.0.0.570901/lib64/libtpsstool.so'.
advixe: Opening result 24 % Resolving information for `libopenblas.so.0'       
advixe: Warning: Cannot locate debugging information for file `/usr/lib/libopenblas.so.0'.
advixe: Opening result 100 % done                                              
advixe: Preparing frequently used data  0 % done                               
advixe: Preparing frequently used data 100 % done                              

Elapsed Time: 6.41s
Total CPU time: 6.76
Time in 5 vectorized loops: 5.59599

advixe: Starting command line: advixe-cl --collect tripcounts --project-dir /home/marckoch/advisor-results/unstructured/poisson --search-dir all:rp=./ --flop --no-trip-counts -- poisson_block_16_novec poisson_block_16_novec.ini
Intel(R) Advisor Command Line Tool
Copyright (C) 2009-2018 Intel Corporation. All rights reserved.
advixe: Opening result 25 % done                                               
advixe: Preparing frequently used data  0 % done                               
advixe: Preparing frequently used data 100 % done                              
advixe: Collection started. To stop the collection, either press CTRL-C or enter from another console window: advixe-cl -r /home/marckoch/advisor-results/unstructured/poisson/e000/trc000 -command stop.
__bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules!
Running without Marker API. Activate Marker API with -m on commandline.
gfs with 4024833 dofs generated  
cc with 0 dofs generated  
advixe: Opening result 71 % Loading 'tripcounts_72649_0.tcs' file              
advixe: Error: Cannot load data file `/home/marckoch/advisor-results/unstructured/poisson/e000/hs000/data.1/tripcounts_72641_0.tcs' (Data file is corrupted).
advixe: Opening result 99 % done                                               
advixe: Preparing frequently used data  0 % done                               
advixe: Preparing frequently used data 100 % done                              

Elapsed Time: 6.41s
Total CPU time: 6.76
Time in 5 vectorized loops: 5.59599
Total GFLOPS: 2.86

advixe-cl -snapshot -cache-binaries -cache-sources -no-pack -project-dir ./
advixe: Opening result 25 % done                                               
advixe: Preparing frequently used data  0 % done                               
advixe: Preparing frequently used data 100 % done                              
advixe:  100 % done                                                            
advixe: Created snapshot: /home/marckoch/advisor-results/unstructured/poisson/snapshot000

Both my work machine and the remote machine run on Ubuntu 16.04.

Best,

Marcel.

0 Kudos

Link Copied

15 Replies
Dmitry_Dontsov
Employee
‎04-02-2019 01:30 AM
1,216 Views

Hello,

Missed sources is not main issue there as I see. Minor issue is problem with time zone settings ("__bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin!") in system. Major issue is fail of tripcounts collection (second collection in roofline analysis): "Error: Cannot load data file `/home/marckoch/advisor-results/unstructured/poisson/e000/hs000/data.1/tripcounts_72641_0.tcs' (Data file is corrupted)."

Which Advisor was used there? 

0 Kudos
Copy link
Marcel_K_
Beginner
‎04-02-2019 01:34 AM
1,216 Views

Hi Dimitry,

the version is

Copyright (C) 2009-2018 Intel Corporation. All rights reserved.
Intel(R) Advisor 2019 (build 570901)

on both machines.

0 Kudos
Copy link
Dmitry_Dontsov
Employee
‎04-02-2019 01:56 AM
1,217 Views

Marcel,

Your Advisor version is a lot of outdated. Could You please try the freshest Advisor version?

Link for download: https://registrationcenter.intel.com/en/products/download/3424/

0 Kudos
Copy link
Zakhar_M_Intel1
Employee
‎04-02-2019 03:25 AM
1,217 Views

Hi Marcel,

Just to clarify: do you see Roofline chart in the GUI, when opening "snapshot" on the remote ("destination") machine? I guess the answer is "YES" and so "tripcounts_72641_0.tcs" failure is likely unimportant issue (which you could possibly ignore; this could be just an indication of error in your service thread profiling or smth like that).

That's being said, upgrading to the latest Advisor version (as Dmitry suggested) still would be useful, because some regressions with source caching were addressed in latest update. Also, could you please try -pack flag to see if "packed snapshot" contains sources in fact?

And of course it is still interesting to check if "tripcounts_72641_0.tcs" failure disappeared.

Zakhar.

0 Kudos
Copy link
Marcel_K_
Beginner
‎04-02-2019 03:38 AM
1,217 Views

Hi Zakhar,

I have no means to view it on the remote machine, since X11 is not installed there. But I can see a Roofline chart, if I view the snapshot on my local machine, although the source view is not available. In that case, it doesn't matter if I use -no-pack or -pack.

0 Kudos
Copy link
Marcel_K_
Beginner
‎04-02-2019 05:35 AM
1,217 Views

This is the output from the newest Intel Advisor version (build 591264):

advixe-cl -collect roofline -project-dir /home/marckoch/advisor-results/unstructured/poisson --search-dir all:rp=./ -v -- poisson_block_16_novec poisson_block_16_novec.ini
advixe: Warning: The Roofline is a special batch mode of data collection. It runs two analyses one by one. There are Survey Analysis and Trip Counts Analysis with FLOP respectively.
advixe: Starting command line: advixe-cl --collect survey --project-dir /home/marckoch/advisor-results/unstructured/poisson --search-dir all:rp=./ -- poisson_block_16_novec poisson_block_16_novec.ini
Intel(R) Advisor Command Line Tool
Copyright (C) 2009-2019 Intel Corporation. All rights reserved.
advixe: Collection started. To stop the collection, either press CTRL-C or enter from another console window: advixe-cl -r /home/marckoch/advisor-results/unstructured/poisson/e000/hs000 -command stop.
__bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules!
Running without Marker API. Activate Marker API with -m on commandline.
gfs with 4024833 dofs generated  
cc with 0 dofs generated  
advixe: Collection stopped.
advixe: Opening result 21 % Resolving information for `libc.so.6'              
advixe: Warning: Cannot locate debugging information for file `/lib64/ld-linux-x86-64.so.2'.
advixe: Opening result 21 % Resolving information for `bash'                   
advixe: Warning: Cannot locate debugging information for file `/usr/bin/tr'.
advixe: Warning: Cannot locate debugging information for file `/home/marckoch/intel/advisor_2019.3.0.591264/lib64/pinruntime/libc-dynamic.so'.
advixe: Opening result 22 % Resolving information for `poisson_block_16_novec' 
advixe: Warning: Cannot locate debugging information for file `/bin/bash'.
advixe: Opening result 23 % Resolving information for `libtpsstool.so'         
advixe: Warning: Cannot locate file `[stack]'.
advixe: Opening result 24 % Resolving information for `[stack]'                
advixe: Warning: Cannot locate debugging information for file `/home/marckoch/intel/advisor_2019.3.0.591264/lib64/libtpsstool.so'.
advixe: Opening result 24 % Resolving information for `libopenblas.so.0'       
advixe: Warning: Cannot locate debugging information for file `/usr/lib/libopenblas.so.0'.
advixe: Opening result 99 % done                                               
advixe: Preparing frequently used data  0 % done                               
advixe: Preparing frequently used data 100 % done                              

Elapsed Time: 6.32s
Total CPU time: 6.75
Time in 5 vectorized loops: 5.57203

advixe: Starting command line: advixe-cl --collect tripcounts --project-dir /home/marckoch/advisor-results/unstructured/poisson --search-dir all:rp=./ --flop --no-trip-counts -- poisson_block_16_novec poisson_block_16_novec.ini
Intel(R) Advisor Command Line Tool
Copyright (C) 2009-2019 Intel Corporation. All rights reserved.
advixe: Opening result 25 % done                                               
advixe: Preparing frequently used data  0 % done                               
advixe: Preparing frequently used data 100 % done                              
advixe: Collection started. To stop the collection, either press CTRL-C or enter from another console window: advixe-cl -r /home/marckoch/advisor-results/unstructured/poisson/e000/trc000 -command stop.
__bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT!
__bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules!
Running without Marker API. Activate Marker API with -m on commandline.
gfs with 4024833 dofs generated  
cc with 0 dofs generated  
advixe: Opening result 75 % Loading 'tripcounts_14950_1.tcs' file              
advixe: Error: Cannot load data file `/home/marckoch/advisor-results/unstructured/poisson/e000/hs000/data.1/tripcounts_14938_0.tcs' (Data file is corrupted).
advixe: Error: Cannot load data file `/home/marckoch/advisor-results/unstructured/poisson/e000/hs000/data.1/tripcounts_14938_1.tcs' (Data file is corrupted).
advixe: Error: Cannot load data file `/home/marckoch/advisor-results/unstructured/poisson/e000/hs000/data.1/tripcounts_14948_0.tcs' (Data file is corrupted).
advixe: Error: Cannot load data file `/home/marckoch/advisor-results/unstructured/poisson/e000/hs000/data.1/tripcounts_14950_0.tcs' (Data file is corrupted).
advixe: Opening result 100 % done                                              
advixe: Preparing frequently used data  0 % done                               
advixe: Preparing frequently used data 100 % done                              

Elapsed Time: 6.32s
Total CPU time: 6.75
Time in 5 vectorized loops: 5.57203
GFLOPS: 2.90

There are still corrupted files and the source files are still missing in the snapshot.

0 Kudos
Copy link
Dmitry_Dontsov
Employee
‎04-02-2019 05:50 AM
1,217 Views

Thanks a lot! Could You plase share with me your snapshot to have a look on corrupted trace files?

Relative to missed source files: Could You please define full path to source files for --search-dir option e.g. --search-dir all:rp=/home/user/source_files_dir?

0 Kudos
Copy link
Marcel_K_
Beginner
‎04-02-2019 06:07 AM
1,217 Views

I get the same output and the missing source files if I use an absolute search path.

snapshot.tar.gz
0 Kudos
Copy link
Dmitry_Dontsov
Employee
‎04-02-2019 06:14 AM
1,217 Views

Thank You!

Corrupted trace files are not point of interest, - please ignore it. It should contain metrics for bash and tr utilities.

We will try to reproduce issue with missed source files locally.

0 Kudos
Copy link
Dmitry_Dontsov
Employee
‎04-02-2019 07:06 AM
1,216 Views

We were able to reproduce the issue locally and will work for that. Currently I can suggest to define path to source files locally (from Project Properties window in GUI). It will allow You to see sources even if it not in snapshot.

0 Kudos
Copy link
Marcel_K_
Beginner
‎04-02-2019 07:30 AM
1,217 Views

I'm not sure I understand what you mean with that. If I open the snapshot on my local machine, I can't set the source or binary directory, since the snapshot is read-only.

If I copy the project directory from the remote system to my local system and open it there, I can set the source directory as usual. But I also must copy source and binary files from the remote machine. The source files are part of a quite large code base, so copying all of them is not really an option. Even copying the binary and some source files is not enough. Advisor is still missing source files.

I would like to reiterate that on my local machine it is sufficient to specify the working directory as the search dir.

0 Kudos
Copy link
Zakhar_M_Intel1
Employee
‎04-02-2019 08:38 AM
1,217 Views

Marcel,

Thank you. I think it is  now clear enough:-) Since we got reproducer from you - will work on the fix in upcoming Updates and also will probably share the pre-release build with you to check if our fix helps and to unblock you in this scenario.

Zakhar.

0 Kudos
Copy link
Alexandra_S_Intel
Employee
‎04-18-2019 10:31 AM
1,217 Views

Marcel,

We have an early build we think may fix the issue. If you would like to test it, please submit a ticket on the Online Service Center: https://software.intel.com/en-us/support/priority-support

0 Kudos
Copy link
Zakhar_M_Intel1
Employee
‎06-24-2019 02:11 PM
1,217 Views

Marcel, 

2019 Update 4 (released in May'2019) should contain the fix. Could you please double-check if it worked fine for you?

0 Kudos
Copy link
Marcel_K_
Beginner
‎06-26-2019 07:59 AM
1,217 Views

Hi Zakhar,

yes the version 2019 update 4 works fine.

Thanks for your (and your co-workers) help.

0 Kudos
Copy link
Reply

For more complete information about compiler optimizations, see our Optimization Notice.