- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello,
I'm currently trying to run a roofline analysis on a remote machine. My approach is to run first "advixe -collect roofline" on the remote machine and then create a snapshot with "advixe -snapshot" and transfer the snapshot to my work machine. If I create the snapshot with "-cache-binaries -cache-sources -no-pack" I expect to see some source files copied to "SNAPSHOT/source_cache/temporary_files", but that folder is empty. The most important sources are in the working directory, so "--search-dir all:=./" should be sufficient for the parts I'm interested in. Additionally, I observe the correct behaviour on my local machine.
To be clear, I used the following commands and got this output:
advixe-cl -collect roofline -project-dir /home/marckoch/advisor-results/unstructured/poisson --search-dir all:rp=./ -v -- poisson_block_16_novec poisson_block_16_novec.ini advixe: Warning: The Roofline is a special batch mode of data collection. It runs two analyses one by one. There are Survey Analysis and Trip Counts Analysis with FLOP respectively. advixe: Starting command line: advixe-cl --collect survey --project-dir /home/marckoch/advisor-results/unstructured/poisson --search-dir all:rp=./ -- poisson_block_16_novec poisson_block_16_novec.ini Intel(R) Advisor Command Line Tool Copyright (C) 2009-2018 Intel Corporation. All rights reserved. advixe: Collection started. To stop the collection, either press CTRL-C or enter from another console window: advixe-cl -r /home/marckoch/advisor-results/unstructured/poisson/e000/hs000 -command stop. __bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin! __bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT! __bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules! __bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin! __bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT! __bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules! __bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin! __bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT! __bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules! __bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin! __bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT! __bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules! Running without Marker API. Activate Marker API with -m on commandline. gfs with 4024833 dofs generated cc with 0 dofs generated advixe: Collection stopped. advixe: Opening result 21 % Resolving information for `bash' advixe: Warning: Cannot locate debugging information for file `/usr/bin/tr'. advixe: Warning: Cannot locate debugging information for file `/lib64/ld-linux-x86-64.so.2'. advixe: Opening result 22 % Resolving information for `bash' advixe: Warning: Cannot locate debugging information for file `/bin/bash'. advixe: Opening result 23 % Resolving information for `libc.so.6' advixe: Warning: Cannot locate file `[stack]'. advixe: Opening result 24 % Resolving information for `poisson_block_16_novec' advixe: Warning: Cannot locate debugging information for file `/home/marckoch/intel/advisor_2019.0.0.570901/lib64/libtpsstool.so'. advixe: Opening result 24 % Resolving information for `libopenblas.so.0' advixe: Warning: Cannot locate debugging information for file `/usr/lib/libopenblas.so.0'. advixe: Opening result 100 % done advixe: Preparing frequently used data 0 % done advixe: Preparing frequently used data 100 % done Elapsed Time: 6.41s Total CPU time: 6.76 Time in 5 vectorized loops: 5.59599 advixe: Starting command line: advixe-cl --collect tripcounts --project-dir /home/marckoch/advisor-results/unstructured/poisson --search-dir all:rp=./ --flop --no-trip-counts -- poisson_block_16_novec poisson_block_16_novec.ini Intel(R) Advisor Command Line Tool Copyright (C) 2009-2018 Intel Corporation. All rights reserved. advixe: Opening result 25 % done advixe: Preparing frequently used data 0 % done advixe: Preparing frequently used data 100 % done advixe: Collection started. To stop the collection, either press CTRL-C or enter from another console window: advixe-cl -r /home/marckoch/advisor-results/unstructured/poisson/e000/trc000 -command stop. __bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin! __bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT! __bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules! __bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin! __bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT! __bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules! __bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin! __bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT! __bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules! __bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin! __bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT! __bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules! Running without Marker API. Activate Marker API with -m on commandline. gfs with 4024833 dofs generated cc with 0 dofs generated advixe: Opening result 71 % Loading 'tripcounts_72649_0.tcs' file advixe: Error: Cannot load data file `/home/marckoch/advisor-results/unstructured/poisson/e000/hs000/data.1/tripcounts_72641_0.tcs' (Data file is corrupted). advixe: Opening result 99 % done advixe: Preparing frequently used data 0 % done advixe: Preparing frequently used data 100 % done Elapsed Time: 6.41s Total CPU time: 6.76 Time in 5 vectorized loops: 5.59599 Total GFLOPS: 2.86
advixe-cl -snapshot -cache-binaries -cache-sources -no-pack -project-dir ./ advixe: Opening result 25 % done advixe: Preparing frequently used data 0 % done advixe: Preparing frequently used data 100 % done advixe: 100 % done advixe: Created snapshot: /home/marckoch/advisor-results/unstructured/poisson/snapshot000
Both my work machine and the remote machine run on Ubuntu 16.04.
Best,
Marcel.
Link Copied
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello,
Missed sources is not main issue there as I see. Minor issue is problem with time zone settings ("__bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin!") in system. Major issue is fail of tripcounts collection (second collection in roofline analysis): "Error: Cannot load data file `/home/marckoch/advisor-results/unstructured/poisson/e000/hs000/data.1/tripcounts_72641_0.tcs' (Data file is corrupted)."
Which Advisor was used there?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Dimitry,
the version is
Copyright (C) 2009-2018 Intel Corporation. All rights reserved. Intel(R) Advisor 2019 (build 570901)
on both machines.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Marcel,
Your Advisor version is a lot of outdated. Could You please try the freshest Advisor version?
Link for download: https://registrationcenter.intel.com/en/products/download/3424/
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Marcel,
Just to clarify: do you see Roofline chart in the GUI, when opening "snapshot" on the remote ("destination") machine? I guess the answer is "YES" and so "tripcounts_72641_0.tcs" failure is likely unimportant issue (which you could possibly ignore; this could be just an indication of error in your service thread profiling or smth like that).
That's being said, upgrading to the latest Advisor version (as Dmitry suggested) still would be useful, because some regressions with source caching were addressed in latest update. Also, could you please try -pack flag to see if "packed snapshot" contains sources in fact?
And of course it is still interesting to check if "tripcounts_72641_0.tcs" failure disappeared.
Zakhar.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Zakhar,
I have no means to view it on the remote machine, since X11 is not installed there. But I can see a Roofline chart, if I view the snapshot on my local machine, although the source view is not available. In that case, it doesn't matter if I use -no-pack or -pack.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
This is the output from the newest Intel Advisor version (build 591264):
advixe-cl -collect roofline -project-dir /home/marckoch/advisor-results/unstructured/poisson --search-dir all:rp=./ -v -- poisson_block_16_novec poisson_block_16_novec.ini advixe: Warning: The Roofline is a special batch mode of data collection. It runs two analyses one by one. There are Survey Analysis and Trip Counts Analysis with FLOP respectively. advixe: Starting command line: advixe-cl --collect survey --project-dir /home/marckoch/advisor-results/unstructured/poisson --search-dir all:rp=./ -- poisson_block_16_novec poisson_block_16_novec.ini Intel(R) Advisor Command Line Tool Copyright (C) 2009-2019 Intel Corporation. All rights reserved. advixe: Collection started. To stop the collection, either press CTRL-C or enter from another console window: advixe-cl -r /home/marckoch/advisor-results/unstructured/poisson/e000/hs000 -command stop. __bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin! __bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT! __bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules! __bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin! __bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT! __bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules! __bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin! __bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT! __bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules! __bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin! __bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT! __bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules! Running without Marker API. Activate Marker API with -m on commandline. gfs with 4024833 dofs generated cc with 0 dofs generated advixe: Collection stopped. advixe: Opening result 21 % Resolving information for `libc.so.6' advixe: Warning: Cannot locate debugging information for file `/lib64/ld-linux-x86-64.so.2'. advixe: Opening result 21 % Resolving information for `bash' advixe: Warning: Cannot locate debugging information for file `/usr/bin/tr'. advixe: Warning: Cannot locate debugging information for file `/home/marckoch/intel/advisor_2019.3.0.591264/lib64/pinruntime/libc-dynamic.so'. advixe: Opening result 22 % Resolving information for `poisson_block_16_novec' advixe: Warning: Cannot locate debugging information for file `/bin/bash'. advixe: Opening result 23 % Resolving information for `libtpsstool.so' advixe: Warning: Cannot locate file `[stack]'. advixe: Opening result 24 % Resolving information for `[stack]' advixe: Warning: Cannot locate debugging information for file `/home/marckoch/intel/advisor_2019.3.0.591264/lib64/libtpsstool.so'. advixe: Opening result 24 % Resolving information for `libopenblas.so.0' advixe: Warning: Cannot locate debugging information for file `/usr/lib/libopenblas.so.0'. advixe: Opening result 99 % done advixe: Preparing frequently used data 0 % done advixe: Preparing frequently used data 100 % done Elapsed Time: 6.32s Total CPU time: 6.75 Time in 5 vectorized loops: 5.57203 advixe: Starting command line: advixe-cl --collect tripcounts --project-dir /home/marckoch/advisor-results/unstructured/poisson --search-dir all:rp=./ --flop --no-trip-counts -- poisson_block_16_novec poisson_block_16_novec.ini Intel(R) Advisor Command Line Tool Copyright (C) 2009-2019 Intel Corporation. All rights reserved. advixe: Opening result 25 % done advixe: Preparing frequently used data 0 % done advixe: Preparing frequently used data 100 % done advixe: Collection started. To stop the collection, either press CTRL-C or enter from another console window: advixe-cl -r /home/marckoch/advisor-results/unstructured/poisson/e000/trc000 -command stop. __bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin! __bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT! __bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules! __bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin! __bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT! __bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules! __bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin! __bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT! __bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules! __bionic_open_tzdata_path: couldn't find any tzdata when looking for Europe/Berlin! __bionic_open_tzdata_path: couldn't find any tzdata when looking for GMT! __bionic_open_tzdata_path: couldn't find any tzdata when looking for posixrules! Running without Marker API. Activate Marker API with -m on commandline. gfs with 4024833 dofs generated cc with 0 dofs generated advixe: Opening result 75 % Loading 'tripcounts_14950_1.tcs' file advixe: Error: Cannot load data file `/home/marckoch/advisor-results/unstructured/poisson/e000/hs000/data.1/tripcounts_14938_0.tcs' (Data file is corrupted). advixe: Error: Cannot load data file `/home/marckoch/advisor-results/unstructured/poisson/e000/hs000/data.1/tripcounts_14938_1.tcs' (Data file is corrupted). advixe: Error: Cannot load data file `/home/marckoch/advisor-results/unstructured/poisson/e000/hs000/data.1/tripcounts_14948_0.tcs' (Data file is corrupted). advixe: Error: Cannot load data file `/home/marckoch/advisor-results/unstructured/poisson/e000/hs000/data.1/tripcounts_14950_0.tcs' (Data file is corrupted). advixe: Opening result 100 % done advixe: Preparing frequently used data 0 % done advixe: Preparing frequently used data 100 % done Elapsed Time: 6.32s Total CPU time: 6.75 Time in 5 vectorized loops: 5.57203 GFLOPS: 2.90
There are still corrupted files and the source files are still missing in the snapshot.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks a lot! Could You plase share with me your snapshot to have a look on corrupted trace files?
Relative to missed source files: Could You please define full path to source files for --search-dir option e.g. --search-dir all:rp=/home/user/source_files_dir?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thank You!
Corrupted trace files are not point of interest, - please ignore it. It should contain metrics for bash and tr utilities.
We will try to reproduce issue with missed source files locally.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
We were able to reproduce the issue locally and will work for that. Currently I can suggest to define path to source files locally (from Project Properties window in GUI). It will allow You to see sources even if it not in snapshot.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I'm not sure I understand what you mean with that. If I open the snapshot on my local machine, I can't set the source or binary directory, since the snapshot is read-only.
If I copy the project directory from the remote system to my local system and open it there, I can set the source directory as usual. But I also must copy source and binary files from the remote machine. The source files are part of a quite large code base, so copying all of them is not really an option. Even copying the binary and some source files is not enough. Advisor is still missing source files.
I would like to reiterate that on my local machine it is sufficient to specify the working directory as the search dir.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Marcel,
Thank you. I think it is now clear enough:-) Since we got reproducer from you - will work on the fix in upcoming Updates and also will probably share the pre-release build with you to check if our fix helps and to unblock you in this scenario.
Zakhar.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Marcel,
We have an early build we think may fix the issue. If you would like to test it, please submit a ticket on the Online Service Center: https://software.intel.com/en-us/support/priority-support
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Marcel,
2019 Update 4 (released in May'2019) should contain the fix. Could you please double-check if it worked fine for you?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Zakhar,
yes the version 2019 update 4 works fine.
Thanks for your (and your co-workers) help.
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page