snb-memory-access: Cannot run data transformation `Compute CPU Usage'

[LambdaLambda]

Greetings, my apologies if this has been answered elsewhere - I have not been able to find a solution on this forum yet.

I'm unable to use amplxe-cl to collect memory access information. Here is a sample invocation with output:

$ amplxe-cl -collect snb-memory-access ./fft 999999
amplxe: Using result path `[removed]/r000memacc'
amplxe: Executing actions 16 % Processing profile metrics and debug information
amplxe: Warning: Error 0x40000026 (Database interface error) -- Cannot run data transformation `Compute CPU Usage'.
amplxe: Executing actions 50 % Generating a report
Result Info
-----------
Parameter                 r000memacc
------------------------  --------------------------------------------------------------------------------------------------------------------------
Application Command Line  ./fft "999999"
CPU Name                  3rd generation Intel(R) Core(TM) Processor family
Computer Name             [removed]
Environment Variables    
Frequency                 3400000000
Logical CPU Count         8
MPI Process Rank         
Operating System          3.5.0-26-generic DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=12.04
DISTRIB_CODENAME=precise
DISTRIB_DESCRIPTION="Ubuntu 12.04.2 LTS"
Result Size               987748
User Name                

Summary
-------
Elapsed Time:  0.000
amplxe: Executing actions 100 % done

However, collecting hotspots works correctly and I am able to get a working report.

[Bernard]

Please read this link://software.intel.com/en-us/forums/topic/368713 It has only a general guidance related to your error.

[LambdaLambda]

Thank you for the link. I am able to run lightweight collection, so I'm led to believe that drivers are setup properly.

[Bernard]

You are welcome:)

[Bernard]

Can you provide some log file of the error?

[LambdaLambda]

Since we've established that the drivers are setup properly, I'm still uncertain about why I am unable to collect memory access information. Do you have any insight there? The processor we are working with is an i7-3770 @ 3.40GHz.

[LambdaLambda]

Sure, does vtune provide error logs or should I collect some data myself? If the latter, which information would be useful here?

[Bernard]

Can you post the log file?It is better option because some vital info about the error will be included.

[LambdaLambda]

I attached the directory created by vtune. If there is another log file you're referencing (see my previous post), please let me know and I can also provide it.

[Bernard]

I cannot see any directory.

[LambdaLambda]

Here is the directiory created by vtune. If there is a different log file that would be helpful (see my previous post), please let me know.

Thanks!

EDIT: The file upload failed on the first try.

[LambdaLambda]

Sorry, the file didn't upload on the first try and when I edited my original post it seems to have gotten deleted instead. Directory attached now.

[David_A_Intel1]

So, just out of curiousity, can you execute the following command and post the output?

> amplxe-runss -context-value-list

[LambdaLambda]

Sure, here you go:

$ amplxe-runss -context-value-list
isGPUAnalysisAvailable: false
ETW: NA
isEtwDxSupported: no
isEtwCLRSupported: no
isPowerAnalysisAvailable: false
isPowerKernelStacksAvailable: false
isSEPDriverAvailable: true
isSEPMICDriverAvailable: false
isNMIWatchDogTimerRunning: false
CPU_NAME: 3rd generation Intel(R) Core(TM) Processor family
CPU: I86
platformType: 86
PMU: ivybridge
isVTSSPPDriverAvailable: true

[Bernard]

Hi,

In log files there is no info related directly to the error like call stacks.I have seen a few options reporting disabled status and I do not know how it can be related to the database error.There is ine file named dicer.db which could contain valuable information,but I cannot open it.

[Mona_J_]

Hi,

Here's the result I receive: Why do I have a driver error? isPowerAnalysisAvailable: DriverError

Also I have the same error when using hotspot from CLI: (Database interface error) -- Cannot run data transformation `Compute CPU Usage'. and apparently no result is created:

/opt/intel/vtune_amplifier_xe_2013/bin64/amplxe-cl   -collect hotspots -result-dir r001hs /research/jalal/sdvb/sd-vbs/benchmarks/mser/data/fullhd/mser  -quiet

opt/intel/vtune_amplifier_xe_2013/bin64/amplxe-runss -context-value-list

isGPUAnalysisAvailable: false
ETW: NA
isEtwDxSupported: no
isEtwCLRSupported: no
isPowerAnalysisAvailable: DriverError
isPowerKernelStacksAvailable: false
isSEPDriverAvailable: false
isSEPMICDriverAvailable: false
isNMIWatchDogTimerRunning: true
CPU_NAME: Intel(R) Core(TM) i7 Processor
CPU: I59
platformType: 59
PMU: corei7
referenceFrequency: 2400000000
isVTSSPPDriverAvailable: true 

I have also attached my pin.log created in the same directory I ran the VTune which gives me the following error :

E: Attach to pid 32146 failed. The Operating System configuration prevents Pin from using the default ...(parent) injection mode.

And didn't get removed by using:

sudo echo 0 > /proc/sys/kernel/yama/ptrace_scope

Please let me know what's possibly wrong and what I'm missing and where the results are stored in r001hs directory.

Thanks a lot,

Mona Jalal.

[Bernard]

>>>Here's the result I receive: Why do I have a driver error? isPowerAnalysisAvailable: DriverError>>>

Maybe driver was not loaded or it is not responding?Can you provide dump of loaded drivers?

[Mona_J_]

However when I run hotspot profiling without -quite flag it works fine but I have no idea where the results which tells which lines/functions are hotspots are stored:

/opt/intel/vtune_amplifier_xe_2013/bin64/amplxe-cl -collect hotspots -result-dir test_result /research/jalal/sdvb/sd-vbs/benchmarks/mser/data/fullhd/mser /research/jalal/sdvb/sd-vbs/benchmarks/mser/data/fullhd/
Input size - (1920x1080)
Verification - Successful
Cycles elapsed - 14050779904

amplxe: Using result path `/research/jalal/vtune/test_result'
amplxe: Executing actions 16 % Resolving information for `libc-2.17.so'
amplxe: Warning: Cannot match file `/lib/x86_64-linux-gnu/libc-2.17.so': checksum mismatch.
amplxe: Warning: Cannot locate symbols for file `/lib/x86_64-linux-gnu/libc-2.17.so'.
amplxe: Executing actions 50 % Generating a report

Collection and Platform Info
----------------------------
Parameter test_result
------------------------ --------------------------------------------------------------------------------------------------------------------------
Application Command Line /research/jalal/sdvb/sd-vbs/benchmarks/mser/data/fullhd/mser "/research/jalal/sdvb/sd-vbs/benchmarks/mser/data/fullhd/"
Computer Name mona
Environment Variables
MPI Process Rank
Operating System 3.2.0-43-generic DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=12.04
DISTRIB_CODENAME=precise
DISTRIB_DESCRIPTION="Ubuntu 12.04.2 LTS"
Result Size 1212181
User Name

CPU
---
Parameter test_result
----------------- ------------------------------
Frequency 2400000000
Logical CPU Count 4
Name Intel(R) Core(TM) i7 Processor

Summary
-------
Elapsed Time: 2.819
CPU Time: 1.998
CPU Usage: 0.634
amplxe: Executing actions 100 % done

jalal@mona:/research/jalal/vtune/test_result$ ls
archive config data.0 sqlite-db test_result.amplxe

Also if you are talking about result of lsmod here it is or please let me know which command is of your favor for dump of loaded drivers:

lsmod
Module Size Used by
vtsspp 323953 0 [permanent]
sep3_10 100952 0 [permanent]
pax 13080 0 [permanent]
vmnet 55694 13 [permanent]
ip6table_filter 12815 0
ip6_tables 27864 1 ip6table_filter
ebtable_nat 12807 0
ebtables 30984 1 ebtable_nat
xt_state 12578 1
ipt_REJECT 12576 2
vsock 52331 0 [permanent]
xt_CHECKSUM 12549 1
iptable_mangle 12734 1
vmci 87347 1 vsock,[permanent]
xt_tcpudp 12603 5
ipt_MASQUERADE 12759 4
iptable_nat 13229 1
nf_nat 25891 2 ipt_MASQUERADE,iptable_nat
iptable_filter 12810 1
vmmon 76201 0 [permanent]
nf_conntrack_ipv4 19716 4 iptable_nat,nf_nat
nf_conntrack 81926 5 xt_state,ipt_MASQUERADE,iptable_nat,nf_nat,nf_conntrack_ipv4
nf_defrag_ipv4 12729 1 nf_conntrack_ipv4
ip_tables 27473 3 iptable_mangle,iptable_nat,iptable_filter
x_tables 29891 12 ip6table_filter,ip6_tables,ebtables,xt_state,ipt_REJECT,xt_CHECKSUM,iptable_mangle,xt_tcpudp,ipt_MASQUERADE,iptable_nat,iptable_filter,ip_tables
kvm_intel 137721 0
bridge 90989 0
stp 12976 1 bridge
kvm 415550 1 kvm_intel
autofs4 37024 4
nvidia 9367786 74 [permanent]
bnep 18281 2
snd_hda_codec_analog 97987 1
rfcomm 47604 0
bluetooth 180153 10 bnep,rfcomm
snd_hda_intel 33719 3
snd_hda_codec 127706 2 snd_hda_codec_analog,snd_hda_intel
snd_hwdep 17764 1 snd_hda_codec
snd_pcm 97275 3 snd_hda_intel,snd_hda_codec
snd_seq_midi 13324 0
snd_rawmidi 30748 1 snd_seq_midi
snd_seq_midi_event 14899 1 snd_seq_midi
snd_seq 61929 2 snd_seq_midi,snd_seq_midi_event
dell_wmi 12681 0
psmouse 97485 0
snd_timer 29990 2 snd_pcm,snd_seq
sparse_keymap 13890 1 dell_wmi
mxm_wmi 13021 0
snd_seq_device 14540 3 snd_seq_midi,snd_rawmidi,snd_seq
snd 79041 14 snd_hda_codec_analog,snd_hda_intel,snd_hda_codec,snd_hwdep,snd_pcm,snd_rawmidi,snd_seq,snd_timer,snd_seq_device
wmi 19256 2 dell_wmi,mxm_wmi
joydev 17693 0
soundcore 15091 1 snd
snd_page_alloc 18529 2 snd_hda_intel,snd_pcm
serio_raw 13211 0
shpchp 37201 0
i7core_edac 28102 0
edac_core 53746 3 i7core_edac
mac_hid 13253 0
dcdbas 14490 0
ppdev 17113 0
parport_pc 32866 1
nfsd 281980 2
nfs 436914 2
lockd 90326 2 nfsd,nfs
fscache 61529 1 nfs
binfmt_misc 17540 1
auth_rpcgss 53380 2 nfsd,nfs
nfs_acl 12883 2 nfsd,nfs
lp 17799 0
parport 46562 3 ppdev,parport_pc,lp
sunrpc 255224 24 nfsd,nfs,lockd,auth_rpcgss,nfs_acl
usbhid 47238 0
hid 99636 1 usbhid
firewire_ohci 41000 0
firewire_core 63600 1 firewire_ohci
crc_itu_t 12707 1 firewire_core
mptsas 63612 3
tg3 152085 0
mptscsih 44882 1 mptsas
mptbase 103162 2 mptsas,mptscsih
scsi_transport_sas 40558 1 mptsas

Thanks,

Mona.

[Bernard]

It seem by looking at drivers names that lsmod output does not contain any VTune related drivers.

[SergeyKostrov]

I'd like to go back to the 1st post because the problem could be related to some issues with SQLite database which is used internally by VTune: ... amplxe: Warning: Error 0x40000026 ( Database interface error ) -- Cannot run data transformation `Compute CPU Usage'. ... and ( from another post ) ... the same error when using hotspot from CLI: ( Database interface error ) -- Cannot run data transformation `Compute CPU Usage' ... Here is a question: Did you try to install recent VTune update?

[Bernard]

>>>Here's the result I receive: Why do I have a driver error? isPowerAnalysisAvailable: DriverError

It seem by looking at drivers names that lsmod output does not contain any VTune related drivers.>>>

Hi Mona my answer is related to your quoted question