cpa_sample code get err could not start sal for user space

[ZhichengCai]

OS: Ubuntu 22.04
Kernel: Linux 5.15.0-140-generic x86_64

Firmware: Intel QAT 8970
HW Driver:  Lastest HW 1.* for Linux ,which is QAT.L.4.28.0-00004.tar.gz
Compile cmd: ./configure --enable-icp-debug --enable-icp-log-syslog --enable-icp-sriov=host --enable-icp-qat-dbg

Other info:

intel_iommu=on has been added into grub configuration and IOMMU and SRIOV has been enabled  from the output of dmesg ,shown as below:

[ 1.152230] Kernel command line: BOOT_IMAGE=/vmlinuz-5.15.0-140-generic root=/dev/mapper/ubuntu--vg-ubuntu--lv ro intel_iommu=on
[ 1.152287] DMAR: IOMMU enabled
[ 2.353764] DMAR-IR: IOAPIC id 8 under DRHD base 0x9b7fc000 IOMMU 9
[ 4.338312] iommu: Default domain type: Translated
[ 4.338312] iommu: DMA domain TLB invalidation policy: lazy mode

VF has been created as :
root@qat:~# lspci -d 8086:37c9
cc:01.0 Co-processor: Intel Corporation C62x Chipset QuickAssist Technology Virtual Function (rev 04)
cc:01.1 Co-processor: Intel Corporation C62x Chipset QuickAssist Technology Virtual Function (rev 04)
cc:01.2 Co-processor: Intel Corporation C62x Chipset QuickAssist Technology Virtual Function (rev 04)
cc:01.3 Co-processor: Intel Corporation C62x Chipset QuickAssist Technology Virtual Function (rev 04)
cc:01.4 Co-processor: Intel Corporation C62x Chipset QuickAssist Technology Virtual Function (rev 04)
cc:01.5 Co-processor: Intel Corporation C62x Chipset QuickAssist Technology Virtual Function (rev 04)
cc:01.6 Co-processor: Intel Corporation C62x Chipset QuickAssist Technology Virtual Function (rev 04)
cc:01.7 Co-processor: Intel Corporation C62x Chipset QuickAssist Technology Virtual Function (rev 04)
cc:02.0 Co-processor: Intel Corporation C62x Chipset QuickAssist Technology Virtual Function (rev 04)
cc:02.1 Co-processor: Intel Corporation C62x Chipset QuickAssist Technology Virtual Function (rev 04)
cc:02.2 Co-processor: Intel Corporation C62x Chipset QuickAssist Technology Virtual Function (rev 04)
cc:02.3 Co-processor: Intel Corporation C62x Chipset QuickAssist Technology Virtual Function (rev 04)
cc:02.4 Co-processor: Intel Corporation C62x Chipset QuickAssist Technology Virtual Function (rev 04)
cc:02.5 Co-processor: Intel Corporation C62x Chipset QuickAssist Technology Virtual Function (rev 04)
cc:02.6 Co-processor: Intel Corporation C62x Chipset QuickAssist Technology Virtual Function (rev 04)
cc:02.7 Co-processor: Intel Corporation C62x Chipset QuickAssist Technology Virtual Function (rev 04)

Tests failed when running cpa_sample_code even add root as groupmember of "qat":
root@qat:~# id root
uid=0(root) gid=0(root) groups=0(root),1001(qat)

root@qat:~# cpa_sample_code signOfLife=1
Latency computation Disabled
qaeOpenFd:162 Memory file handle is not initialized. Initializing it now
qaeMemInit started
/QAT/quickassist/lookaside/access_layer/src/sample_code/performance/cpa_sample_code_main.c, main():506 Could not start sal for user space

[Ronny_G_Intel]

Hi ZhichengCai,

Please try the following commands to check the system status and restart the QAT service:

# service qat_service_vfs status

# service qat_service_vfs restart

You mentioned that you have already done it but can you please check file permissions again:

# ls -l /dev/qat*

Check for modules installed:

# lsmod | grep qat

Was QAT installed after iommu enablement targeting vfs?

If QAT install was performed with intel_iommu=on and ./configure targeting PF use only, this configuration wont work and we will need to recompile and reinstall

If the steps mentioned before do not resolve the issue, I would recommend the following:

1- Refer to section 3 of the following document, https://www.intel.com/content/www/us/en/content-details/773842/intel-quickassist-technology-software-for-linux-getting-started-guide-customer-enabling-release.html

2- For testing purposes, try compiling with only enable sriov flag # ./configure --enable-icp-sriov 

3- Refer to section 4, follow the instructions and # ./build/ cpa_sample_code, dont use other parameters.

Please let me know the results.

Regards,

Ronny G

[Ronny_G_Intel]

Hi ZhichengCai,

I am just checking if you had a chance to try my recommendations mentioned before.

Please let me know the results.

Regards,

Ronny G