rings_reserved leaks in QAT20

[paulinusking]

QAT 20, version=1.2.30.00090

this is the current rings_reserved:

cat /sys/class/uio/uio11/device/uio_ctrl/bundle_*/rings_reserved
0x0003: PID 117319, rings 0x0003.
0x0003: PID 153435, rings 0x0003.
0x0003: PID 153435, rings 0x0003.
0x0003: PID 166943, rings 0x0003.
0x0003: PID 166943, rings 0x0003.
0x0003: PID 166943, rings 0x0003.
0x0003: PID 166943, rings 0x0003.

but these processes already exit, cannot found.

these situation make new isa_user_start failed, error message is:

kernel:

kernel: QAT: Bundle 36, rings 0x0001 already reserved
kernel: QAT: Bundle 48, rings 0x0001 already reserved
kernel: QAT: Bundle 36, rings 0x0001 already reserved
kernel: QAT: Bundle 48, rings 0x0001 already reserved

user:

[error] SalCtrl_CompressionInit() - : Failed to create DC TX handle
[error] SalCtrl_ServiceInit() - : Failed to initialise all service instances
ADF_UIO_PROXY err: adf_user_subsystemInit: Failed to initialise Subservice SAL
[error] SalCtrl_ServiceEventStart() - : Private data is NULL

I thought the rings are leaked, cos cannot found any other processs using qat uio now

[Ronny_G_Intel]

Hi paulinusking,

Thanks for reaching out to Intel Communities.

I see that you are using QAT version 2.0 and running latest driver available version 1.2.0-00090.

You are getting the below error:

[error] SalCtrl_CompressionInit() - : Failed to create DC TX handle

[error] SalCtrl_ServiceInit() - : Failed to initialise all service instances

ADF_UIO_PROXY err: adf_user_subsystemInit: Failed to initialise Subservice SAL

[error] SalCtrl_ServiceEventStart() - : Private data is NULL

With this information I can think of 2 possible scenarios:

1. When running openssl

Is this happening when trying to run openssl (or an openssl-based application) with QAT_engine with the USDM driver with huge pages?

If this is the case, please ensure that huge pages are created.

#cat /sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages (should be greater than zero)

If the number of huge pages is zero, as an example, they can be increased temporarily as follows:

#echo 1024 > /proc/sys/vm/nr_hugepages

2. When running cpa_sample code 

Is this happening when running cpa_sample code, it runs but fails and shows the error that you mentioned, or shows unusual errors with VFs.

If none of the scenarios mentioned above is applicable, please provide details regarding how to replicate this issue and include the icp_dump.

To generate the icp_dump, run the script located at $ICP_ROOT/quickassist/utilities/debug_tool/icp_dump.sh.

This will create a tar file containing your full system setup, including configuration files.

Regards,

Ronny G

[paulinusking]

1.  we are using hugpages, and hugepages not zero.  we use qat normal for a few days.  It dose not work later and cannot resume.

2.  after qat abnormal, I just write a test code to check qat.

auto status = qaeMemInit(); 

if (status != CPA_STATUS_SUCCESS) {

printf("qaeMemInit %d\n", status);

return -1;

}

status = icp_sal_userStart("DATANODE_5008");

if (status != CPA_STATUS_SUCCESS) {

printf("start failed %d\n", status); // it failed on it

qaeMemDestroy();

return -2;

}

3. icp_dump cannot upload 30MB file, so I split into 2 file, pls use   

cat ICP_debug_14h_40m_49s_08d_07m_25y.*.gz. >  ICP_debug_14h_40m_49s_08d_07m_25y.tar.gz

to resume

[paulinusking]

another attachment( I tar czf the second attachment because the upload limit)

pls tar xzf other.tgz first