Data Streaming Accelerator (DSA) driver idxd reports "Unable to turn on user SVA feature".

[haoxiangbd]

Hi,

I am working on some potential software integration using DSA. While loading into linux kernel 6.3, from dmesg I noticed this line "Unable to turn on user SVA feature".  I have been following the steps described in "data-streaming-accelerator-user-guide" and built the kernel with the below configuration switch turned on

CONFIG_INTEL_IOMMU=y CONFIG_INTEL_IOMMU_SVM=y CONFIG_INTEL_IOMMU_DEFAULT_ON=y CONFIG_INTEL_IOMMU_SCALABLE_MODE_DEFAULT_ON=y

CONFIG_INTEL_IDXD=m

CONFIG_INTEL_IDXD_SVM=y

CONFIG_INTEL_IDXD_PERFMON=y

I have also added parameter “intel_iommu=on,sm_on” to the kernel command line but still same problem.

What I do noticed is that on my system, pasid is not enabled for DSA.

$ cat /sys/bus/dsa/devices/dsa0/pasid_enabled

0

And Page Request Interface capabilities is not enabled.

$ lspci -vvv -s 6a:01.0

...

Capabilities: [220 v1] Address Translation Service (ATS)

ATSCap: Invalidate Queue Depth: 00

ATSCtl: Enable+, Smallest Translation Unit: 00

Capabilities: [230 v1] Process Address Space ID (PASID)

PASIDCap: Exec- Priv+, Max PASID Width: 14

PASIDCtl: Enable+ Exec- Priv+

Capabilities: [240 v1] Page Request Interface (PRI)

PRICtl: Enable- Reset-

PRISta: RF- UPRGI- Stopped+

Page Request Capacity: 00000200, Page Request Allocation: 00000000

Kernel driver in use: idxd

Kernel modules: idxd

...

My understanding is that PASID depends on PRI and SVM depends onPASID. Can you please let me know how to enable Page Request Interface capability?

[Victor_G_Intel]

Hello haoxiangbd,

Thank you for posting on the Intel® communities.

To move forward with your request, please provide the information below:

1. The exact motherboard model and processor that you are currently working with.
2. You mentioned that you are using Linux; therefore, we will need to know your exact Linux distribution.
3. Are you requesting this information on behalf of a company? If yes, please provide as many details as possible about the company that you work for.

Best regards,

Victor G.

Intel Technical Support Technician

[haoxiangbd]

$dmidecode -t 2

# dmidecode 3.3

Getting SMBIOS data from sysfs.

SMBIOS 3.5.0 present.

# SMBIOS implementations newer than version 3.3.0 are not

# fully supported by this version of dmidecode.

Handle 0x0002, DMI type 2, 15 bytes

Base Board Information

Manufacturer: Inspur

Product Name: SA5280D7

Version: YZMB-02666-106

Serial Number: MBN304S40040Y01

Asset Tag: 222539873

Features:

Board is a hosting board

Board is replaceable

Location In Chassis: Part Component

Chassis Handle: 0x0003

Type: Motherboard

Contained Object Handles: 0

$lscpu

Architecture:        x86_64

CPU op-mode(s):      32-bit, 64-bit

Byte Order:          Little Endian

Address sizes:       52 bits physical, 57 bits virtual

CPU(s):              192

On-line CPU(s) list: 0-191

Thread(s) per core:  2

Core(s) per socket:  48

Socket(s):           2

NUMA node(s):        2

Vendor ID:           GenuineIntel

CPU family:          6

Model:               143

Model name:          Intel(R) Xeon(R) Platinum 8457C

Stepping:            6

CPU MHz:             2600.000

CPU max MHz:         3800.0000

CPU min MHz:         800.0000

BogoMIPS:            5200.00

Virtualization:      VT-x

L1d cache:           48K

L1i cache:           32K

L2 cache:            2048K

L3 cache:            99840K

NUMA node0 CPU(s):   0-47,96-143

NUMA node1 CPU(s):   48-95,144-191

Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cat_l2 cdp_l3 invpcid_single intel_ppin cdp_l2 ssbd mba ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm rdt_a avx512f avx512dq rdseed adx smap avx512ifma clflushopt clwb intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local split_lock_detect avx_vnni avx512_bf16 wbnoinvd dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req avx512vbmi umip pku ospke waitpkg avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg tme avx512_vpopcntdq rdpid bus_lock_detect cldemote movdiri movdir64b enqcmd fsrm md_clear serialize tsxldtrk pconfig arch_lbr ibt amx_bf16 avx512_fp16 amx_tile amx_int8 flush_l1d arch_capabilities

1. Motherboard and CPU information above.

2. I build my own kernel based on v5.18-rc3 tag. It's the upstream community version.

3. This is requesting for Bytedance. 

[Victor_G_Intel · Accepted solution]

Hello haoxiangbd,

Thank you for your response

In this case, we need to inform you the support for the processor you have is provided over a different channel. The way you can receive support for this processor is by opening a support ticket through our IPS channel. Please find the required information below:

Intel® Premier Support (IPS)

https://www.intel.com/content/www/us/en/design/support/ips/training/welcome.html

Best regards,

Victor G.

Intel Technical Support Technician  

[Victor_G_Intel]

Hello haoxiangbd,

Thank you for your response.

We are glad to know that you've found our information helpful. Since the thread is now solved, we will proceed to close it.

If you need any additional information, please submit a new question as this thread will no longer be monitored.

Best regards,

Victor G. 

Intel Technical Support Technician