Issue with accel-config enable-wq

BrianMartiniello · ‎04-10-2025

I have been able to build and run the 'accel-config' tool from this repository: https://github.com/intel/idxd-config

Using the tool I am able to run the following commands successfully:

accel-config disable-device -v dsa0

accel-config config-engine dsa0/engine0.0 --group-id=0

accel-config disable-wq -v dsa0/wq0.0

accel-config config-wq dsa0/wq0.0 --group-id=0 --type=user --wq-size=32 --priority=10 --max-batch-size=1024 --max-transfer-size=2147483648 --mode=dedicated --name=rcav2

accel-config enable-device -v dsa0

accel-config enable-wq -v dsa0/wq0.0

However, I am getting an error from the tool using the following command:

accel-config enable-wq -v dsa0/wq0.0 dsa0/wq0.1 dsa0/wq0.2 dsa0/wq0.3)

Here is the error with the code modified to add little more print information:

calling accfg_wq_enable for dsa0/wq0.0...

calling accfg_wq_control for wq0.0...

wq "wq0.0" bus type "dsa" driver name "(null)" portal "user" start

failed to write wq0.0 to /sys/bus/dsa/drivers/user/bind: Operation not supported

wq "wq0.0" bus type "dsa" driver name "(null)" portal "user" path "/sys/bus/dsa/drivers/user/bind" sysfs_write_attr failed, rc = -95 (Operation not supported)

failed in dsa0/wq0.0, rc = -95 (Operation not supported)

More information can be found below.

Can any feedback be provided to help explain or debug this issue?

Thanks.

------------------------------------------------

ll /sys/bus/dsa/drivers/user/bind
--w------- 1 root root 4096 Apr 8 19:30 /sys/bus/dsa/drivers/user/bind

IOMMU is enabled

uname -a output: Linux **bleep** 5.14.0-362.8.1.el9_3.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Oct 3 11:12:36 EDT 2023 x86_64 x86_64 x86_64 GNU/Linux

accel-config --version: 4.1.8.gite561a565

modinfo idxd output

filename: /lib/modules/5.14.0-362.8.1.el9_3.x86_64/kernel/drivers/dma/idxd/idxd.ko.xz

import_ns: IDXD

author: Intel Corporation

license: GPL v2

version: 1.00

rhelversion: 9.3

srcversion: BD8361C72E3E2AF2A745421

alias: pci:v00008086d00000CFEsv*sd*bc*sc*i*

alias: pci:v00008086d00000B25sv*sd*bc*sc*i*

depends: idxd_bus

retpoline: Y

intree: Y

name: idxd

vermagic: 5.14.0-362.8.1.el9_3.x86_64 SMP preempt mod_unload modversions

sig_id: PKCS#7

signer: Red Hat Enterprise Linux kernel signing key

sig_key: 1F:F0:D0:D7:72:A6:ED:12:E3:1B:CC:C9:E0:49:15:03:79:D5:1F:69

sig_hashalgo: sha256

signature: 32:A9:2A:7F:3F:1E:73:BF:9A:FF:8B:79:F0:8D:15:0D:F8:F7:15:5D:

68:B3:4D:57:EA:9C:3A:06:AC:E5:F9:ED:F6:E9:B0:E6:36:27:B7:C7:

FA:BE:74:BF:AF:45:84:90:0B:A1:54:FA:4C:82:D1:47:FB:AC:D3:DC:

E8:48:FC:1C:8D:96:43:B0:77:CD:08:35:47:2F:06:6E:D4:1B:05:34:

10:CE:30:68:8E:0C:6B:20:7E:18:F7:64:C3:71:1A:D4:34:FD:54:7B:

11:0B:34:8E:E6:53:10:90:B3:06:70:FA:8B:31:85:B5:ED:62:8B:0A:

96:A7:C2:80:A0:42:A4:91:17:E3:C5:44:9C:13:8A:FF:BB:3B:59:B4:

0E:FF:25:79:F5:40:98:C2:83:E8:E4:FB:DB:32:97:D5:1D:E6:4F:47:

C2:05:C9:9F:27:74:01:97:CB:E7:BF:74:0B:F0:75:CB:50:29:56:D4:

D6:F8:F2:5B:95:6A:3F:4C:E0:45:D2:99:74:C1:94:0A:77:9C:07:DE:

82:72:E0:56:13:9D:1F:3F:88:13:9C:3E:EE:3E:9D:47:20:71:11:42:

91:90:77:0C:C5:DD:3F:79:78:1E:BD:80:A8:34:38:98:16:70:2F:8A:

F1:04:0C:15:56:19:79:19:5F:B5:1C:4B:41:69:D8:B4:CC:3D:4D:46:

ED:AC:0D:65:1D:A9:34:0E:A3:69:C7:05:2D:29:D6:C6:29:8A:96:77:

B3:62:E3:82:74:1F:27:45:69:36:41:79:AE:DC:1D:6D:6B:73:54:C8:

63:A8:72:6F:25:7A:DB:BF:ED:4B:10:5A:F1:E9:DE:C2:E0:5F:D8:CE:

B8:9F:58:5F:3F:25:2A:5B:8C:32:8E:5A:00:7C:62:E8:55:08:CB:C9:

85:B6:AC:30:9F:CA:22:C4:66:FE:67:81:C2:32:D3:6C:87:1D:58:E3:

EF:83:E4:FA:1F:77:88:51:06:C1:A3:EB:BD:14:C4:83:83:49:6C:BF:

4F:F1:36:63

parm: sva:Toggle SVA support on/off (bool)

parm: tc_override:Override traffic class defaults (bool)

dmesg | grep idxd

[ 10.923847] idxd 0000:6a:01.0: Unable to turn on user SVA feature.

[ 10.947687] idxd 0000:6a:01.0: Intel(R) Accelerator Device (v100)

[ 10.947836] idxd 0000:6a:02.0: Unable to turn on user SVA feature.

[ 10.966540] idxd 0000:6a:02.0: Intel(R) Accelerator Device (v100)

[ 10.966833] idxd 0000:e7:01.0: Unable to turn on user SVA feature.

[ 10.984596] idxd 0000:e7:01.0: Intel(R) Accelerator Device (v100)

[ 10.984669] idxd 0000:e7:02.0: Unable to turn on user SVA feature.

[ 10.990445] idxd 0000:e7:02.0: Intel(R) Accelerator Device (v100)

[151760.033617] idxd 0000:6a:01.0: No shared wq support but configured.

[151760.082115] idxd 0000:e7:01.0: No shared wq support but configured.

dmidecode output

Getting SMBIOS data from sysfs.

SMBIOS 3.3.0 present.

Table at 0x6FF17000.

Handle 0xDA00, DMI type 218, 17 bytes

OEM-specific Type

Header and Data:

DA 11 00 DA B2 00 17 20 0E 10 03 FF FF 00 00 00

00

Handle 0x0000, DMI type 0, 26 bytes

BIOS Information

Vendor: Dell Inc.

Version: 2.2.7

Release Date: 05/13/2024

Address: 0xF0000

Runtime Size: 64 kB

ROM Size: 32 MB

Characteristics:

ISA is supported

PCI is supported

PNP is supported

BIOS is upgradeable

BIOS shadowing is allowed

Boot from CD is supported

Selectable boot is supported

EDD is supported

Japanese floppy for Toshiba 1.2 MB is supported (int 13h)

5.25"/360 kB floppy services are supported (int 13h)

5.25"/1.2 MB floppy services are supported (int 13h)

3.5"/720 kB floppy services are supported (int 13h)

8042 keyboard services are supported (int 9h)

Serial services are supported (int 14h)

CGA/mono video services are supported (int 10h)

ACPI is supported

USB legacy is supported

BIOS boot specification is supported

Function key-initiated network boot is supported

Targeted content distribution is supported

UEFI is supported

BIOS Revision: 2.2

Handle 0x0100, DMI type 1, 27 bytes

System Information

Manufacturer: Dell Inc.

Product Name: PowerEdge R760xa

Version: Not Specified

Serial Number: 92FCFZ3

UUID: 4c4c4544-0032-4610-8043-b9c04f465a33

Wake-up Type: Power Switch

SKU Number: SKU=974C;ModelName=PowerEdge R760xa

Family: PowerEdge

Handle 0x0200, DMI type 2, 8 bytes

Base Board Information

Manufacturer: Dell Inc.

Product Name: 0CRRF2

Version: A01

Serial Number: .92FCFZ3.CNIVC003740204.

Poojitha · ‎04-26-2025

Hi BrianMartiniello,

Thank you for reaching out to the Intel support. We acknowledge receipt of your concern and want to assure you that assisting you is our top priority. To effectively troubleshoot the issue you're facing, we require some additional information from your end.

Could you kindly provide the following details?

1.Kindly share the system details and complete product information.

2.Could you please elaborate on the issue you are facing?

Your prompt response with this information will greatly assist us in diagnosing and resolving the issue as quickly as possible.

We look forward to hearing from you soon.

Best regards,

Poojitha N

Intel Customer Support Technician

BrianMartiniello · ‎04-29-2025

1) Please see the dmidecode output in my original post. Here is the output of 'cat /etc/os-release':

NAME="Red Hat Enterprise Linux"
VERSION="9.3 (Plow)"
ID="rhel"
ID_LIKE="fedora"
VERSION_ID="9.3"
PLATFORM_ID="platform:el9"
PRETTY_NAME="Red Hat Enterprise Linux 9.3 (Plow)"
ANSI_COLOR="0;31"
LOGO="fedora-logo-icon"
CPE_NAME="cpe:/o:redhat:enterprise_linux:9::baseos"
HOME_URL="https://www.redhat.com/"
DOCUMENTATION_URL="https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/9"
BUG_REPORT_URL="https://bugzilla.redhat.com/"

REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 9"
REDHAT_BUGZILLA_PRODUCT_VERSION=9.3
REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
REDHAT_SUPPORT_PRODUCT_VERSION="9.3"

2) Using the accel-conf tool I am able to run the following commands successfully:

accel-config disable-device -v dsa0

accel-config config-engine dsa0/engine0.0 --group-id=0

accel-config disable-wq -v dsa0/wq0.0

accel-config config-wq dsa0/wq0.0 --group-id=0 --type=user --wq-size=32 --priority=10 --max-batch-size=1024 --max-transfer-size=2147483648 --mode=dedicated --name=rcav2

accel-config enable-device -v dsa0

accel-config enable-wq -v dsa0/wq0.0

However, I am getting an error from the tool using the following command:

accel-config enable-wq -v dsa0/wq0.0 dsa0/wq0.1 dsa0/wq0.2 dsa0/wq0.3)

Here is the error with the code modified to add little more print information:

calling accfg_wq_enable for dsa0/wq0.0...

calling accfg_wq_control for wq0.0...

wq "wq0.0" bus type "dsa" driver name "(null)" portal "user" start

failed to write wq0.0 to /sys/bus/dsa/drivers/user/bind: Operation not supported

wq "wq0.0" bus type "dsa" driver name "(null)" portal "user" path "/sys/bus/dsa/drivers/user/bind" sysfs_write_attr failed, rc = -95 (Operation not supported)

failed in dsa0/wq0.0, rc = -95 (Operation not supported)

Poojitha · ‎04-29-2025

Hi BrianMartiniell the,

Greetings for the day!

Thank you for your response. Kindly confirm the processor details that you are using in your system.

Could you please confirm whether the processor came with the system or was purchased separately?

This information will help us check the complete details and assist you further.

We appreciate your understanding!

Best regards,

Poojitha N

Intel Customer Support Technician

BrianMartiniello · ‎04-29-2025

The processor came with the system. The output of 'lscpu' is below:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 57 bits virtual
Byte Order: Little Endian
CPU(s): 224
On-line CPU(s) list: 0-223
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Platinum 8480+
CPU family: 6
Model: 143
Thread(s) per core: 2
Core(s) per socket: 56
Socket(s): 2
Stepping: 8
CPU max MHz: 2000.0000
CPU min MHz: 800.0000
BogoMIPS: 4000.00
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bt
s rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movb
e popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cat_l2 cdp_l3 invpcid_single cdp_l2 ssbd mba ibrs ibpb stibp ibrs_enhanced tpr_shad
ow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm rdt_a avx512f avx512dq rdseed adx smap avx512ifma clflushopt clwb intel_pt avx512cd sha_ni avx512
bw avx512vl xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local split_lock_detect avx_vnni avx512_bf16 wbnoinvd dtherm arat pln pts vnmi avx512vbmi umip pku
ospke waitpkg avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg tme avx512_vpopcntdq la57 rdpid bus_lock_detect cldemote movdiri movdir64b enqcmd fsrm md_clear serialize tsxldt
rk pconfig arch_lbr ibt amx_bf16 avx512_fp16 amx_tile amx_int8 flush_l1d arch_capabilities
Virtualization features:
Virtualization: VT-x
Caches (sum of all):
L1d: 5.3 MiB (112 instances)
L1i: 3.5 MiB (112 instances)
L2: 224 MiB (112 instances)
L3: 210 MiB (2 instances)
NUMA:
NUMA node(s): 2
NUMA node0 CPU(s): 0,2,4,6,8,10,12,14,16,18,20,22,24,26,28,30,32,34,36,38,40,42,44,46,48,50,52,54,56,58,60,62,64,66,68,70,72,74,76,78,80,82,84,86,88,90,92,94,96,98,100,102,104,106,108,110,112,114,116,118,1
20,122,124,126,128,130,132,134,136,138,140,142,144,146,148,150,152,154,156,158,160,162,164,166,168,170,172,174,176,178,180,182,184,186,188,190,192,194,196,198,200,202,204,206,208,210,212
,214,216,218,220,222
NUMA node1 CPU(s): 1,3,5,7,9,11,13,15,17,19,21,23,25,27,29,31,33,35,37,39,41,43,45,47,49,51,53,55,57,59,61,63,65,67,69,71,73,75,77,79,81,83,85,87,89,91,93,95,97,99,101,103,105,107,109,111,113,115,117,119,1
21,123,125,127,129,131,133,135,137,139,141,143,145,147,149,151,153,155,157,159,161,163,165,167,169,171,173,175,177,179,181,183,185,187,189,191,193,195,197,199,201,203,205,207,209,211,213
,215,217,219,221,223
Vulnerabilities:
Gather data sampling: Not affected
Itlb multihit: Not affected
L1tf: Not affected
Mds: Not affected
Meltdown: Not affected
Mmio stale data: Not affected
Retbleed: Not affected
Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Spectre v2: Mitigation; Enhanced / Automatic IBRS, IBPB conditional, RSB filling, PBRSB-eIBRS SW sequence
Srbds: Not affected
Tsx async abort: Not affected

Poojitha · ‎04-29-2025

Hi BrianMartiniello,

Thank you for your response. We regret to inform you that, as you have confirmed the processor came along with the system and based on the processor details you shared, it is identified as a tray processor.We refer to these processors as tray or OEM processors. Intel doesn't provide direct warranty support or Technical support.

For more details please follow the below link:

https://www.intel.com/content/www/us/en/support/articles/000029613/processors.html

We recommend that you contact Dell for further assistance.

If you have any questions or doubts, please reach out to us. We are happy to assist you!

Best regards,

Poojitha N

Intel Customer Support Technician

Poojitha · ‎04-30-2025

Hi BrianMartiniello,

As we mentioned earlier, we refer to these processors as tray or OEM processors. Kindly reach out to the OEM for further assistance. We are proceeding with case closure.

Reards,

Poojitha

Intel Customer Support Technician