Intel Arc 770 ubuntu 22.04 oem kernel issue (BAR _: failed to assign)

[AlexanderSchroeter]

I have followed the install instructions for ubuntu jammy here (https://dgpu-docs.intel.com/installation-guides/ubuntu/ubuntu-jammy-arc.html) but after switching to the oem kernel some of my other GPUs (AMD working correctly with the regular kernel) and the A770 don't get recognized.

I believe it has to do with the the failure to assign memory:

sudo dmesg -T

"""

...

[Fri Dec 16 09:28:47 2022] pci 0000:62:01.0: BAR 15: assigned [mem 0x18000000000-0x1800fffffff 64bit pref]
[Fri Dec 16 09:28:47 2022] pci 0000:62:01.0: BAR 14: no space for [mem size 0x01800000]
[Fri Dec 16 09:28:47 2022] pci 0000:62:01.0: BAR 14: failed to assign [mem size 0x01800000]
[Fri Dec 16 09:28:47 2022] pci 0000:63:00.0: BAR 2: assigned [mem 0x18000000000-0x1800fffffff 64bit pref]
[Fri Dec 16 09:28:47 2022] pci 0000:63:00.0: BAR 0: no space for [mem size 0x01000000 64bit]
[Fri Dec 16 09:28:47 2022] pci 0000:63:00.0: BAR 0: failed to assign [mem size 0x01000000 64bit]
[Fri Dec 16 09:28:47 2022] pci 0000:63:00.0: BAR 6: no space for [mem size 0x00200000 pref]
[Fri Dec 16 09:28:47 2022] pci 0000:63:00.0: BAR 6: failed to assign [mem size 0x00200000 pref]

...

"""

I don't remember seeing this issue with the regular ubuntu 22.04 kernel but as per the install instructions the dkms installation would fail on that kernel. 

Help in form of a workaround to either fix the allocation issue or to run the driver with the regular kernel would be much appreciated.

Just for completeness I also see these errors but I believe they are just symptoms of the previous one.

"""

[Fri Dec 16 09:30:04 2022] ================================================================================
[Fri Dec 16 09:30:04 2022] UBSAN: array-index-out-of-bounds in /opt/intel/oneapi/vtune/2022.4.1/sepdk/src/socperf/src/pmu_list.c:392:60
[Fri Dec 16 09:30:04 2022] index -1 is out of range for type 'PMU_INFO_NODE [10]'
[Fri Dec 16 09:30:04 2022] CPU: 126 PID: 2720 Comm: insmod Tainted: G OE 5.17.0-1019-oem #20-Ubuntu
[Fri Dec 16 09:30:04 2022] Hardware name: Supermicro AS -4124GS-TNR/H12DSG-O-CPU, BIOS 2.4 04/22/2022
[Fri Dec 16 09:30:04 2022] Call Trace:
[Fri Dec 16 09:30:04 2022] <TASK>
[Fri Dec 16 09:30:04 2022] show_stack+0x52/0x59
[Fri Dec 16 09:30:04 2022] dump_stack_lvl+0x4c/0x64
[Fri Dec 16 09:30:04 2022] dump_stack+0x10/0x13
[Fri Dec 16 09:30:04 2022] ubsan_epilogue+0x9/0x46
[Fri Dec 16 09:30:04 2022] __ubsan_handle_out_of_bounds.cold+0x44/0x49
[Fri Dec 16 09:30:04 2022] ? cdev_default_release+0x70/0x70
[Fri Dec 16 09:30:04 2022] PMU_LIST_Build_MMIO_List+0xdc/0xf0 [socperf3]
[Fri Dec 16 09:30:04 2022] socperf_Load.cold+0x1cf/0x1fd [socperf3]
[Fri Dec 16 09:30:04 2022] ? SOCPERF_Abnormal_Terminate+0x90/0x90 [socperf3]
[Fri Dec 16 09:30:04 2022] do_one_initcall+0x49/0x210
[Fri Dec 16 09:30:04 2022] ? kmem_cache_alloc_trace+0x1a6/0x320
[Fri Dec 16 09:30:04 2022] do_init_module+0x52/0x260
[Fri Dec 16 09:30:04 2022] load_module+0xb81/0xc90
[Fri Dec 16 09:30:04 2022] __do_sys_finit_module+0xc5/0x130
[Fri Dec 16 09:30:04 2022] __x64_sys_finit_module+0x18/0x20
[Fri Dec 16 09:30:04 2022] do_syscall_64+0x5c/0xc0
[Fri Dec 16 09:30:04 2022] ? ksys_mmap_pgoff+0x10d/0x250
[Fri Dec 16 09:30:04 2022] ? exit_to_user_mode_prepare+0x37/0xb0
[Fri Dec 16 09:30:04 2022] ? syscall_exit_to_user_mode+0x27/0x50
[Fri Dec 16 09:30:04 2022] ? __x64_sys_mmap+0x33/0x40
[Fri Dec 16 09:30:04 2022] ? do_syscall_64+0x69/0xc0
[Fri Dec 16 09:30:04 2022] ? asm_exc_page_fault+0x8/0x30
[Fri Dec 16 09:30:04 2022] entry_SYSCALL_64_after_hwframe+0x44/0xae
[Fri Dec 16 09:30:04 2022] RIP: 0033:0x7f22d3c6da3d
[Fri Dec 16 09:30:04 2022] Code: 5b 41 5c c3 66 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d c3 a3 0f 00 f7 d8 64 89 01 48
[Fri Dec 16 09:30:04 2022] RSP: 002b:00007ffc9ba50dd8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[Fri Dec 16 09:30:04 2022] RAX: ffffffffffffffda RBX: 0000555a937fe7d0 RCX: 00007f22d3c6da3d
[Fri Dec 16 09:30:04 2022] RDX: 0000000000000000 RSI: 0000555a935fbcd2 RDI: 0000000000000003
[Fri Dec 16 09:30:04 2022] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000
[Fri Dec 16 09:30:04 2022] R10: 0000000000000003 R11: 0000000000000246 R12: 0000555a935fbcd2
[Fri Dec 16 09:30:04 2022] R13: 0000555a937fe760 R14: 0000555a935fa888 R15: 0000555a937fe8f0
[Fri Dec 16 09:30:04 2022] </TASK>
[Fri Dec 16 09:30:04 2022] ================================================================================
[Fri Dec 16 09:30:04 2022] socperf3_0: No MMIO list information detected!
[Fri Dec 16 09:30:04 2022] socperf3_0: SocPerf Driver v3.0.0 has been loaded.
[Fri Dec 16 09:30:04 2022] loop5: detected capacity change from 0 to 8
[Fri Dec 16 09:30:04 2022] Dev loop5: unable to read RDB block 8
[Fri Dec 16 09:30:04 2022] loop5: unable to read partition table
[Fri Dec 16 09:30:04 2022] loop5: partition table beyond EOD, truncated
[Fri Dec 16 09:30:05 2022] sep5_34: Driver loading... sym_lookup_func_addr=ffffffffa6993b90
[Fri Dec 16 09:30:05 2022] sep5_34: [load] [UTILITY_Driver_Log_Init@1128]: Initialized driver log using contiguous physical memory.
[Fri Dec 16 09:30:05 2022] sep5_34: [load] [lwpmu_Load@7022]: Major number is 504
[Fri Dec 16 09:30:05 2022] sep5_34: [load] [lwpmu_Load@7029]: Detected 128 total CPUs and 128 active CPUs.
[Fri Dec 16 09:30:05 2022] sep5_34: [warning] [lwpmudrv_Detect_PMT_Endpoints@6152]: Address of PMT function is invalid

[Fri Dec 16 09:30:05 2022] sep5_34: [load] [lwpmu_Load@7356]: PMU collection driver v5.34.12 has been loaded.
[Fri Dec 16 09:30:05 2022] sep5_34: [load] [lwpmu_Load@7366]: NMI will be used for handling PMU interrupts.
[Fri Dec 16 09:30:05 2022] sep5_34: [load] [PMU_LIST_Initialize@701]: PMU check enabled! Ff.M31.S0 index=-1 drv_type=PUBLIC arch_pmu_info_used=no

[Fri Dec 16 09:30:05 2022] ================================================================================
[Fri Dec 16 09:30:05 2022] UBSAN: array-index-out-of-bounds in /opt/intel/oneapi/vtune/2022.4.1/sepdk/src/pmu_list.c:723:38
[Fri Dec 16 09:30:05 2022] index -1 is out of range for type 'PMU_INFO_NODE [52]'
[Fri Dec 16 09:30:05 2022] CPU: 32 PID: 2866 Comm: insmod Tainted: G OE 5.17.0-1019-oem #20-Ubuntu
[Fri Dec 16 09:30:05 2022] Hardware name: Supermicro AS -4124GS-TNR/H12DSG-O-CPU, BIOS 2.4 04/22/2022
[Fri Dec 16 09:30:05 2022] Call Trace:
[Fri Dec 16 09:30:05 2022] <TASK>
[Fri Dec 16 09:30:05 2022] show_stack+0x52/0x59
[Fri Dec 16 09:30:05 2022] dump_stack_lvl+0x4c/0x64
[Fri Dec 16 09:30:05 2022] dump_stack+0x10/0x13
[Fri Dec 16 09:30:05 2022] ubsan_epilogue+0x9/0x46
[Fri Dec 16 09:30:05 2022] __ubsan_handle_out_of_bounds.cold+0x44/0x49
[Fri Dec 16 09:30:05 2022] ? PMU_LIST_Initialize+0x149/0x230 [sep5]
[Fri Dec 16 09:30:05 2022] PMU_LIST_Build_MSR_List+0x1c4/0x1f0 [sep5]
[Fri Dec 16 09:30:05 2022] lwpmu_Load+0x1529/0x1780 [sep5]
[Fri Dec 16 09:30:05 2022] ? __free_one_page+0x6d/0x5a0
[Fri Dec 16 09:30:05 2022] ? __vunmap+0x248/0x2a0
[Fri Dec 16 09:30:05 2022] ? kfree+0xab/0x410
[Fri Dec 16 09:30:05 2022] ? free_unref_page+0xe0/0x190
[Fri Dec 16 09:30:05 2022] ? __vunmap+0x248/0x2a0
[Fri Dec 16 09:30:05 2022] ? kfree+0xab/0x410
[Fri Dec 16 09:30:05 2022] ? lwpmudrv_Abnormal_Handler+0x1c0/0x1c0 [sep5]
[Fri Dec 16 09:30:05 2022] do_one_initcall+0x49/0x210
[Fri Dec 16 09:30:05 2022] ? kmem_cache_alloc_trace+0x1a6/0x320
[Fri Dec 16 09:30:05 2022] do_init_module+0x52/0x260
[Fri Dec 16 09:30:05 2022] load_module+0xb81/0xc90
[Fri Dec 16 09:30:05 2022] __do_sys_finit_module+0xc5/0x130
[Fri Dec 16 09:30:05 2022] __x64_sys_finit_module+0x18/0x20
[Fri Dec 16 09:30:05 2022] do_syscall_64+0x5c/0xc0
[Fri Dec 16 09:30:05 2022] ? exit_to_user_mode_prepare+0x37/0xb0
[Fri Dec 16 09:30:05 2022] ? syscall_exit_to_user_mode+0x27/0x50
[Fri Dec 16 09:30:05 2022] ? __x64_sys_mmap+0x33/0x40
[Fri Dec 16 09:30:05 2022] ? do_syscall_64+0x69/0xc0
[Fri Dec 16 09:30:05 2022] ? syscall_exit_to_user_mode+0x27/0x50
[Fri Dec 16 09:30:05 2022] ? __x64_sys_newfstatat+0x1c/0x20
[Fri Dec 16 09:30:05 2022] ? do_syscall_64+0x69/0xc0
[Fri Dec 16 09:30:05 2022] ? ksys_lseek+0x85/0xc0
[Fri Dec 16 09:30:05 2022] ? exit_to_user_mode_prepare+0x37/0xb0
[Fri Dec 16 09:30:05 2022] ? syscall_exit_to_user_mode+0x27/0x50
[Fri Dec 16 09:30:05 2022] ? __x64_sys_lseek+0x18/0x20
[Fri Dec 16 09:30:05 2022] ? do_syscall_64+0x69/0xc0
[Fri Dec 16 09:30:05 2022] ? irqentry_exit_to_user_mode+0x9/0x20
[Fri Dec 16 09:30:05 2022] ? irqentry_exit+0x35/0x40
[Fri Dec 16 09:30:05 2022] ? exc_page_fault+0x89/0x180
[Fri Dec 16 09:30:05 2022] ? asm_exc_page_fault+0x8/0x30
[Fri Dec 16 09:30:05 2022] entry_SYSCALL_64_after_hwframe+0x44/0xae
[Fri Dec 16 09:30:05 2022] RIP: 0033:0x7fa7322b6a3d
[Fri Dec 16 09:30:05 2022] Code: 5b 41 5c c3 66 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d c3 a3 0f 00 f7 d8 64 89 01 48
[Fri Dec 16 09:30:05 2022] RSP: 002b:00007fffb81ef6b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[Fri Dec 16 09:30:05 2022] RAX: ffffffffffffffda RBX: 000055b510d9e800 RCX: 00007fa7322b6a3d
[Fri Dec 16 09:30:05 2022] RDX: 0000000000000000 RSI: 000055b510d9e2a0 RDI: 0000000000000003
[Fri Dec 16 09:30:05 2022] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000
[Fri Dec 16 09:30:05 2022] R10: 0000000000000003 R11: 0000000000000246 R12: 000055b510d9e2a0
[Fri Dec 16 09:30:05 2022] R13: 000055b510d9e7a0 R14: 00007fffb81ef920 R15: 000055b510d9e910
[Fri Dec 16 09:30:05 2022] </TASK>
[Fri Dec 16 09:30:05 2022] ================================================================================
[Fri Dec 16 09:30:05 2022] sep5_34: [load] [PMU_LIST_Build_MSR_List@727]: No MSR list information detected!

[Fri Dec 16 09:30:05 2022] ================================================================================
[Fri Dec 16 09:30:05 2022] UBSAN: array-index-out-of-bounds in /opt/intel/oneapi/vtune/2022.4.1/sepdk/src/pmu_list.c:761:39
[Fri Dec 16 09:30:05 2022] index -1 is out of range for type 'PMU_INFO_NODE [52]'
[Fri Dec 16 09:30:05 2022] CPU: 32 PID: 2866 Comm: insmod Tainted: G OE 5.17.0-1019-oem #20-Ubuntu
[Fri Dec 16 09:30:05 2022] Hardware name: Supermicro AS -4124GS-TNR/H12DSG-O-CPU, BIOS 2.4 04/22/2022
[Fri Dec 16 09:30:05 2022] Call Trace:
[Fri Dec 16 09:30:05 2022] <TASK>
[Fri Dec 16 09:30:05 2022] show_stack+0x52/0x59
[Fri Dec 16 09:30:05 2022] dump_stack_lvl+0x4c/0x64
[Fri Dec 16 09:30:05 2022] dump_stack+0x10/0x13
[Fri Dec 16 09:30:05 2022] ubsan_epilogue+0x9/0x46
[Fri Dec 16 09:30:05 2022] __ubsan_handle_out_of_bounds.cold+0x44/0x49
[Fri Dec 16 09:30:05 2022] PMU_LIST_Build_PCI_List+0x178/0x180 [sep5]
[Fri Dec 16 09:30:05 2022] lwpmu_Load+0x152e/0x1780 [sep5]
[Fri Dec 16 09:30:05 2022] ? __free_one_page+0x6d/0x5a0
[Fri Dec 16 09:30:05 2022] ? __vunmap+0x248/0x2a0
[Fri Dec 16 09:30:05 2022] ? kfree+0xab/0x410
[Fri Dec 16 09:30:05 2022] ? free_unref_page+0xe0/0x190
[Fri Dec 16 09:30:05 2022] ? __vunmap+0x248/0x2a0
[Fri Dec 16 09:30:05 2022] ? kfree+0xab/0x410
[Fri Dec 16 09:30:05 2022] ? lwpmudrv_Abnormal_Handler+0x1c0/0x1c0 [sep5]
[Fri Dec 16 09:30:05 2022] do_one_initcall+0x49/0x210
[Fri Dec 16 09:30:05 2022] ? kmem_cache_alloc_trace+0x1a6/0x320
[Fri Dec 16 09:30:05 2022] do_init_module+0x52/0x260
[Fri Dec 16 09:30:05 2022] load_module+0xb81/0xc90
[Fri Dec 16 09:30:05 2022] __do_sys_finit_module+0xc5/0x130
[Fri Dec 16 09:30:05 2022] __x64_sys_finit_module+0x18/0x20
[Fri Dec 16 09:30:05 2022] do_syscall_64+0x5c/0xc0
[Fri Dec 16 09:30:05 2022] ? exit_to_user_mode_prepare+0x37/0xb0
[Fri Dec 16 09:30:05 2022] ? syscall_exit_to_user_mode+0x27/0x50
[Fri Dec 16 09:30:05 2022] ? __x64_sys_mmap+0x33/0x40
[Fri Dec 16 09:30:05 2022] ? do_syscall_64+0x69/0xc0
[Fri Dec 16 09:30:05 2022] ? syscall_exit_to_user_mode+0x27/0x50
[Fri Dec 16 09:30:05 2022] ? __x64_sys_newfstatat+0x1c/0x20
[Fri Dec 16 09:30:05 2022] ? do_syscall_64+0x69/0xc0
[Fri Dec 16 09:30:05 2022] ? ksys_lseek+0x85/0xc0
[Fri Dec 16 09:30:05 2022] ? exit_to_user_mode_prepare+0x37/0xb0
[Fri Dec 16 09:30:05 2022] ? syscall_exit_to_user_mode+0x27/0x50
[Fri Dec 16 09:30:05 2022] ? __x64_sys_lseek+0x18/0x20
[Fri Dec 16 09:30:05 2022] ? do_syscall_64+0x69/0xc0
[Fri Dec 16 09:30:05 2022] ? irqentry_exit_to_user_mode+0x9/0x20
[Fri Dec 16 09:30:05 2022] ? irqentry_exit+0x35/0x40
[Fri Dec 16 09:30:05 2022] ? exc_page_fault+0x89/0x180
[Fri Dec 16 09:30:05 2022] ? asm_exc_page_fault+0x8/0x30
[Fri Dec 16 09:30:05 2022] entry_SYSCALL_64_after_hwframe+0x44/0xae
[Fri Dec 16 09:30:05 2022] RIP: 0033:0x7fa7322b6a3d
[Fri Dec 16 09:30:05 2022] Code: 5b 41 5c c3 66 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d c3 a3 0f 00 f7 d8 64 89 01 48
[Fri Dec 16 09:30:05 2022] RSP: 002b:00007fffb81ef6b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[Fri Dec 16 09:30:05 2022] RAX: ffffffffffffffda RBX: 000055b510d9e800 RCX: 00007fa7322b6a3d
[Fri Dec 16 09:30:05 2022] RDX: 0000000000000000 RSI: 000055b510d9e2a0 RDI: 0000000000000003
[Fri Dec 16 09:30:05 2022] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000
[Fri Dec 16 09:30:05 2022] R10: 0000000000000003 R11: 0000000000000246 R12: 000055b510d9e2a0
[Fri Dec 16 09:30:05 2022] R13: 000055b510d9e7a0 R14: 00007fffb81ef920 R15: 000055b510d9e910
[Fri Dec 16 09:30:05 2022] </TASK>
[Fri Dec 16 09:30:05 2022] ================================================================================
[Fri Dec 16 09:30:05 2022] sep5_34: [load] [PMU_LIST_Build_PCI_List@765]: No PCI list information detected!

[Fri Dec 16 09:30:05 2022] ================================================================================
[Fri Dec 16 09:30:05 2022] UBSAN: array-index-out-of-bounds in /opt/intel/oneapi/vtune/2022.4.1/sepdk/src/pmu_list.c:805:39
[Fri Dec 16 09:30:05 2022] index -1 is out of range for type 'PMU_INFO_NODE [52]'
[Fri Dec 16 09:30:05 2022] CPU: 32 PID: 2866 Comm: insmod Tainted: G OE 5.17.0-1019-oem #20-Ubuntu
[Fri Dec 16 09:30:05 2022] Hardware name: Supermicro AS -4124GS-TNR/H12DSG-O-CPU, BIOS 2.4 04/22/2022
[Fri Dec 16 09:30:05 2022] Call Trace:
[Fri Dec 16 09:30:05 2022] <TASK>
[Fri Dec 16 09:30:05 2022] show_stack+0x52/0x59
[Fri Dec 16 09:30:05 2022] dump_stack_lvl+0x4c/0x64
[Fri Dec 16 09:30:05 2022] dump_stack+0x10/0x13
[Fri Dec 16 09:30:05 2022] ubsan_epilogue+0x9/0x46
[Fri Dec 16 09:30:05 2022] __ubsan_handle_out_of_bounds.cold+0x44/0x49
[Fri Dec 16 09:30:05 2022] PMU_LIST_Build_MMIO_List+0x159/0x170 [sep5]
[Fri Dec 16 09:30:05 2022] lwpmu_Load+0x1533/0x1780 [sep5]
[Fri Dec 16 09:30:05 2022] ? __free_one_page+0x6d/0x5a0
[Fri Dec 16 09:30:05 2022] ? __vunmap+0x248/0x2a0
[Fri Dec 16 09:30:05 2022] ? kfree+0xab/0x410
[Fri Dec 16 09:30:05 2022] ? free_unref_page+0xe0/0x190
[Fri Dec 16 09:30:05 2022] ? __vunmap+0x248/0x2a0
[Fri Dec 16 09:30:05 2022] ? kfree+0xab/0x410
[Fri Dec 16 09:30:05 2022] ? lwpmudrv_Abnormal_Handler+0x1c0/0x1c0 [sep5]
[Fri Dec 16 09:30:05 2022] do_one_initcall+0x49/0x210
[Fri Dec 16 09:30:05 2022] ? kmem_cache_alloc_trace+0x1a6/0x320
[Fri Dec 16 09:30:05 2022] do_init_module+0x52/0x260
[Fri Dec 16 09:30:05 2022] load_module+0xb81/0xc90
[Fri Dec 16 09:30:05 2022] __do_sys_finit_module+0xc5/0x130
[Fri Dec 16 09:30:05 2022] __x64_sys_finit_module+0x18/0x20
[Fri Dec 16 09:30:05 2022] do_syscall_64+0x5c/0xc0
[Fri Dec 16 09:30:05 2022] ? exit_to_user_mode_prepare+0x37/0xb0
[Fri Dec 16 09:30:05 2022] ? syscall_exit_to_user_mode+0x27/0x50
[Fri Dec 16 09:30:05 2022] ? __x64_sys_mmap+0x33/0x40
[Fri Dec 16 09:30:05 2022] ? do_syscall_64+0x69/0xc0
[Fri Dec 16 09:30:05 2022] ? syscall_exit_to_user_mode+0x27/0x50
[Fri Dec 16 09:30:05 2022] ? __x64_sys_newfstatat+0x1c/0x20
[Fri Dec 16 09:30:05 2022] ? do_syscall_64+0x69/0xc0
[Fri Dec 16 09:30:05 2022] ? ksys_lseek+0x85/0xc0
[Fri Dec 16 09:30:05 2022] ? exit_to_user_mode_prepare+0x37/0xb0
[Fri Dec 16 09:30:05 2022] ? syscall_exit_to_user_mode+0x27/0x50
[Fri Dec 16 09:30:05 2022] ? __x64_sys_lseek+0x18/0x20
[Fri Dec 16 09:30:05 2022] ? do_syscall_64+0x69/0xc0
[Fri Dec 16 09:30:05 2022] ? irqentry_exit_to_user_mode+0x9/0x20
[Fri Dec 16 09:30:05 2022] ? irqentry_exit+0x35/0x40
[Fri Dec 16 09:30:05 2022] ? exc_page_fault+0x89/0x180
[Fri Dec 16 09:30:05 2022] ? asm_exc_page_fault+0x8/0x30
[Fri Dec 16 09:30:05 2022] entry_SYSCALL_64_after_hwframe+0x44/0xae
[Fri Dec 16 09:30:05 2022] RIP: 0033:0x7fa7322b6a3d
[Fri Dec 16 09:30:05 2022] Code: 5b 41 5c c3 66 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d c3 a3 0f 00 f7 d8 64 89 01 48
[Fri Dec 16 09:30:05 2022] RSP: 002b:00007fffb81ef6b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[Fri Dec 16 09:30:05 2022] RAX: ffffffffffffffda RBX: 000055b510d9e800 RCX: 00007fa7322b6a3d
[Fri Dec 16 09:30:05 2022] RDX: 0000000000000000 RSI: 000055b510d9e2a0 RDI: 0000000000000003
[Fri Dec 16 09:30:05 2022] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000
[Fri Dec 16 09:30:05 2022] R10: 0000000000000003 R11: 0000000000000246 R12: 000055b510d9e2a0
[Fri Dec 16 09:30:05 2022] R13: 000055b510d9e7a0 R14: 00007fffb81ef920 R15: 000055b510d9e910
[Fri Dec 16 09:30:05 2022] </TASK>
[Fri Dec 16 09:30:05 2022] ================================================================================
[Fri Dec 16 09:30:05 2022] sep5_34: [load] [PMU_LIST_Build_MMIO_List@809]: No MMIO list information detected!

[Fri Dec 16 09:30:06 2022] vtsspp: Driver version: 1.8.370-624516
[Fri Dec 16 09:30:06 2022] vtsspp: Driver options: uid: 0, gid: 1001, mode: 660
[Fri Dec 16 09:30:06 2022] vtsspp: Kernel version: 5.17.0-1019-oem
[Fri Dec 16 09:30:06 2022] vtsspp: Detected 128 CPU(s) and 1 thread(s) per core
[Fri Dec 16 09:30:06 2022] vtsspp: CPU family: 0x0f, model: 0x01, stepping: 00
[Fri Dec 16 09:30:06 2022] vtsspp: CPU freq: 2349958KHz, timer freq: 1000000KHz
[Fri Dec 16 09:30:06 2022] vtsspp: Driver options: ksyms: ffffffffa6993b90
[Fri Dec 16 09:30:06 2022] vtsspp: PERFMONv0: fixed counters: 0, general counters: 0
[Fri Dec 16 09:30:06 2022] vtsspp: PMU counters not detected
[Fri Dec 16 09:30:06 2022] vtsspp: Kernel: KPTI detected
[Fri Dec 16 09:30:06 2022] vtsspp: Kernel: KASLR detected
[Fri Dec 16 09:30:06 2022] vtsspp: Failed to initialize driver

"""

Thanks a lot

[AlexanderSchroeter]

Just as a test I removed all but two GPUs. Now the GPU is at least detected but I believe it has the wrong memory size. If I understand the example output in the install instructions correctly the lspci command should show the 16GB of GPU memory but is only showing 256M.

lshw -C display

"""

WARNING: you should run this program as super-user.
*-display
description: VGA compatible controller
product: ASPEED Graphics Family
vendor: ASPEED Technology, Inc.
physical id: 0
bus info: pci@0000:62:00.0
logical name: /dev/fb0
version: 41
width: 32 bits
clock: 33MHz
capabilities: vga_controller cap_list fb
configuration: depth=32 driver=ast latency=0 resolution=1024,768
resources: irq:228 memory:ca000000-caffffff memory:cb000000-cb01ffff ioport:4000(size=128)
*-display
description: VGA compatible controller
product: Intel Corporation
vendor: Intel Corporation
physical id: 0
bus info: pci@0000:83:00.0
version: 08
width: 64 bits
clock: 33MHz
capabilities: vga_controller bus_master cap_list rom
configuration: driver=i915 latency=0
resources: iomemory:5810-580f irq:260 memory:b0000000-b0ffffff memory:58150000000-5815fffffff memory:b1000000-b11fffff
*-display
description: Display controller
product: Vega 20 [Radeon Pro VII/Radeon Instinct MI50 32GB]
vendor: Advanced Micro Devices, Inc. [AMD/ATI]
physical id: 0
bus info: pci@0000:e3:00.0
version: 02
width: 64 bits
clock: 33MHz
capabilities: bus_master cap_list rom
configuration: driver=amdgpu latency=0
resources: iomemory:3fc0-3fbf iomemory:4000-3fff irq:229 memory:3fc00000000-3ffffffffff memory:40000000000-400001fffff memory:c0200000-c027ffff memory:c0280000-c029ffff
WARNING: output may be incomplete or inaccurate, you should run this program as super-user.

"""

lspci -v |grep -A8 VGA

"""

62:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 41) (prog-if 00 [VGA controller])
DeviceName: ASPEED Video AST2500
Subsystem: Super Micro Computer Inc ASPEED Graphics Family
Flags: medium devsel, IRQ 228, NUMA node 0, IOMMU group 4
Memory at ca000000 (32-bit, non-prefetchable) [size=16M]
Memory at cb000000 (32-bit, non-prefetchable) [size=128K]
I/O ports at 4000 [size=128]
Capabilities: <access denied>
Kernel driver in use: ast
--
83:00.0 VGA compatible controller: Intel Corporation Device 56a0 (rev 08) (prog-if 00 [VGA controller])
Subsystem: Intel Corporation Device 1020
Flags: bus master, fast devsel, latency 0, IRQ 260, NUMA node 1, IOMMU group 96
Memory at b0000000 (64-bit, non-prefetchable) [size=16M]
Memory at 58150000000 (64-bit, prefetchable) [size=256M]
Expansion ROM at b1000000 [disabled] [size=2M]
Capabilities: <access denied>
Kernel driver in use: i915
Kernel modules: i915

"""

sudo dmesg -T

"""

[Fri Dec 16 10:10:28 2022] [drm] I915 BACKPORTED INIT
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: BAR 0: releasing [mem 0xb0000000-0xb0ffffff 64bit]
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: BAR 2: releasing [mem 0x58150000000-0x5815fffffff 64bit pref]
[Fri Dec 16 10:10:28 2022] pcieport 0000:82:01.0: BAR 15: releasing [mem 0x58150000000-0x5815fffffff 64bit pref]
[Fri Dec 16 10:10:28 2022] pcieport 0000:81:00.0: BAR 15: releasing [mem 0x58150000000-0x5815fffffff 64bit pref]
[Fri Dec 16 10:10:28 2022] pcieport 0000:81:00.0: BAR 15: no space for [mem size 0x400000000 64bit pref]
[Fri Dec 16 10:10:28 2022] pcieport 0000:81:00.0: BAR 15: failed to assign [mem size 0x400000000 64bit pref]
[Fri Dec 16 10:10:28 2022] pcieport 0000:82:01.0: BAR 15: no space for [mem size 0x400000000 64bit pref]
[Fri Dec 16 10:10:28 2022] pcieport 0000:82:01.0: BAR 15: failed to assign [mem size 0x400000000 64bit pref]
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: BAR 2: no space for [mem size 0x400000000 64bit pref]
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: BAR 2: failed to assign [mem size 0x400000000 64bit pref]
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: BAR 0: assigned [mem 0xb0000000-0xb0ffffff 64bit]
[Fri Dec 16 10:10:28 2022] pcieport 0000:80:01.1: PCI bridge to [bus 81-84]
[Fri Dec 16 10:10:28 2022] pcieport 0000:80:01.1: bridge window [mem 0xb0000000-0xb13fffff]
[Fri Dec 16 10:10:28 2022] pcieport 0000:80:01.1: bridge window [mem 0x58150000000-0x581607fffff 64bit pref]
[Fri Dec 16 10:10:28 2022] pcieport 0000:81:00.0: PCI bridge to [bus 82-84]
[Fri Dec 16 10:10:28 2022] pcieport 0000:81:00.0: bridge window [mem 0xb0000000-0xb13fffff]
[Fri Dec 16 10:10:28 2022] pcieport 0000:81:00.0: bridge window [mem 0x58150000000-0x5815fffffff 64bit pref]
[Fri Dec 16 10:10:28 2022] pcieport 0000:82:01.0: PCI bridge to [bus 83]
[Fri Dec 16 10:10:28 2022] pcieport 0000:82:01.0: bridge window [mem 0xb0000000-0xb11fffff]
[Fri Dec 16 10:10:28 2022] pcieport 0000:82:01.0: bridge window [mem 0x58150000000-0x5815fffffff 64bit pref]
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] Failed to resize BAR2 to 16384M (-ENOSPC)
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: BAR 2: assigned [mem 0x58150000000-0x5815fffffff 64bit pref]
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] Bumping pre-emption timeout from 640 to 7500 on rcs'0.0 to allow slow compute pre-emption
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] Disabling pre-emption timeout to work around forced preemption for rcs'0.0
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] Bumping pre-emption timeout from 640 to 7500 on ccs'0.0 to allow slow compute pre-emption
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] Disabling pre-emption timeout to work around forced preemption for ccs'0.0
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] Bumping pre-emption timeout from 640 to 7500 on ccs'1.0 to allow slow compute pre-emption
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] Disabling pre-emption timeout to work around forced preemption for ccs'1.0
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] Bumping pre-emption timeout from 640 to 7500 on ccs'2.0 to allow slow compute pre-emption
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] Disabling pre-emption timeout to work around forced preemption for ccs'2.0
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] Bumping pre-emption timeout from 640 to 7500 on ccs'3.0 to allow slow compute pre-emption
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] Disabling pre-emption timeout to work around forced preemption for ccs'3.0
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] VT-d active for gfx access
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] Using Transparent Hugepages
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] Cannot use the full memory 0x00000003fa000000 on the device as LMEM BAR size was found to be smaller
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] Continuing with reduced LMEM size: 0x0000000010000000
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] Local memory available: 0x0000000010000000
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=none:owns=none
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] Finished loading DMC firmware i915/dg2_dmc_ver2_07.bin (v2.7)
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] GuC error state capture buffer maybe too small: 2097152 < 3737592 (min = 1245864)
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] GuC firmware i915/dg2_guc_70.2.0.bin version 70.2
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] HuC firmware i915/dg2_huc_7.10.3_gsc.bin version 7.10
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] GuC submission enabled
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] GuC SLPC enabled
[Fri Dec 16 10:10:28 2022] i915 0000:83:00.0: [drm] GuC RC: enabled
[Fri Dec 16 10:10:28 2022] ipmi_si dmi-ipmi-si.0: IPMI kcs interface initialized
[Fri Dec 16 10:10:28 2022] [drm] Initialized i915 1.6.0 20201103 for 0000:83:00.0 on minor 2

"""

I have also attached the whole dmesg log output.

[LuisGustav_A_Intel]

Hello AlexanderSchroeter,  

Thank you for contacting Intel Technical Support for graphics.  

We are sorry to hear you experience problems with Linux Ubuntu after switching to the oem kernel the A770 don't get recognized.

Documentation and instructions for installing, deploying, and updating Intel software to enable general-purpose GPU (GPGPU) capabilities for Ubuntu* 22.04 on 11th Gen and newer Intel® Core™ processors with Intel® Arc™ A-Series Graphics can be found at dgpu-docs.intel.com.

Additional Linux distributions are not supported at this time.

Let me investigate on this matter.

Thank you for choosing Intel. 

Best regards, 

Luis A. 

Intel Customer Support Technician. 

[LuisGustav_A_Intel]

Hello AlexanderSchroeter, 

Thank you for your patience. 

Please provide the following full system configuration motherboard, CPU, BIOS and how many video cards in total are being installed? Is integrated graphics enabled as well?

From the Output of - lspci -v |grep -A8 VGA - seems Resizable BAR is not enabled on this platform. Please check,

We recommend starting off the installation only with Intel® Arc™ A770 Graphics, then once confirmed fully setup proceed with the rest of graphic cards. 

Best regards, 

Luis A. 

Intel Customer Support Technician. 

[LuisGustav_A_Intel]

Hello AlexanderSchroeter, 

I was checking your case and would like to know if you need further assistance? Did you complete the recommendations provided before?

Best regards, 

Luis A. 

Intel Customer Support Technician.  

[AlexanderSchroeter]

Hello LuisGustav_A_Intel,

here is the specifications of the system I tested the GPU with. What is the timeline for standard Ubuntu Support? Not the OEM kernel. Because in that case I would be able to test the GPU in a different system as well.

Here is the requested system configuration and the second system separated by "#######..." 

= GPUs =

As mentioned I had to remove most of the GPUs for the Card to even be recognized but the server can hold 8 GPUs.

~$ lspci -v |grep -A8 VGA
62:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 41) (prog-if 00 [VGA controller])
DeviceName: ASPEED Video AST2500
Subsystem: Super Micro Computer Inc ASPEED Graphics Family
Flags: medium devsel, IRQ 228, NUMA node 0, IOMMU group 4
Memory at ca000000 (32-bit, non-prefetchable) [size=16M]
Memory at cb000000 (32-bit, non-prefetchable) [size=128K]
I/O ports at 4000 [size=128]
Capabilities: <access denied>
Kernel driver in use: ast
--
83:00.0 VGA compatible controller: Intel Corporation Device 56a0 (rev 08) (prog-if 00 [VGA controller])
Subsystem: Intel Corporation Device 1020
Flags: bus master, fast devsel, latency 0, IRQ 229, NUMA node 1, IOMMU group 96
Memory at b0000000 (64-bit, non-prefetchable) [size=16M]
Memory at 58150000000 (64-bit, prefetchable) [size=256M]
Expansion ROM at b1000000 [disabled] [size=2M]
Capabilities: <access denied>
Kernel driver in use: i915
Kernel modules: i915

= CPU =

~$ lscpu
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 43 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 128
On-line CPU(s) list: 0-127
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7452 32-Core Processor
CPU family: 23
Model: 49
Thread(s) per core: 2
Core(s) per socket: 32
Socket(s): 2
Stepping: 0
Frequency boost: enabled
CPU max MHz: 2350.0000
CPU min MHz: 1500.0000
BogoMIPS: 4700.42
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl nonstop_tsc
cpuid extd_apicid aperfmperf rapl pni pclmulqdq monitor ssse3 fma cx16 sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalig
nsse 3dnowprefetch osvw ibs skinit wdt tce topoext perfctr_core perfctr_nb bpext perfctr_llc mwaitx cpb cat_l3 cdp_l3 hw_pstate ssbd mba ibrs ibpb stibp vmmcall fsgsbase bmi1 avx2 smep
bmi2 cqm rdt_a rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local clzero irperf xsaveerptr rdpru wbnoinvd amd_ppin
arat npt lbrv svm_lock nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold avic v_vmsave_vmload vgif v_spec_ctrl umip rdpid overflow_recov succor smca sme
sev sev_es
Virtualization features:
Virtualization: AMD-V
Caches (sum of all):
L1d: 2 MiB (64 instances)
L1i: 2 MiB (64 instances)
L2: 32 MiB (64 instances)
L3: 256 MiB (16 instances)
NUMA:
NUMA node(s): 2
NUMA node0 CPU(s): 0-31,64-95
NUMA node1 CPU(s): 32-63,96-127
Vulnerabilities:
Itlb multihit: Not affected
L1tf: Not affected
Mds: Not affected
Meltdown: Not affected
Mmio stale data: Not affected
Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Spectre v2: Mitigation; Retpolines, IBPB conditional, IBRS_FW, STIBP conditional, RSB filling
Srbds: Not affected
Tsx async abort: Not affected

https://www.supermicro.com/en/Aplus/system/4U/4124/AS-4124GS-TNR.cfm

8 GPUs

= BIOS = (Latest)

BIOS Information
Vendor: American Megatrends Inc.
Version: 2.4
Release Date: 04/22/2022
Address: 0xF0000
Runtime Size: 64 kB
ROM Size: 32 MB
Characteristics:
PCI is supported
BIOS is upgradeable
BIOS shadowing is allowed
Boot from CD is supported
Selectable boot is supported
BIOS ROM is socketed
EDD is supported
5.25"/1.2 MB floppy services are supported (int 13h)
3.5"/720 kB floppy services are supported (int 13h)
3.5"/2.88 MB floppy services are supported (int 13h)
Print screen service is supported (int 5h)
Serial services are supported (int 14h)
Printer services are supported (int 17h)
ACPI is supported
USB legacy is supported
BIOS boot specification is supported
Targeted content distribution is supported
UEFI is supported
BIOS Revision: 5.14

#########################################################################################

= CPUs =

~$ lscpu
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 64
On-line CPU(s) list: 0-63
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz
CPU family: 6
Model: 85
Thread(s) per core: 2
Core(s) per socket: 16
Socket(s): 2
Stepping: 4
CPU max MHz: 3700.0000
CPU min MHz: 1000.0000
BogoMIPS: 4200.00
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs
bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt ts
c_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti intel_ppin ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority e
pt vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb intel_pt avx512cd avx512bw avx512vl xsaveopt
xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke md_clear flush_l1d arch_capabilities
Virtualization features:
Virtualization: VT-x
Caches (sum of all):
L1d: 1 MiB (32 instances)
L1i: 1 MiB (32 instances)
L2: 32 MiB (32 instances)
L3: 44 MiB (2 instances)
NUMA:
NUMA node(s): 2
NUMA node0 CPU(s): 0-15,32-47
NUMA node1 CPU(s): 16-31,48-63
Vulnerabilities:
Itlb multihit: KVM: Mitigation: VMX disabled
L1tf: Mitigation; PTE Inversion; VMX conditional cache flushes, SMT vulnerable
Mds: Mitigation; Clear CPU buffers; SMT vulnerable
Meltdown: Mitigation; PTI
Mmio stale data: Mitigation; Clear CPU buffers; SMT vulnerable
Retbleed: Mitigation; IBRS
Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl and seccomp
Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Spectre v2: Mitigation; IBRS, IBPB conditional, RSB filling, PBRSB-eIBRS Not affected
Srbds: Not affected
Tsx async abort: Mitigation; Clear CPU buffers; SMT vulnerable

= GPUs =

~$ lspci -v |grep -A8 VGA
04:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 41) (prog-if 00 [VGA controller])
DeviceName: ASPEED 2500
Subsystem: ASUSTeK Computer Inc. ASPEED Graphics Family
Flags: bus master, medium devsel, latency 0, IRQ 20, NUMA node 0
Memory at 90000000 (32-bit, non-prefetchable) [size=64M]
Memory at 94000000 (32-bit, non-prefetchable) [size=128K]
I/O ports at 1000 [size=128]
Expansion ROM at 000c0000 [virtual] [disabled] [size=128K]
Capabilities: <access denied>
--
3d:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 [Radeon VII] (rev c1) (prog-if 00 [VGA controller])
Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 [Radeon VII]
Flags: bus master, fast devsel, latency 0, IRQ 64, NUMA node 0
Memory at 30000000000 (64-bit, prefetchable) [size=16G]
Memory at 30400000000 (64-bit, prefetchable) [size=2M]
I/O ports at 7000 [size=256]
Memory at b4100000 (32-bit, non-prefetchable) [size=512K]
Expansion ROM at b4180000 [disabled] [size=128K]
Capabilities: <access denied>
--
60:00.0 VGA compatible controller: Intel Corporation Device 56a0 (rev 08) (prog-if 00 [VGA controller])
Subsystem: Intel Corporation Device 1020
Flags: fast devsel, NUMA node 0
Memory at c4000000 (64-bit, non-prefetchable) [disabled] [size=16M]
Memory at 4ffe0000000 (64-bit, prefetchable) [disabled] [size=256M]
Expansion ROM at c5000000 [disabled] [size=2M]
Capabilities: <access denied>

61:00.0 Audio device: Intel Corporation Device 4f90
--
af:00.0 VGA compatible controller: NVIDIA Corporation TU102 [GeForce RTX 2080 Ti] (rev a1) (prog-if 00 [VGA controller])
Subsystem: Gigabyte Technology Co., Ltd TU102 [GeForce RTX 2080 Ti]
Flags: bus master, fast devsel, latency 0, IRQ 90, NUMA node 1
Memory at ed000000 (32-bit, non-prefetchable) [size=16M]
Memory at 7ffe0000000 (64-bit, prefetchable) [size=256M]
Memory at 7fff0000000 (64-bit, prefetchable) [size=32M]
I/O ports at e000 [size=128]
Expansion ROM at ee000000 [virtual] [disabled] [size=512K]
Capabilities: <access denied>

Currently 3 GPUs (wanting 4) no onboard

= CPUs =

~$ lscpu
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 64
On-line CPU(s) list: 0-63
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz
CPU family: 6
Model: 85
Thread(s) per core: 2
Core(s) per socket: 16
Socket(s): 2
Stepping: 4
CPU max MHz: 3700.0000
CPU min MHz: 1000.0000
BogoMIPS: 4200.00
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs
bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt ts
c_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti intel_ppin ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority e
pt vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb intel_pt avx512cd avx512bw avx512vl xsaveopt
xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke md_clear flush_l1d arch_capabilities
Virtualization features:
Virtualization: VT-x
Caches (sum of all):
L1d: 1 MiB (32 instances)
L1i: 1 MiB (32 instances)
L2: 32 MiB (32 instances)
L3: 44 MiB (2 instances)
NUMA:
NUMA node(s): 2
NUMA node0 CPU(s): 0-15,32-47
NUMA node1 CPU(s): 16-31,48-63
Vulnerabilities:
Itlb multihit: KVM: Mitigation: VMX disabled
L1tf: Mitigation; PTE Inversion; VMX conditional cache flushes, SMT vulnerable
Mds: Mitigation; Clear CPU buffers; SMT vulnerable
Meltdown: Mitigation; PTI
Mmio stale data: Mitigation; Clear CPU buffers; SMT vulnerable
Retbleed: Mitigation; IBRS
Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl and seccomp
Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Spectre v2: Mitigation; IBRS, IBPB conditional, RSB filling, PBRSB-eIBRS Not affected
Srbds: Not affected
Tsx async abort: Mitigation; Clear CPU buffers; SMT vulnerable

= Motherboard =
Manufacturer: ASUSTeK COMPUTER INC.
Product Name: Z11PG-D16 Series

BIOS Information
Vendor: American Megatrends Inc.
Version: 0601
Release Date: 03/01/2018
Address: 0xF0000
Runtime Size: 64 kB
ROM Size: 32 MB
Characteristics:
PCI is supported
APM is supported
BIOS is upgradeable
BIOS shadowing is allowed
Boot from CD is supported
Selectable boot is supported
BIOS ROM is socketed
EDD is supported
5.25"/1.2 MB floppy services are supported (int 13h)
3.5"/720 kB floppy services are supported (int 13h)
3.5"/2.88 MB floppy services are supported (int 13h)
Print screen service is supported (int 5h)
8042 keyboard services are supported (int 9h)
Serial services are supported (int 14h)
Printer services are supported (int 17h)
ACPI is supported
USB legacy is supported
BIOS boot specification is supported
Targeted content distribution is supported
UEFI is supported
BIOS Revision: 5.12

[LuisGustav_A_Intel]

Hello AlexanderSchroeter,

Let me check this further and provide updates as soon as possible. 

Best regards, 

Luis A. 

Intel Customer Support Technician.  

[LuisGustav_A_Intel]

Hello AlexanderSchroeter, 

About standard Ubuntu support, please stay tuned to downloadcenter.intel.com or our Discord server as target dates may shift. 

If the purpose of setup with Intel® Arc™ A770 Graphics is Cloud Gaming computing, you should look at Arc Pro series. 

Upon investigation, the Resizable BAR feature seems the key problem.

Asus Z11PR-D16: BIOS 6602 release notes state that it introduces Resizable BAR, possibly older versions lack the feature.

Supermicro AS -4124GS-TNR: the manufacturer specifies the following "For consumer-grade GPU card support, please contact Supermicro sales and technical support for details." hence suggesting they can improve on 3rd party compatibility.

We encourage you to contact the board manufacturers for card detection problems. 

Best regards, 

Luis A. 

Intel Customer Support Technician.