"KVM: entry failed, hardware error 0x80000021" on : Intel(R) Xeon(R) D-2146NT

[Hguo3]

Hi ,

VM is going to paused state when more than 1 vCPU is assigned to it.

Qemu logs are below:

---------------------------------------------

KVM: entry failed, hardware error 0x80000021

If you're running a guest on an Intel machine without unrestricted mode
support, the failure can be most likely due to the guest entering an invalid
state for Intel VT. For example, the guest maybe running in big real mode
which is not supported on less recent Intel processors.

AX=00000000ffffffed RBX=ffff88003daf4000 RCX=0100000000000000 RDX=0000000000000000
RSI=0000000000000000 RDI=0000000000000046 RBP=ffff88003daf7e98 RSP=ffff88003daf7e98
R8 =0000000000000000 R9 =0000000000000000 R10=0000000000000000 R11=0000000000000000
R12=0000000000000001 R13=ffff88003daf4000 R14=ffff88003daf4000 R15=00000000000000--00
RIP=ffffffff81058e96 RFL=00010286 [--S--P-] CPL=0 II=0 A20=1 SMM=0 HLT=0
ES =0000 0000000000000000 ffffffff 00c00000
CS =0010 0000000000000000 ffffffff 00a09b00 DPL=0 CS64 [-RA]
SS =0000 0000000000000000 ffffffff 00c00000
DS =0000 0000000000000000 ffffffff 00c00000
FS =0000 0000000000000000 ffffffff 00c00000
GS =0000 ffff88003fd00000 ffffffff 00c00000
LDT=0000 0000000000000000 ffffffff 00c00000
TR =0040 ffff88003fd11b40 00002087 00008b00 DPL=0 TSS64-busy
GDT= ffff88003fd09000 0000007f
IDT= ffffffffff529000 00000fff
CR0=8005003b CR2=00000000ffffffff CR3=000000000194a000 CR4=000006e0
DR0=0000000000000000 DR1=0000000000000000 DR2=0000000000000000 DR3=0000000000000000
DR6=00000000fffe0ff0 DR7=0000000000000400
EFER=0000000000000d01
Code=89 e5 fb 5d c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <5d> c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 5d c3 66 0f 1f 84 00 00 00 00 00 55 49 89 ca

Linux kernel VMs dump below:

-------------------------------------------------------------

[10184.019459] *** Guest State ***
[10184.019462] CR0: actual=0x000000008005003b, shadow=0x0000000080050033, gh_mask=fffffffffffffff7
[10184.019464] CR4: actual=0x00000000003026e0, shadow=0x00000000003006e0, gh_mask=ffffffffffffe871
[10184.019465] CR3 = 0x000000000194a000
[10184.019465] PDPTR0 = 0x0000000000000000 PDPTR1 = 0x0000000000000000
[10184.019466] PDPTR2 = 0x0000000000000000 PDPTR3 = 0x0000000000000000
[10184.019466] RSP = 0xffff88003daf7e98 RIP = 0xffffffff81058e96
[10184.019467] RFLAGS=0x00010286 DR7 = 0x0000000000000400
[10184.019468] Sysenter RSP=0000000000000000 CS:RIP=0010:ffffffff81647700
[10184.019469] CS: sel=0x0010, attr=0x0a09b, limit=0xffffffff, base=0x0000000000000000
[10184.019470] DS: sel=0x0000, attr=0x1c000, limit=0xffffffff, base=0x0000000000000000
[10184.019471] SS: sel=0x0000, attr=0x1c000, limit=0xffffffff, base=0x0000000000000000
[10184.019472] ES: sel=0x0000, attr=0x1c000, limit=0xffffffff, base=0x0000000000000000
[10184.019473] FS: sel=0x0000, attr=0x1c000, limit=0xffffffff, base=0x0000000000000000
[10184.019473] GS: sel=0x0000, attr=0x1c000, limit=0xffffffff, base=0xffff88003fd00000
[10184.019474] GDTR: limit=0x0000007f, base=0xffff88003fd09000
[10184.019475] LDTR: sel=0x0000, attr=0x1c000, limit=0xffffffff, base=0x0000000000000000
[10184.019475] IDTR: limit=0x00000fff, base=0xffffffffff529000
[10184.019476] TR: sel=0x0040, attr=0x0008b, limit=0x00002087, base=0xffff88003fd11b40
[10184.019477] EFER = 0x0000000000000801 PAT = 0x0007040600070406
[10184.019478] DebugCtl = 0x0000000000000000 DebugExceptions = 0x0000000000000000
[10184.019478] Interruptibility = 00000000 ActivityState = 00000001
[10184.019479] *** Host State ***
[10184.019479] RIP = 0xffffffffc0458a20 RSP = 0xffff9b6e45a4fc50
[10184.019480] CS=0010 SS=0018 DS=0000 ES=0000 FS=0000 GS=0000 TR=0040
[10184.019481] FSBase=00007fa6f6785700 GSBase=ffff99f6eea80000 TRBase=fffffe0000069000
[10184.019482] GDTBase=fffffe0000067000 IDTBase=fffffe0000000000
[10184.019482] CR0=0000000080050033 CR3=000000012a71e002 CR4=00000000003226e0
[10184.019483] Sysenter RSP=fffffe0000069000 CS:RIP=0010:ffffffffb7801490
[10184.019484] EFER = 0x0000000000000d01 PAT = 0x0407050600070106
[10184.019484] *** Control State ***
[10184.019485] PinBased=0000007f CPUBased=b5a06d7a SecondaryExec=000230f2
[10184.019485] EntryControls=000053ff ExitControls=000befff
[10184.019486] ExceptionBitmap=00060042 PFECmask=00000000 PFECmatch=00000000
[10184.019487] VMEntry: intr_info=80000b0e errcode=00000000 ilen=00000000
[10184.019487] VMExit: intr_info=800000ec errcode=00000000 ilen=00000001
[10184.019488] reason=80000021 qualification=0000000000000000
[10184.019488] IDTVectoring: info=00000000 errcode=00000000
[10184.019489] TSC Offset = 0xfffbc91c6847595d
[10184.019490] TPR Threshold = 0x00virt-APIC addr = 0x00000001258c1000
[10184.019491] EPT pointer = 0x00000001d2bae05e
[10184.019492] Virtual processor ID = 0x0003

In linux kernel, we can only know the 0x80000021 is defined as HVMSG_UNRECOVERABLE_EXCEPTION. No more other information.

So I search the Intel official site : https://www.intel.com/content/www/us/en/resources-documentation/developer.html , hope to get the definition to 0x80000021. But did not find it.

Could you please share the document related to the definition to 0x80000021?

We want to know what type error the 0x80000021 is? And how to debug this issue.

Thanks a lot,

Heng

[IntelSupport]

Hello Hguo3,

We appreciate your contact regarding the error message "KVM: entry failed, hardware error 0x80000021" that you've encountered on your server with Processor.

This error message typically indicates a virtualization-related issue, which can be linked to either hardware virtualization support or guest configuration. To address this matter, please consider the following steps:

Exploring QEMU Support: We recommend exploring the QEMU documentation and support resources, available on their official website at https://www.qemu.org/support/ . Here, you can find detailed guidance on troubleshooting and resolving KVM virtualization-related problems.

Should you require further assistance, please do not hesitate to reach out to us. We are here to support you in making the most of Intel products and services.

Regards,

Vijay N

Intel Customer Support

[IntelSupport]

Hello Hguo3,

Greetings for the day!

This is regarding the case you have with us with the following details.

Case Number: 05997578

Product: Intel® Xeon® Processor D-1518 (6M Cache, 2.20 GHz)

Issue: KVM: entry failed, hardware error 0x80000021

I am sending a follow up if you have any questions from the previous post. If so, please let us know.

Please feel free to reach out to us if you require any further assistance or have additional questions. We appreciate your continued use of Intel products and services.

Best regards,

Vijay N

Intel Customer Support.

[IntelSupport]

Hello Hguo3,

Greetings for the day!

This is regarding the case you have with us with the following details.

Case Number: 05997578

Product: Intel® Xeon® Processor D-1518 (6M Cache, 2.20 GHz)

Issue: KVM: entry failed, hardware error 0x80000021

We have not received a reply from you, and as such, we will be closing your case.

If you want to continue support, please reply to this email and we will reopen your case or create a new one so that we can continue to support you.

Please don’t hesitate to contact us for any further assistance.

Thank you for choosing Intel products and services.

Best regards,

Vijay N.

Intel Customer Support.