PXE-EC8:!PXE structure was not found in UNDI driver code segment XL710

[Zym]

Hi We have issue with PXE boot, Ubuntu 18.04 kernel 5.4.70-050470-generic, We have updated the latest Intel XL710 i40e-2.18.9, iavf-4.4.2, NVM 8.60, but we still have the PXE boot issue with the error.  EFI boot was also tried but problem remains, Thanks.

ubuntu@ai-srv7:~$ ethtool -i ens5f0
driver: i40e
version: 2.18.9
firmware-version: 8.60 0x8000bd7c 1.3140.0
expansion-rom-version:
bus-info: 0000:01:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes

ubuntu@ai-srv7:~/nic_sw$ ethtool ens5f0
Settings for ens5f0:
Supported ports: [ FIBRE ]
Supported link modes: 40000baseCR4/Full
Supported pause frame use: Symmetric Receive-only
Supports auto-negotiation: Yes
Supported FEC modes: Not reported
Advertised link modes: 40000baseCR4/Full
Advertised pause frame use: No
Advertised auto-negotiation: Yes
Advertised FEC modes: Not reported
Speed: 40000Mb/s
Duplex: Full
Port: Direct Attach Copper
PHYAD: 0
Transceiver: internal
Auto-negotiation: off
Cannot get wake-on-lan settings: Operation not permitted
Current message level: 0x0000000f (15)
drv probe link timer
Link detected: no

ubuntu@ai-srv7:~$ modinfo iavf
filename: /lib/modules/5.4.70-050470-generic/updates/drivers/net/ethernet/intel/iavf/iavf.ko
version: 4.4.2
license: GPL
description: Intel(R) Ethernet Adaptive Virtual Function Driver
author: Intel Corporation, <linux.nics@intel.com>
alias: i40evf
srcversion: 4E31961A3DD52B66F0C79BD
alias: pci:v00008086d00000DD5sv*sd*bc*sc*i*
alias: pci:v00008086d00001889sv*sd*bc*sc*i*
alias: pci:v00008086d000037CDsv*sd*bc*sc*i*
alias: pci:v00008086d00001571sv*sd*bc*sc*i*
alias: pci:v00008086d0000154Csv*sd*bc*sc*i*
depends: auxiliary
retpoline: Y
name: iavf
vermagic: 5.4.70-050470-generic SMP mod_unload

sudo ./bootutil64e
Intel(R) Ethernet Flash Firmware Utility
BootUtil version 1.37.34.3
Copyright (C) 2003-2021 Intel Corporation

Type BootUtil -? for help

Port Network Address Location Series WOL Flash Firmware Version
==== =============== ======== ======= === ============================= =======
1 3CFDFEAA3CA8 1:00.0 40GbE N/A UEFI,PXE Enabled 1.1.31
2 3CFDFEAA3CA9 1:00.1 40GbE N/A UEFI,PXE Enabled 1.1.31
3 0CC47ADF14D2 5:00.0 10GbE YES FLASH Not Present
4 0CC47ADF14D3 5:00.1 10GbE YES FLASH Not Present

[Caguicla_Intel]

Hello Zym,

Good day!

We'd like to inform you that we are still checking on this matter with our engineers. Rest assured that we will give you an update once we heard from them but no later than 2-3 business days. 

Best regards,

Crisselle C.

Intel Customer Support 

[Caguicla_Intel]

Hello Zym,

I hope you're doing good!

Please be advised that this request is still escalated to our engineers. Once we received an update from them, we will relay it to you. Please expect another update no later than 3 business days. 

Thank you for your kind understanding. 

Best regards,

Crisselle C.

Intel Customer Support

[Caguicla_Intel]

Hello Zym,

Good day!

We sincerely apologize for the delay on this matter as we are still thoroughly checking on this with our engineer. Please give us more time to look into this. Rest assured that we will update you as soon as there is any findings but not later than 3 business days.

Thank you for your kind patience.

Best regards,

Crisselle C.

Intel Customer Support

[Caguicla_Intel]

Hello Zym,

How are you doing? I hope this message finds you well!

Please be informed that this request is still currently being attended by our engineers. Rest assured that we will let you know as soon as we heard from them. Please expect another update no later than 3 business days. 

Thank you for your kind understanding. 

Best regards,

Crisselle C.

Intel Customer Support

[Caguicla_Intel]

Hello Zym,

Good day!

We'd like to inform you that we are still actively working on this issue with our higher level Engineers. We understand that this is taking longer than you expect and rest assured that we are doing our best to sort this out as soon as possible. We will keep you posted and get back to you within 2-3 business days.

Thank you for the patience. 

Best regards,

Crisselle C.

Intel Customer Support

[Caguicla_Intel]

Hello Zym,

Please accept our apologies for the delay on this matter.

Our engineers are still checking on this one and we ask for your kind cooperation to give us more time with the investigation. Rest assured that we will give you an update as soon as we heard from them but no later than 3 business days. 

Best regards,

Crisselle C.

Intel® Customer Support

[Caguicla_Intel]

Hello Zym,

Good day!

Please be informed that we are still actively working on this issue for you with our higher level Engineers to sort this out as soon as possible. We highly appreciate your patience on this matter. 

Please expect another update for the status of this request no later than 3 business days. 

Best regards,

Crisselle C.

Intel Customer Support

[Caguicla_Intel]

Hello Zym,

Apologies for the delay and inconvenience caused on this matter. 

This request is still under investigation by our engineers. We will give you an update once we heard feedback from them. Please expect another message regarding the status of this request within 3 business days. 

Best regards,

Crisselle C.

Intel Customer Support 

[Caguicla_Intel]

Hello Zym,

Good day and I hope this message finds you well!

Please be informed that we are still waiting for the feedback from our engineering team. Rest assured that we will forward it to you once we heard from the. We will send another update within 3 business days regarding this matter. 

Thank you for your kind patience. 

Best regards,

Crisselle C.

Intel Customer Support 

[Caguicla_Intel]

Hello Zym,

How are you doing? I hope you are doing great!

We apologize for the delay on this matter. We are still waiting for the feedback from our engineers regarding the update on the investigation. We will forward it to you as soon as there is any. 

Please expect another update within 3 business days. 

Best regards,

Crisselle C.

Intel Customer Support

[Caguicla_Intel]

Hello Zym,

Good day!

Please be informed that we are still waiting for an update from our engineering team. Once we heard from them, rest assured that we will communicate it to you. 

We will send another message within 3 business days for the status of this request. 

Best regards,

Crisselle C.

Intel Customer Support 

[Zigfreid_Intel]

Hello Zym,

Good day!

Please be informed that we are still waiting for an update from our engineering team. Once we heard from them, rest assured that we will communicate it to you. 

We will send another message within 3 business days for the status of this request. 

Best regards,

Zigfreid I.

Intel® Customer Support

[Caguicla_Intel]

Hello Zym,

Thank you for the patience on this matter. 

After series of validation, our engineers suspect this issue is caused by setting memory BAR above the 4G boundary.

Here are some options they captured from this application note.

https://www.intel.com/content/dam/support/us/en/documents/network-and-i-o/ethernet-products/Boot_Agent_book_rev_1_9.pdf

Table 1 lists Boot Agent error msg in the Section 9.0 'Troubleshooting Tips'

Legacy expansion ROMs, such as the Intel Boot Agent, are limited by the legacy BIOS architecture to a maximum of 32-bit memory access.

If the BIOS assigns a memory BAR to the controller that is above 32-bit, the Boot Agent is unable to access the device.

In this case, there are 4 options to consider:

a. Configure the BIOS to only assign 32-bit memory BAR addresses.

b. Modify the BIOS to selectively assign 32-bit memory BAR addresses to devices that support PXE.

c. Configure the Ethernet controller to only request 32-bit memory BAR addresses.

 All Intel PCIe Ethernet controllers have EEPROM settings that limit the device to advertising only 32-bit memory BAR support.

d. If the BIOS is UEFI capable, implement a UEFI-based solution instead of legacy PXE. Memory addressing is not a limitation of the UEFI environment.

We would suggest to work with your BIOS manufacturer to implement option A first.

This behavior will be corrected in the future release of the adapter firmware schedule however no ETA at this time.

Feel free to let us know if you have questions or clarifications. 

Awaiting to your reply. 

We will follow up after 3 business days in case we don't hear from you. 

Best regards,

Crisselle C.

Intel® Customer Support

[Caguicla_Intel]

Hello Zym,

Good day!

This is just a follow up message to check if you are able to read our update. If yes, please confirm and let us know of the result once you are able to follow our recommendations. 

Hoping to hear from you soon. 

Should there be no reply, we will follow up after 3 business days. 

Best regards,

Crisselle C.

Intel® Customer Support

[Zym]

Hello 

Thanks for the update,  since the issue has been ongoing for a while, currently we have no condition to test the issue, but we can try next time when problem occur again, Thank you!

[Caguicla_Intel]

Hello Zym,

Thank you for the update. 

Please be informed that we will close this thread since there is no definite time for you to check and we also referred you to BIOS manufacturer. If you need further assistance, please contact us back with a new thread (in reference to this one).

We highly appreciate your time and effort on this one. Please also accept our apologies for the delay and inconvenience that this has caused. 

Thank you for choosing Intel and stay safe!

Best regards,

Crisselle C.

Intel® Customer Support