Failure due to generic standard exception. => isa<> used on a null pointer

[STATEABC]

My openvino version is 2022.3

I want to run crossroad_camera_demo in FPGA+CPU heterogeneous mode, but unfortunately an error occurred

I passed plugins_xml_file to ov:core and loaded arch file. After compiling and running demo, the following error will appear:

[ INFO ] The input graph is split into 222 subgraph(s), CPU:110 FPGA:112.

[ WARNING ] Input graph is split into many subgraphs; this can be caused by unsupported architecture layers - check RMNet_SSD_dla_messages.txt. Splitting the graph into many partitions can lead to running out of FPGA DDR memory.

Using licensed IP
Starting compilation
Error Code: 148
Error Description: Error: Failure due to generic standard exception. => isa<> used on a null pointer
File: ../compiler/core/src/llvm/casting.h
Function: doit
Line #: 152
[ ERROR ]

Any help would be greatly appreciated, thank you!

[Wan_Intel · Accepted solution]

 Hi STATEABC,

Thanks for reaching out to us.

Are you running Crossroad Camera C++ Demo from Open Model Zoo? For your information, Crossroad Camera C++ Demo has been validated with the following models:

• person-vehicle-bike-detection-crossroad-0078
• person-attributes-recognition-crossroad-0230
• person-reidentification-retail-0277

Could you please run the following command and see if you still encountered the error?

./crossroad_camera_demo -i <path_to_video>/inputVideo.mp4 -m <path_to_model>/person-vehicle-bike-detection-crossroad-0078.xml -m_pa <path_to_model>/person-attributes-recognition-crossroad-0230.xml -m_reid <path_to_model>/person-reidentification-retail-0079.xml -d HETERO

Regards,

Wan

[STATEABC]

Hi Wan,

There will still be an error: [ ERROR ] Device with "FPGA" name is not registered in the openVINO Runtime.

And if I add the parameter plugins_xml_file, there will be a new error: [ ERROR ] ../util/hetero_plugin/plugin.cpp 64 The 'MULTI_DEVICE_PRIORITIES' option was not defined for heterogeneous plugin.

Regards,

ABC

[Wan_Intel]

Hi STATEABC,

Thanks for the information.

Could you please provide the following information with us to further investigate the issue?

• OpenVINO™ toolkit version:
• Intel® FPGA AI Suite version:
• Language
• Hardware specifications
• Host Operating System

On the other hand, could you please run the Hello Query Device C++ Sample and share the output with us? 

To build the sample, please refer to the following link:

https://docs.openvino.ai/2022.3/openvino_docs_OV_UG_Samples_Overview.html#build-the-sample-applications

Regards,

Wan

[STATEABC]

Hi Wan,

My openVINO version is 2022.3, FPGA AI Suite version is 2024.1, language is English, and operating system is Ubuntu 22.04.

And the information printed after I run hello_query_device is as follows:

[ INFO ] Build ................................. 2022.3.1-9227-cf2c7da5689-releases/2022/3
[ INFO ]
[ INFO ] Available devices:
[ INFO ] CPU
[ INFO ] SUPPORTED_PROPERTIES:
[ INFO ] Immutable: AVAILABLE_DEVICES : ""
[ INFO ] Immutable: RANGE_FOR_ASYNC_INFER_REQUESTS : 1 1 1
[ INFO ] Immutable: RANGE_FOR_STREAMS : 1 12
[ INFO ] Immutable: FULL_DEVICE_NAME : Intel(R) Core(TM) i7-7800X CPU @ 3.50GHz
[ INFO ] Immutable: OPTIMIZATION_CAPABILITIES : WINOGRAD FP32 FP16 INT8 BIN EXPORT_IMPORT
[ INFO ] Immutable: CACHING_PROPERTIES : ""
[ INFO ] Immutable: CACHE_DIR : ""
[ INFO ] Mutable: NUM_STREAMS : 1
[ INFO ] Mutable: AFFINITY : CORE
[ INFO ] Mutable: INFERENCE_NUM_THREADS : 0
[ INFO ] Mutable: PERF_COUNT : NO
[ INFO ] Mutable: INFERENCE_PRECISION_HINT : f32
[ INFO ] Mutable: PERFORMANCE_HINT : UNDEFINED
[ INFO ] Mutable: PERFORMANCE_HINT_NUM_REQUESTS : 0
[ INFO ]

Regards,

ABC.

[STATEABC]

Hi，Wan

My openVINO version is 2022.3, FPGA AI Suite version is 2024.1, language is English, and system is Ubuntu 22.04

When I run Hello Query Device C++ Sample, the printed information is as follows:

[ INFO ] Build ................................. 2022.3.1-9227-cf2c7da5689-releases/2022/3
[ INFO ]
[ INFO ] Available devices:
[ INFO ] CPU
[ INFO ] SUPPORTED_PROPERTIES:
[ INFO ] Immutable: AVAILABLE_DEVICES : ""
[ INFO ] Immutable: RANGE_FOR_ASYNC_INFER_REQUESTS : 1 1 1
[ INFO ] Immutable: RANGE_FOR_STREAMS : 1 12
[ INFO ] Immutable: FULL_DEVICE_NAME : Intel(R) Core(TM) i7-7800X CPU @ 3.50GHz
[ INFO ] Immutable: OPTIMIZATION_CAPABILITIES : WINOGRAD FP32 FP16 INT8 BIN EXPORT_IMPORT
[ INFO ] Immutable: CACHING_PROPERTIES : ""
[ INFO ] Immutable: CACHE_DIR : ""
[ INFO ] Mutable: NUM_STREAMS : 1
[ INFO ] Mutable: AFFINITY : CORE
[ INFO ] Mutable: INFERENCE_NUM_THREADS : 0
[ INFO ] Mutable: PERF_COUNT : NO
[ INFO ] Mutable: INFERENCE_PRECISION_HINT : f32
[ INFO ] Mutable: PERFORMANCE_HINT : UNDEFINED
[ INFO ] Mutable: PERFORMANCE_HINT_NUM_REQUESTS : 0
[ INFO ]
[ INFO ] GNA
[ INFO ] SUPPORTED_PROPERTIES:
[ INFO ] Immutable: AVAILABLE_DEVICES : GNA_SW
[ INFO ] Immutable: OPTIMAL_NUMBER_OF_INFER_REQUESTS : 1
[ INFO ] Immutable: RANGE_FOR_ASYNC_INFER_REQUESTS : 1 1 1
[ INFO ] Immutable: OPTIMIZATION_CAPABILITIES : INT16 INT8 EXPORT_IMPORT
[ INFO ] Immutable: FULL_DEVICE_NAME : GNA_SW
[ INFO ] Immutable: GNA_LIBRARY_FULL_VERSION : 3.0.0.1910
[ INFO ] Mutable: GNA_SCALE_FACTOR_PER_INPUT : ""
[ INFO ] Mutable: GNA_FIRMWARE_MODEL_IMAGE : ""
[ INFO ] Mutable: GNA_DEVICE_MODE : GNA_SW_EXACT
[ INFO ] Mutable: GNA_HW_EXECUTION_TARGET : UNDEFINED
[ INFO ] Mutable: GNA_HW_COMPILE_TARGET : UNDEFINED
[ INFO ] Mutable: GNA_PWL_DESIGN_ALGORITHM : UNDEFINED
[ INFO ] Mutable: GNA_PWL_MAX_ERROR_PERCENT : 1.000000
[ INFO ] Mutable: PERFORMANCE_HINT : UNDEFINED
[ INFO ] Mutable: INFERENCE_PRECISION_HINT : undefined
[ INFO ] Mutable: PERFORMANCE_HINT_NUM_REQUESTS : 1
[ INFO ] Mutable: LOG_LEVEL : LOG_NONE

[STATEABC]

Hi, Wan

My openVINO version is 2022.3, FPGA AI Suite version is 2024.1, language is English, and system is Ubuntu 22.04

When I run Hello Query Device C++ Sample, the printed information is as follows:

[ INFO ] Build ................................. 2022.3.1-9227-cf2c7da5689-releases/2022/3
[ INFO ]
[ INFO ] Available devices:
[ INFO ] CPU
[ INFO ] SUPPORTED_PROPERTIES:
[ INFO ] Immutable: AVAILABLE_DEVICES : ""
[ INFO ] Immutable: RANGE_FOR_ASYNC_INFER_REQUESTS : 1 1 1
[ INFO ] Immutable: RANGE_FOR_STREAMS : 1 12
[ INFO ] Immutable: FULL_DEVICE_NAME : Intel(R) Core(TM) i7-7800X CPU @ 3.50GHz
[ INFO ] Immutable: OPTIMIZATION_CAPABILITIES : WINOGRAD FP32 FP16 INT8 BIN EXPORT_IMPORT
[ INFO ] Immutable: CACHING_PROPERTIES : ""
[ INFO ] Immutable: CACHE_DIR : ""
[ INFO ] Mutable: NUM_STREAMS : 1
[ INFO ] Mutable: AFFINITY : CORE
[ INFO ] Mutable: INFERENCE_NUM_THREADS : 0
[ INFO ] Mutable: PERF_COUNT : NO
[ INFO ] Mutable: INFERENCE_PRECISION_HINT : f32
[ INFO ] Mutable: PERFORMANCE_HINT : UNDEFINED
[ INFO ] Mutable: PERFORMANCE_HINT_NUM_REQUESTS : 0
[ INFO ]
[ INFO ] GNA
[ INFO ] SUPPORTED_PROPERTIES:
[ INFO ] Immutable: AVAILABLE_DEVICES : GNA_SW
[ INFO ] Immutable: OPTIMAL_NUMBER_OF_INFER_REQUESTS : 1
[ INFO ] Immutable: RANGE_FOR_ASYNC_INFER_REQUESTS : 1 1 1
[ INFO ] Immutable: OPTIMIZATION_CAPABILITIES : INT16 INT8 EXPORT_IMPORT
[ INFO ] Immutable: FULL_DEVICE_NAME : GNA_SW
[ INFO ] Immutable: GNA_LIBRARY_FULL_VERSION : 3.0.0.1910
[ INFO ] Mutable: GNA_SCALE_FACTOR_PER_INPUT : ""
[ INFO ] Mutable: GNA_FIRMWARE_MODEL_IMAGE : ""
[ INFO ] Mutable: GNA_DEVICE_MODE : GNA_SW_EXACT
[ INFO ] Mutable: GNA_HW_EXECUTION_TARGET : UNDEFINED
[ INFO ] Mutable: GNA_HW_COMPILE_TARGET : UNDEFINED
[ INFO ] Mutable: GNA_PWL_DESIGN_ALGORITHM : UNDEFINED
[ INFO ] Mutable: GNA_PWL_MAX_ERROR_PERCENT : 1.000000
[ INFO ] Mutable: PERFORMANCE_HINT : UNDEFINED
[ INFO ] Mutable: INFERENCE_PRECISION_HINT : undefined
[ INFO ] Mutable: PERFORMANCE_HINT_NUM_REQUESTS : 1
[ INFO ] Mutable: LOG_LEVEL : LOG_NONE

[STATEABC]

Hi,

My openVINO version is 2022.3, FPGA AI Suite version is 2024.1, language is English, and system is Ubuntu 22.04

When I run Hello Query Device C++ Sample, the printed information is as follows :

[INFO] Build ................................. 2022.3.1 - 9227 - cf2c7da5689 - releases / 2022 / 3
[INFO]
[INFO] Available devices :
[INFO] CPU
[INFO] SUPPORTED_PROPERTIES :
[INFO] Immutable : AVAILABLE_DEVICES : ""
[INFO] Immutable : RANGE_FOR_ASYNC_INFER_REQUESTS : 1 1 1
[INFO] Immutable : RANGE_FOR_STREAMS : 1 12
[INFO] Immutable : FULL_DEVICE_NAME : Intel(R) Core(TM) i7 - 7800X CPU @ 3.50GHz
[INFO] Immutable: OPTIMIZATION_CAPABILITIES: WINOGRAD FP32 FP16 INT8 BIN EXPORT_IMPORT
[INFO] Immutable : CACHING_PROPERTIES : ""
[INFO] Immutable : CACHE_DIR : ""
[INFO] Mutable : NUM_STREAMS : 1
[INFO] Mutable : AFFINITY : CORE
[INFO] Mutable : INFERENCE_NUM_THREADS : 0
[INFO] Mutable : PERF_COUNT : NO
[INFO] Mutable : INFERENCE_PRECISION_HINT : f32
[INFO] Mutable : PERFORMANCE_HINT : UNDEFINED
[INFO] Mutable : PERFORMANCE_HINT_NUM_REQUESTS : 0
[INFO]
[INFO] GNA
[INFO] SUPPORTED_PROPERTIES :
[INFO] Immutable : AVAILABLE_DEVICES : GNA_SW
[INFO] Immutable : OPTIMAL_NUMBER_OF_INFER_REQUESTS : 1
[INFO] Immutable : RANGE_FOR_ASYNC_INFER_REQUESTS : 1 1 1
[INFO] Immutable : OPTIMIZATION_CAPABILITIES : INT16 INT8 EXPORT_IMPORT
[INFO] Immutable : FULL_DEVICE_NAME : GNA_SW
[INFO] Immutable : GNA_LIBRARY_FULL_VERSION : 3.0.0.1910
[INFO] Mutable : GNA_SCALE_FACTOR_PER_INPUT : ""
[INFO] Mutable : GNA_FIRMWARE_MODEL_IMAGE : ""
[INFO] Mutable : GNA_DEVICE_MODE : GNA_SW_EXACT
[INFO] Mutable : GNA_HW_EXECUTION_TARGET : UNDEFINED
[INFO] Mutable : GNA_HW_COMPILE_TARGET : UNDEFINED
[INFO] Mutable : GNA_PWL_DESIGN_ALGORITHM : UNDEFINED
[INFO] Mutable : GNA_PWL_MAX_ERROR_PERCENT : 1.000000
[INFO] Mutable : PERFORMANCE_HINT : UNDEFINED
[INFO] Mutable : INFERENCE_PRECISION_HINT : undefined
[INFO] Mutable : PERFORMANCE_HINT_NUM_REQUESTS : 1
[INFO] Mutable : LOG_LEVEL : LOG_NONE

[STATEABC]

Hi, Wan

My openVINO version is 2022.3, FPGA AI Suite version is 2024.1, language is English, and system is Ubuntu 22.04

When I run Hello Query Device C++ Sample, the printed information is as follows :

[INFO] Build ................................. 2022.3.1 - 9227 - cf2c7da5689 - releases / 2022 / 3
[INFO]
[INFO] Available devices :
[INFO] CPU
[INFO] SUPPORTED_PROPERTIES :
[INFO] Immutable : AVAILABLE_DEVICES : ""
[INFO] Immutable : RANGE_FOR_ASYNC_INFER_REQUESTS : 1 1 1
[INFO] Immutable : RANGE_FOR_STREAMS : 1 12
[INFO] Immutable : FULL_DEVICE_NAME : Intel(R) Core(TM) i7 - 7800X CPU @ 3.50GHz
[INFO] Immutable: OPTIMIZATION_CAPABILITIES: WINOGRAD FP32 FP16 INT8 BIN EXPORT_IMPORT
[INFO] Immutable : CACHING_PROPERTIES : ""
[INFO] Immutable : CACHE_DIR : ""
[INFO] Mutable : NUM_STREAMS : 1
[INFO] Mutable : AFFINITY : CORE
[INFO] Mutable : INFERENCE_NUM_THREADS : 0
[INFO] Mutable : PERF_COUNT : NO
[INFO] Mutable : INFERENCE_PRECISION_HINT : f32
[INFO] Mutable : PERFORMANCE_HINT : UNDEFINED
[INFO] Mutable : PERFORMANCE_HINT_NUM_REQUESTS : 0
[INFO]
[INFO] GNA
[INFO] SUPPORTED_PROPERTIES :
[INFO] Immutable : AVAILABLE_DEVICES : GNA_SW
[INFO] Immutable : OPTIMAL_NUMBER_OF_INFER_REQUESTS : 1
[INFO] Immutable : RANGE_FOR_ASYNC_INFER_REQUESTS : 1 1 1
[INFO] Immutable : OPTIMIZATION_CAPABILITIES : INT16 INT8 EXPORT_IMPORT
[INFO] Immutable : FULL_DEVICE_NAME : GNA_SW
[INFO] Immutable : GNA_LIBRARY_FULL_VERSION : 3.0.0.1910
[INFO] Mutable : GNA_SCALE_FACTOR_PER_INPUT : ""
[INFO] Mutable : GNA_FIRMWARE_MODEL_IMAGE : ""
[INFO] Mutable : GNA_DEVICE_MODE : GNA_SW_EXACT
[INFO] Mutable : GNA_HW_EXECUTION_TARGET : UNDEFINED
[INFO] Mutable : GNA_HW_COMPILE_TARGET : UNDEFINED
[INFO] Mutable : GNA_PWL_DESIGN_ALGORITHM : UNDEFINED
[INFO] Mutable : GNA_PWL_MAX_ERROR_PERCENT : 1.000000
[INFO] Mutable : PERFORMANCE_HINT : UNDEFINED
[INFO] Mutable : INFERENCE_PRECISION_HINT : undefined
[INFO] Mutable : PERFORMANCE_HINT_NUM_REQUESTS : 1
[INFO] Mutable : LOG_LEVEL : LOG_NONE

[STATEABC]

Hi, Wan

My openVINO version is 2022.3, FPGA AI Suite version is 2024.1, language is English, and system is Ubuntu 22.04

When I run Hello Query Device C++ Sample, the printed information is as follows :

[INFO] Build ................................. 2022.3.1 - 9227 - cf2c7da5689 - releases / 2022 / 3
[INFO]
[INFO] Available devices :
[INFO] CPU
[INFO] SUPPORTED_PROPERTIES :
[INFO] Immutable : AVAILABLE_DEVICES : ""
[INFO] Immutable : RANGE_FOR_ASYNC_INFER_REQUESTS : 1 1 1
[INFO] Immutable : RANGE_FOR_STREAMS : 1 12
[INFO] Immutable : FULL_DEVICE_NAME : Intel(R) Core(TM) i7 - 7800X CPU @ 3.50GHz
[INFO] Immutable: OPTIMIZATION_CAPABILITIES: WINOGRAD FP32 FP16 INT8 BIN EXPORT_IMPORT
[INFO] Immutable : CACHING_PROPERTIES : ""
[INFO] Immutable : CACHE_DIR : ""
[INFO] Mutable : NUM_STREAMS : 1
[INFO] Mutable : AFFINITY : CORE
[INFO] Mutable : INFERENCE_NUM_THREADS : 0
[INFO] Mutable : PERF_COUNT : NO
[INFO] Mutable : INFERENCE_PRECISION_HINT : f32
[INFO] Mutable : PERFORMANCE_HINT : UNDEFINED
[INFO] Mutable : PERFORMANCE_HINT_NUM_REQUESTS : 0
[INFO]
[INFO] GNA
[INFO] SUPPORTED_PROPERTIES :
[INFO] Immutable : AVAILABLE_DEVICES : GNA_SW
[INFO] Immutable : OPTIMAL_NUMBER_OF_INFER_REQUESTS : 1
[INFO] Immutable : RANGE_FOR_ASYNC_INFER_REQUESTS : 1 1 1
[INFO] Immutable : OPTIMIZATION_CAPABILITIES : INT16 INT8 EXPORT_IMPORT
[INFO] Immutable : FULL_DEVICE_NAME : GNA_SW
[INFO] Immutable : GNA_LIBRARY_FULL_VERSION : 3.0.0.1910
[INFO] Mutable : GNA_SCALE_FACTOR_PER_INPUT : ""
[INFO] Mutable : GNA_FIRMWARE_MODEL_IMAGE : ""
[INFO] Mutable : GNA_DEVICE_MODE : GNA_SW_EXACT
[INFO] Mutable : GNA_HW_EXECUTION_TARGET : UNDEFINED
[INFO] Mutable : GNA_HW_COMPILE_TARGET : UNDEFINED
[INFO] Mutable : GNA_PWL_DESIGN_ALGORITHM : UNDEFINED
[INFO] Mutable : GNA_PWL_MAX_ERROR_PERCENT : 1.000000
[INFO] Mutable : PERFORMANCE_HINT : UNDEFINED
[INFO] Mutable : INFERENCE_PRECISION_HINT : undefined
[INFO] Mutable : PERFORMANCE_HINT_NUM_REQUESTS : 1
[INFO] Mutable : LOG_LEVEL : LOG_NONE

[STATEABC]

I don't know why the printed information I replied is always invalid

My openvino version is 2022.3, FPGA AI Suite version is 2024.1, system version is Ubuntu 22.04, language is English,
The first line of the printed information is: Build ................................. 2022.3.1-9227-cf2c7da5689-releases/2022/3
The rest is divided into two parts: CPU and GNA

[Wan_Intel]

Hi STATEABC,

Thanks for the information.

Let me check with relevant team and we'll get back to you as soon as possible.

Regards,

Wan

[Wan_Intel]

Hi STATEABC,

Referring to Section 3. FPGA AI Suite Installation Overview, the FPGA AI Suite has different software dependencies depending on the design example.

Could you please share which board are you using when installing FPGA AI Suite?

Regards,

Wan

[STATEABC]

Hi,Wan

I have some other findings about this problem.

When I choose different .sof files to program into the FPGA device and select the corresponding arch file, different errors will appear.

And constantly changing the programs in the demo so that they can run on the fpga also makes me exhausted, so I want to know if there is a good demo that can be provided for me to refer to?

Yours,

ABC

[Wan_Intel]

Hi STATEABC,

You may refer to FPGA AI Suite Getting Started Guide which provides the following information:

• An overview of the FPGA AI Suite
• Installation instructions and a list of pre-requisites
• A tutorial that walks you through the process of running inference on a ResNet-50 graph, including performance and area estimation

On the other hand, Hardware, Operating Systems and Software pre-requisites for PCIe-based Design Example are available at the following:

• PCIe-based Design Example Hardware Pre-requisites
• PCIe-based Design Example Operating System Pre-requisites
• PCIe-based Design Example Software Pre-requisites

Hope it helps.

Regards,

Wan

[Wan_Intel]

Hi STATEABC,

Thanks for your question.

If you need additional information from Intel, please submit a new question as this thread will no longer be monitored.

Regards,

Wan