Link Copied
Hi Eddie_patton,
Thank you for reaching out to us.
The error might be due to an incorrect core.read_model arguments, thus it was unable to read the model you specify correctly.
For your information, I received a similar error when I execute the core.read_model without specifying my path correctly as shown below:
Exception thrown at 0x00007FFE3D4B4B2C in demo223.exe: Microsoft C++ exception: std::runtime_error at memory location 0x000000BF101CEC48.
Exception thrown at 0x00007FFE3D4B4B2C in demo223.exe: Microsoft C++ exception: InferenceEngine::GeneralError at memory location 0x000000BF101CE700.
Exception thrown at 0x00007FFE3D4B4B2C in demo223.exe: Microsoft C++ exception: ov::Exception at memory location 0x000000BF101CFA18.
Unhandled exception at 0x00007FFE3D4B4B2C in demo223.exe: Microsoft C++ exception: ov::Exception at memory location 0x000000BF101CFA18.
I was able to build and run my code without any issues when configuring the correct model path for the core.read_model here:
Please try to ensure the read model argument is correct. If the error still persists, please provide us with the complete error messages and more details (ie. model file and source code) if possible for us to replicate and validate the issue, thank you.
Regards,
Megat
Thanks for getting back to me Megat.
Apparently I am using a different overloaded version of read_model() than you are (I inherited this code from another dev)
m_modelWeights = VsiAlign::make_aligned<BYTE[]>(vecModelWeights.size());
std::memcpy(m_modelWeights.get(), vecModelWeights.data(), vecModelWeights.size());
m_model = core.read_model(strModel,
ov::Tensor(ov::element::u8, { vecModelWeights.size() }, m_modelWeights.get()));
I looked up the overloads for read_model and am using this overload
std::shared_ptr<ov::Model> read_model( const std::string& model, const Tensor& weights ) const;
I also checked the openvino version again.
You could be right that it's the .bin. We are using encryption, so perhaps decrypting it is causing an issue. I'll regenerate the bin and see what happens.
Use core.read_model(xml_path), I get the same exception
Exception thrown at 0x00007FFACEB5CF19 in SysApp.exe: Microsoft C++ exception: std::runtime_error at memory location 0x00000091605FCF58.
Regarding the sharing of code and model info, I have to get approval from higher ups, but it's unlikely we can do this without an NDA + private channel.
But in the meantime, I'm creating a sample project to isolate the code and the issue.
mo --input_shape [1,256,256,3] --use_new_frontend --saved_model_dir model
Framework & Topology of the model: an object detection model based on RetinaNet.
As per the code segment that where we call the model, I can share that
// FYI: LPCWSTR pszModelPath32
// wstring strNetworkXml
// Check files exist
{
auto bExistsXml = GetFileExists(strNetworkXml);
auto bExistsBin = GetFileExists(pszModelPath);
if (!bExistsXml || !bExistsBin)
{
TheLogger().Log(SysApp::SYSTEM, "%s Inference model files not found\n", __FUNCTION__);
return E_FAIL;
}
}
ov::Core core;
// convert wstring to string
std::string strModel(strNetworkXml.length(), 0);
std::transform(strNetworkXml.begin(), strNetworkXml.end(), strModel.begin(), [](wchar_t c) {
return (char)c;
});
std::wstring w(pszModelPath32);
std::string strWeight(w.begin(), w.end());
//m_model = core.read_model(strNetworkXml.c_str(), pszModelPath); // caused exception
//m_model = core.read_model(strModel, strWeight); // caused exception
m_model = core.read_model(strModel); // latest attempt - caused exception
Hi Eddie_patton,
Thank you for sharing the information.
From our end, we were able to successfully read a retinanet-tf model which was available from Open Model Zoo without any issues. Here is the code snippet that I used to read the model from .xml file:
Upon further investigation of your C++ code snippet, we noticed that you're reading the model from a string data instead of from the .xml file itself. In the Python script you've shared we noticed that you're reading from a model file directly.
The difference that we're able to see are between reading the model from file is successful instead of from a string data. Please have a try by defining the path to your .xml file for the core.read_model() function in your C++ code and see if the issue was resolved.
Regards,
Hairul
Hi Hairul
Perhaps the code naming is misleading, but the debugger shows that strModel = C:\FFSS\debug\Bladder\x64\Host\SysApp\Models\1rmnq505.xml
Question: if one only specifies the xml path, then the read_model() API assumes this is the location of the .bin?
= C:\FFSS\debug\Bladder\x64\Host\SysApp\Models\1rmnq505.bin
In which case, the bin is in the above location, but just thought I'd check.
Hi Eddie_patton,
Thank you for the clarification.
From my end, here is the text visualizer result from successful retinanet-tf model read by providing the xml file path:
Regarding your question, if bin file path was not provided in the core.read_model() function, it will try to read bin file with the same name as the xml. The bin file should be in the same directory as the xml file path for this to work.
Regards,
Hairul
Hi Hairul
So based on what you've shown, the string I'm using is correct. So it's still a mystery why the exception happens.
I downloaded openvino 2023.1 to a different PC and went through the instructions to run the Hello_classification.
https://docs.openvino.ai/2023.0/openvino_inference_engine_samples_hello_classification_README.html
My goal was to get the read_model working in the hello_classification example with the googlenet-v1 model and then try our model that's failing.
Unfortunately, my quest ran into a snag: The read_model() can't find the googlenet-v1 model and throws the exception below.
Which is really odd since I added code to check for the file and it sees it, and it does.
std::ifstream f(model_path.c_str());
if (!f.good()) {
std::cerr << "Could not open file " << model_path << std::endl;
return EXIT_FAILURE;
}
// -------- Step 1. Initialize OpenVINO Runtime Core --------
ov::Core core;
// -------- Step 2. Read a model --------
slog::info << "Loading model files: " << model_path << slog::endl;
std::shared_ptr<ov::Model> model = core.read_model(model_path);
printInputAndOutputsInfo(*model);
The example arguments:
"C:\Users\XXXXXX\Documents\Intel\OpenVINO\openvino_cpp_samples_build\hello_classification\public\googlenet-v1\FP16\googlenet-v1.xml" "C:\Users\XXXXXX\Documents\Intel\OpenVINO\openvino_cpp_samples_build\hello_classification\Data\car.bmp"
GPU
This is the model_path variable. It's correct.
The File Explorer shows both the bin and xml in the same folder.
I found it odd that when I initially ran the example, I got an error saying that the openvinod.dll, tbb_debug.dll and plugin.xml files could not be found. I was able to run after copying them to the hello_classification exe folder from the folders below:
C:\Program Files (x86)\Intel\openvino_2023.1\runtime\bin\intel64\Debug
C:\Program Files (x86)\Intel\openvino_2023.1\runtime\3rdparty\tbb\bin
Any thoughts on why the ie_network_reader.cpp can't find the googlenet-v1 model?
Could it be that windows 10 is somehow blocking access? You'd think the ifstream() would also fail too if that's the case.
Hi Eddie_patton,
From my end, I was able to run the hello_classification sample with googlenet-v1 model in OpenVINO 2023.0 without issue. Here is the result:
However, I did face the "openvinod.dll was not found" error for hello_classification sample when launching Visual Studio without running "setupvars.bat" script beforehand:
Here is the steps that I did to successfully run the hello_classification sample:
- Run the "setupvars.bat" script from the OpenVINO 2023.0 directory in a terminal
- Run the "samples\build_samples_msvc.bat" script to build the samples
- Launch Visual Studio from the same terminal of "setupvars.bat"
- Run the hello_classification sample
Do let us know if the issue was able to be resolved following the steps provided.
Regards,
Hairul
