- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi
I've converted my yolov3 model to .pb and them to .bin and .xml using the official instructions, but when I run it on the NCS2 it puts label boxes everywhere. If I test the origional yolov3 model it works perfectly, so I'm thinking something has gone wrong in the conversion. I'm using tensorflow 1.12, as I read newer versions can cause problems. One area I'm struggling with is configuring the .json file as there is next to no information about what needs to go in this.
I've attached the cfg and the json in a .7z file if someone can take a look and advise me what needs to go where.
Any help would be massively apreciated!
Link Copied
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Peter,
It's likely an issue with the json file or how the model was converted. I've trained a tiny YOLOv3 model using Darknet. Once I had the weight file, I converted to .pb using the following steps (also listed here):
git clone https://github.com/mystic123/tensorflow-yolo-v3.git cd tensorflow-yolo-v3 git checkout ed60b90 python3 convert_weights_pb.py --class_names label.names --data_format NHWC --weights_file yolov3-tiny.weights --tiny
I used the following command to convert the frozen TensorFlow model to IR using the following command:
python3 <OpenVINO>/deployment_tools/model_optimizer/mo_tf.py --input_model frozen_darknet_yolov3_model.pb --tensorflow_use_custom_operations_config yolov3_tiny_custom.json --batch 1 --data_type FP16 --reverse_input_channels
Attached is the json configuration file that I used, I modified it to match the last yolo section in the .cfg file. Hope this helps!
Regards,
Jesus
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Jesus
Thank you for that, I'm still having the same problem. Could you comfirm what version of Tensorflow you are using please?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Peter,
I am using Tensorflow version 1.12, could you share your model so I can give it a try?
Regards,
Jesus
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Jesus
Thats the same as me then. I've attached the weights and names files I'm using, as well as the .pb .bin and .xml files so you can test each step I'm doing. I've also included a test image.
Many thankfor your help!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Peter,
Using OpenVINO toolkit 2019 R2.0.1, I converted your weight file to Tensorflow (.pb) to IR Format with the commands below. Then I ran the IR model using the object_detection_demo_yolov3_async and saw the wheelchair detections (see attached). I also ran the IR model you provided and saw similar results. How are you testing the model? Could you share the results you are seeing?
git clone https://github.com/mystic123/tensorflow-yolo-v3.git cd tensorflow-yolo-v3/ git checkout ed60b90 python3 convert_weights_pb.py --class_names wheelchairs.names --data_format NHWC --weights_file wheelchairs_yolov3-tiny_final.weights --tiny python3 ~/intel/openvino/deployment_tools/model_optimizer/mo_tf.py --input_model frozen_darknet_yolov3_model.pb --tensorflow_use_custom_operations_config yolo_v3_tiny.json --batch 1 --data_type FP16 --reverse_input_channels ./object_detection_demo_yolov3_async -m frozen_darknet_yolov3_model.xml -d MYRIAD -i cam
BTW, the sample uses a camera as input so I pointed the camera at the picture you provided. :)
Regards,
Jesus
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Jesus
The version of OpenVino R2 for the raspberry pi doesn't have object_detection_demo_yolov3_async in its samples any more, do you know why this is?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Dear Batchelor, Peter,
That's odd ! I need to file a bug if that is the case. Anyway, you can find it here:
Are you 100% sure that it's missing from the 2019R2 RPI package ?
Let me know and I will certainly file a bug on your behalf.
Thanks,
Shubha
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Dear Batchelor, Peter,
OK it looks like leaving out some Python scripts was a design decision made "on purpose" to keep the RPI tar.gz package small. But the good news is that you can download it from the link I gave you above.
Have fun !
Let us know if you have more questions,
Shubha
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Shibha
Thanks for that, we were wondering! Could the online guides be updated to explain this please? I'm trying a reinstall on my Pi today, so I'll see if that fixes it!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Peter,
Thank you for providing your feedback, I will share with the appropriate team to improve our documentation. Let me know if you have additional questions.
Regards,
Jesus
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Jesus
That seems to be working with that Async demo code provided. The bounding box for the detected object is really small, any idea what could be causing this?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Peter,
I took a closer look at the sample code, it looks like the sample is for the full version of YoloV3 as it's not doing any calculations for the anchor offsets needed for tiny Yolo V3.
However, we have another sample demo for tiny YoloV3. Take a look at the following link: https://github.com/movidius/ncappzoo/tree/master/networks/TinyYolo_v3
You will need to make a couple of simple changes to match to your model.
Change Line 159 to match your model, I believe you only have 1 class:
num_of_classes = 1 #default 80
Use the following formula to calculate the number of values.If your model only has 1 class, you will have 6 values.
80 class scores + 4 coordinate values + 1 objectness score = 85 values
Update the values from "85 to "6" on lines 180, 184, 185, 186,187 and 191
box_confidence_score = output_node_results[0][row][col][anchor_boxes * 85 + 4]
Let me know if this works for you!
Regards,
Jesus
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Jesus
Amazing! Also, it may be worth linking to that git in documentation. Thanks for all of your help!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Peter,
Glad it worked for you! We just released the Neural Compute Application Zoo (ncappzoo) for the Intel Neural Compute Stick 2 using the OpenVINO toolkit and will add it to the get started guide. Your project is very interesting, have you considered sharing your project on the ncappzoo repository?
Edit: The Get Started Guide for the Intel NCS 2 already contains a link to the ncappzoo repository.
Regards,
Jesus
![](/skins/images/7FC17B7B85029576C25F1E43CE255B51/responsive_peak/images/icon_anonymous_message.png)
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page