Link Copied
Hi Aqil,
Thank you for reaching out to us.
Yes, you are correct, Intel® Core™ i9-12900KF is more powerful than Intel® Core™ i7-11700 therefore theoretically should perform better. However, other factors such as the model used might affect the results of the OpenVINO™ inference.
From the Performance Benchmark page, I configured the benchmark graph comparing i7-1185G7 and i9-12900HK. The results show that while most models perform better (lower latency) on the 12th gen CPU, there are some models that perform better (lower latency) on the 11th gen CPU. I share some of the results below:
Based on your average results, the difference of 1.229ms might be plausible. However, to provide any confirmation, more details are needed. Please share with us your model for further investigation.
On the other hand, the CPU plugin offers thread scheduling on 12th gen Intel® Core and up. You can choose to run inference on E-cores, P-cores, or both, depending on your application’s configurations. You can read more on the Release Notes page, under the New and Changed in 2023.0 section.
Could you try out the thread scheduling and run the benchmark on Intel® Core™ i9-12900KF using only P-cores to see if this solves your issue? For your information, I configured my scheduling core type to P-cores in Python here:
Regards,
Megat
Hi,
I analyzed the result when i add scheduling PCORE_ONLY parameter in IR part. But the result is not improving. Here's the result shown as below, all numbers are recorded in milliseconds (ms).
i9-12900KF (without scheduling)
min 7.426463
max 12.879063
avg 9.938032436
i9-12900KF (scheduling PCORE_ONLY)
min 7.024152001
max 12.607284
avg 9.807636577
i7-11700
min 8.051206
max 13.548221
avg 8.709539491
From the result above, we can see, i just gained about 0.1ms from not using scheduling to use it. I also want to share the piece of code that does the IR part as shown below (we're using YOLOV7 Openvino script)
My question, what is the best IR parameter for 12th gen cpu ?
From my data, the i7-11700 and i5-1135G7, these two gave me logic and relevant benchmark data. Only the 12th gen not giving proper data.
Best regards and thank you,
Aqil
Hi,
I got the new result, and it's not really a great improvement. All numbers shown in millisecond (ms).
i9-12900KF (no scheduling core parameter) :
| min | 7.426463 |
| max | 12.879063 |
| avg | 9.938032436 |
i9-12900KF using PCORE_ONLY :
| min | 7.024152001 |
| max | 12.607284 |
| avg | 9.807636577 |
i7-11700
| min | 8.051206 |
| max | 13.548221 |
| avg | 8.709539491 |
As shown above, i only gained roughly 0.1ms by stating scheduling core parameter PCORE_ONLY. And i'll share a piece of the code where the inference part take place :
Other information i can share, we're using YOLOV7 Openvino. My benchmark program will run a local video mp4, car entering toll gate, we detect the licence plate, and read it. (Detection plate, crop the plate, feed into Optical Character Recognition).
The numbers i just share to you, is only the detection part (car enter, we detect the plate). This part is the most time taken compared to Post-Processing time taken and OCR time taken.
So my question, based from my piece of code i shared, what is the best parameter for Inferencing especially for 12th gen cpu ?
I've tested on i7-11700 and i5-1135G7, and the result for these two cpu are relevant and logic.
Best regards and thank you,
Aqil
Hi Aqil,
Thanks for the details you provided.
For your information, on my end, I validated the YOLOv7 model with OpenVINO™ Benchmark Tool on Intel® Core™ i9-12900 and Intel® Core™ i7-1185G7. I received results that show that my i9-12900 performs better (137.90ms avg) than i7-1185G7 (194.66ms avg). However, it is important to note that the i7-1185G7 is less powerful than the i7-11700 that you have tested. I show my results below:
i9-12900:
i7-1185G7:
On the other hand, we have informed the relevant team regarding your issue for further investigation and we'll get back to you once we receive any confirmation, thank you.
Regards,
Megat
