- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Starting the service now takes at least 2.5 seconds(base on bert).
Is there any way to optimize the startup time, hopefully within 1 second? If the startup time is less than 1 second, it is possible to provide tremendous throughput by cloud serverless architecture.
Link Copied
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Linchpin,
Thanks for reaching out to us.
For your information, the smaller the model’s size, the faster the start-up time of the OpenVINO™ Model Server. We regret to inform you that the method to optimize the start-up time of the OpenVINO™ Model Server is not available.
bert-small-uncased-whole-word-masking-squad-int8-0002 vs face-detection-retail-0004:
Sorry for the inconvenience and thank you for your support.
Regards,
Wan
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Wan,
Thank you for your experimental work.
Regards,
Lane
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Linchpin,
Thank you for your question.
If you need any additional information from Intel, please submit a new question as this thread is no longer being monitored.
Regards,
Wan
![](/skins/images/7FC17B7B85029576C25F1E43CE255B51/responsive_peak/images/icon_anonymous_message.png)
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page