model server not working models/resnet50

[Scuba]

Hey folks,

My model server is not coming up, this was working fine couple of months back and now stopped working, any insights

I am using this repo wget //storage.openvinotoolkit.org/repositories/open_model_zoo/2022.1/models_bin/2/resnet50-binary-0001/FP32-INT1/resnet50-binary-0001.{xml,bin} -P models/resnet50/1

sudo docker-compose down

sudo docker-compose up

WARN[0000] /home/fedora/docker-compose.yml: the attribute `version` is obsolete, it will be ignored, please remove it to avoid potential confusion

WARN[0000] /home/fedora/docker-compose.yml: the attribute `version` is obsolete, it will be ignored, please remove it to avoid potential confusion

[+] Running 0/0

⠋ Network fedora_default  Creating                                                      0.1s

WARN[0000] Found orphan containers ([fedora-resnet3-1 fedora-resnet6-1 fedora-resnet5-1 fedora-resnet4-1 fedora-resnet8-1 fedora-resnet7-1 fedora-resnet2-1]) for this project. If you remov[+] Running 2/2his service in your compose file, you can run this command with the --remove-or ✔ Network fedora_default      Created                                                   0.1s

✔ Container fedora-resnet1-1  Created                                                   0.1s

Attaching to resnet1-1

resnet1-1  | [2024-11-01 22:07:42.262][1][serving][info][server.cpp:75] OpenVINO Model Server 2024.4.28219825c

resnet1-1  | [2024-11-01 22:07:42.262][1][serving][info][server.cpp:76] OpenVINO backend c3152d32c9c7

resnet1-1  | [2024-11-01 22:07:42.262][1][serving][info][pythoninterpretermodule.cpp:35] PythonInterpreterModule starting

resnet1-1  | [2024-11-01 22:07:42.368][1][serving][info][pythoninterpretermodule.cpp:46] PythonInterpreterModule started

resnet1-1  | [2024-11-01 22:07:42.382][1][modelmanager][info][modelmanager.cpp:125] Available devices for Open VINO: CPU

resnet1-1  | [2024-11-01 22:07:42.382][1][serving][info][grpcservermodule.cpp:122] GRPCServerModule starting

resnet1-1  | [2024-11-01 22:07:42.383][1][serving][info][grpcservermodule.cpp:191] GRPCServerModule started

resnet1-1  | [2024-11-01 22:07:42.383][1][serving][info][grpcservermodule.cpp:192] Started gRPC server on port 9001

resnet1-1  | [2024-11-01 22:07:42.383][1][serving][info][servablemanagermodule.cpp:51] ServableManagerModule starting

resnet1-1  | [2024-11-01 22:07:42.383][1][modelmanager][error][modelmanager.cpp:1316] Couldn't list directories in path: /models/resnet50

resnet1-1  | [2024-11-01 22:07:42.383][1][modelmanager][error][modelmanager.cpp:157] Couldn't start model manager

resnet1-1  | [2024-11-01 22:07:42.383][1][serving][error][servablemanagermodule.cpp:58] ovms::ModelManager::Start() Error: The provided base path is invalid or doesn't exists

resnet1-1  | [2024-11-01 22:07:42.383][1][serving][info][grpcservermodule.cpp:200] GRPCServerModule shutting down

resnet1-1  | [2024-11-01 22:07:42.383][1][serving][info][grpcservermodule.cpp:205] Shutdown gRPC server

resnet1-1  | [2024-11-01 22:07:42.383][1][serving][info][grpcservermodule.cpp:209] GRPCServerModule shutdown

resnet1-1  | [2024-11-01 22:07:42.383][1][serving][info][servablemanagermodule.cpp:65] ServableManagerModule shutting down

resnet1-1  | [2024-11-01 22:07:42.384][1][serving][info][servablemanagermodule.cpp:71] ServableManagerModule shutdown

resnet1-1  | [2024-11-01 22:07:42.384][1][serving][info][pythoninterpretermodule.cpp:57] PythonInterpreterModule shutting down

resnet1-1  | [2024-11-01 22:07:42.384][1][serving][info][pythoninterpretermodule.cpp:62] PythonInterpreterModule shutdown

resnet1-1  | Python version

resnet1-1  | 3.10.12 (main, Sep 11 2024, 15:47:36) [GCC 11.4.0]

resnet1-1 exited with code 1

[fedora@fedora-vm-100g ~]$

[fedora@fedora-vm-100g ~]$

[fedora@fedora-vm-100g ~]$ cat docker-compose.yml

version: '3'

services:

  resnet1:

    image: openvino/model_server:latest

    command: >

      --model_name resnet

      --model_path /models/resnet50

      --layout NHWC:NCHW

      --port 9001

    volumes:

      - /home/fedora/models:/models

    ports:

      - "9001:9001"

[fedora@fedora-vm-100g ~]$

[Wan_Intel]

Hi Scuba,

Thanks for reaching out to us.

To further investigate the issue, could you please provide us with the information as follows:

• Hardware specifications
• Host operating system
• Python version

On the other hand, could you please add the following command when launching OpenVINO™ Model Server?

--log_level=DEBUG

Regards,

Wan

[Wan_Intel]

Hi Scuba,

Thanks for your question.

If you need additional information from Intel, please submit a new question as this thread will no longer be monitored.

Regards,

Wan