504 (Gateway Timeout)

[Mooncake]

I have used the command "buildah push $REGISTRY_URL/benchmark:custom" many times,but I got the same following errors.

[JesusE_Intel]

Hi Mooncake,

Can you provide the full steps to reproduce the issue? I tested with a very simple Dockerfile and did not have any issues pushing to my private registry. Please provide your Dockerfile as well.

Here are steps I took:

Dockerfile:

[build@cliservice-devcloud-prod-1-9v7bz test]$ cat Dockerfile 

FROM alpine

CMD ["echo", "Hello World!"]

Build Container:

[build@cliservice-devcloud-prod-1-9v7bz test]$ buildah bud --format docker -f Dockerfile -t hello_world:1.0 .

STEP 1: FROM alpine

Getting image source signatures

Copying blob 8921db27df28 done  

Copying config 042a816809 done  

Writing manifest to image destination

Storing signatures

STEP 2: CMD ["echo", "Hello StackOverflow!"]

STEP 3: COMMIT hello_world:1.0

Getting image source signatures

Copying blob 8e012198eea1 skipped: already exists  

Copying blob 5f70bf18a086 done  

Copying config 14cad57e15 done  

Writing manifest to image destination

Storing signatures

--> 14cad57e154

Push to Private Registry:

[build@cliservice-devcloud-prod-1-9v7bz test]$ buildah tag hello_world:1.0 $REGISTRY_URL/hello_world:1.0

[build@cliservice-devcloud-prod-1-9v7bz test]$ buildah push $REGISTRY_URL/hello_world:1.0

Getting image source signatures

Copying blob 5f70bf18a086 done  

Copying blob 8e012198eea1 done  

Copying config 14cad57e15 done  

Writing manifest to image destination

Storing signatures

Regards,

Jesus

[Mooncake]

Hi, Here are the full steps.

Build Container:

[build@cliservice-devcloud-prc-1-v8ztr openvino-dev-latest]$ buildah bud --format docker -f ./developer-samples/python/benchmark/dockerfile/ubuntu18/openvino_cgvh_dev_2021.4.dockerfile -t $REGISTRY_URL/benchmark:custom .

Push to Private Registry:

[build@cliservice-devcloud-prc-1-v8ztr openvino-dev-latest]$ buildah tag $REGISTRY_URL/benchmark:custom $REGISTRY_URL/benchmark:custom
[build@cliservice-devcloud-prc-1-v8ztr openvino-dev-latest]$ buildah push $REGISTRY_URL/benchmark:custom
Getting image source signatures
Copying blob 1318a9bb5a3d done
Copying blob 8ebe8bf9a7b6 done
Copying blob 2aec5cff3cb4 done
Copying blob b4f084753f69 done
Copying blob 824bf068fd3d done
Copying blob d86ca7bc5879 done
Copying blob b221f9ac4002 done
Copying blob 79b4a8921115 done
Copying blob 856b54a0503d done
Copying blob 4d2b2bc25ec6 done
Copying blob ad2ec6be5093 done
Copying blob 76913aae488a [================>---------------------] 1.8GiB / 3.9GiB
Copying blob 73de2d3a04c5 [--------------------------------------] 8.0b / 160.5KiB
Copying blob f1d1336405c5 [--------------------------------------] 8.0b / 5.0KiB
Copying blob 8403c928936c [--------------------------------------] 8.0b / 55.5KiB
Copying blob 83ecd8916241 [--------------------------------------] 8.0b / 46.5KiB
Getting image source signatures
Getting image source signatures
Getting image source signatures
Copying blob 9b690cc54925 done
Copying blob 83ecd8916241 done
Copying blob 7b4ee1a88472 done
Copying blob 73de2d3a04c5 done
Copying blob f1d1336405c5 done
Copying blob 8403c928936c done
Copying blob afc4670a56c8 done
Copying blob 4cbd30c0f629 done
Copying blob 869cbed038d4 done
Copying blob 387269beb2c2 done
Copying blob 4158296d9215 done
Copying blob 75de083c1f7e done
Copying blob 527d4a6dd47d done
error pushing image "default-route-openshift-image-registry.apps.prc.cfa.devcloud.intel.cn/luohye25-intel/benchmark:custom" to "docker://default-route-openshift-image-registry.apps.prc.cfa.devcloud.intel.cn/luohye25-intel/benchmark:custom": error copying layers and metadata from "containers-storage:[vfs@/home/build/.local/share/containers/storage+/var/tmp/1000/containers]default-route-openshift-image-registry.apps.prc.cfa.devcloud.intel.cn/luohye25-intel/benchmark:custom" to "docker://default-route-openshift-image-registry.apps.prc.cfa.devcloud.intel.cn/luohye25-intel/benchmark:custom": Error trying to reuse blob sha256:824bf068fd3dc3ad967022f187d85250eb052f61fe158486b2df4e002f6f984e at destination: failed to read from destination repository luohye25-intel/benchmark: 504 (Gateway Timeout)
ERRO exit status 1

[JesusE_Intel]

Hi Mooncake,

Using the same commands you provided, I am not able to reproduce the error. The container is successfully imported from my side. Did you make any changes to the sample? Have you made any modifications to the benchmark_app? Could you compress the following directory, download it and attach it to the discussion?

./developer-samples/python/benchmark

Regards,

Jesus

[Mooncake]

Hi Jesus,

After  compressing the directory, it is over 71MB,so i can't attach it to the discussion.And now, I receive anthoer error.

Error:

Patch "https://default-route-openshift-image-registry.apps.prc.cfa.devcloud.intel.cn/v2/luohye25-intel/benchmark/blobs/uploads/39c8667e-7460-4958-a9a0-5f7dc65bcf1f?_state=a2WzObro4joB8ltc1uTwI647M9bsnqpe6yRm3z45LC57Ik5hbWUiOiJsdW9oeWUyNS1pbnRlbC9iZW5jaG1hcmsiLCJVVUlEIjoiMzljODY2N2UtNzQ2MC00OTU4LWE5YTAtNWY3ZGM2NWJjZjFmIiwiT2Zmc2V0IjowLCJTdGFydGVkQXQiOiIyMD...": write tcp 10.128.2.202:59532->10.138.128.4:443: use of closed network connection
ERRO exit status 1

[JesusE_Intel]

Hi Mooncake,

For some odd reason, when you respond to me a new discussion is created. I've merged your new reply to the existing discussion.

Could you try attaching only the files that you have modified? The new error seems to be an issue with the connection, is this a persistent error now?

Regards,

Jesus

[Mooncake]

Hi Jesus,

  Here is the file I only modified. The error still persistent. Sometimes is "error pushing image "default-route-openshift-image-registry.apps.prc.cfa.devcloud.intel.cn/luohye25-intel/benchmark:custom" to "docker://default-route-openshift-image-registry.apps.prc.cfa.devcloud.intel.cn/luohye25-intel/benchmark:custom": error copying layers and metadata from "containers-storage:[vfs@/home/build/.local/share/containers/storage+/var/tmp/1000/containers]default-route-openshift-image-registry.apps.prc.cfa.devcloud.intel.cn/luohye25-intel/benchmark:custom" to "docker://default-route-openshift-image-registry.apps.prc.cfa.devcloud.intel.cn/luohye25-intel/benchmark:custom": Error trying to reuse blob sha256:824bf068fd3dc3ad967022f187d85250eb052f61fe158486b2df4e002f6f984e at destination: failed to read from destination repository luohye25-intel/benchmark: 504 (Gateway Timeout) ", sometimes is "Patch "https://default-route-openshift-image-registry.apps.prc.cfa.devcloud.intel.cn/v2/luohye25-intel/benc...": write tcp 10.128.2.202:59532->10.138.128.4:443: use of closed network connection"

[JesusE_Intel · Accepted solution]

Hi Mooncake,

Looks like the file didn't attach to your reply. However, looking at the log you provided it seems to be an issue with OpenVINO unable to re-use the compiled model (blob). Have you tried to run the modified benchmark on a local machine?

If you can please, try to attach the modified files once more. Unfortunately, I am unable to reproduce the issue without knowing the exact changes made to the benchmark sample.

Regards,

Jesus

[JesusE_Intel]

If you need any additional information, please submit a new question as this thread will no longer be monitored.