topic Hi Jonathan, in Intel® oneAPI Math Kernel Library

apt repository broken

JMart62 — Wed, 30 May 2018 21:29:18 GMT

Dear all,

I get the following errors in Ubuntu 18.04 when running

wget https://apt.repos.intel.com/intel-gpg-keys/GPG-PUB-KEY-INTEL-SW-PRODUCTS-2019.PUB
apt-key add GPG-PUB-KEY-INTEL-SW-PRODUCTS-2019.PUB
wget https://apt.repos.intel.com/setup/intelproducts.list -O /etc/apt/sources.list.d/intelproducts.list
# The previous three work without problems, but the following line has the issue:
apt-get update && apt-get install -y --no-install-recommends intel-mkl-64bit-2018.3

Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease
Hit:2 http://security.ubuntu.com/ubuntu bionic-security InRelease
Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease
Get:4 https://apt.repos.intel.com/intelpython binary/ InRelease [1403 B]
Get:5 https://apt.repos.intel.com/mkl all InRelease [4422 B]
Hit:6 http://archive.ubuntu.com/ubuntu bionic-backports InRelease
Get:7 https://apt.repos.intel.com/ipp all InRelease [4416 B]
Get:8 https://apt.repos.intel.com/tbb all InRelease [4400 B]
Get:9 https://apt.repos.intel.com/daal all InRelease [4414 B]
Get:10 https://apt.repos.intel.com/mpi all InRelease [4358 B]
Get:11 https://apt.repos.intel.com/intelpython binary/ Packages [1853 B]
Get:12 https://apt.repos.intel.com/mkl all/main amd64 Packages [39.3 kB]
Err:12 https://apt.repos.intel.com/mkl all/main amd64 Packages
File has unexpected size (45690 != 39339). Mirror sync in progress? [IP: 23.67.128.143 443]
Hashes of expected file:
- Filesize:39339 [weak]
- SHA512:6c55f783460cb6b09e2006fd85ad9c10d9abb0226de4f96d2c2ee3558ce3b593ddaa470170dfde7187271bbeae2f843e5bacce4095f7cb2ac0adac853096f99b
- SHA256:0ecd4a8ec38322c936789aefd423fd0c562aa2088a0baa20b0cabc7824f9032e
- SHA1:aa20c4f4f9944676a1421c22b794cde84b054ee2 [weak]
- MD5Sum:439ae5cfb5a4584eeaec01f13f2acc63 [weak]
Release file created at: Thu, 15 Mar 2018 11:31:06 +0000
Get:13 https://apt.repos.intel.com/mkl all/main all Packages [13.0 kB]
Err:13 https://apt.repos.intel.com/mkl all/main all Packages

Get:14 https://apt.repos.intel.com/ipp all/main all Packages [6740 B]
Get:15 https://apt.repos.intel.com/ipp all/main amd64 Packages [18.0 kB]
Get:16 https://apt.repos.intel.com/tbb all/main all Packages [5967 B]
Get:17 https://apt.repos.intel.com/tbb all/main amd64 Packages [8200 B]
Get:18 https://apt.repos.intel.com/daal all/main all Packages [6028 B]
Get:19 https://apt.repos.intel.com/daal all/main amd64 Packages [10.5 kB]
Get:20 https://apt.repos.intel.com/mpi all/main all Packages [791 B]
Get:21 https://apt.repos.intel.com/mpi all/main amd64 Packages [1725 B]
Fetched 83.3 kB in 2s (53.7 kB/s)
Reading package lists... Done
W: Conflicting distribution: https://apt.repos.intel.com/intelpython binary/ InRelease (expected binary/ but got )
E: Failed to fetch https://apt.repos.intel.com/mkl/dists/all/main/binary-amd64/Packages.gz ; File has unexpected size (45690 != 39339). Mirror sync in progress? [IP: 23.67.128.143 443]
Hashes of expected file:
- Filesize:39339 [weak]
- SHA512:6c55f783460cb6b09e2006fd85ad9c10d9abb0226de4f96d2c2ee3558ce3b593ddaa470170dfde7187271bbeae2f843e5bacce4095f7cb2ac0adac853096f99b
- SHA256:0ecd4a8ec38322c936789aefd423fd0c562aa2088a0baa20b0cabc7824f9032e
- SHA1:aa20c4f4f9944676a1421c22b794cde84b054ee2 [weak]
- MD5Sum:439ae5cfb5a4584eeaec01f13f2acc63 [weak]
Release file created at: Thu, 15 Mar 2018 11:31:06 +0000
E: Failed to fetch https://apt.repos.intel.com/mkl/dists/all/main/binary-all/Packages.gz
E: Some index files failed to download. They have been ignored, or old ones used instead.

It worked multiple times on Sunday, but that was still 2018.2, and it worked once today for 2018.3, but failed about 5 times today already. It appears as if one mirror is ok and another is in a broken state. Can anyone confirm this? Any ideas how to resolve this?

Thanks and best regards,

Jonathan

Hi Jonathan,

Ying_H_Intel — Thu, 31 May 2018 02:51:09 GMT

Hi Jonathan,

Thank you for your report. I will escalate to the deployment team and see if they have any suggestion.
I guess, as we are deploying MKL 2018 u3 recently (the MKL 2018 u3 was done in APT 2 days ago), which may bring unstable status of the servers.

Best Regards,
Ying

I am also experiencing this

Simpson__Adam — Thu, 31 May 2018 19:31:14 GMT

I am also experiencing this issue on Ubuntu/16.04.

I believe that https://apt.repos.intel.com/mkl/dists/all/InRelease has the wrong file size(and hashes) for the index file "main/binary-amd64/Packages". Perhaps this wasn't updated when the repo got updated for MKL 2018 u3?

Any help fixing this would be much appreciated!

Thanks a lot, Ying!

JMart62 — Thu, 31 May 2018 20:16:17 GMT

Thanks a lot, Ying!

Just to keep you updated and help with the bug hunt: Today, I got the same error with a different IP address (see below).

Best,

Jonathan

Err:20 https://apt.repos.intel.com/mpi all/main all Packages
File has unexpected size (1251 != 791). Mirror sync in progress? [IP: 95.100.64.47 443]
Hashes of expected file:
- Filesize:791 [weak]
- SHA512:6aaecc1992db6f76c9de16aafd840f00dc89da624d21049ba02cfd08456b5d1bd38264b9060944ad274fdacc34888cf7e4a74d060d08dba53926370e85fcd201
- SHA256:5459864e393a1b57efac83ccd402ce640ccc8f31349000cc119856eab32fd408
- SHA1:f0926bd401a45dc40f7e2d09f5e866ca694d518a [weak]
- MD5Sum:5dd7837d013b0f7b6e44f29acd520840 [weak]
Release file created at: Thu, 15 Mar 2018 10:46:54 +0000
Get:21 https://apt.repos.intel.com/mpi all/main amd64 Packages [1725 B]
Err:21 https://apt.repos.intel.com/mpi all/main amd64 Packages

Fetched 141 kB in 4s (32.1 kB/s)
Reading package lists... Done
W: Conflicting distribution: https://apt.repos.intel.com/intelpython binary/ InRelease (expected binary/ but got )
E: Failed to fetch https://apt.repos.intel.com/mpi/dists/all/main/binary-all/Packages.gz ; File has unexpected size (1251 != 791). Mirror sync in progress? [IP: 95.100.64.47 443]
Hashes of expected file:
- Filesize:791 [weak]
- SHA512:6aaecc1992db6f76c9de16aafd840f00dc89da624d21049ba02cfd08456b5d1bd38264b9060944ad274fdacc34888cf7e4a74d060d08dba53926370e85fcd201
- SHA256:5459864e393a1b57efac83ccd402ce640ccc8f31349000cc119856eab32fd408
- SHA1:f0926bd401a45dc40f7e2d09f5e866ca694d518a [weak]
- MD5Sum:5dd7837d013b0f7b6e44f29acd520840 [weak]
Release file created at: Thu, 15 Mar 2018 10:46:54 +0000
E: Failed to fetch https://apt.repos.intel.com/mpi/dists/all/main/binary-amd64/Packages.gz
E: Some index files failed to download. They have been ignored, or old ones used instead.

Hi Jonathan, Adam,

Ying_H_Intel — Mon, 04 Jun 2018 07:58:43 GMT

Hi Jonathan, Adam,

The problem was escalated to our repository administrator. They replied , thank you reports! they already purged caches for the files, the files should be accessible and downloadable. Please let me know if you have any result.

Best Regards,
Ying

I have the same problem on

Wink__Alle_Meije — Fri, 31 Aug 2018 08:22:29 GMT

I have the same problem on my Debian (stretch) system, getting a warning only from the intelpython repo.

In the file /etc/apt/sources.list.d/intelproducts.list I have

deb https://apt.repos.intel.com/intelpython binary/
deb https://apt.repos.intel.com/mkl all main
deb https://apt.repos.intel.com/ipp all main
deb https://apt.repos.intel.com/tbb all main
deb https://apt.repos.intel.com/daal all main
deb https://apt.repos.intel.com/mpi all main

and after each apt update I get the warning

W: Conflicting distribution: https://apt.repos.intel.com/intelpython binary/ InRelease (expected binary/ but got )

Is it possible to fix the warning?

Thanks!

Hi,

chat__pil — Wed, 12 Sep 2018 14:15:56 GMT

Hi,

I am still experiencing the same problem as Jonathan. Please fix this soon.

Thanks in advance

I have the same problem on my

Kopylov__Yevhen — Wed, 12 Sep 2018 15:41:10 GMT

I have the same problem on my Ubuntu 16.04.4 E: Failed to fetch https://apt.repos.intel.com/mkl/dists/all/main/binary-amd64/Packages ; Writing more data than expected (241534 > 239155)

I am having problems to, i.e.

Nottingham__Chris — Wed, 12 Sep 2018 22:38:00 GMT

I am having problems to, i.e.,

wget https://apt.repos.intel.com/intel-gpg-keys/GPG-PUB-KEY-INTEL-SW-PRODUCTS-2019.PUB
sudo apt-key add GPG-PUB-KEY-INTEL-SW-PRODUCTS-2019.PUB
sudo sh -c 'echo deb https://apt.repos.intel.com/mkl all main > /etc/apt/sources.list.d/intel-mkl.list'
sudo apt-get update

Hit:1 http://nz.archive.ubuntu.com/ubuntu bionic InRelease
Hit:2 http://nz.archive.ubuntu.com/ubuntu bionic-updates InRelease            
Hit:3 http://nz.archive.ubuntu.com/ubuntu bionic-backports InRelease          
Get:4 https://apt.repos.intel.com/mkl all InRelease [4,422 B]                 
Get:5 https://apt.repos.intel.com/mkl all/main i386 Packages [16.8 kB]        
Err:5 https://apt.repos.intel.com/mkl all/main i386 Packages
  File has unexpected size (18205 != 16822). Mirror sync in progress? [IP: 184.27.92.21 443]

  Hashes of expected file:
   - Filesize:16822 [weak]
   - SHA512:fc0747fbdbf998b6acfd02847f0439c5704ac74371b0551a3d7dda93a33922b65a0f1c00cc4a7b7ec530e3cb238fc05cb61ccefe3f18da314e1556f72ba4b790
   - SHA256:26e462b4fa2ee9c6600b8681d0a0524d32a6c16d0d7eefa039ddc72054310132
   - SHA1:c341b78c41120b141bb37d34eb295709290f4dcd [weak]
   - MD5Sum:843f99b2d39625e02a4e08ae525400d2 [weak]
  Release file created at: Tue, 15 May 2018 15:47:25 +0000

Hit:6 http://security.ubuntu.com/ubuntu bionic-security InRelease
Get:7 https://apt.repos.intel.com/mkl all/main all Packages [12.6 kB]         
Err:7 https://apt.repos.intel.com/mkl all/main all Packages                   
Get:8 https://apt.repos.intel.com/mkl all/main amd64 Packages [36.6 kB]       
Err:8 https://apt.repos.intel.com/mkl all/main amd64 Packages
Fetched 4,422 B in 1s (5,648 B/s)
Reading package lists... Done

E: Failed to fetch https://apt.repos.intel.com/mkl/dists/all/main/binary-i386/Packages.bz2  File has unexpected size (18205 != 16822). Mirror sync in progress? [IP: 184.27.92.21 443]
   Hashes of expected file:
    - Filesize:16822 [weak]
    - SHA512:fc0747fbdbf998b6acfd02847f0439c5704ac74371b0551a3d7dda93a33922b65a0f1c00cc4a7b7ec530e3cb238fc05cb61ccefe3f18da314e1556f72ba4b790
    - SHA256:26e462b4fa2ee9c6600b8681d0a0524d32a6c16d0d7eefa039ddc72054310132
    - SHA1:c341b78c41120b141bb37d34eb295709290f4dcd [weak]
    - MD5Sum:843f99b2d39625e02a4e08ae525400d2 [weak]
   Release file created at: Tue, 15 May 2018 15:47:25 +0000
E: Failed to fetch https://apt.repos.intel.com/mkl/dists/all/main/binary-all/Packages.bz2 
E: Failed to fetch https://apt.repos.intel.com/mkl/dists/all/main/binary-amd64/Packages.bz2 
E: Some index files failed to download. They have been ignored, or old ones used instead.

chris@chris-desktop:~$ sudo apt-get install intel-mkl-2019.0-045
Reading package lists... Done
Building dependency tree      
Reading state information... Done
E: Unable to locate package intel-mkl-2019.0-045
E: Couldn't find any package by glob 'intel-mkl-2019.0-045'
E: Couldn't find any package by regex 'intel-mkl-2019.0-045'

Note, issues occurring on both 16.04 and 18.04

Hello, I can also confirm

degraca__arom — Thu, 13 Sep 2018 00:41:00 GMT

Hello, I can also confirm that I'm experiencing this problem as well. I use mkl to within docker and in order for my unit tests to be run with travis and appveyor I install mkl via apt.

Please notice Err 21 and Err 23 in the screen shot.

I would also like to add that the problem seems upstream because I can't even see mkl in the apt-cache as a result of:

apt-cache search mkl

Please fix this promptly, I'm using mkl for my undergraduate senior thesis and until the upstream is fix my build is quite hacky.

(Edit) In order to cleanly demonstrate the problem, Here is a Dockerfile which cleanly demonstrates the problem.

#DOCKER FILE BEGIN

#
# Ubuntu Dockerfile
#
# https://github.com/dockerfile/ubuntu
#

# Pull base image.
FROM ubuntu:18.04

# Install.
RUN \
sed -i 's/# $.*multiverse$$/\1/g' /etc/apt/sources.list && \
apt-get update && \
apt-get -y upgrade && \
apt-get install -y build-essential && \
apt-get install -y software-properties-common && \
apt-get install -y byobu curl wget && \
#mkl install begins here
wget https://apt.repos.intel.com/intel-gpg-keys/GPG-PUB-KEY-INTEL-SW-PRODUCTS-2019.PUB && \
apt-key add GPG-PUB-KEY-INTEL-SW-PRODUCTS-2019.PUB && \
sh -c 'echo deb https://apt.repos.intel.com/mkl all main > /etc/apt/sources.list.d/intel-mkl.list' && \
apt-get -y update && \
#mkl install ends here
rm -rf /var/lib/apt/lists/*

# Add files.
ADD root/.bashrc /root/.bashrc
ADD root/.gitconfig /root/.gitconfig
ADD root/.scripts /root/.scripts

# Set environment variables.
ENV HOME /root

# Define working directory.
WORKDIR /root

# Define default command.
CMD ["bash"]

#DOCKER FILE END

Dear Chirs and Arom,

Ying_H_Intel — Thu, 13 Sep 2018 05:36:30 GMT

Dear Chirs and Arom,

Thank you everyone for the report. we escalate the issue to our install team. we suppose to fix it as soon as possible and update you if any news.

Thanks
Ying

Dear All,

Ying_H_Intel — Mon, 17 Sep 2018 05:37:44 GMT

Dear All,

Our internal support team fix the problem. there is a issue in our deploy system. it should be no more problems in future.

Thank you much for the report!

Best Regards,

Ying

Re: Dear All,

Wilkes__Chris — Thu, 22 Apr 2021 01:35:25 GMT

I'm experiencing a similar problem right now:

https://community.intel.com/t5/Intel-oneAPI-HPC-Toolkit/Errors-when-trying-to-use-Intel-MPI-yum-apt-repos/m-p/1275505/highlight/false#M8134

Re: Dear All,

Loller96 — Thu, 30 Sep 2021 12:52:32 GMT

Hi, I face the same issue right now:

Err:7 https://apt.repos.intel.com/oneapi all/main amd64 Packages
File has unexpected size (97059 != 123241). Mirror sync in progress? [IP: 23.9.11.90 443]
Hashes of expected file:
  - Filesize:123241 [weak]
  - SHA512:ce504506c37bdca5151d49d299ff15e33deebcbece068139f699d1f7a6e25bae873b10bd177f823e9fb357ac9d18a4cd0dce6be254567418a1f0aed5b356382c
  - SHA256:b4d3fa20a44464bc978fa6f49cfd7c6aa30635972468ea383bf2e79d6107485d
  - SHA1:7fea77a5124d63b2c836c384bb5f59a05cc46072 [weak]
  - MD5Sum:858168f2c4ce6460d683c63b33501304 [weak]
Release file created at: Wed, 29 Sep 2021 08:17:36 +0000
Fetched 354 kB in 1s (415 kB/s)
Reading package lists...
E: Failed to fetch https://apt.repos.intel.com/oneapi/dists/all/main/binary-amd64/Packages.gz File has unexpected size (97059 != 123241). Mirror sync
in progress? [IP: 23.9.11.90 443]
  Hashes of expected file:
   - Filesize:123241 [weak]
   - SHA512:ce504506c37bdca5151d49d299ff15e33deebcbece068139f699d1f7a6e25bae873b10bd177f823e9fb357ac9d18a4cd0dce6be254567418a1f0aed5b356382c
   - SHA256:b4d3fa20a44464bc978fa6f49cfd7c6aa30635972468ea383bf2e79d6107485d
   - SHA1:7fea77a5124d63b2c836c384bb5f59a05cc46072 [weak]
   - MD5Sum:858168f2c4ce6460d683c63b33501304 [weak]
  Release file created at: Wed, 29 Sep 2021 08:17:36 +0000