Page MenuHomeSoftware Heritage

swh-docker-dev CI build - broken since build #569 - 404 not found for psql apt repo
Closed, MigratedEdits Locked

Description

here's a recent failed build log

that's a weird one, the failure is:

Err:10 http://apt.postgresql.org/pub/repos/apt -pgdg/main amd64 Packages
  404  Not Found [IP: 217.196.149.55 80]
Fetched 7931 kB in 1s (6260 kB/s)
Reading package lists...
W: The repository 'http://apt.postgresql.org/pub/repos/apt -pgdg Release' does not have a Release file.
E: Failed to fetch http://apt.postgresql.org/pub/repos/apt/dists/-pgdg/main/binary-amd64/Packages  404  Not Found [IP: 217.196.149.55 80]
E: Some index files failed to download. They have been ignored, or old ones used instead.

looks like a malformed sources.list line, note the dists/-pgdg/main/ path aprt

Event Timeline

zack triaged this task as High priority.Sep 27 2020, 11:10 AM
zack created this task.

It seems the python 3.7 images on the jenkins master is quite old :

root@thyssen:~# docker images | grep python
python                     3.7                  a4cc999cf2aa        16 months ago       929MB

root@thyssen:~# docker run -ti --rm --entrypoint bash  python:3.7
root@f4a0db163208:/# cat /etc/os-release
PRETTY_NAME="Debian GNU/Linux 9 (stretch)"
NAME="Debian GNU/Linux"
VERSION_ID="9"
VERSION="9 (stretch)"
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"

This old image is based on debian 9 instead of debian 10 on the recent versions :

✗ docker images | grep python
python                     3.7                 11c6e5fd966a        2 weeks ago         876MB

➜  puppet-environment git:(vagrant) ✗ docker run -ti --entrypoint bash --rm  python:3.7
root@598ba0616781:/# cat /etc/os-release 
PRETTY_NAME="Debian GNU/Linux 10 (buster)"
NAME="Debian GNU/Linux"
VERSION_ID="10"
VERSION="10 (buster)"
VERSION_CODENAME=buster
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"

To fix the build, I saved the current version just in case and refreshed the image :

root@thyssen:~# docker tag python:3.7 python:3.7-T2644
root@thyssen:~# docker pull python:3.7
3.7: Pulling from library/python
57df1a1f1ad8: Pull complete 
71e126169501: Pull complete 
1af28a55c3f3: Pull complete 
03f1c9932170: Pull complete 
65b3db15f518: Pull complete 
3e3b8947ed83: Pull complete 
38d9e7938097: Pull complete 
724043f425e0: Pull complete 
6cf90f3f5863: Pull complete 
Digest: sha256:5b430fe2263d891ce94145fdc320fe2a88336cc127301637625d6e5fe37bef60
Status: Downloaded newer image for python:3.7
docker.io/library/python:3.7

root@thyssen:~# docker images | grep python
python                     3.7                  11c6e5fd966a        2 weeks ago         876MB
python                     3.7-T2644            a4cc999cf2aa        16 months ago       929MB

The build of the image is ok (the tests are still in progress at the moment) : https://jenkins.softwareheritage.org/view/all/job/swh-docker-dev/572/console

We should discuss if the --pull option should be added to the build command to refresh the underlying images.

I have added the `--pull` option in the job configuration so the python image will always be pulled (if needed) during the build :

+ docker build --pull --build-arg=CASS_DRIVER_NO_CYTHON=1 --no-cache -t swh/stack .
Sending build context to Docker daemon  122.3MB

Step 1/13 : FROM python:3.7
3.7: Pulling from library/python
Digest: sha256:5b430fe2263d891ce94145fdc320fe2a88336cc127301637625d6e5fe37bef60
Status: Image is up to date for python:3.7
 ---> 11c6e5fd966a