Talk:Continuous integration/Docker

When I try the instructions for "Adjusting an image" with `docker-pkg update` in the releng/dev-images repo, I get:

❯ docker-pkg -c dockerfiles/config.yaml --info update --reason "Add php-ast package (T246386)" --version 0.1.0 stretch-php72 dockerfiles/

== Step 0: scanning {d}

2020-04-13 15:59:37,143 [docker-pkg-build] INFO - Processing the dockerfile template in /home/kostajh/src/releng/dev-images/dockerfiles/eventlogging (builder.py:240)

2020-04-13 15:59:37,321 [docker-pkg-build] INFO - Processing the dockerfile template in /home/kostajh/src/releng/dev-images/dockerfiles/stretch-php72-fpm-apache2-blubber (builder.py:240)

2020-04-13 15:59:37,335 [docker-pkg-build] INFO - Processing the dockerfile template in /home/kostajh/src/releng/dev-images/dockerfiles/restbase (builder.py:240)

2020-04-13 15:59:37,348 [docker-pkg-build] INFO - Processing the dockerfile template in /home/kostajh/src/releng/dev-images/dockerfiles/stretch-php72-fpm-apache2-xdebug (builder.py:240)

2020-04-13 15:59:37,541 [docker-pkg-build] INFO - Processing the dockerfile template in /home/kostajh/src/releng/dev-images/dockerfiles/mediawiki-xdebug (builder.py:240)

2020-04-13 15:59:37,552 [docker-pkg-build] INFO - Processing the dockerfile template in /home/kostajh/src/releng/dev-images/dockerfiles/parsoid (builder.py:240)

2020-04-13 15:59:37,559 [docker-pkg-build] INFO - Processing the dockerfile template in /home/kostajh/src/releng/dev-images/dockerfiles/stretch-php72-webserver-xdebug (builder.py:240)

2020-04-13 15:59:37,562 [docker-pkg-build] INFO - Processing the dockerfile template in /home/kostajh/src/releng/dev-images/dockerfiles/stretch-php72-apache2 (builder.py:240)

2020-04-13 15:59:37,564 [docker-pkg-build] INFO - Processing the dockerfile template in /home/kostajh/src/releng/dev-images/dockerfiles/stretch-php72-fpm-apache2 (builder.py:240)

2020-04-13 15:59:37,737 [docker-pkg-build] INFO - Processing the dockerfile template in /home/kostajh/src/releng/dev-images/dockerfiles/stretch-php72-webserver (builder.py:240)

2020-04-13 15:59:37,747 [docker-pkg-build] INFO - Processing the dockerfile template in /home/kostajh/src/releng/dev-images/dockerfiles/stretch-php72 (builder.py:240)

2020-04-13 15:59:37,935 [docker-pkg-build] INFO - Processing the dockerfile template in /home/kostajh/src/releng/dev-images/dockerfiles/stretch (builder.py:240)

Traceback (most recent call last):

  File "/home/kostajh/.local/bin/docker-pkg", line 8, in <module>

   sys.exit(main())

  File "/home/kostajh/.local/lib/python3.8/site-packages/docker_pkg/cli.py", line 139, in main

   update(application, args.reason, args.select, args.version)

  File "/home/kostajh/.local/lib/python3.8/site-packages/docker_pkg/cli.py", line 195, in update

   to_update = application.images_to_update()

  File "/home/kostajh/.local/lib/python3.8/site-packages/docker_pkg/builder.py", line 323, in images_to_update

   self._build_dependencies()

  File "/home/kostajh/.local/lib/python3.8/site-packages/docker_pkg/builder.py", line 317, in _build_dependencies

   raise RuntimeError(

RuntimeError: Image wikimedia-stretch (dependency of docker-registry.wikimedia.org/dev/stretch:0.0.2) not found

But I do have `wikimedia-stretch` on my host:

❯ docker image ls | grep wikimedia-stretch

docker-registry.wikimedia.org/wikimedia-stretch                       20200408            25434ebb7eee        4 days ago          56.2MB

docker-registry.wikimedia.org/wikimedia-stretch                       latest              25434ebb7eee        4 days ago          56.2MB

docker-registry.wikimedia.org/wikimedia-stretch                       <none>              4f955902919e        4 months ago        56.1MB

@Jdforrester (WMF) any ideas?

Huh. Not really; just tried that locally and it works fine.

This is the CI build system. It uses docker-registry.wikimedia.org/releng/ as the default prefix, so maybe that's an issue? But then, why would it work locally? Are you trying to revise wikimedia-stretch and use an unpublished version of that?

I was trying to add the php-ast package to stretch-php72 in the releng/dev-images repo. I assumed that the update command would then allow all the images which depend on that one to get updated. Am I misusing this command?

Yes. It doesn't work cross-repo; you have to make the changes in releng/dev-images, merge them, publish the images, and then re-build the images in that repo.

I wonder if https://gerrit.wikimedia.org/r/plugins/gitiles/releng/dev-images/+/master/dockerfiles/stretch/control#1 is the problem?

That should cascade through, though? The dev-images build starts from / not /releng? Or am I mis-remembering?