Wikimedia Release Engineering Team/Train development environment/2020-06-18

2020-06-18

As Always

• Meeting archive: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Train_development_environment
• Last Time: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Train_development_environment/2020-06-04

TODOS

•  Done TODO: Lars to create image for other to try
•  Done TODO: Jeena to demo packer
•  Done TODO: thcipriani to set next meeting
•  Done TODO: Mukunda investigate cloud-init
•  Done TODO: Mukunda + Lars to sync up on building a deployment server (puppet, etc.)
•  Done TODO: Mukunda cloudinit to run puppet on vmdb2 image
  • Got cloud-init working with liw's base image (after adding the cloud-init package) and also using debian official image for openstack: https://cloud.debian.org/images/cloud/OpenStack/current-10/
•  Done TODO: Mukunda + Lars pairing
• TODO: Brennen to test Windows if possible

Notes

• CloudInit
  • Needs to be pre-packaged in that image
  • There are standard Debian images for this already
  • https://gerrit.wikimedia.org/g/mediawiki/tools/train-dev/
  • Did some work on getting puppet to run, but there are many fiddly details

• Puppet
  • Lars bought a book on puppet
  • Our production puppet code-base is large and complicated
  • Can run puppet-apply in the VM after overriding defaults
    • realm.pp in the maniphest directory https://gerrit.wikimedia.org/r/plugins/gitiles/operations/puppet/+/production/manifests/realm.pp

• Config Management Options
  • Mukunda saves us
  • SRE saves us
  • We do something different
  • We could do something akin to mediawiki-vagrant: equivalent, but different
  • Would like to use a shim with ops puppet

• Subteams
  • Puppet team to setup deployment-server-like VM
  • VM team setup a deploymet-server-like
    • GOAL: Run all the Tuesday steps of train without external access
    • Get a list of packages on the deployment server from deployment-deploy01.deployment-prep.eqiad.wmflabs:

   sudo cat /var/lib/puppet/client_data/catalog/deployment-deploy01.deployment-prep.eqiad.wmflabs.json | jq -r '.resources|.[] | select(.type=="Package").title'

• TODO: Mukunda and Tyler to make puppet work or die trying
• TODO: demo vmdb2 w/cloudinit + scap prep
• TODO: lars to push WIP patch for train-dev
• TODO: jeena + brennen to try to get running vm from train-dev repo
  • GOAL: run scap-prep inside the image
  • STRETCHGOAL: scap patch
• TODO: tyler poke about ^ in 1:1s