Wikimedia Release Engineering Team/Deployment pipeline/2018-07-05

= 2018-07-05 =

Last Time

 * 2018-06-07

General

 * First meeting of 2018/2019-Q1

RelEng

 * Been working on integration/pipelinelib
 * Shared Groovy library
 * Move logic from buried in integration/config jjb -> shared library loaded as part of the job


 * Test-only portion of pipeline
 * For things not being deployed, frex: pipelinelib
 * Might help evangelize pipeline a bit


 * 2018/2019 - Q1
 * 2018-2019: Moving *all* services
 * Move verify stage from Minikube to CI k8s namespace in production context
 * TODO list (pulled from deploy1001) -- some are done; some don't need done; some have important pieces missing (probably); some are probably no longer used
 * 3d2png/deploy
 * mobileapps/deploy
 * iegreview/iegreview
 * relforge/mjolnir
 * dumps/dumps
 * debmonitor/deploy
 * restbase/deploy
 * citoid/deploy
 * docker-pkg/deploy
 * wdqs/wdqs
 * netbox/deploy
 * servermon/servermon
 * cp-jobqueue/cp-jobqueue
 * wikimedia/discovery/analytics
 * scholarships/scholarships
 * puppetboard/deploy
 * prometheus/jmx_exporter
 * prometheus/jmx_exporter
 * eventlogging/eventbus
 * eventlogging/analytics
 * librenms/librenms
 * graphoid/deploy
 * jobrunner/jobrunner
 * cxserver/deploy
 * gerrit/gerrit
 * cpjobqueue/deploy
 * striker/deploy
 * zotero/translation-server
 * zotero/translators
 * ores/deploy
 * electron-render/deploy
 * search/mjolnir/deploy
 * parsoid/deploy
 * changeprop/deploy
 * recommendation-api/deploy
 * horizon/deploy
 * performance/coal
 * performance/navtiming
 * eventstreams/deploy
 * trending-edits/deploy
 * phabricator/deployment
 * proton/deploy
 * statsv/statsv
 * analytics/turnilo/deploy
 * analytics/refinery
 * analytics/aqs/deploy
 * analytics/superset/deploy
 * analytics/pivot/deploy
 * ✅ mathoid/deploy
 * cassandra/logstash-logback-encoder
 * cassandra/metrics-collector
 * cassandra/twcs
 * logstash/plugins
 * jobrunner.old/jobrunner
 * tilerator/deploy
 * kartotherian/deploy

SREs

 * Upgrade of the staging cluster to 1.8.14 kubernetes done today
 * Upgrade of the production clusters to happen next week
 * Starting to look into kubernetes 1.9


 * Starting to look into https://github.com/roboll/helmfile, https://github.com/att-comdev/armada, https://github.com/Eneco/landscaper

Services
= As Always =
 * Release Pipeline Workboard
 * Meeting notes