Deployment tooling/Cabal/2016-05-16

Redefining Userkeys

 * We're currently blocking: https://phabricator.wikimedia.org/T132747
 * TODO followup ticket about betacluster cherry picks
 * TODO comment about why un-cherry-picked ORES patch on beta
 * Get beta working again :)

Solution proposal

 * Add key to ops/private
 * Remove key argument from scap::target
 * Don't allow consumers to specify key argument
 * Fail if consumer tries to provide key
 * use secret function for public and private key
 * need a way to get key fingerprint, use generate....

Random Things

 * New package deployed (thanks Filippo!)

Small puppet changes needing review (maybe puppetswat)

 * use subcommands everywhere in puppet
 * clean old binstubs – this one is slightly higher priority, at least on mw1017

List of Doom
Generated with: find /srv/deployment -type d -maxdepth 2 | sort | nl (and some vim massage)

If the list can be trusted:
 * 38 remaining
 * 11 done
 * 22% complete

Services to migrate:
 * 1) abacist/abacist
 * 2) ✅ analytics/aqs
 * 3) analytics/kraken
 * 4) analytics/refinery
 * 5) cassandra/logstash-logback-encoder
 * 6) cassandra/metrics-collector
 * 7) ✅ changeprop/deploy
 * 8) ✅ citoid/deploy
 * 9) ✅ cxserver/deploy
 * 10)  dropwizard/metrics
 * 11)  dumps/dumps
 * 12)  elasticsearch/plugins
 * 13)  ✅ eventlogging/analytics
 * 14)  ✅ eventlogging/eventbus
 * 15)  ??? eventlogging/eventlogging
 * 16)  fluoride/fluoride
 * 17)  gdash/gdash (deprecated)
 * 18)  grafana/grafana (deprecated, using debs now on krypton)
 * 19)  graphoid/deploy
 * 20)  iegreview/iegreview
 * 21)  integration/config
 * 22)  integration/kss
 * 23)  integration/mediawiki-tools-codesniffer
 * 24)  integration/php-coveralls
 * 25)  integration/phpcs
 * 26)  integration/phpunit
 * 27)  integration/slave-scripts
 * 28)  jobrunner/jobrunner
 * 29)  kartotherian/deploy
 * 30)  kibana/kibana
 * 31)  librenms/librenms [ops]
 * 32)  logstash/plugins
 * 33)  ✅ mathoid/deploy
 * 34)  ✅ mobileapps/deploy
 * 35)  ocg/ocg
 * 36)  parsoid/deploy
 * 37)  ✅ phabricator/deployment
 * 38)  rcstream/rcstream
 * 39)  restbase/deploy
 * 40)  scholarships/scholarships
 * 41)  sentry/sentry
 * 42)  servermon/servermon [ops]
 * 43)  statsv/statsv
 * 44)  tessera/tessera (deprecated)
 * 45)  tilerator/deploy
 * 46)  wdqs/wdqs
 * 47)  wikimedia/discovery
 * 48)  ✅ zotero/translation-server
 * 49)  ✅ zotero/translators

As Always

 * Phase 2
 * Phase 1
 * Workboard https://phabricator.wikimedia.org/tag/scap3/
 * Etherpad backed up to https://www.mediawiki.org/wiki/Deployment_tooling/Cabal
 * Future document https://www.mediawiki.org/wiki/Deployment_tooling/Future
 * Spreadsheet: https://docs.google.com/spreadsheets/d/1MlEsFxrLvdZdV_G82WEAIvBXr7ArO7nCEKaFClHhJEw/edit#gid=0