Wikimedia Release Engineering Team/Checkin archive/20170123

= 2017-01-23 =

Vacations/Important dates

 * https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
 * How to do it


 * Jan 26-27: Chad, maybe
 * February 20: President's Day
 * March 13: Monthly day off
 * April 14: Monthly day off

Time spent spreadsheet

 * week 3: https://docs.google.com/spreadsheets/d/1OZzvtlc116UIsFFbic1zX34LXgAJddPTXMGVE6uMsJw/edit#gid=255161607

Rotating positions and absences
Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers

Jan 23 and Jan 30

 * Train: Mukunda
 * wmf.9
 * wmf.10
 * SoS: Dan
 * Out:
 * Chad: 1/26-27, maybe

Feb 6 and Feb 13

 * Train: Tyler
 * wmf.11
 * wmf.12
 * SoS: Chad
 * Out:

Actions from last meeting

 * Greg: reply to martin

Scrum of Scrums

 * https://phabricator.wikimedia.org/project/board/64/
 * Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

This week

 * Blocking
 * Blocked
 * Updates
 * scap 3.5 planned for this week
 * Updates
 * scap 3.5 planned for this week

Last week

 * Blocking
 * Blocked
 * Updates
 * Train/deploys back to normal
 * Updates
 * Train/deploys back to normal

Volunteer deployers ?

 * Add more Volunteers? Is there any specific policy. Directed one at Greg.
 * https://wikitech.wikimedia.org/wiki/SWAT_deploys#New_SWAT_Team_member_check-list
 * Need trust, technical endorsement (eg approve kabal of deployers). Directed to Greg for questions.
 * Greg hasn't responded yet :/
 * TODO: Greg to email Martin

Mid-year check-in

 * Next week...

Quarterly Review

 * Friday at 8am... ugh. Greg'll go. No one else needs to.
 * https://docs.google.com/presentation/d/1V6H_ebe0WTQey4AsivgF7j7BrsEnX6ystKgSa7wO_eA/edit#slide=id.g1b66bc6307_0_90

Annual Planning

 * https://etherpad.wikimedia.org/p/releng-annual-intention-fy1718
 * From Marko: https://docs.google.com/a/wikimedia.org/document/d/1aa6uO9uqEhe5lNetmluIgBDh3JVAQ4GTbw-jOc-qu9M/edit?usp=sharing

Q3 goal/project check-in

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201617Q3

Continuous Integration Infrastructure modernization

 * Gather requirements for new CI system -


 * Tyler will schedule stalk people
 * Status?


 * Want a preliminary meeting with dan/hashar to get on same page before bringing in others (had a brief one with dan)
 * Tuesday 9am-9:30am pst?
 * ^ works for marko and giuseppe (other folks targetted for meeting); cuts it close for hashar
 * purpose: preliminary requirements, scope, initial POC targets
 * short: 30mins
 * There is a workboard now: https://phabricator.wikimedia.org/project/view/2453/
 * Just getting started

Build fanout support in scap3

 * https://phabricator.wikimedia.org/T121276

3.5.0 -- this week! On beta

MediaWiki

 * sync-dir and sync-file are now the same command
 * sync-dir is deprecated
 * l10n-purge is no longer a command
 * Flatten the deployment directory into a single git repository (prep for git sync)
 * /srv/mediawiki-staging is many git repos
 * /srv/medaiwiki is one git repo
 * Canaries now use explicit service for logstash_checker.py (checks fatals too)
 * old proxies and canaries (not in mw-installation) ignored
 * Fix for git-cache-info (sha1 regex)

Services/Scap3

 * (no message) -> (no justification)
 * Improved rollback behavior
 * all groups rolled back
 * per group and global failure limit
 * skip rollback where host failed due to ssh

General/Fun

 * optional fancy progress bar
 * improved cowsay compatibility for scap say

Phabricator

 * Re-evaluate and improve search functionality in Phabricator -


 * Making good progress on ElasticSearch query optimization. I have a working prototype and I hope to deploy that this week for testing.

Browser tests

 * T155640 selenium-Core Jenkins job failing
 * fixed
 * T155794 Browser test Jenkins videos are corrupt
 * low prio
 * T139740 Port Selenium tests from Ruby to Node.js
 * looked into credential storage libraries

Last week

 * rspec puppet polish up
 * run qunit/phpunit for MediaWiki release tarballs (WIP) https://integration.wikimedia.org/ci/job/mediawiki-releases/
 * + related mw ext fix
 * clean up of Gerrit changes

This week

 * contint2001
 * doc for rspec puppet
 * finish MediaWiki (tarball) releases test job https://integration.wikimedia.org/ci/job/mediawiki-releases/
 * get a bump of Nodepool pool

Last week
Train, multiversion cleanups, scap, gerrit

Last week
QA Interview prep (question, people), Incident Review, Wramp-up cont...

This week
Identify first pass interviewees and schedule interviews, build knowledge re CI now and future, build knowledge of current QA/Test processes.

Last week

 * Phabricator Phabricator Phabricator
 * Optimized Phabricator's ElasticSearch query builder.

This week

 * Deployment train, 1.29.0-wmf.9 / T154683
 * Deploy ~2 months worth of phabricator updates.

Last week

 * Scap 3.5.0
 * Setup some kind of requirements gather meeting for CI thangs.

This week

 * scap 3.5.0
 * Future of CI prep stuffs
 * Git fat deployment?
 * would like to poke at some puppet updates: scap/ci-staging

Last week

 * jet lag
 * T155640 selenium-Core Jenkins job failing
 * T155794 Browser test Jenkins videos are corrupt

This week

 * T139740 Port Selenium tests from Ruby to Node.js
 * T152963 Increase in failures caused by Saucelabs
 * T152432 Make it possible to execute tests as a specific (new) MediaWiki user on beta cluster