Wikimedia Release Engineering Team/Checkin archive/20161107

Developed by Adriana Venter

Adriana Media Inc.DigiNet DigiServ rianav@live.com Copyright Java Github developer.

= 2016-11-7 =

Vacations/Important dates
How to do it: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off
 * Friday Nov 11th: US+France - Veterans day/Armistice day
 * November 18: Greg in Seattle at RELENG Conference/workshop - http://releng.polymtl.ca/RELENG2016/html/index.html
 * November 24+25: US Holiday (Thanksgiving)
 * December 26-30: XMas Holiday
 * January 2nd: New Year's Day (observed)
 * January 9-11: Dev Summit
 * January 12-13: All Hands
 * January 16: MLK Jr Day
 * February 20: President's Day
 * March 13: New day off for some reason
 * April 14: New day off for some reason

Time spent spreadsheet

 * week 44: https://docs.google.com/spreadsheets/d/1YMflnOBggixLV-Ra0L6P7vxgUkR6sFik6Aas1y3Zsxg/edit#gid=2101326447

Rotating positions and absences
Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers

Oct 17 and Oct 24

 * Train: Chad+Mukunda splitting
 * no train week of Oct 17
 * wmf.23
 * Chad on Tuesday, Mukunda on Wednesday/Thursday
 * SoS: Tyler
 * https://phabricator.wikimedia.org/E155/27
 * https://phabricator.wikimedia.org/E155/28

Oct 31 and Nov 7

 * Train: Mukunda
 * wmf.1
 * Tues:Tyler, Wed/Thurs:Mukunda
 * wmf.2
 * just Mukunda
 * SoS: Dan
 * https://phabricator.wikimedia.org/E155/29
 * https://phabricator.wikimedia.org/E155/30
 * Out:
 * October 31: Mukunda + Antoine
 * November 1: Antoine (France holiday: all-saints)
 * November 4: Mukunda
 * November 11: Antoine

Nov 14 and Nov 21

 * Train: Tyler
 * [ wmf.3]
 * no wmf.4 this week, Thanksgiving
 * SoS: Mukunda
 * https://phabricator.wikimedia.org/E155/31
 * https://phabricator.wikimedia.org/E155/32
 * Out:
 * November 18: Greg in Seattle at RELENG Conference/workshop - http://releng.polymtl.ca/RELENG2016/html/index.html
 * November 24+25: US Holiday (Thanksgiving)

Actions from last meeting

 * [Who?] Audit if any other projects than MW+Ext use gating
 * greg to make a task, assign to Dan
 * See https://gerrit.wikimedia.org/r/#/c/320191/1/zuul/parameter_functions.py + mediawiki/core + mediawiki/vendor

Scrum of Scrums

 * https://phabricator.wikimedia.org/project/board/64/
 * Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

This week

 * Blocking
 * Blocked
 * Updates
 * 1.28 rc.1 today
 * Help squash boogz! https://phabricator.wikimedia.org/project/board/1982/
 * 1.28 rc.1 today
 * Help squash boogz! https://phabricator.wikimedia.org/project/board/1982/

Last week

 * Blocking
 * Blocked
 * Updates
 * FYI, MW 1.28 release is happening https://lists.wikimedia.org/pipermail/wikitech-l/2016-October/086859.html
 * CI downtime on Thursday https://lists.wikimedia.org/pipermail/wikitech-l/2016-October/086882.html
 * FYI, MW 1.28 release is happening https://lists.wikimedia.org/pipermail/wikitech-l/2016-October/086859.html
 * CI downtime on Thursday https://lists.wikimedia.org/pipermail/wikitech-l/2016-October/086882.html

QA Hire

 * I'm screening people/doing my interview with some this week

Offsite

 * Follow-ups / EVERYTHING
 * Greg needs to make a timeline for some of the action items

Future of CI plan

 * Determine future composition of the CI infrastructure with a plan on how to get there without disrupting expected services and performance.


 * Greg to do what he just said (talk to mark, faidon, and brandon)
 * Nice cost triangle from Dan: https://docs.google.com/drawings/d/1oRq9B_W_5dkjxmTHFzGpKz5M3R_7ta3907gb1uKNerw/edit?ts=58193145

Use a unified git repo for MW deploys

 * figure out timeline re what we can do before 3.4 (hopefully before thanksgiving)

Release MediaWiki 1.28
TODO:
 * Sync up with Darian re security release out prior to general release
 * one last 1.26 before EOL
 * Chad to do this week

Browser tests

 * continuing work on documentation (T108108)
 * reviewing/merging a few patches in Gerrit
 * https://gerrit.wikimedia.org/r/#/c/318305/ Avoid endless recursion when environments.yml is missing
 * https://gerrit.wikimedia.org/r/#/c/314676/ test: raise_error should have an explicit message
 * https://gerrit.wikimedia.org/r/#/c/304332/ 1.7.3: Add API log level to environment settings
 * https://gerrit.wikimedia.org/r/#/c/304331/ 0.7.1: Increase log verbosity
 * pairing with Rummana on Node.js+Selenium tests for VisualEditor

Phabricator

 * Possible deploy this week (for calendar updates)
 * dzahn proposed patch for git-ssh for phab2001 last week
 * after that it's config repo cluster support
 * then we could offload some deamon work to phab2001 (even when it isn't doing web requests)
 * Mukunda to look at ES comment from Evan? (I missed exactly)

DB Inconsistencies
https://phabricator.wikimedia.org/T132416 and https://phabricator.wikimedia.org/T104459 (see also: https://www.mediawiki.org/wiki/Development_policy#Database_patches )

Last week

 * Migrated more jobs to Nodepool
 * contint1001 migrated (with Tyler and Daniel Zahn)

This week

 * More jobs to Nodepool
 * gallium aftermaths

Last week

 * dancing and lounging

Last week

 * Work on QA "checkpoint" costs diagrams
 * Show verification logic for unit/integration/end-to-end tests, etc.
 * Represent computational and human costs associated with (re)testing feedback along the pipeline stages
 * Continue hacking on proof of concept integration/docker instance(?)
 * Help with blocking scap changes or wishlist items

This week

 * Continue hacking on proof of concept integration/docker instance(?)
 * Improve scap rollback behavior (failure tolerance and first-class finalize stage)

Last week

 * Mostly vacation + a bit of work on scap3
 * Train duties for 1.29.0-wmf.1

This week

 * Maybe? push a phabricator update this week - calendar has been progressing upstream, looks like a good time to deploy it.
 * 1.29.0-wmf.2
 * Look into running elasticsearch + innodb fulltext search in parallel
 * Need to confirm that we can keep both indexes updated

Last week

 * 1_28
 * CI switch
 * ❌ scap 3.3.1

This week

 * New scap release, 3.3.1
 * Possibly 3.3.2?
 * Scap bugfixes

Last week

 * Catching up
 * T108108 Improve documentation around running/writing (with lots of examples) browser tests
 * pairing with Rummana on Node.js+Selenium tests for VisualEditor
 * pairing with Elena on Ruby+Rspec tests for Echo API
 * Senior QA Analyst hiring

This week

 * T108108 Improve documentation around running/writing (with lots of examples) browser tests
 * T149319 mediawiki_selenium integration test fails: Unable to find Mozilla geckodriver.
 * pairing with Rummana on Node.js+Selenium tests for VisualEditor
 * pairing with Elena on Ruby+Rspec tests for Echo API
 * Senior QA Analyst hiring