Wikimedia Release Engineering Team/Checkin archive/20161114

= 2016-11-14 =

Vacations/Important dates
How to do it: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off
 * November 18: Greg in Seattle at RELENG Conference/workshop - http://releng.polymtl.ca/RELENG2016/html/index.html
 * November 24+25: US Holiday (Thanksgiving)
 * Nov 30: Tyler: eye appointment 1:45pm -- may be useless afterwords
 * December 26: Željko Holiday (St Stephen's Day)
 * December 26-30: XMas Holiday
 * January 2nd: New Year's Day (observed)
 * January 6: Željko Holiday (Epiphany)
 * January 9-11: Dev Summit
 * January 12-13: All Hands
 * January 16: MLK Jr Day
 * February 20: President's Day
 * March 13: New day off for some reason
 * April 14: New day off for some reason

Time spent spreadsheet

 * week 45: https://docs.google.com/spreadsheets/d/1YMflnOBggixLV-Ra0L6P7vxgUkR6sFik6Aas1y3Zsxg/edit#gid=119979618

Rotating positions and absences
Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers

Oct 31 and Nov 7

 * Train: Mukunda
 * wmf.1
 * Tues:Tyler, Wed/Thurs:Mukunda
 * wmf.2
 * just Mukunda
 * SoS: Dan
 * https://phabricator.wikimedia.org/E155/29
 * https://phabricator.wikimedia.org/E155/30
 * Out:
 * October 31: Mukunda + Antoine
 * November 1: Antoine (France holiday: all-saints)
 * November 4: Mukunda
 * November 11: Antoine

Nov 14 and Nov 21

 * Train: Tyler
 * wmf.3
 * no wmf.4 this week, Thanksgiving
 * SoS: Mukunda
 * https://phabricator.wikimedia.org/E155/34
 * https://phabricator.wikimedia.org/E155/35
 * Out:
 * November 18: Greg in Seattle at RELENG Conference/workshop - http://releng.polymtl.ca/RELENG2016/html/index.html
 * November 24+25: US Holiday (Thanksgiving)

Nov 28 and Dec 5

 * Train:
 * [ wmf.4]
 * [ wmf.5]
 * SoS:
 * https://phabricator.wikimedia.org/E155/33
 * https://phabricator.wikimedia.org/E155/34
 * Out:
 * none

Dec 12 and Dec 19

 * Train:
 * [ wmf.6]
 * no train/deploys week of Dec 19
 * SoS:
 * https://phabricator.wikimedia.org/E155/35
 * https://phabricator.wikimedia.org/E155/36
 * Out:
 * none?

Dec 26 and Jan 2

 * Train:
 * No train/deploys week of Dec 26
 * [ wmf.7]
 * SoS:
 * https://phabricator.wikimedia.org/E155/37
 * https://phabricator.wikimedia.org/E155/38
 * Out:
 * Week of Dec 26th: Everyone
 * Jan 2nd: New Year's Day observed

Actions from last meeting

 * [Who?] Audit if any other projects than MW+Ext use gating
 * greg to make a task, assign to Dan
 * See https://gerrit.wikimedia.org/r/#/c/320191/1/zuul/parameter_functions.py + mediawiki/core + mediawiki/vendor
 * https://phabricator.wikimedia.org/T150701
 * Greg needs to make a timeline for some of the action items

Scrum of Scrums

 * https://phabricator.wikimedia.org/project/board/64/
 * Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

This week

 * Blocking
 * Blocked
 * Updates
 * 1.28 rc.1 this week (for realz)
 * scap 3.3.1 to go out (already on Beta Cluster)
 * Phabricator update this week (Wednesday) with Calendar improvements (in support of DevSummit)
 * scap 3.3.1 to go out (already on Beta Cluster)
 * Phabricator update this week (Wednesday) with Calendar improvements (in support of DevSummit)

Last week

 * Blocking
 * Blocked
 * Updates
 * 1.28 rc.1 today
 * Help squash boogz! https://phabricator.wikimedia.org/project/board/1982/
 * 1.28 rc.1 today
 * Help squash boogz! https://phabricator.wikimedia.org/project/board/1982/

QA Hire

 * I'm screening people/doing my interview with some this week

Offsite

 * Follow-ups / EVERYTHING
 * Greg needs to make a timeline for some of the action items

Future of CI plan

 * Determine future composition of the CI infrastructure with a plan on how to get there without disrupting expected services and performance.


 * Emailed Mark/Faidon/Brandon, hopefully setting up first meeting soon (haven't heard back by 5:15pm on Thursday before Veteran's Day)
 * Shared these two docs with them:
 * Triangles by Dan: https://docs.google.com/drawings/d/1oRq9B_W_5dkjxmTHFzGpKz5M3R_7ta3907gb1uKNerw/edit
 * CI/CD Workflow: https://docs.google.com/drawings/d/1z7njKQ4QpZenslE9xXr5V9qHM-rbOneT_6L_Gt3utr8/edit


 * Created CI Docker experimentation tasks
 * Spike/tracking task https://phabricator.wikimedia.org/T150501
 * CI slave https://phabricator.wikimedia.org/T150502
 * https://gerrit.wikimedia.org/r/#/c/320942/

Use a unified git repo for MW deploys

 * https://phabricator.wikimedia.org/D429

Stretch goal: Replace rsync with git syncing
Nope. not this quarter.

Release MediaWiki 1.28

 * 1.28rc.1 this week

Browser tests

 * Mostly finished with documentation (need to read everything one more time)
 * Working on non-trivial code examples (Ruby, Node.js)
 * Need help with Ruby+RSpec (Decided to drop RSpec)

Last Week

 * Possible deploy this week (for calendar updates)
 * Didn't happen
 * dzahn proposed patch for git-ssh for phab2001 last week
 * after that it's config repo cluster support
 * then we could offload some deamon work to phab2001 (even when it isn't doing web requests)
 * Mukunda to look at ES comment from Evan? (I missed exactly)
 * First meeting of the phabricator user group
 * Dropbox and Twitter
 * https://paper.dropbox.com/doc/Phabricator-Meetup-csvC4rqQ0vSGF7LhO3Ebr

This week

 * Phab deploy will happen this week
 * Deploying lots of calendar updates along with a lot of other little things
 * https://secure.phabricator.com/w/changelog/2016.46/
 * https://phabricator.wikimedia.org/project/profile/2257/

DB Inconsistencies
https://phabricator.wikimedia.org/T132416 and https://phabricator.wikimedia.org/T104459 (see also: https://www.mediawiki.org/wiki/Development_policy#Database_patches )

Last week

 * More jobs to Nodepool
 * gallium aftermaths
 * polished up Jenkins security

This week

 * Ploticus/EasyTimeline log spam + font not showing on ZH wiki
 * Nodepool quota bump to happen (hopefully) + move PHP jobs to it
 * Jenkins 2.x testing??
 * Assist Docker experiment
 * Clone mw/core for the job running against operations/mediawiki-config (for dcausse/Erik B)

Last week

 * Security mess

This week

 * More security mess
 * rc.1

Last week

 * Continue hacking on proof of concept integration/docker instance(?)
 * Improve scap rollback behavior (failure tolerance and first-class finalize stage)

This week

 * Continue hacking on proof of concept integration/docker instance(?)
 * Improve scap target failure tolerance

Last week

 * Maybe? push a phabricator update this week - calendar has been progressing upstream, looks like a good time to deploy it.
 * Didn't happen
 * 1.29.0-wmf.2
 * Look into running elasticsearch + innodb fulltext search in parallel
 * Need to confirm that we can keep both indexes updated
 * phabricator user group meeting (4 hours long!)
 * Learned a LOT about how Dropbox and Twitter do CI with harbormaster
 * Dropbox's setup is really nice
 * https://paper.dropbox.com/doc/Phabricator-Meetup-csvC4rqQ0vSGF7LhO3Ebr

This week

 * Definitely phab update this week

Last week

 * New scap release, 3.3.1
 * Possibly 3.3.2?
 * Scap bugfixes

This week

 * Scap 3.3.1-1 out the door
 * Train
 * assemble 3.4.0

Last week

 * T108108 Improve documentation around running/writing (with lots of examples) browser tests
 * T149319 mediawiki_selenium integration test fails: Unable to find Mozilla geckodriver.
 * pairing with Rummana on Node.js+Selenium tests for VisualEditor
 * pairing with Elena on Ruby+Rspec tests for Echo API

This week

 * T108108 Improve documentation around running/writing (with lots of examples) browser tests
 * pairing with Rummana on Node.js+Selenium tests for VisualEditor
 * pairing with Elena on Ruby+Rspec tests for Echo API
 * Senior QA Analyst hiring