Wikimedia Release Engineering Team/Checkin archive/20160404

= 2016-04-04 =

Vacations/Important dates
How to do it: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off
 * March 28th - Antoine && Željko - local holiday (Easter Monday)
 * March 31st - April 3rd : Hackathon in Israel
 * April 1st - Q4 goals published
 * April 1st - FDC Annual Plan Narrative going to the FDC
 * April 11-15 - Antoine - vacation
 * April 14-15 - Željko - conference
 * May 2 - 6th - Reading Team offsite
 * May 6th Friday - Antoine
 * May 9-Mid June-ish?: Greg - paternity leave - exact dates TBD
 * May 16-July 4: Dan - paternity leave :D
 * Late May - draft Q1 (July 1st - Sept 30th) due
 * May 30: US HOLIDAY - Memorial Day
 * June 15-24: Chad - Vegas/EDC
 * June 22nd - 28th : Wikimania in Italy
 * July 1st - Q1 goals published
 * July 1st – Annual Plan, Budget, Risks Document and FAQ are posted
 * August: Antoine - France holiday - because french. :)
 * August 22-September 9: Dan - paternity leave part deux
 * January 2017 : Dev Summit + All Hands (presumably)

Train conductor
Week of ...
 * Jan 11 (wmf.10): Dan
 * Jan 18 (wmf.11) - : Dan
 * Jan 25 (wmf.11) - : Dan
 * Feb 01 (wmf.12) - : Antoine with Dan pairing
 * Feb 08 (wmf.13) - : Chad
 * Feb 15 (wmf.14) - : Antoine
 * Feb 22 (wmf.14) - : Chad
 * Feb 29 (wmf.15) - : Chad
 * Mar 07 (wmf.16) - : Mukunda
 * Mar 14 (wmf.17) - : Mukunda
 * Mar 21 (wmf.18) - : Tyler
 * Mar 28 (wmf.19) - : Tyler
 * Apr 04 (wmf.20) - : Dan
 * Apr 11 (wmf.21) - : Dan
 * Apr 18: Master datacenter switch
 * Apr 25 (wmf.22) - : Antoine(?)
 * May 2 (wmf.23) - : Antoine(?)
 * May 9 (wmf.24) - : Chad(?)
 * 1.28?

Maniphest query for these tasks: https://phabricator.wikimedia.org/u/blockers

Scrum of Scrums representative
(bad time for EU folks) Dan, Tyler, Chad, Mukunda Week of ...
 * Feb 08: Tyler
 * Feb 15: Dan
 * Feb 22: Tyler
 * Feb 29: Tyler
 * Mar 07: Chad
 * Mar 14: Chad
 * Mar 21: Mukunda
 * Mar 28: Mukunda
 * Apr 04: Tyler
 * Apr 11: Tyler
 * Apr 18: Dan(?)
 * Apr 25: Dan(?)
 * May 02: Chad(?)
 * May 09: Chad(?)

CI point person
...

Actions from last meeting

 * ACTION: Antoine to make a list of things not to do
 * AGREED: Antoine to poke channel whenever something bad happens and seek a buddy to pair resolution with
 * Next: Greg to make a task for this :)
 * https://phabricator.wikimedia.org/T131778
 * ACTION: Greg ping Chad about Q3 timespent spreadsheet (since he's out that week)
 * ACTION: Mukunda to read over https://phabricator.wikimedia.org/T114421 wrt to Phab/differential
 * ACTION: mukunda to file a task requesting a spare machine for a web frontend for Phab
 * ACTION: Greg to summarize in email the peer-review system from Howie/Terry
 * ACTION: Tyler/Chad/Someone to make an announcement about end of quarter goal of killing trebuchet (worded better)
 * ACTION: Document the scap migration timeline somewhere
 * ACTION: Greg to see what our survey options are (for the browser test user satisfaction survey)
 * ACTION: Greg to find the person at WMF who can maybe help with survey writing

New vs Maint time spent

 * Q3: https://docs.google.com/spreadsheets/d/1LJDc5W2Mlpzc0L1i7WyPwWU8AgWMn0fXRuNEEmg1EMU/edit#gid=0
 * Q4: https://docs.google.com/spreadsheets/d/1SjLoTALS4_DA77M-F-gLbIFIai5b8pXkPO7AgR303FI/edit

ACTION: Greg ping Chad about Q3

Scrum of Scrums

 * https://phabricator.wikimedia.org/project/board/64/
 * Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R


 * Phabricator event for testing if it's useful: https://phabricator.wikimedia.org/E155


 * Blocked on us:
 * us blocked
 * keyholder patch from mukunda
 * Krenair would like us to mention https://phabricator.wikimedia.org/T97593
 * QUESTION for Ops: what is the timeline to migrate the appservers to Jessie?
 * QUESTION for Ops: what is the timeline to migrate the appservers to Jessie?

Other Team Business

 * Time to update https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Skill_matrix :)


 * ACTION: greg to update this
 * nvm, Antoine did
 * Probably need to be aware of https://phabricator.wikimedia.org/T114421 "[RFC] Optional Travis integration for Jenkins"
 * It's set to "stalled" right now
 * ACTION: Mukunda to read over wrt to Phab/differential
 * Iridium overheating issue (see ops@ list message from Tim and https://phabricator.wikimedia.org/T131742
 * Chris Johnson (DC tech) suggests reapplying thermal paste, downtime of 10 minutes
 * ACTION: yuup
 * ACTION: mukunda to file a task requesting a spare machine for a web frontend for Phab
 * a collaborator
 * Peer feedback system proposal (we'd be guinea pigs)....
 * ACTION: Greg to summarize/email

Consolidate deploy tools / Train 2.0
https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Project/Train2.0
 * Migrate remaining services to scap3
 * Services Team owned services and MW -
 * All other services -


 * scap 3.1 is on production
 * using new python refreshcdbjson
 * git-fat, deploy-init, etc
 * keyholder/hiera patch waiting (see SoS)
 * spent time with ORES migration, now deployed with scap3 on Beta Cluster
 * services will be moving more stuff after Marko gets a few puppet patches merged
 * Zuul server to use scap3, after ORES sorted out requirements for python software deployment

ACTION: Tyler/Chad/Someone to make an announcement about end of quarter goal of killing trebuchet Ref: https://phabricator.wikimedia.org/project/view/1824/
 * This week, Tyler on point to draft it this today, others review it, verify with Chad's earlier email
 * (greg to make a quick task for it)
 * ACTION: Document the timeline somewhere
 * Chad announced deprecation of Trebuchet back in March 11th on ops list
 * aka: "no new services with trebuchet"

Differential Migration
https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Project/Differential_Migration
 * Conclude RFC process -
 * Documentation and workflow explanation -
 * Phase 1 repository migration -
 * Spec out needed glue for Differential to Gearman to Nodepool -


 * Made progress with Gearman firewall rule
 * thanks to dzahn
 * Phabricator can talk to Gearman to trigger Jenkins jobs
 * if we use https instead of ssh to checkout git repos we're unblocked
 * Unblocked to prototype Differential + Gearman
 * Greg added more explicit task ordering on https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Project/Differential_Migrationh

End_to_End_test_language_expansion
https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Project/End_to_End_test_language_expansion
 * Evaluate available JavaScript end-to-end testing frameworks. -
 * Prototype new JS framework. -
 * Send out user satisfaction survey. -


 * New projects/subprojects in phabricator to track quarterly Malu work
 * https://phabricator.wikimedia.org/project/board/1905/
 * Prototype is not far off
 * https://phabricator.wikimedia.org/project/view/1906/
 * Next: start drafting the survey
 * ACTION: Greg to see what our survey options are
 * GOAL: draft it this week, get reviews from team next meeting
 * ACTION: Greg to find the person at WMF who can maybe help
 * Resource factory is the only remaining prototype "feature"
 * https://phabricator.wikimedia.org/T131220

CI Scaling/Nodepool

 * Jenkins Gearman plugin upgraded to 2.0 (send delta instead of full list)
 * tox jobs --> to nodepool
 * only a few left (pywikibot), rest migrated today (4/4)
 * npm 2.x --> unblocks bunch of migration of npm jobs to Nodepool
 * Goal of getting tox and npm migrated this week
 * Building Zend 5.5 on Jessie. Tyler tip: http://dotdeb.org/
 * Need HHVM on Jessie
 * QUESTION: what is the timeline to migrate the appservers to Jessie?

Browser tests

 * old https://integration.wikimedia.org/ci/view/BrowserTests/view/-Dashboard/
 * new https://integration.wikimedia.org/ci/view/selenium/
 * config moving from Jenkins job inline shell to MediaWiki selenium rake task (easier maintenance)

Beta Cluster

 * skipped, not much to report about it anyway