Wikimedia Release Engineering Team/Checkin archive/20160229



Vacations/Important dates[edit]

How to do it:

  • March 4th - strategic narrative annual plan due
  • March 11th - draft Q4 (April 1st - June 30th) goals due
  • March 11th - Željko - probably working half day, traveling to a conference in the afternoon
  • March 25th Friday - Tyler
  • March 28th - Antoine && Željko - local holiday (Easter Monday)
  • March 31st - April 3rd : Hackathon in Israel
  • April 1st - Q4 goals published
  • April - Antoine: holidays one of the two first weeks
  • May 6th Friday - Antoine
  • May 9-Mid June-ish?: Greg - paternity leave - exact dates TBD
  • May 17-(?): Dan - paternity leave :D
  • Late May - draft Q1 (July 1st - Sept 30th) due
  • May 30: US HOLIDAY - Memorial Day
  • June (mid): Chad - EDC
  • June 22nd - 28th : Wikimania in Italy
  • July 1st - Q1 goals published
  • July 1st – Annual Plan, Budget, Risks Document and FAQ are posted
  • August: France holiday - because french. :)
  • January 2017 : Dev Summit + All Hands (presumably)

Team Business[edit]

Rotating positions[edit]

Train conductor[edit]

Week of ...

  • Feb 29: Chad
  • Mar 7: Mukunda
  • Mar 14: Mukunda
  • Mar 21: Tyler - Code freeze, due to the eqiad -> codfw switch over (announcement coming)`
    • So we need to make sure Mar 14th week is super stable.

Scrum of Scrums representative[edit]

(bad time for EU folks) Dan, Tyler, Chad, Mukunda Week of ...

  • Feb 29: Tyler
  • Mar 7: Chad
  • Mar 14: Chad
  • Mar 21: Mukunda

= CI point person[edit]

  • reassess later

Actions from last meeting[edit]

  • TODO - No One Yet: investigate carbon aggregation of stats >1 month old behavior
    • ACTION: Antoine to create a task
      • Overdue

New vs Maint time spent[edit]

Scrum of Scrums[edit]
Blocked on us: closed

    • Went under the radar. Turns out the root cause got fixed by @Maxsem in MediaWiki core a few days/weeks before ;-)

Blocked on ops (sorta):
Refactor phabricator module in puppet to remove git tag pinning behavior
(resolved) scap::target should use scap's debian package instead of trebuchet

Other Team Business[edit] - if anyone feels like writing a blag about something.

Annual Planning[edit]

Spreadsheet (team only) -
Planning worksheet:

Q3 goal/project check-in[edit]

Reduce CI Wait time[edit]

  • mediawiki-core-npm migrated to mediawiki-core-npm-node4.3 (ie Nodepool)
  • mediawiki services jobs being migrated. Mathoid pending on devs, Graphoid on some puppet work
  • Nodepool needs a few cherry picks, hopefully this week
  • Nodepool upgrade blocked on python-shade

Consolidate deploy tools[edit]

Migrate MediaWiki to scap3 - task T114313
Q2 Quarterly Goal hold over: Migrate all Service team owned services and MW deploys to scap3 -

HTTP server tests for scap

  • probably have a winner now
  • smart git http server in python, forked and modified
  • good performance over the other ones we tested
  • - lets get this repo into phabricator.
    • Should we just merge it directly into scap? it's MIT licensed and very self-contained.
      • Tyler: I'd vote merge into scap unless there are folks with specific objections

Updated package with bugfixes for AQS (permissions issues mostly)

  • AQS is Yes Done
  • Marko was on vacation last week, will check in on what's next with him today

Working on a packaging pipeline with Antoine

  • using Jenkins etc ( shell wrappers around cowbuilder / git build-package ) + aptly for publishing
  • working on setting up Beta to automatically deploy packages from a repo

Goal: make it reusable. Will be an intensive for ops to migrate the .deb repositories to Differential.

Differential Migration[edit]
Integrate Differential with our Continuous Integration infrastructure - task T31
Shepherd the RFC - task T119908
Discuss at WikiDev16 - task T114320
Garner early adopter projects (goal: 1 project per WMF "team")

Other Work[edit]

Browser tests cleanup of red tests[edit]

Going well, the red line is going down without decreasing the green line much, see The creation of jobs is now configured in the repos themselves via a yaml file (!!!), mostly there

beta cluster[edit]

Clean up job queue (200k stall jobs) Maybe need a second jobrunner instance or run more jobs on the existing one