Wikimedia Release Engineering Team/Checkin archive/20160926



Vacations/Important dates[edit]

How to do it:

Team Business[edit]

Time spent spreadsheet[edit]

Rotating positions and absences[edit]

Maniphest query for deployment blocker tasks:

weeks of Sep 19 and Sep 26[edit]

weeks of Oct 03 and Oct 10[edit]

Oct 17 and Oct 24[edit]

  • Train
    • none on Oct 17

Actions from last meeting[edit]

TODO: Antoine write a migration plan for gallium

  • lIn my head only. Been busy with wmf.19 explosion / random Zend 5.5 segfault etc.
    • Still to do, went syphoned in jobrunner issue / lack of monitoring / bunch of reviews etc
  • Do this week

TODO: Talk about release process/strategy first week of Q2 (Oct 3) with Ops (Brandon)

Scrum of Scrums[edit]
Blocked on us:

This week[edit]

  • Blocking
  • Blocked
  • Updates
    • New scap (3.3.0)
      • scap caches local config for it's deployment (machines don't have to reach back to tin)

Last week[edit]

Other Team Business[edit]

  • Contint root proposal
    • Can we just have an ops person?
  • do we know if vendors (Antoine and Željko) are coming to all hands?
    • TLDR: yes
  • Short term contractors budget
    • explicit list, obvs
    • time it takes to onboard
    • teams need to make this an explicit goal themselves


Q1 goal/project check-in[edit]

Phase out Ubuntu Precise[edit]

Replace primary production Continuous Integration host (gallium) - task T95757[edit]

  • Huge delay on figuring out a network lan to host the new machine
  • Puppet refactoring mostly done
  • Need a migration plan then schedule the switch

Upgrade Phabricator database servers to Maria10/Jessie - task T138460[edit]

  • Yes Done

Upgrade Beta Cluster database servers to Maria10/Jessie - task T138778[edit]

  • Yes Done
  • Gotta shutdown then drop the old instances?

Move Gerrit off of ytterbium - task T125018[edit]

  • Yes Done

Reduce Technical Debt[edit]

Perform a technical debt analysis of software and services maintained by WMF Release Engineering - task T138225

  • Yes Done

Streamline deployments (long-lived branches)[edit]

keyresult task:

  • Convert our production deployment strategy to use long-lived branches - task T89945

project view:

Non-Quarterly goal work[edit]

CI Scaling/Nodepool[edit]

Browser tests[edit]

- mediawiki_selenium feature to show/capture Selenium WebDriver requests to remote browser T94577 - Firefox v47 breaks mediawiki_selenium T137561 - Update mediawiki_selenium to use Marionette T137540

-> need geckodriver to be packaged (tis a rust app :() or drop Firefox?

Beta Cluster[edit]

  • MW apps reimaged to Jessie with ops leading
  • web servers (deployment-mediawiki*)
  • deployment servers (deployment-mira is primary, deployment-tin02 backup
  • jobrunner02 done
  • tmh to be done later


DB Inconsistencies[edit] and (see also: )

People status updates[edit]


Last week[edit]

  • Help on wmf.19 issue has I can
  • Gallium migration plan
    • Overdue :(
  • Nodepool upgrade hopefully
  • Migrate some jobs hopefully

This week[edit]

  • Gallium migration plan


Last week[edit]

  • Learn to play the ukelele
  • Finally looping back on DB consistencies since I have free cycles this week (what I have what?!)
  • Wrap up some logging-related cleanups I've been poking
  • Yell at Timo re: static files.

This week[edit]


Last week[edit]

  • Beta DBs

This week[edit]


Last week[edit]

This week[edit]

  • Finish getting scap swat and cli stuff merged
  • Talk with Greg about the automation of deployment blockers, release milestones/tasks, etc.


Last week[edit]

  • wmf.19
  • scap3 updates (blocking things)
  • Code review for llb

This week[edit]


Last week[edit]

  • T94577 mediawiki_selenium feature to show/capture Selenium WebDriver requests to remote browser.
  • T137561 Firefox v47 breaks mediawiki_selenium
  • T137540 Update mediawiki_selenium to use Marionette
  • T145718 CentralNotice: Intermittent unexplained browser test failures
  • conference

This week[edit]

  • MEDIAWIKI_URL may be set to incorrect value in mwext-mw-selenium job T144912
  • mediawiki_selenium feature to show/capture Selenium WebDriver requests to remote browser T94577
  • Improve documentation around running/writing (with lots of examples) browser tests T108108