Wikimedia Release Engineering Team/Checkin archive/20160822



Vacations/Important dates[edit]

How to do it:

  • Sept 02: Q2 goals draft published
  • Sept 05: US Holiday (Labor day) - Greg
  • Sept 23: Q2 goals finalized
  • Oct 01: Start of Q2
  • October 10: US Holiday (Indigenous People's Day)
  • October 17-21: Offsite in Washington D.C.
  • October 31: Mukunda maybe?
  • October 28 - Nov 2 (ish) - Chad
  • November 24: US Holiday (Thanksgiving)
  • January 9-11: Dev Summit
  • January 12-13: All Hands

Team Business[edit]

Time spent spreadsheet[edit]

Rotating positions and absences[edit]

Maniphest query for deployment blocker tasks:

weeks of Aug 8 and Aug 15[edit]

weeks of Aug 22 and Aug 29[edit]

weeks of Sep 05 and Sep 12[edit]

Actions from last meeting[edit]

Scrum of Scrums[edit]
Blocked on us:

This week[edit]

Last week ... Ooops, didn't happen[edit]

Other Team Business[edit]


Q2 (Oct - Dec) Goals[edit]

  • CI Tech Debt (meta goal)
    • #1
    • #2
  • Experiment/Stretch: MW deploy tech debt:
    • scap swat
    • ability to check something???

Q1 goal/project check-in[edit]

Phase out Ubuntu Precise[edit]

Replace primary production Continuous Integration host (gallium) - task T95757[edit]

Upgrade Phabricator database servers to Maria10/Jessie - task T138460[edit]

  • Yes Done

Upgrade Beta Cluster database servers to Maria10/Jessie - task T138778[edit]

Move Gerrit off of ytterbium[edit]

  • Yes Done

Reduce Technical Debt[edit]

Perform a technical debt analysis of software and services maintained by WMF Release Engineering - task T138225

Hot spots:

  • MW 3rd party release, l10nupdate, (and probably swat) tooling
  • Nodepool

Next steps?

  • ???

Streamline deployments (long-lived branches)[edit]

keyresult task:

  • Convert our production deployment strategy to use long-lived branches - task T89945

project view:

Non-Quarterly goal work[edit]

SWAT deploy changes[edit]

  • European SWAT deploys (task T137970
    • NEXT: this week :)
  • Future changes?

CI Scaling/Nodepool[edit]

  • Catch Antoine up on Nodepool state

Browser tests[edit]

Beta Cluster[edit]


DB Inconsistencies[edit]

People status updates[edit]


Last week[edit]

  • Vacation

This week[edit]

  • Catch up on Nodepool incident
  • Migrate jobs back to Nodepool instance
  • Ideally get quota raised
  • Figure out contint1001 network with ops / Tyler
  • done: clear out 3 weeks worth of mails
  • personal: learn how to play


Last week[edit]

  • DB consistencies ....
  • Long lived branches
  • CI outage incident report

This week[edit]

  • MW release today (finally)
  • Finally going to do DB consistency script -- per our 1:1 this shouldn't be so hard
  • Long lived branches (long may they ilve)


Last week[edit]

This week[edit]


Last week[edit]

This week[edit]

  • Finish the `scap swat` tool which is taking shape nicely.
  • Propose Improvements to the scap remote execution api to make it easy to use from scap plugins
    • This could facilitate development of arbitrary scap checks which can be ran separately from deployments
    • Will discuss with Tyler during the deployments meeting and go from there.


Last week[edit]

  • Bugfix scap update
  • Try to stay on top of gallium things
  • Incident report for CI outage!

This week[edit]

  • Bugfix scap update
  • nodepool things


Last week[edit]

  • Catching up

This week[edit]