Wikimedia Release Engineering Team/Checkin archive/20160718

From mediawiki.org

2016-07-18[edit]

Special Guest - Rachel Farrand![edit]

Team offiste planning!

Spreadsheets!

Notes:

  • Rachel will begin working on hotel/venue options in Chicago and DC \o/

Special Guest - Andrew with CI questions[edit]

  • Need a good metric to watch for labs changes impact on CI
  • Respawn may be causing DNS issues, can we increase the wait time there?
  • What metrics do we have:
   https://grafana.wikimedia.org/dashboard/db/releng-kpis
   https://grafana.wikimedia.org/dashboard/db/releng-zuul

Vacations/Important dates[edit]

How to do it: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off

  • July 25 - August 15: Željko vacation. Will have laptop with me. Reachable via phone.
  • July 30 - August 21: Antoine vacation. At home 1st week.
  • August 1st - 5th: Mukunda - vacation: Concert & relaxation

...

  • January 9-11: Dev Summit
  • January 12-13: All Hands

Team Business[edit]

Rotating positions and absences[edit]

Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers

weeks of July 11 and 18[edit]


weeks of July 25 and Aug 1[edit]


Time spent spreadsheet[edit]

Actions from last meeting[edit]

  • Upgrade mariadb in deployment-prep from Precise/MariaDB 5.5 to Jessie/MariaDB 5.10 https://phabricator.wikimedia.org/T138778
    • TODO: Greg. What is the priority? Check with Jaime. We have other priorities.
    • Yes Done Commented/asked on task.
  • SWAT deploy next steps:
    • Yes Done TODO: Zeljko do an 8am Pacific SWAT deploy with Tyler
    • Yes Done TODO: After that, update docs
    • NEXT: stalled pending finding people to do the SWAT window while Antoine and Zeljko are on vacation


Scrum of Scrums[edit]

https://phabricator.wikimedia.org/project/board/64/
Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

This week[edit]

  • Blocking
  • Blocked
  • Updates
    • Zuul upgraded this week, should address a bunch of issues

Last week[edit]


Other Team Business[edit]

  • European SWAT deploys next steps (task T137970
    • stalled until after Antoine and Zeljko's vacations, unless 2 other trained SWATers step forward
  • Andrew interrupts with nodepool questions
    • New labvirt nodes coming online today, please be alert to weird behavior
    • Labs OPs would like to see metrics about testing performance:
      • Benefit from increasing # of concurrent nodes
      • Cost/benefit from changing rate of node recreation

Q1 goal/project check-in[edit]

Phase out Ubuntu Precise[edit]

keyresult tasks:

  • Replace primary production Continuous Integration host (gallium) - task T95757
    • Meeting with Chase on Thursday was skipped
    • Faidon will respond this week with his thoughts, we're waiting on him
  • Upgrade Phabricator database servers to Maria10/Jessie - task T138460
    • waiting on Jaime to failover m3-master
  • Upgrade Beta Cluster database servers to Maria10/Jessie - task T138778
    • waiting on Jaime to priority


Reduce Technical Debt[edit]

Perform a technical debt analysis of software and services maintained by WMF Release Engineering - task T138225


Streamline deployments (long-lived branches)[edit]

keyresult task:

  • Convert our production deployment strategy to use long-lived branches - task T89945

project view: https://phabricator.wikimedia.org/project/view/2117/

  • reorganized/repurposed other meetings to work on this
  • time this past week was mostly spent on Phabricator fixing (task graphs, oh boy do we like tracking tasks)


Non-Quarterly goal work[edit]

CI Scaling/Nodepool[edit]

Browser tests[edit]

Differential migration[edit]

Differential weekly (https://etherpad.wikimedia.org/p/diffuerential-weekly ) TODOs:

    • semi-related TODO: file task re upgrading MW-Vagrant guests to Jessie

Beta Cluster[edit]

  • "deployment-fluorine becomes unresponsive frequently" - https://phabricator.wikimedia.org/T140313
    • From Matt (who's trying to diagnose login issues): "Happened again. I worked around it by rebooting in wikitech, but shouldn't keep happening."


Other[edit]

People status updates[edit]

Antoine[edit]

Last week[edit]

  • Gerrit upgrade / Zuul upgrade
  • Target host to replace gallium
  • Sync up with Tyler for CI / gallium phase out
  • Moaar maintenance
  • Offsite site/date

This week[edit]

Chad[edit]

Last week[edit]

  • Gerrit. Gerrit. Gerrit.

This week[edit]

  • Moar gerrit. Train. Choo choo.

Dan[edit]

Last week[edit]

  • Getting back

This week[edit]

Mukunda[edit]

Last week[edit]

  • Phabricator upgrade on wednesday
  • Figure out where to start on the long lived branches project

This week[edit]

  • Get the merge-wmf-branch script cleaned up and shared with the team for feedback
  • Brainstorm improvements / other ideas around branch merging / cherry-picking

Tyler[edit]

This week[edit]

  • MW Canary work

Last week[edit]

  • SWAT training/documentation
  • Task wrangling


This week[edit]

Željko[edit]

Last week[edit]

This week[edit]

Retrieved from "https://www.mediawiki.org/w/index.php?title=Wikimedia_Release_Engineering_Team/Checkin_archive/20160718&oldid=3615559"