Wikimedia Release Engineering Team/Checkin archive/20190304

From mediawiki.org


2019-03-04[edit]

Vacations/Important dates[edit]

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
How to do it
  • March 11 (WMF Holiday) - US Staff
  • April 9-12: Greg at tech-mgt F2F in Portland
  • April 22 (WMF Holiday) - US Staff
  • April 22-27: Team offsite in Chicago
  • April 22nd - Antoine, Easter - we're flying to Chicago?
  • May 1st - Antoine and Željko, Labor Day / May Day
  • May 8th - Antoine, 1945 victory
  • May 17-19 - Wikimedia Hackathon 2019 (Prague, Czechia)
    • Attending:
  • May 30th-31th - Antoine, Feast of the Ascension
  • June 10th - Antoine, Pentecost -- see https://en.wikipedia.org/wiki/Eastertide for Antoine/France Easter holidays
  • May 27 (Memorial Day) - US Staff
  • June 19 (Juneteenth) - US Staff

Rotating positions[edit]

Train[edit]

Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R
  • Jan 07 - wmf.12 - Dan
  • Jan 14 - wmf.13 - Dan
  • Jan 21 - wmf.14 - Mukunda
  • Jan 28 - wmf.15 - No Train (All Hands)
  • Feb 04 - wmf.16 - Mukunda
  • Feb 11 - wmf.17 - Tyler
  • Feb 18 - wmf.18 - Tyler
  • Feb 25 - wmf.19 - Antoine
  • Mar 04 - wmf.20 - Antoine
  • Mar 11 - wmf.21 - Zeljko
  • Mar 18 - wmf.22 - Zeljko
  • Mar 25 - wmf.23 - Dan
  • Apr 01 - wmf.24 - Dan
  • Apr 08 - wmf.25 - Mukunda
  • Apr 15 - wmf.26 - Mukunda
  • Apr 22 - 1.34.0-wmf.1 - NO TRAIN, team offsite
  • Apr 29 - wmf.2 - Tyler
  • May 06 - wmf.3 - Tyler
  • May 13 - wmf.4 - Antoine
  • May 20 - wmf.5 - Antoine
  • May 27 - wmf.6 - Zeljko
  • June 03 - wmf.7 - Zeljko

SoS[edit]

  • Zeljko 4eva! :)

Team Business[edit]

Book club[edit]


Spring Offsite[edit]

  • Location: Chicago, IL (Central timezone, UTC-5 while we're there)
  • Dates: Arrive Monday 4/22, Depart Saturday 4/27.
  • BOOK FLIGHTS BY: March 21
  • Activity day: Send your suggestions to me if you have them :) I'll make the voting spreadsheet later.
    • Chicago Bulls!!!11!oneone
      • April 10 -- Regular Season ends, so only if they're good this year :)
    • I've heard there's good pizza :P
      • I'm sure we'll have some of that for our dinners, unless you want to do a cooking class :)
    • Greenfield park conservatory?
    • Museum of Science and Industry - https://www.msichicago.org/
    • Any American sport would be fun (basketball, football, baseball..) (Lars doesn't like watching sports, but would be happy to sit somewhere quite for the duration) (thcipriani: baseball isn't so much about watching baseball :)) (Lars: going to the baseball stadium is stressful when there's thousands of others there (I'm difficult, sorry))
  • Program: Haven't started yet :)


Monthly reflection on accomplishments - March '19 edition[edit]

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
Add as you have them!

Mid-term planning and what it means for us[edit]


Q4 Goals planning[edit]


Annual Planning is coming up[edit]

  • Regardless of the mid-term planning above we need to have a clear idea of what we want to accomplish next fiscal (for the newbies: our fiscal year is July 1st - June 30th)[[
  • As it stands now Platform Evolution is one of the main mid-term goals with Engineering Productivity as a highlighted sub-goal/project
  • Timeline: https://office.wikimedia.org/wiki/Annual_planning/FY19-20


Incoming/Needs attention[edit]

Recover from corrupted beta MySQL slave (deployment-db04)[edit]

Pywikibot CI[edit]


Scrum of Scrums[edit]

Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums

Incoming from last week[edit]

  • Blocking:


Outgoing this week (wrong section heading is on purpose for copy/pasting into Scrum of Scrums etherpad[edit]

Release Engineering[edit]


Callouts[edit]

  • Release Engineering


Train status and happenings[edit]

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor
  • "the site is still up"
  • EventBus and logstash blew up, lost some events
  • a few new error spam reports filed in phabricator


Quarterly Goals for Q3[edit]

https://www.mediawiki.org/wiki/Wikimedia_Technology/Goals/2018-19_Q3

TEC1 (Maint): Outcome 1 / Output 1.1[edit]

GOAL: Automate the generation of change log notes
WHO: Mukunda, (Tyler on backup)

TEC1 (Maint): Outcome 1 / Output 1.1[edit]

GOAL: Investigate notification methods for developers with changes that are riding any given train
WHO: Mukunda, Tyler


TEC3 (Pipeline): Outcome 1 / Output 1.2[edit]

GOAL: Instrument Quibble for data collection
WHO: Mukunda, Antoine


TEC3 (Pipeline): Outcome 1 / Output 1.2[edit]

GOAL: Create a graph where time is spent and make a prioritized list for improvements.
WHO: Mukunda, Antoine


TEC3 (Pipeline): Outcome 2 / Output 2.1[edit]

GOAL: Select and integrate a code health metric solution into our tooling.
WHO: JR, ...


TEC3 (Pipeline): Outcome 3 / Output 3.1[edit]

GOALS:
Adopt more services into Deployment pipeline - task T212801
cxserver, ORES (partially), citoid, changeprop, cpjobqueue (stretch)
Deploy eventgate
WHO: Dan, Tyler, Lars
    • changeprop

TEC12 (DevProd): Outcome 1 / Output 1.1[edit]

GOAL: Conduct interviews with development stakeholders and compile a report that informs future work creation of a rubric.
WHO: Jeena, Mukunda


TEC13 (Code Health): Outcome 1 / Output 1.1[edit]

GOALs:
Develop and communicate guidelines and best practices for successful Code Stewardship.
(Continued from Q2) Update/refresh review queue (review process for initial code deployment)
WHO: JR

went on walkabout - pivoting a little

TEC13 (Code Health): Outcome 2 / Output 2.2[edit]

GOAL: 5 of the 15 prioritized repositories have at least 1 end-to-end test - task T206621
WHO: Zeljko



TEC13 (Code Health): Outcome 2 / Output 2.3[edit]

GOALs:
Evolve/develop tools and processes to support the PE refactoring effort to improve code health.
Develop common test strategy that enable teams to engage in more effective and efficient testing practices. (maybe should be output 2.4?)
WHO: JR, Core Platform Team

JS code coverage GAP may be close to being addressed. Code Health Metrics WG (Kosta) may have a good solution in place.


TEC13 (Code Health): Outcome 3 / Output 3.2[edit]

GOALs:
Speak at All Hands on the status of Technical Debt
Engage and coach development teams on their approach to managing technical debt.
WHO: JR, Core Platform Team



TEC13 (Code Health): Outcome 4 / Output 4.1[edit]

GOALs: Code Health Dashboard with 50% of repositories covered.
WHO: JR, Core Platform Team

current mixing of unit and integration tests it our use model is potentially causing issues with pulling in results to SonarQube/Cloud.

Other non-goal work[edit]

Selenium[edit]

Gerrit[edit]

Phabricator[edit]


Jenkins[edit]

QA/Code Health[edit]

interesting stuff :-)

SCAP[edit]

Standup![edit]

Antoine[edit]

  • What I plan to do this week
  • What I'm blocked on
  • Other?


Brennen[edit]

  • What I plan to do this week
    • CI evaluation - we have time scheduled to meet twice
    • Review and test Jeena's restbase chart - https://gerrit.wikimedia.org/r/c/releng/local-charts/+/493766
    • New developer docs discussion with Eric Gardner and Hana Worku
      • Evaluate existing dev bootstrapping docs around Docker, etc.
    • Maybe summarize some book notes
  • What I'm blocked on
  • Other?


Dan[edit]

  • What I plan to do this week
    • Get caught up
  • What I'm blocked on
    • Kauai brain 8D
  • Other?


Greg[edit]

  • What I plan to do this week
    • OMG Planning (4 hours of workshopping tomorrow)
    • Talk with people
    • Loop back to Beta Cluster code stewardship
    • Review queue, ugh
    • Book highlighting/scribbles to notes
    • Loop back to TechConf thinking/planning
  • What I'm blocked on
  • Other?

James[edit]

  • What I plan to do this week
  • What I'm blocked on
    • being sick :(
  • Other?


Jean-Rene[edit]

  • What I plan to do this week
    • Catch up on book
    • Code stewardship review activities
    • Code Stewards best practices (metrics to enable)
  • What I'm blocked on
  • Other?


Jeena[edit]

  • What I plan to do this week
    • Merge restbase chart
    • Update tickets and documentation for Developer Productivity work
    • Work on improving local env performance (look into suggestions from Kosta)
    • New Developer Docs Discussion
    • Read book
  • What I'm blocked on
  • Other?


Lars[edit]

  • What I plan to do this week
    • Get Quibble running on my laptop
    • Start evaluating CI tooling options
  • What I'm blocked on
    • n/a
  • Other?
    • n/a


Mukunda[edit]

  • What I plan to do this week
    • Finally release the vandalism revert script
    • Deploy conduit method that is required by the above ^
    • Read a book
    • Fix bulk editing in phabricator ( https://phabricator.wikimedia.org/T216867 )
    • More work with subtypes
  • What I'm blocked on
  • Other?


Tyler[edit]

  • What I plan to do this week
    • work-todo: Scheduled: TODO Review pruning docker image jenkins job work
    • work-todo: Scheduled: TODO Scap Python3: Make working scap dev environment
    • work-todo: Scheduled: TODO Scap Python3: Investigate python3 print v Jenkins shell
    • work-todo: Scheduled: TODO Train Automation: Ping AndyRussG about updating HEAD
    • work-todo: Scheduled: TODO Continuous Delivery Bookclub: Inspectional Read Ch 1-4
    • work-todo: Scheduled: TODO Continuous Delivery Bookclub: Outline Ch 1-4
    • work-todo: Scheduled: TODO Gerrit 2.15.1(0|1): Schedule upgrade
    • work-todo: Scheduled: TODO Gerrit 2.15.1(0|1): Investigate JGit GC issue Yes Done (cf: https://gerrit.wikimedia.org/r/c/operations/puppet/+/493963 )
    • work-todo: Scheduled: TODO Gerrit 2.15.1(0|1): Investigate Gerrit prometheus export
    • work-todo: Scheduled: TODO Blubber: Policy File: Write a policyfile to enforce wmf base images
    • work-todo: Scheduled: TODO Blubber: Policy File: Where to store policyfile...production-charts? puppet?
    • work-todo: Scheduled: TODO Deployment Pipeline: Draft TEC3 Goal email
    • work-todo: Scheduled: TODO Sonarcube: deploy job-template change
  • What I'm blocked on
  • Other?


Zeljko[edit]


Grooming[edit]

Team Kanban Board Review and Triage[edit]


Once / month-ish review of backlog(s)[edit]


Kanban stats[edit]

Burnup chart
Retrieved from "https://www.mediawiki.org/w/index.php?title=Wikimedia_Release_Engineering_Team/Checkin_archive/20190304&oldid=3615621"