Wikimedia Release Engineering Team/Checkin archive/20170315

From mediawiki.org

2017-03-15[edit]

Vacations/Important dates[edit]

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
How to do it
  • March 23-28: Chad in Miami
  • March 30, 31: Tyler in Wichita
  • March 30-Apr 3: Greg in Berlin (Wikimedia Conference)
  • April 10-17 (ish): Dan out
  • April 14: Monthly day off
  • May 15-18: Team Offsite in Vienna
  • May 19-21: EU Hackathon

Team Business[edit]

Time spent spreadsheet[edit]

Rotating positions and absences[edit]

Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers

Mar 6 and Mar 13[edit]

  • Train: Mukunda
  • SoS: Tyler
  • Out:
    • Mon Mar 13th: Monthly day off

Mar 20 and Mar 27[edit]

  • Train: Tyler (plus Chad for goup2 on March 30th)
  • SoS: Chad
  • Out:
    • March 23-28: Chad in Miami
    • March 30, 31: Tyler in Wichita
    • Thu March 30 - Mon Apr 3: Greg in Berlin (Wikimedia Conference)

Apr 3 and Apr 10[edit]

  • Train: Chad
  • SoS: JR
  • Out:
    • April 10-17: Dan
    • April 14 (Friday): US Staff holiday

Actions from last meeting[edit]


Scrum of Scrums[edit]

https://phabricator.wikimedia.org/project/board/64/
Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

This week[edit]

  • Blocking
  • Blocked
  • Updates

This week[edit]


Other Team Business[edit]

Keyholder blogpost[edit]


Logspam[edit]

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor


Annual Planning[edit]

Technology-wide planning[edit]
E_TOOMANYGDOCS

Q3 goal/project check-in[edit]

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201617Q3

Continuous Integration Infrastructure modernization[edit]

Gather requirements for new CI system - task T153270
  • Need to dust off specifications that we worked on early, use to evaluate deployment pipeline
  • Evaluation of Pearson Deployment Pipeline continues
    • k8s infra being build on ci-staging
    • plugin (god help us all) is installed and ready
  • Random aside: can MediaWiki Config live in a containerized world?
    • No. Maybe.
  • Update from Antoine on yesterday's (Tuesday's) CI backlog
    • tl;dr: tons of jobs flooding the system, not directly due to the migration of jobs that happened on Monday (which was a 10% increase)


Migrate MediaWiki deploys to scap3 (part 2 — This time, it's personal; A.K.A Scappy Strikes Back)[edit]

Build fanout support in scap3[edit]

https://phabricator.wikimedia.org/T121276
Have a clear course of action to get actionables done by end of quarter (sync git data to proxies post-canary check and just prior to using proxies; also need some minor puppet tweaks for some symlinks and a new vhost)
Lots of stuff getting done in scap3-MW-MVP (https://phabricator.wikimedia.org/project/view/1823/ )
Gotta fix up the mergeMessageFileList crap (extension-list)
rewriting updateWikiversions as scap plugin
Improved lock handling

Phabricator[edit]

Non-Quarterly goal work[edit]

Browser tests[edit]

  • T139740 Port Selenium tests from Ruby to Node.js
    • Almost there. No major changes to the commit in the last few weeks. I really think somebody should just push the big red +2 button. We can fix the minor things later.
  • T159945 Selenium/WebdriverIO tests in JavaScript/Node.js
    • Submitted skill share session for Vienna hackathon.
  • T158074 Update Ruby tests to Selenium 3
    • Done as far as we are concerned. 3 repositories left to teams to update.
  • T152963 Increase in failures caused by Saucelabs
    • Looks like T160086 (Upgrade Cucumber from version 1 to version 3) is the simplest way to rerun tests
  • T1331 Remove lines from Gemfile that are used by RVM
    • Done. An intern did all the work, Antoine and me were reviewing.

Beta Cluster[edit]

People status updates[edit]

Antoine[edit]

Last week[edit]

  • Qunit thing from SoS
  • Reviews of Javascript/Selenium for MediaWiki
    • Yes Done
  • Prepare to upgrade Jenkins on contint2001 (copy data, upgrade, see what happens)
  • As time allow (since 02/27)
    • migrate PHP 5.3 jobs to PHP 5.5 (due end of march)
    • Think about getting more Jenkins instances (beta, one for browser tests, maybe tools-labs)
  • Investigated puppetization of Jenkins .xml file. The encryption of secret with a randomly generated salt blocks me. Not sure how to provision that in puppet.

This week[edit]

  • {done} read doc about bootstrapvz
  • PHP5.3 jobs migrated. Precise instance will be shutdown/deleted on Monday March 20th
  • migration to Nodepool mostly complete. Leftover jobs have to be either deleted, move to other jenkins or integrated in existing jobs
  • Upgrade Jenkins on contint2001


Chad[edit]

Last week[edit]

  • Scap 3
  • Quick gerrit downtime (LDAP change)

This week[edit]

  • scap scap scap (more scap)
    • Did I mention scap?

Dan[edit]

Last week[edit]

  • Help break out CI/CD build PoC tasks (set up registry, image config/builder, etc.)
  • Play with Pearson Jenkins plugin
  • Grab a task and start hacking

This week[edit]

  • Continuing to set up and test k8s


JR[edit]

  • quality interviews
  • CI knowledge building
  • bug/defect data wrangling

Last week[edit]

  • quality interviews
    • met with Andre, Bernd, Giles
  • test reporting dashboard
    • requirements/highlevel design
  • CI knowledge building

This week[edit]

Mukunda[edit]

Last week[edit]

  • Deployment Train
  • leftover from last week
    • dust off the phab milestone scap plugin
      • look at making it update the deployment schedule (in addition to the deployment blocker tasks)
      • this probably won't happen this week
  • Search engine overhaul
    • Another week, another round of code review

This week[edit]

Tyler[edit]

Last week[edit]

  • Polish up blog post
  • scap3 fanout stuff w/chad
  • CI digging deep

This week[edit]

  • Scap3 fanout stuff
  • Hooking together pieces of Pearson Pipeline w/Dan
  • Dusting off critera doc for Pearson Pipeline eval

Željko[edit]

Last week[edit]

  • T158074 Update Ruby tests to Selenium 3
  • T152963 Increase in failures caused by Saucelabs
  • T139740 Port Selenium tests from Ruby to Node.js
  • T159931 Provisioning visualeditor role fails with `Unable to locate package zookeeper-server`
  • T159945 Selenium/WebdriverIO tests in JavaScript/Node.js
  • T160086 Upgrade Cucumber from version 1 to version 3
  • T1331 Remove lines from Gemfile that are used by RVM

This week[edit]

  • T139740 Port Selenium tests from Ruby to Node.js
  • T150435 Selenium tests for VisualEditor in Node.js
  • T152963 Increase in failures caused by Saucelabs => * T160086 Upgrade Cucumber from version 1 to version 3
Retrieved from "https://www.mediawiki.org/w/index.php?title=Wikimedia_Release_Engineering_Team/Checkin_archive/20170315&oldid=3615550"