Wikimedia Release Engineering Team/Checkin archive/20170315
2017-03-15[edit]
Vacations/Important dates[edit]
- March 23-28: Chad in Miami
- March 30, 31: Tyler in Wichita
- March 30-Apr 3: Greg in Berlin (Wikimedia Conference)
- April 10-17 (ish): Dan out
- April 14: Monthly day off
- May 15-18: Team Offsite in Vienna
- May 19-21: EU Hackathon
Team Business[edit]
Time spent spreadsheet[edit]
Rotating positions and absences[edit]
Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers
Mar 6 and Mar 13[edit]
Mar 20 and Mar 27[edit]
- Train: Tyler (plus Chad for goup2 on March 30th)
- SoS: Chad
- Out:
- March 23-28: Chad in Miami
- March 30, 31: Tyler in Wichita
- Thu March 30 - Mon Apr 3: Greg in Berlin (Wikimedia Conference)
Apr 3 and Apr 10[edit]
Actions from last meeting[edit]
- TODO: Sign up for the Product and Technology consultation if you have any slight amount of interest: https://office.wikimedia.org/wiki/Product_and_Tech_consultation
- Mukunda and Antoine sync up
Scrum of Scrums[edit]
- https://phabricator.wikimedia.org/project/board/64/
- Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R
This week[edit]
- Blocking
- Blocked
- Updates
This week[edit]
- Blocking
- Blocked
- T139740 Port Selenium tests from Ruby to Node.js, the patch is almost ready, please review https://gerrit.wikimedia.org/r/#/c/328191/
- Updates
Other Team Business[edit]
Keyholder blogpost[edit]
- https://etherpad.wikimedia.org/p/keyholder-blog
- https://docs.google.com/document/d/1kNjUbdI92J1SwENnvBcDdvE4IbqsIb8HzIAj1lwQW4s/edit
- Feedback from Faidon, Ori, bd808: all is well
- Sent ^ google doc to blogteam
Logspam[edit]
Annual Planning[edit]
Technology-wide planning[edit]
- E_TOOMANYGDOCS
Q3 goal/project check-in[edit]
Continuous Integration Infrastructure modernization[edit]
- Gather requirements for new CI system - task T153270
- Need to dust off specifications that we worked on early, use to evaluate deployment pipeline
- Evaluation of Pearson Deployment Pipeline continues
- k8s infra being build on ci-staging
- kubectl cluster-info => "Kubernetes master is running at http://localhost:8080" !!!
- plugin (god help us all) is installed and ready
- k8s infra being build on ci-staging
- Random aside: can MediaWiki Config live in a containerized world?
- No. Maybe.
- Update from Antoine on yesterday's (Tuesday's) CI backlog
- tl;dr: tons of jobs flooding the system, not directly due to the migration of jobs that happened on Monday (which was a 10% increase)
Migrate MediaWiki deploys to scap3 (part 2 — This time, it's personal; A.K.A Scappy Strikes Back)[edit]
Build fanout support in scap3[edit]
- https://phabricator.wikimedia.org/T121276
- Have a clear course of action to get actionables done by end of quarter (sync git data to proxies post-canary check and just prior to using proxies; also need some minor puppet tweaks for some symlinks and a new vhost)
- Lots of stuff getting done in scap3-MW-MVP (https://phabricator.wikimedia.org/project/view/1823/ )
- Gotta fix up the mergeMessageFileList crap (extension-list)
- rewriting updateWikiversions as scap plugin
- Improved lock handling
Phabricator[edit]
Non-Quarterly goal work[edit]
Browser tests[edit]
- T139740 Port Selenium tests from Ruby to Node.js
- Almost there. No major changes to the commit in the last few weeks. I really think somebody should just push the big red +2 button. We can fix the minor things later.
- T159945 Selenium/WebdriverIO tests in JavaScript/Node.js
- Submitted skill share session for Vienna hackathon.
- T158074 Update Ruby tests to Selenium 3
- Done as far as we are concerned. 3 repositories left to teams to update.
- T152963 Increase in failures caused by Saucelabs
- Looks like T160086 (Upgrade Cucumber from version 1 to version 3) is the simplest way to rerun tests
- T1331 Remove lines from Gemfile that are used by RVM
- Done. An intern did all the work, Antoine and me were reviewing.
Beta Cluster[edit]
People status updates[edit]
Antoine[edit]
Last week[edit]
- Qunit thing from SoS
Done Chromium upgrade solved it. https://phabricator.wikimedia.org/T153038
- Reviews of Javascript/Selenium for MediaWiki
Done
- Prepare to upgrade Jenkins on contint2001 (copy data, upgrade, see what happens)
- As time allow (since 02/27)
- migrate PHP 5.3 jobs to PHP 5.5 (due end of march)
- Think about getting more Jenkins instances (beta, one for browser tests, maybe tools-labs)
- Investigated puppetization of Jenkins .xml file. The encryption of secret with a randomly generated salt blocks me. Not sure how to provision that in puppet.
This week[edit]
- {done} read doc about bootstrapvz
- PHP5.3 jobs migrated. Precise instance will be shutdown/deleted on Monday March 20th
- migration to Nodepool mostly complete. Leftover jobs have to be either deleted, move to other jenkins or integrated in existing jobs
- Upgrade Jenkins on contint2001
Chad[edit]
Last week[edit]
- Scap 3
- Quick gerrit downtime (LDAP change)
This week[edit]
- scap scap scap (more scap)
- Did I mention scap?
Dan[edit]
Last week[edit]
- Help break out CI/CD build PoC tasks (set up registry, image config/builder, etc.)
- Play with Pearson Jenkins plugin
- Grab a task and start hacking
This week[edit]
- Continuing to set up and test k8s
JR[edit]
- quality interviews
- CI knowledge building
- bug/defect data wrangling
Last week[edit]
- quality interviews
- met with Andre, Bernd, Giles
- test reporting dashboard
- requirements/highlevel design
- CI knowledge building
This week[edit]
Mukunda[edit]
Last week[edit]
- Deployment Train
- leftover from last week
- dust off the phab milestone scap plugin
- look at making it update the deployment schedule (in addition to the deployment blocker tasks)
- this probably won't happen this week
- dust off the phab milestone scap plugin
- Search engine overhaul
- Another week, another round of code review
This week[edit]
Tyler[edit]
Last week[edit]
- Polish up blog post
- scap3 fanout stuff w/chad
- CI digging deep
This week[edit]
- Scap3 fanout stuff
- Hooking together pieces of Pearson Pipeline w/Dan
- Dusting off critera doc for Pearson Pipeline eval
Željko[edit]
Last week[edit]
- T158074 Update Ruby tests to Selenium 3
- T152963 Increase in failures caused by Saucelabs
- T139740 Port Selenium tests from Ruby to Node.js
- T159931 Provisioning visualeditor role fails with `Unable to locate package zookeeper-server`
- T159945 Selenium/WebdriverIO tests in JavaScript/Node.js
- T160086 Upgrade Cucumber from version 1 to version 3
- T1331 Remove lines from Gemfile that are used by RVM
This week[edit]
- T139740 Port Selenium tests from Ruby to Node.js
- T150435 Selenium tests for VisualEditor in Node.js
- T152963 Increase in failures caused by Saucelabs => * T160086 Upgrade Cucumber from version 1 to version 3