Wikimedia Release Engineering Team/Goals/201516Q2/checkin-10-27

From mediawiki.org

30 (ish) day checkin on Q2 goals[edit]

https://phabricator.wikimedia.org/tag/releng-201516-q2/
https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201516Q2

KPIs[edit]

  • do mw core gate-processing time for this quarter, reassess for next quarter if needed
  • warning: carbon aggregate metrics per average after roughly a month. So old data most probably do not represent what you want.

Reduce number of deploy tools from 3 to 2[edit]

Migrate all Service team owned services and MW deploys to scap3[edit]

https://phabricator.wikimedia.org/T109926
technically mediawiki deploys already use scap3 but none of the new features ;)
I really want to use it for Phabricator deployments but hit a few blockers last time I tried.
I (Tyler) have concerns about this goal
* We've done 1 deploy to beta cluster
** service team as a whole, unaware
* One deploy wasn't flawless
** Ugly Puppet wrangling
** I (Tyler) think it went well, but I knew where the sticking points would be
** Configuration concerns were raised (resulting doc sprint this week)
* "How far from AQS deployments are we?"

How to stay on track[edit]

Open question.

Initial thoughts:

  • Focus on Analytics Query Service (based on RESTBase) —definitely first real-world use-case
    • Limited permissions for deployers
    • Seemingly means they can't use ansible (likely)
    • TODO Puppet wrangling required
    • TODO Who else to talk to about it?
    • TODO How can we test it?
    • https://phabricator.wikimedia.org/T114999

Retire Gerrit and Gitblit in favor of Phabricator[edit]

Decommission Gitblit[edit]

https://phabricator.wikimedia.org/T111465
upstream is adding an "optional, unique repository name" which should solve our issues with callsigns
Phabricator hosted repositories are now available over https and ssh.
  • url redirect (gerrit->phab repo name) stuffness
  • stupid naming

Code review RFC: creation, publication, discussion, feedback etc[edit]

https://phabricator.wikimedia.org/T114311
Phabricator can now merge differential patches with dry dock.
  • talk more in the weekly

Weekly checkin[edit]

Weekly checkin created on thursday. Pending Antoine familly schedule ... Will follow up on internal mailling list.


Reduce CI wait time[edit]

CI checkin minutes https://www.mediawiki.org/wiki/Continuous_integration_meetings/2015-10-27/Minutes

All: Please read and comment on https://lists.wikimedia.org/pipermail/qa/2015-October/002414.html

Need a better time for US folks.

CI cluster responds to spike in queued builds by starting and registering additional jenkins slaves[edit]

https://phabricator.wikimedia.org/T111106
  • 10 standing instances, will automatically spike to 20 as needed
  • nodepool doesn't send metrics to statsd :( :( :(


Migrate majority of CI jobs to Nodepool[edit]

https://phabricator.wikimedia.org/T114315
  • < 10% right now
  • we need the caching implemented before we can do much more otherwise we risk being blocked/rate-limited by upstreams (github etc)
    • everyone, please review the caching proposal! :)

Release MediaWiki 1.26[edit]

A quality MW 1.26 successfully released[edit]

https://phabricator.wikimedia.org/T110486
Board pruned of extraneous material, needs more triage. https://phabricator.wikimedia.org/tag/mw-1.26-release/
Chad will send email to wikitech-l asking for help with the blockers today


Be firm in what we are going to accept in 1.26.

Retrieved from "https://www.mediawiki.org/w/index.php?title=Wikimedia_Release_Engineering_Team/Goals/201516Q2/checkin-10-27&oldid=1925622"