Wikimedia Release Engineering Team/Goals/201516Q3/checkin-02-18

Consolidate deploy tools

 * Migrate MediaWiki to scap3 -

Antoine: for l10n we have a task to use the plain .php file directly in hhvm but that exhausts hhvm caches quiet fast (no gc on hhvm)
 * no where near ;)
 * started forming a plan Friday Feb. 12th
 * still forming the experimenting plan
 * did get a lot of prereqs done (thanks to the Phabricator needs)
 * dropped the idea of using zsync (for l10n stuff) for now
 * looking into git-annex


 * Q2 Quarterly Goal hold over: Migrate all Service team owned services and MW deploys to scap3 - https://phabricator.wikimedia.org/T109926


 * unblocked thanks to the Phab related things (see above)
 * Tyler has a patch: making the service nodes hiera config available to use scap
 * after that is merged the ball is in the services court mostly
 * Marko/Services will be aware of this as of this coming Monday (Feb 22)
 * Getting services on Beta Cluster migrated to scap is the next obvious win
 * Services owners should own this migration as well - us supporting them
 * Then get Jenkins, on postmerge, to scap deploy on beta cluster deployment-tin
 * Tyler or someone to email Ops list after his patch is merged with the update and "yo, get migrating"

Differential Migration

 * https://etherpad.wikimedia.org/p/diffuerential-weekly
 * Integrate Differential with our Continuous Integration infrastructure -


 * we have scap running CI via Jenkins
 * stuff required for MW or OOUI is not in place yet
 * barrier is moving CI logic into the individual repos (?)
 * something something harbormaster (I missed what Mukunda said)
 * 
 * Shepherd the RFC -


 * not much, prereq is the above stuff on CI
 * Discuss at WikiDev16 -


 * done
 * Garner early adopter projects (goal: 1 project per WMF "team")


 * scap
 * Thumbor
 * composer-merge-plugin
 * WikimediaUI - https://phabricator.wikimedia.org/diffusion/WMUI/repository/master/
 * ooui (not yet)
 * pywikibot (not yet)

Reduce CI Wait time

 * KPI: https://grafana.wikimedia.org/dashboard/db/releng-kpis?panelId=2&fullscreen
 * Migrate remaining CI jobs to Nodepool -
 * php composer (Zend and HHVM) -
 * as many miscellaneous jobs as possible -

Not done / shifted. Worked on Oct-Dec 2015 completion instead ie migrate npm jobs
 * Services to Nodepool / NodeJS 4.3
 * Misc npm jobs (such as mediawiki)
 * Generic npm job

Lot of maintenance related workload (php55, generalize jobs, reviews, support) :-/


 * Migrate Jenkins to Jessie -
 * Not going to happen anytime soon. EOUTOFTIME