Roadmap/2012/October

From mediawiki.org

October 2012[edit]

Technical Operations[edit]

  • Redis/Memcached
    • Deploy limited php-redis on the apaches, and all new sessions are being written to a redis instance (mc1). [Tim/Asher] [Done]
  • Swift
    • start migrating swift backend servers to new NAS1 server [Mark] [done]
    • Evaluate Ceph [Faidon/Asher/Aaron] [on-going]
  • Commons infrastructure
    • migrate ms7 (commons) to Nas1 [Done]
    • replicate Nas1 (Tampa) to Nas2 (Ashburn) [done]
  • Parser Cache
    • build 2 more parser cache instances@ Tampa [Mark] [Done]
  • Deploy Varnish on upload@Eqiad to replace squid [Mark] {done]
  • Deploy 4 new servers for bits@ESAM [Mark] [done]
  • Deploy Wikidata

Features[edit]

  • VisualEditor/Parsoid (Trevor, Roan, Rob, Gabriel, Subbu, MarkTraceur, + Wikia)
    • API finalization/debugging [IN PROCESS]
    • Iteration on Visual Editor for Dec release [IN PROCESS]
    • Parsoid testing framework for semantic/superficial regressions [IN MAINTENANCE]
    • Node.js parsoid to completion [ONGOING, 75% exact, 93% semantic]
    • experimentation into C/C++ version [ON HOLD UNTIL JAN]
  • New Pages Feed (fka Page Triage) (Kaldari, Benny)
    • Additional socialization and public announcement/launch [DONE]
    • Descriptive statistics on NPF (revised dashboard on toolserver) [Dario] [IN PROCESS]
    • Bug fixes (no more feature development) [ONGOING]
  • Echo (Notifications) and Flow (Kaldari, Benny, Werdna, Luke Welling, Preilly, Aaron S)
    • re-deployment of Echo prototype for Mediawiki.org [Werdna/Vibha/Kaldari] [NOV 1]
    • issue with relative timestamping (WSTimestamp::GetHumanTimestamp and Language::prettyTimestamp patch) [IN PROCESS]
    • Continued development of Echo prototype for Mediawiki.org [Werdna/Vibha/Kaldari/Benny] [ONGOING]
    • Selection of initial use cases [Vibha/Fabrice] [DONE]
    • UI and bugfixing of Echo [Krenair] [ONGOING]
    • Global user changes [JamesF] [IN PROCESS]
    • (see Performance engineering for infrastructure prep work:)
  • Article feedback (Matthias)
    • (most delayed because of Wikivoyage resourcing)
    • Oversight checklist (to help reduce the volume of oversight requests) [DONE]
    • Continued AbuseFilter work [DONE]
    • Conversion analysis: [DONE]
    • performance/db related changes to AFTv5 queries before scaling, + sharding (see Database sharding) [Matthias] [IN PROCESS]
  • E3 (Ori, S, Luke)
    • Clicktracking/Analytics
      • Event tracking live [DONE]
      • EventTracking schema filtering [IN PROCESS]
      • Clicktracking sunset [Scheduled for 10/31]
      • Funnel tracking of Community Portal [Started] (will be ongoing)
    • Account Creation User Experience
      • Deployment of first test to production [DONE]
      • Deployment of second test to production (client-side validation) [10/24]
      • Minor UI tweaks [IN PROCESS]
      • Data analysis once experiment is complete [IN PROCESS]

Fundraising[edit]

  • Data discrepency error/regressions [IN PROCESS]

Multimedia[edit]

Mobile[edit]

  • Beta features
    • left nav [DONE]
    • new typography [DONE]
    • login [DONE]
  • Prod
    • left nav [DONE]
    • new typography [DONE]
  • promote wikipedia beta app to stable [DONE]
  • mobile friendly resource loader [DONE]
  • dynamic sections [DONE]
  • pickup any remaining redirects [office, chapters, ...] [DONE]
  • Launch Saudi [DONE]

QA[edit]

  • Created basic Regression Tests Mobile Browser Regression Tests
  • Start Implementing Watir-based browser Mobile Testing Watir-webdriver Mobile Testing
  • Continue working with Chris and Zeljko to use CI framework that the Platform QA team is setting up
  • Continue to work with the Product team to Test prior to each deployment

Platform / Dev-Ops[edit]

MediaWiki Core[edit]

QA[edit]

  • Beta labs
    • Continue refining beta labs performance [Antoine/Chris/Ĺ˝eljko] [ONGOING]
  • Begin work on Watir-based browser testing framework
    • Create at least one useful end-to-end test for important Wikipedia feature, with automatic execution (Jenkins-driven) and results reporting [Chris/Ĺ˝eljko]
    • Create a list of targets for browser testing according to priority
  • Continue integrating Mobile QA with overall QA/testing activities

Analytics[edit]

See also: Analytics/Roadmap

Kraken[edit]
  • Set up Maven / Somatype Artifact Repository (continuous integration) [dsc]
    • WMF Maven parent pom [dsc]
  • Puppetize Kraken [otto] (Ongoing)
  • Set up JMX monitoring -- needs to be our LAN [otto + dsc]
    • Hadoop Ganglia Monitoring [otto] (Oct) [DONE]
  • Get Storm set up [dsc + otto]
    • Start work on ETL topology [dsc]
  • Hardware reinstallation -- Depends on Ops [otto]
  • Get to consensus with Ops regarding logging of the firehose [dsc + otto] [DONE]
    • Research needed: test running cli JVM producers does not cause extra load [otto] [not doing]
Limn[edit]
  • Refactor charting to use d3 [dan + dsc]
    • Feature Parity with Dygraphs (plus bugfixes, etc) (Oct)
  • Bugfixes (like Save-As, UI Error Notifications, ...) [dan] (Oct)
  • Improve Limn wiki, docs, & guides (esp those shameful screenshots) [dan] (Oct)
  • UI support for remote datasets via proxy [dsc + dan] (Oct)
  • Deploy reportcard / gerrit-stats on stat1001 (aka, "the Debian packaging discussion") [otto + dsc]
  • Support the Global Dev dashboard [evan] (Ongoing)
  • Support the Gerrit Stats dashboard [diederik] (Ongoing)
Legacy Log Collection[edit]
  • Add support for new domain names in webstatscollector (blog, etc) [diederik]
  • udp2log filters
    • Update filters for Wikipedia Zero [otto] (Ongoing)
    • Filter by X-Carrier headers. [otto + asher + diederik]
    • udp-filter to filter by http status. [otto]
WikiStats[edit]
  • Reduce backlog regarding Wikistats traffic (squid etc) scripts [stefan]
  • Repair data errors in wikistats, and add process for checking data integrity [ezachte] (Sept)
  • Make wikistats more robust (MoM validations) [ezachte]
  • Add Blackbox testing to WikiStats [diederik + ezachte]
Infrastructure[edit]
  • Access/support requests for stat1, stat1001 [otto] (Ongoing)
  • Migrate Reportcard off Labs onto stat1001 -- reportcard.wikimedia.org [otto + dsc] (Oct)
  • Maintenance of oxygen/emery/locke [otto] (Ongoing)
Data Releases[edit]
  • Publish Monthly Report Card -- deal with monthly data processing irregularities, perform correction/validation [ezachte + diederik + dsc] (Ongoing)
  • Create Data Release Practices Task Force [diederik]
  • Start pushing datasets to AWS [diederik]
  • Finalize scripts to massively compact dammit.lt data [erik]
    • Blogpost about what awesome stuff you can do with this [diederik + ?]


Engineering Community Team[edit]

  • Bug Wrangling [Andre + volunteers] -- ongoing
    • Updating BZ maintenance documentation [Andre] -- in progress
  • Followup from events [Sumana] -- ongoing
    • Followup on Grace Hopper
  • Tech Ambassadors Network [Guillaume] -- ongoing on meta
    • Volunteer product management program [Guillaume] -- being integrated into Tech/Ambassadors
  • Misc Engineering community proposals
    • 20% time [Sumana] -- ongoing - target 16 Nov - moved to November
    • CoC [Sumana] -- in process

i18n/L10n[edit]

  • Internationalization/Localization
    • Universal Language Selector
      • Version 1 development [IN PROGRESS]
      • User Experience / UI testing [ONGOING]
      • Technical documentation [IN PROGRESS]
    • Project Lassi: Translate UI/UX Improvements
      • User Experience / UI testing Round 1 [DONE]
      • UI design finalization for development [IN PROGRESS]
      • Prototype development [IN PROGRESS]
    • Translate API
      • API definition [On Hold]
    • Central Notice-Translate integration
      • Code changes DONE
      • Code review/testing: The i18n team has put this integration project on hold until availability from fundraising engineers to complete code review for deployment. ON HOLD
      • Deployment - scheduled for next sprint SCHEDULED
    • Web Fonts
      • Adding languages [ONGOING]
    • Narayam
      • Adding input methods for other languages [ONGOING]
    • Project Milkshake
      • Design specification, API specification, Documentation [ONGOING]
      • jQuery.i18n Development [IN PROGRESS]
      • jQuery.uls Development [IN PROGRESS]
      • jQuery.ime Development [IN PROGRESS]
      • jQuery.webfonts Development [IN PROGRESS]
      • Technical documentation [DONE]
    • Language search
      • Initial analysis [DONE]
      • Prototype initial concept [IN PROGRESS]
      • Integration into ULS [IN PROGRESS]
    • Standards participation
      • Comments on ARB Specification [DONE]
    • Language Summit
      • Preparation for November 6-7 Language Summit [IN PROGRESS]
    • Language Team Community Meetup
      • Language Team Pune Meetup Nov 4 [IN PROGRESS]
      • Language Team Bangalore Meetup Nov 9 [IN PROGRESS]
    • India DevCamp
      • Preparation of Topics for DevCamp [IN PROGRESS]
      • Registration now open [IN PROGRESS]