User:Sharihareswara (WMF)/archivedectmeetings Mar2013

mobile file upload testing
How many people did we get in the exercise? (see http://www.mediawiki.org/wiki/Mobile_QA/Commons_uploads for rough stats )
 * Quim to follow up

Success:
 * how many people downloaded app for Android, weekly build & Google Play, how many people testing iOS app, how many people ewnt into beta mode & uploaded from mobile web, & how many bug reports filed that week (and how many from employees & non-). Also, was Commons community aware & involved?
 * We did get strong + & - opinions from Commons folks in their Village Pump.
 * After Quim gets the data, let's talk about whether this was successful & why, & how to replicate
 * What made a difference? we had new releases - news during the week. Novelty attracts people.

Lua rollout
March 13th (Wed) across all Wikipedias
 * San Francisco Meetup on March 14: http://www.meetup.com/Wikipedia-Engineering-Meetup/events/106078042/ to be streamed live, put on YouTube
 * http://etherpad.wmflabs.org/pad/p/Lua
 * Sumana working with Jan & Brad
 * Quim working to talk to Lua community in Bay Area.
 * Reuse talk Brad gave at the TechTalk Hangout last week
 * QA? opportunity to test templates that have been ported

Everyone: Look at Village Pump:Technical on en.wp -- thread about 10-second timeout

Volunteer product management
Sumana to give Howie a description of how volunteer Product Managers have gotten involved, what costs/benefits have come with them.
 * Chris wants a subject matter expert for search to help Chris get feature acceptance tests for Search; RobLa is more interested in doing some triage around the Search components in BZ. Also we have Solr knowledge around WMF, so maybe Chris should just follow up with Ram.
 * MWSearch, Lucene Search, Lucene Search 2, and 1 more. Reasonably good page on wikitech.wikimedia.org . And bugs are intermittent, hard to reproduce

TODO: bug triage (Andre to initially groom list of bugs), Chris to talk to Ram to get understanding of feature, find out what info he needs to get some bugs solved.
 * RobLa thinks it's premature to run an event even 3 weeks from now. Once we get a search engineer hired, ready to start seriously moving to Solr, etc. is better.
 * Chad, Ram, Andre, maybe Chris to walk through the list to determine priority, deduplicate, clean up components. Chad can bring long-term perspective on search & on the BZ tickets. Maybe AFTER that, decide to run an event.

Followup included potential discussion of a Platform PM - very tentative.

Followup from quarterly review
Sumana to send summary to wikitech-l
 * CRM stuff - LCA. Also: Erik: ECT must come in the next quarter with an information architecture to structure all the technical volunteer engagement.
 * Quim started defining the problem -- these 2 are related. Intake, management of volunteers, evaluation of contribution.  Connects with OpenHatch followup.  We need to do some proper planning & subcontract the work.  Not trivial projects.
 * Chris to toss an idea to Quim about scalable communication.
 * We're trying to balance low-touch (scalable) with high-touch (mentorship) approaches, and leverage other groups. OpenHatch, SocialCoding4Good.  They all want small tasks; several, like OPW & SocialCoding4Good, also want mentorship program ideas.
 * Weekend Testing Americas has new leadership and is rebooting their practice, Chris had a first conversation with new leadership Mar 4 about a possible collaboration. WTA has exercise 1st Saturday every month.
 * Quim hopes to have good solution by Dec 31 2013
 * Quim planning to subcontract work on
 * Redesign of some key mediawiki.org pages to get a fluent intake of contributors (ref "information architecture").
 * "CRM" aka volunteers management. - http://www.mediawiki.org/wiki/User:Qgil/Contributors
 * Automated metrics to evaluate all of the above.

Work with LCA re community advocates
 * Sumana ought to chat with Maggie & Philippe while they're here in SF

LCA warns re danger if code of conduct is imposed from above Work with OpenStack to see what metrics they're using?
 * Quim to look into this next week

Hiring
Multimedia - there are 2 positions. https://wikimediafoundation.org/wiki/Job_openings

OPW interns
https://meta.wikimedia.org/wiki/Program_evaluation_basics:_the_program_impact_model
 * Valerie - describing flow of "how would I know how to report a bug" on en.wp, creating image
 * Maria - collecting data, creating a page to show researchers what kinds of data is available from WMF. MW group on DataHub
 * Lesson to ourselves? Monthly reports to be required in future programs, to connect with the Wikimedia movement practice of monthly reports.

Vacations, conferences, etc.
This Friday is Open Source Bridge talk deadline

Željko: Chris: Valerie looking for an idea for Grace Hopper - March 15th is deadline
 * Amsterdam Hackathon 24-26 May
 * Selenium Conference June 10-12
 * Submitted a talk for a local open source conference (15-17 May)
 * Planning to submit a talk for another local conference (06-07 September)
 * Mar 11 (Jury duty)
 * Mar 18 (PTO)
 * Apr 22-25 (Google Test Automation Conference, NYC)
 * May 2-5 (Telerik Test Summit Peer Conference, Austin TX)
 * Amsterdam Hackathon

People care about our statuses!

 * New category: https://www.mediawiki.org/wiki/Category:Project_status
 * RSS feed: https://www.mediawiki.org/w/index.php?title=Special:RecentChangesLinked/Category:Project_status&feed=rss&target=Category%3AProject_status
 * Discussion: https://www.mediawiki.org/wiki/Project:Current_issues#Categorize_.22.2Fstatus.22_subpages_24401
 * Are there any analytics? how do we know people are reading?
 * Someone cared enough to do the above. :-)
 * Pull this kind of fresh activity to the mediawiki.org homepage

March 12th agenda
Quim: drafting https://www.mediawiki.org/wiki/User:Qgil/Contributors - early feedback welcome.

mobile file upload testing
Was the mobile team happy? was it useful?
 * yes. It was a release-like experience - public pressure from real users. Helped them understand what they have for users.
 * We ought to narrow the topic *further* - mobile app OR mobile web.

For testing activities, CLEAR STEPS ARE ESSENTIAL.
 * It wasn't obvious whether people needed to be registered. It's not trivial for the average Wikipedia user to figure that out.
 * Maybe the first exercise should have been signin/register workflow. AND ONLY THAT.

What were the numbers? After Quim gets the data, let's talk about whether this was successful & why, & how to replicate http://www.mediawiki.org/wiki/Mobile_QA/Commons_uploads#Results We don't know how many people were involved.
 * We'll have better data this week because Željko, Quim & Chris will be the ones who already have that data
 * In the future, predefine what data we want so we can get it from partner teams better

This week's search exercise
QA: Browser automation testing for Wikipedia Search http://www.mediawiki.org/wiki/QA/Browser_testing/Search_features What are the success metrics?
 * Chris would like to see ~10 edits to the backlog page http://www.mediawiki.org/wiki/Qa/test_backlog
 * How many people whom we didn't expect make the edits? And how many of them are not WMFers?
 * Goal: 5 scenarios written by 5 volunteers

for the next one, let's get it together further in advance.

Lua rollout
March 13th. Just be aware. https://blog.wikimedia.org/2013/03/11/lua-templates-faster-more-flexible-pages/ - community-focused post
 * Sumana drafting technical post for this Wed.

OPW
Quim: final showcase/meeting?
 * Valerie finishing blog post
 * Mariya working on draft of data sources guide, FAQ
 * Next week: Quim meeting each mentor/mentee pair to ask how things are going; last week, a get-together

Misc
OSBridge talk deadline extended http://opensourcebridge.org/blog/2013/03/were-extending-our-call-for-proposals/ Saturday, March 23 at 11:59 p.m.

Consider http://2013.texaslinuxfest.org/, Valerie!

Željko: Chris: Valerie looking for an idea for Grace Hopper - March 15th is deadline Time off:
 * May 24-26, Amsterdam Hackathon
 * June 10-12, Selenium Conference
 * Submitted talks/workshops for a couple of local open source conferences, waiting for reply (May 15-17, September 06-07)
 * Mar 11 (Jury duty)
 * Mar 18 (PTO)
 * Apr 22-25 (Google Test Automation Conference, NYC)
 * May 2-5 (Telerik Test Summit Peer Conference, Austin TX)
 * May 24-26 Amsterdam Hackathon
 * Aug 4-10 Agile2013 (not certain but likely)
 * Chris: day off Mar 18
 * Sumana: day off this Thursday Mar 14

General requests

 * Come to the Bugzilla office hours today
 * Comments on the expanded version of https://www.mediawiki.org/wiki/Product_development and the new version of https://www.mediawiki.org/wiki/How_to_contribute ?
 * Note: events on https://www.mediawiki.org/wiki/Project:Calendar (and related pages) now support events spanning multiple days, using the "enddate" parameter
 * Skim the open tasks https://www.mediawiki.org/wiki/Product_development in case you have anything to add!
 * IRC bug triage today re LQT (and a blog post! https://blog.wikimedia.org/2013/03/19/help-wikimedia-squash-software-bugs/ )
 * Are we using #wikimedia-office per  https://www.mediawiki.org/wiki/User:Sharihareswara_%28WMF%29/archivedectmeetings_Feb2013#Wikimedia_QA_IRC_channel_or_mail_list_or_open_other_direct_channels.3F ?
 * Go ahead and greet every person who shows up even if it feels a little foolish
 * Check out https://docs.google.com/a/wikimedia.org/spreadsheet/ccc?key=0Agte_lJNpi-OdGpJSHdMZV83UjdTdHc5UFVrdXBwaWc#gid=0 -- ensuring we test a variety of features and balance testability, urgency,  movement goals, etc.? (Including exploratory testing & test  automation)
 * Check Measuring success of QA activities: http://www.mediawiki.org/wiki/QA/Strategy#Measuring_success

Previous volunteer events
Mobile upload: https://www.mediawiki.org/wiki/Mobile_QA/Commons_uploads#Results

Number of people who tried to upload at least one picture (new users): 34. 9 for iOS and 28 for Android.

21 non-WMF people used the mobile web upload features, and they uploaded a total of 30 images.

QA: Browser automation testing for Wikipedia Search http://www.mediawiki.org/wiki/QA/Browser_testing/Search_features Was it successful? https://www.mediawiki.org/wiki/QA/Browser_testing/Search_features#Evaluation In the future: let's try doing it in longer form, not so synchronous
 * Chris wanted to see ~10 edits to the backlog page http://www.mediawiki.org/wiki/Qa/test_backlog
 * 6 scenarios added from the exercise
 * How many people whom we didn't expect make the edits? And how many of them are not WMFers? Goal: 5 scenarios written by 5 volunteers
 * 7 participants, one not connected to WMF
 * "7" includes Valerie & Sucheta.
 * Note: the IRC channel was observed, and at least one non-participant IRC observer complimented the exercise.

Next volunteer event
What's the next exercise? https://www.mediawiki.org/wiki/Project:Calendar  How will we do outreach?
 * Features testing partnering with Weekend Testing scheduled Apr 6, targeting E3 projects "New Tools for New Users" or similar . Public announcements week of Mar 25.
 * predefine what data we want so we can get it from partner teams better

OPW wrapup

 * Quim has set up meetings with all mentor/mentee pairs, an all-hands at end

Search bugs
Search is nominally functioning on beta labs, but should be tested using enwiki as a reference. https://bugzilla.wikimedia.org/show_bug.cgi?id=34250 Andre at some point wants to push for consensus to reduce # of search components in BZ
 * Andre would like to clarify: Are we (Chris, Ram, Andre, etc) fine with http://www.mediawiki.org/wiki/Search and https://wikitech.wikimedia.org/wiki/User:Ram, the current status of bug reports after initial cleanup, and Search testing infrastructure [plans], or is there any further discussion or meeting wanted by involved parties?
 * http://www.mediawiki.org/wiki/User:Cmcmahon(WMF)/Search_bugs_draft
 * Of these 4 components, 2 deal with Lucene
 * move to subpage of Search
 * Chris would like to know from Ram what bugs are to be addressed in the very near future.
 * Andre, what are the candidates for fixing in the very near term? (before we switch to Solr.)
 * Let's aim to document the weird ways search works now so we can decide on behavior for the future.
 * ask Ram & Chad

Bugzilla admin rights
From February conversation:
 * Come up with guidelines and requirements who should be Bugzilla admin and why. Nothing in place currently, number growing -> coordination  and security issue, plus do non-employees need an NDA? RFC planned for  later this week by Andre.

Followup?
 * No feedback by Geoff. Philippe said that an NDA is definitely needed (Bugzilla admin = access to Security bug reports), and "whether we want to even allow it" (non-WMF Bugzilla admins) "at all, that's an Engineering decision", so the ball is back in our court.
 * Is it possible to have a lower level of access than admin that will still be helpful?
 * Decision: Andre to come up with proposed policy and bring it up at an Ops meeting, where they will probably agree, and then implement it.

Vacations & conferences
Andre: OSBridge talk deadline extended http://opensourcebridge.org/blog/2013/03/were-extending-our-call-for-proposals/ Saturday, March 23 at 11:59 p.m. Texas Linux Fest: deadline April 1st
 * Easter Holidays from Fri March29 - Mon April01 (that's public holidays here)
 * maybe https://www.mediawiki.org/wiki/How_to_contribute/Presentation ?

Consider http://2013.texaslinuxfest.org/, Valerie! Željko:

out of office for Platform Engineering team meeting this week, attending local bi-monthly software tester's meetup

May 24-26, Amsterdam Hackathon

June 10-12, Selenium Conference

Submitted talks/workshops for a couple of local open source conferences, waiting for reply (May 15-17, September 06-07)

Chris:

Apr 22-25 (Google Test Automation Conference, NYC)

May 2-5 (Telerik Test Summit Peer Conference, Austin TX)

May 24-26 Amsterdam Hackathon

Aug 4-10 Agile2013 (not certain but likely)

Sumana:
 * Somewhat out of communication Thursday & Friday due to SMWCon in NYC

On communicating changes (volunteers)

 * Do we know what caused Niklas' thread "Who is responsible for communicating changes in MediaWiki to WMF sites?"
 * Quim: It's difficult to offer a good solution when the problem that triggers a complaint is unknown.
 * btw expect a follow up from me (guillaume) about this general topic later today (started independently)

Security training
Security for developers/Training - what were the outcomes? http://www.mediawiki.org/wiki/Security_for_developers/Training http://lists.wikimedia.org/pipermail/wikitech-l/2013-March/067756.html


 * Mix of people - newcomers & seasoned developers. 14 active participants speaking. ~15 people seemed to join to lurk
 * Some hadn't watched video ahead of time - need more reminders?
 * People helped each other

Since Chris didn't have to prepare AT ALL, this had great ROI.

Is this a good model to copy for QA, performance, or other topics where we have existing slides/video/tutorial docs?
 * we have a narrated slideshow & some other videos from QA
 * Lua
 * Git/Gerrit

Need videos for the future
Chris wants there to be a test coverage thing someday https://integration.wikimedia.org/cover/mediawiki-core/master/php/ but there's no video yet

We ought to have some videos about performance

QA priorities, measuring success

 * Check out https://docs.google.com/a/wikimedia.org/spreadsheet/ccc?key=0Agte_lJNpi-OdGpJSHdMZV83UjdTdHc5UFVrdXBwaWc#gid=0 -- ensuring we test a variety of features and balance testability,  urgency, movement goals, etc.? (Including exploratory testing & test  automation)
 * Based on the spreadsheet, Quim has proposed to have the next browser automation goal about ACUX, following its release and manual testing week. Waiting for confirmation from Zeljko / Chris / Steven. (Meeting later today to discuss the Apr6 ET exercise, we'll discuss this as well)
 * Existing browser tests for GuidedTour have found two regression issues so far, so this is a high value project.


 * Check Measuring success of QA activities: http://www.mediawiki.org/wiki/QA/Strategy#Measuring_success
 * Check/join the ongoing discussion to apply this to Bug Days (Bug Weeks?): https://www.mediawiki.org/wiki/Talk:QA/Strategy
 * Let's all get this finished this week.

Followup from quarterly review

 * Sumana still needs to send brief summary to wikitech-l
 * Work with OpenStack to see what metrics they're using - did Quim look into this?
 * Discussed with Ryan Lane, who proposed this idea. They are working on user dashboards showing basically their gerrit stats. Not related to MediaWiki so far. We decided to focus first on improving user profiles via https://www.mediawiki.org/wiki/User:Qgil/Contributors#People Not particularly applicable to us; ok to let this go.
 * About Metrics, Quim plans to subcontract the development of automated stats, but first we need to answer the question: what questions do we want to answer with metrics? what type of decisions do we want to make using metrics? Otherwise we risk to do just a collection of factoids not influencing our planning. But I need to have hands (a bit more) free to plan this.

Using statuses better
Pull this kind of fresh activity to the mediawiki.org homepage?
 * Some of the statuses are incomprehensible -- maybe exposing them and ensuring they are used (someplace public and constant, like a feed) would cause people to write better updates?
 * Possible risk: teams won't use them as much? fewer but more PR-y updates, less frequent, thus maybe less useful internally

Possible Lua hobby project to actually pull the statuses someplace

New category: https://www.mediawiki.org/wiki/Category:Project_status

RSS feed: https://www.mediawiki.org/w/index.php?title=Special:RecentChangesLinked/Category:Project_status&feed=rss&target=Category%3AProject_status

Discussion: https://www.mediawiki.org/wiki/Project:Current_issues#Categorize_.22.2Fstatus.22_subpages_24401

BTW, Guillaume & Quim to transclude project calendar onto home page (obsolete stuff there right now)
 * The functionality itself was added a month ago: https://www.mediawiki.org/wiki/Template_talk:New_opportunities/Content

RobLa on high-priority escalation

 * https://bugzilla.wikimedia.org/46401
 * Big JavaScript regression. Need Krinkle's help
 * Hard to reproduce.
 * First report on the 20th, bug murmurs on Commons over 23rd/24th weekend, then got more input & more useful data (actual error message from JS console)
 * Probably need to revert some of Timo's code
 * May need to send a note to wikitech-ambassadors (heads-up Guillaume)

GSOC mentors

 * Quim expected more responses from WMF teams (combined with LevelUp), but I'm impressed by the initiative of some WMF individuals. Maybe they will respond if/when students' proposals show up in their area?
 * https://www.mediawiki.org/wiki/Summer_of_Code_2013
 * http://www.mediawiki.org/wiki/Talk:Mentorship_programs/Possible_projects#GSOC_2013_candidates_missing_one_thing_or_two_25493

Vacations & conferences
Andre:


 * Easter Holidays from Fri March29 - Mon April01 (that's public holidays here)
 * maybe Open Source Bridge Conference, Portland, June 18–21, 2013

Texas Linux Fest: deadline April 1st - http://2013.texaslinuxfest.org/, Valerie!
 * maybe https://www.mediawiki.org/wiki/How_to_contribute/Presentation ?
 * https://www.mediawiki.org/wiki/Events/FOSDEM/2013_-_Lightning_-_Qgil

Željko: Chris:
 * May 24-26, Wikimedia Hackathon, Amsterdam, Netherlands
 * June 10-12, Selenium Conference, Boston, MA, USA
 * Submitted talks/workshops for a couple of local open source conferences, waiting for reply (May 15-17, September 06-07)
 * Apr 22-25 (Google Test Automation Conference, NYC)
 * May 2-5 (Telerik Test Summit Peer Conference, Austin TX)
 * May 24-26, Wikimedia Hackathon, Amsterdam, Netherlands
 * Aug 4-10 Agile2013 (not certain but likely)

Sumana:
 * Offline Thursday (train)