Talk:Post-edit feedback

From MediaWiki.org
Jump to navigation Jump to search

This reminds me of the EditSimilar extension, which Wikia built several years ago (though they no longer use it). It might be worth of looking into that extension and seeing if there's something that could be reused instead of trying to reinvent the wheel from scratch. :-) --Jack Phoenix (Contact) 17:58, 12 June 2012 (UTC)

Thanks Jack! At this point we don't want to use this to deliver task recommendations, just to be clear. Steven Walling (WMF) • talk 18:57, 12 June 2012 (UTC)

Testing[edit]

Experiment #0 (Dry Run)[edit]

  1. Does experiment comply with functional reqs N/A Steven Walling (WMF) • talk 20:01, 24 July 2012 (UTC)
  2. Perform cross browser check N/A Steven Walling (WMF) • talk 20:01, 24 July 2012 (UTC)
  3. Verify bucketed experience - users in experiment receive correct treatment Yes Done - Steven Walling (WMF) • talk 16:48, 24 July 2012 (UTC)
  4. Verify bucketed experience - users in control group receive correct treatment Yes Done - Steven Walling (WMF) • talk 16:48, 24 July 2012 (UTC)
  5. Verify non-bucket experience - users not in the experiment experience standard WP experience Yes Done - Steven Walling (WMF) • talk 16:48, 24 July 2012 (UTC)
  6. Data verification - is all data being stored in the right place and in the right way? Yes Done (Note: there are some issues Dario identified that need to be dealt with.) Steven Walling (WMF) • talk 16:48, 24 July 2012 (UTC)
  7. Test articles with special elements - semi protected, coordinates, featured articles, infoboxes Yes Done - Steven Walling (WMF) • talk 17:25, 24 July 2012 (UTC)
  8. Test articles with special characters perform appropriately (incl. in title) Yes Done Steven Walling (WMF) • talk 16:48, 24 July 2012 (UTC)
  9. Test redirected articles perform appropriately Yes Done Steven Walling (WMF) • talk 16:48, 24 July 2012 (UTC)
  10. Test disambiguation pages perform appropriately Yes Done Steven Walling (WMF) • talk 16:48, 24 July 2012 (UTC)
  11. Test correct limiting of experience by namespace (depending on reqs) Yes Done - Steven Walling (WMF) • talk 16:48, 24 July 2012 (UTC)
  12. Test with major gadgets turned on - no conflicts. esp. applies to Twinkle and Navigation Popups N/A Steven Walling (WMF) • talk 00:08, 25 July 2012 (UTC)
  13. Test in other popular skins, esp. Monobook Yes Done Steven Walling (WMF) • talk 16:48, 24 July 2012 (UTC)
  14. Test performance on long articles and/or other long pages if applicable Yes Done Steven Walling (WMF) • talk 16:54, 24 July 2012 (UTC)
  15. Verify that opt-out is respected Yes Done - Steven Walling (WMF) • talk 16:48, 24 July 2012 (UTC)

Experiment #1 (confirmation vs. gratitude)[edit]

  1. Does experiment visually comply with design reqs Yes Done Steven Walling (WMF) • talk 20:33, 26 July 2012 (UTC)
  2. Does experiment comply with workflow/UI reqs Yes Done Steven Walling (WMF) • talk 20:33, 26 July 2012 (UTC)
  3. Does experiment comply with functional reqs Yes Done Steven Walling (WMF) • talk 21:25, 25 July 2012 (UTC)
  4. Perform cross browser check (See spreadsheet for details) Yes Done Steven Walling (WMF) • talk 20:33, 26 July 2012 (UTC)
  5. Verify bucketed experience - users in experiment receive correct treatment  Yes Done Steven Walling (WMF) • talk 21:25, 25 July 2012 (UTC)
  6. Verify bucketed experience - users in control group receive correct treatment Yes Done Steven Walling (WMF) • talk 21:25, 25 July 2012 (UTC)
  7. Verify non-bucket experience - users not in the experiment experience standard WP experience Yes Done Steven Walling (WMF) • talk 21:25, 25 July 2012 (UTC)
  8. Data verification - is all data being stored in the right place and in the right way?  Yes Done Steven Walling (WMF) • talk 00:10, 27 July 2012 (UTC)
  9. Test articles with special elements - semi protected, coordinates, featured articles, infoboxes Yes Done Steven Walling (WMF) • talk 21:25, 25 July 2012 (UTC)
  10. Test articles with special characters perform appropriately (incl. in title)  Yes Done Steven Walling (WMF) • talk 21:25, 25 July 2012 (UTC)
  11. Test redirected articles perform appropriately Yes Done Steven Walling (WMF) • talk 06:41, 26 July 2012 (UTC)
  12. Test disambiguation pages perform appropriately N/A
  13. Test correct limiting of experience by namespace (depending on reqs) N/A
  14. Test with major gadgets turned on - no conflicts. esp. applies to Twinkle and Navigation Popups N/A (New users only, unlikely to use these)
  15. Test in other popular skins, esp. Monobook N/A (brand-new users in the experiment probably won't be switching skins)
  16. Test performance on long articles and/or other long pages if applicable Yes Done Steven Walling (WMF) • talk 20:33, 26 July 2012 (UTC)
  17. Verify that opt-out is respected Yes Done Steven Walling (WMF) • talk 06:41, 26 July 2012 (UTC)

Experiment #2 (historical feedback)[edit]

  1. Does experiment visually comply with design reqs Yes Done Steven Walling (WMF) • talk 16:48, 17 September 2012 (UTC)
  2. Does experiment comply with workflow/UI reqs Yes Done Steven Walling (WMF) • talk 00:11, 13 September 2012 (UTC)
  3. Does experiment comply with functional reqs Yes Done Steven Walling (WMF) • talk 00:11, 13 September 2012 (UTC)
  4. Verify bucketed experience - users in experiment receive correct treatment Yes Done Steven Walling (WMF) • talk 00:11, 13 September 2012 (UTC)
  5. Verify bucketed experience - users in control group receive correct treatment Yes Done Steven Walling (WMF) • talk 23:44, 10 September 2012 (UTC)
  6. Verify non-bucket experience - users not in the experiment experience standard WP experience Yes Done Steven Walling (WMF) • talk 00:23, 11 September 2012 (UTC)
  7. Verify that opt-out is respected Yes Done Steven Walling (WMF) • talk 23:44, 10 September 2012 (UTC)
  8. Test in other popular skins, esp. Monobook Yes Done Steven Walling (WMF) • talk 16:48, 17 September 2012 (UTC)
  9. Test articles with special elements - semi-protected, coordinates, featured articles, infoboxes N/A Steven Walling (WMF) • talk 00:30, 6 September 2012 (UTC)
  10. Test articles with special characters perform appropriately (incl. in title)
  11. Test redirected articles perform appropriately N/A Steven Walling (WMF) • talk 00:24, 13 September 2012 (UTC)
  12. Test page creation performs appropriately Yes Done Steven Walling (WMF) • talk 00:11, 13 September 2012 (UTC)
  13. Test correct limiting of experience by namespace (none, in this case) Yes Done Steven Walling (WMF) • talk 00:11, 13 September 2012 (UTC)
  14. Test performance on long articles and/or other long pages if applicable. N/A Steven Walling (WMF) • talk 00:30, 6 September 2012 (UTC)
  15. Perform cross browser check Yes Done Steven Walling (WMF) • talk 16:48, 17 September 2012 (UTC)
  16. Data verification - is all data being stored in the right place and in the right way? N/A (Data being used is revision and user tables.) Steven Walling (WMF) • talk 16:48, 17 September 2012 (UTC)

Issues[edit]

This is just a log of issues dealt with during testing, mostly all fixed:

  1. Post-edit feedback (2) looks slightly broken in IE7 (and presumably IE6 as well). As these combined are less than 5% or less of our logged in visits, we've decided to not delay deployment to wait for fixes. Previous tries at simple fixes like bumping up the z index failed to work, and this is apparently a known IE7 bug. Steven Walling (WMF) • talk 23:53, 18 September 2012 (UTC)

Alternate designs[edit]

Duration[edit]

I'm not sure where to put suggestions, but I guess here is fine: the current 2-second notification seems a bit short to me, maybe make it a few seconds longer? Regards, SPQRobin (talk) 21:13, 27 October 2012 (UTC)

We originally tested it at three-five seconds. Five was too long, but bumping it up one second is probably appropriate. Thanks, Steven Walling (WMF) • talk 18:27, 29 October 2012 (UTC)