Talk:Post-edit feedback

This reminds me of the EditSimilar extension, which Wikia built several years ago (though they no longer use it). It might be worth of looking into that extension and seeing if there's something that could be reused instead of trying to reinvent the wheel from scratch. :-) --Jack Phoenix (Contact) 17:58, 12 June 2012 (UTC)
 * Thanks Jack! At this point we don't want to use this to deliver task recommendations, just to be clear. Steven Walling (WMF) &bull; talk   18:57, 12 June 2012 (UTC)

Experiment #0 (Dry Run)

 * 1) Does experiment comply with functional reqs N/A Steven Walling (WMF) &bull;  talk   20:01, 24 July 2012 (UTC)
 * 2) Perform cross browser check N/A Steven Walling (WMF) &bull;  talk   20:01, 24 July 2012 (UTC)
 * 3) Verify bucketed experience - users in experiment receive correct treatment ✅ - Steven Walling (WMF) &bull;  talk   16:48, 24 July 2012 (UTC)
 * 4) Verify bucketed experience - users in control group receive correct treatment  ✅ - Steven Walling (WMF) &bull;  talk   16:48, 24 July 2012 (UTC)
 * 5) Verify non-bucket experience - users not in the experiment experience standard WP experience ✅ - Steven Walling (WMF) &bull;  talk   16:48, 24 July 2012 (UTC)
 * 6) Data verification - is all data being stored in the right place and in the right way? ✅ (Note: there are some issues Dario identified that need to be dealt with.) Steven Walling (WMF) &bull;  talk   16:48, 24 July 2012 (UTC)
 * 7) Test articles with special elements - semi protected, coordinates, featured articles, infoboxes ✅ - Steven Walling (WMF) &bull;  talk   17:25, 24 July 2012 (UTC)
 * 8) Test articles with special characters perform appropriately (incl. in title) ✅ Steven Walling (WMF) &bull;  talk   16:48, 24 July 2012 (UTC)
 * 9) Test redirected articles perform appropriately ✅ Steven Walling (WMF) &bull;  talk   16:48, 24 July 2012 (UTC)
 * 10) Test disambiguation pages perform appropriately ✅ Steven Walling (WMF) &bull;  talk   16:48, 24 July 2012 (UTC)
 * 11) Test correct limiting of experience by namespace (depending on reqs) ✅ - Steven Walling (WMF) &bull;  talk   16:48, 24 July 2012 (UTC)
 * 12) Test with major gadgets turned on - no conflicts. esp. applies to Twinkle and Navigation Popups N/A Steven Walling (WMF) &bull;  talk   00:08, 25 July 2012 (UTC)
 * 13) Test in other popular skins, esp. Monobook ✅ Steven Walling (WMF) &bull;  talk   16:48, 24 July 2012 (UTC)
 * 14) Test performance on long articles and/or other long pages if applicable ✅ Steven Walling (WMF) &bull;  talk   16:54, 24 July 2012 (UTC)
 * 15) Verify that opt-out is respected ✅ - Steven Walling (WMF) &bull;  talk   16:48, 24 July 2012 (UTC)

Experiment #1 (confirmation vs. gratitude)

 * 1) Does experiment visually comply with design reqs ✅ <font style="font-family:Palatino, Georgia, serif;">Steven Walling (WMF) &bull;  talk   20:33, 26 July 2012 (UTC)
 * 2) Does experiment comply with workflow/UI reqs ✅ <font style="font-family:Palatino, Georgia, serif;">Steven Walling (WMF) &bull;  talk   20:33, 26 July 2012 (UTC)
 * 3) Does experiment comply with functional reqs ✅ <font style="font-family:Palatino, Georgia, serif;">Steven Walling (WMF) &bull;  talk   21:25, 25 July 2012 (UTC)
 * 4) Perform cross browser check (See spreadsheet for details) ✅ <font style="font-family:Palatino, Georgia, serif;">Steven Walling (WMF) &bull;  talk   20:33, 26 July 2012 (UTC)
 * 5) Verify bucketed experience - users in experiment receive correct treatment ￼ ✅ <font style="font-family:Palatino, Georgia, serif;">Steven Walling (WMF) &bull;  talk   21:25, 25 July 2012 (UTC)
 * 6) Verify bucketed experience - users in control group receive correct treatment ￼✅ <font style="font-family:Palatino, Georgia, serif;">Steven Walling (WMF) &bull;  talk   21:25, 25 July 2012 (UTC)
 * 7) Verify non-bucket experience - users not in the experiment experience standard WP experience ￼✅ <font style="font-family:Palatino, Georgia, serif;">Steven Walling (WMF) &bull;  talk   21:25, 25 July 2012 (UTC)
 * 8) Data verification - is all data being stored in the right place and in the right way? ￼ ✅ <font style="font-family:Palatino, Georgia, serif;">Steven Walling (WMF) &bull;  talk   00:10, 27 July 2012 (UTC)
 * 9) Test articles with special elements - semi protected, coordinates, featured articles, infoboxes ￼✅ <font style="font-family:Palatino, Georgia, serif;">Steven Walling (WMF) &bull;  talk   21:25, 25 July 2012 (UTC)
 * 10) Test articles with special characters perform appropriately (incl. in title) ￼ ✅ <font style="font-family:Palatino, Georgia, serif;">Steven Walling (WMF) &bull;  talk   21:25, 25 July 2012 (UTC)
 * 11) Test redirected articles perform appropriately ￼✅ <font style="font-family:Palatino, Georgia, serif;">Steven Walling (WMF) &bull;  talk   06:41, 26 July 2012 (UTC)
 * 12) Test disambiguation pages perform appropriately ￼N/A
 * 13) Test correct limiting of experience by namespace (depending on reqs) ￼N/A
 * 14) Test with major gadgets turned on - no conflicts. esp. applies to Twinkle and Navigation Popups N/A (New users only, unlikely to use these)
 * 15) Test in other popular skins, esp. Monobook  N/A  (brand-new users in the experiment probably won't be switching skins)
 * 16) Test performance on long articles and/or other long pages if applicable ✅ <font style="font-family:Palatino, Georgia, serif;">Steven Walling (WMF) &bull;  talk   20:33, 26 July 2012 (UTC)
 * 17) Verify that opt-out is respected ✅ <font style="font-family:Palatino, Georgia, serif;">Steven Walling (WMF) &bull;  talk   06:41, 26 July 2012 (UTC)

Issues
This is just a log of issues dealt with during testing, mostly all fixed:


 * 1) Registration date was not being picked up quickly and was having caching issues. Fixed now. This may be a bug in ResourceLoader.
 * 2) Width and height of the message was about three times too big. Fixed now.
 * 3) Post-edit was not registering as true when the edit was via undo. Fixed now.
 * 4) The X to dismiss the modal slowed down implementation and testing, so it was removed as non-essential.
 * 5) Server-side code signals to the JS browser code that the user is viewing a page post-edit by appending <tt>pe=1</tt> to the query string. This different URL is visible to all users who edit during the experiment, not just the small subset of eligible users who may see the feedback message. Attempted fix in.
 * 6) Feedback was only appearing in NS0. Fixed and went live at ~2:00pm Pacific time on Wednesday August 1.
 * 7) A save via the keybinding does not register as post-edit = true. We need to add post-edit tracking for the referrer   in addition to  . Needs fix, but note that the submit action is also the referrer for edits where a CAPTCHA is required, etc. (Decided to hold off on this until PEF2)