Talk:Post-edit feedback

This reminds me of the EditSimilar extension, which Wikia built several years ago (though they no longer use it). It might be worth of looking into that extension and seeing if there's something that could be reused instead of trying to reinvent the wheel from scratch. :-) --Jack Phoenix _(Contact) 17:58, 12 June 2012 (UTC)

Thanks Jack! At this point we don't want to use this to deliver task recommendations, just to be clear. Steven Walling (WMF) • talk 18:57, 12 June 2012 (UTC)

Testing

Experiment #0 (Dry Run)

1. Does experiment comply with functional reqs N/A Steven Walling (WMF) • talk 20:01, 24 July 2012 (UTC)
2. Perform cross browser check N/A Steven Walling (WMF) • talk 20:01, 24 July 2012 (UTC)
3. Verify bucketed experience - users in experiment receive correct treatment  Done - Steven Walling (WMF) • talk 16:48, 24 July 2012 (UTC)
4. Verify bucketed experience - users in control group receive correct treatment  Done - Steven Walling (WMF) • talk 16:48, 24 July 2012 (UTC)
5. Verify non-bucket experience - users not in the experiment experience standard WP experience  Done - Steven Walling (WMF) • talk 16:48, 24 July 2012 (UTC)
6. Data verification - is all data being stored in the right place and in the right way?  Done (Note: there are some issues Dario identified that need to be dealt with.) Steven Walling (WMF) • talk 16:48, 24 July 2012 (UTC)
7. Test articles with special elements - semi protected, coordinates, featured articles, infoboxes  Done - Steven Walling (WMF) • talk 17:25, 24 July 2012 (UTC)
8. Test articles with special characters perform appropriately (incl. in title)  Done Steven Walling (WMF) • talk 16:48, 24 July 2012 (UTC)
9. Test redirected articles perform appropriately  Done Steven Walling (WMF) • talk 16:48, 24 July 2012 (UTC)
10. Test disambiguation pages perform appropriately  Done Steven Walling (WMF) • talk 16:48, 24 July 2012 (UTC)
11. Test correct limiting of experience by namespace (depending on reqs)  Done - Steven Walling (WMF) • talk 16:48, 24 July 2012 (UTC)
12. Test with major gadgets turned on - no conflicts. esp. applies to Twinkle and Navigation Popups N/A Steven Walling (WMF) • talk 00:08, 25 July 2012 (UTC)
13. Test in other popular skins, esp. Monobook  Done Steven Walling (WMF) • talk 16:48, 24 July 2012 (UTC)
14. Test performance on long articles and/or other long pages if applicable  Done Steven Walling (WMF) • talk 16:54, 24 July 2012 (UTC)
15. Verify that opt-out is respected  Done - Steven Walling (WMF) • talk 16:48, 24 July 2012 (UTC)

Experiment #1 (confirmation vs. gratitude)

1. Does experiment visually comply with design reqs  Done Steven Walling (WMF) • talk 20:33, 26 July 2012 (UTC)
2. Does experiment comply with workflow/UI reqs  Done Steven Walling (WMF) • talk 20:33, 26 July 2012 (UTC)
3. Does experiment comply with functional reqs  Done Steven Walling (WMF) • talk 21:25, 25 July 2012 (UTC)
4. Perform cross browser check (See spreadsheet for details)  Done Steven Walling (WMF) • talk 20:33, 26 July 2012 (UTC)
5. Verify bucketed experience - users in experiment receive correct treatment   Done Steven Walling (WMF) • talk 21:25, 25 July 2012 (UTC)
6. Verify bucketed experience - users in control group receive correct treatment  Done Steven Walling (WMF) • talk 21:25, 25 July 2012 (UTC)
7. Verify non-bucket experience - users not in the experiment experience standard WP experience  Done Steven Walling (WMF) • talk 21:25, 25 July 2012 (UTC)
8. Data verification - is all data being stored in the right place and in the right way?   Done Steven Walling (WMF) • talk 00:10, 27 July 2012 (UTC)
9. Test articles with special elements - semi protected, coordinates, featured articles, infoboxes  Done Steven Walling (WMF) • talk 21:25, 25 July 2012 (UTC)
10. Test articles with special characters perform appropriately (incl. in title)   Done Steven Walling (WMF) • talk 21:25, 25 July 2012 (UTC)
11. Test redirected articles perform appropriately  Done Steven Walling (WMF) • talk 06:41, 26 July 2012 (UTC)
12. Test disambiguation pages perform appropriately N/A
13. Test correct limiting of experience by namespace (depending on reqs) N/A
14. Test with major gadgets turned on - no conflicts. esp. applies to Twinkle and Navigation Popups N/A (New users only, unlikely to use these)
15. Test in other popular skins, esp. Monobook N/A (brand-new users in the experiment probably won't be switching skins)
16. Test performance on long articles and/or other long pages if applicable  Done Steven Walling (WMF) • talk 20:33, 26 July 2012 (UTC)
17. Verify that opt-out is respected  Done Steven Walling (WMF) • talk 06:41, 26 July 2012 (UTC)

Experiment #2 (historical feedback)

1. Does experiment visually comply with design reqs  Done Steven Walling (WMF) • talk 16:48, 17 September 2012 (UTC)
2. Does experiment comply with workflow/UI reqs  Done Steven Walling (WMF) • talk 00:11, 13 September 2012 (UTC)
3. Does experiment comply with functional reqs  Done Steven Walling (WMF) • talk 00:11, 13 September 2012 (UTC)
4. Verify bucketed experience - users in experiment receive correct treatment  Done Steven Walling (WMF) • talk 00:11, 13 September 2012 (UTC)
5. Verify bucketed experience - users in control group receive correct treatment  Done Steven Walling (WMF) • talk 23:44, 10 September 2012 (UTC)
6. Verify non-bucket experience - users not in the experiment experience standard WP experience  Done Steven Walling (WMF) • talk 00:23, 11 September 2012 (UTC)
7. Verify that opt-out is respected  Done Steven Walling (WMF) • talk 23:44, 10 September 2012 (UTC)
8. Test in other popular skins, esp. Monobook  Done Steven Walling (WMF) • talk 16:48, 17 September 2012 (UTC)
9. Test articles with special elements - semi-protected, coordinates, featured articles, infoboxes N/A Steven Walling (WMF) • talk 00:30, 6 September 2012 (UTC)
10. Test articles with special characters perform appropriately (incl. in title)
11. Test redirected articles perform appropriately N/A Steven Walling (WMF) • talk 00:24, 13 September 2012 (UTC)
12. Test page creation performs appropriately  Done Steven Walling (WMF) • talk 00:11, 13 September 2012 (UTC)
13. Test correct limiting of experience by namespace (none, in this case)  Done Steven Walling (WMF) • talk 00:11, 13 September 2012 (UTC)
14. Test performance on long articles and/or other long pages if applicable. N/A Steven Walling (WMF) • talk 00:30, 6 September 2012 (UTC)
15. Perform cross browser check  Done Steven Walling (WMF) • talk 16:48, 17 September 2012 (UTC)
16. Data verification - is all data being stored in the right place and in the right way? N/A (Data being used is revision and user tables.) Steven Walling (WMF) • talk 16:48, 17 September 2012 (UTC)

Issues

This is just a log of issues dealt with during testing, mostly all fixed:

1. Post-edit feedback (2) looks slightly broken in IE7 (and presumably IE6 as well). As these combined are less than 5% or less of our logged in visits, we've decided to not delay deployment to wait for fixes. Previous tries at simple fixes like bumping up the z index failed to work, and this is apparently a known IE7 bug. Steven Walling (WMF) • talk 23:53, 18 September 2012 (UTC)

Alternate designs

• Confirmation and gratitude
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 

• Historical feedback
• 
• 
• 
• 
• 
• 

Duration

I'm not sure where to put suggestions, but I guess here is fine: the current 2-second notification seems a bit short to me, maybe make it a few seconds longer? Regards, SPQRobin (talk) 21:13, 27 October 2012 (UTC)

We originally tested it at three-five seconds. Five was too long, but bumping it up one second is probably appropriate. Thanks, Steven Walling (WMF) • talk 18:27, 29 October 2012 (UTC)