MediaWiki

Selenium/Ruby/Workshops/WTA ACUX Test Plan Apr 6

< Selenium | Ruby | Workshops

ping weekendtestersamericas on skype to join

Test plan for Weekend Testing Americas session on the new Account creation user experience: Saturday, April 6, 2013 5pm UTC - 1pm EDT - 10am PDT.

Weekend Testing Americas is a group of volunteers who are also very experienced software QA testers. We're going to be hunting for bugs in the new design of login and account creation on a testing environment setup in Wikimedia Labs.

The next step, after that testing and any relevant bug fixing, is to enable the new look on an opt-in basis via a URL parameter, across the Wikimedia projects, including Wikipedia. This will mean that editors will have the opportunity to test the new design on their home wiki and ensure there are no further bugs or problems with the localization, before we enable the changes as defaults.

This activity is also part of Wikimedia's QA weekly goals. You are invited to our upcoming activities!

Mockup of new account creation page
Mockup of new login page.

Objectives

edit

Platforms/Browsers of Interest

edit
  • IE7 and IE8/IE9 in "compatibility mode"
  • IE8
  • IE9
  • IE10
  • Firefox with and without "HTTPS-Everywhere" extension
  • Chrome
  • All browsers with and without "privacy/incognito" mode set
  • Also of interest: earlier versions of Firefox; Opera; also Safari

Test environments

edit

All the work will be done in testing environments. You can experiment at will.

Setup

edit
  • Be prepared to clear cache and appropriate cookies in browsers used for testing
  • Be prepared to use incognito/private mode in browsers used for testing
  • Create an account in Bugzilla https://bugzilla.wikimedia.org/ if you don't already have one
    • This is not strictly required, but recommended strongly for reporting issues

Test Charters and Features to be Tested

edit

In essence we are testing the new Login/Account Creation experience at http://toro.wmflabs.org/wiki/Special:UserLogin?useAgora=1 against the old experience at http://toro.wmflabs.org/wiki/Special:UserLogin

  • Account Creation: manually append &useAgora=1 to all URLs used for testing
    • Navigate to Account Creation page:
      • Use the link in the top right menu
      • Visit from Special:Search
      • Visit from the Main Page
      • Visit from a random content page
      • Visit from other namespaces like User: or Special:
      • Create account after invoking editor as anonymous user
  • New User login: manually append &useAgora=1 to all URLs used for testing
    • Navigate to Login page:
      • Use the link in the top right menu
      • Visit from Special:Search
      • Visit from the Main Page
      • Visit from a random content page
      • Visit from other namespaces like User: or Special:
    • Login after invoking editor as anonymous user
  • Behavior when cookies and cache are possibly polluted
  • Features documented in https://gerrit.wikimedia.org/r/#/c/55847 and https://bugzilla.wikimedia.org/show_bug.cgi?id=44628 (note the discussion on both issues)
    • Displays a "secure login" link if HTTPS is available.
    • Loads additional CSS for its form features (e.g. more attractive errorbox, "Join wiki" messaging).
    • Defines new "userlogin-xx" messages; many are the same as existing messages but without ':' on the end.
    • Uses a distinct title for Login instead of generic "Log in / Create account".
    • Outputs checkboxes using UserloginTemplateAgora::labelledCheck()
    • Removes the [mailmypassword] code branch from its login template as it is never executed.

Out of scope

edit
  • Mobile browsers
    • Tablet browsers that default to the desktop view and support javascript are in scope.
edit
  • Note: edits from this exercise will likely incur feedback and criticism, just as any edits from new users would. Significant support for new editors of Wikipedia is available at The Teahouse. http://en.wikipedia.org/wiki/Wikipedia:Teahouse
edit
  • Note: We will be using information gathered from this exercise to inform our next community browser testing event, writing Cucumber scenarios for these features. Feel free to join us! http://www.mediawiki.org/wiki/QA/Weekly_goals
  • Ongoing questions and support in the #wikimedia-dev connect IRC channel on Freenode: look for users chrismcmahon, qgil.

Reporting issues

edit

Evaluation

edit
PENDING. For an example, see QA/Browser testing/Search features#Evaluation.

★★★☆☆

  • Summary:
  • Results:
  • Participation: WMF? Wikimedia? Other?
    • New:
    • Repeating:
    • Mood:
  • Documentation:
  • Promotion:
  • Developer team:
  • Organizers:
  • Lessons learned:
Retrieved from "https://www.mediawiki.org/w/index.php?title=Selenium/Ruby/Workshops/WTA_ACUX_Test_Plan_Apr_6&oldid=3688206"