Selenium/Ruby/Workshops/WTA ACUX Test Plan Apr 6
This page is obsolete. It is being retained for archival purposes. It may document extensions or features that are obsolete and/or no longer supported. Do not rely on the information here being up-to-date. See Selenium instead. |
ping weekendtestersamericas on skype to join
Test plan for Weekend Testing Americas session on the new Account creation user experience: Saturday, April 6, 2013 5pm UTC - 1pm EDT - 10am PDT.
Weekend Testing Americas is a group of volunteers who are also very experienced software QA testers. We're going to be hunting for bugs in the new design of login and account creation on a testing environment setup in Wikimedia Labs.
The next step, after that testing and any relevant bug fixing, is to enable the new look on an opt-in basis via a URL parameter, across the Wikimedia projects, including Wikipedia. This will mean that editors will have the opportunity to test the new design on their home wiki and ensure there are no further bugs or problems with the localization, before we enable the changes as defaults.
This activity is also part of Wikimedia's QA weekly goals. You are invited to our upcoming activities!
Objectives
edit- Test the new Account creation user experience.
- Test the new Login user experience.
- General exploratory testing in various browsers
Platforms/Browsers of Interest
edit- IE7 and IE8/IE9 in "compatibility mode"
- IE8
- IE9
- IE10
- Firefox with and without "HTTPS-Everywhere" extension
- Chrome
- All browsers with and without "privacy/incognito" mode set
- Also of interest: earlier versions of Firefox; Opera; also Safari
Test environments
editAll the work will be done in testing environments. You can experiment at will.
- Default environment: http://toro.wmflabs.org/wiki/Special:UserLogin?useAgora=1
- Fallback: http://piramido.wmflabs.org/wiki/Special:UserLogin?useAgora=1
- also try targets for returnto e.g. http://toro.wmflabs.org/w/index.php?title=Special:UserLogin&returnto=Main+Page&useAgora=1
- Compare to existing login/account creation experience at http://test2.wikipedia.org/w/index.php?title=Special:UserLogin
Setup
edit- Be prepared to clear cache and appropriate cookies in browsers used for testing
- Be prepared to use incognito/private mode in browsers used for testing
- Create an account in Bugzilla https://bugzilla.wikimedia.org/ if you don't already have one
- This is not strictly required, but recommended strongly for reporting issues
Test Charters and Features to be Tested
editIn essence we are testing the new Login/Account Creation experience at http://toro.wmflabs.org/wiki/Special:UserLogin?useAgora=1 against the old experience at http://toro.wmflabs.org/wiki/Special:UserLogin
- Account Creation: manually append
&useAgora=1
to all URLs used for testing- Navigate to Account Creation page:
- Use the link in the top right menu
- Visit from Special:Search
- Visit from the Main Page
- Visit from a random content page
- Visit from other namespaces like User: or Special:
- Create account after invoking editor as anonymous user
- Navigate to Account Creation page:
- New User login: manually append
&useAgora=1
to all URLs used for testing- Navigate to Login page:
- Use the link in the top right menu
- Visit from Special:Search
- Visit from the Main Page
- Visit from a random content page
- Visit from other namespaces like User: or Special:
- Login after invoking editor as anonymous user
- Navigate to Login page:
- Behavior when cookies and cache are possibly polluted
- Features documented in https://gerrit.wikimedia.org/r/#/c/55847 and https://bugzilla.wikimedia.org/show_bug.cgi?id=44628 (note the discussion on both issues)
- Displays a "secure login" link if HTTPS is available.
- Loads additional CSS for its form features (e.g. more attractive errorbox, "Join wiki" messaging).
- Defines new "userlogin-xx" messages; many are the same as existing messages but without ':' on the end.
- Uses a distinct title for Login instead of generic "Log in / Create account".
- Outputs checkboxes using UserloginTemplateAgora::labelledCheck()
- Removes the [mailmypassword] code branch from its login template as it is never executed.
Out of scope
edit- Mobile browsers
- Tablet browsers that default to the desktop view and support javascript are in scope.
Recommended Procedures
edit- A secondary goal of this exercise is to improve the actual Wikipedia articles about software testing as a new user would.
- As a software tester and a new Wikipedia editor, I want to improve the Wikipedia articles on software testing so that others may benefit from my knowledge
- Some example pages to edit:
- Note: edits from this exercise will likely incur feedback and criticism, just as any edits from new users would. Significant support for new editors of Wikipedia is available at The Teahouse. http://en.wikipedia.org/wiki/Wikipedia:Teahouse
Background and related information
edit- Documentation and design information: https://www.mediawiki.org/wiki/Account_creation_user_experience
- Note: We will be using information gathered from this exercise to inform our next community browser testing event, writing Cucumber scenarios for these features. Feel free to join us! http://www.mediawiki.org/wiki/QA/Weekly_goals
- Features testing at Wikipedia: http://www.mediawiki.org/wiki/QA/Features_testing
- Features testing group for interested people: http://www.mediawiki.org/wiki/Groups/Proposals/Features_testing
- Ongoing questions and support in the #wikimedia-dev connect IRC channel on Freenode: look for users
chrismcmahon
,qgil
.
Reporting issues
edit- Use this link to file a report in Bugzilla https://bugzilla.wikimedia.org/enter_bug.cgi?product=MediaWiki&component=User%20login
- Product: MediaWiki
- Component: User login
- When creating a bugzilla ticket, make the title "WTA <your issue>" for help in triage later
- Discuss issues in WTA Skype channel and/or IRC channel freenode#wikimedia-dev
Evaluation
edit- PENDING. For an example, see QA/Browser testing/Search features#Evaluation.
★★★☆☆
- Summary:
- Results:
- Participation: WMF? Wikimedia? Other?
- New:
- Repeating:
- Mood:
- Documentation:
- Promotion:
- Developer team:
- Organizers:
- Lessons learned: