Mobile design/Usertesting

This page is for proposing usability testing on usertesting.com.

General parameters

• Follow the format below to submit a test idea
  • Not everything must be filled in, but the more the better

• There is no guarantee that your text can be run in the timeframe specified

• Development milestones will often dictate when a test should be run

• If some test ideas are similar, we will merge them

• Some editing of test ideas may be done to enhance suitability

• If a test idea is not suitable, a comment will be put here right under the proposed test title

• Once a test is run, the link to view the results will be posted here at the top of the proposed test section

Format and options

• The urgency and date by which you want the test to run
  • This is no guarantee we can run it by then

• Create a short URL on bit.ly (for mobile web tests)

• Choose mobile device:
  • iPhone
  • Android
  • Blackberry
  • iPad

• What are you testing?
  • App in a store
  • App not yet released or unavailable in store
    • for iPhone app not yet released:

1. You complete this signup form.
2. We'll find available users and email you their UDIDs.
3. You email your ad hoc app files to us.
4. We'll distribute the files to the users so they can do the test.

• Mobile website

• Number of users for test
  • A reasonable number for your testing, typically 3-4 users should suffice
  • We often start with one usually, to test the test

• Scenario:
  • 750 characters

• Tasks as they are recording the video:
  • 750 characters each
  • 4 by default, more can be added
  • The last task should be to go to useragentstring.com

• Questions, after they finish recording the video:
  • 4 fields only
  • In the last question, include: Visit useragentstring.com on your mobile browser and copy the user agent info here, if possible.

• Demographics:
  • Gender: Any (use highest rated testers), Male, Female
  • Web Expertise: Any (use highest rated testers), Average Web User, Advanced Web User
  • Country: Any (use highest rated testers), United States, United Kingdom, Canada

• Favorite users:
  • single field, presumably usernames, comma separated

• Other options:
  • Title for this job (optional)

• Your email address (if you are not comfortable leaving it on this page, email pchangwikimedia.org)

Easy test proposal

• Create a subpage (just open it and click save)
  
  
• Edit the page to add details for all of the information requested.
• When you are done with that, add yourself to the bottom of this page (with {{/Your Test Name}}).

Proposed tests

Wikipedia App Test 1

Initial result from 1 iPhone user: https://accounts.usertesting.com/TestResults.aspx?b7m2g2e8y7x6e8p4 or File:Wikipedia App Test 1 - iPhone 4S.ogv.

1 iPad user: https://accounts.usertesting.com/TestResults.aspx?j5k4w7i8w1a0l2n2 or File:Wikipedia App Test 1 - iPad.ogv

• Choose mobile device:
  • iPhone
  • Android
  • iPad

• What are you testing?
  • App in a store
    • Go to the App Store and search for the Wikipedia Mobile App. Download and install it.

• Number of users for test
  • 2 users iPhone, 2 users Android, 2 users iPad

• Scenario:
  • Please only accept this test if you have Twitter set up on your mobile device. You love using Wikipedia so much that you’d like to have an app dedicated to finding all the detailed information that you never know when you’re going to need. Good news! Wikipedia is available as an app on your mobile device.

• Tasks as they are recording the video:
  • Task 1: On your iPhone/iPad/Android Device open the brand new Wikipedia App that you just downloaded. You and your friends have been discussing the upcoming 2012 Summer Olympics and would like to find out more about it. Try to find the Wikipedia Article on this global event.
  • Task 2: See if you can find, staying on the Olympics article, the names of the Mascots for the Games. Once you’ve found their names, read some more information about them to find out when they were announced, how their names came about and what age range the target audience for the Mascots is.
  • Task 3: Your Spanish friend would like to read this information but they are unable to read English easily. Try to find the Spanish version of the page for them to be able to read. Once you've found it, attempt to share the article with them using your preferred sharing method from those available within the app.
  • Task 4: After your friend has read the article, you would like to return back to the English version and share it with your Twitter followers. Attempt to share it with them.
  • Task 5: You notice on the Sharing options that there is an option to "Save to Read It Later". Attempt to set this up on the app and save the English version of the Mascots article to Read It Later.
  • Task 6: If you have any time left, please browse through the rest of the app, commenting on anything else you try out.

• Questions, after they finish recording the video:
  • Question 1: What did you expect to see when you opened up the Wikipedia App? Is there anything that you would prefer to see when the app initially starts?
  • Question 2: Was there any part of the app that you found to be irritating or annoying that lowered your opinion of the app?
  • Question 3: What is this app missing that you expected to see? Would you like any further sharing features?
  • Question 4: Do you find this app to be better than our mobile site, http://en.m.wikipedia.org/? (Only for those users who have previously tested with us). Please visit useragentstring.com on your mobile browser and copy the user agent info here, if possible.

• Demographics:
  • Gender: Any (use highest rated testers)
  • Web Expertise: Any (use highest rated testers)
  • Country: Any (use highest rated testers)

• Favorite users:
  • vlcn1500 (iOS)
  • Bradz1988 and kayaker (Android)
    • Why do you want to specify these users?--Eloquence (talk) 22:11, 11 May 2012 (UTC)
      • Ah sorry, I meant to make that clear. These are users that have already tested the m.wikipedia.org site with us, their comments were good and answers to questions were detailed. Hence, it may be a good idea to see how they feel the mobile app compares with the site - Question 4 would be aimed towards these users. The Helpful One 22:43, 11 May 2012 (UTC)
        • Got it. I would suggest splitting that into a separate test to avoid comparing apples to oranges in a single test.--Eloquence (talk) 00:15, 12 May 2012 (UTC)

• Other options:
  • Title for this job
    • Wikipedia App Test 1
  • Other requirements, tell users if they need to meet an additional requirement:
    • Please only accept this test if you have Twitter set up on your mobile device.

Comments

Proposed by The Helpful One 21:45, 11 May 2012 (UTC)

I've made some tweaks as a result of watching the first test video. The Helpful One 22:49, 14 May 2012 (UTC)