User Testing, Prototype Revisions

Announcements

  • This week we’ll complete our user testing exercises
  • Next week we’ll continue refining our projects & team pages, and begin documenting our prototypes in advance of delivery to our clients
  • The Usability Reports & Usability Testing Design Notebook entry due dates have been moved to next week Wednesday.

Design Notebooks & Team Pages

Let’s take a few minutes to review the project flows you’ve been working on over the last couple of weeks.

Paper Prototypes & User Testing

Exercise

  • Together with your team, review your paper prototypes to make sure they clearly represent user flows you intend to develop for your project.
  • Revise your paper prototype as necessary in preparation for usability testing
  • Make a list of specific things your team would like to observe about how your test users use your prototype

Paper Prototype Usability Testing Roles

  • Tester – The one who was going to test the other teams’ prototypes. This person will be asked to “think aloud” while testing the prototypes, to give observers context.
  • Computer/Device – This person should remain silent and react to the tester’s commands using the paper prototype components. For example, when the tester texts a response to an SMS prompt, the “Device” should swap in the next prompt (tip: be sure to include error messages)
  • Assistant-computer – In times of need, an “assistant-computer” to give the “computer/device” some extra processing power! (i.e., on-the-fly cutting and pasting of missing GUI elements, SMS prompts or messages).
  • Observer – This person writes down everything the testers say and do, but especially what they don’t/can’t do or have difficulty with.

Exercise

  • Organize your team into the usability testing roles listed above
  • We’ll cycle around the room 3 or 4 times, rotating roles each time
  • Between each cycle, make revisions to your paper prototype bsed on the observations of the previous cycle
  • We want everyone to play each role, and each team should end up with 3 or 4 sets of usability testing observations to use as inputs for refining your prototypes
  • Did your paper prototype improve with each subsequent cycle?

Assignment

Usability Reports

  • Together with your team, create a new Google Document and title it “Usability Report”
  • Identify your team and the date on the report
  • Create a heading called Methodology and write a description of how you conducted your usability tests, including how many rounds of testers were tested. Also include descriptions of the roles team members performed during testing (see the roles listed above)
  • Create another heading called Objectives and list the specific things your team was looking to validate through the testing
  • Create another heading called Observations and combine the three or four sets of observations into one master list. Be sure to de-duplicate repeated observations

Team Page

  • Create a new heading called “Usability Testing” on your team page on the blog
  • Add a link to your Usability Report under this heading, include the date in the link text
  • Make sure all of the links on your team pages are actual links and not just urls in text. Proper links should be hyperlinked text that describes what is being linked to.

Design Notebooks

  • Individually, create a new slide in your Design Notebook and title it “Usability Testing”
  • Write a brief paragraph highlighting what you learned about your prototype’s usability from the tests
  • Did anything surprise you?
  • Make a list of refinements you’d recommend your team make to your prototype based on the observations from the testing exercises
  • Include a link to your team’s Usability Report on your slide

*Submit the link to your Design Notebook to Canvas before we meet again next week

User Testing

Announcements

Design Notebooks & Team Pages

Let’s take a few minutes to review your “Flows & Paper Prototypes” Design Notebook entries and team pages from last week.

Paper Prototypes & User Testing

Usability Testing

What is usability?

Why test usability?

  • Are end-users doing what you want them to be doing?
  • Are they doing what you expected them to do?
  • Did they become confused while trying to reach their goals?
  • Did you really think through all possible paths through the application?
  • Did they have a preferred path?
  • Are some paths unused?
  • Are some paths used in ways that weren’t intended?

Why use paper prototypes to test usability?

Exercise

  • Together with your team, review your paper prototypes to make sure they clearly represent user flows you intend to develop for your project.
  • Revise your paper prototype as necessary in preparation for usability testing
  • Make a list of specific things your team would like to observe about how your test users use your prototype

Paper Prototype Usability Testing Roles

  • Tester – The one who was going to test the other teams’ prototypes. This person will be asked to “think aloud” while testing the prototypes, to give observers context.
  • Computer/Device – This person should remain silent and react to the tester’s commands using the paper prototype components. For example, when the tester texts a response to an SMS prompt, the “Device” should swap in the next prompt (tip: be sure to include error messages)
  • Assistant-computer – In times of need, an “assistant-computer” to give the “computer/device” some extra processing power! (i.e., on-the-fly cutting and pasting of missing GUI elements, SMS prompts or messages).
  • Observer – This person writes down everything the testers say and do, but especially what they don’t/can’t do or have difficulty with.

Exercise

  • Organize your team into the usability testing roles listed above
  • We’ll cycle around the room 3 or 4 times, rotating roles each time
  • Between each cycle, make revisions to your paper prototype bsed on the observations of the previous cycle
  • We want everyone to play each role, and each team should end up with 3 or 4 sets of usability testing observations to use as inputs for refining your prototypes
  • Did your paper prototype improve with each subsequent cycle?

Assignment

Usability Reports

  • Together with your team, create a new Google Document and title it “Usability Report”
  • Identify your team and the date on the report
  • Create a heading called Methodology and write a description of how you conducted your usability tests, including how many rounds of testers were tested. Also include descriptions of the roles team members performed during testing (see the roles listed above)
  • Create another heading called Objectives and list the specific things your team was looking to validate through the testing
  • Create another heading called Observations and combine the three or four sets of observations into one master list. Be sure to de-duplicate repeated observations

Team Page

  • Create a new heading called “Usability Testing” on your team page on the blog
  • Add a link to your Usability Report under this heading, include the date in the link text

Design Notebooks

  • Individually, create a new slide in your Design Notebook and title it “Usability Testing”
  • Write a brief paragraph highlighting what you learned about your prototype’s usability from the tests
  • Did anything surprise you?
  • Make a list of refinements you’d recommend your team make to your prototype based on the observations from the testing exercises
  • Include a link to your team’s Usability Report on your slide

*Submit the link to your Design Notebook to Canvas before we meet again next week

Flows & Paper Prototypes

Announcements

Design Notebooks

Let’s take a few minutes to review some of your Design Notebooks.

Project Status

How are your projects coming along?

Diagrams & Content Maps Redux

Team Blog Pages

Team Pages

Exercise

  • Organize into your teams and update your team’s class blog page with links to your diagrams and content maps
  • Make sure you also have a link to your project’s concept presentation on your team page

Flows & Paper Prototypes

Some examples

Paper Prototyping Tools

  • Paper
  • Cardboard
  • Scissors
  • Stickies
  • Pen/Pencil
  • POP

Exercise

  • Organize into your teams
  • Using your User Personas, User Stories and or Jobs, pick an example user and identify a specific task they need to be able to accomplish using your solution
  • Create a flow for the task by a list of steps that user will need to take to complete the task – be sure to include an entry point and final goal for the task
  • Create a set of drawings on paper that represent these interactions; these could be screens, or text messages, or voice menus, etc
  • Be sure to include descriptions of the specific content that will need to be present (just a description at the moment, you’ll need to develop the actual content later)

Assignment

Midterm Papers

If you didn’t submit your midterm paper this week, complete it and submit it no later than Wednesday, March 23rd at 11:59 pm in Canvas.

Reading

Paper Prototypes

  • Meet with your team and continue developing your paper prototypes
  • Based on the reading, and using your User Personas, User Stories and/or Jobs, pick two additional example users (for three total, including the one you developed in class) and identify specific tasks they need to be able to accomplish for your solution
  • Create flows for each by writing lists of steps they’ll need to take to complete the tasks – be sure to include entry points and goals
  • Create a set of drawings on paper that represent their interactions; these could be screens, or text messages, or voice menus, etc
  • Be sure to include descriptions of the specific content that will need to be present (just a description at the moment, you’ll need to develop the actual content later)

Design Notebooks

  • Create a new slide in your Design Notebooks and title it “Flows & Paper Prototypes”
  • Write a paragraph defining what flows are and why you should use them to describe what your system needs to do.
  • Include links to the flows and paper prototype images your team created for your project

*Submit the link to your Design Notebook to Canvas before we meet again next week

Diagrams & Content Maps

Announcements

Paper Status Reports

Let’s take a few minutes to review the status of your papers.

Design Notebooks

Let’s take a few minutes to review your Design Notebooks:

  • Based on the best uses of User Personas + User Stories vs Jobs, which approach do you feel is more appropriate for your team?

Project Status Reports

Organize into your teams and let’s take a few minutes to talk about your projects’ status.

Questions for Partners

What questions did you prepare for your partners?

Partner Contacts

Did you make contact with your partner organization?

User Personas + User Stories vs Jobs

Which techniques did your team decide makes more sense for your situation?

How many were you able to create?

Diagrams & Content Maps

Why use diagrams?

What kinds of things should you diagram?

Exercise

Break up into your teams and:

  1. Based on one of your user stories/jobs from last week, create the list of steps a user needs to take to complete their goal. Do this for three of your user stories/jobs.
  2. Based on your research and the answers your partner organization gave in response to your list of questions, make a list of your partner organization’s goals.

Diagraming Tools

Exercise

  1. Using one of the tools listed above, create a user flow for one of the lists of steps created in the exercise above.
  2. Make a list of the content elements you’ll need to write, photograph, laser cut, etc to fulfill each of the steps in this user flow.
  3. Make a list of the content elements you’ll need to create in order to fulfill the goals of your partner organization.
  4. Create a content map based on this article, making sure to map each content element you listed in steps 2 & 3.

Assignment

Midterm Papers

Continue working on your midterm papers.

Team Projects

Meet with your team and complete the following:

User Flows

  • For each of your user stories and/or jobs diagram a complete user flow.

Content Maps

  • Based on your partner’s business goals and the user flows you diagramed, make a list of all content elements you’ll need to create, and diagram your content map.

Design Notebooks

  • Create a new slide in your Design Notebooks and title it “Diagrams & Content Maps”
  • Write a brief paragraph reflecting on the exercises you performed with your team this week. What went well? What could be improved?
  • Include a link to the user flows & content maps you and your team created this week.

*Submit the link to your Design Notebook to Canvas before we meet again next week