Prototyping & usability testing

Usability testing plan

Colton Schweitzer
October 14, 2020

Once you have gotten to the point where you’re ready to start usability testing, first create a test plan. The purpose of the usability test plan is to document: 

Your goals for testing

Why are you running the test? What are you hoping to learn?

The list of research questions

What questions do you need to answer about your designs/wireframes/prototype? Are there any interactions you need to test?

How, where, and when to conduct the test

Is your test moderated or unmoderated? Remote or in-person? When are you conducting the test?

Who’s participating in your test?

Who are you testing with? This information will depend on the study goals and product audience.

Once you’ve built the plan, you can start building your usability test script.

You’ll read the usability test script to each participant and use it to guide the session.  

Basic sections of a usability test script:

The introduction

Pre-study questions

Scenarios and tasks

And post-study questions

Here are 5 metrics that Usability.gov recommends to capture task completion:

• Successful task completion: Whether or not the participant was able to successfully complete the task.

• Critical errors: If the participant isn’t able to finish the task for one reason or another. They may not even be aware that the task is incomplete or incorrect. 

• Non-critical errors: These are errors that don’t result in the participant’s ability to successfully complete the task. These usually mean that the assignment was completed less efficiently.

• Error-free rate: The percentage of participants who completed the task without any errors (critical or non-critical).

• Time on task: The amount of time it takes the participant to complete the task. 

You don’t need to use all of these. We typically record successful task completion and subjective metrics like how difficult they thought the task was and how satisfied they were with the experience. 

Planning for a usability test is a crucial step in the testing process. It sets you up for success and will take the stress out of testing because you’ve already planned for everything you’ll encounter.

Back to vault

302

Back to vault

302

What is UX?

2
Getting started

Why is UX important?

3
Getting started

What is the UX process?

4
Getting started

What is design thinking?

5
Getting started

What do UX designers do?

6
Getting started

UX vs UI

7
Getting started

Do UX designers need to know how to code?

8
Getting started

Recommended UX books

9
Getting started

UX university programs: Pros & cons

12
Getting started

UX bootcamps: Pros & cons

13
Getting started

6 brutal truths aspiring UX designers don't want to hear

14
Getting started

Difference Between Graphic Designer vs UX Designer vs UI Designer

15
Getting started

Intro to research & understanding

101
Research & understanding

Finding a problem to solve

102
Research & understanding

SWOT analysis

103
Research & understanding

Competitive analysis

104
Research & understanding

Heuristic evaluation (usability evaluation)

105
Research & understanding

Task analysis

106
Research & understanding

Stakeholder interview

107
Research & understanding

Framing the problem

108
Research & understanding

Research plan

109
Research & understanding

Survey

110
Research & understanding

User interview

111
Research & understanding

Card sorting

112
Research & understanding

Customer journey map

113
Research & understanding

Empathy map

114
Research & understanding

Affinity diagram

115
Research & understanding

Personas

116
Research & understanding

Contextual inquiry

117
Research & understanding

Diary study

120
Research & understanding

Eye tracking

121
Research & understanding

Intro to IA

201
IA & wireframing

Layout + CRAP

203
IA & wireframing

Site map

204
IA & wireframing

Scenarios

205
IA & wireframing

Storyboards

206
IA & wireframing

Low vs high-fidelity

207
IA & wireframing

Sketching

208
IA & wireframing

Wireframes

209
IA & wireframing

User flows

210
IA & wireframing

Intro to usability testing

301
Prototyping & usability testing

Usability testing plan

302
Prototyping & usability testing

Prototypes

304
Prototyping & usability testing

Research report

305
Prototyping & usability testing

Typography basics

401
Visual design & handoff

Color basics

402
Visual design & handoff

Color accessibility

403
Visual design & handoff

Pixels vs points

404
Visual design & handoff

Layout + 8pt grid system

405
Visual design & handoff

Design system

406
Visual design & handoff

UX writing

408
Visual design & handoff

"Final" usability test

409
Visual design & handoff

UX portfolio basics

501
UX portfolio

Your portfolio is just another UX project

502
UX portfolio

Choosing a site builder for your UX portfolio

503
UX portfolio

UX portfolio inspiration

504
UX portfolio

5 tips for junior UXers asking for portfolio feedback

505
UX portfolio