
How to improve usability testing - quantitative methods and RITE
About
Are you struggling to convince the business about testing? Or is it your team that doesn't believe in testing in an agile environment? You write reports for the sake of writing, yet you'd like your research to have a real impact on the product design? Join me to learn how to conduct usability testing in agile projects, where a mix of quantitative and qualitative methods can impact research effectiveness, reliability, and replicability of results. I'll talk about metrics, RITE testing, and quantitative methods in usability testing.
Watch the full talk
Watch this WaysConf session, then continue with related talks or explore the current programme.
Talk in brief
A practical comparison of qualitative usability testing, quantitative measures, and the Rapid Iterative Testing and Evaluation method. The talk defines usability through learnability, efficiency, and successful task completion, then argues that observing customers only at the end of a project is too late. Metrics show where performance changes, qualitative sessions help explain why, and RITE turns each small group of sessions into immediate design decisions and a revised prototype. The useful shift is from producing research reports to maintaining a continuous, observable cycle of testing and improvement.
Key takeaways
- 01
Define usability through observable performance
Learnability, successful completion, efficiency, and error recovery give teams more useful targets than a general impression of ease.
Watch from 3:16 - 02
Bring the whole product group near evidence
Product, design, engineering, and business colleagues make stronger decisions when they observe the same customer behavior.
Watch from 5:47 - 03
Practice user-centered work continuously
Regular contact with feedback and customer sessions matters more than claiming a user-centered process in a final report.
Watch from 8:17 - 04
Balance user, business, and technology constraints
Usability decisions improve when teams make all three layers explicit instead of optimizing one in isolation.
Watch from 10:46 - 05
Revise prototypes during the research cycle
RITE workshops after each session group let teams fix clear problems and test the changed design immediately.
Watch from 16:09
Video chapters
- 0:55Three ways to strengthen usability testing
The opening introduces usability, mixed methods, measurement, and rapid iterative evaluation.
- 3:16Learnability and efficiency as product qualities
Usability is described through what customers can learn, repeat, and complete with reasonable effort.
- 5:47The classic moderated testing workflow
A familiar sequence of preparation, target-group sessions, observation, and reporting establishes the baseline.
- 8:17From occasional studies to continuous contact
User-centered practice is reframed as repeated exposure to behavior and feedback across the product cycle.
- 10:46Three layers behind every design decision
Customer needs, business outcomes, and technical realities are considered together during prioritization.
- 13:26Quantitative measures before and after change
Completion, time, and navigation behavior create a snapshot that teams can compare after improvement.
- 16:09Rapid iteration between participant groups
RITE converts observations into decisions and a new prototype before the next small group arrives.
Read edited transcript highlights
These concise notes were edited from automatic captions and checked against the talk structure. They are not a verbatim transcript.
Usability becomes actionable when it is measurable
A usable product helps a new customer learn enough to succeed and repeat the task later without unnecessary effort. Teams can examine completion, time, errors, and recovery while still listening to the person’s interpretation. These measures do not reduce usability to one number; they create concrete signals that a design change can improve.
Watch from 3:16Observation creates alignment across disciplines
A usability report can be summarized differently by every function. When product managers, developers, designers, and business colleagues observe the same session, they share the behavioral evidence behind the issue. A structured discussion afterward can then separate clear problems from personal preferences and connect the finding to implementation and business constraints.
Watch from 5:47User-centered design is a repeated behavior
Meeting customers once near launch does not make a process customer-centered. Regular sessions, feedback review, and direct observation keep assumptions visible while decisions are still reversible. The objective is not research theatre or a larger archive; it is a routine in which evidence can change the backlog, prototype, and understanding of the problem.
Watch from 8:17Useful decisions balance three connected layers
Designers advocate for customers, but the product must also support an organizational outcome and work within technical opportunities and limits. Naming these layers prevents hidden tradeoffs. A strong decision shows what improves for the customer, why the organization can sustain it, and what the technology enables or constrains now.
Watch from 10:46RITE shortens the distance from evidence to change
Instead of completing every session and waiting for a final report, the team reviews observations after a small participant group, agrees on clear improvements, and updates the prototype. The next group tests that revision. This approach is appropriate when problems are sufficiently understood and changes can be made without invalidating the research question.
Watch from 16:09

