Every day I help build great products that everyone can use. Part of building these products is understanding how people use them. One way to achieve this is through lean usability testing.
Lean usability testing is one of the key elements we used to build Ausmed - the online platform helping healthcare professionals around the world document their continuing professional learning. As a result of over 3 million hours of continuing professional learning has been documented on the platform. The app has also received over 2.5K ratings with an average 4.7-star rating on the app store. I’ve also had the privilege of applying this style of testing to the government, education and startup sectors.
Some of the benefits of lean usability testing are:
The purpose of this post is to share how I use lean usability testing to help build great products that everyone can use.
Lean usability testing can be applied to all customer facing products. It doesn't matter if you're B2B, B2G, or B2C. If you have customers, usability testing is for you! Some real-world scenarios you can apply usability testing to include:
Steve Krug says, “a thing is usable if a person of average — or even below average ability and experience — can figure out how to use the thing for its intended purpose, without it being more trouble than it’s worth.”
Usability problems are not hard to find. Have you ever encountered one of these doors? Are you meant to push or pull?
If you’re confused you’re not the only one. Every day people have trouble getting through these doors and for this reason, they have been given a name — the Norman Door.
At its core, lean means creating more value for customers with fewer resources. Lean usability testing helps identify usability problems and create value for customers, using limited resources. It’s not to be confused with a focus group where you ask people about their opinions.
Lean Usability Testing is the art and science of testing the designs you have created with your target audience and then turning your insights from observation into actions.
Taking action on your insights
Following an evidence-based approach gives you the confidence to take action on the insights you find. This is because an evidence-based approach ensures your findings are valid and reliable. You might consider several things with such an approach, however, we will focus on two of the most important here. These include:
Why you only need to speak to five users (Nielson, 2000)
Five people can help you find 85% of the usability problems. However speaking to three people will generally help you find more problems than you can fix.
The most striking truth about the graph is that speaking to zero users gives you zero insights.
As soon as you collect data from a single user, your insights shoot up and you have already learned almost a third of all there is to know about the usability of design.
As you add more and more users, you learn less and less because you will keep seeing the same things again and again. After the fifth user you are wasting your time observing the same findings over and over.
What are the most common cognitive biases?
There are many cognitive biases that you can fall prey to with this style of testing. We will cover three here:
A client from the government sector approached us to build a site that allows people to find and download spatial data. At the beginning of the engagement, we had a lot of assumptions about how the final product would work and a limited amount of data to support us. Before building the live version we built a clickable prototype and tested 15 high priority tasks with 5 users.
Speaking to five people allowed us to find more usability problems than we could fix. It also disproved some of our riskiest assumptions. The findings indicated that 77% of all tasks completed were successful while 23% of the tasks completed were unsuccessful. We focused on fixing the tasks that caused the most problems first and then moved ahead confidently with the build and release.
This approach highlights how following an evidence-based approach can yield great outcomes. We were able to reduce risk and increase confidence with our client in under a week. Had we not conducted the testing we would not have had any data to support our decisions. Not having data to support product based decisions is risky business.
The next step to complement the lean usability testing would be to set up analytics on the live site. The purpose of this would be to gain a deeper understanding of how people are using the site to then make additional refinements.
Want to contribute to User Interviews content? Here’s how.
Get "Fresh Views," our weekly newsletter, delivered to your inbox. We feature interviews and point-of-views from UXers, product managers, and research nerds of all stripes.Subscribe
Research sessions don’t always go according to plan, but having backup plans and a user focused attitude will take you far
It's 2018-going-on-2019 after all