SUBSCRIBE TO OUR NEWSLETTER
A step-by-step plan to get the most important insights for your product.
You always want to start with why. Research is usually done to inform decisions that have to be made. What are those decisions? Which ones are riskiest? Which ones need to be made now, and which ones can be put off until later? Which ones will be expensive to change if you later learn new information?
In my case, I'm broadly looking to better understand what's challenging to people who commission or conduct user interviews, so that I can tailor my services to solve their problems. I would like to find and convert more research clients for my business. When visitors are first learning about my services, they will form opinions that may be hard to change. Thus, my top priority is to learn about how they find and choose researchers. Specifically, I'd like this research to inform the creation of a compelling service detail page (and validate the need for one).
Once you have a clear idea of the research goals and which decisions the research will inform, you can get more specific about your research plan.
At this point, you want to brainstorm lots and lots of questions. This is sometimes called question-storming. You likely won't get answers to all of them, but this exercise helps you uncover the big questions and get in the right frame of mind for focusing on the study participants.
Think about what evidence you wish you had in order to make those decisions confidently. What do you want to know about your users? What is the context around the decisions they make and the actions they take? What are the differences among them? Which ones make a bigger difference on how likely they are to become your customer? List as many questions as you can think of, and then prioritize them so that you can stay on the highest value content in your interviews.
In my case, I created a list of over 20 questions, and then prioritized them to focus on these three:
Now you'll be better able to steer each interview to the most valuable information. Next, you'll need to decide who to recruit.
How do you know when you’ve talked to enough people? My rule of thumb is that when you start to see patterns or hear the same things again, you're ready to make decisions based on the research. But how long does that take? If you've planned your research well, it could be as few as 3 to 5 people. On the other hand, if you've talked to 10 people and you're still not seeing patterns, then you should take a look at how you are deciding who to talk to. Think about what differences in your potential users might make a difference in the way they use your product or service. Focus in on the differences that are likely to affect the decision area you are working in for this research effort. The more targeted you can get, the better.
If you're reading this and thinking, but my product needs to appeal to everyone, keep in mind that you'll need to get from here to there. In today's world of personalized digital experiences, products win by solving a particular problem for a targeted set of users who have similar unmet needs. Only after a company has gained traction can they begin to scale to more and more user segments until, if they are lucky, we may one day look on them as something that everybody wants.
In my case, I hypothesize that the significant differences will be around their existing expertise and resources. I'm most interested in helping people level up their research skills and encouraging them to talk with customers themselves, so I want to set up a screener that finds people who want to get started with user research or to get more value out of their research efforts.
Once you've got your target participant profile, you can set up your research recruitment. While the recruitment is underway, move on to crafting your interview guide.
Direct questions often get answers that are subject to cognitive bias. The respondent will answer with their idealized scenario, rather than their reality. If you aren't sure what I'm talking about, just ask someone who wants to get healthier how likely they are to go to the gym next week. Then, ask them how many times they went to the gym last week. Get different answers? This is because we aren't very good at predicting our own future behavior. (If you want to go deeper on this topic, check out the Ladder of Evidence by Teresa Torres.
So as an interviewer, what can you do? Ask instead for specific stories. Go back to your list of research questions, and think about what stories from the participant's past would give insight into how they've acted and behaved in your area of interest. If you're looking to improve an existing product, ask them to tell you about the last time they encountered the particular use case you are interested in. If you're exploring a new product, think about related areas.
For my example, I'd want to find stories about times when they hired research help. If they had never done so before, I'd ask for stories about times when they sought help in an area that they wanted to get stronger in. I put my interview guide in a table format so that I can have prompts and reminders of what's important right next to where I take notes during the live interview. It looks like this:
Ever listen to a user interview where the interviewer sounded like they were doing a telephone survey? I have, and it was painful. The interviewer asks questions, and the respondent gives terse answers. At its worst, it can sound more like an interrogation than a conversation.
I find that the trick to avoiding this situation is to focus on building rapport before asking the deeper questions. I always start by introducing myself and asking if it's ok to record the session. Then I ask them about themselves. Most people, especially those who agree to participate in research, love to talk about themselves! Since I do a lot of B2B work, my standard opening question is to ask someone to tell me about their job and how long they've been doing it. For B2C, I ask them some basic personal interest questions to get them flowing.
However you start, the key is to make sure the first questions are easy, not thought-provoking. When questions make us think, we often start to worry about whether we are getting the "right" answer. You want to get the participant to feel like they are having a conversation with an old friend, not a challenging teacher.
So build out your interview guide with questions and prompts that will help you build up this rapport. Start with context questions, like descriptions of their organization or their family. Add transitions before changes in topic, so they aren't wondering what you are getting at and trying to guess how to answer. Then lead into asking them for specific stories. Plan your wrap up as well: tell them that the conversation was really helpful for you. At this point, you may want to tell them a bit about the project you are working on, if you haven’t already, and ask if they'd like to stay in touch for future research or updates.
Once you've got an interview guide drafted, get started! With modern tools like User Interviews, conducting research has become so cheap that you don't need to spend hours and hours preparing to get the most value out of every call. If you have a lot of internal stakeholders, give them a chance to share their concerns and questions, but emphasize that you are starting a continuous process. The more you interview, the less planning you need to do for each one. Build up a habit and work on improving your technique and flow over time.
You'll be on your way to using customer interviews to truly empathize with your user, driving innovation in your product.
Want to contribute to User Interviews content? Here’s how.
Holly Hester-Reilly is the founder of H2R Product Science, a product management and user research training and consulting company. She's worked with growth companies like MediaMath, Shutterstock and the Lean Startup Co, and enterprises like Weight Watchers and Toys “R” Us to figure out which product growth opportunities they should pursue.
Leadership & Strategy
July 26, 2021
Should you become a UX manager or grow as an individual contributor? Amber Davis, UX Research Director at Audible, shared advice on making big career decisions and knowing your own strengths.