Note to the reader:
This part of the field guide comes from our 2019 version of the UX Research Field Guide. Updated content for this chapter is coming soon!
Want to know when it's released?
Subscribe to our newsletter!
As you read through the Field Guide, you may start to notice a pattern: Just about every how-to section starts with some version of âidentify your research questions and goals.â
â
Thatâs because defining your objectives (and then having a clear and actionable plan to achieve them) is a necessary step in the user research process, no matter which method you choose.
A user research plan is a document (or less commonly, a slide deck or internal wiki page) that outlines the goals, objectives, and logistical considerations of a research project for your stakeholders and team.
Good UX research plans provide everyone involved with a concise overview of the who, what, when, why, and how of any given research project.Â
They are used at the kickoff of a research initiative to strengthen stakeholder buy-in and create alignment around the goals of the research at hand.Â
UX research plans also serve as points of reference throughout the research process, ensuring that your inquiry remains focused on answering the key research questions defined at the outset. For this reason, they are also useful tools for effectively reporting on the results of your research in a way that speaks directly to your stakeholdersâ needs, as defined at the beginning of a project. Â
A good research plan is a prerequisite for doing good user research.
Depending on who you ask, a research plan is either one part of research design, or the other way around. Or theyâre the same thing. Or theyâre notâŠ
If you wanted to get really particular about it, you could argue that a research design refers to the methodology and approach, while a research plan also includes logistical considerations like timelines, budgets, and so on.Â
But in practice, the two terms are frequently used interchangeably by UX researchers⊠and TBH, we think thatâs fine.
Similarly, the distinction between âdesigning researchâ and âplanning researchâ (or heck, âdesigning a research planâ) is largely semantic. Both these verbs can be defined as âto create a strategy for conducting research.â
In this Field Guide, weâll be using the terms as follows:
Simple enough, right?
Itâs only been a few paragraphs since we last said it, but this bears repeating:
In other words, if you want to conduct UX research, you need to have a plan. Hereâs why:
â
Putting together a research plan is often a collaborative effort that involves understanding what stakeholders wish to accomplish, and what questions they need answered in order to make smarter decisions.
A good UX research planâone that addresses their needs, ties research to business objectives, and gives a succinct overview of the methods and logistics involvedâis a fantastic way to earn stakeholder buy-in and set realistic expectations about the research process and outcomes.
If the goal of your UX research is âto get to know your customers better,â thatâs totally fine.Â
But in order to know that your research is working, youâll need to get more specific about what it is you want to know about them (our bet is that itâs probably something to do with your product, and notâfor exampleâwhich set of grandparents they secretly prefer).Â
Youâll also need to decide which customers youâll talk to and how often, which methods youâll use, how youâll record and share their answers, and so on.Â
Creating a research plan will help you make sure your efforts line up with the overall goal of your research, and that youâre able to demonstrate the value of your work when all is said and done.
â
No-show participants, too many participants that donât fit your criteria, too few participants full stop, technological difficulties, overbooked schedules, mountains of poorly organized data, trouble distributing incentives distribution, research reports that donât get readâŠ
Frankly, thereâs a lot that can go wrong with user research. And every speed bump and set back costs time, money, and patienceâfor you, for participants, and for stakeholders.
Thereâs really no good reason to skip research planning.
Hereâs an example of a user research planâitâs adapted from the same template we use internally at User Interviews. Weâll go through how to fill out this document and create a UX research plan step-by-step in the next section.
â
At a minimum, your research plan should include:
â
Youâll define these in steps 1 and 2 (below).Â
Research goals state what youâre trying to learn or accomplish with your research.
Your research questions should reflect the goals of your study and should be:
â
Speak your stakeholdersâ language.Â
Effectively tying research efforts to bottom-line goals will go a long way toward earning stakeholder buy-in. Use the transcripts from your stakeholder interviews (step 3) to get a sense for how key decision-makers talk about their objectives and measures of success.
â
Explain the approach youâre taking to answer your research question (defined in step 4). Include brief descriptions of the methods youâll use, the tools youâll need, how long things will take, and anything else you think stakeholders will want to know about the âhow.â
Just remember, these folks are (probably) not as research-savvy as you are. Use plain language.
â
Describe who youâre going to recruit (step 6). What are their defining characteristics (i.e. how are you screening for good-fit participants)?
Include information about the strategies youâll use to recruit participants. Are you using a research recruiting platform? Social media? Emails to customers?
Also be sure to explain how you plan to compensate people for their time.
â
Donât forget the boring logistics!Â
Be clear about the tools youâll need, the roles different members of your team will play, and your research schedule (step 5 again).
â
Finally, set some expectations about anticipated outcomes, deliverables, and next steps.Â
For example, if youâre in the discovery phase of product development, make it clear that the insights from this research will inform product visionâbut that further research will be needed to validate designs and direction.
â
This is a step-by-step guide to planning user research. It explains the process by which a research plan comes together into a shareable document (like the one above) that enables team alignment, accountability, and efficiency throughout your study.
â
If youâre reading this Field Guide cover-to-cover, youâll likely notice a pattern: Most how-to sections start with defining your research goals or design challenge.
Research goals state what it is you are trying to learn from your research.Â
Design challenges clearly define a known problem, the solution to which you are hoping to identify through user research.
Clarifying your research goals is especially important in the early stages of a research project, when the scope of your inquiry may be quite broad. Once you have something specific to test, whether thatâs a prototype developed post-discovery or a live feature, your research focus can then be framed as design challenges. Rebecca Smith and Kendra Leith of MIT D-Lab advise that:
Terminology aside (in practice, the difference between research goals and design challenges is often blurry), having clearly stated goals and motivations for doing research is a critical step that provides focus and creates shared understanding between your team and key stakeholders.
To identify your research goals, ask yourself the following questions:Â
A good research question is specific, practical, and actionable.
It should be:
A good research question acts as a beaconâitâs what drives your research forward, lets you know when research is âdone,â and itâs what gets everyone involved on the same page.Â
Whatâs more, starting with a question is the best way to ensure youâre using your research to investigate rather than to validate. Investigating means youâre digging deeper into a problem, or searching for an answer, whereas validating means youâre working to say the solution youâve created is the right one.Â
While research can validate your solution (indeed, thatâs what evaluative research is all about), doing user research to prove youâre right is not a good use of anyoneâs time or energy.Â
Going into research with a questioning mindset leaves you more open to new solutions and ideas that may arise in the course of your research. It also leaves room for the solution you originally envisioned to be the wrong one, which is ok. The goal of research is to learn, grow, and make better decisions.Â
Some example of good research questions:
Each of these questions could be answered through targeted research, and each would require different kinds of research and scopes of work.Â
â
This next step is all about figuring out what you already know (or could learn without doing user research). There are three ways to take stock of existing information:
As you might remember from the chapter on stakeholder interviews, these interviews are semi-structured, in-depth interviews that are conducted at the outset of a research project to create consensus and align around research goals.
Potential UX research stakeholders include people who:
Unless you work at an agency and your key stakeholders are wildly different for every project (different people, different companies, different customers, different business goals), the stakeholder interviews you conduct at this stage should be specific to your current project.
Ideally, youâll have already conducted some stakeholder interviews with the key players and decision makers at your company, which means you have a general understanding of what they do, what they care about, how they measure success, and what they can tell you about the product and customers.Â
That means youâll be able to re-interview the people most affected by this particular project about their concerns, how the results will impact their role, and what existing knowledge they can bring to the table.
If that isnât the case, dedicate extra time to this stepâand do it early, to make sure your research goals and questions are rooted in business needs.Â
The essential question to ask yourself at this stage is:Â
â
â
Weâll let you in on a little secret: You donât have to do everything yourself.
Why waste limited resources on rediscovering information that other people have found and published?Â
Secondary research involves collecting and synthesizing existing data and insights on a topic.
A literature review is a type of secondary research in which researchers review published information (articles, websites, videos, research journals) related to a topic area in order to identify patterns and trends.Â
MIT D-Labs recommends youâll need approximately 20 to 80 hours for this step, but it really depends on the project and your existing knowledge of the topic. In any event, be prepared to do lots of reading!Â
It can be helpful to create spreadsheets or notes documents that allow you to compare insights across sources. After going through all of your sources, write up a summary of key insights that might inform the direction of your inquiries.
â
Just as literature reviews can save you from redundant research about a topic, consulting your companyâs product analytics and customer feedback data can save you from spending time researching things your customers have already told you through their words and actions.
Analytics can be a treasure trove of quantitative data. Coordinate with your product and analytics teams to dig into things like key user flows, in-app behaviors, and business metrics.Â
Likewise, bug reports and support tickets can help you understand how the user experience has been impacted by current or historical frustrations.
And donât forget your sales, customer success, and marketing teamsâthey are often the keepers of a wealth of qualitative insights about what customers and prospective customers think and say about your product.
â
Your methodology will be informed by your research question. If you jump directly to methodology, you may end up stunting your study before itâs even started. Some questions are best answered by customer interviews, while others can be answered through tree tests, task analysis, or maybe even field studies. Many studies will include multiple methods as well.
Need a refresher on what kinds of research you can do? We cover that in the upcoming UX Research Methodologies module, but feel free to skip ahead and circle back.
But there are a lot of different methods out there, and even experienced researchers can be overwhelmed by choice without a good framework. A user research framework is a systematic way of categorizing research methodologies and approaches to guide decisions about which method to use, when.Â
You can map methods according to:
â
In the methodology section of your research plan, youâll also need to include the details of your study, like a moderator guide for interviews, or the wireframe youâre testing for a usability study.
Anticipate and get ahead of questions like:
Work out a research schedule.Â
This will depend on your methodology and how many participants you includeâyou may be able to do all your customer interviews in one day, or you may be conducting a diary study that will take a few weeks to complete.Â
Set up a timeline and dates as soon as you can. Even if you donât schedule sessions immediately, setting a timeline keeps you accountable. And be realistic about how many sessions you and your team can conduct in a day.
Finally, consider the logistics. What is the budget for your research? Will you give the participants an incentive? Do you need to reserve a space to conduct your research? Do you need to pay for additional software?Â
Whether youâre an experienced researcher or are just getting started, recruiting the right research participants can be a real challenge.Â
Weâve dedicated an entire module (coming up next!) to the topic of user research recruiting, and we highly recommend that you read it for a fuller understanding of recruiting strategies and best practices..
Here are the highlights, which youâll need to think about when putting together your research plan:
â
The specific, practical, and actionable research question you defined in step 2 should contain clues to who your participants should be.
Say your question is: âWhat tools do college students use to keep track of their schedules?â
You know you need to talk to people who are:
Thatâs it, really, unless youâre developing a solution exclusively for students in the Massachusetts public university system, in which case âattends UMass, any campusâ may or may not be useful criteria.
â
Your methodology will determine how many participants you need to recruit to participate in your study. Quantitative studies require a lot of people to achieve statistical significance. An interview-based study or a usability test, on the other hand, may only require you to recruit 5 to 10 participants.Â
Suggested sample sizes for different types of UX research:
A screener is a brief (<10 questions, ideally) survey that prospective participants take to determine whether or not they qualify for your study.
Itâs a sieve that filters out the participants who can help answer your research questions from all the folks who canât.
A few rules of thumb for creating effective screener surveys:
â
Regardless of your methods, participants, or budget, you should compensate participants for their time in one way or another. Research incentives (which, by the way, donât have to be monetary) should be distributed as soon as the research session ends.
Whether youâre offering gift cards, account credits, or swag, the most important thing is that you choose incentives that are valuable and relevant to the people youâre looking to recruitâand that you have a way to distribute them in a timely manner.
Here are our recommendations for calculating the right incentives a nutshell:
â
This is one of the most important parts of your plan, because it outlines what happens once youâve finished your research.Â
The way you analyze and present your research can have a huge influence on the kind of impact your research is able to make at your company. Getting these things right is almost as important as conducting the research in the first place.
Consider how you will analyze and report on your research findings. Good research analysis begins at the planning stage, before research actually begins. Think about the kind of data youâre collecting (Is it qualitative or quantitative? Will it be in the form of videos or survey responses? How much data will there be?) and develop a plan for recording, coding, and analyzing it as you go.
Think about the kinds of artifacts your study will produce, and how youâll present them to stakeholders.Â
Will you share findings as you go or wrap it all up in a final report? Is it better to deliver results in a meeting or asynchronously? Is there another study you want to complete after this one? How will people access your research after you complete it?Â
You canât know for certain what the outputs of your research will be, but you can plan to:
â
đ Read more about UX Research Reports and Deliverables
â
Your research plan ultimately leads to research findings, which go on to inform decisions that ultimatelyâafter much testing and iterationâend up in the hands of real people.