SUBSCRIBE TO OUR NEWSLETTER
It's easy to create a screener survey, but taking a little extra time can drastically increase your recruit's effectiveness.
Looking for oceanographers between the ages of 21-25 who live in Indiana? Yeah, that’s a tricky one. While it’s good to have a distinct audience in mind for your research, considering the feasibility of your recruit is always important. I encourage researchers to have some flexibility around some of their criteria in case the audience is too niche to reach your goals.
On the flip side, you’ll want to make sure that your recruit has focus. Otherwise, you might lose track of what you’re trying to accomplish. Running a study about mobile apps? You could include questions that filter out people who don’t have the smartphone you need—or perhaps don’t have a smartphone at all. Specifying the audience that best fits your research needs will give you a more refined candidate pool that you won’t have to comb through later.
Every day we have a mix of projects launched by both experienced researchers, and some who might be recruiting for the very first time. Either way, our team always reviews projects to make recommendations.
Of the missteps that we come across, spelling and grammatical errors are at the top of the list. We know—you want to launch your studies and get the recruit started as quickly as possible, but keep in mind that your screener is the first touchpoint you have with potential participants. Not only are spelling errors jarringly unprofessional, but they can lead to confusion if they interrupt the clarity of the question being asked. Taking a few minutes to review your screener could save you time fixing bigger mistakes later. Try asking a colleague to read your survey, or write it, then come back to it an hour, or even a day later if you have the luxury.
The screener is your chance to get to know the people who might become a part of your user research endeavor. You might as well learn as much as you can about these folks!
One of my personal pet peeves is coming across screeners with exclusively “Yes/No” questions. At User Interviews we offer a variety of question formats, and you can use them all to your advantage. Sure, you could list a bunch of questions with simple quick-click options, but why not add a little fun and nuance into the mix? Plus, adding some more interesting questions can give you more insights than you imagined.
In one study, a client was interested in speaking to people who proactively look for deals when shopping online for clothing. The original screener looked something like this:
This was such a missed opportunity to gain some valuable consumer insights! And the screener doesn’t need to be long to be insightful. Our revisions, pictured below, would add some much-needed clarity to candidate responses.
The outcome of a few minutes of thoughtful revisions? Improved data collection and a happy client!
Skip logic is a great way to customize your screener. It offers areas to give some participants an opportunity to expand their responses, as needed.
For instance, let’s say you are conducting a study on pet ownership. You might want to capture more information about the type of pets someone has, but you also don’t want to exclude those who have no pets. In the example below, you’ll notice that the questions on page two are only relevant for respondents who do not have pets. Skip Logic allows you to set up the respondent journey so that pet owners will essentially jump over these questions. It creates a customized feel and avoids confusion for the respondent while gathering the information you need.
While the questions on your screener help to strain your candidate pool, many researchers miss out on opportunities to get a sense of a candidate’s personality, and even have a little fun!
I always encourage researchers to include at least one articulation question, typically at the end of the screener. After all, this is a bit of an interview process to see who would be the best fit for your study. Perhaps you’re looking for creative-thinkers to join in an interactive in-person focus group. Use an open-ended question to capture more about the way they approach situations, and think/problem solve. Here are a few of my favorites:
Well, there you have it. The seven most common screener mistakes we see in our day-to-day. If you have questions about screener surveys or getting started with your first project at User Interviews, drop us a line at email@example.com. Happy recruiting!
Want to contribute to User Interviews content? Here’s how.
Melanie Albert is the VP of Operations at User Interviews. She's managed thousands of research studies and knows a thing or two about how to find great participants for user research.
July 2, 2020
Decide on the right screening criteria, write non-leading questions, avoid professional testers, and identify the right mix of great research participants.