Designing Semi-Structured Interviews

Before conducting a set of customer interviews, you need to decide how much structure you need to impose on those conversations. Will open, free-flowing conversations yield you with the insights you need? Or do you need to lead the discussion down a specific path? To answer this question, first ask yourself why you are conducting the interviews:

  • Are they a form of account management—one-off calls with customers to hear how they are doing and if they have any urgent needs or interesting suggestions?
  • Are you getting yourself up to speed because you are new to the company or product team and don’t know what you don’t know?
  • Are you doing them as research to inform a product marketing initiative?

The first two use cases don’t need a structured interview and are probably better off without one. Let the customer lead the direction of the conversation. If the calls are intended as research, they will benefit from some structure. Here’s why:

Pitfalls of Unstructured Interviews

In wide-open conversations, it can be easy to inadvertently relinquish control over the conversation to the customer. Let’s face it: it is hard to schedule an interview, so once you have someone on the line, you can feel beholden to them because they’ve agreed to give up some of their time for you.

The risk is that customers can go off on tangents or even rants that may be important to them but not necessarily helpful for what you are trying to do. If you are trying to evaluate the opportunity for a new product feature, hearing about a customer’s frustration with the license renewal isn’t that useful. This is more likely to happen if you position the interview as open-ended, such as “I’d like to hear from you about how things are going…”

Without any structure, even you can take the discussion down really interesting paths, only to find at the end that you didn’t spend enough time on the topics that will help you with the challenges/decisions at hand. Repeat this over several interviews, and you end up with a data set that lacks consistency and consists of anecdotes rather than trends.

Using a semi-structured interview helps you keep the conversation on track. When a customer goes off track, you can gently tell them that what they are sharing is valuable but that you have some topics that you need to cover in the interview. It is easier to provide this type of feedback if it’s true.

Assumptions & Hypotheses

Any type of primary research, including in-depth interviews, tends to provide more actionable insights when used to test hypotheses and assumptions. This also provides the outline for a semi-structured interview. Identifying what you need to validate and what you need to learn more about can be as helpful as the interviews themselves.

That said, articulating assumptions and hypotheses to test is easier said than done. The following framework can help:

  1. We believe our ICP has the following profile…
  2. Has these objectives…
  3. Experiences these problems…
  4. That are due to…
  5. And will value our solution because…

Once you’ve completed the framework, you can identify the areas where you feel confident in your understanding of the customer, where you need validation, and your biggest informational gaps.

5-8 Big Questions

Depending on the amount of time you have with the customer (20, 30, 45 minutes), you should have 5-8 big-picture topic areas to cover in your interview. For each big-picture topic, prepare a series of supporting questions that you may or may not use. These questions help prime you as the interviewer for what you should be listening for. They also help you keep track of things that are not said by the customer, e.g., you expected XYZ to surface as an urgent need, but no customer mentioned it spontaneously.

As a product marketer, common use cases for customer interviews include gathering customer requirements and evaluating interest in new features. So, as an example, let’s assume you work at a company that provides inventory management software for mid-size industrial manufacturers. You want to understand how much value customers see in an AI-powered forecasting module. Your first big question and follow-up could be:

What are the biggest inventory management challenges you encounter?

If time permits, probe on the following if the customer doesn’t mention them spontaneously

To what degree are the following challenges for you and your organization?

  • Accurately tracking inventory across plant and warehouse locations
  • Integrating with supplier systems
  • Not being able to forecast inventory needs accurately

The next big-picture question and follow-ups for the inventory management software interview could be.

What are the challenges you encounter when trying to forecast your inventory needs?

If time permits, probe on the following if the customer doesn’t mention them spontaneously

To what degree are the following contributing to that problem?

  • Data is spread out over multiple legacy systems
  • Forecasts are made manually using spreadsheets
  • Customer demands seem to fluctuate

And then…

How useful would a forecasting tool that includes the following features and functionality be?

If time permits, probe on the following if the customer doesn’t mention them spontaneously

To what degree…

  • Would this address the challenges you regularly encounter
  • What concerns would you have
  • What is missing that we’d need to add for the tool to have value

As demonstrated in this example, a semi-structured interview can be visualized as funnel that consists of a series of nested triangles. You start with the first big-picture topic and drill down as time allows. Then, you expand back to the next big-picture topic, usually narrower than the first, and repeat the process.

Although we recommend big-picture questions, that means in the context of what you are trying to understand. Don’t go too big by asking, “What is keeping you up at night?” That question gives up control of the interview to the customer. What keeps them up at night may not have anything to do with your solution. This can be useful in early exploratory research, but can waste time in most customer interviews. Using the example above, it is better to ask, “Thinking about your inventory management, what keeps you up at night?”

And, of course, a semi-structured interview is not a survey. And you are not a robot. It is important to make adjustments and course corrections during an interview and over the course of multiple interviews as you learn new things. However, your objectives don’t change. Think of a semi-structured interview guide as a roadmap. Whether you take a train, plane, or car, there are multiple routes from Boston to New York City, but they all lead you southwest. At the end of the interviews, you want to have consistently addressed all your questions and be able to identify what is a pattern and what is an anecdote.