Conducting Research Interviews: How to Stop Getting Polite Answers and Find What Users Actually Do

Conducting Research Interviews: How to Stop Getting Polite Answers and Find What Users Actually Do

The most dangerous research interview is not the one where a participant says nothing useful. It is the one where they agree with every premise in your discussion guide.

I have watched teams leave interviews convinced they had validated a feature idea because six participants said they would use it. Three months later, the feature shipped, adoption barely moved, and the same team wondered why customers had “changed their minds.” They had not. The interviews had captured polite preference, not real behavior.

Conducting research interviews well means treating every smooth, agreeable answer as a warning sign. People are good at explaining what they think they should do, what their company says it does, and what they would like to believe about their own process. They are far less likely to volunteer the messy sequence of shortcuts, stalled approvals, spreadsheet workarounds, and internal politics that actually drives product decisions.

My view is blunt: if an interview does not reveal a concrete past event, a constraint, and a tradeoff, it is not yet useful research. It is conversation. The goal is not to collect customer opinions. The goal is to reconstruct the reality that produced customer behavior.

Why Most Research Interviews Produce Weak Evidence

Most teams know the basic rules. Ask open-ended questions. Avoid leading participants. Let them speak. Those rules matter, but they do not solve the central problem: interviews are often structured around what the company wants to build rather than what the participant recently did.

Take this common question: “How do you manage customer feedback today?” It sounds harmless. In practice, it invites an idealized process description. A product manager may say feedback is centralized, categorized, and shared with leadership. Probe into the last specific customer request, however, and you may find that feedback is split across Salesforce, Slack, support tickets, sales call notes, and a spreadsheet only one person understands.

The participant is not lying. They are compressing a complicated operating reality into a clean summary because that is how humans answer broad questions. Your job as a researcher is to make that compression impossible.

Another failure is recruiting by job title alone. “We interviewed ten product managers” is not a research sample; it is a vague audience description. A product manager who evaluated a user research platform last week has fundamentally different evidence from one who has never owned research operations. Recent behavior is more valuable than seniority, company size, or self-described expertise.

Finally, teams mistake interview volume for confidence. Fifteen shallow conversations do not beat five interviews where participants show the actual workflow, describe a recent failure, and explain what happened when the stakes were real. Depth is not a nice-to-have in qualitative research. It is the mechanism that separates signal from well-worded noise.

Start With the Decision You Need to Make

Before conducting research interviews, do not write questions. Write the decision the research needs to inform.

“Learn how users think about analytics” is not a decision. It is an invitation to collect broad, contradictory commentary. “Decide whether mid-market teams need faster self-serve segmentation or guided explanations for unusual conversion changes” is a decision. It tells you what to investigate, who to recruit, and what evidence would change the roadmap.

I use a four-part research brief to prevent interviews from becoming aimless discovery theater:

  1. Decision: What will the team choose, prioritize, change, or stop after this research?
  2. Behavioral event: What recent situation should every participant be able to describe in detail?
  3. Population: Which participants have faced that event recently enough to remember the sequence?
  4. Competing explanations: What are the two or three plausible reasons behind the behavior?

The competing explanations are where rigor begins. If trial conversion falls, do not assume users are confused by onboarding. They may lack urgency, be blocked by data access, fail to see value before setup work begins, or simply use another tool for the same job. An interview guide should help you distinguish between these explanations, not prove the team's favorite one.

In a study for a B2B workflow platform, the team believed new customers were abandoning setup because an integrations page was too technical. We interviewed eight recently inactive accounts and reconstructed their onboarding attempts. Only two were blocked by technical complexity. Five had a more basic problem: setup depended on three internal stakeholders, but no one had clear ownership. The interface needed some improvement, but the bigger opportunity was coordination design—owner assignment, task visibility, reminders, and a realistic implementation path.

That is the value of decision-led research. It prevents a visible symptom from becoming the entire diagnosis.

Recruit for Fresh Events, Not General Opinions

The highest-leverage screener question is usually: “When was the last time you did this?”

If you want to understand how teams choose analytics tools, recruit people who evaluated one in the past 90 days. If you want to understand reporting workflows, recruit people who built, exported, or presented a report in the past month. If you want to understand churn, speak with people who downgraded, canceled, or reduced usage recently—not customers who vaguely remember considering it.

Fresh events give researchers three advantages. Participants remember the sequence more accurately. They can access artifacts such as comparison documents, email threads, dashboards, and spreadsheets. And they can explain the context that made a decision matter at that moment.

When I was researching support escalation workflows for a SaaS company, we initially recruited experienced support leaders. Their strategic perspective was useful but abstract. Midway through the study, I added frontline agents who had escalated a case in the previous seven days. One agent walked me through a real escalation involving a billing discrepancy, two internal handoffs, and a customer threatening to pause renewal. The critical friction was not ticket routing, as leadership assumed. It was that agents had no reliable way to see whether finance had acted. One interview changed the problem framing from “improve routing” to “make ownership and status visible across teams.”

Recruiting for recency does not mean every participant must fit a narrow demographic profile. It means every participant must bring evidence, not just commentary.

Use a Past-Behavior Interview Flow

The strongest research interviews move through time. Chronology forces specificity and reveals the conditions around a decision. Concept questions invite generalities; event reconstruction exposes what actually happened.

Use this sequence for the core of your interview:

  1. Anchor the event: “Tell me about the last time you needed to investigate a drop in conversion.”
  2. Rebuild the timeline: “What triggered that? What did you do first? What happened after that?”
  3. Locate the friction: “Where did you slow down, hesitate, ask for help, or change direction?”
  4. Uncover the workaround: “How did you get around it, and what did that cost in time, risk, or effort?”
  5. Identify consequences: “What happened if this was not resolved? Who noticed or was affected?”
  6. Explore alternatives: “What other option did you consider, and why did you not use it?”

This is more effective than asking, “What are your pain points?” Pain points are often vague labels. A sequence reveals frequency, dependencies, emotional stakes, organizational constraints, and existing alternatives.

Listen for verbs rather than adjectives. “Reporting is frustrating” is weak evidence. “Every Friday I export data, clean it in a spreadsheet, send it to finance, wait for corrections, and rebuild the deck before Monday” is useful evidence. It reveals a repeated workflow, multiple handoffs, a deadline, and an opportunity to reduce rework.

Probe for Proof, Not Just Explanation

The moment a participant says something that supports your hypothesis, slow down. Do not reward the answer by moving on to the next question.

Ask for the last example. Ask what happened next. Ask who else was involved. Ask to see the artifact if the format allows it. The best probes are not “Why?” repeated five times. Repeated why questions can push people to invent a rational explanation after the fact. Better questions ask for observable detail.

  • “Can you walk me through the most recent example?”
  • “What did you do immediately after you noticed that problem?”
  • “What did the spreadsheet, message, or report need to contain?”
  • “Who had to approve or validate that decision?”
  • “What would have happened if you had done nothing?”

In one product analytics study, a participant said, “Leadership needs better dashboards.” That statement could easily have become a feature request. I asked about the last leadership request instead. Executives did not ask for another dashboard. They asked why trial conversion had dropped in one customer segment. The team already had charts; what they lacked was a fast way to connect an anomalous metric to customer context, qualitative feedback, and recent product changes.

The difference matters. “Build more dashboards” is a solution request. “Help teams investigate meaningful changes without manually stitching together evidence” is a problem worth solving.

Find the Tradeoff Behind Every Feature Request

Participants routinely ask for simplicity, flexibility, automation, customization, and control. These requests are too broad to prioritize because they hide tradeoffs.

A request for customization may really be a need to avoid political risk. A request for automation may be a desire to remove repetitive work, or it may be a way to escape accountability. A request for more data may be a request for interpretation.

To get beyond surface preferences, ask what the participant gave up to get their current outcome:

  • “When did you choose the manual option instead of automation?”
  • “What would you be unwilling to give up to make this workflow faster?”
  • “Who needs control here, and who would rather avoid another decision?”
  • “Why was the slower or more expensive option worth it?”
  • “If this problem disappeared tomorrow, what would still prevent success?”

Tradeoffs are where product strategy lives. They tell you whether a problem deserves a new feature, a clearer workflow, a better default, a service intervention, or no investment at all.

Use AI to Increase Depth at the Right Moment

AI can make conducting research interviews dramatically faster, but only if it increases research rigor rather than generating more generic transcripts. A loosely configured AI moderator will ask polite questions at scale and produce a large repository of shallow answers. That is not insight operations. It is ambiguity with a dashboard.

A research-grade AI interview workflow needs explicit controls: the behavioral event to investigate, required probes, hypotheses to distinguish, leading language to avoid, and rules for following unexpected but important threads. The moderator should be able to return to a vague answer, ask for a concrete example, and pursue contradictions rather than mechanically advancing through a script.

Turn Interview Evidence Into a Product Decision

Do not synthesize research by listing answers to each interview question. Organize findings around behavioral patterns and the decisions they support.

For each finding, capture four things: the observed pattern, the supporting evidence, the boundary condition, and the implication. For example: new administrators delay setup when implementation requires cross-functional coordination. The evidence is a repeated set of recent stories and workarounds. The boundary condition is that the issue is most severe in teams without a dedicated implementation owner. The implication is to design for coordination and accountability, not merely simplify settings.

A research interview is successful when it makes a team less certain about its assumptions and more certain about its next move. That is the standard. Not a folder of recordings. Not a slide full of quotes. A sharper decision grounded in what people actually did when the stakes were real.

The questions you ask before the interview shape everything you hear during it. If you want to pressure-test your interview guide or build one from scratch, start with this practical resource on how to write qualitative research questions—it includes 45+ examples you can adapt immediately. Usercall automates the interview process so you can run more sessions without sacrificing the depth that makes research actionable.

Related: semi-structured interview techniques most researchers get wrong · how to ask better follow-up questions in qualitative research · 35 proven qualitative interview questions with real examples

Get faster & more confident user insights
with AI native qualitative analysis & interviews

👉 TRY IT NOW FREE
Junu Yang
Junu is a founder and qualitative research practitioner with 15+ years of experience in design, user research, and product strategy. He has led and supported large-scale qualitative studies across brand strategy, concept testing, and digital product development, helping teams uncover behavioral patterns, decision drivers, and unmet user needs. Before founding UserCall, Junu worked at global design firms including IDEO, Frog, and RGA, contributing to research and product design initiatives for companies whose products are used daily by millions of people. Drawing on years of hands-on interview moderation and thematic analysis, he built UserCall to solve a recurring challenge in qualitative research: how to scale depth without sacrificing rigor. The platform combines AI-moderated voice interviews with structured, researcher-controlled thematic analysis workflows. His work focuses on bridging traditional qualitative methodology with modern AI systems—ensuring speed and scale do not compromise nuance or research integrity. LinkedIn: https://www.linkedin.com/in/junetic/
Published
2026-08-01

Should you be using an AI qualitative research tool?

Do you collect or analyze qualitative research data?

Are you looking to improve your research process?

Do you want to get to actionable insights faster?

You can collect & analyze qualitative data 10x faster w/ an AI research tool

Start for free today, add your research, and get deeper & faster insights

TRY IT NOW FREE

Related Posts