Vendbridge websiteCartorga

Voice, chat or human? How a consultancy scaled its method with AI interviewers

Vendbridge turned its own method into AI interviewers and tested them with 98 people. Voice beat chat: half the interview time, 58% more distinct needs. And per minute, voice surfaced at least two and a half times as many insights as an experienced human interviewer typically does. Run in parallel, AI interviews scale their method from a handful of interviews to an entire population.

Key takeaways

  • ≥2.5×More insights per interview minute from the AI voice interviewer than from an experienced human interviewer
  • 7.6 vs 14 minMedian voice conversation against chat, and voice still surfaced 58% more distinct needs
  • 5 daysFor all 98 interviews, voice and chat, run in parallel; voice in four languages from one setup
  • ~8.3/10Rating in both channels: people rated voice and chat alike

About the study

Qualitative interviews are one of the best ways to learn what people need, but they do not scale. A typical project needs 20 to 30 interviews per group, which takes six to eight weeks and many hours of senior staff. So most projects hear a handful of people and guess the rest.

Vendbridge, a Zurich strategy boutique, wanted to know whether AI interviewers can take over this work without losing depth. Together with moweb, which recruited the respondents from its panel, and Cartorga, Vendbridge ran a controlled test on an everyday decision: how people choose a holiday. Half the respondents spoke with an AI voice interviewer, half typed with an AI chat interviewer, both following Vendbridge’s method.

How it works

  1. Bring your method.The consultancy brings what makes its work good: the questions, the steps to explore and the rules for what counts as a finding. Here: Vendbridge’s CFI method.
  2. Build your interviewer.On Cartorga, the consultancy turns its method into its own AI voice or chat interviewer, without a development team.
  3. Scale it to everyone.The interviewer talks to a whole company or customer base at once, in several languages, at any hour.
  4. Analyse with the same method.Findings come out in the method’s own terms, each traced to what a person said. The consultant judges what they mean.

In this study, the voice interviewer ran on Cartorga. The chat interviewer was a prototype that Vendbridge built itself.

Does an AI interviewer surface as much as a human?

≥2.5×More insights per interview minute than an experienced human interviewer

Per minute, it surfaces more. Each voice interview produced 8.1 insights (Job Metrics) on average, about one for every minute of conversation. From past CFI projects, Vendbridge puts an experienced human interviewer at about 0.3 to 0.4 per minute. Minute for minute, the AI voice interviewer surfaced at least two and a half times as much.

And AI interviews do not have to be long, because they can be many: they run in parallel, so interviewing ten times the people does not take ten times the weeks.

The human figure is an estimate from past projects, not a controlled comparison. A direct test with the same guide and the same analysis is next.

Exhibit 1.  The AI voice interviewer surfaces more insights per minute than a human 00.51.0 per minuteAI voice interviewer: 1.0 insights per interview minute, this studyAI voicethis study1.0Experienced human interviewer: about 0.3 to 0.4 insights per interview minute, estimate from past projectsHuman interviewerestimate, past projects0.3 to 0.4AI chat interviewer: 0.4 insights per interview minute, this studyAI chatthis study0.4
Insights (Job Metrics) per interview minute. AI: 49 voice and 49 chat interviews in this study. Human: estimate from past Vendbridge CFI projects, not measured in this study.

Can it scale to a whole company?

5 daysFor all 98 interviews, voice and chat

Yes. All 98 interviews, voice and chat, ran in parallel, at whatever hour suited each respondent, and were done in five days, from 22 to 26 September. The voice interviewer ran in German or Swiss German, French, English and Italian from one setup, with no extra work per language.

Exhibit 2.  One setup, four languages German or Swiss German: 83 interviews83 German or Swiss GermanFrench: 10 interviews10English: 4 interviewsItalian: 1 interviewFrench 10 · English 4 · Italian 1
All 98 interviews by the language respondents answered in. Voice (49): German or Swiss German 39, French 6, English 3, Italian 1. Chat (49): German interface; 44 answered in German, 4 in French, 1 in English.

Do more interviews find more needs?

+1.8New needs from each further voice interview, even after 49 interviews

Scale also brings depth. After 49 interviews, each further voice interview still added about 1.8 new needs, and more than half of all needs came up in just one interview. The usual rule of 20 to 30 interviews was made for hour-long human interviews. With AI interviews, extra interviews cost little, so the point where new interviews stop adding needs can decide when to stop.

Exhibit 3.  Neither group runs out of new needs: after 49 interviews, voice still adds about 2 new needs each, chat about 1 Distinct needs found against number of interviews, average of 2,000 random interview orders Distinct needsusual range, 20 to 30 per group0408012016011020304049InterviewsVoice: 153 distinct needs after 49 interviewsVoice: 153 needs+1.8 per extra interviewChat: 97 distinct needs after 49 interviewsChat: 97 needs+1.0 per extra interview
Per-group Long-Lists after merging (153 voice, 97 chat). Expected number of distinct needs after n interviews drawn at random from the 49 of each group.

“AI did not replace our method. It finally let us use it with everyone, not just the twenty people we had time for.”

Beat Walther, Partner, Vendbridge

Do people like talking to an AI interviewer?

~8.3/10Rating in both channels, voice and chat

Yes, in both channels alike. Voice and chat were both rated about 8.3 out of 10 on average. Whether people spoke or typed, they rated the AI interviewer about the same.

In voice, 78% gave 8 or higher and 53% a 9 or a 10; the most common rating was 10. Only 4 of 36 rated it below 7, mostly because the AI misheard them or a question felt repetitive.

We said at the start of every interview that it was run by an AI and that people could stop at any time. None of the 98 respondents broke off.

“Nine, because you just have to talk, no need to write.”Voice respondent, rating 9/10, translated from French
Exhibit 4.  Most participants rate it 8 or higher, in voice and in chat 05101Rating 2: 1 participant123Rating 4: 1 participant14Rating 5: 1 participant15Rating 6: 1 participant16Rating 7: 4 participants47Rating 8: 9 participants98Rating 9: 8 participants89Rating 10: 11 participants1110
Voice: number of participants per rating, 1 to 10, asked by the AI at the end of the interview. 36 ratings.
Chat: participants per rating, 1 to 5 01020Rating 1: 2 participants21Rating 2: 3 participants32Rating 3: 3 participants33Rating 4: 14 participants144Rating 5: 23 participants235
Chat: number of participants per rating, 1 to 5, short form after the interview. 45 ratings.

Does age matter?

NoEvery age group rates the voice interview 8 or higher

Every age group rated the voice interview between 8.0 and 8.8 on average, around the overall average of 8.3. Younger participants rated slightly higher, but the link between age and rating is weak and not significant.

In chat, too, we found no significant link between age and rating. But the chat averages swing much more from one age group to the next, from 7.6 to 9.4, while voice stays between 8.0 and 8.8.

Voice seems to more reliably offer a predictable experience to people of all ages.

“I would give an eight, because you as an AI responded quite well to my questions, as if you were a real person.”Voice respondent, rating 8/10, translated from German
Exhibit 5.  Every age group rates the AI interviewer about 8 or higher 0510VoiceChatVoiceChatUnder 40: voice 8.8, chat 7.8Under 4011 voice · 9 chat ratings8.87.840-49: voice 8.7, chat 9.440-499 voice · 10 chat ratings8.79.450-59: voice 8.0, chat 9.050-596 voice · 10 chat ratings8.09.060 and over: voice 8.2, chat 7.660 and over9 voice · 16 chat ratings8.27.6All ages: voice 8.3, chat 8.4All ages35 voice · 45 chat ratings8.38.4
Average rating by age group, out of 10. Voice: 35 ratings with a known age, no significant relationship between age and rating (Spearman ρ = −0.17, p = 0.32). Chat: 45 ratings, 1-5 scale multiplied by 2; no significant relationship between age and rating (Spearman ρ = −0.05, p = 0.76).

Voice or chat?

+58%More distinct needs by voice than by chat: 153 against 97

Voice hears more, chat asks more precisely. People say about three times as many words as they type, so voice found more distinct needs, including rare ones: 80 needs came up only in voice, 38 only in chat. Chat answers shrank by half after the first fifth of the interview; voice answers stayed long to the end.

Chat has its own strengths. The question stays on screen, the answer arrives as exact text, and chat gave exact money amounts more often. That makes voice the better tool for discovering needs in depth, and chat strong for screening and collecting figures. A hybrid that shows and speaks each question is the next test.

Exhibit 6.  Voice finds more, in half the time VoiceChatDistinct needs after merging: voice 153, chat 97Distinct needs after merging15397Median words per respondent: voice 279, chat 97Median words per respondent27997Median interview length, minutes: voice 7.6, chat 14Median interview length, minutes7.614
49 voice and 49 chat interviews. Bars scaled per row. All differences far too large to be chance (permutation test, p < 0.001).
Exhibit 7.  Voice yields more metrics because people say more Job Metrics per interviewVoiceChatTrend048121625501002505001000Respondent words per interview (log scale)Chat interview: 69 words, 6 Job MetricsChat interview: 79 words, 4 Job MetricsChat interview: 274 words, 8 Job MetricsChat interview: 43 words, 5 Job MetricsChat interview: 70 words, 3 Job MetricsChat interview: 200 words, 9 Job MetricsChat interview: 79 words, 6 Job MetricsChat interview: 26 words, 3 Job MetricsChat interview: 97 words, 5 Job MetricsChat interview: 106 words, 4 Job MetricsChat interview: 161 words, 5 Job MetricsChat interview: 71 words, 4 Job MetricsChat interview: 81 words, 6 Job MetricsChat interview: 71 words, 7 Job MetricsChat interview: 25 words, 0 Job MetricsChat interview: 110 words, 4 Job MetricsChat interview: 103 words, 7 Job MetricsChat interview: 102 words, 5 Job MetricsChat interview: 127 words, 3 Job MetricsChat interview: 205 words, 10 Job MetricsChat interview: 58 words, 5 Job MetricsChat interview: 197 words, 9 Job MetricsChat interview: 251 words, 7 Job MetricsChat interview: 62 words, 7 Job MetricsChat interview: 62 words, 2 Job MetricsChat interview: 42 words, 3 Job MetricsChat interview: 157 words, 9 Job MetricsChat interview: 67 words, 1 Job MetricsChat interview: 118 words, 5 Job MetricsChat interview: 75 words, 7 Job MetricsChat interview: 78 words, 7 Job MetricsChat interview: 136 words, 7 Job MetricsChat interview: 94 words, 6 Job MetricsChat interview: 25 words, 3 Job MetricsChat interview: 230 words, 12 Job MetricsChat interview: 43 words, 3 Job MetricsChat interview: 129 words, 8 Job MetricsChat interview: 113 words, 12 Job MetricsChat interview: 101 words, 3 Job MetricsChat interview: 38 words, 4 Job MetricsChat interview: 201 words, 7 Job MetricsChat interview: 230 words, 9 Job MetricsChat interview: 61 words, 5 Job MetricsChat interview: 69 words, 4 Job MetricsChat interview: 168 words, 12 Job MetricsChat interview: 258 words, 7 Job MetricsChat interview: 261 words, 10 Job MetricsChat interview: 69 words, 3 Job MetricsChat interview: 132 words, 6 Job MetricsVoice interview: 118 words, 5 Job MetricsVoice interview: 570 words, 15 Job MetricsVoice interview: 387 words, 8 Job MetricsVoice interview: 126 words, 3 Job MetricsVoice interview: 395 words, 10 Job MetricsVoice interview: 212 words, 8 Job MetricsVoice interview: 220 words, 8 Job MetricsVoice interview: 176 words, 8 Job MetricsVoice interview: 116 words, 8 Job MetricsVoice interview: 578 words, 13 Job MetricsVoice interview: 785 words, 8 Job MetricsVoice interview: 522 words, 10 Job MetricsVoice interview: 292 words, 10 Job MetricsVoice interview: 308 words, 9 Job MetricsVoice interview: 416 words, 8 Job MetricsVoice interview: 313 words, 9 Job MetricsVoice interview: 119 words, 6 Job MetricsVoice interview: 157 words, 5 Job MetricsVoice interview: 279 words, 9 Job MetricsVoice interview: 541 words, 11 Job MetricsVoice interview: 124 words, 8 Job MetricsVoice interview: 325 words, 11 Job MetricsVoice interview: 349 words, 7 Job MetricsVoice interview: 89 words, 3 Job MetricsVoice interview: 196 words, 3 Job MetricsVoice interview: 254 words, 6 Job MetricsVoice interview: 497 words, 7 Job MetricsVoice interview: 1231 words, 13 Job MetricsVoice interview: 338 words, 8 Job MetricsVoice interview: 253 words, 10 Job MetricsVoice interview: 274 words, 9 Job MetricsVoice interview: 205 words, 7 Job MetricsVoice interview: 217 words, 5 Job MetricsVoice interview: 103 words, 4 Job MetricsVoice interview: 203 words, 7 Job MetricsVoice interview: 631 words, 14 Job MetricsVoice interview: 301 words, 9 Job MetricsVoice interview: 452 words, 16 Job MetricsVoice interview: 106 words, 5 Job MetricsVoice interview: 56 words, 2 Job MetricsVoice interview: 279 words, 4 Job MetricsVoice interview: 163 words, 8 Job MetricsVoice interview: 318 words, 11 Job MetricsVoice interview: 259 words, 5 Job MetricsVoice interview: 254 words, 8 Job MetricsVoice interview: 136 words, 4 Job MetricsVoice interview: 350 words, 9 Job MetricsVoice interview: 333 words, 8 Job MetricsVoice interview: 327 words, 14 Job MetricsTrend for both groups: Job Metrics = -8.07 + 2.97 × ln(words)
Each dot is one interview (49 voice, 49 chat). Respondent words only, screening questions left out; the word axis is on a log scale. The line is one trend for both groups together.

Why not build your own?

Vendbridge tried. With AI coding tools, it built a working chat interviewer in two weeks, and it ran well as a prototype. Running it in client projects is another matter: data protection, tracing every interview, stable quality as the AI models change, and fixing errors all keep costing time.

“Building our own interviewer showed us where the effort lies. The prototype took two weeks. Making it fit for client projects, with data protection, traceability, stable quality across model upgrades and support, would take far longer and keep costing. Our conclusion as a consultancy: we build the method, not the tool.”Yann Wermuth, Vendbridge

What this means

  • More insights per minute.The AI voice interviewer surfaced at least two and a half times as many insights per minute as an experienced human interviewer.
  • Scale to everyone.Hear a whole company or customer base instead of a handful of people, in their own language, and let new needs decide when to stop.
  • The method stays with the consultant.The consultancy designs, steers and judges. The AI runs the conversations, and people rate it alike whether they speak or type.

About the partners and the method

Vendbridge (Zurich) is a consultancy that measures what customers want, using its Customer-Focused Innovation (CFI) method, built over 20 years and more than 200 growth missions. moweb (Düsseldorf) has run online panels since 2004 and today reaches more than 3 million members in over 30 countries. Cartorga provided the platform on which Vendbridge deployed its method, to scale it to a much larger group of people sourced through moweb.

Respondents were leisure travellers from Germany, Austria and Switzerland, recruited from the moweb panel and split into two groups of 49. Both interviewers followed the same interview logic, and insights were extracted and merged with the same CFI rules for both channels.

← All resultsRead next: Will people talk to an AI interviewer? 99 calls say yes