When Less Is More: An Empirical Study of Minimal Responses in Counseling Dialogues and the Behavior of LLMs
Minimal responses (backchannel cues, concise empathic statements) are interactionally valuable in counseling but overlooked by current dialogue systems that favor long, content-rich replies A two-stage filtering method (length + content filtering, then LLM contextual verification) was developed for cross-lingual analysis of minimal responses across counseling datasets Minimal responses are common in human-collected counseling datasets but substantially underrepresented in LLM-generated responses
Analysis
TL;DR
- Minimal responses (backchannel cues, concise empathic statements) are interactionally valuable in counseling but overlooked by current dialogue systems that favor long, content-rich replies
- A two-stage filtering method (length + content filtering, then LLM contextual verification) was developed for cross-lingual analysis of minimal responses across counseling datasets
- Minimal responses are common in human-collected counseling datasets but substantially underrepresented in LLM-generated responses
- Strong commercial LLMs can generate minimal responses when explicitly instructed but struggle to judge when they are contextually appropriate
- Counseling-specific models trained on synthetic data perform particularly poorly, defaulting to longer responses, and LLM-based evaluation frameworks may undervalue appropriately minimal responses
Why It Matters
This research exposes a critical gap in how AI counseling systems are designed and evaluated—prioritizing verbosity over interactional effectiveness. For AI practitioners building therapeutic or support dialogue systems, ignoring the nuance of minimal responses risks producing models that feel overbearing or miss key moments where silence and brevity are most supportive. It also raises concerns about the reliability of LLM-based evaluation metrics in domain-specific applications.
Technical Details
- The authors developed a two-stage filtering pipeline: first filtering utterances by length and content criteria, then performing contextual verification using an LLM to confirm minimal-response appropriateness
- Cross-lingual analysis was conducted across multiple counseling dialogue datasets to compare the prevalence of minimal responses in human vs. LLM-generated dialogues
- Evaluation was performed in manually curated dialogue contexts where human counselors had used minimal responses, testing both general-purpose and counseling-specific LLMs
- The study found that while strong commercial LLMs can produce minimal responses under explicit instruction, they lack the pragmatic judgment to deploy them contextually without prompting
- Counseling-specific models trained on synthetic data showed the poorest performance, consistently generating longer, more information-dense responses instead
Industry Insight
- AI dialogue systems for mental health and counseling should incorporate explicit training and evaluation on minimal response generation, rather than optimizing solely for response richness or informativeness
- LLM-based automated evaluation pipelines need domain-aware calibration, as they may systematically penalize interactionally appropriate brief responses, skewing model optimization in the wrong direction
- Synthetic data training for specialized counseling models requires careful curation that preserves the full spectrum of counselor utterance styles, including brevity, to avoid reinforcing verbosity bias
Disclaimer: The above content is generated by AI and is for reference only.