Research Papers 论文研究 7h ago Updated 3h ago 更新于 3小时前 46

Thinking effort aligns between humans and reasoning models in abductive reasoning 思考努力在人类与推理模型的溯因推理中保持一致

Large reasoning models (LRMs) trained with reinforcement learning from verifiable rewards show behavioral alignment with humans in abductive reasoning tasks, extending prior work on deductive reasoning Abductive reasoning was chosen as the test domain because its difficulty cannot be inferred from formal structure, preventing models from mimicking effort without genuine search LRMs and humans not only align in reasoning effort but also tend to make similar types of errors Decoding methods that e 研究揭示大型推理模型(LRMs)与人类在溯因推理任务中的推理努力存在行为对齐 使用溯因推理作为实验范式,因其难度无法从形式结构推断,排除了模型通过捷径模仿努力的可能性 发现模型与人类不仅推理成本对齐,还倾向于犯相似类型的错误 允许探索多条推理路径的解码方法可显著提升人机推理成本对齐程度

62
Hot 热度
72
Quality 质量
65
Impact 影响力

Analysis 深度分析

TL;DR

  • Large reasoning models (LRMs) trained with reinforcement learning from verifiable rewards show behavioral alignment with humans in abductive reasoning tasks, extending prior work on deductive reasoning
  • Abductive reasoning was chosen as the test domain because its difficulty cannot be inferred from formal structure, preventing models from mimicking effort without genuine search
  • LRMs and humans not only align in reasoning effort but also tend to make similar types of errors
  • Decoding methods that enable models to explore multiple reasoning paths significantly increase alignment in reasoning cost between humans and LRMs across three tested models

Why It Matters

This research provides stronger empirical evidence that modern reasoning models share cognitive characteristics with humans beyond surface-level behavioral similarity, which has profound implications for cognitive modeling and AI safety. For AI practitioners, it suggests that multi-path decoding strategies can produce models whose reasoning profiles more closely mirror human cognition, potentially improving interpretability and trust in AI systems.

Technical Details

  • The study builds on de Varda et al. (2025), comparing human reaction times with model reasoning traces, but isolates abductive reasoning as a cleaner testbed than deductive tasks
  • Unlike deductive reasoning, abductive reasoning difficulty cannot be inferred from formal logical structure, eliminating the possibility that models exploit shortcuts to simulate effort without genuine computational search
  • Three LRM architectures were tested, all optimized with reinforcement learning from verifiable rewards rather than standard preference alignment
  • The key intervention involved decoding methods that allow models to explore multiple reasoning paths, which was shown to increase alignment in reasoning cost between humans and LRMs
  • Error analysis revealed that models and humans tend to make similar errors, suggesting shared failure modes in abductive reasoning

Industry Insight

  • Multi-path decoding should be considered a standard technique when evaluating or deploying reasoning models, as it not only improves performance but also produces more human-aligned reasoning profiles
  • The finding that models and humans share error patterns suggests that human-centric evaluation benchmarks may be more predictive of real-world model failures than previously assumed
  • Researchers and practitioners should prioritize abductive and non-deductive reasoning tasks when validating cognitive alignment claims, as these domains resist shortcut exploitation and provide firmer evidence of genuine reasoning behavior

TL;DR

  • 研究揭示大型推理模型(LRMs)与人类在溯因推理任务中的推理努力存在行为对齐
  • 使用溯因推理作为实验范式,因其难度无法从形式结构推断,排除了模型通过捷径模仿努力的可能性
  • 发现模型与人类不仅推理成本对齐,还倾向于犯相似类型的错误
  • 允许探索多条推理路径的解码方法可显著提升人机推理成本对齐程度

为什么值得看

本文为认知建模领域提供了关于AI与人类推理过程相似性的新实证证据,表明经过强化学习优化的推理模型在认知机制上与人类存在深层对齐。这对理解大模型的真实推理能力、评估AI认知水平具有重要参考价值。

技术解析

  • 研究聚焦大型推理模型(LRMs),这类模型通过可验证奖励的强化学习优化,目标是获得正确推理结果而非偏好对齐响应
  • 采用溯因推理(abductive reasoning)作为实验范式,区别于演绎推理,其难度无法从形式结构推断,模型无法通过捷径模仿努力
  • 通过对比人类反应时间与模型推理轨迹来量化"思考成本",在三个不同模型上验证了对齐现象
  • 实验发现多路径探索解码方法(let models explore multiple reasoning paths)能增加人机推理成本对齐

行业启示

  • 溯因推理可作为评估AI真实推理能力的更可靠基准,避免模型通过模式匹配"假装"推理
  • 多路径探索解码策略为提升模型推理质量提供了有效技术路径
  • 人机推理对齐的发现支持将认知科学方法应用于AI评估与优化,推动可解释AI发展

Disclaimer: The above content is generated by AI and is for reference only. 免责声明:以上内容由 AI 生成,仅供参考。

Research 科学研究 Alignment 对齐 LLM 大模型 Evaluation 评测 Benchmark 基准测试