Research Papers 论文研究 1d ago Updated 16h ago 更新于 16小时前 44

TELLER: Dual-Path Iterative Preference Optimization for Table Entity Linking TELLER:用于表格实体链接的双路径迭代偏好优化

TELLER introduces a dual-path framework for table entity linking that combines iterative direct preference optimization with iterative length-normalized regularized preference optimization for reasoning The direct-answer path refreshes preference data with residual errors from the updated model, achieving accuracy gains from 94.35% to 94.50% on TableInstruct and 87.59% to 88.20% on MammoTab V2 The reasoning path uses filtered and compressed chain-of-thought rationales, improving accuracy from 92 TELLER提出双路径迭代偏好优化框架,解决表格实体链接中静态训练监督无法适应模型演进残差错误的问题 直接回答路径通过残差错误动态刷新偏好数据,在TableInstruct和MammoTab V2上分别实现94.50%和88.20%的准确率 推理路径采用长度归一化正则化偏好优化,在MammoTab V2上从79.09%提升至81.85%,同时保持高完整性推理生成率 该方法证明迭代偏好学习对简洁实体预测和显式推理均有效,为表格知识融合提供新范式

58
Hot 热度
72
Quality 质量
62
Impact 影响力

Analysis 深度分析

TL;DR

  • TELLER introduces a dual-path framework for table entity linking that combines iterative direct preference optimization with iterative length-normalized regularized preference optimization for reasoning
  • The direct-answer path refreshes preference data with residual errors from the updated model, achieving accuracy gains from 94.35% to 94.50% on TableInstruct and 87.59% to 88.20% on MammoTab V2
  • The reasoning path uses filtered and compressed chain-of-thought rationales, improving accuracy from 92.90% to 92.95% on TableInstruct and from 79.09% to 81.85% on MammoTab V2 while maintaining high complete reasoning generation rates
  • The key innovation addresses static training supervision by making preference data adaptive to the evolving model's residual errors
  • Both concise entity prediction and explicit reasoning benefit from iterative preference learning, demonstrating the framework's versatility

Why It Matters

This work addresses a critical limitation in current entity linking systems: static preference data that cannot adapt to the residual errors of evolving models. For AI practitioners building table-based information extraction pipelines, TELLER offers a practical dual-path approach that improves accuracy on both direct prediction and reasoning-intensive tasks. The iterative preference optimization framework could serve as a template for other structured data understanding applications beyond entity linking.

Technical Details

  • Dual-path architecture: TELLER employs two parallel paths—a direct-answer path using iterative direct preference optimization (DPO) with residual-error-driven preference data refresh, and a reasoning path using filtered/compressed chain-of-thought rationales followed by iterative length-normalized regularized preference optimization
  • Candidate retrieval: The system first retrieves and ranks Wikidata candidates, then retains reduced table evidence in the prompt to balance context richness with computational efficiency
  • Iterative preference learning: Unlike static preference datasets, TELLER dynamically refreshes preference data based on the residual errors produced by the updated model at each iteration, enabling continuous adaptation
  • Length normalization: The reasoning path incorporates length-normalized regularized preference optimization to address bias introduced by variations in reasoning length during sequence-level preference learning
  • Benchmarks: Evaluated on TableInstruct entity-linking subset and MammoTab V2, with the direct-answer path showing +0.15% and +0.61% accuracy improvements, and the reasoning path showing +0.05% and +2.76% improvements respectively

Industry Insight

  • The iterative preference optimization approach demonstrated in TELLER could be generalized to other structured data tasks where static training data fails to capture model evolution, suggesting a broader paradigm shift from one-shot preference learning to continuous adaptive training
  • The dual-path design—separating concise prediction from explicit reasoning—offers a practical blueprint for systems that need to balance latency (direct answers) with interpretability (reasoning traces), particularly in domain-specific applications like healthcare or finance where explainability matters
  • The significant reasoning path improvement on MammoTab V2 (+2.76%) versus the smaller gain on TableInstruct suggests that iterative preference learning with reasoning is particularly valuable for complex, domain-specific table linking tasks, warranting targeted investment in reasoning-capable pipelines for challenging real-world datasets

TL;DR

  • TELLER提出双路径迭代偏好优化框架,解决表格实体链接中静态训练监督无法适应模型演进残差错误的问题
  • 直接回答路径通过残差错误动态刷新偏好数据,在TableInstruct和MammoTab V2上分别实现94.50%和88.20%的准确率
  • 推理路径采用长度归一化正则化偏好优化,在MammoTab V2上从79.09%提升至81.85%,同时保持高完整性推理生成率
  • 该方法证明迭代偏好学习对简洁实体预测和显式推理均有效,为表格知识融合提供新范式

为什么值得看

本文针对表格实体链接任务中静态偏好数据的固有缺陷,提出动态迭代优化机制,为知识图谱与结构化数据的融合提供了可复用的技术框架。其双路径设计平衡了推理效率与可解释性,对工业界部署实体链接系统具有直接参考价值。

技术解析

  • 双路径架构设计:直接回答路径专注于高效实体预测,推理路径通过压缩链式思维提供可解释性,两者共享Wikidata候选检索和表格证据压缩的前处理流程
  • 迭代偏好优化机制:直接回答路径利用更新模型的残差错误动态刷新偏好数据对,避免静态训练数据的分布偏移;推理路径引入长度归一化正则化,消除推理长度变化对序列级偏好学习的偏向
  • 实验验证:在TableInstruct实体链接子集和MammoTab V2基准上,直接回答路径分别提升0.15%和0.61%,推理路径提升0.05%和2.76%,证明迭代优化对两类任务均有增益

行业启示

  • 迭代偏好学习框架可推广至其他表格理解任务(如表格问答、表格补全),建议团队在实体链接系统中引入残差驱动的动态偏好更新机制
  • 双路径设计为生产环境提供灵活性:高并发场景可用直接回答路径保障延迟,复杂推理场景启用推理路径提升可解释性
  • 长度归一化正则化技术对任何涉及变长推理的序列学习任务均有借鉴价值,建议纳入模型优化标准流程

Disclaimer: The above content is generated by AI and is for reference only. 免责声明:以上内容由 AI 生成,仅供参考。

LLM 大模型 Fine-tuning 微调 Research 科学研究 Training 训练 Evaluation 评测