Research Papers 论文研究 3d ago Updated 2d ago 更新于 2天前 47

Polaris: Learning to Generate Table Descriptions from Retrieval Feedback Polaris:从检索反馈中学习生成表格描述

Polaris trains an LLM to generate table descriptions optimized for retrieval effectiveness rather than linguistic fluency The system repurposes existing table retrieval benchmarks as supervision by ranking candidate descriptions using BM25 and applying Direct Preference Optimization (DPO) Polaris expands abbreviated table and column names before generation to reduce vocabulary mismatch between queries and descriptions Extensive experiments show Polaris significantly outperforms the state-of-the- Polaris系统通过检索反馈直接训练LLM生成表描述,突破传统方法仅优化语言流畅性的局限 利用现有表检索基准中的查询-表相关性判断作为监督信号,通过BM25排序生成偏好对进行DPO微调 引入缩写扩展技术,在生成前展开表和列名缩写,有效减少词汇不匹配问题 实验表明Polaris显著优于当前最先进方法AutoDDG,验证了检索基准可复用为训练监督数据

62
Hot 热度
72
Quality 质量
68
Impact 影响力

Analysis 深度分析

TL;DR

  • Polaris trains an LLM to generate table descriptions optimized for retrieval effectiveness rather than linguistic fluency
  • The system repurposes existing table retrieval benchmarks as supervision by ranking candidate descriptions using BM25 and applying Direct Preference Optimization (DPO)
  • Polaris expands abbreviated table and column names before generation to reduce vocabulary mismatch between queries and descriptions
  • Extensive experiments show Polaris significantly outperforms the state-of-the-art AutoDDG solution
  • The broader contribution demonstrates that retrieval benchmarks can serve as a supervision signal for training LLMs to generate retrieval-oriented metadata

Why It Matters

This work addresses a critical gap in table-centric NLP pipelines where table retrieval is a foundational step for tasks like NL2SQL. By shifting the optimization objective from fluency to retrieval effectiveness, Polaris offers a practical approach to improving the first stage of many database-driven AI systems. The methodology of repurposing existing benchmarks as training supervision is also broadly applicable to other domains where retrieval quality matters.

Technical Details

  • Core Method: Polaris generates multiple candidate natural-language descriptions for each table, ranks them by BM25 retrieval effectiveness against query-table relevance judgments from existing benchmarks, and constructs preference pairs for DPO fine-tuning
  • Vocabulary Expansion: The system preprocesses tables by expanding abbreviated table and column names before description generation, directly addressing the vocabulary mismatch problem between user queries and table metadata
  • Training Pipeline: Leverages query-table relevance labels already present in table retrieval benchmarks as implicit supervision, eliminating the need for additional labeled data
  • Benchmark Comparison: Evaluated against AutoDDG, the current state-of-the-art approach for automated table description generation, with Polaris showing significant performance improvements
  • arXiv Reference: 2608.17171 [cs.CL], submitted 17 Aug 2026

Industry Insight

  • The DPO-based approach to optimizing LLM outputs for retrieval effectiveness rather than fluency could be generalized to other metadata generation tasks beyond tables, such as document summarization for search or schema description generation
  • Repurposing existing benchmarks as training data offers a cost-effective path to improving LLM capabilities without expensive human annotation, a strategy applicable across many NLP subfields
  • As NL2SQL and table-centric AI systems become more prevalent in enterprise settings, retrieval-optimized table descriptions will likely become a standard component of production database query pipelines

TL;DR

  • Polaris系统通过检索反馈直接训练LLM生成表描述,突破传统方法仅优化语言流畅性的局限
  • 利用现有表检索基准中的查询-表相关性判断作为监督信号,通过BM25排序生成偏好对进行DPO微调
  • 引入缩写扩展技术,在生成前展开表和列名缩写,有效减少词汇不匹配问题
  • 实验表明Polaris显著优于当前最先进方法AutoDDG,验证了检索基准可复用为训练监督数据

为什么值得看

本文提出了一种创新的LLM训练范式,证明现有检索基准本身即可作为监督信号,无需额外标注成本。这对降低表检索场景的训练成本、提升NL2SQL等任务的检索效果具有重要实践价值。

技术解析

  • 核心方法:给定查询-表相关性判断,为每个表生成多个候选描述,按BM25检索效果排序构建偏好对,使用Direct Preference Optimization (DPO)微调LLM
  • 缩写扩展:在生成描述前扩展缩写表和列名,减少词汇不匹配导致的检索效果下降
  • 基准复用:将现有表检索基准重新定义为监督数据来源,无需额外标注即可训练检索导向的元数据生成模型
  • 实验验证:在多个表检索基准上测试,Polaris显著超越AutoDDG等SOTA方法

行业启示

  • 为NL2SQL等表中心NLP任务提供了更高效的检索优化方案,可直接提升端到端任务性能
  • 展示了"基准即数据"的新思路,降低检索增强场景的模型训练成本
  • 为其他需要生成检索导向元数据的场景提供了可复用的训练范式

Disclaimer: The above content is generated by AI and is for reference only. 免责声明:以上内容由 AI 生成,仅供参考。

LLM 大模型 RAG 检索增强生成 Benchmark 基准测试 Evaluation 评测 Research 科学研究