Research Papers 论文研究 5h ago Updated 1h ago 更新于 1小时前 44

GreenLeaf Law Embed Tiny: A Compact Embedding Model for Legal Domain Retrieval GreenLeaf法律嵌入迷你版:面向法律领域检索的紧凑嵌入模型

GreenLeaf Law Embed Tiny is a 0.6B parameter embedding model specifically designed for legal domain retrieval tasks It achieves 75.11% on the Massive Legal Embedding Benchmark (MLEB) and 64.38% on MTEB(Law, v1), competing effectively among sub-1B parameter models The model uses a two-stage training pipeline combining knowledge distillation from a larger teacher model with domain-specific fine-tuning and hard negative mining A curated dataset of 3.4 million query-passage pairs, including 150,000 GreenLeaf Law Embed Tiny是一个0.6B参数的轻量级法律领域嵌入模型,在1B以下参数规模中表现竞争力强 在MLEB基准上达到75.11%,在MTEB(Law, v1)上达到64.38%,验证了小参数模型在垂直领域的可行性 采用两阶段训练策略:知识蒸馏(大模型→小模型)+ 硬负样本挖掘的领域微调 构建了340万查询-段落对数据集,其中15万为跨司法管辖区人工标注的高质量样本 支持BF16/INT8/binary多级量化,可在资源受限环境中高效部署

58
Hot 热度
72
Quality 质量
62
Impact 影响力

Analysis 深度分析

TL;DR

  • GreenLeaf Law Embed Tiny is a 0.6B parameter embedding model specifically designed for legal domain retrieval tasks
  • It achieves 75.11% on the Massive Legal Embedding Benchmark (MLEB) and 64.38% on MTEB(Law, v1), competing effectively among sub-1B parameter models
  • The model uses a two-stage training pipeline combining knowledge distillation from a larger teacher model with domain-specific fine-tuning and hard negative mining
  • A curated dataset of 3.4 million query-passage pairs, including 150,000 human-curated samples across diverse legal jurisdictions, was used for training
  • The architecture supports multiple quantization levels (BF16, INT8, binary) enabling deployment in resource-constrained environments

Why It Matters

This model addresses the growing need for efficient, domain-specific embedding solutions in the legal sector, where specialized knowledge retrieval is critical. By demonstrating that a compact 0.6B parameter model can achieve competitive performance, it shows that smaller, fine-tuned models can rival larger general-purpose alternatives in specialized domains. This has significant implications for organizations seeking to deploy legal AI systems with limited computational resources.

Technical Details

  • Architecture: 0.6B parameter embedding model with support for multiple quantization levels (BF16, INT8, binary) for flexible deployment
  • Training Pipeline: Two-stage approach - first distilling knowledge from a larger teacher model into the compact student architecture, then applying domain-specific fine-tuning with hard negative mining to improve retrieval accuracy
  • Dataset: 3.4 million query-passage pairs including 150,000 human-curated samples spanning diverse legal jurisdictions, ensuring broad coverage of legal domains
  • Benchmarks: Evaluated on Massive Legal Embedding Benchmark (MLEB) achieving 75.11% and MTEB(Law, v1) achieving 64.38%, demonstrating strong performance among sub-1B parameter models
  • Key Innovation: The combination of knowledge distillation with hard negative mining and domain-specific fine-tuning on high-quality curated data enables competitive performance despite the model's compact size

Industry Insight

  • Organizations working in legal tech can now deploy efficient embedding models without requiring massive computational infrastructure, reducing costs and enabling edge deployment for legal AI applications
  • The success of domain-specific training with high-quality curated data reinforces the trend that specialized models can outperform general-purpose alternatives in niche domains, even at smaller scales
  • The multi-quantization support (BF16, INT8, binary) provides flexibility for different deployment scenarios, from cloud-based services to resource-constrained environments, making legal AI more accessible to smaller firms and jurisdictions

TL;DR

  • GreenLeaf Law Embed Tiny是一个0.6B参数的轻量级法律领域嵌入模型,在1B以下参数规模中表现竞争力强
  • 在MLEB基准上达到75.11%,在MTEB(Law, v1)上达到64.38%,验证了小参数模型在垂直领域的可行性
  • 采用两阶段训练策略:知识蒸馏(大模型→小模型)+ 硬负样本挖掘的领域微调
  • 构建了340万查询-段落对数据集,其中15万为跨司法管辖区人工标注的高质量样本
  • 支持BF16/INT8/binary多级量化,可在资源受限环境中高效部署

为什么值得看

本文展示了小参数模型(<1B)在法律垂直领域的有效解决方案,为资源受限场景下的法律AI部署提供了可行路径。两阶段训练方法(蒸馏+硬负样本挖掘)对垂直领域模型优化具有参考价值。

技术解析

  • 模型规模与性能:0.6B参数嵌入模型,在MLEB上达到75.11%,在MTEB(Law, v1)上达到64.38%,在1B以下参数模型中处于领先水平。
  • 两阶段训练流程:第一阶段通过知识蒸馏将大教师模型的知识迁移到紧凑的学生架构;第二阶段进行领域微调,结合硬负样本挖掘(hard negative mining)提升检索区分度。
  • 数据集构建:340万查询-段落对,包含15万人工标注样本,覆盖多个法律管辖区,强调数据质量而非单纯规模。
  • 推理优化:支持BF16、INT8、binary三种量化级别,适配不同硬件约束,实现从云端到边缘设备的灵活部署。

行业启示

  • 垂直领域模型开发应重视"高质量数据+针对性训练"而非盲目追求参数规模,小模型在专业场景可媲美通用大模型。
  • 硬负样本挖掘是提升检索模型性能的关键技术,值得在金融、医疗等需要高精度检索的领域推广。
  • 多级量化支持降低了法律科技部署门槛,有助于推动AI在法律实务中的普及应用。

Disclaimer: The above content is generated by AI and is for reference only. 免责声明:以上内容由 AI 生成,仅供参考。

Embedding Model 嵌入模型 Legal AI 法律AI Open Source 开源 Fine-tuning 微调 Benchmark 基准测试