AI News AI资讯 14d ago Updated 13d ago 更新于 13天前 49

Google's DiffusionGemma proves you don't need to train from scratch to build a text diffusion model Google的DiffusionGemma证明无需从头训练即可构建文本扩散模型

Google DeepMind retrofitted the existing Gemma-4-26B-A4B language model into a diffusion-based text model called DiffusionGemma, using less than 10% of the original training token budget DiffusionGemma refines blocks of 256 tokens in parallel rather than generating text autoregressively, achieving approximately 1,500 tokens per second on an Nvidia H100 — nearly quadrupling tokens per compute step A novel combined training phase called SD·RL merges reinforcement learning and sampler distillation, Google DeepMind将Gemma-4-26B-A4B改造为扩散模型DiffusionGemma,仅用不到10%原始训练token预算完成转换 采用两阶段训练(重建学习+SD·RL强化学习与采样器蒸馏结合),在H100上达到约1,500 tokens/秒的生成速度 双向推理机制允许模型并行生成答案与推理过程,可在输出定稿前自我纠错,Sudoku正确率达85% 模型保留自回归模式,可在两种生成模式间切换,已在多语言语音识别和交互式放射学报告生成等场景应用

70
Hot 热度
72
Quality 质量
68
Impact 影响力

Analysis 深度分析

TL;DR

  • Google DeepMind retrofitted the existing Gemma-4-26B-A4B language model into a diffusion-based text model called DiffusionGemma, using less than 10% of the original training token budget
  • DiffusionGemma refines blocks of 256 tokens in parallel rather than generating text autoregressively, achieving approximately 1,500 tokens per second on an Nvidia H100 — nearly quadrupling tokens per compute step
  • A novel combined training phase called SD·RL merges reinforcement learning and sampler distillation, raising reasoning benchmark scores by an average of ten points while producing answers roughly 50% shorter
  • Bidirectional diffusion enables self-correction during generation, allowing the model to fix early mistakes before finalizing output, demonstrated by an 85% success rate on Sudoku puzzles compared to the base model's complete failure
  • The model retains autoregressive text generation capability, supports rapid structured output completion in 2-3 refinement steps, and is released under Apache 2.0 on Hugging Face as an experimental research foundation

Why It Matters

DiffusionGemma represents a significant step toward alternative text generation paradigms beyond autoregression, demonstrating that diffusion-based language models can achieve competitive speed and reasoning performance through retrofitting rather than expensive from-scratch training. For AI practitioners, this opens a resource-efficient pathway to explore diffusion architectures for specialized applications like structured output generation, multilingual speech recognition, and interactive systems where parallel token refinement offers tangible throughput advantages.

Technical Details

  • Architecture conversion: The team started with the pre-trained Gemma-4-26B-A4B model and converted it into a diffusion model using two training stages — first, learning to reconstruct noisy text blocks from example data, then a combined reinforcement learning and sampler distillation phase (SD·RL) that reduces required compute steps while maintaining quality
  • Parallel token refinement: Unlike autoregressive models that generate one token at a time, DiffusionGemma processes blocks of 256 tokens in parallel through iterative denoising, enabling bidirectional reasoning where the model can correct early errors before finalizing output
  • Performance metrics: Achieves approximately 1,500 tokens per second on Nvidia H100 accelerators, with reasoning benchmark improvements of +10 points on average, answers running ~50% shorter, and Sudoku solving accuracy reaching ~85% versus the base model's 0%
  • Training efficiency: Required less than 10% of the original training token budget, with SD·RL prioritizing speed by reducing compute steps while distilling sampler efficiency — structured outputs like JSON and code repairs complete in just 2-3 refinement steps
  • Hybrid generation modes: The model preserves its original autoregressive word-by-word generation capability, allowing users to switch between diffusion-based parallel refinement and traditional sequential generation depending on the task requirements

Industry Insight

  • The retrofitting approach demonstrates that diffusion-based language models can be developed at a fraction of the cost of training from scratch, suggesting a viable research and deployment pathway for organizations seeking to explore non-autoregressive architectures without massive compute investments
  • The parallel token refinement paradigm offers compelling throughput advantages for single-user, latency-sensitive applications, but the throughput convergence at ~32 concurrent requests highlights the need for further optimization in batched serving scenarios before diffusion models can compete at scale
  • Early adoption by startups like Interfaze for multilingual speech recognition and radiology report generation indicates that specialized, resource-efficient adaptations of diffusion language models may find niche commercial value before general-purpose autoregressive models are fully displaced

TL;DR

  • Google DeepMind将Gemma-4-26B-A4B改造为扩散模型DiffusionGemma,仅用不到10%原始训练token预算完成转换
  • 采用两阶段训练(重建学习+SD·RL强化学习与采样器蒸馏结合),在H100上达到约1,500 tokens/秒的生成速度
  • 双向推理机制允许模型并行生成答案与推理过程,可在输出定稿前自我纠错,Sudoku正确率达85%
  • 模型保留自回归模式,可在两种生成模式间切换,已在多语言语音识别和交互式放射学报告生成等场景应用

为什么值得看

DiffusionGemma展示了将成熟语言模型快速改造为扩散架构的可行路径,为文本生成领域提供了除自回归外的新范式。其"速度优先"的设计思路和对现有模型的高效复用策略,对降低AI研发成本具有参考价值。

技术解析

  • 模型改造:基于Gemma-4-26B-A4B,通过两阶段训练转换为扩散模型,训练token预算不到原模型的10%
  • SD·RL训练:将强化学习与采样器蒸馏合并为单一流程,推理基准质量平均提升10分,每计算步token数接近4倍增长
  • 双向并行生成:每次处理256个token块,答案与推理同步发展,支持错误修正;结构化输出(JSON/代码)仅需2-3步精炼
  • 性能表现:单用户场景约1,500 tokens/秒,32并发请求时自回归模型在吞吐量上追平;存在重复循环和推理段落未闭合等问题

行业启示

  • 扩散模型在文本生成领域的应用正在突破,"改造优于从头训练"的思路可降低研发门槛,适合资源受限场景
  • 速度-质量权衡策略值得借鉴:通过牺牲部分绝对精度换取显著速度提升,适用于对延迟敏感的应用场景
  • 混合生成模式(扩散+自回归)可能是实用化路径,允许根据任务特性灵活切换,兼顾效率与可靠性

Disclaimer: The above content is generated by AI and is for reference only. 免责声明:以上内容由 AI 生成,仅供参考。

Gemini Gemini Open Source 开源 LLM 大模型 Training 训练 Research 科学研究