Research Papers 论文研究 2h ago Updated 59m ago 更新于 59分钟前 52

FlowEvo: Self-Evolving Agents through the Co-Evolution of Workflows and Executable Skills FlowEvo:通过工作流和可执行技能的协同进化实现自我演化的智能体

FlowEvo is a training-free framework that compiles successful execution traces into reusable skill records for LLM agents. It establishes a workflow-skill-workflow feedback loop to accumulate and refine task-solving capability over time without updating model parameters. The framework includes three coupled mechanisms: workflow-to-skill compilation, skill-to-workflow feedback, and skill curation. Experiments show FlowEvo achieves an 82.8% success rate on ALFWorld, 23.6 percentage points above th FlowEvo是一种无需训练的框架,通过工作流与可执行技能的协同进化,使智能体能够在不更新模型参数的情况下积累和精炼任务解决能力。 该框架将成功轨迹编译为可重用的技能记录,并通过技能库在推理时间持久化,支持未来任务求解。 FlowEvo包含三个核心机制:工作流到技能的编译、技能到工作流的反馈以及技能策展,形成闭环反馈系统。 在ALFWorld、HumanEval和GSM8K基准测试中,FlowEvo实现了最佳的准确率-成本权衡,ALFWorld成功率82.8%,比最强基线高出23.6个百分点。 消融实验证实每个机制对整体结果均有贡献,且代码已开源。

75
Hot 热度
78
Quality 质量
72
Impact 影响力

Analysis 深度分析

TL;DR

  • FlowEvo is a training-free framework that compiles successful execution traces into reusable skill records for LLM agents.
  • It establishes a workflow-skill-workflow feedback loop to accumulate and refine task-solving capability over time without updating model parameters.
  • The framework includes three coupled mechanisms: workflow-to-skill compilation, skill-to-workflow feedback, and skill curation.
  • Experiments show FlowEvo achieves an 82.8% success rate on ALFWorld, 23.6 percentage points above the strongest baseline, with less than half the token usage of the most efficient baseline.

Why It Matters

This research addresses a critical limitation in LLM agent development: the transient nature of workflows discovered during execution. By enabling agents to retain and systematically reuse successful procedures, FlowEvo offers a path toward more efficient and capable autonomous systems that improve over time without costly retraining. The demonstrated improvements in both success rate and computational efficiency make this approach highly relevant for deploying LLM agents in real-world applications.

Technical Details

  • Workflow-to-skill compilation: Extracts reusable executable artifacts from successful traces, pairing them with auxiliary structured guidance. Admission applies interface, replay, and safety checks where feasible.
  • Skill-to-workflow feedback: Retrieves accumulated skills from the skill bank to support future problem solving through either direct execution or structured context injection.
  • Skill curation: Monitors downstream utility and suppresses skills that cause negative transfer, ensuring only beneficial skills persist in the skill bank.
  • Training-free operation: The entire framework operates at inference time without updating model parameters, making it computationally efficient and easy to deploy.
  • Benchmark performance: Achieved 82.8% success rate on ALFWorld (23.6 percentage points above strongest baseline) with less than half the token usage of the most efficient baseline. Also tested on HumanEval and GSM8K for code/math generation tasks.

Industry Insight

  • Cost-effective agent development: FlowEvo demonstrates that significant improvements in agent capability can be achieved without expensive retraining, making it an attractive approach for organizations looking to deploy LLM agents efficiently.
  • Long-term agent learning: The skill bank approach enables agents to accumulate knowledge over time, creating a path toward more autonomous and capable systems that improve with experience rather than requiring constant retraining.
  • Safety and reliability: The inclusion of safety checks and negative transfer suppression in the skill curation mechanism addresses important concerns about deploying autonomous agents in real-world environments, potentially accelerating adoption in regulated industries.

TL;DR

  • FlowEvo是一种无需训练的框架,通过工作流与可执行技能的协同进化,使智能体能够在不更新模型参数的情况下积累和精炼任务解决能力。
  • 该框架将成功轨迹编译为可重用的技能记录,并通过技能库在推理时间持久化,支持未来任务求解。
  • FlowEvo包含三个核心机制:工作流到技能的编译、技能到工作流的反馈以及技能策展,形成闭环反馈系统。
  • 在ALFWorld、HumanEval和GSM8K基准测试中,FlowEvo实现了最佳的准确率-成本权衡,ALFWorld成功率82.8%,比最强基线高出23.6个百分点。
  • 消融实验证实每个机制对整体结果均有贡献,且代码已开源。

为什么值得看

FlowEvo为AI智能体提供了一种高效、无需重训练的技能积累与进化机制,显著提升了复杂任务求解的长期效率与泛化能力,对构建可持续进化的自主智能系统具有重要参考价值。其工作流与技能的协同进化范式,为当前LLM agent的“一次性使用”瓶颈提供了创新解决方案。

技术解析

  • 工作流到技能编译:从成功的推理轨迹中提取可重用的可执行代码或工具调用片段,并辅以结构化元数据(如输入输出规范、前置条件、后置条件),形成技能记录。
  • 技能到工作流反馈:在后续任务中,智能体可从技能库中检索相关技能,通过直接调用或将其作为结构化上下文注入提示工程,增强推理能力。
  • 技能策展机制:持续监控技能在实际任务中的效用,对导致负迁移(negative transfer)的技能进行抑制或淘汰,确保技能库质量。
  • 推理时间持久化:技能记录在推理阶段持久化存储于技能库中,实现跨任务、跨会话的知识积累,无需重新训练模型。
  • 多领域验证:在交互式环境(ALFWorld)和代码/数学生成任务(HumanEval, GSM8K)中均表现优异,验证了框架的通用性与鲁棒性。

行业启示

  • 智能体长期进化成为新范式:FlowEvo证明了无需参数更新即可实现能力积累,推动AI agent从“单次推理”向“持续学习”演进,为构建具有记忆与进化能力的自主系统提供新路径。
  • 技能库与提示工程结合潜力巨大:将可执行技能结构化并嵌入提示流程,可显著提升复杂任务成功率,建议行业关注技能标准化与库建设。
  • 成本与效率优化关键:FlowEvo在降低token使用量同时提升准确率,表明技能复用是降低推理成本的有效手段,适用于高并发、低延迟场景的agent部署。

Disclaimer: The above content is generated by AI and is for reference only. 免责声明:以上内容由 AI 生成,仅供参考。

Agent Agent LLM 大模型 Research 科学研究 Programming 编程