AI agents win at Slay the Spire 2 after researchers replace growing chat logs with structured memory
AgenticSTS replaces growing context logs with a structured five-layer memory architecture to prevent "context rot" and maintain performance in long-horizon tasks. The system achieves a 60% win rate in Slay the Spire 2 by utilizing an L5 skill library, doubling the baseline performance of frontier models without memory. Compared to traditional agents, AgenticSTS reduces token usage by 66-90x and latency by 4x, keeping prompt size constant regardless of game duration. Memory transferability is lim
Analysis
TL;DR
- AgenticSTS replaces growing context logs with a structured five-layer memory architecture to prevent "context rot" and maintain performance in long-horizon tasks.
- The system achieves a 60% win rate in Slay the Spire 2 by utilizing an L5 skill library, doubling the baseline performance of frontier models without memory.
- Compared to traditional agents, AgenticSTS reduces token usage by 66-90x and latency by 4x, keeping prompt size constant regardless of game duration.
- Memory transferability is limited; strategies learned by one model do not effectively transfer to others, indicating strong model-specific dependencies in learned behaviors.
Why It Matters
This research addresses the critical scalability bottleneck of "context rot" in agentic AI, demonstrating that efficient memory management is more impactful than raw model capability for complex, multi-step reasoning tasks. By proving that structured, bounded memory can significantly outperform unbounded context windows, it provides a practical blueprint for reducing inference costs and improving reliability in real-world applications requiring long-term state retention.
Technical Details
- Five-Layer Memory Architecture: The agent constructs prompts from five distinct slots: L1 (fixed protocols), L2 (current state schemas), L3 (retrieved rules), L4 (episodic summaries of past runs), and L5 (strategic skills).
- Skill Library Implementation: L5 stores tactical rules for recurring situations; enabling this layer increased win rates from 30% to 60% on the lowest difficulty setting.
- Performance Benchmarks: Tested on Slay the Spire 2, where frontier models previously failed completely. The agent reached higher difficulties (A6-A8) only when inter-run memory (L4/L5) was active.
- Efficiency Metrics: Maintained a consistent ~5,000 token count per turn, whereas competing agents with growing logs reached up to 527,000 tokens, causing significant latency increases.
Industry Insight
- Shift from Context to Structure: Developers should prioritize designing explicit memory structures and retrieval mechanisms over relying on expanding context windows to manage long-running agent sessions.
- Cost Optimization: Implementing bounded memory architectures can drastically reduce API costs and latency, making complex agentic workflows economically viable at scale.
- Model-Specific Memory: Since learned memory does not easily transfer between different model architectures, teams should expect to fine-tune or retrain memory components for each specific model deployment rather than treating memory as a portable asset.
Disclaimer: The above content is generated by AI and is for reference only.