IBM Releases Granite 4.2: Bringing Native Reasoning and Agentic RL to Open Enterprise Models
IBM released Granite 4.2, a family of open reasoning LLMs (3B, 8B, 30B) built from scratch on ~15T tokens, with native chain-of-thought reasoning and a thinking/non-thinking/low-effort mode switch Agentic RL (SWE, Terminal, Search) is applied only to the 8B and 30B models via a multi-stage asynchronous GRPO pipeline, creating a significant capability gap between the 3B and larger variants All models ship under Apache 2.0 with full commercial deployment rights, targeting everything from laptop in
Analysis
TL;DR
- IBM released Granite 4.2, a family of open reasoning LLMs (3B, 8B, 30B) built from scratch on ~15T tokens, with native chain-of-thought reasoning and a thinking/non-thinking/low-effort mode switch
- Agentic RL (SWE, Terminal, Search) is applied only to the 8B and 30B models via a multi-stage asynchronous GRPO pipeline, creating a significant capability gap between the 3B and larger variants
- All models ship under Apache 2.0 with full commercial deployment rights, targeting everything from laptop inference (3B via Ollama/LM Studio) to enterprise GPU clusters (30B via vLLM)
- The 30B model achieves 57.00 on SWE-Bench Verified and 29.24 on Terminal-Bench 2.1, while the 3B already reaches 78.33 on AIME25
- IBM simultaneously released Granite Speech 5.0 Turbo CTC, a 470M-parameter ASR model with no LLM backbone, delivering ~12,600 RTFx throughput on a single H200
Why It Matters
Granite 4.2 represents a significant shift in the open-weight reasoning model landscape by combining explicit chain-of-thought capabilities with agentic reinforcement learning at scale, all under a permissive Apache 2.0 license. For AI practitioners, it provides a rare deployable alternative to closed reasoning models, with size-appropriate options ranging from edge devices to data-center GPUs, and the agentic RL training on real sandboxed environments directly addresses the growing demand for autonomous coding and tool-use agents in production.
Technical Details
- Architecture: Decoder-only dense transformer (not MoE or hybrid), using Grouped Query Attention with 8 KV heads, RoPE (θ = 10,000,000), SwiGLU MLPs, RMSNorm (ε = 1e-5), untied input/output embeddings, and bfloat16 precision. The 3B has 40 layers / 2560 embedding, the 8B has 40 layers / 4096 embedding, and the 30B has 64 layers / 32768 MLP hidden size. Published context is 128K tokens with a 512K long-context pre-training phase.
- Pre-training: ~15 trillion tokens from scratch, including 1 trillion tokens of synthetic code generated via IBM's CodeAlchemy pipeline.
- Post-training pipeline: A multi-stage, multi-environment RL chain using asynchronous GRPO with leave-one-out baselines and truncated importance sampling. The sequence is RLVR → skill boosters → SWE → Terminal → Search → RLHF. SFT used ~7.2M samples (~100B tokens, ~65B trainable) with a 31.6% agentic / 68.4% non-agentic mix, and trajectories were generated across OpenHands, SWE-agent, Terminus-2, MiniSWE, Codex, and Goose harnesses, judged by GPT-OSS-120B and Gemma 4.
- Agentic RL scope: Only the 8B and 30B models receive the agentic RL block (SWE, Terminal, Search), while the 3B receives foundational RL and alignment only — a key design decision explaining the capability gap across sizes.
- Granite Speech 5.0 Turbo CTC: 470M-parameter connectionist temporal classification (CTC) model with no LLM backbone, achieving ~12,600 RTFx on a single H200 (vs. ~6,000 for current Open ASR leaderboard leaders). WebGPU demo available.
- Serving: Speculative decoding layer included for faster inference; GGUF quants down to Q4_K_M released; FP8/NVFP4 support on vLLM for the 30B.
Industry Insight
- The deliberate exclusion of agentic RL from the 3B model signals that IBM views autonomous tool-use capability as a scale-dependent property, suggesting that smaller reasoning models will remain primarily suited for structured, non-agentic tasks — practitioners should match model size to agent complexity requirements rather than assuming capability scales linearly.
- The multi-stage GRPO pipeline with leave-one-out baselines and truncated importance sampling offers a replicable blueprint for open-reasoning model development; teams building proprietary reasoning models may adopt similar asynchronous RL chaining to avoid the instability of single-pass RLHF on long-CoT trajectories.
- The Apache 2.0 licensing combined with on-premise deployment viability positions Granite 4.2 as a strong candidate for regulated industries (financial services, healthcare, public sector) that require both reasoning capability and data sovereignty, potentially accelerating open-weight model adoption in compliance-sensitive verticals.
Disclaimer: The above content is generated by AI and is for reference only.