Liquid AI Releases LFM2.5-DSpark Draft Models That Deliver Up to 3.18x Faster Decoding Without Changing Model Outputs
Liquid AI released DSpark draft model checkpoints for three LFM2.5 models (1.2B-Instruct, 2.6B, 8B-A1B), adding speculative decoding paths with ~300M-parameter drafters Achieves up to 3.18x faster decoding on H100 GPUs and 2.87x on M4 Max MacBook Pro with zero accuracy loss under greedy decoding DSpark combines a DFlash-style parallel backbone, a lightweight sequential head modeled as a Markov chain, and a confidence-scheduled verifier for token pruning Speedup is workload-dependent, ranging fro
Analysis
TL;DR
- Liquid AI released DSpark draft model checkpoints for three LFM2.5 models (1.2B-Instruct, 2.6B, 8B-A1B), adding speculative decoding paths with ~300M-parameter drafters
- Achieves up to 3.18x faster decoding on H100 GPUs and 2.87x on M4 Max MacBook Pro with zero accuracy loss under greedy decoding
- DSpark combines a DFlash-style parallel backbone, a lightweight sequential head modeled as a Markov chain, and a confidence-scheduled verifier for token pruning
- Speedup is workload-dependent, ranging from 1.04x to 3.18x, with multi-tool function-calling scenarios seeing 57% latency reduction on LFM2.5-2.6B
- Licensed under LFM Open License v1.0 for commercial use under $10M annual revenue; larger enterprises require direct licensing from Liquid AI
Why It Matters
This release makes speculative decoding significantly more accessible for self-hosted deployments, offering dramatic latency improvements without any compromise to output quality. For AI practitioners building agentic systems, local coding assistants, or on-device applications, DSpark provides a practical path to faster inference that scales across both cloud GPUs and consumer hardware.
Technical Details
- Architecture: Each drafter is approximately 300M parameters (295.7M for 1.2B-Instruct, 327.7M for 2.6B and 8B-A1B targets) with 5 full-attention layers, hidden_size=2048, intermediate_size=6144, GQA at 32 heads over 8 KV heads, and a block size of 9 tokens
- DSpark Method: Combines three components: (1) a DFlash-style parallel backbone conditioned on target context features for single-pass hidden state generation, (2) a lightweight sequential head using a Markov chain at rank 256 to restore inter-token dependency, and (3) a confidence-scheduled verifier that prunes low-confidence suffixes when verification cost exceeds savings
- Implementation: Weights ship as Safetensors and GGUF formats; both llama.cpp and SGLang provide day-one support with dedicated speculative decoding flags; embedding and LM head are tied from the target model at load time
- Benchmarks: Tested on MATH500, HumanEval, MBPP, GSM8K, and MT-Bench with block size 9, batch size 1, and temperature 0; H100 results in BF16 via SGLang, M4 Max results in FP16 GGUF via llama.cpp with Metal
- Performance: LFM2.5-1.2B-Instruct achieves 2.10x mean speedup (656→1384 tok/s) on H100 and 2.54x (138→350 tok/s) on M4 Max; LFM2.5-2.6B achieves 2.67x (323→864 tok/s) on H100; LFM2.5-8B-A1B achieves 2.54x (418→1074 tok/s) on H100 but only 1.18x on M4 Max due to MoE implementation limitations
Industry Insight
- Agentic AI deployment: The 57% latency reduction in multi-tool function-calling scenarios makes DSpark particularly valuable for agent systems that repeatedly decode during planning and tool execution cycles, directly improving user experience in conversational AI applications
- Hardware-aware optimization: The significant performance gap between dense and MoE models on Apple Silicon (3.18x vs 1.18x on M4 Max) highlights that speculative decoding benefits are not uniform across architectures; practitioners should benchmark their specific model types before deployment
- Licensing strategy: The $10M revenue threshold in the LFM Open License creates a clear bifurcation between indie/startup adoption and enterprise licensing, suggesting Liquid AI is targeting the long-tail developer market while preserving revenue from larger organizations
Disclaimer: The above content is generated by AI and is for reference only.