Running Low-Latency Analytical Workloads with GPU-Accelerated Presto on NVIDIA GB200 NVL72
GPU-accelerated Presto on NVIDIA GB200 NVL72 achieves up to 8x lower latency than multinode CPU clusters for TPC-H analytical benchmarks. Performance gains are driven by NVIDIA cuDF for query execution, NVLink 5.0 for high-bandwidth GPU-to-GPU communication, and GPUDirect Storage for direct data transfer. Cluster-level optimizations, including increased I/O task sizes and query rewriting, yield up to 64% faster query runtimes by reducing CPU involvement and NUMA penalties. Single-node DGX B200 c
Analysis
TL;DR
- GPU-accelerated Presto on NVIDIA GB200 NVL72 achieves up to 8x lower latency than multinode CPU clusters for TPC-H analytical benchmarks.
- Performance gains are driven by NVIDIA cuDF for query execution, NVLink 5.0 for high-bandwidth GPU-to-GPU communication, and GPUDirect Storage for direct data transfer.
- Cluster-level optimizations, including increased I/O task sizes and query rewriting, yield up to 64% faster query runtimes by reducing CPU involvement and NUMA penalties.
- Single-node DGX B200 configurations outperform 8-10 node Intel Xeon CPU clusters, demonstrating the efficiency of consolidating workloads onto fewer, more powerful GPU nodes.
- Scaling to the GB200 NVL72 system (18 nodes) with IBM Storage Scale enables high-throughput processing of multi-terabyte datasets with minimal I/O bottlenecks.
Why It Matters
This development signals a paradigm shift in data analytics infrastructure, proving that GPU-accelerated engines can significantly outperform traditional CPU-based distributed systems for large-scale analytical workloads. For AI practitioners and data engineers, it highlights the critical importance of optimizing the entire stack—from storage protocols like GPUDirect Storage to interconnect technologies like NVLink—to unlock the full potential of modern AI hardware. This efficiency gain reduces operational costs and latency, enabling faster iteration cycles for data-intensive applications and real-time analytics.
Technical Details
- Hardware Architecture: Benchmarks were conducted on NVIDIA DGX B200 (single-node, 8 GPUs) and GB200 NVL72 (multinode, 18 nodes, 72 B200 GPUs total). The GB200 NVL72 features NVLink connectivity between all GPUs and ConnectX-7 NICs for 400 Gbps networking.
- Software Stack: Utilizes GPU-accelerated Presto with NVIDIA cuDF for query execution and Velox for data processing. Communication between GPU workers is optimized using UcxExchange.
- Storage Integration: Paired with IBM Storage Scale (formerly GPFS), leveraging NVIDIA GPUDirect Storage (GDS) to enable Remote Direct Memory Access (RDMA) from storage directly to GPU memory, bypassing host CPU and system memory.
- Benchmark Methodology: Used TPC-H derived queries (22 analytical queries) on Parquet datasets at scale factors 1K (~1 TB), 3K (~3 TB), 10K, and 30K. Runtimes included SQL parsing, plan optimization, worker execution, and result return, averaged over multiple runs.
- Optimization Techniques: Key improvements came from increasing I/O task size, utilizing more I/O threads, rewriting queries for GPU efficiency, and tuning UcxExchange configurations for inter-node communication.
Industry Insight
- Consolidation Opportunity: Organizations can reduce infrastructure complexity and cost by replacing large CPU clusters with fewer, high-performance GPU nodes without sacrificing throughput or latency.
- End-to-End Optimization: Maximizing performance requires holistic optimization across the stack, particularly focusing on I/O paths (GDS) and interconnects (NVLink), rather than just raw compute power.
- Real-Time Analytics Viability: The demonstrated latency reductions make interactive, real-time analytics on massive datasets feasible, opening new possibilities for AI agents and data-driven decision-making systems.
Disclaimer: The above content is generated by AI and is for reference only.