Open Source 开源项目 3h ago Updated 1h ago 更新于 1小时前 50

MetaRoCE: A New RDMA Transport Built for AI-Scale Ethernet MetaRoCE:专为AI规模以太网设计的新型RDMA传输协议

Meta released MetaRoCE, a clean-sheet RDMA transport protocol purpose-built for AI workloads on commodity Ethernet, designed to scale to million-GPU clusters MetaRoCE moves intelligence from the network fabric to the endpoint NIC, enabling native out-of-order delivery, multipathing, and loss tolerance without requiring PFC or pause frames The protocol separates ordered message streams from bandwidth paths within a single connection, eliminating the need for dozens of queue pairs per node pair an Meta推出MetaRoCE协议,专为百万级GPU规模的AI工作负载设计,基于普通以太网实现RDMA传输 核心创新是将网络智能从交换机转移到端点NIC,实现原生乱序交付、多路径和丢包容忍 通过OCP开源规范、参考软件实现和合规测试套件,推动行业采用 在保持现有RDMA Verbs API兼容的同时,支持多平面网络架构

72
Hot 热度
75
Quality 质量
70
Impact 影响力

Analysis 深度分析

TL;DR

  • Meta released MetaRoCE, a clean-sheet RDMA transport protocol purpose-built for AI workloads on commodity Ethernet, designed to scale to million-GPU clusters
  • MetaRoCE moves intelligence from the network fabric to the endpoint NIC, enabling native out-of-order delivery, multipathing, and loss tolerance without requiring PFC or pause frames
  • The protocol separates ordered message streams from bandwidth paths within a single connection, eliminating the need for dozens of queue pairs per node pair and keeping connection state constant regardless of workload parallelism
  • MetaRoCE is open-sourced through the Open Compute Project (OCP) with a specification, reference software implementation, and compliance test suite
  • The protocol works across diverse fabric topologies (fat-tree, multiplane, deep-buffer, shallow-buffer) using only standard ECN marking and ECMP, with no proprietary switch requirements

Why It Matters

MetaRoCE addresses one of the most critical bottlenecks in large-scale AI infrastructure: network communication between GPUs during distributed training and inference. As clusters scale to hundreds of thousands or millions of GPUs, even minor network inefficiencies strand significant compute capacity and inflate training costs. By open-sourcing the protocol through OCP, Meta is pushing the industry toward Ethernet as the default AI fabric, potentially reducing reliance on expensive proprietary interconnects like NVLink or InfiniBand while delivering comparable or superior performance at scale.

Technical Details

  • Out-of-Order Delivery: MetaRoCE treats out-of-order packet arrival as normal. Every packet carries its own destination address, allowing data to be written directly to its final memory location without a reorder buffer or head-of-line blocking. Sends match to posted receive buffers without requiring a prior round trip.
  • Native Multipathing: Each connection maintains first-class paths with per-path RTT, ECN state, and utilization telemetry. The NIC dynamically changes UDP source ports for ECMP entropy and selects fabric planes, enabling congestion and failure to be distinguished and handled per-path rather than stalling the entire connection.
  • Loss Tolerance via Selective Acknowledgment: The protocol treats Ethernet as inherently lossy (no PFC/pause frames). A 256-bit selective acknowledgment bitvector identifies gaps as loss rather than reordering, triggering immediate retransmission of exactly the missing packet on the path that lost it.
  • Bidirectional Congestion Control: Combines sender-driven AIMD (Additive Increase Multiplicative Decrease) based on ECN marks with receiver-driven fair-share rate hints. Each acknowledgment returns the receiver's allocated bandwidth share per sender, enabling incast resolution in one to two round trips with improved fairness and tail latency.
  • Unified Connection Architecture: A single connection carries many independent ordered streams (one per communicator/collective) above and many paths below under one congestion controller. This eliminates the traditional RDMA pattern of opening dozens of queue pairs per node pair, keeping connection state bounded regardless of workload parallelism. The existing RDMA Verbs API remains largely untouched, with extensions for features like multiplane support.

Industry Insight

  • The open-sourcing of MetaRoCE through OCP signals a strategic push to make Ethernet the universal AI fabric, which could dramatically reduce infrastructure costs by eliminating dependence on proprietary interconnect ecosystems and enabling commodity hardware to power frontier model training.
  • The protocol's topology independence and lack of proprietary switch requirements make it particularly attractive for multi-cloud and hybrid deployments, where organizations cannot control underlying fabric configuration — a growing reality as AI workloads distribute across vendor clouds.
  • The architectural shift of moving intelligence from fabric to endpoint represents a broader trend in AI networking: as GPU compute outpaces network evolution, endpoint-driven protocols that maximize existing infrastructure will become increasingly critical for scaling beyond current cluster size limits.

TL;DR

  • Meta推出MetaRoCE协议,专为百万级GPU规模的AI工作负载设计,基于普通以太网实现RDMA传输
  • 核心创新是将网络智能从交换机转移到端点NIC,实现原生乱序交付、多路径和丢包容忍
  • 通过OCP开源规范、参考软件实现和合规测试套件,推动行业采用
  • 在保持现有RDMA Verbs API兼容的同时,支持多平面网络架构

为什么值得看

MetaRoCE解决了大规模AI训练中网络成为性能瓶颈的关键问题,为以太网成为AI基础设施首选提供了新的协议层方案。其开源策略将加速行业标准化,降低AI集群网络部署成本。

技术解析

  • 端点智能架构:MetaRoCE将网络智能从交换机转移到NIC,每个逻辑路径拥有独立的实时遥测(RTT、ECN状态、利用率),实现细粒度路径管理
  • 原生乱序交付:数据包按设计乱序到达,每个包携带目标地址直接写入最终内存位置,无需重排序缓冲区和队头阻塞
  • 多路径与丢包容忍:每个连接拥有独立路径,通过UDP源端口作为ECMP熵值,NIC可动态切换路径;采用256位选择性确认位图精确检测丢包并触发重传
  • 双向拥塞控制:结合发送端ECN驱动的AIMD和接收端公平共享速率提示,每个路径维护独立窗口,实现快速incast恢复和更好的尾部延迟
  • 拓扑独立性与API兼容:仅需交换机支持ECN标记和ECMP,兼容fat-tree、多平面、深浅缓冲等多种网络拓扑;现有RDMA Verbs API无需修改即可使用

行业启示

  • 以太网在AI基础设施中的地位将进一步巩固,Meta通过开源协议降低行业采用门槛,推动标准化进程
  • 网络协议设计从"网络中心"向"端点智能"转变,为未来AI集群网络优化提供新范式
  • 百万级GPU规模的网络需求将驱动RDMA协议创新,拥塞控制和多路径管理成为关键竞争点

Disclaimer: The above content is generated by AI and is for reference only. 免责声明:以上内容由 AI 生成,仅供参考。

GPU GPU Training 训练 Inference 推理 Open Source 开源