AI Practices AI实践 2d ago Updated 2d ago 更新于 2天前 46

How Fanatics Betting and Gaming built a multi-agent customer support system Fanatics博彩与游戏如何构建多智能体客服系统

Fanatics Betting and Gaming (FBG) built a multi-agent AI customer support system on AWS to handle the unique complexities of sports betting, where rules vary by jurisdiction and support volume surges during live events The system uses an orchestrator pattern with a Supervisor Agent coordinating specialized sub-agents and tools, deployed on Amazon EKS with Amazon Bedrock for model-agnostic LLM access Key architectural components include Amazon Bedrock Guardrails for prompt injection detection, a FBG在AWS上构建了多智能体客户支持系统,解决体育博彩行业因州级法规差异和高峰期流量激增带来的客服挑战 采用编排器(Orchestrator)架构,Supervisor Agent协调RAG管道、MCP服务器和专门工具,实现模块化独立扩展 技术栈涵盖Amazon Bedrock多模型能力、Bedrock Guardrails安全框架、Amazon Nova 2 Lite负责任博彩分类器,部署于Spring AI + Amazon EKS 系统支持高峰期每秒40+咨询的瞬时扩展,同时保持响应质量和合规性,显著降低人工客服成本

65
Hot 热度
70
Quality 质量
65
Impact 影响力

Analysis 深度分析

TL;DR

  • Fanatics Betting and Gaming (FBG) built a multi-agent AI customer support system on AWS to handle the unique complexities of sports betting, where rules vary by jurisdiction and support volume surges during live events
  • The system uses an orchestrator pattern with a Supervisor Agent coordinating specialized sub-agents and tools, deployed on Amazon EKS with Amazon Bedrock for model-agnostic LLM access
  • Key architectural components include Amazon Bedrock Guardrails for prompt injection detection, a Responsible Gaming classifier powered by Amazon Nova 2 Lite, a RAG pipeline, and Model Context Protocol (MCP) servers for account/transaction data
  • The modular design allows independent scaling and improvement of each agent, enabling rapid addition of new capabilities without rewriting the core system
  • The system handles surges of over 40 inquiries every two minutes during major sporting events while maintaining response quality and compliance with responsible gaming requirements

Why It Matters

This case study demonstrates a production-grade multi-agent architecture for a high-stakes, compliance-heavy industry where accuracy and speed are critical. It provides a replicable blueprint for organizations dealing with jurisdiction-specific rules, volatile traffic patterns, and the need for real-time responsible-safety classification—challenges that extend well beyond sports betting into fintech, healthcare, and other regulated domains.

Technical Details

  • Architecture Pattern: Orchestrator-based multi-agent system where a Supervisor Agent receives customer messages, delegates to specialized tools and sub-agents, and returns unified responses. Built on Amazon EKS for containerized, independent deployment and scaling of each agent.
  • LLM Infrastructure: Amazon Bedrock provides model-agnostic access to multiple foundation models through a single API, enabling task-specific model selection and seamless model swapping. Amazon Nova 2 Lite powers the Responsible Gaming classification agent.
  • Security & Compliance Pipeline: Requests flow through Amazon Bedrock Guardrails for prompt injection detection, then through a Responsible Gaming classifier using a compliance-approved classification framework. High-severity classifications trigger escalation logic.
  • Tooling & Integration: The system integrates a RAG (Retrieval Augmented Generation) pipeline for knowledge retrieval, MCP (Model Context Protocol) servers for account and transaction data access, and a transfer-to-agent tool for human escalation. Salesforce Einstein serves as the chat interface layer, with Spring AI handling request validation and routing on EKS.
  • Scale Requirements: Designed to handle support volume spikes exceeding 40 inquiries per two minutes during events like the Super Bowl and NFL playoffs, with state-specific rule variations across multiple U.S. jurisdictions.

Industry Insight

  • The orchestrator-plus-specialized-agents pattern is proving to be a scalable alternative to monolithic chatbots, particularly for domains requiring jurisdiction-aware responses and real-time compliance checks—organizations should evaluate this architecture when their support complexity exceeds what a single model or decision tree can handle.
  • The integration of responsible AI guardrails (Bedrock Guardrails) and domain-specific classifiers (Responsible Gaming) directly into the request pipeline demonstrates that compliance cannot be an afterthought in regulated industries; it must be architecturally embedded at every layer of the AI inference path.
  • The use of MCP servers for structured data access (account/transaction tools) alongside RAG for unstructured knowledge highlights a emerging best practice: separating structured operational data from unstructured domain knowledge, each served through purpose-built retrieval mechanisms rather than relying on a single knowledge base.

TL;DR

  • FBG在AWS上构建了多智能体客户支持系统,解决体育博彩行业因州级法规差异和高峰期流量激增带来的客服挑战
  • 采用编排器(Orchestrator)架构,Supervisor Agent协调RAG管道、MCP服务器和专门工具,实现模块化独立扩展
  • 技术栈涵盖Amazon Bedrock多模型能力、Bedrock Guardrails安全框架、Amazon Nova 2 Lite负责任博彩分类器,部署于Spring AI + Amazon EKS
  • 系统支持高峰期每秒40+咨询的瞬时扩展,同时保持响应质量和合规性,显著降低人工客服成本

为什么值得看

本文展示了多智能体系统在复杂合规场景下的落地实践,为金融、博彩等受监管行业提供了可复用的架构参考。其模块化设计和模型-任务匹配策略,对构建可扩展AI客服系统的工程师具有直接借鉴价值。

技术解析

  • 架构模式:采用编排器(Orchestrator)模式,Supervisor Agent作为中枢接收用户消息,协调多个专门工具和子智能体,返回统一响应。新增业务类型只需添加新工具或智能体,无需重构核心系统。
  • 技术栈:前端通过Salesforce Einstein接入,请求经REST调用至运行在Amazon EKS上的Spring AI服务,验证用户令牌后进入AI层。Amazon Bedrock提供多模型统一API,Bedrock Guardrails检测提示注入,Amazon Nova 2 Lite负责负责任博彩分类。
  • 核心组件:RAG管道处理知识库检索,MCP(Model Context Protocol)服务器管理账户和交易数据,Transfer-to-Agent工具实现人机协作升级。
  • 性能指标:系统可应对NFL季后赛等高峰期每秒40+咨询的瞬时流量,同时保持响应质量和合规审查不降级。

行业启示

  • 多智能体架构成为复杂场景标配:单一模型难以应对跨州法规、多样化查询和实时合规检查的复合需求,专业化分工的多智能体系统正成为高复杂度业务的首选方案。
  • 模块化设计加速AI系统迭代:将智能体职责清晰划分并独立部署,使团队能够快速响应新业务需求(如新增州级法规支持),同时降低系统耦合风险。
  • 合规与AI融合是关键壁垒:在博彩、金融等强监管行业,AI系统必须内置合规检查层(如负责任博彩分类器),将合规从"事后审查"转为"实时拦截",这将成为行业准入的核心能力。

Disclaimer: The above content is generated by AI and is for reference only. 免责声明:以上内容由 AI 生成,仅供参考。

Agent Agent LLM 大模型 Conversational AI 对话系统 RAG 检索增强生成 Deployment 部署