AI Skills AI技能 3h ago Updated 1h ago 更新于 1小时前 48

Z.ai's Models Found 2,436 Vulnerabilities. The Weights Aren't the Bottleneck — Your Patch Pipeline Is Z.ai 的模型发现了 2,436 个漏洞。瓶颈不在权重——而是你的补丁流程

Z.ai's GLM-5.3 model identified 2,436 software vulnerabilities across 269 open-source projects, with only 53 disclosed and 2,383 still under embargo as of August 14, 2026 The downloadable weights were delayed past the target date of August 28, 2026 because cyber capabilities during post-training scaled faster than anticipated, prompting additional safety hardening GLM-5.3 scored 84.5% on CyberGym (vulnerability discovery) but only 54.4% on ExploitBench (exploitation), revealing a 23.6-point gap Z.ai的GLM-5.3模型在269个开源项目中累计发现2,436个漏洞,其中仅53个已公开,2,383个仍处于保密状态等待修复 模型延迟发布开源权重是因为网络安全能力在扩展后训练中超出预期,但核心瓶颈已从"发现漏洞"转向"修复漏洞" GLM-5.3在漏洞发现(CyberGym 84.5%)与漏洞利用(ExploitBench 54.4%)之间存在23.6个百分点的能力差距,发现能力领先但利用能力落后 发现的漏洞平均存在26.6年,最古老的漏洞可追溯至1981年,说明软件本身并未变差,而是发现成本大幅降低 作者实测显示39.3%的PyPI核心包和28.3%的npm核心包在过去90天内无新版本发

68
Hot 热度
72
Quality 质量
65
Impact 影响力

Analysis 深度分析

TL;DR

  • Z.ai's GLM-5.3 model identified 2,436 software vulnerabilities across 269 open-source projects, with only 53 disclosed and 2,383 still under embargo as of August 14, 2026
  • The downloadable weights were delayed past the target date of August 28, 2026 because cyber capabilities during post-training scaled faster than anticipated, prompting additional safety hardening
  • GLM-5.3 scored 84.5% on CyberGym (vulnerability discovery) but only 54.4% on ExploitBench (exploitation), revealing a 23.6-point gap between finding flaws and weaponizing them
  • The average vulnerability had gone undiscovered for 26.6 years, with the oldest dating to 1981, indicating the bottleneck has shifted from discovery to remediation
  • Independent measurement showed 39.3% of 84 critical PyPI packages had shipped no release in 90 days, and 15.5% had shipped nothing in a year, exposing a severe remediation capacity gap

Why It Matters

This article reframes the AI security narrative: the scarce resource is no longer vulnerability discovery but vulnerability remediation, and the industry's patch pipeline cannot keep pace with AI-accelerated finding rates. For AI practitioners and security teams, it highlights that model capability advances outstrip the human infrastructure needed to act on them, creating a growing queue of undisclosed vulnerabilities that could be exploited if ever leaked. The weight delay is less about restricting access and more about buying time for a safer release, but it does nothing to address the 2,383 findings already in the pipeline.

Technical Details

  • GLM-5.3 was built on the same base model as GLM-5.2, with gains attributed to approximately one month of expanded post-training involving more task environments, a broader work mix, and additional compute, specifically including vulnerability-discovery work
  • Benchmark performance: CyberGym (1,507 tasks from 188 software projects) scored 84.5% for GLM-5.3 versus 83.8% and 83.6% for two frontier competitors; ExploitBench scored 54.4% for GLM-5.3 versus 78.0% for the strongest comparison model
  • The vulnerability ledger covers 269 open-source projects including the Linux kernel, Redis, WebKit, and FreeBSD, with severity breakdowns of 107 critical and 990 high findings, all produced under Z.ai's own evaluation harness with no independent replication as of publication
  • Release cadence measurement methodology: on August 20, 2026, the complete release history for 84 widely depended-on PyPI packages and 46 core npm packages was pulled from public JSON APIs, measuring releases published in the previous 24 months and days since the most recent release
  • GLM-5.3-Flash was released under an MIT license on August 26, 2026, while the flagship GLM-5.3 weights remained unpublished as a placeholder on Hugging Face targeting around August 28

Industry Insight

The industry is entering an era where vulnerability discovery scales like software but remediation still scales like people, creating a structural bottleneck that no amount of model improvement can solve on its own—organizations must invest in automated patching pipelines and maintainership infrastructure to close the gap. The weight-delay model signals a broader industry shift toward metered and gated releases for powerful AI capabilities, but this only controls future capability distribution, not the findings already produced, meaning the real risk lies in the 2,383 embargoed vulnerabilities that could leak or be independently discovered. Supply-chain dashboards and maintenance health assessments are frequently distorted by hyper-active packages drowning out the median project, so practitioners should use "days since last release per package" rather than median gaps between releases to get an accurate picture of ecosystem responsiveness.

TL;DR

  • Z.ai的GLM-5.3模型在269个开源项目中累计发现2,436个漏洞,其中仅53个已公开,2,383个仍处于保密状态等待修复
  • 模型延迟发布开源权重是因为网络安全能力在扩展后训练中超出预期,但核心瓶颈已从"发现漏洞"转向"修复漏洞"
  • GLM-5.3在漏洞发现(CyberGym 84.5%)与漏洞利用(ExploitBench 54.4%)之间存在23.6个百分点的能力差距,发现能力领先但利用能力落后
  • 发现的漏洞平均存在26.6年,最古老的漏洞可追溯至1981年,说明软件本身并未变差,而是发现成本大幅降低
  • 作者实测显示39.3%的PyPI核心包和28.3%的npm核心包在过去90天内无新版本发布,暴露出修复能力的严重不足

为什么值得看

这篇文章揭示了AI时代软件安全的根本性转变:漏洞发现已从稀缺资源变为可规模化获取的能力,而修复能力仍受限于人力和维护者响应速度。对AI从业者和安全研究者而言,理解这一差距对于制定有效的安全策略至关重要。

技术解析

GLM-5.3通过约一个月的扩展后训练(更多任务环境、更广泛的工作组合、更多算力)显著提升了网络安全能力,从发现孤立缺陷发展为规划完整利用链。在CyberGym基准测试中达到84.5%的准确率,领先于两个前沿竞争对手(83.8%和83.6%),但在ExploitBench上仅获得54.4%的得分,与最强竞品78.0%存在明显差距。

漏洞发现方面,模型在269个开源项目(包括Linux内核、Redis、WebKit和FreeBSD)中识别出2,436个漏洞,其中107个为严重级别,990个为高级别。所有网络安全数据均来自Z.ai自己的评估配置,截至发表时未有独立验证。

在依赖包维护方面,作者分析了84个PyPI核心包和46个npm核心包的发布频率,发现39.3%的PyPI包和28.3%的npm包在过去90天内没有新版本发布,5个PyPI包(python-dateutil、itsdangerous、colorama、sniffio、cycler)在两年内无更新。

行业启示

AI驱动的安全发现能力正在快速超越人类的修复能力,这种不对称性要求行业重新思考安全治理的优先级——从"如何发现更多漏洞"转向"如何加速漏洞修复"。开源维护者的响应速度已成为整个软件供应链的安全瓶颈,需要建立更有效的激励机制和工具支持。

模型能力的评估应该更加全面,不能仅看发现漏洞的数量,还要考虑实际利用的可行性和修复的可行性。同时,"发布频率"作为维护健康度的代理指标存在局限性,稳定且功能完整的库可能长期不发布新版本但仍能快速响应安全修复。

Disclaimer: The above content is generated by AI and is for reference only. 免责声明:以上内容由 AI 生成,仅供参考。

LLM 大模型 Open Source 开源 Security 安全 Research 科学研究 Evaluation 评测