Research Papers 论文研究 3d ago Updated 2d ago 更新于 2天前 46

SW-ProxyCE: Zero-Query Adversarial Transfer from Public EEG Encoders to Private Downstream Models SW-ProxyCE:从公开EEG编码器到私有下游模型的零查询对抗迁移

SW-ProxyCE is a zero-query adversarial transfer attack framework that exploits publicly available EEG foundation encoders to generate adversarial examples that transfer to private downstream models without any access to victim parameters, outputs, or gradients. The method uses shrinkage-whitened class prototypes derived from a small labeled reference set to recover task-level decision geometry, enabling transferable adversarial generation without training an additional surrogate classifier. Eval 首次系统研究EEG基础模型部署中的对抗转移攻击安全问题,揭示公开编码器可能使私有下游模型面临安全风险 提出SW-ProxyCE(收缩白化代理交叉熵)框架,通过收缩白化类原型从少量标签参考集恢复任务级决策几何,实现零查询对抗样本生成 在三个EEG任务、多种基础编码器和下游模型设置下验证,证明基于公开编码器生成的对抗样本可有效转移到不可访问的私有模型 SW-ProxyCE显著优于任务无关的表示偏移攻击方法,表明EEG基础模型的强迁移性并不等同于对抗鲁棒性

58
Hot 热度
76
Quality 质量
68
Impact 影响力

Analysis 深度分析

TL;DR

  • SW-ProxyCE is a zero-query adversarial transfer attack framework that exploits publicly available EEG foundation encoders to generate adversarial examples that transfer to private downstream models without any access to victim parameters, outputs, or gradients.
  • The method uses shrinkage-whitened class prototypes derived from a small labeled reference set to recover task-level decision geometry, enabling transferable adversarial generation without training an additional surrogate classifier.
  • Evaluated across three EEG tasks using three general-purpose foundation encoders and one paradigm-specific pre-trained encoder, covering both linear-probing and full-fine-tuning downstream models in cross-subject and within-subject scenarios.
  • Results show that adversarial examples generated from the public encoder and limited labeled references effectively transfer to inaccessible downstream models, consistently outperforming task-agnostic representation-shift attacks.
  • The findings reveal that strong transferability of EEG foundation models does not necessarily imply adversarial robustness, exposing a previously unexplored security risk in open EEG foundation model deployment.

Why It Matters

This work highlights a critical security vulnerability in the growing ecosystem of open EEG foundation models: publicly released encoders can be weaponized to attack private downstream models without any query access, which has direct implications for clinical and consumer brain-computer interface systems. For AI practitioners deploying foundation models in sensitive domains, this underscores the need to treat model openness as a dual-edged sword that requires adversarial robustness considerations alongside performance gains.

Technical Details

  • Attack Setting: The paper investigates a public-encoder/private-downstream threat model where attackers have white-box access to a released foundation encoder and a small task-matched labeled reference set, but zero access to the victim model's parameters, outputs, or gradients.
  • SW-ProxyCE Method: The core innovation is Shrinkage-Whitened Proxy Cross-Entropy, which constructs shrinkage-whitened class prototypes from the reference set to approximate task-level decision boundaries. This allows adversarial perturbation generation directly in the representation space of the public encoder without training a surrogate classifier.
  • Evaluation Setup: Three EEG tasks were tested using three general-purpose foundation encoders and one paradigm-specific pre-trained encoder. Both linear-probing and full-fine-tuning downstream models were evaluated under cross-subject and within-subject transfer scenarios.
  • Baseline Comparison: SW-ProxyCE was compared against task-agnostic representation-shift attacks, demonstrating consistent superiority and confirming that task-aware geometry recovery is essential for effective adversarial transfer in EEG domains.
  • Key Finding: The strong cross-task and cross-subject transferability that makes EEG foundation models useful also makes them inherently vulnerable to query-free adversarial attacks, establishing a fundamental tension between utility and robustness.

Industry Insight

  • Organizations releasing EEG foundation model encoders should proactively assess and mitigate adversarial transfer risks, potentially through encoder-level robustness training or output sanitization, before open distribution.
  • Deployers of private downstream EEG models—especially in clinical or safety-critical BCI applications—should treat publicly available encoders as a threat surface and implement adversarial defense mechanisms such as input preprocessing, detection filters, or certified robustness techniques.
  • The broader implication extends beyond EEG: any domain adopting the open-foundation-model paradigm (e.g., medical imaging, speech, text) should anticipate similar zero-query transfer vulnerabilities and incorporate security evaluations into model release pipelines.

TL;DR

  • 首次系统研究EEG基础模型部署中的对抗转移攻击安全问题,揭示公开编码器可能使私有下游模型面临安全风险
  • 提出SW-ProxyCE(收缩白化代理交叉熵)框架,通过收缩白化类原型从少量标签参考集恢复任务级决策几何,实现零查询对抗样本生成
  • 在三个EEG任务、多种基础编码器和下游模型设置下验证,证明基于公开编码器生成的对抗样本可有效转移到不可访问的私有模型
  • SW-ProxyCE显著优于任务无关的表示偏移攻击方法,表明EEG基础模型的强迁移性并不等同于对抗鲁棒性

为什么值得看

本文首次揭示了EEG基础模型开源生态中的安全漏洞,为神经信号AI系统的安全性研究开辟了新方向。提出的零查询攻击框架对实际部署场景具有重要警示意义,提醒从业者在享受基础模型便利的同时需重视潜在安全风险。

技术解析

  • 攻击设置:零查询场景,攻击者仅能访问公开的基础编码器(白盒)和少量任务匹配的标签参考集,无法获取私有下游模型的参数、输出或梯度信息
  • 核心方法:SW-ProxyCE通过收缩白化类原型从少量参考数据中恢复任务级决策几何结构,无需训练额外代理分类器即可生成可迁移的对抗样本
  • 实验设置:使用三种通用基础编码器和一种范式特定预训练编码器,在三个EEG任务上评估,覆盖线性探测和全微调两种下游模型适配方式,以及跨被试和受试内两种场景
  • 对比基线:与任务无关的表示偏移攻击方法进行对比,验证所提方法的有效性

行业启示

  • 基础模型开源趋势下需建立配套的安全评估机制,公开表示可能成为攻击者利用的入口点
  • EEG等神经信号AI应用的安全防护应纳入模型设计考量,高迁移性不等于高鲁棒性
  • 建议开发者和部署方在采用公开基础模型时,进行对抗鲁棒性测试并考虑引入防御机制

Disclaimer: The above content is generated by AI and is for reference only. 免责声明:以上内容由 AI 生成,仅供参考。

Security 安全 Research 科学研究 Embedding Model 嵌入模型