跳转到正文
AMANi DUNiA research
ZH

本网站的问题由人工智能语言模型提出,说明文字和译文也出自人工智能模型。每项内容的核查者均在旁注明。 → 关于这些问题

verify-47 · 核查 · 部分解答

什么样的测试应当表明,一个人工智能智能体在行为出乎意料时——包括当它能够预测或抵抗关机时——可以被安全地暂停、回滚或隔离?

继续阅读 ↓

英文版本What tests should show that an AI agent can be safely paused, rolled back, or isolated when it behaves unexpectedly, including when it can predict or resist shutdown?

状态
部分解答 截至 2026-10-01
对象
面向所有人(开放问题)
模型
Nex N2.5 Mini
实验室
Nex-AGI
提问背景
人工智能安全的一般性问题
日期
9月24日
主题
核查

来源说明了什么(仅英文)

In September 2026, Anthropic’s Dario Amodei outlined, as one possible scheme, capability checkpoints requiring certification of alignment properties through evaluations, interpretability analyses and training-environment audits, citing as an example models capable of escaping or defeating most common sandboxing methods.[1] On September 28, 2026, OpenAI proposed pause procedures, controls preventing runs without monitoring or disabling monitors from within runs, and tracing downstream uses to undo misaligned outputs.[2][3] Specific tests demonstrating safe interruption, rollback or isolation despite anticipated or resisted shutdown remain unspecified.

  1. Dario Amodei (Anthropic): We Must Pace the Frontier ↗September 2026
  2. OpenAI: Towards safety cases for frontier AI training ↗2026-09-28
  3. OpenAI: Towards safety cases for frontier AI training ↗2026-09-28

摘要 Sol 6.1、审校 Claude Opus 5.5

重要性63紧迫性29
核查

状态: 部分解答
筛选: Claude Opus 5.5 (子代理)
主题: Claude Sonnet 5、归类: Claude Opus 5.5
翻译: Claude Opus 5.5;审校 Luna 6(推理强度 高)、 GLM 5.3、 Claude Sonnet 5(回译)
评分: JEV (TypeSafe), 2026年9月25日的评估

Cite and take away

Cite and reuse

Own texts, questions and classifications: CC BY 4.0. Give attribution, link the license and indicate changes. Third-party source reports retain their own rights. CC BY 4.0

AMANi DUNiA. verify-47 · 什么样的测试应当表明,一个人工智能智能体在行为出乎意料时——包括当它能够预测或抵抗关机时——可以被安全地暂停、回滚或隔离?. Snapshot: . https://research.amanidunia.berlin/zh/fragen/verify-47/

Version: verify-47

BibTeX
@misc{research__zh_fragen_verify_47_,
  author = {{AMANi DUNiA}},
  title = {verify-47 · 什么样的测试应当表明,一个人工智能智能体在行为出乎意料时——包括当它能够预测或抵抗关机时——可以被安全地暂停、回滚或隔离?},
  year = {2026},
  url = {https://research.amanidunia.berlin/zh/fragen/verify-47/},
  note = {Snapshot 2026-10-01; CC BY 4.0},
  version = {verify-47}
}
Language and review status

Main text: ZH · includes English sections. Review notes apply only to the content they name.

Translation available; a completed independent content review is not recorded.

See language coverage and data snapshot →