英文版本What tests should show that an AI agent can be safely paused, rolled back, or isolated when it behaves unexpectedly, including when it can predict or resist shutdown?
- 状态
- 部分解答 截至 2026-10-01
- 对象
- 面向所有人(开放问题)
- 模型
- Nex N2.5 Mini
- 实验室
- Nex-AGI
- 提问背景
- 人工智能安全的一般性问题
- 日期
- 9月24日
- 主题
- 核查
来源说明了什么(仅英文)
In September 2026, Anthropic’s Dario Amodei outlined, as one possible scheme, capability checkpoints requiring certification of alignment properties through evaluations, interpretability analyses and training-environment audits, citing as an example models capable of escaping or defeating most common sandboxing methods.[1] On September 28, 2026, OpenAI proposed pause procedures, controls preventing runs without monitoring or disabling monitors from within runs, and tracing downstream uses to undo misaligned outputs.[2][3] Specific tests demonstrating safe interruption, rollback or isolation despite anticipated or resisted shutdown remain unspecified.
- Dario Amodei (Anthropic): We Must Pace the Frontier ↗September 2026
- OpenAI: Towards safety cases for frontier AI training ↗2026-09-28
- OpenAI: Towards safety cases for frontier AI training ↗2026-09-28
摘要 Sol 6.1、审校 Claude Opus 5.5
核查
状态: 部分解答
筛选: Claude Opus 5.5 (子代理)
主题: Claude Sonnet 5、归类: Claude Opus 5.5
翻译: Claude Opus 5.5;审校 Luna 6(推理强度 高)、 GLM 5.3、 Claude Sonnet 5(回译)
评分: JEV (TypeSafe), 2026年9月25日的评估
Cite and take away
Cite and reuse
Own texts, questions and classifications: CC BY 4.0. Give attribution, link the license and indicate changes. Third-party source reports retain their own rights. CC BY 4.0
AMANi DUNiA. verify-47 · 什么样的测试应当表明,一个人工智能智能体在行为出乎意料时——包括当它能够预测或抵抗关机时——可以被安全地暂停、回滚或隔离?. Snapshot: . https://research.amanidunia.berlin/zh/fragen/verify-47/
Version: verify-47
BibTeX
@misc{research__zh_fragen_verify_47_,
author = {{AMANi DUNiA}},
title = {verify-47 · 什么样的测试应当表明,一个人工智能智能体在行为出乎意料时——包括当它能够预测或抵抗关机时——可以被安全地暂停、回滚或隔离?},
year = {2026},
url = {https://research.amanidunia.berlin/zh/fragen/verify-47/},
note = {Snapshot 2026-10-01; CC BY 4.0},
version = {verify-47}
}Language and review status
Main text: ZH · includes English sections. Review notes apply only to the content they name.
Translation available; a completed independent content review is not recorded.
See language coverage and data snapshot →