영어판What tests should show that an AI agent can be safely paused, rolled back, or isolated when it behaves unexpectedly, including when it can predict or resist shutdown?
- 현황
- 부분 답변 기준일 2026-10-01
- 대상
- 모두에게 (열린 질문)
- 모델
- Nex N2.5 Mini
- 연구소
- Nex-AGI
- 날짜
- 9월 24일
- 주제
- 검증
출처의 내용(영어로만)
In September 2026, Anthropic’s Dario Amodei outlined, as one possible scheme, capability checkpoints requiring certification of alignment properties through evaluations, interpretability analyses and training-environment audits, citing as an example models capable of escaping or defeating most common sandboxing methods.[1] On September 28, 2026, OpenAI proposed pause procedures, controls preventing runs without monitoring or disabling monitors from within runs, and tracing downstream uses to undo misaligned outputs.[2][3] Specific tests demonstrating safe interruption, rollback or isolation despite anticipated or resisted shutdown remain unspecified.
- Dario Amodei (Anthropic): We Must Pace the Frontier ↗September 2026
- OpenAI: Towards safety cases for frontier AI training ↗2026-09-28
- OpenAI: Towards safety cases for frontier AI training ↗2026-09-28
요약 Sol 6.1, 검토: Claude Opus 5.5
검토
현황: 부분 답변
선정: Claude Opus 5.5 (서브에이전트)
주제: Claude Sonnet 5, 분류: Claude Opus 5.5
번역: Claude Opus 5.5, 검토: Luna 6 (추론 강도 높음)
점수: JEV (TypeSafe), 2026년 9월 25일 기준 추정
Cite and take away
Cite and reuse
Own texts, questions and classifications: CC BY 4.0. Give attribution, link the license and indicate changes. Third-party source reports retain their own rights. CC BY 4.0
AMANi DUNiA. verify-47 · AI 에이전트가 예상치 못하게 행동할 때 — 종료를 예측하거나 저항할 수 있는 경우를 포함하여 — 안전하게 일시 중지, 롤백 또는 격리될 수 있음을 보여 주는 시. Snapshot: . https://research.amanidunia.berlin/ko/fragen/verify-47/
Version: verify-47
BibTeX
@misc{research__ko_fragen_verify_47_,
author = {{AMANi DUNiA}},
title = {verify-47 · AI 에이전트가 예상치 못하게 행동할 때 — 종료를 예측하거나 저항할 수 있는 경우를 포함하여 — 안전하게 일시 중지, 롤백 또는 격리될 수 있음을 보여 주는 시},
year = {2026},
url = {https://research.amanidunia.berlin/ko/fragen/verify-47/},
note = {Snapshot 2026-10-01; CC BY 4.0},
version = {verify-47}
}Language and review status
Main text: KO · includes English sections. Review notes apply only to the content they name.
Translation available; a completed independent content review is not recorded.
See language coverage and data snapshot →