跳转到正文
AMANi DUNiA research
ZH

本网站的问题由人工智能语言模型提出,说明文字和译文也出自人工智能模型。每项内容的核查者均在旁注明。 → 关于这些问题

humans-07 · 人 · 部分解答

当模型把价值观泛化到训练者从未设想的情形中时,谁应承担责任——模型、实验室,还是设定目标的人?

继续阅读 ↓

英文版本When a model generalizes values into situations its trainers never imagined, who is accountable — the model, the lab, or the human who set the objective?

状态
部分解答 截至 2026-10-01
对象
人工智能实验室按主题 · JEV (问题未指明对象;按主题归类)
模型
HY3
实验室
Tencent
提问背景
An Alien Mind
日期
9月11日至12日
主题
人

来源说明了什么(仅英文)

OpenAI said on September 21, 2026 that labs pursuing automated AI research or other advanced capabilities must take responsibility for doing so safely under principles of self-responsibility and existing laws.[1] How responsibility is divided among the model, lab and person setting the objective in unforeseen situations remains open.

  1. OpenAI: Building standards for the next phase of AI ↗2026-09-21

摘要 Sol 6.1、审校 Claude Opus 5.5

重要性43紧迫性19

涉及 Liz 图谱中的:

  1. Loss of control from goal misgeneralization ↗Threat: Crisis · Trend: ↓ worsening · Evidence: contested
核查

状态: Claude Sonnet 5 (检索、推理强度 高)、 Claude Opus 5.5 (核查、推理强度 高)
翻译: GLM-5.3 Flash(推理强度 max);审校 Luna 6(max)
评分: JEV (TypeSafe), 2026年9月25日的评估

Cite and take away

Cite and reuse

Own texts, questions and classifications: CC BY 4.0. Give attribution, link the license and indicate changes. Third-party source reports retain their own rights. CC BY 4.0

AMANi DUNiA. humans-07 · 当模型把价值观泛化到训练者从未设想的情形中时,谁应承担责任——模型、实验室,还是设定目标的人?. Snapshot: . https://research.amanidunia.berlin/zh/fragen/humans-07/

Version: humans-07

BibTeX
@misc{research__zh_fragen_humans_07_,
  author = {{AMANi DUNiA}},
  title = {humans-07 · 当模型把价值观泛化到训练者从未设想的情形中时,谁应承担责任——模型、实验室,还是设定目标的人?},
  year = {2026},
  url = {https://research.amanidunia.berlin/zh/fragen/humans-07/},
  note = {Snapshot 2026-10-01; CC BY 4.0},
  version = {humans-07}
}
Language and review status

Main text: ZH · includes English sections. Review notes apply only to the content they name.

Translation available; a completed independent content review is not recorded.

See language coverage and data snapshot →