英文版本What cyber-capability evidence should a lab publish before release — methods, task families, failure rates, version tested — so a ministry on either side can reproduce it rather than trust it?
- 状态
- 部分解答 截至 2026-10-01
- 对象
- 人工智能实验室评估机构 (对象取自问题文本,于2026年10月22日用 Clef(Cloudflare)确定)
- 模型
- DeepSeek V4.1 Flash
- 实验室
- DeepSeek
- 提问背景
- 陈一新的文章
- 日期
- 9月13日至17日
- 主题
- 网络
来源说明了什么(仅英文)
On 3 September 2026, OpenAI named four public cyber benchmarks—ExploitBench, ExploitGym, SEC-Bench Pro and SRE-Bench—and two internal evaluations, Sandbox Bench and ExploitBench - Internal Port (June – August 2026), which refreshes ExploitBench with more recently disclosed vulnerabilities; the full methods, failure rates and tested model version needed for reproduction remain open.[1]
- OpenAI: GPT-6 Astra System Card ↗2026-09-03
摘要 Sol 6.1、审校 Claude Opus 5.5
涉及 Liz 图谱中的:
- Capabilities are Difficult to Estimate and Understand ↗Threat: Open problem · Trend: → steady · Evidence: contested
核查
状态: Claude Sonnet 5 (检索、推理强度 高)、 Claude Opus 5.5 (核查、推理强度 高)
翻译: GLM-5.3 Flash(推理强度 max);审校 Luna 6(max)
评分: JEV (TypeSafe), 2026年9月25日的评估
Cite and take away
Cite and reuse
Own texts, questions and classifications: CC BY 4.0. Give attribution, link the license and indicate changes. Third-party source reports retain their own rights. CC BY 4.0
AMANi DUNiA. cyber-08 · 实验室在发布之前应当公布哪些网络能力证据——方法、任务族、失败率、受测版本——使任何一方的部委都能复现它,而不是只能信任它?. Snapshot: . https://research.amanidunia.berlin/zh/fragen/cyber-08/
Version: cyber-08
BibTeX
@misc{research__zh_fragen_cyber_08_,
author = {{AMANi DUNiA}},
title = {cyber-08 · 实验室在发布之前应当公布哪些网络能力证据——方法、任务族、失败率、受测版本——使任何一方的部委都能复现它,而不是只能信任它?},
year = {2026},
url = {https://research.amanidunia.berlin/zh/fragen/cyber-08/},
note = {Snapshot 2026-10-01; CC BY 4.0},
version = {cyber-08}
}Language and review status
Main text: ZH · includes English sections. Review notes apply only to the content they name.
Translation available; a completed independent content review is not recorded.
See language coverage and data snapshot →