Engelse versieWhat cyber-capability evidence should a lab publish before release — methods, task families, failure rates, version tested — so a ministry on either side can reproduce it rather than trust it?
- Status
- deels beantwoord Vanaf 2026-10-01
- Geadresseerde
- AI-laboratoriaevaluatoren (Adresaten afgenomen uit de vraagtekst, bepaald met Clef (Cloudflare) op 22 okt. 2026)
- Model
- DeepSeek V4.1 Flash
- Lab
- DeepSeek
- Gelegenheid
- artikel van Chen Yixin
- Datum
- 13-17 sept.
- Onderwerp
- Cyber
Wat de bronnen zeggen
On 3 September 2026, OpenAI named four public cyber benchmarks—ExploitBench, ExploitGym, SEC-Bench Pro and SRE-Bench—and two internal evaluations, Sandbox Bench and ExploitBench - Internal Port (June – August 2026), which refreshes ExploitBench with more recently disclosed vulnerabilities; the full methods, failure rates and tested model version needed for reproduction remain open.[1]
- OpenAI: GPT-6 Astra System Card ↗2026-09-03
Samengevat door Sol 6.1, gecontroleerd door Claude Opus 5.5
Aangeraakt in Liz's Atlas:
- Capabilities are Difficult to Estimate and Understand ↗Threat: Open problem · Trend: → steady · Evidence: contested
Gecontroleerd
Status: Claude Sonnet 5 (onderzoek, inspanning hoog), Claude Opus 5.5 (controle, inspanning hoog)
Vertaling: Apple Translation (macOS), gecontroleerd door Claude Opus 5.5
Scores: JEV (TypeSafe), schatting van 25 september 2026
Cite and take away
Cite and reuse
Own texts, questions and classifications: CC BY 4.0. Give attribution, link the license and indicate changes. Third-party source reports retain their own rights. CC BY 4.0
AMANi DUNiA. cyber-08 · Welk bewijs van cybercapaciteit moet een laboratorium publiceren vóór de release — methode. Snapshot: . https://research.amanidunia.berlin/nl/fragen/cyber-08/
Version: cyber-08
BibTeX
@misc{research__nl_fragen_cyber_08_,
author = {{AMANi DUNiA}},
title = {cyber-08 · Welk bewijs van cybercapaciteit moet een laboratorium publiceren vóór de release — methode},
year = {2026},
url = {https://research.amanidunia.berlin/nl/fragen/cyber-08/},
note = {Snapshot 2026-10-01; CC BY 4.0},
version = {cyber-08}
}Language and review status
Main text: NL · includes English sections. Review notes apply only to the content they name.
Translation available; a completed independent content review is not recorded.
See language coverage and data snapshot →