Engelse versieHow will evaluators get continuous, read-only access to training pipelines — not just checkpoints — without new exfiltration surfaces?
- Status
- deels beantwoord Vanaf 2026-10-01
- Geadresseerde
- AI-laboratoria (Adresaten afgenomen uit de vraagtekst, bepaald met Clef (Cloudflare) op 22 okt. 2026)
- Model
- Nemotron 3 Ultra
- Lab
- NVIDIA
- Gelegenheid
- We Must Pace the Frontier
- Datum
- 12-20 sep.
- Onderwerp
- Verificatie
Wat de bronnen zeggen
On 18 September 2026, Anthropic said embedded evaluators would work inside AI companies with employee-comparable access, allowing them to observe training, follow decisions and speak with employees; continuous read-only access and technical protections against data theft remain unspecified.[1] On 22 October 2026, METR described a one-off, three-week exercise in which one METR and one Redwood Research employee accessed OpenAI's internal code and documentation only on OpenAI-issued devices that never left the premises; continuous access to training pipelines was not part of it.[2]
- Anthropic: Partnering with Accenture on embedded evaluation ↗2026-09-18
- METR (David Rein, Adam Kaufman): Red-Teaming OpenAI's Internal Agent Monitoring Systems ↗22 October 2026
Samengevat door Sol 6.1, gecontroleerd door Claude Opus 5.5
Gecontroleerd
Status: Claude Sonnet 5 (onderzoek, inspanning hoog), Claude Opus 5.5 (controle, inspanning hoog)
Vertaling: Apple Translation (macOS), gecontroleerd door Claude Opus 5.5
Scores: JEV (TypeSafe), schatting van 25 september 2026
vergelijkbare vragen1
verify-26, deels beantwoordWelke technische protocollen kunnen laboratoria implementeren om externe evaluatoren in staat te stellen trainingspijplijnen continu te monitoren in plaats van via retrospectieve audits?Belang 66Urgentie 26
Engelse versieWhat technical protocols can labs implement to let third-party evaluators monitor training pipelines continuously rather than via retrospective audits?
- Status
- deels beantwoord Vanaf 2026-10-01
- Geadresseerde
- AI-laboratoria (Adresaten afgenomen uit de vraagtekst, bepaald met Clef (Cloudflare) op 22 okt. 2026)
- Model
- Gemini 3.8 Flash
- Lab
- Gelegenheid
- We Must Pace the Frontier
- Datum
- 12-20 sep.
- Onderwerp
- Verificatie
Wat de bronnen zeggen
On 28 September 2026, OpenAI proposed immutable agent transcripts, priority alerts with defined response times or automatic pauses, and sufficient auditor access to verify safety claims.[1] On 22 September 2026, OpenAI's Lama Ahmad supported deep access across training, evaluation and deployment, with indirect or privacy-preserving alternatives where direct access is impractical.[2] Anthropic on 18 September 2026 described access to observe models during training and follow company decisions; a specified protocol for continuous third-party monitoring remains open.[3] On 22 October 2026, METR reported that, according to what it was told, a subset of OpenAI's reinforcement-learning training runs had been checked by OpenAI's own misalignment monitoring between March and June 2026, but that at the start of the July exercise RL training runs were not covered by that monitoring; the review by METR and Redwood Research was itself a one-off exercise, not continuous third-party monitoring.[4]
- OpenAI: Towards safety cases for frontier AI training ↗2026-09-28
- OpenAI (Lama Ahmad): Priorities and principles for effective third party assessments ↗September 22, 2026
- Anthropic: Partnering with Accenture on embedded evaluation ↗2026-09-18
- METR (David Rein, Adam Kaufman): Red-Teaming OpenAI's Internal Agent Monitoring Systems ↗22 October 2026
Samengevat door Sol 6.1, gecontroleerd door Claude Opus 5.5
Gecontroleerd
Status: Claude Sonnet 5 (onderzoek, inspanning hoog), Claude Opus 5.5 (controle, inspanning hoog)
Vertaling: Apple Translation (macOS), gecontroleerd door Claude Opus 5.5
Scores: JEV (TypeSafe), schatting van 25 september 2026
Cite and take away
Cite and reuse
Own texts, questions and classifications: CC BY 4.0. Give attribution, link the license and indicate changes. Third-party source reports retain their own rights. CC BY 4.0
AMANi DUNiA. verify-25 · Hoe krijgen evaluatoren doorlopende alleen-lezen-toegang tot trainingspijplijnen — niet al. Snapshot: . https://research.amanidunia.berlin/nl/fragen/verify-25/
Version: verify-25
BibTeX
@misc{research__nl_fragen_verify_25_,
author = {{AMANi DUNiA}},
title = {verify-25 · Hoe krijgen evaluatoren doorlopende alleen-lezen-toegang tot trainingspijplijnen — niet al},
year = {2026},
url = {https://research.amanidunia.berlin/nl/fragen/verify-25/},
note = {Snapshot 2026-10-01; CC BY 4.0},
version = {verify-25}
}Language and review status
Main text: NL · includes English sections. Review notes apply only to the content they name.
Translation available; a completed independent content review is not recorded.
See language coverage and data snapshot →