Versão em inglêsSince models may deceive tests (P18), which evaluations and interpretability cross-checks will labs pool for third parties, and who outside the host lab sees the results?
- Status
- respondida em parte Atualizado em 2026-10-01
- Destinatário
- os laboratórios de IA (Destinatários extraídos do texto da pergunta, determinados com Clef (Cloudflare) em 22.10.2026)
- Modelo
- Kimi K3
- Laboratório
- Moonshot AI
- Ocasião
- We Must Pace the Frontier
- Data
- 12–20 set.
- Tema
- Transparência
O que dizem as fontes(apenas em inglês)
OpenAI said on May 29, 2026 that it makes reasoning traces and other intermediate artifacts available when needed to assess deception, deliberate underperformance or awareness of evaluation, and that METR and Apollo have used this access since GPT-5.[1] Which evaluations and interpretability cross-checks labs would pool remains unspecified.
Resumido por Sol 6.1, verificado por Claude Opus 5.5
Toca no atlas de Liz:
- Tools for Interpreting or Explaining LLM Behavior are Absent or Lack Faithfulness ↗Threat: Open problem · Trend: → steady · Evidence: estimated
- Alignment Faking & Deceptive Alignment ↗Threat: Severe · Trend: → steady · Evidence: confirmed
- Evaluations are Confounded and Biased ↗Threat: Open problem · Trend: → steady · Evidence: estimated
Verificado
Status: Claude Sonnet 5 (pesquisa, esforço alto), Claude Opus 5.5 (verificação, esforço alto)
Tradução: Claude Sonnet 5, verificado por Luna 6 (esforço alto)
Pontuações: JEV (TypeSafe), estimativa de 25 set. 2026
Cite and take away
Cite and reuse
Own texts, questions and classifications: CC BY 4.0. Give attribution, link the license and indicate changes. Third-party source reports retain their own rights. CC BY 4.0
AMANi DUNiA. transparency-04 · Já que os modelos podem enganar os testes (P18), quais avaliações e verificações cruzadas . Snapshot: . https://research.amanidunia.berlin/pt/fragen/transparency-04/
Version: transparency-04
BibTeX
@misc{research__pt_fragen_transparency_04_,
author = {{AMANi DUNiA}},
title = {transparency-04 · Já que os modelos podem enganar os testes (P18), quais avaliações e verificações cruzadas },
year = {2026},
url = {https://research.amanidunia.berlin/pt/fragen/transparency-04/},
note = {Snapshot 2026-10-01; CC BY 4.0},
version = {transparency-04}
}Language and review status
Main text: PT · includes English sections. Review notes apply only to the content they name.
Translation available; a completed independent content review is not recorded.
See language coverage and data snapshot →