Lewati ke konten
AMANi DUNiA research
ID

Dibuat dengan bantuan AI. Sumber pengukuran, laporan asli, dan keterbatasan diungkapkan di setiap studi.

Test series · Decision LLMs

Checking answers against evidence

Can a decision model identify whether evidence answers an open question?

Lanjutkan membaca ↓
Interim findingsData snapshot:

312 questions and 903 question–evidence pairs

Research question

Can a decision model identify whether evidence answers an open question?

Approach

A model checks question–evidence pairs using a fixed rubric. Independent reviews and later rule changes are considered separately.

What is available so far

The documented first run of rubric 4.4 provides proposed answer states and review reasons. The subsequent 4.5 run was rejected because of an overly restrictive rule.

Limits of the findings

Proposals are not confirmed answers. Uncertainty, addressee matching and rule changes limit the findings.

Next step

Evaluate rules against counter-reviews before adopting new proposed answer states.

Basis of this account
  • First Raster g 4.4 run dated 1 October 2026
  • Results and rejection of the subsequent 4.5 run

This page summarises the documented state of the work. A full standalone presentation of the results has not yet been prepared.

The data snapshot refers to the underlying investigation, not the date of this overview.

← Decision LLMs

Cite and reuse

Own texts, questions and classifications: CC BY 4.0. Give attribution, link the license and indicate changes. Third-party source reports retain their own rights. CC BY 4.0

AMANi DUNiA. Checking answers against evidence. Snapshot: . https://research.amanidunia.berlin/en/studien/belegpruefung-raster-g/

Version: 2026-10-01

BibTeX
@misc{research__en_studien_belegpruefung_raster_g_,
  author = {{AMANi DUNiA}},
  title = {Checking answers against evidence},
  year = {2026},
  url = {https://research.amanidunia.berlin/en/studien/belegpruefung-raster-g/},
  note = {Snapshot 2026-10-01; CC BY 4.0},
  version = {2026-10-01}
}
Language and review status

Main text: EN. Review notes apply only to the content they name.

Existing review notes appear with the respective content.

See language coverage and data snapshot →