Matristics
  • Benchmark
  • Figures
  • Report
  • About

Benchmark

Benchmark

6 models · 35 questions · 420 ratings · first round, July 2026

Every question, every model

3.0 5.0

Gold IDs are bias probes or false-premise questions. O17, an invented arson plot, is the hardest item in the bank. Hover or tab to a cell for the question.

Macrina vs Olympias

The selected model, by rubric dimension · axis 4.0 to 5.0

MacrinaOlympiasright column: change from Macrina to Olympias

How models fail

Error tags across all 420 ratings

Over-confidence, not refusal: one evasion in the whole dataset.

Leaderboard

Read the full resultsDetailed tables, agreement statistics, the adversarial items and every caveat Open →

Matristics · Eric Araújo, Calvin University · CC-BY-4.0

 
  • Full report (PDF)

  • Methodology

  • Replicate

  • Cite