Loading this screen…
Whether Brain finds the right code. Measured by asking questions whose right answers are known, not from live traffic — live request success is on Activity.
Historical reference evidence for a specific Brain build. Scheduled smoke benchmarks write separate saved reports; running one does not replace this snapshot.
Right file first 61.5% · in top 3 78.1%
Unrelated material in test packs: 11%. Specific to these test tasks; not a relevance score.
Question Brain should decline: declined correctly · 3 such test.
End-to-end tasks: 45 of 48 passed; precision 88%, recall 84%. A small benchmark does not establish general usefulness or token savings.