See how Echo performs, question by question.

For the detailed results, you can open every question, the correct answer, and both stored model answers. If an answer was not returned, the row says so explicitly and leaves it out of direct comparisons. The page is read-only and does not rerun either model.

Yes. Model outputs can vary between runs. This page preserves the exact measured run used for each displayed score, and every question view shows the number of stored runs.

Only when Echo and Fable were tested on the same questions. If one side is missing answers, the page says the scores are not directly comparable.

No. They show how the tested systems performed on the questions listed here. Public benchmarks can also appear in model training data, so these results are evidence, not a universal guarantee.

Yes. We show recorded losses as clearly as the results where Echo matches or leads. Evaluations still being completed are withheld until their runs are ready.

The 100-question set was used while building Echo, so it is useful but not an independent test. A separate 41-question set was tested later, but Fable answered only 19 of those questions, so the two overall scores cannot be compared directly. The 19 questions both answered remain visible as an exploratory view.

Math and multiple-choice answers are checked against the known answer. Code is run against tests. We keep the checked answers fixed so the displayed totals do not change silently.

The newest score summaries passed our arithmetic checks, but their question-by-question answers are not yet published here. They remain clearly labeled as summaries until those examples are added.