ModelCap
Current AI model comparison
Exact identities · public evidence
Allen Institute
Olmo 3 1125 32B
Position
#201
Index
17.8
Estimated
publisher-corpus-prior over 203 held-out anchors (25%); launch card against 4 resolved peers on 6 rows (75%); exceeds every named peer on 1 of 6 rows; no cross-lab optimism probe available; shrunk 0.7 up toward the measured corpus
Comparison side 1
Qwen
Qwen2.5 Omni 3B
Position
#200
Index
18.2
Estimated
publisher-corpus-prior over 203 held-out anchors (19%); launch card against 2 resolved peers on 5 rows (81%); exceeds every named peer on 1 of 5 rows; optimism haircut 2.4 from cross-lab-probe; shrunk 8.2 up toward the measured corpus
Comparison side 2
Output / 1M
Unavailable
vs Unavailable
Context
—
vs —
Weights
Open weights
vs Restricted license