ModelCap
Current AI model comparison
Exact identities · public evidence
Allen Institute
Olmo 3 1025 7B
Position
#222
Index
11.1
Estimated
publisher-corpus-prior over 215 held-out anchors (9%); launch card against 2 resolved peers on 6 rows (92%); exceeds every named peer on 1 of 6 rows; no cross-lab optimism probe available; shrunk 0.7 up toward the measured corpus
Comparison side 1
Microsoft
Phi 3.5 mini instruct
Position
#221
Index
11.5
Estimated
publisher-corpus-prior over 215 held-out anchors (26%); launch card against 4 resolved peers on 6 rows (74%); exceeds every named peer on 1 of 6 rows; optimism haircut 0.67 from cross-lab-probe; shrunk 1.6 toward the measured corpus
Comparison side 2
Output / 1M
Unavailable
vs Unavailable
Context
—
vs —
Weights
Open weights
vs Open weights