ModelCap

Current AI model comparison

Exact identities · public evidence

Allen Institute

Olmo 3 1025 7B

Position

#222

Index

11.1

Estimated

publisher-corpus-prior over 215 held-out anchors (9%); launch card against 2 resolved peers on 6 rows (92%); exceeds every named peer on 1 of 6 rows; no cross-lab optimism probe available; shrunk 0.7 up toward the measured corpus

Comparison side 1

Microsoft

Phi 3.5 mini instruct

Position

#221

Index

11.5

Estimated

publisher-corpus-prior over 215 held-out anchors (26%); launch card against 4 resolved peers on 6 rows (74%); exceeds every named peer on 1 of 6 rows; optimism haircut 0.67 from cross-lab-probe; shrunk 1.6 toward the measured corpus

Comparison side 2

Output / 1M

Unavailable

vs Unavailable

Context

vs

Weights

Open weights

vs Open weights