Skip to content
ModelCap

Gemma 3 12B

Arena #236Official publisher releaseGated access7d #188 → #193

Google·#193 of 352 on the current board·cheaper than #192 GPT-4o (2024-08-06)

Gemma 3 12B is a language model from Google. It ranks #193 of 352 on ModelCap's current board, with an Index score of 36.4, measured on 2 public benchmarks. Its score range of 30.4–42.4 spans positions #153–#237. It is listed at $0.05 per million input tokens and $0.15 per million output tokens across 2 providers. It reads up to 131K tokens of context, and its weights are downloadable after an access request.

Figures as of 6 Nov 2026, 13:52 UTC · download the public dataset · methodology

ModelCap Index · Current board
36.4#193
Measured on 2 public benchmarks · range 30.4–42.4
Evidence as of 28 Oct 2026, 00:00 UTC
Market Gravity
33.6
Secondary market signal
Input
$0.05
per 1M tokens
Output
$0.15
per 1M tokens
Context
131K
tokens
Providers
2
4 endpoints

Providers

Uptime measured over the last 30 minutes
ProviderInputOutputContextQuantUptime
DeepInfrabf16/flexCheapest$0.04$0.12131Kbf16—
DeepInfrabf16$0.05$0.15131Kbf16100.0%
NextBitint4$0.075$0.15131Kint4100.0%
DeepInfrabf16/priority$0.075$0.225131Kbf1686.67%

Hugging Face Inference Providers

Exact repository identity

Provider economics and telemetry published by the Hugging Face Router. These are operational signals, not benchmark results.

ProviderInputOutputContextTTFTThroughputFeatures
deepinfra
live
$0.05$0.15131K915 ms32.9 tok/stools · structured

Reported evaluation leads (9)

Not independent measurement

Structured rows reported in this exact model repository at the pinned revision below. They are the publisher talking about itself: never measured evidence, never a score input on their own. They remain quarantined until dataset revision, harness, configuration and identity pass ModelCap’s independent admission review.

Dataset / taskMetricValueRevisionProvenance
Idavidrein/gpqa
main
—36.5471
Unpinned
not published
Reported
Quarantined
Idavidrein/gpqa
diamond
—33.8384
Unpinned
not published
Reported
Quarantined
LEXam-Benchmark/LEXam
open_question
—41.29
Unpinned
not published
Reported
Quarantined
LEXam-Benchmark/LEXam
mcq_4_choices
—29.94
Unpinned
not published
Reported
Quarantined
MBZUAI/longshot-bench
overall
—40.1
Unpinned
not published
Reported
Quarantined
MBZUAI/longshot-bench
core_perception
—32.9
Unpinned
not published
Reported
Quarantined
MBZUAI/longshot-bench
reasoning
—47.02
Unpinned
not published
Reported
Quarantined
MBZUAI/longshot-bench
information
—38.42
Unpinned
not published
Reported
Quarantined
MBZUAI/longshot-bench
multimodal
—42.07
Unpinned
not published
Reported
Quarantined

Other versions (1)

ModelCap Index · Current board

Methodology
36.4
Measured on 2 public benchmarks
Current board
#193 of 352
Score range
30.4–42.4
Rank range
#153–#237
Evidence as of
28 Oct 2026, 00:00 UTC
Benchmarks used
Arena Coding, Arena Overall
Technical details
Public rank basis
Measured (measured)
Evidence label
Measured · 2 public benchmark observations across 2 boards
Index support
49.4% · moderate
Identity binding
Exact catalogue product · google/google/gemma-3-12b-it · aggregates disclosed benchmark configurations · endpoint configuration not claimed · artifact metadata google/gemma-3-12b-it@96b6f1eccf38110c56df3a15bffe176da04bfd80 (not the evaluation revision)
Index observations used
2
Qualified Index evidence point
36.4
Bayesian Evidence Score · measured evidence input only

BES normalizes admitted public benchmark evidence for measured Index rows. Its legacy score and observables prior do not define the public language rank.

Observed capability
36.4
Evidence status
confirmed · 73% mass
General preference
38.3
Coding
22.7
Agents & tools
—
Reasoning
—
Evidence breadth
92%
Evidence coverage
49%
Market and catalogue signals · secondary, never the language Index rank
Usage (OpenRouter popularity)
12.9
Liquidity (providers × uptime)
74.2
Open reach (HF downloads)
—
Surface (context / tools / modalities)
60.2
Freshness
10.1
  • · OpenRouter popularity #160
  • · 2 live providers
  • · Catalogue: context 131072, tools, modalities Text/Image
  • · First seen 2025-03-13

These adoption and deployment observations remain context only. They do not change this model's ModelCap Index score or rank.

BES evidence selected · measured input only

The bounded 0–100 capability score blends each source’s competitive placement with its published achievement, then combines capability families. Evidence breadth adds a modest uncertainty adjustment; price and popularity are not part of benchmark-led rank.

Deployment readiness

Metadata index
77.3
strong · 93% metadata coverage
Not capability
Artifact reproducibility
100.0
Access & legal clarity
68.3
Deployability
80.0
Evaluation provenance
48.1

Not yet published: a link to the licence terms, pinned evaluation dataset versions.

A metadata completeness and deployability index—not a safety certification, quality grade, or production-readiness claim.

Market activity

Venue coverage
Market Gravity
33.6
OpenRouter weekly popularity
#160 of 339

Market Gravity uses OpenRouter’s full-catalogue popularity order. Sparse Vercel top-ten observations appear only when published and do not affect the score.

Arena preference

Status
Ranked
Source
LMArena
Official rank
#236 of 419
Rating
1341.7
95% confidence interval
1332–1351
Votes
4K
Source published at
28 Oct 2026, 00:00 UTC
Category
overall
Identity match confidence
99%

Market Gravity breakdown

Usage55%
12.9

OpenRouter weekly popularity across the full model catalogue.

Liquidity25%
74.2

Independent providers versus the model's open or closed cohort, weighted by uptime.

Open reach15%
50.0

Hugging Face 30-day downloads for open models; neutral for closed models.

Freshness5%
10.1

Time since first public availability, on a six-month half-life.

Specification

Model ID
google/gemma-3-12b-it
Context window
131K tokens
Declared output cap
16K tokens

OpenRouter catalogue or provider-endpoint declaration. Limits can vary by provider and prompt length; a model-wide maximum has not been independently verified. OpenRouter metadata

Inputs
Text, Image
Outputs
Text
Tokenizer
Gemini
Cached input tokens
Not offered
First seen on OpenRouter
13 Mar 2025
Knowledge cutoff
2024-08-31

Capabilities

  • Not supported: Reasoning
  • Supported: Tool use
  • Supported: Structured output
  • Supported: Response format
  • Not supported: Moderated

Weights & access

Gated access. The weights are hosted behind an access request or acceptance step. Review the publisher's access requirements and license before use or redistribution.

Access
Gated access
Licence
gemma
Pinned revision
96b6f1eccf38
Parameters
12.2B
Architecture
Gemma3ForConditionalGeneration
Model type
gemma3
Hugging Face downloads (30d)
360K
Downloads (all time)
23.5M
Likes
907
Repository updated
21 Mar 2025, 20:28 UTC

Compare Gemma 3 12B with

Pick any model

Benchmark leaderboards featuring Gemma 3 12B

All leaderboards
Public benchmark boards on which Gemma 3 12B has a published result
LeaderboardScoreSource rankConfigurationPublished
Arena text leaderboardArena (LMArena)13421332–1351#236 of 419Not reported28 Oct 2026
Arena coding leaderboardArena (LMArena)13161292–1339#298 of 414Default28 Oct 2026
BFCL V4 function-calling leaderboardUC Berkeley (Gorilla)30.4#49 of 83Prompt12 Apr 2026

Alternatives to Gemma 3 12B, by the numbers

Ranked neighbours

Models within 3 places of #193 on the ModelCap Index.

Cheaper at a similar or higher Index

Index score within 3 points of, or above, this model's, with a lower listed blended price (3:1 input:output).

Other ranked Google models

The same publisher's other current models with a public Index position.

Gemma 3 12B: common questions

How does Gemma 3 12B rank among AI models?

Gemma 3 12B holds ModelCap Index position #193 of 352 ranked language models as of 6 November 2026, with an Index score of 36.4 (interval 30.4–42.4); evidence: measured. The Index combines public benchmark boards with published uncertainty; the methodology page explains the weighting.

How much does Gemma 3 12B cost per 1M tokens?

Gemma 3 12B is listed at $0.05 per 1M input tokens and $0.15 per 1M output tokens as of 6 November 2026; the lowest output price among 2 providers is $0.12 on DeepInfra. Prices come from the OpenRouter catalogue and re-observe on every refresh. For 1,000 requests using 2,000 input and 500 output tokens each, the listed rates imply $0.175 total (2M input + 0.5M output). This excludes caching, batch discounts, prompt-length tiers, tool charges and retries; verify the chosen endpoint's rate and limits before budgeting.

What is the context window of Gemma 3 12B?

Gemma 3 12B has a published context window of 131K tokens (131,072). The snapshot lists a 16,384 token catalogue-declared route output cap. OpenRouter catalogue or provider-endpoint declaration. Limits can vary by provider and prompt length; a model-wide maximum has not been independently verified. The providers table lists each endpoint's context limit.

Is Gemma 3 12B open-weight?

Gated access (gemma). The weights are hosted behind an access request or acceptance step. Review the publisher's access requirements and license before use or redistribution. The repository is google/gemma-3-12b-it on Hugging Face.

Which API providers serve Gemma 3 12B?

2 providers serve Gemma 3 12B through OpenRouter as of 6 November 2026: DeepInfra and NextBit. Each provider's price, context limit, quantization and measured uptime are in the providers table above.

Which benchmarks has Gemma 3 12B been evaluated on?

Gemma 3 12B has published results on 3 public boards tracked by ModelCap as of 6 November 2026: Arena text 1342 (#236 of 419), Arena coding 1316 (#298 of 414) and BFCL V4 30.4 (#49 of 83). Each board page ranks every tracked model on that benchmark. The ModelCap Index scores the results its methodology admits, with published uncertainty, and shows reference boards without scoring them.

How does Gemma 3 12B compare with Gemma 3 27B?

Gemma 3 12B ranks #193 (Index 36.4) and Gemma 3 27B ranks #152 (Index 42.6) on the ModelCap Index as of 6 November 2026. The head-to-head page lines up their benchmarks, listed prices, context windows and provider counts side by side.

When was Gemma 3 12B released?

Gemma 3 12B first appeared in the catalogue on 13 Mar 2025, with a published knowledge cutoff of 2024-08-31. It is the current version in its family. Rank and price movements since then are recorded on the site's changes feed.