Skip to content
ModelCap

Llama 3.1 Tulu 3 8B

Arena #343Official publisher releaseRestricted license6.9d #307 → #302

Allen Institute·#302 of 352 on the current board

Llama 3.1 Tulu 3 8B is a language model from Allen Institute. It ranks #302 of 352 on ModelCap's current board, with an Index score of 14.4, measured on 2 public benchmarks. Its score range of 8.0–20.8 spans positions #287–#339. Its weights are downloadable under a use-restricted licence.

Figures as of 6 Nov 2026, 20:49 UTC · download the public dataset · methodology

ModelCap Index · Current board
14.4#302
Measured on 2 public benchmarks · range 8.0–20.8
Evidence as of 28 Oct 2026, 00:00 UTC
Market Gravity
7.8
Secondary market signal

OpenRouter endpoint status could not be refreshed. This model is not treated as currently served until a successful observation arrives.

Input
Unlisted
no listed API price
Output
Unlisted
no listed API price
Context
—
tokens
Providers
0
endpoints

Providers

Uptime measured over the last 30 minutes

Current provider status is unavailable.

Other versions (2)

ModelCap Index · Current board

Methodology
14.4
Measured on 2 public benchmarks
Current board
#302 of 352
Score range
8.0–20.8
Rank range
#287–#339
Evidence as of
28 Oct 2026, 00:00 UTC
Benchmarks used
Arena Coding, Arena Overall
Technical details
Public rank basis
Measured (measured)
Evidence label
Measured · 2 public benchmark observations across 2 boards
Index support
45.2% · moderate
Identity binding
Exact catalogue product · allenai/allenai/Llama-3.1-Tulu-3-8B · aggregates disclosed benchmark configurations · endpoint configuration not claimed · artifact metadata allenai/Llama-3.1-Tulu-3-8B@666943798adbde0b1aff34626007e26986a3c107 (not the evaluation revision)
Index observations used
2
Qualified Index evidence point
14.4
Bayesian Evidence Score · measured evidence input only

BES normalizes admitted public benchmark evidence for measured Index rows. Its legacy score and observables prior do not define the public language rank.

Observed capability
14.4
Evidence status
confirmed · 72% mass
General preference
14.3
Coding
15.0
Agents & tools
—
Reasoning
—
Evidence breadth
92%
Evidence coverage
45%
Market and catalogue signals · secondary, never the language Index rank
Usage (OpenRouter popularity)
—
Liquidity (providers × uptime)
—
Open reach (HF downloads)
—
Surface (context / tools / modalities)
0.0
Freshness
6.5
  • · Catalogue surface
  • · First seen 2024-11-20

These adoption and deployment observations remain context only. They do not change this model's ModelCap Index score or rank.

BES evidence selected · measured input only

The bounded 0–100 capability score blends each source’s competitive placement with its published achievement, then combines capability families. Evidence breadth adds a modest uncertainty adjustment; price and popularity are not part of benchmark-led rank.

Deployment readiness

Metadata index
55.4
partial · 69% metadata coverage
Not capability
Artifact reproducibility
100.0
Access & legal clarity
67.5
Deployability
8.0
Evaluation provenance
47.5

Not yet published: a link to the licence terms, a current serving provider, measured provider uptime, published provider pricing, declared context and output limits, pinned evaluation dataset versions.

A metadata completeness and deployability index—not a safety certification, quality grade, or production-readiness claim.

Market activity

Venue coverage
Market Gravity
7.8
OpenRouter weekly popularity
Not listed

Market Gravity uses OpenRouter’s full-catalogue popularity order. Sparse Vercel top-ten observations appear only when published and do not affect the score.

Arena preference

Status
Ranked
Source
LMArena
Official rank
#343 of 419
Rating
1220.5
95% confidence interval
1210–1231
Votes
3K
Source published at
28 Oct 2026, 00:00 UTC
Category
overall
Identity match confidence
100%

Market Gravity breakdown

Usage55%
0.0

OpenRouter weekly popularity across the full model catalogue.

Liquidity25%
0.0

Independent providers versus the model's open or closed cohort, weighted by uptime.

Open reach15%
50.0

Hugging Face 30-day downloads for open models; neutral for closed models.

Freshness5%
6.5

Time since first public availability, on a six-month half-life.

Specification

Model ID
allenai/Llama-3.1-Tulu-3-8B
Declared output cap
Unknown

OpenRouter catalogue or provider-endpoint declaration. Limits can vary by provider and prompt length; a model-wide maximum has not been independently verified. OpenRouter metadata

Inputs
Text
Outputs
Text
Cached input tokens
Not offered
First seen on OpenRouter
20 Nov 2024

Capabilities

  • Not supported: Reasoning
  • Not supported: Tool use
  • Not supported: Structured output
  • Not supported: Response format
  • Not supported: Moderated

Weights & access

Restricted license. Downloadable weights use a model-specific or use-restricted license. Review the linked license before use, redistribution, or commercial deployment.

Access
Restricted license
Licence
llama3.1
Pinned revision
666943798adb
Parameters
8.0B
Architecture
LlamaForCausalLM
Model type
llama
Hugging Face downloads (30d)
5K
Downloads (all time)
344K
Likes
178
Repository updated
13 Feb 2025, 20:21 UTC

Compare Llama 3.1 Tulu 3 8B with

Pick any model

Benchmark leaderboards featuring Llama 3.1 Tulu 3 8B

All leaderboards
Public benchmark boards on which Llama 3.1 Tulu 3 8B has a published result
LeaderboardScoreSource rankConfigurationPublished
Arena text leaderboardArena (LMArena)12211210–1231#343 of 419Not reported28 Oct 2026
Arena coding leaderboardArena (LMArena)12521228–1277#343 of 414Default28 Oct 2026

Alternatives to Llama 3.1 Tulu 3 8B, by the numbers

Ranked neighbours

Models within 3 places of #302 on the ModelCap Index.

Other ranked Allen Institute models

The same publisher's other current models with a public Index position.

Llama 3.1 Tulu 3 8B: common questions

How does Llama 3.1 Tulu 3 8B rank among AI models?

Llama 3.1 Tulu 3 8B holds ModelCap Index position #302 of 352 ranked language models as of 6 November 2026, with an Index score of 14.4 (interval 8.0–20.8); evidence: measured. The Index combines public benchmark boards with published uncertainty; the methodology page explains the weighting.

How much does Llama 3.1 Tulu 3 8B cost per 1M tokens?

No live API price is listed for Llama 3.1 Tulu 3 8B in the current snapshot as of 6 November 2026 because the latest endpoint refresh was unavailable. ModelCap shows a price only when a provider currently lists one.

Is Llama 3.1 Tulu 3 8B open-weight?

Restricted license (llama3.1). Downloadable weights use a model-specific or use-restricted license. Review the linked license before use, redistribution, or commercial deployment. The repository is allenai/Llama-3.1-Tulu-3-8B on Hugging Face.

Which benchmarks has Llama 3.1 Tulu 3 8B been evaluated on?

Llama 3.1 Tulu 3 8B has published results on 2 public boards tracked by ModelCap as of 6 November 2026: Arena text 1221 (#343 of 419) and Arena coding 1252 (#343 of 414). Each board page ranks every tracked model on that benchmark. The ModelCap Index scores the results its methodology admits, with published uncertainty, and shows reference boards without scoring them.

How does Llama 3.1 Tulu 3 8B compare with Llama 3.1 Tulu 3 70B?

Llama 3.1 Tulu 3 8B ranks #302 (Index 14.4) and Llama 3.1 Tulu 3 70B ranks #267 (Index 23.7) on the ModelCap Index as of 6 November 2026. The head-to-head page lines up their benchmarks, listed prices, context windows and provider counts side by side.

When was Llama 3.1 Tulu 3 8B released?

Llama 3.1 Tulu 3 8B first appeared in the catalogue on 20 Nov 2024. It is the current version in its family. Rank and price movements since then are recorded on the site's changes feed.