Skip to content
ModelCap

Phi 3 medium 4k instruct

Current board #2401 Arena configurationsOfficial publisher releaseOpen weights7d #240 → #240

Microsoft·microsoft/Phi-3-medium-4k-instruct

Phi 3 medium 4k instruct is ModelCap current-board rank #240 with Index 9.2 (Measured), from the ModelCap Index as of 23 Sept 2026, 04:02 UTC.

Phi 3 medium 4k instruct weight access is open weights, from ModelCap classification of published repository metadata as of 23 Sept 2026, 04:02 UTC.

Snapshot facts · download the public dataset · methodology

ModelCap Index · Current board
9.2#240
Measured · 63% support · score interval 4.2–14.2
Evidence as of 13 Sept 2026, 14:00 UTC
Market Gravity
12.3
Secondary market signal

OpenRouter endpoint status could not be refreshed. This model is not treated as currently served until a successful observation arrives.

Input
Self-hosted
weights only · no listed API price
Output
Self-hosted
weights only · no listed API price
Context
tokens
Providers
0
endpoints
Gateway spend
latest · Vercel share

Providers

Uptime measured over the last 30 minutes

Current provider status is unavailable.

Reasoning efforts

Best supported result can inform ModelCap

Published Max, X-High, High and other configurations for this model. These are sourced scores, not head-to-head essays.

Related community configurations

Human preference rating
ConfigurationRatingSource rankVotesSource
Default
phi-3-medium-4k-instruct
1198
CI 1192–1203
#33425KArena
Match 100%

Reported evaluation leads (2)

Not independent measurement

Structured rows reported in this exact model repository at the pinned revision below. They are the publisher talking about itself: never measured evidence, never a score input on their own. They remain quarantined until dataset revision, harness, configuration and identity pass ModelCap’s independent admission review.

Dataset / taskMetricValueRevisionProvenance
openai/gsm8k
gsm8k
91
Unpinned
not published
Reported
Quarantined
TIGER-Lab/MMLU-Pro
mmlu_pro
55.7
Unpinned
not published
Reported
Quarantined

Other versions (1)

ModelCap Index · Current board

Methodology
9.2
Measured · 2 public benchmark observations across 2 boards
Current board
#240
Public rank basis
Measured (measured)
Index support
62.8% · strong
Index interval
4.2–14.2
Rank posterior
Not available
Top 5 / Top 10 probability
Not available / Not available
Posterior as of
Snapshot timestamp unavailable
Evidence as of
13 Sept 2026, 14:00 UTC
Identity binding
Exact catalogue product · microsoft/microsoft/Phi-3-medium-4k-instruct · aggregates disclosed benchmark configurations · endpoint configuration not claimed · artifact metadata microsoft/Phi-3-medium-4k-instruct@48d87cd5e0523b430d77e93becd3655cd6897230 (not the evaluation revision)
Index observations used
2
Qualified Index evidence point
9.2
Bayesian Evidence Score · measured evidence input only

BES normalizes admitted public benchmark evidence for measured Index rows. Its legacy score and observables prior do not define the public language rank.

Observed capability
9.2
Evidence status
confirmed · 77% mass
General preference
9.1
Coding
9.5
Agents & tools
Reasoning
Evidence breadth
92%
Evidence coverage
63%
Market and catalogue signals · secondary, never the language Index rank
Usage (OpenRouter popularity)
Liquidity (providers × uptime)
Open reach (HF downloads)
80.7
Surface (context / tools / modalities)
0.0
Freshness
3.7
  • · HF 30d downloads 18505
  • · Catalogue surface
  • · First seen 2024-05-07

These adoption and deployment observations remain context only. They do not change this model's ModelCap Index score or rank.

BES evidence selected · measured input only

The bounded 0–100 capability score blends each source’s competitive placement with its published achievement, then combines capability families. Evidence breadth adds a modest uncertainty adjustment; price and popularity are not part of benchmark-led rank.

Deployment readiness

Metadata index
58.4
partial · 70% metadata coverage
Not capability
Artifact reproducibility
85.0
Access & legal clarity
100.0
Deployability
8.0
Evaluation provenance
52.6

Missing: artifactReproducibility.base-lineage, deployability.independent-provider-records, deployability.measured-provider-uptime, deployability.published-provider-pricing, deployability.declared-capacity, evaluationProvenance.evaluation-dataset-revisions.

A metadata completeness and deployability index—not a safety certification, quality grade, or production-readiness claim.

Market activity

Venue coverage
Market Gravity
12.3
OpenRouter weekly popularity
Not listed

Market Gravity uses OpenRouter’s full-catalogue popularity order. Sparse Vercel top-ten observations appear only when published and do not affect the score.

Arena preference

Configuration results available

Arena has published current community results for Default. No default-configuration result is published, so the raw Arena field stays configuration-specific. The strongest supported result can still inform ModelCap Score with reduced confidence.

Current board through 13 Sept 2026, 14:00 UTC

Market Gravity breakdown

Usage55%
0.0

OpenRouter weekly popularity across the full model catalogue.

Liquidity25%
0.0

Independent providers versus the model's open or closed cohort, weighted by uptime.

Open reach15%
80.7

Hugging Face 30-day downloads for open models; neutral for closed models.

Freshness5%
3.7

Time since first public availability, on a six-month half-life.

Specification

Context window
tokens
Max output
Inputs
Text
Outputs
Text
Tokenizer
Cached input tokens
Not offered
First seen on OpenRouter
7 May 2024

Capabilities

  • Not supported: Reasoning
  • Not supported: Tool use
  • Not supported: Structured output
  • Not supported: Response format
  • Not supported: Moderated

Weights & access

Open weights. Downloadable weights are published under an OSI or free-culture license in the current repository metadata. This describes weight availability, not whether the full training stack qualifies as Open Source AI.

Access
Open weights
Licence
mit
Pinned revision
48d87cd5e052
Parameters
14.0B
Architecture
Phi3ForCausalLM
Model type
phi3
Hugging Face downloads (30d)
19K
Downloads (all time)
966K
Likes
225
Repository updated
10 Dec 2025, 20:18 UTC

Compare Phi 3 medium 4k instruct with

Pick any model

Benchmark leaderboards featuring Phi 3 medium 4k instruct

All leaderboards
Public benchmark boards on which Phi 3 medium 4k instruct has a published result
LeaderboardScoreSource rankConfigurationPublished
Arena coding leaderboardArena (LMArena)12311221–1242#339 of 397Default13 Sept 2026

Alternatives to Phi 3 medium 4k instruct, by the numbers

Ranked neighbours

Models within 3 places of #240 on the ModelCap Index.

Other ranked Microsoft models

The same publisher's other current models with a public Index position.

Phi 3 medium 4k instruct: common questions

How does Phi 3 medium 4k instruct rank among AI models?

Phi 3 medium 4k instruct holds ModelCap Index position #240 of 265 ranked language models as of 23 September 2026, with an Index score of 9.2 (interval 4.2–14.2); evidence: measured. The Index combines public benchmark boards with published uncertainty; the methodology page explains the weighting.

How much does Phi 3 medium 4k instruct cost per 1M tokens?

No live API price is listed for Phi 3 medium 4k instruct in the current snapshot as of 23 September 2026 because the latest endpoint refresh was unavailable. ModelCap shows a price only when a provider currently lists one.

Is Phi 3 medium 4k instruct open-weight?

Open weights (mit). Downloadable weights are published under an OSI or free-culture license in the current repository metadata. This describes weight availability, not whether the full training stack qualifies as Open Source AI. The repository is microsoft/Phi-3-medium-4k-instruct on Hugging Face.

Which benchmarks has Phi 3 medium 4k instruct been evaluated on?

Phi 3 medium 4k instruct has published results on 1 public board tracked by ModelCap as of 23 September 2026: Arena coding 1231 (#339 of 397). Each board page ranks every tracked model on that benchmark; the ModelCap Index combines them with published uncertainty.

How does Phi 3 medium 4k instruct compare with Llama 3.1 SuperNova Lite?

Phi 3 medium 4k instruct ranks #240 (Index 9.2) and Llama 3.1 SuperNova Lite ranks #241 (Index 9.2) on the ModelCap Index as of 23 September 2026. The head-to-head page lines up their benchmarks, listed prices, context windows and provider counts side by side.

When was Phi 3 medium 4k instruct released?

Phi 3 medium 4k instruct first appeared in the catalogue on 7 May 2024. It is the current version in its family. Rank and price movements since then are recorded on the site's changes feed.