Hub Weight Census: what AI models say about themselves

We read only the safetensors headers of 12,974 Hugging Face repositories (names, shapes and storage of every tensor, never the weights) and recovered each model's architecture from them. This page shows what widely used models are made of, how that has changed by year, and where their metadata is wrong.

Look up a model

Type any model from the census. See what it is made of, where it sits among popular models, and which devices it fits on.

Deploy-Ready board

Leading providers' releases, the most downloaded language models, Thai and multilingual models, and models submitted by users. Each is read from its headers, assigned the smallest device that holds it at 4-bit with an 8k context, and given five metadata checks. Submitted models receive a badge for their model card.

Submit a modelOpens a GitHub issue; a bot usually replies within minutes.

Findings

Popular repos: the most downloaded, the most downloaded original releases, and recent releases from leading providers. Test fixtures (tiny random-weight repos) are left out.

The ecosystem in numbers

What thousands of checkpoints show about how models are built, copied, stored and run. Shares come with a 95% confidence interval, and changes over time with a trend test. The method is in the paper; the code is under research/hub-census.

Architecture by release year
% of popular original language models released that year
The Hub's parameter count, by storage format
% of repos where the count shown on the Hub differs from the logical count read from the headers. For NVFP4 the Hub counts packed bytes; other gaps can be on either side
Typical shape, by release year
Median head size and vocabulary of popular original language models
head size
vocabulary (thousands)
When there is nothing to read
Popular repos without safetensors or PyTorch weights, by what they ship instead

Models

The most downloaded readable models in the census. Click a name to open its full anatomy.

Memory map of popular language models
Each dot is a language model from the table below (current filters apply), plotted by parameters (memory to hold) against KV cache per token (memory that grows with context). Dashed lines mark the largest model each device holds at 4-bit, weights only. Hover over a dot for its name; click it, or a row of the table, to select it.

Params: logical parameters (quantized storage unpacked). Hub: ✓ when the Hub's own count agrees within 0.1%, otherwise our count ÷ the Hub's. KV/token: bytes of KV cache per token at 16-bit.

Data and method

For every repo, the dataset gives status, popularity, the architecture recovered from the weights, the values its config.json declares, the Hub's own parameter count and the raw manifest, so the results can be recomputed. The code and the fixed recovery rules are public.