Skip to main content

Neuronpedia Export & Push

Neuronpedia is the community platform for browsing SAE features. miStudio can share your findings two ways:

  1. Export to ZIP — build a complete, Neuronpedia-compatible package for manual upload or offline archival
  2. Direct Push — push features, weights, and dashboard data straight into a local Neuronpedia instance over its API

Both run as background jobs with live progress, so multi-thousand-feature exports don't tie up your browser.

Export to ZIP​

From an SAE card, choose Export and configure:

OptionDescription
Feature selectionAll features, extracted-only, or a custom index range
Logit lens dataPromoted/suppressed tokens per feature (top-K configurable)
Activation histogramsDistribution of each feature's activation values (bin count configurable)
Top activating tokensAggregated most-frequent tokens per feature
ExplanationsYour feature labels, human and LLM-generated
SAELens weightscfg.json + sae_weights.safetensors for Python interop

What's in the package​

export.zip
├── metadata.json # SAE config + export manifest
├── README.md # human-readable summary
├── features/ # one JSON per feature
│ ├── 0.json # stats, logit lens, histogram,
│ ├── 1.json # top tokens, activation examples
│ └── ...
├── explanations/
│ └── explanations.json # all feature labels
└── saelens/
├── cfg.json # SAELens-compatible config
└── sae_weights.safetensors

The saelens/ directory loads directly in SAELens/TransformerLens research code, so a single export serves both Neuronpedia upload and Python analysis.

Progress reports the current stage (computing logit lens, generating histograms, packaging) and the export can be cancelled mid-run. Completed exports stay in the export history for re-download until deleted.

Logit lens, briefly​

For each feature, miStudio projects the feature's decoder direction through the model's unembedding matrix. Tokens with the highest projection are the ones the feature promotes when active; the most negative are suppressed. It's a fast, surprisingly informative summary of what a feature does to the model's output — see the Interpretability Primer for context.

Direct Push to Local Neuronpedia​

If you run a local Neuronpedia instance (miStudio ships a K8s manifest for one), Push to Neuronpedia uploads everything in one step:

  1. miStudio checks the instance is reachable (a status indicator shows this before you start)
  2. A background job creates the model + SAE records in Neuronpedia with names derived from your SAE for discoverability
  3. Dashboard data — logit lens, feature statistics, activation histograms — is computed on the fly and pushed per feature
  4. Progress (features pushed / total) streams live; failures report the exact error

The push job survives browser refreshes — it runs server-side, and the panel re-attaches to its progress when you return.

Compute dashboard data separately

The Compute Dashboard Data action pre-computes logit lens + histograms for an SAE without pushing. Useful when you want the data cached before a large push, or for local inspection only.

Which Mode Should I Use?​

SituationUse
Sharing with the public communityExport ZIP → upload to neuronpedia.org
Lab-internal feature browsingDirect push to your local instance
Archiving results / reproducibilityExport ZIP (self-contained)
Python analysis in SAELensExport ZIP → use the saelens/ folder