LLM
GA
Open source
Pythia 12B
Interpretability and training research
Release2023-02
Context2K
Max output—
Parameters12B
Local / VRAM16–32 GB
LicenseOpen source
Overview
Pythia 12B is a model in the LLM category from EleutherAI. It was released in 2023-02. The vendor is based in US. Best for: Interpretability and training research.
Notes: Positioning from the vendor site; specs, access and pricing can change — verify before production use.
Strengths
- Full checkpoint suite
- Fully open
- Reproducible
Limits
- Dated quality
- Short context
Specifications
| Vendor | EleutherAI |
|---|---|
| Category | LLM |
| Release | 2023-02 |
| Status | GA |
| License | Open source |
| License name | Apache-2.0 |
| Commercial use | Not specified |
| Parameters | 12B |
| Context window | 2K |
| Input modalities | Text |
| Output modalities | Text |
| Prompt types | Text |
| Negative prompts | No |
| Max outputs | 1 |
| Local deployment | Yes |
| VRAM | 16–32 GB |
| System RAM | 32–64 GB |
| API access | Yes |
| Pricing | Free (self-host) |
| Confidence | Medium |
| Vendor country | US |
| Vendor type | Research |
Pricing & hardware
Free (self-host)
This model can be self-hosted or run locally. Approximate GPU memory: 16–32 GB. Approximate system RAM: 32–64 GB. API access is available.