Platform
GA
Open source
SGLang
Fast inference for complex prompt/agent workloads
Release2023-12
Context—
Max output—
ParametersUndisclosed
Local / VRAM16–80 GB
LicenseOpen source
Overview
SGLang is a model in the Platform category from SGLang. It was released in 2023-12. The vendor is based in US. Best for: Fast inference for complex prompt/agent workloads.
Strengths
- RadixAttention
- Structured output
- Multi-GPU
Limits
- Setup knowledge
- Model support not as broad as vLLM
Specifications
| Vendor | SGLang |
|---|---|
| Category | Platform |
| Release | 2023-12 |
| Status | GA |
| License | Open source |
| License name | Apache-2.0 |
| Commercial use | Allowed |
| Input modalities | Text, Image |
| Output modalities | Text |
| Prompt types | Text |
| Negative prompts | No |
| Max outputs | 1 |
| Local deployment | Yes |
| VRAM | 16–80 GB |
| System RAM | 32–256 GB |
| API access | Yes |
| Pricing | Free |
| Confidence | High |
| Vendor country | US |
| Vendor type | Platform |
Pricing & hardware
Free
This model can be self-hosted or run locally. Approximate GPU memory: 16–80 GB. Approximate system RAM: 32–256 GB. API access is available.