Platform
GA
Proprietary
Anyscale Endpoints
Open-model inference and batch jobs
Release2023-10
Context—
Max output—
ParametersUndisclosed
Local / VRAMAPI only
LicenseProprietary
Overview
Anyscale Endpoints is a model in the Platform category from Anyscale. It was released in 2023-10. The vendor is based in US. Best for: Open-model inference and batch jobs.
Notes: Positioning from the vendor site; specs, access and pricing can change — verify before production use.
Strengths
- Ray-based scaling
- Broad open catalog
Limits
- Requires Ray knowledge
- Catalog changes often
Specifications
| Vendor | Anyscale |
|---|---|
| Category | Platform |
| Release | 2023-10 |
| Status | GA |
| License | Proprietary |
| Commercial use | Not specified |
| Input modalities | Text |
| Output modalities | Text |
| Prompt types | Text |
| Negative prompts | No |
| Max outputs | 1 |
| Local deployment | No |
| API access | Yes |
| Pricing | Usage-based / enterprise |
| Confidence | Medium |
| Vendor country | US |
| Vendor type | Platform |
Pricing & hardware
Usage-based / enterprise
API-only: local GPU memory is not applicable. API access is available.