aibender logo aibenderAI model catalog
Platform GA Proprietary

Friendli Engine

by FriendliAI · South Korea

High-throughput serving engine for open models

Open in interactive catalog Explore data analysis
Release2023-01
Context—
Max output—
ParametersUndisclosed
Local / VRAMAPI only
LicenseProprietary

Overview

Friendli Engine is a model in the Platform category from FriendliAI. It was released in 2023-01. The vendor is based in South Korea. Best for: High-throughput serving engine for open models.

Notes: Positioning from the vendor site; specs, access and pricing can change — verify before production use.

Strengths

  • High throughput
  • Speculative decoding

Limits

  • Engine-first, few extras
  • Enterprise sales

Specifications

VendorFriendliAI
CategoryPlatform
Release2023-01
StatusGA
LicenseProprietary
Commercial useNot specified
Input modalitiesText
Output modalitiesText
Prompt typesText
Negative promptsNo
Max outputs1
Local deploymentNo
API accessYes
PricingUsage-based / enterprise
ConfidenceMedium
Vendor countrySouth Korea
Vendor typePlatform

Pricing & hardware

Usage-based / enterprise

API-only: local GPU memory is not applicable. API access is available.

More from FriendliAI

No other models are listed for this vendor.