aibender logo aibenderAI model catalog
Platform GA Open source

KoboldCpp

Single-file GGUF runner with a web UI

Release2023-05
Context—
Max output—
ParametersUndisclosed
Local / VRAMLocal
LicenseOpen source

Overview

KoboldCpp is a model in the Platform category from KoboldAI. It was released in 2023-05. The vendor is based in US. Best for: Single-file GGUF runner with a web UI.

Notes: Positioning from the vendor site; specs, access and pricing can change — verify before production use.

Strengths

  • One executable
  • GGUF/GGML support
  • CPU + GPU

Limits

  • Basic UI
  • Manual model downloads

Specifications

VendorKoboldAI
CategoryPlatform
Release2023-05
StatusGA
LicenseOpen source
License nameAGPL-3.0
Commercial useNot specified
Input modalitiesText
Output modalitiesText
Prompt typesText
Negative promptsNo
Max outputs1
Local deploymentYes
API accessYes
PricingFree (self-host)
ConfidenceMedium
Vendor countryUS
Vendor typePlatform

Pricing & hardware

Free (self-host)

This model can be self-hosted or run locally. API access is available.

More from KoboldAI