BSD Ports

misc/koboldcpp 1.86.2 DragonFly

Simple way to run GGML and GGUF AI models with a KoboldAI WebUI

System
DragonFly
Repository
DPorts
Maintainer
[email protected] (as in FreeBSD)
License
AGPLv3
Categories
misc
Package size
11403.8 KiB, 50262.5 KiB installed

Description

KoboldCpp is an easy-to-use AI text-generation software for GGML and GGUF models, inspired by the original KoboldAI. It's a single self-contained distributable from Concedo, that builds off llama.cpp, and adds a versatile KoboldAI API endpoint, additional format support, Stable Diffusion image generation, speech-to-text, backward compatibility, as well as a fancy UI with persistent stories, editing tools, save formats, memory, world info, author's note, characters, scenarios and everything KoboldAI and KoboldAI Lite have to offer.

In the other systems

SystemPortVersion
DragonFlymisc/koboldcpp1.86.2
FreeBSDmisc/koboldcpp1.121

Install

Binary package:

pkg install koboldcpp

From DPorts:

cd /usr/dports/misc/koboldcpp && make install clean

Dependencies

Run dependencies 4

No port depends on this one.

Configuration

No options to configure.

Service scripts
none
Flavors
koboldcpp-portable-1.86.2