misc/koboldcpp 1.86.2 DragonFly
Simple way to run GGML and GGUF AI models with a KoboldAI WebUI
- System
- DragonFly
- Repository
- DPorts
- Maintainer
- [email protected] (as in FreeBSD)
- License
- AGPLv3
- Categories
- misc
- Package size
- 11403.8 KiB, 50262.5 KiB installed
Description
KoboldCpp is an easy-to-use AI text-generation software for GGML and GGUF models, inspired by the original KoboldAI. It's a single self-contained distributable from Concedo, that builds off llama.cpp, and adds a versatile KoboldAI API endpoint, additional format support, Stable Diffusion image generation, speech-to-text, backward compatibility, as well as a fancy UI with persistent stories, editing tools, save formats, memory, world info, author's note, characters, scenarios and everything KoboldAI and KoboldAI Lite have to offer.
In the other systems
| System | Port | Version |
|---|---|---|
| DragonFly | misc/koboldcpp | 1.86.2 |
| FreeBSD | misc/koboldcpp | 1.121 |
Install
Binary package:
pkg install koboldcpp
From DPorts:
cd /usr/dports/misc/koboldcpp && make install clean
Dependencies
No port depends on this one.
Configuration
No options to configure.
- Service scripts
- none
- Flavors
koboldcpp-portable-1.86.2