BSD Ports

misc/llama.cpp 0.6.0 OpenBSD

LLM inference system

System
OpenBSD
Repository
OpenBSD ports
Maintainer
Kirill A. Korinsky <[email protected]>
Last update
Commit
b077c5b1cd
Categories
misc

Description

Inference of Meta's LLaMA model (and others) in pure C/C++ with minimal setup and state-of-the-art performance on a wide range of hardware

Install

Binary package:

pkg_add llama.cpp

From the ports tree:

cd /usr/ports/misc/llama.cpp && make install

Dependencies

Build dependencies 2
Run dependencies 2

No port depends on this one.

Commit history 9

DateCommitCreditsLog message
b077c5b1cd kirill misc/llama.cpp: update to 0.6.0
a565447205 kirill misc/llama.cpp: update to 0.5.0
5c4f6bb11d kirill misc/llama.cpp: update to 0.4.1
3227f6c4a9 kirill misc/llama.cpp: update to 0.4.0
639b3cc97f kirill misc/llama.cpp: update to b10433

The latest 5 of 9 in the history this site was built from.