BSD Ports

misc/llama-cpp 3285 DragonFly

Facebook's LLaMA model in C/C++

System
DragonFly
Repository
DPorts
Maintainer
[email protected] (as in FreeBSD)
License
MIT
Categories
misc
Package size
2777.8 KiB, 21454.0 KiB installed

Description

The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide variety of hardware - locally and in the cloud.

In the other systems

SystemPortVersion
DragonFlymisc/llama-cpp3285
FreeBSDmisc/llama-cpp11669
MidnightBSDai/llama-cpp9426

Install

Binary package:

pkg install llama-cpp

From DPorts:

cd /usr/dports/misc/llama-cpp && make install clean

Dependencies

Run dependencies 1

No port depends on this one.