wip/agentcc-gateway 1.56.1 NetBSD
OpenAI-compatible LLM gateway with routing, guardrails, and caching
- System
- NetBSD
- Repository
- pkgsrc-wip
- Maintainer
- [email protected]
- Port added
- Last update
- Commit
a418c2a5b4- License
- apache-2.0
- Categories
- wip, net
Description
Agent Command Center (agentcc-gateway) is a high-performance, OpenAI-compatible LLM gateway written in Go. It sits between your application and LLM providers, providing a single OpenAI-compatible API for every provider you configure.
Features:
- One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock, Cohere, Azure, and local self-hosted endpoints (vLLM, Ollama, LMStudio, TGI, LocalAI)
- 15 routing strategies: retries, circuit breakers, failover, hedged/race, latency-aware, cost-optimized, model fallback, shadow/mirror, and more
- Cost control: exact + semantic caching, per-key budgets, quotas, virtual keys, rate limits, credits ledger
- 18 built-in guardrail scanners (PII, injection, jailbreak, secrets, hallucination, MCP security, content moderation, and more) plus adapters for 15 third-party guardrail vendors
- Observability: Prometheus + OpenTelemetry, per-request metrics
- Modern protocols: MCP, A2A, Assistants, vector stores, batch, files, realtime WebSocket, responses API
Single binary, single YAML config, no proprietary control plane required.
Version history 2
Upstream's version as each commit to the port's Makefile set it, or as this site first saw it in the system's packages; the tree's own revisions are not versions here.
Install
From pkgsrc-wip (no binary package):
cd /usr/pkgsrc/wip/agentcc-gateway && make install clean
Dependencies
No port depends on this one.