BSD Ports

www/anubis 1.28.1v0 OpenBSD

proof-of-work proxy to protect web resources from scrapers

System
OpenBSD
Repository
OpenBSD ports
Maintainer
The OpenBSD ports mailing-list <[email protected]>
Last update
Commit
4111a4c64f
Categories
www, lang/go

Description

Anubis acts as middleware between a reverse proxy and backend web server. It assesses whether a connection is likely to be from a scraper bot and, if this seems that there's a chance of this, it issues a SHA-256 proof- of-work challenge before allowing the connection to proceed.

As of 1.14.x, Anubis decides to present a challenge using this logic:

User-Agent contains "Mozilla"
Request path is not in /.well-known, /robots.txt, or /favicon.ico
Request path is not obviously an RSS feed (ends with .rss, .xml, or .atom)

This should ensure that git clients, RSS readers, and other low-harm clients can get through without issue, but high-risk clients such as browsers and AI scraper bots impersonating browsers will get blocked.

When a challenge is passed, a signed JSON Web Token (JWT) is provided as a cookie, allowing future requests to pass without triggering the challenge.

Using Anubis will likely result in your website not being indexed by some search engines. This is considered a feature, not a bug.

In the other systems

SystemPortVersion
OpenBSDwww/anubis1.28.1v0
FreeBSDmail/anubis4.3_9
NetBSDwww/anubis1.27.0nb4
DragonFlymail/anubis4.3_6
HardenedBSDmail/anubis4.3_9
GhostBSDmail/anubis4.3_9

Install

Binary package:

pkg_add anubis

From the ports tree:

cd /usr/ports/www/anubis && make install

Dependencies

Build dependencies 1

No port depends on this one.

Commit history 4

DateCommitCreditsLog message
4111a4c64f sthen update to anubis-1.28.1
3b0223b4ef sthen update to anubis-1.27.0
d524623b2b sthen update to anubis-1.26.2
0ede8935ca sthen update to anubis-1.26.0