www/larbin 2.6.3p4 OpenBSD

little and fast Web crawler

Homepage
Browse the port
OpenPorts
Other distributions
Search similar

System: OpenBSD
Repository: OpenBSD ports
Maintainer: The OpenBSD ports mailing-list <[email protected]>
Categories: www

Description

Larbin is a web crawler (also called (web) robot, spider, scooter...). It is intended to fetch a large number of web pages to fill the database of a search engine. With a network fast enough, Larbin should be able to fetch more than 100 millions pages on a standard PC.

Install

Binary package:

pkg_add larbin

From the ports tree:

cd /usr/ports/www/larbin && make install

Dependencies

Run dependencies 1

net/adns

No port depends on this one.