BSD Portswww/py-protego 0.1.16_1 DragonFly
Pure-Python robots.txt parser
- System
- DragonFly
- Repository
- DPorts
- Maintainer
- [email protected] (as in FreeBSD)
- License
- BSD3CLAUSE
- Categories
- python, www
- Package size
- 36.7 KiB, 202.3 KiB installed
Description
Protego is a pure-Python robots.txt parser with support for modern conventions. It is mainly used by Scrapy application when crawling websites.
In the other systems
| System | Port | Version |
|---|---|---|
| DragonFly | www/py-protego | 0.1.16_1 |
| FreeBSD | www/py-protego | 0.1.16_1 |
| NetBSD | www/py-protego | 0.6.2 |
| HardenedBSD | www/py-protego | 0.1.16_1 |
| GhostBSD | www/py-protego | 0.1.16_1 |
Install
Binary package:
pkg install py311-protegoFrom DPorts:
cd /usr/dports/www/py-protego && make install clean