devel/py-grab 0.6.41_2 DragonFly
Site scraping framework
- System
- DragonFly
- Repository
- DPorts
- Maintainer
- [email protected] (as in FreeBSD)
- License
- MIT
- Categories
- devel, python
- Package size
- 155.2 KiB, 977.6 KiB installed
Description
Grab is a python web scraping framework. Grab provides tons of helpful methods to scrape web sites and to process the scraped content:
* Automatic cookies (session) support * HTTP and SOCKS proxy with and without authorization * Keep-Alive support * IDN support * Tools to work with web forms * Easy multipart file uploading * Flexible customization of HTTP requests * Automatic charset detection * Powerful API of extracting info from HTML documents with XPATH queries * Asynchronous API to make thousands of simultaneous queries. This part of library called Spider and it is too big to even list its features in this README. * Python 3 ready
In the other systems
| System | Port | Version |
|---|---|---|
| DragonFly | devel/py-grab | 0.6.41_2 |
| FreeBSD | devel/py-grab | 0.6.41_4 |
| HardenedBSD | devel/py-grab | 0.6.41_4 |
| GhostBSD | devel/py-grab | 0.6.41_4 |
Install
Binary package:
pkg install py311-grab
From DPorts:
cd /usr/dports/devel/py-grab && make install clean
Dependencies
Run dependencies 8
No port depends on this one.