BSD Portsdevel/py-grab 0.6.41_4 FreeBSD
Site scraping framework
- System
- FreeBSD
- Repository
- FreeBSD ports
- Maintainer
- [email protected]
- License
- MIT
- Categories
- devel, python
- Package size
- 164.2 KiB, 919.9 KiB installed
Description
Grab is a python web scraping framework. Grab provides tons of helpful methods to scrape web sites and to process the scraped content:
* Automatic cookies (session) support * HTTP and SOCKS proxy with and without authorization * Keep-Alive support * IDN support * Tools to work with web forms * Easy multipart file uploading * Flexible customization of HTTP requests * Automatic charset detection * Powerful API of extracting info from HTML documents with XPATH queries * Asynchronous API to make thousands of simultaneous queries. This part of library called Spider and it is too big to even list its features in this README. * Python 3 ready
In the other systems
| System | Port | Version |
|---|---|---|
| FreeBSD | devel/py-grab | 0.6.41_4 |
| DragonFly | devel/py-grab | 0.6.41_2 |
Install
Binary package:
pkg install py312-grabFrom the ports tree:
cd /usr/ports/devel/py-grab/ && make install cleanTo depend on this port in another port's Makefile:
RUN_DEPENDS= py312-grab>0:devel/py-grabPackages
The version each package repository carries. “-” means the repository builds no package of it, “n/a” that there is no such repository.
| Repository | aarch64 | amd64 | armv6 | armv7 | i386 |
|---|---|---|---|---|---|
| FreeBSD:14:latest | 0.6.41_4 | 0.6.41_4 | 0.6.41_1 | 0.6.41_3 | 0.6.41_4 |
| FreeBSD:14:quarterly | 0.6.41_4 | 0.6.41_4 | n/a | 0.6.41_2 | 0.6.41_4 |
| FreeBSD:15:latest | 0.6.41_4 | 0.6.41_4 | n/a | 0.6.41_3 | 0.6.41_3 |
| FreeBSD:15:quarterly | 0.6.41_4 | 0.6.41_4 | n/a | n/a | n/a |
| FreeBSD:16:latest | 0.6.41_4 | 0.6.41_4 | n/a | n/a | n/a |
| FreeBSD:16:quarterly | n/a | n/a | n/a | n/a | n/a |
Dependencies
As this port's Makefile names them.
Runtime 7
${PYTHON_PKGNAMEPREFIX}lxml>0: devel/py-lxml${PYTHON_PKGNAMEPREFIX}pycurl>0: ftp/py-pycurl${PYTHON_PKGNAMEPREFIX}weblib>0: devel/py-weblib${PYTHON_PKGNAMEPREFIX}selection>0: devel/py-selection${PYTHON_PKGNAMEPREFIX}six>0: devel/py-six${PYTHON_PKGNAMEPREFIX}user_agent>0: www/py-user_agent${PYTHON_PKGNAMEPREFIX}defusedxml>0: devel/py-defusedxml
The full lists below include those, and their dependencies in turn.
Build dependencies 11
Run dependencies 31
- archivers/brotli
- archivers/liblz4
- archivers/zstd
- devel/gettext-runtime
- devel/libffi
- devel/libunistring
- devel/py-defusedxml
- devel/py-lxml
- devel/py-pyquery
- devel/py-pytz
- devel/py-selection
- devel/py-six
- devel/py-weblib
- devel/readline
- dns/libidn2
- dns/libpsl
- ftp/curl
- ftp/py-pycurl
- lang/python312
- math/mpdecimal
- print/indexinfo
- russian/py-pytils
- security/libgcrypt
- security/libgpg-error
- security/libssh2
- textproc/expat2
- textproc/libxml2
- textproc/libxslt
- www/libnghttp2
- www/py-cssselect
- www/py-user_agent
No port depends on this one.
Configuration
No options to configure.
- USES
- python
- Service scripts
- none
Files
distinfo 1
| File | Size | SHA256 |
|---|---|---|
| grab-0.6.41.tar.gz | 1.06236e+06 | 86aeba303179c1ec8779bd28d30d99458dc450747e537f2735965788651364e3 |
Master sites 1
- PYPI
Commit history 0
No commits in the history this site was built from.