BSD Ports

www/py-w3lib 2.4.1 NetBSD

Python library of web-related functions

System
NetBSD
Repository
pkgsrc
Maintainer
[email protected]
Last update
Commit
896b13b0b1
License
modified-bsd
Categories
www, python
Package size
37.9 KiB, 185.6 KiB installed

Description

This is a Python library of web-related functions, such as: * remove comments, or tags from HTML snippets * extract base url from HTML snippets * translate entites on HTML strings * convert raw HTTP headers to dicts and vice-versa * construct HTTP auth header * converting HTML pages to unicode * sanitize urls (like browsers do) * extract arguments from urls

In the other systems

SystemPortVersion
NetBSDwww/py-w3lib2.4.1
FreeBSDwww/py-w3lib2.4.1
DragonFlywww/py-w3lib1.21.0_1
HardenedBSDwww/py-w3lib2.4.1
GhostBSDwww/py-w3lib2.4.1

Install

Binary package:

pkgin install py311-w3lib

From pkgsrc:

cd /usr/pkgsrc/www/py-w3lib && make install clean

Packages

The version each package repository carries. “-” means the repository builds no package of it, “n/a” that there is no such repository.

RepositoryVersion
NetBSD 10.1 x86_642.4.1
NetBSD 10.1 aarch642.4.1
SmartOS / illumos x86_642.5.0
macOS 15 arm642.5.0

Dependencies

Run dependencies 1

Configuration

No options to configure.

Service scripts
none
Flavors
py312-w3lib-2.4.1, py313-w3lib-2.4.1, py314-w3lib-2.4.1

Commit history 1

DateCommitCreditsLog message
896b13b0b1 adam py-w3lib: updated to 2.5.0
2.5.0 (2026-09-30) New features: - Added support for Python 3.15 - Added :func:`~w3lib.url.add_http_if_no_scheme`, ported from Scrapy, which adds ``http`` as the default scheme to a URL that has none - ``w3lib.url.parse_qsl_to_bytes``, :func:`~w3lib.url.url_query_parameter`, :func:`~w3lib.url.add_or_replace_parameter`, :func:`~w3lib.url.add_or_replace_parameters` and :func:`~w3lib.url.canonicalize_url` now accept a *separator* (or *query_separator* for :func:`~w3lib.url.canonicalize_url`) keyword argument, to support query strings that use a separator other than ``&`` - :func:`~w3lib.html.get_base_url` and :func:`~w3lib.html.get_meta_refresh` now accept a *max_scan* keyword argument, an upper bound on how much of the document they look at …