www/py-scrapy 2.11.1_1 DragonFly

High level scraping and web crawling framework

System: DragonFly
Repository: DPorts
Maintainer: [email protected] (as in FreeBSD)
License: BSD3CLAUSE
Categories: python, www
Package size: 509.5 KiB, 3309.0 KiB installed

Description

Scrapy is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

In the other systems

The newest version among them is 2.18.0, as upstream numbers it.

System

Port

Version

Vulnerabilities

Status

Maintainer

Last update

DragonFly

www/py-scrapy

2.11.1_1 behind since 2026-07-23

none known

[email protected]

FreeBSD

www/py-scrapy

2.18.0 newest

none known

[email protected]

2026-09-30

NetBSD

www/py-scrapy

2.18.0 newest

none known

[email protected]

2026-10-16

GhostBSD

www/py-scrapy

2.18.0 newest

no data

[email protected]

Compare across BSDs

Install

Binary package:

pkg install py311-Scrapy

From DPorts:

cd /usr/dports/www/py-scrapy && make install clean

Dependency graph

Ports that need it on the left, what it needs to run on the right; at most 8 of each. "Dependencies" below lists them all.

graph LR
  me["www/py-scrapy"]
  me --> d0["devel/py-itemadapter"]
  me --> d1["devel/py-itemloaders"]
  me --> d2["devel/py-lxml"]
  me --> d3["devel/py-twisted"]
  me --> d4["devel/py-zope.interface"]
  me --> d5["dns/py-tldextract"]
  me --> d6["lang/python311"]
  me --> d7["security/py-cryptography-legacy"]
  me -.-> dmore(["7 more"])
  classDef this fill:#ab2b28,color:#ffffff,stroke:#ab2b28
  class me this

Dependencies

Run dependencies 15

No port depends on this one.

Configuration

No options to configure.

Service scripts: none

Message after installing

===>   NOTICE:

This port is deprecated; you may wish to reconsider installing it:

Depends on expired textproc/py-parsel.

It is scheduled to be removed on or after 2025-06-01.