www/p5-Gungho 0.09008_2 FreeBSD

Event Based High Performance Web Crawler Framework

System: FreeBSD
Repository: FreeBSD ports
Maintainer: [email protected]
License: ART10, GPLv1+
Categories: www, perl5
Package size: 120.6 KiB, 229.9 KiB installed

Description

Gungho is Yet Another Web Crawler Framework, aimed to be extensible and fast.

Gungho tries to build from clean structures, based upon principles from the likes of Catalyst and Plagger, so that you can easily extend it to your liking.

Features such as robot rules handling (robots.txt) and request throttling can be removed/added on the fly, just by specifying the components that you want to load. You can easily create additional functionality by writing your own component.

In the other systems

The newest version among them is 0.09008, as upstream numbers it.

System

Port

Version

Vulnerabilities

Status

Maintainer

Last update

FreeBSD

www/p5-Gungho

0.09008_2 newest

none known

[email protected]

DragonFly

www/p5-Gungho

0.09008_2 newest

none known

[email protected]

HardenedBSD

www/p5-Gungho

0.09008_2 newest

no data

[email protected]

GhostBSD

www/p5-Gungho

0.09008_2 newest

no data

[email protected]

Install

Binary package:

pkg install p5-Gungho

From the ports tree:

cd /usr/ports/www/p5-Gungho/ && make install clean

To depend on this port in another port's Makefile:

RUN_DEPENDS=	p5-Gungho>0:www/p5-Gungho

Packages

The version each package repository carries. “-” means the repository builds no package of it, “n/a” that there is no such repository.

Repository

aarch64

amd64

armv6

armv7

i386

FreeBSD:14:latest

0.09008_2

FreeBSD:14:quarterly

0.09008_2

n/a

0.09008_2

FreeBSD:15:latest

0.09008_2

n/a

0.09008_2

FreeBSD:15:quarterly

0.09008_2

n/a

FreeBSD:16:latest

0.09008_2

n/a

FreeBSD:16:quarterly

n/a

Dependency graph

Ports that need it on the left, what it needs to run on the right; at most 8 of each. "Dependencies" below lists them all.

graph LR
  me["www/p5-Gungho"]
  u0["www/p5-GunghoX-FollowLinks"] --> me
  me --> d0["converters/p5-Cpanel-JSON-XS"]
  me --> d1["converters/p5-Encode-Locale"]
  me --> d2["converters/p5-MIME-Base32"]
  me --> d3["converters/p5-MIME-Base64"]
  me --> d4["databases/p5-Cache-Memcached"]
  me --> d5["databases/p5-Cache-Memcached-Managed"]
  me --> d6["devel/p5-Algorithm-C3"]
  me --> d7["devel/p5-B-Hooks-EndOfScope"]
  me -.-> dmore(["129 more"])
  classDef this fill:#ab2b28,color:#ffffff,stroke:#ab2b28
  class me this

Dependencies

As this port's Makefile names them.

Build 31

p5-Best>=0 : devel/p5-Best
p5-Class-Accessor>=0 : devel/p5-Class-Accessor
p5-Class-C3-Componentised>=0 : devel/p5-Class-C3-Componentised
p5-Class-C3-XS>=0.02 : devel/p5-Class-C3-XS
p5-Class-C3>=0.16 : devel/p5-Class-C3
p5-Class-Data-Inheritable>=0 : devel/p5-Class-Data-Inheritable
p5-Class-Inspector>=0 : devel/p5-Class-Inspector
p5-Config-Any>=0 : devel/p5-Config-Any
p5-Danga-Socket-Callback>=0 : devel/p5-Danga-Socket-Callback
p5-Danga-Socket>=1.57 : devel/p5-Danga-Socket
p5-Data-Throttler-Memcached>=0.0003 : devel/p5-Data-Throttler-Memcached
p5-Data-Throttler>=0 : devel/p5-Data-Throttler
p5-Event-Notify>=0.00004 : devel/p5-Event-Notify
p5-Exception-Class>=0 : devel/p5-Exception-Class
p5-HTML-RobotsMETA>=0 : www/p5-HTML-RobotsMETA
p5-HTTP-Parser>=0 : www/p5-HTTP-Parser
p5-IO-Async>=0 : devel/p5-IO-Async
p5-Log-Dispatch>=0 : devel/p5-Log-Dispatch
p5-POE-Component-Client-DNS>=0 : dns/p5-POE-Component-Client-DNS
p5-POE-Component-Client-HTTP>=0.81 : www/p5-POE-Component-Client-HTTP
p5-POE-Component-Client-Keepalive>=0 : net/p5-POE-Component-Client-Keepalive
p5-POE>=0.9999 : devel/p5-POE
p5-Path-Class>=0 : devel/p5-Path-Class
p5-Regexp-Common>=0 : textproc/p5-Regexp-Common
p5-UNIVERSAL-isa>=0.06 : devel/p5-UNIVERSAL-isa
p5-UNIVERSAL-require>=0 : devel/p5-UNIVERSAL-require
p5-URI>=0 : net/p5-URI
p5-WWW-RobotRules-Parser>=0 : www/p5-WWW-RobotRules-Parser
p5-Web-Scraper-Config>=0 : www/p5-Web-Scraper-Config
p5-YAML>=0 : textproc/p5-YAML
p5-libwww>=0 : www/p5-libwww

Runtime 31

p5-Best>=0 : devel/p5-Best
p5-Class-Accessor>=0 : devel/p5-Class-Accessor
p5-Class-C3-Componentised>=0 : devel/p5-Class-C3-Componentised
p5-Class-C3-XS>=0.02 : devel/p5-Class-C3-XS
p5-Class-C3>=0.16 : devel/p5-Class-C3
p5-Class-Data-Inheritable>=0 : devel/p5-Class-Data-Inheritable
p5-Class-Inspector>=0 : devel/p5-Class-Inspector
p5-Config-Any>=0 : devel/p5-Config-Any
p5-Danga-Socket-Callback>=0 : devel/p5-Danga-Socket-Callback
p5-Danga-Socket>=1.57 : devel/p5-Danga-Socket
p5-Data-Throttler-Memcached>=0.0003 : devel/p5-Data-Throttler-Memcached
p5-Data-Throttler>=0 : devel/p5-Data-Throttler
p5-Event-Notify>=0.00004 : devel/p5-Event-Notify
p5-Exception-Class>=0 : devel/p5-Exception-Class
p5-HTML-RobotsMETA>=0 : www/p5-HTML-RobotsMETA
p5-HTTP-Parser>=0 : www/p5-HTTP-Parser
p5-IO-Async>=0 : devel/p5-IO-Async
p5-Log-Dispatch>=0 : devel/p5-Log-Dispatch
p5-POE-Component-Client-DNS>=0 : dns/p5-POE-Component-Client-DNS
p5-POE-Component-Client-HTTP>=0.81 : www/p5-POE-Component-Client-HTTP
p5-POE-Component-Client-Keepalive>=0 : net/p5-POE-Component-Client-Keepalive
p5-POE>=0.9999 : devel/p5-POE
p5-Path-Class>=0 : devel/p5-Path-Class
p5-Regexp-Common>=0 : textproc/p5-Regexp-Common
p5-UNIVERSAL-isa>=0.06 : devel/p5-UNIVERSAL-isa
p5-UNIVERSAL-require>=0 : devel/p5-UNIVERSAL-require
p5-URI>=0 : net/p5-URI
p5-WWW-RobotRules-Parser>=0 : www/p5-WWW-RobotRules-Parser
p5-Web-Scraper-Config>=0 : www/p5-Web-Scraper-Config
p5-YAML>=0 : textproc/p5-YAML
p5-libwww>=0 : www/p5-libwww

The full lists below include those, and their dependencies in turn.

Build dependencies 137

The first 100 are listed.

Run dependencies 137

The first 100 are listed.

Required by 1

www/p5-GunghoX-FollowLinks

Configuration

No options to configure.

USES: perl5 shebangfix
Service scripts: none

Files

pkg-plist 108

bin/gungho
%%SITE_PERL%%/Gungho.pm
%%SITE_PERL%%/Gungho/Base.pm
%%SITE_PERL%%/Gungho/Base/Class.pm
%%SITE_PERL%%/Gungho/Component.pm
%%SITE_PERL%%/Gungho/Component/Authentication.pm
%%SITE_PERL%%/Gungho/Component/Authentication/Basic.pm
%%SITE_PERL%%/Gungho/Component/BlockPrivateIP.pm
%%SITE_PERL%%/Gungho/Component/Cache.pm
%%SITE_PERL%%/Gungho/Component/Core.pm
%%SITE_PERL%%/Gungho/Component/RobotRules.pm
%%SITE_PERL%%/Gungho/Component/RobotRules/Rule.pm
%%SITE_PERL%%/Gungho/Component/RobotRules/Storage.pm
%%SITE_PERL%%/Gungho/Component/RobotRules/Storage/Cache.pm
%%SITE_PERL%%/Gungho/Component/RobotRules/Storage/DB_File.pm
%%SITE_PERL%%/Gungho/Component/RobotsMETA.pm
%%SITE_PERL%%/Gungho/Component/Scraper.pm
%%SITE_PERL%%/Gungho/Component/Setup.pm
%%SITE_PERL%%/Gungho/Component/Throttle.pm
%%SITE_PERL%%/Gungho/Component/Throttle/Domain.pm
%%SITE_PERL%%/Gungho/Component/Throttle/Provider.pm
%%SITE_PERL%%/Gungho/Component/Throttle/Simple.pm
%%SITE_PERL%%/Gungho/Component/Throttle/Throttler.pm
%%SITE_PERL%%/Gungho/Engine.pm
%%SITE_PERL%%/Gungho/Engine/Danga/Socket.pm
%%SITE_PERL%%/Gungho/Engine/IO/Async.pm
%%SITE_PERL%%/Gungho/Engine/POE.pm
%%SITE_PERL%%/Gungho/Exception.pm
%%SITE_PERL%%/Gungho/Handler.pm
%%SITE_PERL%%/Gungho/Handler/FileWriter/Simple.pm
%%SITE_PERL%%/Gungho/Handler/Inline.pm
%%SITE_PERL%%/Gungho/Handler/Null.pm
%%SITE_PERL%%/Gungho/Inline.pm
%%SITE_PERL%%/Gungho/Log.pm
%%SITE_PERL%%/Gungho/Log/Dispatch.pm
%%SITE_PERL%%/Gungho/Log/Simple.pm
%%SITE_PERL%%/Gungho/Manual/FAQ.pod
%%SITE_PERL%%/Gungho/Manual/TODO.pod
%%SITE_PERL%%/Gungho/Plugin.pm
%%SITE_PERL%%/Gungho/Plugin/Apoptosis.pm
%%SITE_PERL%%/Gungho/Plugin/RequestLog.pm
%%SITE_PERL%%/Gungho/Plugin/RequestTimer.pm
%%SITE_PERL%%/Gungho/Plugin/Statistics.pm
%%SITE_PERL%%/Gungho/Plugin/Statistics/Format/XML.pm
%%SITE_PERL%%/Gungho/Plugin/Statistics/Storage/SQLite.pm
%%SITE_PERL%%/Gungho/Provider.pm
%%SITE_PERL%%/Gungho/Provider/File/Simple.pm
%%SITE_PERL%%/Gungho/Provider/Inline.pm
%%SITE_PERL%%/Gungho/Provider/Simple.pm
%%SITE_PERL%%/Gungho/Provider/YAML.pm
%%SITE_PERL%%/Gungho/Request.pm
%%SITE_PERL%%/Gungho/Request/http.pm
%%SITE_PERL%%/Gungho/Response.pm
%%SITE_PERL%%/Gungho/Util.pm
%%PERL5_MAN1%%/gungho.1.gz
%%PERL5_MAN3%%/Gungho.3.gz
%%PERL5_MAN3%%/Gungho::Base.3.gz
%%PERL5_MAN3%%/Gungho::Base::Class.3.gz
%%PERL5_MAN3%%/Gungho::Component.3.gz
%%PERL5_MAN3%%/Gungho::Component::Authentication.3.gz
%%PERL5_MAN3%%/Gungho::Component::Authentication::Basic.3.gz
%%PERL5_MAN3%%/Gungho::Component::BlockPrivateIP.3.gz
%%PERL5_MAN3%%/Gungho::Component::Cache.3.gz
%%PERL5_MAN3%%/Gungho::Component::Core.3.gz
%%PERL5_MAN3%%/Gungho::Component::RobotRules.3.gz
%%PERL5_MAN3%%/Gungho::Component::RobotRules::Rule.3.gz
%%PERL5_MAN3%%/Gungho::Component::RobotRules::Storage.3.gz
%%PERL5_MAN3%%/Gungho::Component::RobotRules::Storage::Cache.3.gz
%%PERL5_MAN3%%/Gungho::Component::RobotRules::Storage::DB_File.3.gz
%%PERL5_MAN3%%/Gungho::Component::RobotsMETA.3.gz
%%PERL5_MAN3%%/Gungho::Component::Scraper.3.gz
%%PERL5_MAN3%%/Gungho::Component::Setup.3.gz
%%PERL5_MAN3%%/Gungho::Component::Throttle.3.gz
%%PERL5_MAN3%%/Gungho::Component::Throttle::Domain.3.gz
%%PERL5_MAN3%%/Gungho::Component::Throttle::Provider.3.gz
%%PERL5_MAN3%%/Gungho::Component::Throttle::Simple.3.gz
%%PERL5_MAN3%%/Gungho::Component::Throttle::Throttler.3.gz
%%PERL5_MAN3%%/Gungho::Engine.3.gz
%%PERL5_MAN3%%/Gungho::Engine::Danga::Socket.3.gz
%%PERL5_MAN3%%/Gungho::Engine::IO::Async.3.gz
%%PERL5_MAN3%%/Gungho::Engine::POE.3.gz
%%PERL5_MAN3%%/Gungho::Exception.3.gz
%%PERL5_MAN3%%/Gungho::Handler.3.gz
%%PERL5_MAN3%%/Gungho::Handler::FileWriter::Simple.3.gz
%%PERL5_MAN3%%/Gungho::Handler::Inline.3.gz
%%PERL5_MAN3%%/Gungho::Handler::Null.3.gz
%%PERL5_MAN3%%/Gungho::Inline.3.gz
%%PERL5_MAN3%%/Gungho::Log.3.gz
%%PERL5_MAN3%%/Gungho::Log::Dispatch.3.gz
%%PERL5_MAN3%%/Gungho::Log::Simple.3.gz
%%PERL5_MAN3%%/Gungho::Manual::FAQ.3.gz
%%PERL5_MAN3%%/Gungho::Manual::TODO.3.gz
%%PERL5_MAN3%%/Gungho::Plugin.3.gz
%%PERL5_MAN3%%/Gungho::Plugin::Apoptosis.3.gz
%%PERL5_MAN3%%/Gungho::Plugin::RequestLog.3.gz
%%PERL5_MAN3%%/Gungho::Plugin::RequestTimer.3.gz
%%PERL5_MAN3%%/Gungho::Plugin::Statistics.3.gz
%%PERL5_MAN3%%/Gungho::Plugin::Statistics::Format::XML.3.gz
%%PERL5_MAN3%%/Gungho::Plugin::Statistics::Storage::SQLite.3.gz
%%PERL5_MAN3%%/Gungho::Provider.3.gz

The first 100 are listed.

distinfo 1

File

Size

SHA256

Gungho-0.09008.tar.gz

95556

9467a81e26ab566f7a3992b2f34ff87a73a37980029819c3b0fe2cd9699a2311

Master sites 1

CPAN

Commit history 0

No commits in the history this site was built from.