p5-Gungho
0.09008_2Event Based High Performance Web Crawler Framework
Gungho is Yet Another Web Crawler Framework, aimed to be extensible and fast. Gungho tries to build from clean structures, based upon principles from the likes of Catalyst and Plagger, so that you can easily extend it to your liking. Features such as robot rules handling (robots.txt) and request throttling can be removed/added on the fly, just by specifying the components that you want to load. You can easily create additional functionality by writing your own component.
Origin: www/p5-Gungho
Category: www
Size: 230KiB
License: ART10, GPLv1+
Maintainer: perl@FreeBSD.org
Dependencies: 32 packages
Required by: 1 packages
Website: metacpan.org/release/Gungho
$
pkg install p5-GunghoDependencies (32)
perl5p5-libwwwp5-YAMLp5-Web-Scraper-Configp5-WWW-RobotRules-Parserp5-URIp5-UNIVERSAL-requirep5-UNIVERSAL-isap5-Regexp-Commonp5-Path-Classp5-POE-Component-Client-Keepalivep5-POE-Component-Client-HTTPp5-POE-Component-Client-DNSp5-POEp5-Log-Dispatchp5-IO-Asyncp5-HTTP-Parserp5-HTML-RobotsMETAp5-Exception-Classp5-Event-Notifyp5-Data-Throttler-Memcachedp5-Data-Throttlerp5-Danga-Socket-Callbackp5-Danga-Socketp5-Config-Anyp5-Class-Inspectorp5-Class-Data-Inheritablep5-Class-C3-XSp5-Class-C3-Componentisedp5-Class-C3p5-Class-Accessorp5-Best
Required By (1 packages)
More in www
py311-requests2.32.5
Python HTTP for Humansp5-libwww6.81
Perl5 library for WWW accessp5-HTML-Parser3.83
Perl5 module for parsing HTML documentsphp84-session8.4.16
The session shared extension for phpp5-Catalyst-Runtime5.90132_1
Elegant MVC Web Application Framework (Runtime)py311-django424.2.29
High-level Python Web Frameworkapache242.4.66
Version 2.4.x of Apache web serverp5-HTTP-Message7.01
Representation of HTTP style messagesp5-Template-Toolkit3.102
Extensible template processing systemp5-Plack1.0051
Perl extension of PSGI reference implementation and utilities