webcrawl
1.10_2Download web sites without user interaction by following links
WebCrawl is a program designed to download an entire web-site without user interaction (although an interactive mode is available). It works simply by starting with a single web page, and following all links from that page to attempt to recreate the directory structure on the remote server.
Origin: www/webcrawl
Category: www
Size: 28.4KiB
License: not specified
Maintainer: demon@FreeBSD.org
Dependencies: 0 packages
Required by: 0 packages
$
pkg install webcrawlMore in www
py311-requests2.32.5
Python HTTP for Humansp5-libwww6.81
Perl5 library for WWW accessp5-HTML-Parser3.83
Perl5 module for parsing HTML documentsphp84-session8.4.16
The session shared extension for phpp5-Catalyst-Runtime5.90132_1
Elegant MVC Web Application Framework (Runtime)py311-django424.2.29
High-level Python Web Frameworkapache242.4.66
Version 2.4.x of Apache web serverp5-HTTP-Message7.01
Representation of HTTP style messagesp5-Template-Toolkit3.102
Extensible template processing systemp5-Plack1.0051
Perl extension of PSGI reference implementation and utilities