summaryrefslogtreecommitdiff
path: root/www/webcrawl/pkg-descr
blob: f75c581b57bed8d5d74ee61f5ff17b3323ad7e0d (plain) (blame)
1
2
3
4
5
6
7
WebCrawl is a program designed to download an entire web-site without
user interaction (although an interactive mode is available). It works simply
by starting with a single web page, and following all links from that page
to attempt to recreate the directory structure on the remote server.

--Dima
dima@chg.ru