Read Me
Smart Cache Loader
Very configurable web grabber with special Smart Cache support
Radim Kolar (hsn/at/sendmail.cz)
http://scloader.sourceforge.net/
GPL license
What is it:
This program catches parts of WWW server, it parses HTML and downloads
any needed things.
1. This program may be hard to configure and operate. I am interrested
in any feedback how to make it easier.
2. You definitively need to READ MANUAL and SAMPLE cfg
3. Configuration of this program is quite tricky.
4. Look inside loader.cnf and html documentation and try to understand
how to configure and use
5. Basic usage: java -jar scloader.jar [sitename ...] [options ...] [URL ...]
main options:
depth=X <scan depth>
threads=X <download threads>
upd=XXX <update flags>
log=XXX <log flags>
6. In cause of troubles join mailing list
7. Use http://scache.sourceforge.net/ for more user friendly interface
to this program.
Special URL formats:
====================
:URL -> add visited URL. This URL will not be loader/parsed.
@filename -> expand file contents as command line arguments
:@filename -> expand visited
URL#sitename -> configure URL as site sitename
LIMITATIONS:
============
Content-type and size handling is not yet implemented.
Cookies sent by server are ignored.
Have fun.
Radim Kolar