[go: up one dir, main page]

Menu

Tree [5f9033] master / doc /
 History

HTTPS access


File Date Author Commit
 Makefile 2010-06-02 Radim Kolar <> [b10a99] Added support for generating docbook documentat...
 README 2019-08-22 Radim Kolar Radim Kolar [d8ce8a] retab + encourage users to read manual
 loader.xml 2010-06-02 hsn@sendmail.cz <> [494a7b] corrected error in docbook xml markup

Read Me

                               Smart Cache Loader
         Very configurable web grabber with special Smart Cache support
                        Radim Kolar (hsn/at/sendmail.cz)

                     http://scloader.sourceforge.net/
                                  GPL license


What is it:
This program catches parts of WWW server, it parses HTML and downloads
any needed things.

1. This program may be hard to configure and operate. I am interrested
in any feedback how to make it easier.

2. You definitively need to READ MANUAL and SAMPLE cfg

3. Configuration of this program is quite tricky.

4. Look inside loader.cnf and html documentation and try to understand
how to configure and use

5. Basic usage: java -jar scloader.jar [sitename ...] [options ...] [URL ...]
main options:
  depth=X <scan depth>
  threads=X <download threads>
  upd=XXX <update flags>
  log=XXX <log flags>

6. In cause of troubles join mailing list

7. Use http://scache.sourceforge.net/ for more user friendly interface
   to this program.

Special URL formats:
====================

:URL -> add visited URL. This URL will not be loader/parsed.
@filename -> expand file contents as command line arguments
:@filename -> expand visited
URL#sitename -> configure URL as site sitename

LIMITATIONS:
============
 Content-type and size handling is not yet implemented.
 Cookies sent by server are ignored.

Have fun.

  Radim Kolar