eXtensible Text Framework (XTF) Code

Framework for search and display of heterogenous document collections.

Brought to you by: khasting, lrschiff, mhaye

[9c8ca6]: / robots.txt Maximize Restore History

Download this file

23 lines (17 with data), 218 Bytes

User-agent: *
Disallow: /

# Google
User-agent: googlebot
Disallow:

# MSN
User-agent: msnbot
Disallow:

# Yahoo
User-agent: slurp
Disallow:

# Ask Jeeves
User-agent: teoma
Disallow:

# Wget
User-agent: wget
Disallow: