# Thomas Station: robots.txt # # This file is used to allow crawlers to index our site. # It is NOT used for any other purpose, such as filtering # advertiser impressions or clicks. # User-agent: * Disallow: /ext/ Disallow: /cgi-bin/ Disallow: /spec/ Disallow: /_include/ Disallow: /adm/ Disallow: /images/ Disallow: /error_docs/