# Disallow access to these dirs - all crawlers User-agent: * Disallow: ../cgi-bin/ Disallow: /autosure/ Disallow: /backup/ Disallow: /downloads/ Disallow: /eguide/ Disallow: /ftparchive/ Disallow: /gcl_admin/ Disallow: /ID/ Disallow: /id21/ Disallow: /ID_amny/ Disallow: /images/ Disallow: /mtf/ Disallow: /photo_large/ Disallow: /photo_thumb/ Disallow: /phpMyAdmin/ Disallow: /webalizer/ Disallow: /youfind/ Disallow: /sub/images/ Disallow: /sub/includes/ Disallow: /sub/temp/ Crawl-delay: 10