User-agent: * # directed to all spiders Disallow: /adsl/ Disallow: /cgi-bin/ Disallow: /images/ Disallow: /cdrom/ Disallow: /Usage/ Disallow: /Usage/index.html Disallow: /Usage/webalizer.current Disallow: /Usage/webalizer.hist