User-agent: * Disallow: /logs/ Disallow: /old-logs/ Disallow: /cgi-bin/spambot_trap/ Disallow: /cgi-bin/info2html Disallow: /cgi-bin/manbrowser Disallow: /syscollect/.htpasswd.o Disallow: /projects/disksuite/device_1/.file_htpasswd Disallow: /projects/disksuite/device_2/.file_htpasswd Disallow: /projects/disksuite/device_3/.file_htpasswd Disallow: /projects/disksuite/device_4/.file_htpasswd Disallow: /css/fnalu/internals/.file_htpasswd Disallow: /csi/internal/internal/.file_passwd Disallow: /scs/fnalu/internals/.file_htpasswd Disallow: /scs/fnalu/internal/.file_htpasswd Disallow: /toc-unix/ctcom/.file_htpasswd Disallow: /toc-unix/ctcom/.file_htpasswd.000517 Disallow: /toc-unix/ctcom.ettab/.file_htpasswd Disallow: /toc-unix/ctcom.ettab/.file_htpasswd.000517 Disallow: /toc-unix/.file_htpasswd Disallow: /fss/ctcom/.file_htpasswd Disallow: /fss/ctcom/.010731.file_htpasswd Disallow: /fss/ctcom/.000517.file_htpasswd Disallow: /csi.old/internal/internal/.file_passwd User-agent: vspider Disallow: /~ Disallow: /logs/ Disallow: /old-logs/ Disallow: /cgi-bin/spambot_trap/