# robots.txt for http://searchftp.1command.com/ # see # for an explanation. User-agent: SpokeSpider Disallow: / Disallow: /* Disallow: */* User-agent: Girafabot Disallow: / Disallow: /* Disallow: */* User-agent: * Disallow: /cgi-bin/ Disallow: /2add/ Disallow: /banner/ Disallow: /2add/ Disallow: /JS/ Disallow: /masters/ Disallow: /traceroute/ Disallow: /web/