robots.txt
Don't allow any search engines (robots) to index anything in /cgi-bin:
User-agent: * Disallow: /cgi-bin/
Don't allow any search engines (robots) to index anything:
User-agent: * Disallow: /
Don't allow any search engines (robots) to index anything in /cgi-bin:
User-agent: * Disallow: /cgi-bin/
Don't allow any search engines (robots) to index anything:
User-agent: * Disallow: /