robots.txt

Don't allow any search engines (robots) to index anything in /cgi-bin:

User-agent: *
Disallow: /cgi-bin/

Don't allow any search engines (robots) to index anything:

User-agent: *
Disallow: /