User-agent: * # directed to all spiders, Disallow: /cgi-bin/ Disallow: /misc/ Disallow: /guestbook/ Disallow /climbing/rock/bull_run.htm