# Disallow all crawlers access to certain pages. User-agent: * Disallow: /cgi/ Disallow: /newsfeeds/ Disallow: /counter/ Disallow: /vwd_scripts/ Disallow: /Scripts/ Disallow: /images/