# Deny access to all web spiders User-agent: * Disallow: /