# Small robots.txt # More information about this file can be found at # http://www.robotstxt.org/ # Paths (clean URLs) User-agent: * Crawl-Delay: 10 Disallow: /bass Disallow: /bob # Paths (no clean URLs) User-agent: * Crawl-Delay: 10 Disallow: /?q=bass Disallow: /?q=bob