# Disallow all crawlers access to certain pages.

User-agent: *
Disallow: /x/
Disallow: /f/

User-agent: Xombot
Disallow: /