# www.robotstxt.org/ # http://code.google.com/web/controlcrawlindex/ User-agent: * Disallow: /contact Disallow: /events/add Disallow: /legal Disallow: /terms Disallow: /privacy Disallow: /mb Disallow: /mapapp Disallow: /_status Crawl-delay: 2