# Block all crawlers for specific paths User-agent: * Disallow: /account Disallow: /auth Disallow: /discourse Disallow: /events/notes # Allow all crawlers User-agent: * Allow: /