User-agent: * Allow: / # Public content — explicitly allowed for clarity Allow: /blog/ Allow: /scenarios/ Allow: /tools/ # Disallow authenticated/protected routes Disallow: /dashboard Disallow: /practice Disallow: /app Disallow: /analytics Disallow: /mock-exams Disallow: /mock-exam/ Disallow: /scenario/ # Disallow utility/internal routes Disallow: /api/ Disallow: /auth/ # Crawl-delay for rate limiting Crawl-delay: 1 # AI assistant / LLM crawlers — explicitly allowed so Plabster content # can be cited by ChatGPT, Claude, Gemini, and Perplexity answers User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-User Allow: / User-agent: Google-Extended Allow: / User-agent: PerplexityBot Allow: / User-agent: anthropic-ai Allow: / # Sitemap location Sitemap: https://www.plabster.com/sitemap.xml