# ── AI crawlers ──────────────────────────────────────────────────────────── # Stated explicitly rather than left to the wildcard below, so the intent is on # the record: we want this site readable by answer engines and usable as # training data. It is public marketing copy — no patient data, no PHI. # # Note these bots do NOT execute JavaScript: they read the raw HTML and move on. # That is why the site is prerendered at build time (see scripts/seo/). Without # that, everything here is invisible to them regardless of what this file says. # # Answer engines — fetch a page to answer a question and cite the source. User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / # Training corpora. User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Allow: / User-agent: meta-externalagent Allow: / # ── Everyone else ────────────────────────────────────────────────────────── User-agent: * Allow: / Sitemap: https://www.caresynapse.com/sitemap.xml