# Search engines and AI assistants are welcome to read, index and cite the public site: the
# homepage, How it works, the MCP guide, pricing, FAQ, blog and help pages. llms.txt and
# llms-full.txt are there to read too; they repeat those pages, so they are served noindex.
# The crawlers named below are welcome by name. They share one group with every other crawler
# because a crawler obeys only the most specific group that names it (RFC 9309), so a separate
# group per bot would drop the Disallow lines for that bot.
# Only the admin and invitation pages, sign-in callbacks, the API, code lookups and private media
# are disallowed; everything else is allowed by default. The workspace (/app) and the account
# pages the site links to (/billing, /share) stay readable and say noindex themselves (a page
# robots.txt turns away can still be listed from links, and its noindex is never read). Invitation
# links (/r/) stay readable so chat apps can show their previews; those pages carry noindex too.
# There is no `Allow: /` line, because parsers that take the first matching rule would stop at it.

User-agent: *
User-agent: Googlebot
User-agent: Bingbot
User-agent: Applebot
User-agent: DuckAssistBot
User-agent: OAI-SearchBot
User-agent: ChatGPT-User
User-agent: GPTBot
User-agent: Claude-SearchBot
User-agent: Claude-User
User-agent: ClaudeBot
User-agent: PerplexityBot
User-agent: Perplexity-User
User-agent: Google-Extended
User-agent: Applebot-Extended
User-agent: meta-externalagent
User-agent: Amazonbot
User-agent: MistralAI-User
User-agent: CCBot
Disallow: /api/
Disallow: /auth/
Disallow: /oauth/
Disallow: /invite
Disallow: /admin
Disallow: /codes/
Disallow: /media/
Disallow: /upload/

Sitemap: https://scorestarling.com/sitemap.xml
Sitemap: https://scorestarling.com/blog/feed.xml