# Skribra robots.txt # We welcome all crawlers including AI training bots # # Machine-readable entry points (robots.txt has no field for these, so they are # listed as comments — llms.txt carries the same links in a parseable form): # https://skribra.com/llms.txt site index for agents # https://skribra.com/llms-full.txt the whole site as one markdown file # https://skribra.com/openapi.json OpenAPI 3.1 for both Skribra APIs # https://skribra.com/api/v1 public REST API, no key required # https://skribra.com/developers developer hub # # Every page also answers `Accept: text/markdown`, or a `.md` suffix. User-Agent: * Allow: / User-Agent: GPTBot Allow: / User-Agent: ChatGPT-User Allow: / User-Agent: Google-Extended Allow: / User-Agent: Anthropic-AI Allow: / User-Agent: ClaudeBot Allow: / User-Agent: CCBot Allow: / User-Agent: Amazonbot Allow: / User-Agent: Applebot-Extended Allow: / User-Agent: Bytespider Allow: / User-Agent: meta-externalagent Allow: / User-Agent: PerplexityBot Allow: / User-Agent: Cohere-AI Allow: / Sitemap: https://skribra.com/sitemap.xml