# Vanagon Dictionary robots policy # Public-safe Dictionary pages, docs, feeds, OpenAPI, llms files, and read-only API/MCP introspection are crawlable by default. # Agent policy: https://dictionary.vanagon.com/.well-known/agent-policy.json # AI policy: https://dictionary.vanagon.com/.well-known/ai-policy.json # Trust policy: https://dictionary.vanagon.com/.well-known/trust.json # LLMs: https://dictionary.vanagon.com/llms.txt # Humans: https://dictionary.vanagon.com/humans.txt User-agent: GPTBot Allow: / Disallow: /api/v1/recovery Disallow: /admin Disallow: /api/admin Disallow: /api/private Disallow: /api/protected Disallow: /api/telemetry/404 Disallow: /api/webhooks Disallow: /api/definitions/*/report Disallow: /api/moderation Disallow: /api/v1/ingest Disallow: /api/v1/import Disallow: /api/v1/moderation Disallow: /api/v1/rankings/recalculate Disallow: /api/v1/definitions/*/history Disallow: /api/v1/definitions/*/approve Disallow: /api/v1/definitions/*/flag Disallow: /api/v1/definitions/*/reject Disallow: /api/v1/removal-requests Disallow: /api/v1/removal-requests/*/approve Disallow: /api/v1/removal-requests/*/reject Disallow: /api/v1/reports Disallow: /api/v1/audit Disallow: /api/v1/workflows User-agent: ChatGPT-User Allow: / Disallow: /api/v1/recovery Disallow: /admin Disallow: /api/admin Disallow: /api/private Disallow: /api/protected Disallow: /api/telemetry/404 Disallow: /api/webhooks Disallow: /api/definitions/*/report Disallow: /api/moderation Disallow: /api/v1/ingest Disallow: /api/v1/import Disallow: /api/v1/moderation Disallow: /api/v1/rankings/recalculate Disallow: /api/v1/definitions/*/history Disallow: /api/v1/definitions/*/approve Disallow: /api/v1/definitions/*/flag Disallow: /api/v1/definitions/*/reject Disallow: /api/v1/removal-requests Disallow: /api/v1/removal-requests/*/approve Disallow: /api/v1/removal-requests/*/reject Disallow: /api/v1/reports Disallow: /api/v1/audit Disallow: /api/v1/workflows User-agent: OAI-SearchBot Allow: / Disallow: /api/v1/recovery Disallow: /admin Disallow: /api/admin Disallow: /api/private Disallow: /api/protected Disallow: /api/telemetry/404 Disallow: /api/webhooks Disallow: /api/definitions/*/report Disallow: /api/moderation Disallow: /api/v1/ingest Disallow: /api/v1/import Disallow: /api/v1/moderation Disallow: /api/v1/rankings/recalculate Disallow: /api/v1/definitions/*/history Disallow: /api/v1/definitions/*/approve Disallow: /api/v1/definitions/*/flag Disallow: /api/v1/definitions/*/reject Disallow: /api/v1/removal-requests Disallow: /api/v1/removal-requests/*/approve Disallow: /api/v1/removal-requests/*/reject Disallow: /api/v1/reports Disallow: /api/v1/audit Disallow: /api/v1/workflows User-agent: ClaudeBot Allow: / Disallow: /api/v1/recovery Disallow: /admin Disallow: /api/admin Disallow: /api/private Disallow: /api/protected Disallow: /api/telemetry/404 Disallow: /api/webhooks Disallow: /api/definitions/*/report Disallow: /api/moderation Disallow: /api/v1/ingest Disallow: /api/v1/import Disallow: /api/v1/moderation Disallow: /api/v1/rankings/recalculate Disallow: /api/v1/definitions/*/history Disallow: /api/v1/definitions/*/approve Disallow: /api/v1/definitions/*/flag Disallow: /api/v1/definitions/*/reject Disallow: /api/v1/removal-requests Disallow: /api/v1/removal-requests/*/approve Disallow: /api/v1/removal-requests/*/reject Disallow: /api/v1/reports Disallow: /api/v1/audit Disallow: /api/v1/workflows User-agent: Claude-User Allow: / Disallow: /api/v1/recovery Disallow: /admin Disallow: /api/admin Disallow: /api/private Disallow: /api/protected Disallow: /api/telemetry/404 Disallow: /api/webhooks Disallow: /api/definitions/*/report Disallow: /api/moderation Disallow: /api/v1/ingest Disallow: /api/v1/import Disallow: /api/v1/moderation Disallow: /api/v1/rankings/recalculate Disallow: /api/v1/definitions/*/history Disallow: /api/v1/definitions/*/approve Disallow: /api/v1/definitions/*/flag Disallow: /api/v1/definitions/*/reject Disallow: /api/v1/removal-requests Disallow: /api/v1/removal-requests/*/approve Disallow: /api/v1/removal-requests/*/reject Disallow: /api/v1/reports Disallow: /api/v1/audit Disallow: /api/v1/workflows User-agent: Claude-SearchBot Allow: / Disallow: /api/v1/recovery Disallow: /admin Disallow: /api/admin Disallow: /api/private Disallow: /api/protected Disallow: /api/telemetry/404 Disallow: /api/webhooks Disallow: /api/definitions/*/report Disallow: /api/moderation Disallow: /api/v1/ingest Disallow: /api/v1/import Disallow: /api/v1/moderation Disallow: /api/v1/rankings/recalculate Disallow: /api/v1/definitions/*/history Disallow: /api/v1/definitions/*/approve Disallow: /api/v1/definitions/*/flag Disallow: /api/v1/definitions/*/reject Disallow: /api/v1/removal-requests Disallow: /api/v1/removal-requests/*/approve Disallow: /api/v1/removal-requests/*/reject Disallow: /api/v1/reports Disallow: /api/v1/audit Disallow: /api/v1/workflows User-agent: PerplexityBot Allow: / Disallow: /api/v1/recovery Disallow: /admin Disallow: /api/admin Disallow: /api/private Disallow: /api/protected Disallow: /api/telemetry/404 Disallow: /api/webhooks Disallow: /api/definitions/*/report Disallow: /api/moderation Disallow: /api/v1/ingest Disallow: /api/v1/import Disallow: /api/v1/moderation Disallow: /api/v1/rankings/recalculate Disallow: /api/v1/definitions/*/history Disallow: /api/v1/definitions/*/approve Disallow: /api/v1/definitions/*/flag Disallow: /api/v1/definitions/*/reject Disallow: /api/v1/removal-requests Disallow: /api/v1/removal-requests/*/approve Disallow: /api/v1/removal-requests/*/reject Disallow: /api/v1/reports Disallow: /api/v1/audit Disallow: /api/v1/workflows User-agent: Perplexity-User Allow: / Disallow: /api/v1/recovery Disallow: /admin Disallow: /api/admin Disallow: /api/private Disallow: /api/protected Disallow: /api/telemetry/404 Disallow: /api/webhooks Disallow: /api/definitions/*/report Disallow: /api/moderation Disallow: /api/v1/ingest Disallow: /api/v1/import Disallow: /api/v1/moderation Disallow: /api/v1/rankings/recalculate Disallow: /api/v1/definitions/*/history Disallow: /api/v1/definitions/*/approve Disallow: /api/v1/definitions/*/flag Disallow: /api/v1/definitions/*/reject Disallow: /api/v1/removal-requests Disallow: /api/v1/removal-requests/*/approve Disallow: /api/v1/removal-requests/*/reject Disallow: /api/v1/reports Disallow: /api/v1/audit Disallow: /api/v1/workflows User-agent: Google-Extended Allow: / Disallow: /api/v1/recovery Disallow: /admin Disallow: /api/admin Disallow: /api/private Disallow: /api/protected Disallow: /api/telemetry/404 Disallow: /api/webhooks Disallow: /api/definitions/*/report Disallow: /api/moderation Disallow: /api/v1/ingest Disallow: /api/v1/import Disallow: /api/v1/moderation Disallow: /api/v1/rankings/recalculate Disallow: /api/v1/definitions/*/history Disallow: /api/v1/definitions/*/approve Disallow: /api/v1/definitions/*/flag Disallow: /api/v1/definitions/*/reject Disallow: /api/v1/removal-requests Disallow: /api/v1/removal-requests/*/approve Disallow: /api/v1/removal-requests/*/reject Disallow: /api/v1/reports Disallow: /api/v1/audit Disallow: /api/v1/workflows User-agent: CCBot Allow: / Disallow: /api/v1/recovery Disallow: /admin Disallow: /api/admin Disallow: /api/private Disallow: /api/protected Disallow: /api/telemetry/404 Disallow: /api/webhooks Disallow: /api/definitions/*/report Disallow: /api/moderation Disallow: /api/v1/ingest Disallow: /api/v1/import Disallow: /api/v1/moderation Disallow: /api/v1/rankings/recalculate Disallow: /api/v1/definitions/*/history Disallow: /api/v1/definitions/*/approve Disallow: /api/v1/definitions/*/flag Disallow: /api/v1/definitions/*/reject Disallow: /api/v1/removal-requests Disallow: /api/v1/removal-requests/*/approve Disallow: /api/v1/removal-requests/*/reject Disallow: /api/v1/reports Disallow: /api/v1/audit Disallow: /api/v1/workflows User-agent: * Allow: / Allow: /api/docs Allow: /api/health Allow: /api/v1/health Allow: /api/v1/terms Allow: /api/v1/search Allow: /api/v1/categories Allow: /api/v1/tags Allow: /api/v1/locales Allow: /api/v1/agent-policy Allow: /api/mcp Disallow: /api/v1/recovery Disallow: /admin Disallow: /api/admin Disallow: /api/private Disallow: /api/protected Disallow: /api/telemetry/404 Disallow: /api/webhooks Disallow: /api/definitions/*/report Disallow: /api/moderation Disallow: /api/v1/ingest Disallow: /api/v1/import Disallow: /api/v1/moderation Disallow: /api/v1/rankings/recalculate Disallow: /api/v1/definitions/*/history Disallow: /api/v1/definitions/*/approve Disallow: /api/v1/definitions/*/flag Disallow: /api/v1/definitions/*/reject Disallow: /api/v1/removal-requests Disallow: /api/v1/removal-requests/*/approve Disallow: /api/v1/removal-requests/*/reject Disallow: /api/v1/reports Disallow: /api/v1/audit Disallow: /api/v1/workflows Disallow: /api/*/admin Disallow: /api/*/private Disallow: /api/*/protected Disallow: /*?token= Disallow: /*?key= Disallow: /*?secret= Sitemap: https://dictionary.vanagon.com/sitemap-index.xml # Feed: https://dictionary.vanagon.com/rss.xml # Atom: https://dictionary.vanagon.com/feed.xml