# LangLucid robots.txt — see Terms of Use for restrictions on scraping and AI training. User-agent: * Allow: / Disallow: /admin Disallow: /me Disallow: /analytics Disallow: /auth/ Disallow: /signin Disallow: /signup Disallow: /signout # Common AI / LLM crawlers — site content may not be used for model training without consent. User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: Google-Extended Disallow: / User-agent: CCBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: ClaudeBot Disallow: / User-agent: cohere-ai Disallow: / User-agent: Bytespider Disallow: / User-agent: Amazonbot Disallow: / User-agent: FacebookBot Disallow: / User-agent: Applebot-Extended Disallow: /