# robots.txt for https://chiropracticmarkham.com # Generated 2026-09-28. Policy: open (search, AI search, AI assistants and AI training all allowed). # Blocks only private, duplicate or infinite URL spaces. Pages, CSS, JS and images stay open. # robots.txt is public and voluntary: it is not a security or privacy control. # 1. Every crawler: Google, Bing, Apple and any bot not named below User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / # 2. AI search, AI assistants and AI training: explicitly welcome, same rules as group 1. # Named groups do not inherit '*' rules, so the rules are repeated here. User-agent: OAI-SearchBot User-agent: Claude-SearchBot User-agent: PerplexityBot User-agent: Amzn-SearchBot User-agent: meta-webindexer User-agent: ChatGPT-User User-agent: Claude-User User-agent: Perplexity-User User-agent: meta-externalfetcher User-agent: MistralAI-User User-agent: Amzn-User User-agent: DuckAssistBot User-agent: GPTBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: meta-externalagent User-agent: Amazonbot User-agent: CCBot Allow: / # 3. Refused: aggressive crawlers with weak robots.txt compliance and no referral value User-agent: Bytespider Disallow: / # AI guidance file: https://chiropracticmarkham.com/llms.txt Sitemap: https://chiropracticmarkham.com/sitemap.xml