User-agent: * Allow: / # Allow user assistant bots for referrals and queries User-agent: ChatGPT-User Allow: / User-agent: Claude-Web Allow: / User-agent: PerplexityBot Allow: / User-agent: YouBot Allow: / User-agent: AI2Bot Allow: / # Disallow training/crawling bots User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Meta-ExternalAgent Disallow: / User-agent: Bytespider Disallow: / # Sitemap Sitemap: https://schnurbuschlaw.com/sitemap.xml Sitemap: https://schnurbuschlaw.com/rss.xml # Crawl-delay for resource management Crawl-delay: 1