# Health Data Export - Robots.txt User-agent: * Allow: / Disallow: /private/ Disallow: /admin/ # Sitemap Location (must be absolute URL) Sitemap: https://www.healthdataexport.com/sitemap.xml # Crawl Delay Crawl-delay: 1 # User-agent specific rules User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Claude-Web Allow: / User-agent: anthropic-ai Allow: /