User-agent: * Allow: / Disallow: /api/ Disallow: /internal/ Disallow: /admin/ Disallow: /auth Sitemap: https://www.instantresponse.ai/sitemap.xml # AI search and answer engines: explicitly allowed (same private paths excluded). User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: PerplexityBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Bingbot Allow: / Disallow: /api/ Disallow: /internal/ Disallow: /admin/ Disallow: /auth