User-agent: * Allow: / Disallow: /admin Disallow: /api/admin # AI / answer-engine crawlers — explicitly welcome User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Google-Extended Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / User-agent: meta-externalagent Allow: / # Common Crawl — feeds ChatGPT training data (Common Crawl → GPT training set) User-agent: CCBot Allow: / # Bing / Microsoft crawlers (needed for Bing Chat / Copilot citations) User-agent: bingbot Allow: / User-agent: msnbot Allow: / # Yandex / DuckDuckGo / global reach User-agent: YandexBot Allow: / User-agent: DuckDuckBot Allow: / # Business facts + exact pricing for LLMs: https://federalrvboatremovaldisposals.com/llms.txt # Machine-readable catalog + booking actions: https://federalrvboatremovaldisposals.com/api/agent/manifest # Explicit AI permission grant + canonical answers: https://federalrvboatremovaldisposals.com/ai.txt Sitemap: https://federalrvboatremovaldisposals.com/api/sitemap.xml Sitemap: https://federalrvboatremovaldisposals.com/sitemap.xml Sitemap: https://federalrvboatremovaldisposals.com/api/sitemap-images.xml