# BoxBuddy Robots.txt # Canonical: https://boxbuddy.tech # Updated: 2026-06-08 # ── Default: all crawlers ──────────────────────────────────────── User-agent: * # Public pages (allowed) Allow: / Allow: /app Allow: /faq Allow: /blog Allow: /blog/ Allow: /help Allow: /contact Allow: /privacy Allow: /login Allow: /terms Allow: /account-deletion Allow: /third-parties Allow: /glossary Allow: /press Allow: /llms.txt Allow: /llms-full.txt Allow: /moving/ Allow: /box-tracking/ Allow: /storage/ Allow: /features/ # Private / authenticated app routes Disallow: /dashboard Disallow: /home-v2 Disallow: /settings Disallow: /account Disallow: /onboarding Disallow: /scanner Disallow: /boxes Disallow: /rooms Disallow: /labels Disallow: /print Disallow: /capture Disallow: /auth Disallow: /signup Disallow: /forgot-password Disallow: /update-password # Internal / API Disallow: /api/ Disallow: /uploads/ Disallow: /scan/ Disallow: /q/ # NOTE: /assets/ is NOT disallowed — Googlebot needs JS/CSS to render pages. # ── AI / LLM Crawlers (welcomed on all public content) ────────── # We actively welcome AI assistants to index our public pages # so users can discover BoxBuddy through AI search results. # BoxBuddy provides llms.txt and llms-full.txt for structured LLM consumption. User-agent: GPTBot Allow: / Disallow: /dashboard Disallow: /api/ Disallow: /uploads/ Disallow: /scan/ Disallow: /q/ User-agent: ChatGPT-User Allow: / Disallow: /dashboard Disallow: /api/ Disallow: /uploads/ User-agent: Claude-Web Allow: / Disallow: /dashboard Disallow: /api/ Disallow: /uploads/ User-agent: ClaudeBot Allow: / Disallow: /dashboard Disallow: /api/ Disallow: /uploads/ User-agent: anthropic-ai Allow: / Disallow: /dashboard Disallow: /api/ Disallow: /uploads/ User-agent: Google-Extended Allow: / Disallow: /dashboard Disallow: /api/ Disallow: /uploads/ User-agent: PerplexityBot Allow: / Disallow: /dashboard Disallow: /api/ Disallow: /uploads/ User-agent: Bytespider Allow: / Disallow: /dashboard Disallow: /api/ Disallow: /uploads/ User-agent: cohere-ai Allow: / Disallow: /dashboard Disallow: /api/ Disallow: /uploads/ User-agent: Applebot-Extended Allow: / Disallow: /dashboard Disallow: /api/ Disallow: /uploads/ User-agent: meta-externalagent Allow: / Disallow: /dashboard Disallow: /api/ Disallow: /uploads/ User-agent: YouBot Allow: / Disallow: /dashboard Disallow: /api/ Disallow: /uploads/ User-agent: OAI-SearchBot Allow: / Disallow: /dashboard Disallow: /api/ Disallow: /uploads/ User-agent: Bingbot Allow: / Disallow: /dashboard Disallow: /api/ Disallow: /uploads/ # ── Sitemap ────────────────────────────────────────────────────── Sitemap: https://boxbuddy.tech/sitemap.xml Sitemap: https://boxbuddy.tech/feed.xml # ── LLM Discovery ─────────────────────────────────────────────── # See https://llmstxt.org for the llms.txt standard # LLMs can read /llms.txt for a structured summary of this site # LLMs can read /llms-full.txt for complete product documentation