# WeddingCakes Hub — robots.txt # Allow search engines and AI crawlers User-agent: * Allow: / Disallow: /dashboard/ Disallow: /api/ Allow: /api/sitemap*.xml # AI crawlers — explicitly allowed per SPECIFICATIONS.md User-agent: Googlebot Allow: / User-agent: GPTBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: ClaudeBot Allow: / User-agent: ChatGPT-User Allow: / # LLM-optimized page — structured data for AI assistants # See https://weddingcakeshub.com/for-llms for machine-readable directory info Allow: /for-llms Sitemap: https://weddingcakeshub.com/api/sitemap.xml