# RedBison — robots.txt # Auto-generated by scripts/generate-robots.ts from the router. # Do not edit by hand — changes will be overwritten on the next build. # We welcome AI answer engines. All tools are free, ad-free, and browser-based. User-agent: Googlebot Allow: / Disallow: /lovable Disallow: /not-found User-agent: Bingbot Allow: / Disallow: /lovable Disallow: /not-found User-agent: Twitterbot Allow: / Disallow: /lovable Disallow: /not-found User-agent: facebookexternalhit Allow: / Disallow: /lovable Disallow: /not-found User-agent: GPTBot Allow: / Disallow: /lovable Disallow: /not-found User-agent: OAI-SearchBot Allow: / Disallow: /lovable Disallow: /not-found User-agent: ChatGPT-User Allow: / Disallow: /lovable Disallow: /not-found User-agent: ClaudeBot Allow: / Disallow: /lovable Disallow: /not-found User-agent: Claude-SearchBot Allow: / Disallow: /lovable Disallow: /not-found User-agent: Claude-User Allow: / Disallow: /lovable Disallow: /not-found User-agent: PerplexityBot Allow: / Disallow: /lovable Disallow: /not-found User-agent: Perplexity-User Allow: / Disallow: /lovable Disallow: /not-found User-agent: Google-Extended Allow: / Disallow: /lovable Disallow: /not-found User-agent: Google-CloudVertexBot Allow: / Disallow: /lovable Disallow: /not-found User-agent: Google-Agent Allow: / Disallow: /lovable Disallow: /not-found User-agent: Google-GeminiNotebook Allow: / Disallow: /lovable Disallow: /not-found User-agent: Applebot-Extended Allow: / Disallow: /lovable Disallow: /not-found User-agent: CCBot Allow: / Disallow: /lovable Disallow: /not-found User-agent: Meta-ExternalAgent Allow: / Disallow: /lovable Disallow: /not-found User-agent: meta-webindexer Allow: / Disallow: /lovable Disallow: /not-found User-agent: Meta-ExternalFetcher Allow: / Disallow: /lovable Disallow: /not-found User-agent: Amazonbot Allow: / Disallow: /lovable Disallow: /not-found User-agent: Amzn-SearchBot Allow: / Disallow: /lovable Disallow: /not-found User-agent: Amzn-User Allow: / Disallow: /lovable Disallow: /not-found User-agent: DuckAssistBot Allow: / Disallow: /lovable Disallow: /not-found User-agent: MistralAI-Training Allow: / Disallow: /lovable Disallow: /not-found User-agent: MistralAI-Index Allow: / Disallow: /lovable Disallow: /not-found User-agent: MistralAI-User Allow: / Disallow: /lovable Disallow: /not-found User-agent: YouBot Allow: / Disallow: /lovable Disallow: /not-found # --- Default --- User-agent: * Allow: / Disallow: /lovable Disallow: /not-found Sitemap: https://redbison.dev/sitemap.xml # LLM/AI catalog (llmstxt.org format) # https://redbison.dev/llms.txt # https://redbison.dev/llms-full.txt # https://redbison.dev/ai-tools.json # Crawl Delay (be respectful) Crawl-delay: 1