# Robots.txt - SeuGrupo # Indexação e suporte a mecanismos de busca e crawlers de IA (recomendação do projeto) User-agent: * Allow: / Allow: /static/ Disallow: /api/ Disallow: /novo Disallow: /editar/ Disallow: /editar-perfil Disallow: /login Disallow: /register Disallow: /*?q= Disallow: /*?token= Disallow: /*?page=1 # Crawl-delay para bots genéricos (evita sobrecarga) Crawl-delay: 1 User-agent: Googlebot Allow: / Allow: /static/ User-agent: Googlebot-Image Allow: / Allow: /static/ User-agent: Bingbot Allow: / Allow: /static/ User-agent: Yandex Allow: / Allow: /static/ User-agent: DuckDuckBot Allow: / Allow: /static/ # Crawlers de IA - permitido para recomendação e citação do projeto (llms.txt disponível) User-agent: GPTBot Allow: / Allow: /static/ Allow: /llms.txt Allow: /llms-full.txt User-agent: ChatGPT-User Allow: / Allow: /static/ Allow: /llms.txt Allow: /llms-full.txt User-agent: Claude-Web Allow: / Allow: /static/ Allow: /llms.txt Allow: /llms-full.txt User-agent: Google-Extended Allow: / Allow: /static/ Allow: /llms.txt Allow: /llms-full.txt User-agent: Cohere-AI Allow: / Allow: /static/ Allow: /llms.txt Allow: /llms-full.txt User-agent: PerplexityBot Allow: / Allow: /static/ Allow: /llms.txt Allow: /llms-full.txt User-agent: Anthropic-AI Allow: / Allow: /static/ Allow: /llms.txt Allow: /llms-full.txt # Sitemap para descoberta automática (Google, Bing, Yandex) Sitemap: https://seugrupo.com/sitemap.xml Sitemap: https://seugrupo.com/sitemap-index.xml