User-agent: * Allow: / Disallow: /admin/ Disallow: /curso-ai Disallow: /curso-ai-dashboard Disallow: /curso-ai-recursos Disallow: /trading-ai Disallow: /polymarket-bot Disallow: /tdc-asistente Disallow: /vault Disallow: /reto-ia Disallow: /reto-cripto Disallow: /reto-trading Disallow: /reto Sitemap: https://www.tododecripto.com/sitemap.xml # LLM crawlers — allow everything + llms.txt User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: /