Probador de robots.txt

Inspeccione cómo rudrax.cloud controla el acceso del rastreador, las rutas bloqueadas, las referencias de mapas del sitio y las reglas del rastreador de IA.

Preview

Puntaje: 100

Document your AI crawler policy explicitly in robots.txt so future bots know how to treat your content.
Ensure important pages, CSS and JavaScript assets are crawlable so search engines can fully render your site.

Get your full report + exact fixes

See what’s hurting your SEO and how to fix it step by step.

Full breakdown
Actionable fixes
Prioritized next steps

Estado de Robots.txt Presente Puntaje 100 /100 · Fuerte

Dominio rudrax.cloud

URL del archivo robots.txt https://rudrax.cloud/robots.txt

Último analizado junio 2, 2026

Ver Robots.txt completo

Abrir robots.txt en una nueva pestaña

Descargar robots.txt

Vista previa del contenido de Robots.txt

# RudraX.cloud â Robots.txt
# Last updated: 2026-05-29
# SEO & GEO optimized â allowing all AI crawlers for maximum visibility

# Default rules for all crawlers
User-agent: *
Allow: /
Allow: /services
Allow: /services/ai-agents
Allow: /services/web-development
Allow: /services/app-development
Allow: /services/seo-geo-aeo
Allow: /services/hosting
Allow: /about
Allow: /solutions
Allow: /playground
Allow: /pricing
Allow: /ai-models
Allow: /autonomous-agents
Allow: /blog
Allow: /faq
Allow: /case-studies
Allow: /privacy
Allow: /terms
Allow: /contact
Allow: /dashboard
Allow: /resources
Allow: /stats
Allow: /roadmap
Allow: /comparison
Allow: /showcase
Allow: /changelog
Disallow: /*?*

# Crawl-delay
Crawl-delay: 1

# Google
User-agent: Googlebot
Allow: /
Allow: /dashboard

# Google-Extended (used by Vertex AI and Bard)
User-agent: Google-Extended
Allow: /

# Bing
User-agent: Bingbot
Allow: /
Allow: /dashboard

# Yahoo
User-agent: Slurp
Allow: /

# DuckDuckGo
User-agent: DuckDuckBot
Allow: /

# ChatGPT / OpenAI
User-agent: GPTBot
Allow: /
Allow: /blog$
Allow: /services$
Allow: /faq$
Allow: /case-studies$
Allow: /about$
Allow: /resources$
Allow: /stats$
Allow: /comparison$
Allow: /showcase$
Allow: /roadmap$
Allow: /changelog$

# ChatGPT-User (user-initiated ChatGPT browsing)
User-agent: ChatGPT-User
Allow: /

# Claude (Anthropic)
User-agent: ClaudeBot
Allow: /
Allow: /blog$
Allow: /faq$
Allow: /services$
Allow: /about$

# Claude-Web
User-agent: Claude-Web
Allow: /

# Perplexity AI
User-agent: PerplexityBot
Allow: /
Allow: /blog$
Allow: /faq$
Allow: /services$
Allow: /case-studies$
Allow: /about$
Allow: /resources$
Allow: /stats$
Allow: /comparison$
Allow: /showcase$
Allow: /roadmap$
Allow: /changelog$

# Common AI/LLM crawlers
User-agent: CCBot
Allow: /
Allow: /blog$
Allow: /faq$
Allow: /about$
Allow: /resources$
Allow: /stats$
Allow: /comparison$
Allow: /showcase$
Allow: /roadmap$
Allow: /changelog$

User-agent: FacebookBot
Allow: /

User-agent: Applebot
Allow: /

User-agent: Amazonbot
Allow: /

# Sitemap
Sitemap: https://rudrax.cloud/sitemap.xml

Reglas de agente de usuario

Agentes de usuario	Caminos permitidos	Caminos no permitidos
*	/ /services /services/ai-agents /services/web-development /services/app-development /services/seo-geo-aeo /services/hosting /about /solutions /playground /pricing /ai-models /autonomous-agents /blog /faq /case-studies /privacy /terms /contact /dashboard /resources /stats /roadmap /comparison /showcase /changelog	/?
googlebot	/ /dashboard	No hay reglas explícitas para no permitir.
google-extended	/	No hay reglas explícitas para no permitir.
bingbot	/ /dashboard	No hay reglas explícitas para no permitir.
slurp	/	No hay reglas explícitas para no permitir.
duckduckbot	/	No hay reglas explícitas para no permitir.
gptbot	/ /blog$ /services$ /faq$ /case-studies$ /about$ /resources$ /stats$ /comparison$ /showcase$ /roadmap$ /changelog$	No hay reglas explícitas para no permitir.
chatgpt-user	/	No hay reglas explícitas para no permitir.
claudebot	/ /blog$ /faq$ /services$ /about$	No hay reglas explícitas para no permitir.
claude-web	/	No hay reglas explícitas para no permitir.
perplexitybot	/ /blog$ /faq$ /services$ /case-studies$ /about$ /resources$ /stats$ /comparison$ /showcase$ /roadmap$ /changelog$	No hay reglas explícitas para no permitir.
ccbot	/ /blog$ /faq$ /about$ /resources$ /stats$ /comparison$ /showcase$ /roadmap$ /changelog$	No hay reglas explícitas para no permitir.
facebookbot	/	No hay reglas explícitas para no permitir.
applebot	/	No hay reglas explícitas para no permitir.
amazonbot	/	No hay reglas explícitas para no permitir.

Rutas bloqueadas y permitidas

Caminos bloqueados	/?
Caminos permitidos	/ /services /services/ai-agents /services/web-development /services/app-development /services/seo-geo-aeo /services/hosting /about /solutions /playground /pricing /ai-models /autonomous-agents /blog /faq /case-studies /privacy /terms /contact /dashboard /resources /stats /roadmap /comparison /showcase /changelog /blog$ /services$ /faq$ /case-studies$ /about$ /resources$ /stats$ /comparison$ /showcase$ /roadmap$ /changelog$
retraso de rastreo	1,0 segundos

Mapas del sitio detectados

https://rudrax.cloud/sitemap.xml

Política de rastreadores de IA

No se detectaron bloqueos explícitos para rastreadores de IA comunes (GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended).

Recomendaciones

Document your AI crawler policy explicitly in robots.txt so future bots know how to treat your content.
Ensure important pages, CSS and JavaScript assets are crawlable so search engines can fully render your site.