Probador de robots.txt

Inspeccione cómo thailabhub.com controla el acceso del rastreador, las rutas bloqueadas, las referencias de mapas del sitio y las reglas del rastreador de IA.

Preview

Puntaje: 100

  • Review your AI crawler policy for GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot and Google-Extended to ensure it matches your content strategy.
  • Ensure important pages, CSS and JavaScript assets are crawlable so search engines can fully render your site.

Get your full report + exact fixes

See what’s hurting your SEO and how to fix it step by step.

  • Full breakdown
  • Actionable fixes
  • Prioritized next steps

No spam. One email with your report and next steps.

Estado de Robots.txt Presente Puntaje 100 /100 · Fuerte
Dominio thailabhub.com
URL del archivo robots.txt https://thailabhub.com/robots.txt
Último analizado junio 2, 2026

Ver Robots.txt completo

Abrir robots.txt en una nueva pestaña

Descargar robots.txt

Vista previa del contenido de Robots.txt

User-Agent: *
Allow: /
Disallow: /api/
Disallow: /th/admin/
Disallow: /th/dashboard/
Disallow: /th/factory/
Disallow: /th/portal/
Disallow: /th/desktop/
Disallow: /th/payment/
Disallow: /th/rfq/
Disallow: /th/store/
Disallow: /en/admin/
Disallow: /en/dashboard/
Disallow: /en/factory/
Disallow: /en/portal/
Disallow: /en/desktop/
Disallow: /en/payment/
Disallow: /en/rfq/
Disallow: /en/store/

User-Agent: GPTBot
Allow: /
Disallow: /api/
Disallow: /th/admin/
Disallow: /th/dashboard/
Disallow: /th/factory/
Disallow: /th/portal/
Disallow: /th/desktop/
Disallow: /th/payment/
Disallow: /th/rfq/
Disallow: /th/store/
Disallow: /en/admin/
Disallow: /en/dashboard/
Disallow: /en/factory/
Disallow: /en/portal/
Disallow: /en/desktop/
Disallow: /en/payment/
Disallow: /en/rfq/
Disallow: /en/store/

User-Agent: ChatGPT-User
Allow: /
Disallow: /api/
Disallow: /th/admin/
Disallow: /th/dashboard/
Disallow: /th/factory/
Disallow: /th/portal/
Disallow: /th/desktop/
Disallow: /th/payment/
Disallow: /th/rfq/
Disallow: /th/store/
Disallow: /en/admin/
Disallow: /en/dashboard/
Disallow: /en/factory/
Disallow: /en/portal/
Disallow: /en/desktop/
Disallow: /en/payment/
Disallow: /en/rfq/
Disallow: /en/store/

User-Agent: OAI-SearchBot
Allow: /
Disallow: /api/
Disallow: /th/admin/
Disallow: /th/dashboard/
Disallow: /th/factory/
Disallow: /th/portal/
Disallow: /th/desktop/
Disallow: /th/payment/
Disallow: /th/rfq/
Disallow: /th/store/
Disallow: /en/admin/
Disallow: /en/dashboard/
Disallow: /en/factory/
Disallow: /en/portal/
Disallow: /en/desktop/
Disallow: /en/payment/
Disallow: /en/rfq/
Disallow: /en/store/

User-Agent: anthropic-ai
Allow: /
Disallow: /api/
Disallow: /th/admin/
Disallow: /th/dashboard/
Disallow: /th/factory/
Disallow: /th/portal/
Disallow: /th/desktop/
Disallow: /th/payment/
Disallow: /th/rfq/
Disallow: /th/store/
Disallow: /en/admin/
Disallow: /en/dashboard/
Disallow: /en/factory/
Disallow: /en/portal/
Disallow: /en/desktop/
Disallow: /en/payment/
Disallow: /en/rfq/
Disallow: /en/store/

User-Agent: ClaudeBot
Allow: /
Disallow: /api/
Disallow: /th/admin/
Disallow: /th/dashboard/
Disallow: /th/factory/
Disallow: /th/portal/
Disallow: /th/desktop/
Disallow: /th/payment/
Disallow: /th/rfq/
Disallow: /th/store/
Disallow: /en/admin/
Disallow: /en/dashboard/
Disallow: /en/factory/
Disallow: /en/portal/
Disallow: /en/desktop/
Disallow: /en/payment/
Disallow: /en/rfq/
Disallow: /en/store/

User-Agent: PerplexityBot
Allow: /
Disallow: /api/
Disallow: /th/admin/
Disallow: /th/dashboard/
Disallow: /th/factory/
Disallow: /th/portal/
Disallow: /th/desktop/
Disallow: /th/payment/
Disallow: /th/rfq/
Disallow: /th/store/
Disallow: /en/admin/
Disallow: /en/dashboard/
Disallow: /en/factory/
Disallow: /en/portal/
Disallow: /en/desktop/
Disallow: /en/payment/
Disallow: /en/rfq/
Disallow: /en/store/

User-Agent: CCBot
Allow: /
Disallow: /api/
Disallow: /th/admin/
Disallow: /th/dashboard/
Disallow: /th/factory/
Disallow: /th/portal/
Disallow: /th/desktop/
Disallow: /th/payment/
Disallow: /th/rfq/
Disallow: /th/store/
Disallow: /en/admin/
Disallow: /en/dashboard/
Disallow: /en/factory/
Disallow: /en/portal/
Disallow: /en/desktop/
Disallow: /en/payment/
Disallow: /en/rfq/
Disallow: /en/store/

User-Agent: Google-Extended
Allow: /
Disallow: /api/
Disallow: /th/admin/
Disallow: /th/dashboard/
Disallow: /th/factory/
Disallow: /th/portal/
Disallow: /th/desktop/
Disallow: /th/payment/
Disallow: /th/rfq/
Disallow: /th/store/
Disallow: /en/admin/
Disallow: /en/dashboard/
Disallow: /en/factory/
Disallow: /en/portal/
Disallow: /en/desktop/
Disallow: /en/payment/
Disallow: /en/rfq/
Disallow: /en/store/

User-Agent: FacebookBot
Allow: /
Disallow: /api/
Disallow: /th/admin/
Disallow: /th/dashboard/
Disallow: /th/factory/
Disallow: /th/portal/
Disallow: /th/desktop/
Disallow: /th/payment/
Disallow: /th/rfq/
Disallow: /th/store/
Disallow: /en/admin/
Disallow: /en/dashboard/
Disallow: /en/factory/
Disallow: /en/portal/
Disallow: /en/desktop/
Disallow: /en/payment/
Disallow: /en/rfq/
Disallow: /en/store/

User-Agent: Meta-ExternalAgent
Allow: /
Disallow: /api/
Disallow: /th/admin/
Disallow: /th/dashboard/
Disallow: /th/factory/
Disallow: /th/portal/
Disallow: /th/desktop/
Disallow: /th/payment/
Disallow: /th/rfq/
Disallow: /th/store/
Disallow: /en/admin/
Disallow: /en/dashboard/
Disallow: /en/factory/
Disallow: /en/portal/
Disallow: /en/desktop/
Disallow: /en/payment/
Disallow: /en/rfq/
Disallow: /en/store/

User-Agent: Applebot-Extended
Allow: /
Disallow: /api/
Disallow: /th/admin/
Disallow: /th/dashboard/
Disallow: /th/factory/
Disallow: /th/portal/
Disallow: /th/desktop/
Disallow: /th/payment/
Disallow: /th/rfq/
Disallow: /th/store/
Disallow: /en/admin/
Disallow: /en/dashboard/
Disallow: /en/factory/
Disallow: /en/portal/
Disallow: /en/desktop/
Disallow: /en/payment/
Disallow: /en/rfq/
Disallow: /en/store/

Sitemap: https://thailabhub.com/sitemap.xml
Sitemap: https://thailabhub.com/llms.txt

Reglas de agente de usuario

Agentes de usuario Caminos permitidos Caminos no permitidos
*
  • /
  • /api/
  • /th/admin/
  • /th/dashboard/
  • /th/factory/
  • /th/portal/
  • /th/desktop/
  • /th/payment/
  • /th/rfq/
  • /th/store/
  • /en/admin/
  • /en/dashboard/
  • /en/factory/
  • /en/portal/
  • /en/desktop/
  • /en/payment/
  • /en/rfq/
  • /en/store/
gptbot
  • /
  • /api/
  • /th/admin/
  • /th/dashboard/
  • /th/factory/
  • /th/portal/
  • /th/desktop/
  • /th/payment/
  • /th/rfq/
  • /th/store/
  • /en/admin/
  • /en/dashboard/
  • /en/factory/
  • /en/portal/
  • /en/desktop/
  • /en/payment/
  • /en/rfq/
  • /en/store/
chatgpt-user
  • /
  • /api/
  • /th/admin/
  • /th/dashboard/
  • /th/factory/
  • /th/portal/
  • /th/desktop/
  • /th/payment/
  • /th/rfq/
  • /th/store/
  • /en/admin/
  • /en/dashboard/
  • /en/factory/
  • /en/portal/
  • /en/desktop/
  • /en/payment/
  • /en/rfq/
  • /en/store/
oai-searchbot
  • /
  • /api/
  • /th/admin/
  • /th/dashboard/
  • /th/factory/
  • /th/portal/
  • /th/desktop/
  • /th/payment/
  • /th/rfq/
  • /th/store/
  • /en/admin/
  • /en/dashboard/
  • /en/factory/
  • /en/portal/
  • /en/desktop/
  • /en/payment/
  • /en/rfq/
  • /en/store/
anthropic-ai
  • /
  • /api/
  • /th/admin/
  • /th/dashboard/
  • /th/factory/
  • /th/portal/
  • /th/desktop/
  • /th/payment/
  • /th/rfq/
  • /th/store/
  • /en/admin/
  • /en/dashboard/
  • /en/factory/
  • /en/portal/
  • /en/desktop/
  • /en/payment/
  • /en/rfq/
  • /en/store/
claudebot
  • /
  • /api/
  • /th/admin/
  • /th/dashboard/
  • /th/factory/
  • /th/portal/
  • /th/desktop/
  • /th/payment/
  • /th/rfq/
  • /th/store/
  • /en/admin/
  • /en/dashboard/
  • /en/factory/
  • /en/portal/
  • /en/desktop/
  • /en/payment/
  • /en/rfq/
  • /en/store/
perplexitybot
  • /
  • /api/
  • /th/admin/
  • /th/dashboard/
  • /th/factory/
  • /th/portal/
  • /th/desktop/
  • /th/payment/
  • /th/rfq/
  • /th/store/
  • /en/admin/
  • /en/dashboard/
  • /en/factory/
  • /en/portal/
  • /en/desktop/
  • /en/payment/
  • /en/rfq/
  • /en/store/
ccbot
  • /
  • /api/
  • /th/admin/
  • /th/dashboard/
  • /th/factory/
  • /th/portal/
  • /th/desktop/
  • /th/payment/
  • /th/rfq/
  • /th/store/
  • /en/admin/
  • /en/dashboard/
  • /en/factory/
  • /en/portal/
  • /en/desktop/
  • /en/payment/
  • /en/rfq/
  • /en/store/
google-extended
  • /
  • /api/
  • /th/admin/
  • /th/dashboard/
  • /th/factory/
  • /th/portal/
  • /th/desktop/
  • /th/payment/
  • /th/rfq/
  • /th/store/
  • /en/admin/
  • /en/dashboard/
  • /en/factory/
  • /en/portal/
  • /en/desktop/
  • /en/payment/
  • /en/rfq/
  • /en/store/
facebookbot
  • /
  • /api/
  • /th/admin/
  • /th/dashboard/
  • /th/factory/
  • /th/portal/
  • /th/desktop/
  • /th/payment/
  • /th/rfq/
  • /th/store/
  • /en/admin/
  • /en/dashboard/
  • /en/factory/
  • /en/portal/
  • /en/desktop/
  • /en/payment/
  • /en/rfq/
  • /en/store/
meta-externalagent
  • /
  • /api/
  • /th/admin/
  • /th/dashboard/
  • /th/factory/
  • /th/portal/
  • /th/desktop/
  • /th/payment/
  • /th/rfq/
  • /th/store/
  • /en/admin/
  • /en/dashboard/
  • /en/factory/
  • /en/portal/
  • /en/desktop/
  • /en/payment/
  • /en/rfq/
  • /en/store/
applebot-extended
  • /
  • /api/
  • /th/admin/
  • /th/dashboard/
  • /th/factory/
  • /th/portal/
  • /th/desktop/
  • /th/payment/
  • /th/rfq/
  • /th/store/
  • /en/admin/
  • /en/dashboard/
  • /en/factory/
  • /en/portal/
  • /en/desktop/
  • /en/payment/
  • /en/rfq/
  • /en/store/

Rutas bloqueadas y permitidas

Caminos bloqueados
  • /api/
  • /th/admin/
  • /th/dashboard/
  • /th/factory/
  • /th/portal/
  • /th/desktop/
  • /th/payment/
  • /th/rfq/
  • /th/store/
  • /en/admin/
  • /en/dashboard/
  • /en/factory/
  • /en/portal/
  • /en/desktop/
  • /en/payment/
  • /en/rfq/
  • /en/store/
Caminos permitidos
  • /
retraso de rastreo No se detectó ninguna directiva de retraso de rastreo.

Mapas del sitio detectados

Política de rastreadores de IA

Al menos un rastreador de IA (como GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot o Google-Extended) parece estar bloqueado por robots.txt.

Recomendaciones

  • Review your AI crawler policy for GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot and Google-Extended to ensure it matches your content strategy.
  • Ensure important pages, CSS and JavaScript assets are crawlable so search engines can fully render your site.

Analiza este sitio con otras herramientas

¿Quiere un sitio web que realmente genere clientes potenciales?

Inicie un proyecto de sitio web centrado en la conversión con un equipo que cree sitios rápidos y optimizados para SEO para empresas reales.

Iniciar proyecto