Robots.txt Tester

Inspect how hoisach.com controls crawler access, blocked paths, sitemap references and AI crawler rules.

Preview

Score: 100

  • Document your AI crawler policy explicitly in robots.txt so future bots know how to treat your content.
  • Ensure important pages, CSS and JavaScript assets are crawlable so search engines can fully render your site.

Get your full report + exact fixes

See what’s hurting your SEO and how to fix it step by step.

  • Full breakdown
  • Actionable fixes
  • Prioritized next steps

No spam. One email with your report and next steps.

Robots.txt Status

Robots.txt Status Present Score 100 /100 · Strong
Domain hoisach.com
Last analyzed June 15, 2026

View Full Robots.txt

Robots.txt Content Preview

# robots.txt cho Hội Sách (WordPress)
# Mục tiêu: tối đa hóa crawl HTML hợp lệ.

User-agent: *
Allow: /
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /*?s=*
Disallow: /*?p=*
Disallow: /*hoisach_render_webstory=
Disallow: /page/

# AI crawlers
User-agent: GPTBot
Allow: /

User-agent: ChatGPT-User
Allow: /

User-agent: Anthropic-ai
Allow: /

User-agent: Claude-Web
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: Google-Extended
Allow: /

User-agent: cohere-ai
Allow: /

# Search engines
User-agent: Googlebot
Allow: /

User-agent: Bingbot
Allow: /

Sitemap: https://hoisach.com/sitemap.xml
Sitemap: https://hoisach.com/sitemap-webstories.xml

User-agent Rules

User-agent(s) Allowed paths Disallowed paths
*
  • /
  • /wp-admin/admin-ajax.php
  • /wp-admin/
  • /*?s=*
  • /*?p=*
  • /*hoisach_render_webstory=
  • /page/
gptbot
  • /
No explicit Disallow rules.
chatgpt-user
  • /
No explicit Disallow rules.
anthropic-ai
  • /
No explicit Disallow rules.
claude-web
  • /
No explicit Disallow rules.
perplexitybot
  • /
No explicit Disallow rules.
google-extended
  • /
No explicit Disallow rules.
cohere-ai
  • /
No explicit Disallow rules.
googlebot
  • /
No explicit Disallow rules.
bingbot
  • /
No explicit Disallow rules.

Blocked and Allowed Paths

Blocked paths
  • /wp-admin/
  • /*?s=*
  • /*?p=*
  • /*hoisach_render_webstory=
  • /page/
Allowed paths
  • /
  • /wp-admin/admin-ajax.php
Crawl-delay No Crawl-delay directive detected.

Sitemaps Detected

AI Crawler Policy

No explicit blocks were detected for common AI crawlers (GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended).

Recommendations

  • Document your AI crawler policy explicitly in robots.txt so future bots know how to treat your content.
  • Ensure important pages, CSS and JavaScript assets are crawlable so search engines can fully render your site.

Analyze this site with other tools

Want a website that actually generates leads?

Start a conversion-focused website project with a team that builds fast, SEO-optimized sites for real businesses.