Robots.txt Tester

Inspect how eduvillage.online controls crawler access, blocked paths, sitemap references and AI crawler rules.

Robots.txt Status

Robots.txt Status Present Score 100 /100 ยท Strong
Domain eduvillage.online
Last analyzed May 10, 2026

View Full Robots.txt

Robots.txt Content Preview

User-agent: *
Allow: /
Disallow: /admin/
Disallow: /accounts/
Disallow: /billing/
Disallow: /ielts/*/result/
Disallow: /ielts/share/
# Allow indexing of IELTS exam pages
Allow: /ielts/test/*/exam/
# Allow indexing of new tag URLs
Allow: /tag/*/

Disallow: /?page=
Disallow: /*?q=
Disallow: /*?search=
Disallow: /*?ajax=
Disallow: /*?type=
Disallow: /*?next=
Disallow: /*?subject=
Disallow: /*?class_name=
Disallow: /*?sort=
Disallow: /*?order=

Sitemap: https://eduvillage.online/sitemap.xml

User-agent Rules

User-agent(s) Allowed paths Disallowed paths
*
  • /
  • /ielts/test/*/exam/
  • /tag/*/
  • /admin/
  • /accounts/
  • /billing/
  • /ielts/*/result/
  • /ielts/share/
  • /?page=
  • /*?q=
  • /*?search=
  • /*?ajax=
  • /*?type=
  • /*?next=
  • /*?subject=
  • /*?class_name=
  • /*?sort=
  • /*?order=

Blocked and Allowed Paths

Blocked paths
  • /admin/
  • /accounts/
  • /billing/
  • /ielts/*/result/
  • /ielts/share/
  • /?page=
  • /*?q=
  • /*?search=
  • /*?ajax=
  • /*?type=
  • /*?next=
  • /*?subject=
  • /*?class_name=
  • /*?sort=
  • /*?order=
Allowed paths
  • /
  • /ielts/test/*/exam/
  • /tag/*/
Crawl-delay No Crawl-delay directive detected.

Sitemaps Detected

AI Crawler Policy

No explicit blocks were detected for common AI crawlers (GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended).

Recommendations

  • Document your AI crawler policy explicitly in robots.txt so future bots know how to treat your content.
  • Ensure important pages, CSS and JavaScript assets are crawlable so search engines can fully render your site.

Analyze this site with other tools

Want a website that actually generates leads?

Start a conversion-focused website project with a team that builds fast, SEO-optimized sites for real businesses.