Robots.txt Tester

Inspect how blogger.com controls crawler access, blocked paths, sitemap references and AI crawler rules.

Preview

Score: 84

  • robots.txt does not reference any sitemap URLs.
  • Important content paths appear blocked in robots.txt.

Get your full report + exact fixes

See what’s hurting your SEO and how to fix it step by step.

  • Full breakdown
  • Actionable fixes
  • Prioritized next steps

No spam. One email with your report and next steps.

Robots.txt Status

Robots.txt Status Present Score 84 /100 · Strong
Domain blogger.com
Last analyzed June 9, 2026

View Full Robots.txt

Robots.txt Content Preview

# robots.txt for https://www.blogger.com

User-agent: *
Disallow: /blog_this.pyra
Disallow: /blog-this.g
Disallow: /comment.g
Disallow: /comment-iframe.g
Disallow: /comment/delete/
Disallow: /comment/frame/
Disallow: /comment/fullpage/
Disallow: /create-blog.g
Disallow: /delete-comment.g
Disallow: /email-blog/
Disallow: /email-page/
Disallow: /email-post/
Disallow: /email-post.g
Disallow: /followers.g
Disallow: /followers/
Disallow: /post-edit.g
Disallow: /page-edit.g
Disallow: /blog/post/edit/
Disallow: /blog/page/edit/
Disallow: /rearrange
Disallow: /share-post.g

User-agent Rules

User-agent(s) Allowed paths Disallowed paths
* No explicit Allow rules.
  • /blog_this.pyra
  • /blog-this.g
  • /comment.g
  • /comment-iframe.g
  • /comment/delete/
  • /comment/frame/
  • /comment/fullpage/
  • /create-blog.g
  • /delete-comment.g
  • /email-blog/
  • /email-page/
  • /email-post/
  • /email-post.g
  • /followers.g
  • /followers/
  • /post-edit.g
  • /page-edit.g
  • /blog/post/edit/
  • /blog/page/edit/
  • /rearrange
  • /share-post.g

Blocked and Allowed Paths

Blocked paths
  • /blog_this.pyra
  • /blog-this.g
  • /comment.g
  • /comment-iframe.g
  • /comment/delete/
  • /comment/frame/
  • /comment/fullpage/
  • /create-blog.g
  • /delete-comment.g
  • /email-blog/
  • /email-page/
  • /email-post/
  • /email-post.g
  • /followers.g
  • /followers/
  • /post-edit.g
  • /page-edit.g
  • /blog/post/edit/
  • /blog/page/edit/
  • /rearrange
  • /share-post.g
Allowed paths No explicit Allow paths detected.
Crawl-delay No Crawl-delay directive detected.

Sitemaps Detected

No Sitemap directives found in robots.txt.

AI Crawler Policy

No explicit blocks were detected for common AI crawlers (GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended).

Issues Found

  • robots.txt does not reference any sitemap URLs.
  • Important content paths appear blocked in robots.txt.

Recommendations

  • Add a Sitemap directive in robots.txt pointing to your primary XML sitemap.
  • Document your AI crawler policy explicitly in robots.txt so future bots know how to treat your content.
  • Consider adding explicit Allow rules for important sections to clarify crawling intent for complex setups.
  • Ensure important pages, CSS and JavaScript assets are crawlable so search engines can fully render your site.

Analyze this site with other tools

Want a website that actually generates leads?

Start a conversion-focused website project with a team that builds fast, SEO-optimized sites for real businesses.