Robots.txt Tester

Inspect how faridabadbuilderfloor.wordpress.com controls crawler access, blocked paths, sitemap references and AI crawler rules.

Preview

Score: 100

  • Document your AI crawler policy explicitly in robots.txt so future bots know how to treat your content.
  • Ensure important pages, CSS and JavaScript assets are crawlable so search engines can fully render your site.

Get your full report + exact fixes

See what’s hurting your SEO and how to fix it step by step.

  • Full breakdown
  • Actionable fixes
  • Prioritized next steps

No spam. One email with your report and next steps.

Robots.txt Status

Robots.txt Status Present Score 100 /100 · Strong
Domain faridabadbuilderfloor.wordpress.com
Last analyzed June 6, 2026

View Full Robots.txt

Robots.txt Content Preview

# If you are regularly crawling WordPress.com sites, please use our firehose to receive real-time push updates instead.
# Please see https://developer.wordpress.com/docs/firehose/ for more details.

Sitemap: https://faridabadbuilderfloor.wordpress.com/sitemap.xml
Sitemap: https://faridabadbuilderfloor.wordpress.com/news-sitemap.xml

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /wp-login.php
Disallow: /wp-signup.php
Disallow: /press-this.php
Disallow: /remote-login.php
Disallow: /activate/
Disallow: /cgi-bin/
Disallow: /mshots/v1/
Disallow: /next/
Disallow: /public.api/

# This file was generated on Mon, 01 Jun 2026 13:09:58 +0000

User-agent Rules

User-agent(s) Allowed paths Disallowed paths
*
  • /wp-admin/admin-ajax.php
  • /wp-admin/
  • /wp-login.php
  • /wp-signup.php
  • /press-this.php
  • /remote-login.php
  • /activate/
  • /cgi-bin/
  • /mshots/v1/
  • /next/
  • /public.api/

Blocked and Allowed Paths

Blocked paths
  • /wp-admin/
  • /wp-login.php
  • /wp-signup.php
  • /press-this.php
  • /remote-login.php
  • /activate/
  • /cgi-bin/
  • /mshots/v1/
  • /next/
  • /public.api/
Allowed paths
  • /wp-admin/admin-ajax.php
Crawl-delay No Crawl-delay directive detected.

Sitemaps Detected

AI Crawler Policy

No explicit blocks were detected for common AI crawlers (GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended).

Recommendations

  • Document your AI crawler policy explicitly in robots.txt so future bots know how to treat your content.
  • Ensure important pages, CSS and JavaScript assets are crawlable so search engines can fully render your site.

Analyze this site with other tools

Want a website that actually generates leads?

Start a conversion-focused website project with a team that builds fast, SEO-optimized sites for real businesses.