Robots.txt Tester

Inspect how compactusfrance.fr controls crawler access, blocked paths, sitemap references and AI crawler rules.

Preview

Score: 92

Blocking CSS or JS may prevent search engines from rendering pages correctly.

Get your full report + exact fixes

See what’s hurting your SEO and how to fix it step by step.

Full breakdown
Actionable fixes
Prioritized next steps

Robots.txt Status Present Score 92 /100 · Strong

Domain compactusfrance.fr

robots.txt URL https://compactusfrance.fr/robots.txt

Last analyzed May 22, 2026

View Full Robots.txt

Open robots.txt in a new tab

Download robots.txt

Robots.txt Content Preview

User-agent: *
Allow: /

# Allow important directories
Allow: /products/
Allow: /gallery/
Allow: /assets/*.css
Allow: /assets/*.js

# Block non-essential files for better crawl budget
Disallow: /assets/*.map
Disallow: /assets/temp/
Disallow: /*.log$
Disallow: /loading.html

# Allow legal pages
Allow: /mentions-legales.html
Allow: /politique-confidentialite.html

# Sitemap location (primary)
Sitemap: https://compactusfrance.fr/sitemap.xml

# Crawl-delay for polite crawling
Crawl-delay: 1

# Special rules for major search engines
User-agent: Googlebot
Allow: /
Crawl-delay: 0

User-agent: Bingbot  
Allow: /
Crawl-delay: 1

User-agent: facebookexternalhit
Allow: /

User-agent: Twitterbot
Allow: /

User-agent: LinkedInBot
Allow: /

# Crawl-delay for respectful crawling
Crawl-delay: 1

User-agent Rules

User-agent(s)	Allowed paths	Disallowed paths
*	/ /products/ /gallery/ /assets/.css /assets/.js /mentions-legales.html /politique-confidentialite.html	/assets/.map /assets/temp/ /.log$ /loading.html
googlebot	/	No explicit Disallow rules.
bingbot	/	No explicit Disallow rules.
facebookexternalhit	/	No explicit Disallow rules.
twitterbot	/	No explicit Disallow rules.
linkedinbot	/	No explicit Disallow rules.

Blocked and Allowed Paths

Blocked paths	/assets/.map /assets/temp/ /.log$ /loading.html
Allowed paths	/ /products/ /gallery/ /assets/.css /assets/.js /mentions-legales.html /politique-confidentialite.html
Crawl-delay	1.0 seconds

Sitemaps Detected

https://compactusfrance.fr/sitemap.xml

AI Crawler Policy

No explicit blocks were detected for common AI crawlers (GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended).

Issues Found

Blocking CSS or JS may prevent search engines from rendering pages correctly.

Recommendations

Document your AI crawler policy explicitly in robots.txt so future bots know how to treat your content.
Ensure important pages, CSS and JavaScript assets are crawlable so search engines can fully render your site.