Robots.txt Tester

Inspect how oteli-tut.com controls crawler access, blocked paths, sitemap references and AI crawler rules.

Preview

Score: 100

  • Document your AI crawler policy explicitly in robots.txt so future bots know how to treat your content.
  • Ensure important pages, CSS and JavaScript assets are crawlable so search engines can fully render your site.

Get your full report + exact fixes

See what’s hurting your SEO and how to fix it step by step.

  • Full breakdown
  • Actionable fixes
  • Prioritized next steps

No spam. One email with your report and next steps.

Robots.txt Status

Robots.txt Status Present Score 100 /100 · Strong
Domain oteli-tut.com
Last analyzed June 9, 2026

View Full Robots.txt

Robots.txt Content Preview

Sitemap: https://oteli-tut.com/sitemap.xml
Sitemap: https://oteli-tut.com/sitemap_en.xml
Sitemap: https://oteli-tut.com/sitemap_ru.xml
Sitemap: https://oteli-tut.com/sitemap_uk.xml

User-agent: *
Allow: /ads/preferences/
Allow: /gtt/k
Allow: /gpt/
Allow: /pagead/show_ads.js
Allow: /pagead/js/adsbygoogle.js
Allow: /pagead/js/*show_ads_impl.js
Allow: /static/glade.js
Allow: /static/glade/
Allow: /tag/js/

Allow: /*.png
Allow: /*.jpg
Allow: /*.jpeg
Allow: /*.gif
Allow: /*.ico
Allow: /*.svg

Disallow: /administrator/
Disallow: /bin/
Disallow: /cache/
Disallow: /cli/
Disallow: /components/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /layouts/
Disallow: /libraries/
Disallow: /logs/
Disallow: /modules/
Disallow: /plugins/
Disallow: /tmp/

Disallow: /layouts/
Disallow: /component/
Disallow: /*?
Disallow: /*.php$

Allow: /components/*.js
Allow: /components/*.css
Allow: /modules/*.js
Allow: /modules/*.css
Allow: /plugins/*.js
Allow: /plugins/*.css
Allow: /templates/*.js
Allow: /templates/*.css
Allow: /media/*.js
Allow: /media/*.css

User-agent Rules

User-agent(s) Allowed paths Disallowed paths
*
  • /ads/preferences/
  • /gtt/k
  • /gpt/
  • /pagead/show_ads.js
  • /pagead/js/adsbygoogle.js
  • /pagead/js/*show_ads_impl.js
  • /static/glade.js
  • /static/glade/
  • /tag/js/
  • /*.png
  • /*.jpg
  • /*.jpeg
  • /*.gif
  • /*.ico
  • /*.svg
  • /components/*.js
  • /components/*.css
  • /modules/*.js
  • /modules/*.css
  • /plugins/*.js
  • /plugins/*.css
  • /templates/*.js
  • /templates/*.css
  • /media/*.js
  • /media/*.css
  • /administrator/
  • /bin/
  • /cache/
  • /cli/
  • /components/
  • /includes/
  • /installation/
  • /language/
  • /layouts/
  • /libraries/
  • /logs/
  • /modules/
  • /plugins/
  • /tmp/
  • /layouts/
  • /component/
  • /*?
  • /*.php$

Blocked and Allowed Paths

Blocked paths
  • /administrator/
  • /bin/
  • /cache/
  • /cli/
  • /components/
  • /includes/
  • /installation/
  • /language/
  • /layouts/
  • /libraries/
  • /logs/
  • /modules/
  • /plugins/
  • /tmp/
  • /component/
  • /*?
  • /*.php$
Allowed paths
  • /ads/preferences/
  • /gtt/k
  • /gpt/
  • /pagead/show_ads.js
  • /pagead/js/adsbygoogle.js
  • /pagead/js/*show_ads_impl.js
  • /static/glade.js
  • /static/glade/
  • /tag/js/
  • /*.png
  • /*.jpg
  • /*.jpeg
  • /*.gif
  • /*.ico
  • /*.svg
  • /components/*.js
  • /components/*.css
  • /modules/*.js
  • /modules/*.css
  • /plugins/*.js
  • /plugins/*.css
  • /templates/*.js
  • /templates/*.css
  • /media/*.js
  • /media/*.css
Crawl-delay No Crawl-delay directive detected.

Sitemaps Detected

AI Crawler Policy

No explicit blocks were detected for common AI crawlers (GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended).

Recommendations

  • Document your AI crawler policy explicitly in robots.txt so future bots know how to treat your content.
  • Ensure important pages, CSS and JavaScript assets are crawlable so search engines can fully render your site.

Analyze this site with other tools

Want a website that actually generates leads?

Start a conversion-focused website project with a team that builds fast, SEO-optimized sites for real businesses.