Robots.txt Tester

Inspect how courtneydailey.com controls crawler access, blocked paths, sitemap references and AI crawler rules.

Preview

Score: 100

Document your AI crawler policy explicitly in robots.txt so future bots know how to treat your content.
Ensure important pages, CSS and JavaScript assets are crawlable so search engines can fully render your site.

Get your full report + exact fixes

See what’s hurting your SEO and how to fix it step by step.

Full breakdown
Actionable fixes
Prioritized next steps

Robots.txt Status Present Score 100 /100 · Strong

Domain courtneydailey.com

robots.txt URL https://courtneydailey.com/robots.txt

Last analyzed May 13, 2026

View Full Robots.txt

Open robots.txt in a new tab

Download robots.txt

Robots.txt Content Preview

# Squarespace Robots Txt

User-agent: AI2Bot
User-agent: Ai2Bot-Dolma
User-agent: aiHitBot
User-agent: Amazonbot
User-agent: anthropic-ai
User-agent: Applebot-Extended
User-agent: Bytespider
User-agent: CCBot
User-agent: ClaudeBot
User-agent: cohere-ai
User-agent: cohere-training-data-crawler
User-agent: DuckAssistBot
User-agent: FacebookBot
User-agent: Google-Extended
User-agent: GoogleOther
User-agent: GoogleOther-Image
User-agent: GoogleOther-Video
User-agent: GPTBot
User-agent: img2dataset
User-agent: Meta-ExternalAgent
User-agent: MyCentralAIScraperBot
User-agent: omgili
User-agent: omgilibot
User-agent: Quora-Bot
User-agent: TikTokSpider
User-agent: YouBot
User-agent: AdsBot-Google
User-agent: AdsBot-Google-Mobile
User-agent: AdsBot-Google-Mobile-Apps
User-agent: *
Disallow: /config
Disallow: /search
Disallow: /account$
Disallow: /account/
Disallow: /commerce/digital-download/
Disallow: /api/
Allow: /api/ui-extensions/
Disallow: /static/
Disallow:/*?author=*
Disallow:/*&author=*
Disallow:/*?tag=*
Disallow:/*&tag=*
Disallow:/*?month=*
Disallow:/*&month=*
Disallow:/*?view=*
Disallow:/*&view=*
Disallow:/*?format=json
Disallow:/*&format=json
Disallow:/*?format=page-context
Disallow:/*&format=page-context
Disallow:/*?format=main-content
Disallow:/*&format=main-content
Disallow:/*?format=json-pretty
Disallow:/*&format=json-pretty
Disallow:/*?format=ical
Disallow:/*&format=ical
Disallow:/*?reversePaginate=*
Disallow:/*&reversePaginate=*

Sitemap: https://www.courtneydailey.com/sitemap.xml

User-agent Rules

User-agent(s)	Allowed paths	Disallowed paths
ai2bot	No explicit Allow rules.	No explicit Disallow rules.
ai2bot-dolma	No explicit Allow rules.	No explicit Disallow rules.
aihitbot	No explicit Allow rules.	No explicit Disallow rules.
amazonbot	No explicit Allow rules.	No explicit Disallow rules.
anthropic-ai	No explicit Allow rules.	No explicit Disallow rules.
applebot-extended	No explicit Allow rules.	No explicit Disallow rules.
bytespider	No explicit Allow rules.	No explicit Disallow rules.
ccbot	No explicit Allow rules.	No explicit Disallow rules.
claudebot	No explicit Allow rules.	No explicit Disallow rules.
cohere-ai	No explicit Allow rules.	No explicit Disallow rules.
cohere-training-data-crawler	No explicit Allow rules.	No explicit Disallow rules.
duckassistbot	No explicit Allow rules.	No explicit Disallow rules.
facebookbot	No explicit Allow rules.	No explicit Disallow rules.
google-extended	No explicit Allow rules.	No explicit Disallow rules.
googleother	No explicit Allow rules.	No explicit Disallow rules.
googleother-image	No explicit Allow rules.	No explicit Disallow rules.
googleother-video	No explicit Allow rules.	No explicit Disallow rules.
gptbot	No explicit Allow rules.	No explicit Disallow rules.
img2dataset	No explicit Allow rules.	No explicit Disallow rules.
meta-externalagent	No explicit Allow rules.	No explicit Disallow rules.
mycentralaiscraperbot	No explicit Allow rules.	No explicit Disallow rules.
omgili	No explicit Allow rules.	No explicit Disallow rules.
omgilibot	No explicit Allow rules.	No explicit Disallow rules.
quora-bot	No explicit Allow rules.	No explicit Disallow rules.
tiktokspider	No explicit Allow rules.	No explicit Disallow rules.
youbot	No explicit Allow rules.	No explicit Disallow rules.
adsbot-google	No explicit Allow rules.	No explicit Disallow rules.
adsbot-google-mobile	No explicit Allow rules.	No explicit Disallow rules.
adsbot-google-mobile-apps	No explicit Allow rules.	No explicit Disallow rules.
*	/api/ui-extensions/	/config /search /account$ /account/ /commerce/digital-download/ /api/ /static/ /?author= /&author= /?tag= /&tag= /?month= /&month= /?view= /&view= /?format=json /&format=json /?format=page-context /&format=page-context /?format=main-content /&format=main-content /?format=json-pretty /&format=json-pretty /?format=ical /&format=ical /?reversepaginate= /&reversepaginate=

Blocked and Allowed Paths

Blocked paths	/config /search /account$ /account/ /commerce/digital-download/ /api/ /static/ /?author= /&author= /?tag= /&tag= /?month= /&month= /?view= /&view= /?format=json /&format=json /?format=page-context /&format=page-context /?format=main-content /&format=main-content /?format=json-pretty /&format=json-pretty /?format=ical /&format=ical /?reversepaginate= /&reversepaginate=
Allowed paths	/api/ui-extensions/
Crawl-delay	No Crawl-delay directive detected.

Sitemaps Detected

https://www.courtneydailey.com/sitemap.xml

AI Crawler Policy

No explicit blocks were detected for common AI crawlers (GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended).

Recommendations

Document your AI crawler policy explicitly in robots.txt so future bots know how to treat your content.
Ensure important pages, CSS and JavaScript assets are crawlable so search engines can fully render your site.