Robots.txt Tester

Inspect how pinterest.ru controls crawler access, blocked paths, sitemap references and AI crawler rules.

Preview

Score: 84

  • At least one user-agent has Disallow: / which blocks the entire site.
  • robots.txt contains a very large number of Disallow rules; consider simplifying patterns.

Get your full report + exact fixes

See what’s hurting your SEO and how to fix it step by step.

  • Full breakdown
  • Actionable fixes
  • Prioritized next steps

No spam. One email with your report and next steps.

Robots.txt Status Present Score 84 /100 · Strong
Domain pinterest.ru
robots.txt URL https://pinterest.ru/robots.txt
Last analyzed May 11, 2026

View Full Robots.txt

Open robots.txt in a new tab

Download robots.txt

Robots.txt Content Preview

# Allowlist your bot: https://help.pinterest.com/bot-submission-form
#
# Pinterest is hiring!
#
# Learn about the SEO work that we're doing at https://medium.com/@Pinterest_Engineering/demystifying-seo-with-experiments-a183b325cf4c
#
# Check out some of our available positions at https://www.pinterestcareers.com/

User-agent: 2checkout
User-agent: AASA-Bot
User-agent: AccessibleWebBot
User-agent: Adagiobot
User-agent: adbeat_bot
User-agent: ADmantX
User-agent: AdometryBot
User-agent: Adsense-Snapshot-Google
User-agent: AdsTxtCrawler
User-agent: Adyen
User-agent: AhrefsBot
User-agent: AhrefsSiteAudit
User-agent: Akismet
User-agent: Algolia Crawler
User-agent: AmazonProductDiscovery
User-agent: Aolbot-News
User-agent: APIs-Google
User-agent: AppInsights
User-agent: Applebot
User-agent: AppleNewsBot
User-agent: Archive-It
User-agent: archive.org_bot
User-agent: ArchiveBot
User-agent: ArchiveTeam-ArchiveBot
User-agent: AspiegelBot
User-agent: Audisto Crawler
User-agent: Awario
User-agent: Baidu-ADS
User-agent: Baiduspider
User-agent: Barkrowler
User-agent: bingbot
User-agent: BingPreview
User-agent: bitlybot
User-agent: bl.uk_ldfc_bot
User-agent: BLP_bbot
User-agent: bordermanager
User-agent: botify
User-agent: BrandVerity
User-agent: Bravebot
User-agent: BrightEdge Crawler
User-agent: BrightEdge-Crawler
User-agent: BUbiNG
User-agent: CaliperBot
User-agent: CapitalOneBot
User-agent: Catchpoint
User-agent: cf-qualys-scanner
User-agent: Chrome-Lighthouse
User-agent: CJBot
User-agent: ClarityBot
User-agent: Clickagy Intelligence Bot v2
User-agent: Cloudflare-AI-Search
User-agent: CloudflareBrowserRenderingCrawler
User-agent: coccocbot
User-agent: ContextualBot
User-agent: CookieReports
User-agent: Coveobot
User-agent: CriteoBot
User-agent: curly-
User-agent: cXensebot
User-agent: Datadog
User-agent: DataForSeoBot
User-agent: Daum
User-agent: demandbase
User-agent: Discordbot
User-agent: DotBot
User-agent: DoubleVerifyBot
User-agent: Doximity-Pipeline
User-agent: Dragonbot
User-agent: Dratabot
User-agent: DuckAssistBot
User-agent: DuckDuckBot
User-agent: DuckDuckGo-Favicons-Bot
User-agent: DVBot
User-agent: eContext
User-agent: ecurly Webhook
User-agent: EngageBDR
User-agent: europarchive.org
User-agent: evidon
User-agent: ExaleadCloudview
User-agent: FacebookBot
User-agent: facebookcatalog
User-agent: facebookexternalhit
User-agent: Facebot
User-agent: FastDAST
User-agent: FeedBurner
User-agent: Feedfetcher-Google
User-agent: FlipboardProxy
User-agent: FlippBot
User-agent: Freshping
User-agent: GeedoProductSearch
User-agent: Google Favicon
User-agent: Google News
User-agent: Google Page Speed Insights
User-agent: Google Wireless Transcoder
User-agent: Google-Apps-Script
User-agent: Google-Certificates-Bridge
User-agent: Google-CWS
User-agent: Google-Display-Ads-Bot
User-agent: Google-Firebase
User-agent: Google-HotelAdsVerifier
User-agent: Google-InspectionTool
User-agent: Google-NotebookLM
User-agent: Google-PageRenderer
User-agent: Google-PhysicalWeb
User-agent: Google-Pinpoint
User-agent: Google-Read-Aloud
User-agent: Google-Safety
User-agent: Google-Site-Verification
User-agent: Google-speakr
User-agent: Google-Structured-Data-Testing
User-agent: Google-Trust-Services
User-agent: google_partner_monitoring
User-agent: GoogleAssociationService
User-agent: GoogleImageProxy
User-agent: GoogleMessages
User-agent: GoogleProducer
User-agent: GoogleSecurityScanner
User-agent: grafana/synthetic-monitoring
User-agent: GroovinaAdsbot
User-agent: GuestpostsBot
User-agent: heritrix
User-agent: Hotjar
User-agent: HubSpot
User-agent: ia_archiver
User-agent: IABot
User-agent: IAS-Crawler
User-agent: ias_crawler
User-agent: ias_wombles
User-agent: INA dlweb
User-agent: infolink
User-agent: InteractiveAdvertisingBureau
User-agent: ip-label
User-agent: J-BRW
User-agent: J-DLC
User-agent: James BOT
User-agent: JobRapido
User-agent: Jooblebot
User-agent: Jumio
User-agent: kakaotalk-scrap
User-agent: KargoBot-Artemis
User-agent: Leikibot
User-agent: LiftoffDroid
User-agent: line-poker
User-agent: Linguee Bot
User-agent: linkchecker.pro
User-agent: LOCKSS cache
User-agent: LogicMonitor SiteMonitor
User-agent: Lyonl
User-agent: magpie-crawler
User-agent: Mastodon
User-agent: MaxPoint Bot
User-agent: MBCrawler
User-agent: mediaboardbot
User-agent: MediaMonitoringBot
User-agent: Mediatoolkitbot
User-agent: MeltwaterNews
User-agent: meta-externalfetcher
User-agent: Metorik
User-agent: MgidBot
User-agent: MicrosoftPreview
User-agent: MixrankBot
User-agent: MJ12bot
User-agent: moatbot
User-agent: MojeekBot
User-agent: Monsidobot
User-agent: Moreover
User-agent: Morningscore Bot
User-agent: MSNPTC
User-agent: msrbot
User-agent: MTRobot
User-agent: netarkivindsamling
User-agent: NetpeakCheckerBot
User-agent: NeumobBot
User-agent: Neustar
User-agent: Nielsen
User-agent: NostoCrawlerBot
User-agent: NumeratorBot
User-agent: OdklBot
User-agent: OKX-dolphin-crawler
User-agent: OnCrawl
User-agent: OneTrust
User-agent: OPBot
User-agent: OSZKbot
User-agent: outbrain
User-agent: Paddle
User-agent: PageFreezer
User-agent: Pandalytics
User-agent: parsely.com
User-agent: ParselySharesBot
User-agent: PayPal
User-agent: peer39_crawler
User-agent: Pinterest
User-agent: Pinterestbot
User-agent: Plukkie
User-agent: Prerender
User-agent: PriceSpider
User-agent: ProjectShield-UrlCheck
User-agent: proximic
User-agent: QualifiedBot
User-agent: Quantcastbot
User-agent: Qwantbot
User-agent: Qwantify
User-agent: Razorpay
User-agent: Rigor
User-agent: RiverglassScanner
User-agent: RKG Url Verifier
User-agent: rogerbot-crawler
User-agent: RuxitSynthetic
User-agent: scanalert
User-agent: search.marginalia.nu
User-agent: SearchAtlas Bot
User-agent: SeekportBot
User-agent: SemanticJuice
User-agent: SemrushBot
User-agent: SemrushBot-BA
User-agent: SemrushBot-OCOB
User-agent: SemrushBot-SA
User-agent: SemrushBot-SI
User-agent: SemrushBot-SWA
User-agent: sentry
User-agent: SentryUptimeBot
User-agent: seo-audit-check-bot
User-agent: SeobilityBot
User-agent: SERankingBacklinksBot
User-agent: SeznamBot
User-agent: SinceraSyntheticUser
User-agent: SISTRIX Optimizer
User-agent: SiteAuditBot
User-agent: sitebulb
User-agent: SiteCheckerBotCrawler
User-agent: Siteimprove-SiteCheck
User-agent: SiteSearch360
User-agent: SkypeUriPreview
User-agent: Slack-ImgProxy
User-agent: Slackbot
User-agent: Slurp
User-agent: SmarshBot
User-agent: SmartBriefBot
User-agent: Snap URL Preview Service
User-agent: SnapPreviewBot
User-agent: Sogou
User-agent: solarwinds
User-agent: spbot
User-agent: Splunk Synthetics
User-agent: SpringBot
User-agent: SSL Labs
User-agent: ssr.ias-lab.de
User-agent: Stape
User-agent: SteamChat
User-agent: Storebot-Google
User-agent: Stripe
User-agent: Sucuri
User-agent: TagInspector
User-agent: TelegramBot
User-agent: Teoma
User-agent: trendictionbot
User-agent: trovitBot
User-agent: Tumblr
User-agent: twibble.io
User-agent: TwinWaveScanner
User-agent: um-LN
User-agent: VaultPress
User-agent: vercel-screenshot
User-agent: Viber
User-agent: VigLink
User-agent: VocusBot
User-agent: W3C-checklink
User-agent: W3C_Validator
User-agent: Wappalyzer
User-agent: WhatsApp
User-agent: woorankreview
User-agent: Y!J-ASR
User-agent: Y!J-BRJ/YATS crawler
User-agent: Y!J-BRU/VSIDX
User-agent: Y!J-BRW
User-agent: Y!J-BRY/YATSH crawler
User-agent: Y!J-BRZ/YATSHA crawler
User-agent: Y!J-MMP/dscv
User-agent: Y!J-WSC
User-agent: YaDirectFetcher
User-agent: Yahoo Ad monitoring
User-agent: Yahoo Link Preview
User-agent: Yahoo! Slurp
User-agent: Yahoo-Japan-ASR
User-agent: YahooCacheSystem
User-agent: YahooExternalCache
User-agent: yahoofeedseeker
User-agent: YahooMailProxy
User-agent: YaK
User-agent: Yandex
User-agent: Yeti
User-agent: YextBot
User-agent: YioopBot
User-agent: YJ-SAD
Allow: /_ngjs/resource/*/get/
Allow: /business/create/
Allow: /resource/*/get/
Disallow: /*/*/*/_tools/*
Disallow: /*/*/*/more_ideas/
Disallow: /*/*/_tools/*
Disallow: /*/*/activity/*
Disallow: /*/*/group/
Disallow: /*/*/invite/
Disallow: /*/*/more_ideas/*
Disallow: /*/?*amp_client_id*
Disallow: /*/?z=1
Disallow: /*/__wishlist__/*
Disallow: /*/_activities/*
Disallow: /*/_activity/*
Disallow: /*/_community/*
Disallow: /*/_created/*
Disallow: /*/_followers/*
Disallow: /*/_following/*
Disallow: /*/_quick_saves/*
Disallow: /*/_saved/*
Disallow: /*/_shop/*
Disallow: /*/_shopping_list/*
Disallow: /*/communities/
Disallow: /*/discovered/*
Disallow: /*/followers/*
Disallow: /*/following/*
Disallow: /*/likes/*
Disallow: /*/organize/*
Disallow: /*/pins/
Disallow: /*/profile-about/
Disallow: /*/scheduled-pin/*
Disallow: /*/scheduled-pins/*
Disallow: /*/story_pins/*
Disallow: /*/tagged/*
Disallow: /*/tried/*
Disallow: /*/video_pins/*
Disallow: /?show_error=true
Disallow: /_/_/*
Disallow: /_/_/pixel/*
Disallow: /_ngjs/resource/
Disallow: /about/*
Disallow: /addboard/
Disallow: /admin/
Disallow: /age-appeal/*
Disallow: /amp/*
Disallow: /appealed-pin/
Disallow: /autocomplete/
Disallow: /board/*
Disallow: /board_activity/*
Disallow: /board_activity_comment/*
Disallow: /bookmarklet/
Disallow: /branded-pins/
Disallow: /business/ad_create/
Disallow: /business/business-access/*
Disallow: /business/business-hierarchy/*
Disallow: /business/business-manager/*
Disallow: /business/catalogs/*
Disallow: /business/commerce-integrations/*
Disallow: /business/community-information/
Disallow: /business/convert/
Disallow: /business/create-linked-account/
Disallow: /business/hub/
Disallow: /business/invite/*
Disallow: /business/onboarding/
Disallow: /business/pin_create/
Disallow: /business/referral/*
Disallow: /business/site/
Disallow: /business/switch-account/
Disallow: /business/top-ads/
Disallow: /business/update/
Disallow: /business/verified-merchant/status/
Disallow: /christmas-spotlight/
Disallow: /close-account/
Disallow: /communities/*
Disallow: /community/*
Disallow: /community_comment/*
Disallow: /community_post/*
Disallow: /connect/*/
Disallow: /content-claiming/*
Disallow: /conversation/*
Disallow: /conversations/*
Disallow: /convert-business/
Disallow: /convert-personal/
Disallow: /copyright-reporting/*
Disallow: /create_pin/
Disallow: /creative-studio/
Disallow: /creative_editor/
Disallow: /creator-spotlight/*
Disallow: /creator_hub/_earn
Disallow: /creator_hub/_partnerships
Disallow: /csrf_error/
Disallow: /ct.html
Disallow: /deactivate-account/
Disallow: /delete_post/
Disallow: /discover/*
Disallow: /edit/*
Disallow: /editorial/*/*/
Disallow: /email/*
Disallow: /email_verification_error/
Disallow: /engagement/*
Disallow: /explore/*/?p=*
Disallow: /facebook/
Disallow: /fb.html
Disallow: /follow_board/
Disallow: /follow_user/
Disallow: /google_gdn.html
Disallow: /google_search.html
Disallow: /hanukkah-spotlight/
Disallow: /holiday-spotlight/
Disallow: /holidays-celebrations/
Disallow: /homefeed/
Disallow: /homefeed/*
Disallow: /idea-ads-tool/*
Disallow: /idea-pin-builder/*
Disallow: /idea-pin-invite/
Disallow: /install-shuffles/
Disallow: /invite/
Disallow: /invited/
Disallow: /join/?next=*
Disallow: /join/signup/?next=*
Disallow: /kwanzaa-spotlight/
Disallow: /lens-search/*
Disallow: /linked/*
Disallow: /live-session/*
Disallow: /login/?next=*
Disallow: /logout/
Disallow: /m/
Disallow: /new_invite/
Disallow: /news_hub/*
Disallow: /notifications/
Disallow: /oauth/line/*
Disallow: /oauth/login/*
Disallow: /oauth_error/
Disallow: /offsite/
Disallow: /parental-consent/confirmation/
Disallow: /parental-passcode/
Disallow: /password/reset/
Disallow: /password/reset/*
Disallow: /pin-builder/*
Disallow: /pin-communities/*
Disallow: /pin-creation-tool/*
Disallow: /pin-editor/
Disallow: /pin/*/activities
Disallow: /pin/*/activity/
Disallow: /pin/*/analytics
Disallow: /pin/*/brand-catalog/
Disallow: /pin/*/brand-catalog/*
Disallow: /pin/*/comments
Disallow: /pin/*/email
Disallow: /pin/*/feedback
Disallow: /pin/*/idea-pin/related-products/*
Disallow: /pin/*/likes
Disallow: /pin/*/promote
Disallow: /pin/*/reaction
Disallow: /pin/*/related-products
Disallow: /pin/*/related-products/*
Disallow: /pin/*/repin
Disallow: /pin/*/repins
Disallow: /pin/*/share
Disallow: /pin/*/shop-the-look/*
Disallow: /pin/*/tag
Disallow: /pin/*/takes
Disallow: /pin/*/visual-search
Disallow: /pin/*/visual-shop
Disallow: /pin/create/*
Disallow: /pin/find/
Disallow: /pin/find?url=*
Disallow: /pin_shop/*
Disallow: /pinterest-predicts/
Disallow: /pinterest-wellbeing/*
Disallow: /pinterestwellbeing/*
Disallow: /place/*
Disallow: /prefs/
Disallow: /product-catalogs/
Disallow: /product-catalogs/*
Disallow: /product-feed/
Disallow: /pw/*
Disallow: /quiz/*
Disallow: /recently-viewed/
Disallow: /refresh_stored_accounts
Disallow: /refresh_token
Disallow: /register/
Disallow: /reports-and-violations/
Disallow: /request-data/
Disallow: /resource/
Disallow: /safe-redirect/
Disallow: /search/
Disallow: /search?
Disallow: /secure/*
Disallow: /sendHeaderEarly/
Disallow: /settings/*
Disallow: /shop_pins/*
Disallow: /signup/*
Disallow: /socialmanager/*
Disallow: /source/*
Disallow: /sso/*
Disallow: /story-pin-builder/*
Disallow: /story-pin-invite/
Disallow: /story_feed/
Disallow: /story_pins/*
Disallow: /suspension-appeal/*
Disallow: /sw-shell.html
Disallow: /taggingtool/*
Disallow: /thanksgiving-spotlight/
Disallow: /theme/*
Disallow: /tv/*
Disallow: /unauth-profile/
Disallow: /unlink/
Disallow: /upload-lens-image
Disallow: /upload-lens-image-history
Disallow: /upload-shuffle-draft
Disallow: /v1/urls/count.json
Disallow: /v3/pidgets/log/
Disallow: /website/confirm/
Disallow: /website/confirm/download*
Disallow: /welcome/
Disallow: /your-shop/
Disallow: /your-shop/*

User-agent: Googlebot
Allow: /_ngjs/resource/*/get/
Allow: /business/create/
Allow: /resource/*/get/
Disallow: /*/*/*/_tools/*
Disallow: /*/*/*/more_ideas/
Disallow: /*/*/_tools/*
Disallow: /*/*/activity/*
Disallow: /*/*/group/
Disallow: /*/*/invite/
Disallow: /*/*/more_ideas/*
Disallow: /*/?*amp_client_id*
Disallow: /*/?z=1
Disallow: /*/__wishlist__/*
Disallow: /*/_activities/*
Disallow: /*/_activity/*
Disallow: /*/_community/*
Disallow: /*/_created/*
Disallow: /*/_followers/*
Disallow: /*/_following/*
Disallow: /*/_quick_saves/*
Disallow: /*/_saved/*
Disallow: /*/_shop/*
Disallow: /*/_shopping_list/*
Disallow: /*/communities/
Disallow: /*/discovered/*
Disallow: /*/followers/*
Disallow: /*/following/*
Disallow: /*/likes/*
Disallow: /*/organize/*
Disallow: /*/pins/
Disallow: /*/profile-about/
Disallow: /*/scheduled-pin/*
Disallow: /*/scheduled-pins/*
Disallow: /*/story_pins/*
Disallow: /*/tagged/*
Disallow: /*/tried/*
Disallow: /*/video_pins/*
Disallow: /?show_error=true
Disallow: /_/_/*
Disallow: /_/_/pixel/*
Disallow: /_ngjs/resource/
Disallow: /about/*
Disallow: /addboard/
Disallow: /admin/
Disallow: /age-appeal/*
Disallow: /amp/*
Disallow: /appealed-pin/
Disallow: /autocomplete/
Disallow: /board/*
Disallow: /board_activity/*
Disallow: /board_activity_comment/*
Disallow: /bookmarklet/
Disallow: /branded-pins/
Disallow: /business/ad_create/
Disallow: /business/business-access/*
Disallow: /business/business-hierarchy/*
Disallow: /business/business-manager/*
Disallow: /business/catalogs/*
Disallow: /business/commerce-integrations/*
Disallow: /business/community-information/
Disallow: /business/convert/
Disallow: /business/create-linked-account/
Disallow: /business/hub/
Disallow: /business/invite/*
Disallow: /business/onboarding/
Disallow: /business/pin_create/
Disallow: /business/referral/*
Disallow: /business/site/
Disallow: /business/switch-account/
Disallow: /business/top-ads/
Disallow: /business/update/
Disallow: /business/verified-merchant/status/
Disallow: /christmas-spotlight/
Disallow: /close-account/
Disallow: /communities/*
Disallow: /community/*
Disallow: /community_comment/*
Disallow: /community_post/*
Disallow: /connect/*/
Disallow: /content-claiming/*
Disallow: /conversation/*
Disallow: /conversations/*
Disallow: /convert-business/
Disallow: /convert-personal/
Disallow: /copyright-reporting/*
Disallow: /create_pin/
Disallow: /creative-studio/
Disallow: /creative_editor/
Disallow: /creator-spotlight/*
Disallow: /creator_hub/_earn
Disallow: /creator_hub/_partnerships
Disallow: /csrf_error/
Disallow: /ct.html
Disallow: /deactivate-account/
Disallow: /delete_post/
Disallow: /discover/*
Disallow: /edit/*
Disallow: /editorial/*/*/
Disallow: /email/*
Disallow: /email_verification_error/
Disallow: /engagement/*
Disallow: /explore/*
Disallow: /explore/*/?p=*
Disallow: /facebook/
Disallow: /fb.html
Disallow: /follow_board/
Disallow: /follow_user/
Disallow: /google_gdn.html
Disallow: /google_search.html
Disallow: /hanukkah-spotlight/
Disallow: /holiday-spotlight/
Disallow: /holidays-celebrations/
Disallow: /homefeed/
Disallow: /homefeed/*
Disallow: /idea-ads-tool/*
Disallow: /idea-pin-builder/*
Disallow: /idea-pin-invite/
Disallow: /install-shuffles/
Disallow: /invite/
Disallow: /invited/
Disallow: /join/?next=*
Disallow: /join/signup/?next=*
Disallow: /kwanzaa-spotlight/
Disallow: /lens-search/*
Disallow: /linked/*
Disallow: /live-session/*
Disallow: /login/?next=*
Disallow: /logout/
Disallow: /m/
Disallow: /new_invite/
Disallow: /news_hub/*
Disallow: /notifications/
Disallow: /oauth/line/*
Disallow: /oauth/login/*
Disallow: /oauth_error/
Disallow: /offsite/
Disallow: /parental-consent/confirmation/
Disallow: /parental-passcode/
Disallow: /password/reset/
Disallow: /password/reset/*
Disallow: /pin-builder/*
Disallow: /pin-communities/*
Disallow: /pin-creation-tool/*
Disallow: /pin-editor/
Disallow: /pin/*/activities
Disallow: /pin/*/activity/
Disallow: /pin/*/analytics
Disallow: /pin/*/brand-catalog/
Disallow: /pin/*/brand-catalog/*
Disallow: /pin/*/comments
Disallow: /pin/*/email
Disallow: /pin/*/feedback
Disallow: /pin/*/idea-pin/related-products/*
Disallow: /pin/*/likes
Disallow: /pin/*/promote
Disallow: /pin/*/reaction
Disallow: /pin/*/related-products
Disallow: /pin/*/related-products/*
Disallow: /pin/*/repin
Disallow: /pin/*/repins
Disallow: /pin/*/share
Disallow: /pin/*/shop-the-look/*
Disallow: /pin/*/tag
Disallow: /pin/*/takes
Disallow: /pin/*/visual-search
Disallow: /pin/*/visual-shop
Disallow: /pin/create/*
Disallow: /pin/find/
Disallow: /pin/find?url=*
Disallow: /pin_shop/*
Disallow: /pinterest-predicts/
Disallow: /pinterest-wellbeing/*
Disallow: /pinterestwellbeing/*
Disallow: /place/*
Disallow: /prefs/
Disallow: /product-catalogs/
Disallow: /product-catalogs/*
Disallow: /product-feed/
Disallow: /pw/*
Disallow: /quiz/*
Disallow: /recently-viewed/
Disallow: /refresh_stored_accounts
Disallow: /refresh_token
Disallow: /register/
Disallow: /reports-and-violations/
Disallow: /request-data/
Disallow: /resource/
Disallow: /safe-redirect/
Disallow: /search/
Disallow: /search?
Disallow: /secure/*
Disallow: /sendHeaderEarly/
Disallow: /settings/*
Disallow: /shop_pins/*
Disallow: /signup/*
Disallow: /socialmanager/*
Disallow: /source/*
Disallow: /sso/*
Disallow: /story-pin-builder/*
Disallow: /story-pin-invite/
Disallow: /story_feed/
Disallow: /story_pins/*
Disallow: /suspension-appeal/*
Disallow: /sw-shell.html
Disallow: /taggingtool/*
Disallow: /thanksgiving-spotlight/
Disallow: /theme/*
Disallow: /tv/*
Disallow: /unauth-profile/
Disallow: /unlink/
Disallow: /upload-lens-image
Disallow: /upload-lens-image-history
Disallow: /upload-shuffle-draft
Disallow: /v1/urls/count.json
Disallow: /v3/pidgets/log/
Disallow: /website/confirm/
Disallow: /website/confirm/download*
Disallow: /welcome/
Disallow: /your-shop/
Disallow: /your-shop/*

User-agent: Twitterbot
Allow: /_ngjs/resource/*/get/
Allow: /business/create/
Allow: /pin/*/feedback
Allow: /pin/*/sent
Allow: /resource/*/get/
Disallow: /*/*/*/_tools/*
Disallow: /*/*/*/more_ideas/
Disallow: /*/*/_tools/*
Disallow: /*/*/activity/*
Disallow: /*/*/group/
Disallow: /*/*/invite/
Disallow: /*/*/more_ideas/*
Disallow: /*/?*amp_client_id*
Disallow: /*/?z=1
Disallow: /*/__wishlist__/*
Disallow: /*/_activities/*
Disallow: /*/_activity/*
Disallow: /*/_community/*
Disallow: /*/_created/*
Disallow: /*/_followers/*
Disallow: /*/_following/*
Disallow: /*/_quick_saves/*
Disallow: /*/_saved/*
Disallow: /*/_shop/*
Disallow: /*/_shopping_list/*
Disallow: /*/communities/
Disallow: /*/discovered/*
Disallow: /*/followers/*
Disallow: /*/following/*
Disallow: /*/likes/*
Disallow: /*/organize/*
Disallow: /*/pins/
Disallow: /*/profile-about/
Disallow: /*/scheduled-pin/*
Disallow: /*/scheduled-pins/*
Disallow: /*/story_pins/*
Disallow: /*/tagged/*
Disallow: /*/tried/*
Disallow: /*/video_pins/*
Disallow: /?show_error=true
Disallow: /_/_/*
Disallow: /_/_/pixel/*
Disallow: /_ngjs/resource/
Disallow: /about/*
Disallow: /addboard/
Disallow: /admin/
Disallow: /age-appeal/*
Disallow: /amp/*
Disallow: /appealed-pin/
Disallow: /autocomplete/
Disallow: /board/*
Disallow: /board_activity/*
Disallow: /board_activity_comment/*
Disallow: /bookmarklet/
Disallow: /branded-pins/
Disallow: /business/ad_create/
Disallow: /business/business-access/*
Disallow: /business/business-hierarchy/*
Disallow: /business/business-manager/*
Disallow: /business/catalogs/*
Disallow: /business/commerce-integrations/*
Disallow: /business/community-information/
Disallow: /business/convert/
Disallow: /business/create-linked-account/
Disallow: /business/hub/
Disallow: /business/invite/*
Disallow: /business/onboarding/
Disallow: /business/pin_create/
Disallow: /business/referral/*
Disallow: /business/site/
Disallow: /business/switch-account/
Disallow: /business/top-ads/
Disallow: /business/update/
Disallow: /business/verified-merchant/status/
Disallow: /christmas-spotlight/
Disallow: /close-account/
Disallow: /communities/*
Disallow: /community/*
Disallow: /community_comment/*
Disallow: /community_post/*
Disallow: /connect/*/
Disallow: /content-claiming/*
Disallow: /conversation/*
Disallow: /conversations/*
Disallow: /convert-business/
Disallow: /convert-personal/
Disallow: /copyright-reporting/*
Disallow: /create_pin/
Disallow: /creative-studio/
Disallow: /creative_editor/
Disallow: /creator-spotlight/*
Disallow: /creator_hub/_earn
Disallow: /creator_hub/_partnerships
Disallow: /csrf_error/
Disallow: /ct.html
Disallow: /deactivate-account/
Disallow: /delete_post/
Disallow: /discover/*
Disallow: /edit/*
Disallow: /editorial/*/*/
Disallow: /email/*
Disallow: /email_verification_error/
Disallow: /engagement/*
Disallow: /explore/*
Disallow: /explore/*/?p=*
Disallow: /facebook/
Disallow: /fb.html
Disallow: /follow_board/
Disallow: /follow_user/
Disallow: /google_gdn.html
Disallow: /google_search.html
Disallow: /hanukkah-spotlight/
Disallow: /holiday-spotlight/
Disallow: /holidays-celebrations/
Disallow: /homefeed/
Disallow: /homefeed/*
Disallow: /idea-ads-tool/*
Disallow: /idea-pin-builder/*
Disallow: /idea-pin-invite/
Disallow: /install-shuffles/
Disallow: /invite/
Disallow: /invited/
Disallow: /join/?next=*
Disallow: /join/signup/?next=*
Disallow: /kwanzaa-spotlight/
Disallow: /lens-search/*
Disallow: /linked/*
Disallow: /live-session/*
Disallow: /login/?next=*
Disallow: /logout/
Disallow: /m/
Disallow: /new_invite/
Disallow: /news_hub/*
Disallow: /notifications/
Disallow: /oauth/line/*
Disallow: /oauth/login/*
Disallow: /oauth_error/
Disallow: /offsite/
Disallow: /parental-consent/confirmation/
Disallow: /parental-passcode/
Disallow: /password/reset/
Disallow: /password/reset/*
Disallow: /pin-builder/*
Disallow: /pin-communities/*
Disallow: /pin-creation-tool/*
Disallow: /pin-editor/
Disallow: /pin/*/activities
Disallow: /pin/*/activity/
Disallow: /pin/*/analytics
Disallow: /pin/*/brand-catalog/
Disallow: /pin/*/brand-catalog/*
Disallow: /pin/*/comments
Disallow: /pin/*/email
Disallow: /pin/*/idea-pin/related-products/*
Disallow: /pin/*/likes
Disallow: /pin/*/promote
Disallow: /pin/*/reaction
Disallow: /pin/*/related-products
Disallow: /pin/*/related-products/*
Disallow: /pin/*/repin
Disallow: /pin/*/repins
Disallow: /pin/*/share
Disallow: /pin/*/shop-the-look/*
Disallow: /pin/*/tag
Disallow: /pin/*/takes
Disallow: /pin/*/visual-search
Disallow: /pin/*/visual-shop
Disallow: /pin/create/*
Disallow: /pin/find/
Disallow: /pin/find?url=*
Disallow: /pin_shop/*
Disallow: /pinterest-predicts/
Disallow: /pinterest-wellbeing/*
Disallow: /pinterestwellbeing/*
Disallow: /place/*
Disallow: /prefs/
Disallow: /product-catalogs/
Disallow: /product-catalogs/*
Disallow: /product-feed/
Disallow: /pw/*
Disallow: /quiz/*
Disallow: /recently-viewed/
Disallow: /refresh_stored_accounts
Disallow: /refresh_token
Disallow: /register/
Disallow: /reports-and-violations/
Disallow: /request-data/
Disallow: /resource/
Disallow: /safe-redirect/
Disallow: /search/
Disallow: /search?
Disallow: /secure/*
Disallow: /sendHeaderEarly/
Disallow: /settings/*
Disallow: /shop_pins/*
Disallow: /signup/*
Disallow: /socialmanager/*
Disallow: /source/*
Disallow: /sso/*
Disallow: /story-pin-builder/*
Disallow: /story-pin-invite/
Disallow: /story_feed/
Disallow: /story_pins/*
Disallow: /suspension-appeal/*
Disallow: /sw-shell.html
Disallow: /taggingtool/*
Disallow: /thanksgiving-spotlight/
Disallow: /theme/*
Disallow: /tv/*
Disallow: /unauth-profile/
Disallow: /unlink/
Disallow: /upload-lens-image
Disallow: /upload-lens-image-history
Disallow: /upload-shuffle-draft
Disallow: /v1/urls/count.json
Disallow: /v3/pidgets/log/
Disallow: /website/confirm/
Disallow: /website/confirm/download*
Disallow: /welcome/
Disallow: /your-shop/
Disallow: /your-shop/*

User-agent: Mediapartners-Google
User-agent: AmazonAdBot
Allow: /pin/
Allow: /search/*
Disallow: /

User-agent: Google-adstxt
User-agent: IAB-Tech-Lab
Allow: /ads.txt
Allow: /app-ads.txt
Disallow: /

User-agent: adidxbot
User-agent: AdsBot-Google
User-agent: AdsBot-Google-Mobile
User-agent: AxonBot
User-agent: Google Web Preview
User-agent: Google-Ads-Overview
User-agent: Google-AdWords-Express
User-agent: Google-Adwords-Instant
User-agent: LinkedInBot
User-agent: meta-externalads
User-agent: SnapchatAds
User-agent: Taboolabot
Allow: /

User-agent: YandexAdditional
User-agent: YandexAdditionalBot
Disallow: /

User-agent: *
Disallow: /

Sitemap: https://ru.pinterest.com/v3_sitemaps/ideas_hub_expansion_v2_sitemap_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/new_years_eve_pin_reinforce_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/board_link_sitemap_tier_1_quality_uncrawled_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/christmas_pin_newset_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/board_link_sitemap_recent_engagement_tier_1_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/user_link_sitemap_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/image_pin_high_quality_tier_1_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/board_link_sitemap_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/board_link_sitemap_high_cohesion_tier_0_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/board_link_sitemap_tier_0_quality_uncrawled_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/board_link_sitemap_high_cohesion_tier_1_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/seasonal_halloween_segment_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/image_pin_sitemap_recent_engagement_tier_0_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/new_years_eve_pin_newset_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/christmas_pin_reinforce_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/product_pin_sitemap_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/image_pin_sitemap_high_engagement_tier_0_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/video_pin_sitemap_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/image_pin_sitemap_recent_engagement_tier_1_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/image_pin_sitemap_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/board_link_sitemap_recent_engagement_tier_0_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/video_product_pin_sitemap_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/image_pin_sitemap_high_engagement_tier_1_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/board_link_sitemap_tier_3_quality_uncrawled_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/image_pin_high_quality_tier_0_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/board_link_sitemap_tier_2_quality_uncrawled_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/board_link_sitemap_new_years_eve_board_reinforce_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/board_link_sitemap_christmas_new_year_eve_board_reinforce_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/board_link_sitemap_christmas_board_reinforce_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/ideahub_new_years_eve_sitemap_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/ideahub_christmas_sitemap_ru.pinterest.com.xml
Sitemap: https://ru.pinterest.com/v3_sitemaps/new_years_eve_pin_ru.pinterest.com.xml

User-agent Rules

User-agent(s) Allowed paths Disallowed paths
2checkout No explicit Allow rules. No explicit Disallow rules.
aasa-bot No explicit Allow rules. No explicit Disallow rules.
accessiblewebbot No explicit Allow rules. No explicit Disallow rules.
adagiobot No explicit Allow rules. No explicit Disallow rules.
adbeat_bot No explicit Allow rules. No explicit Disallow rules.
admantx No explicit Allow rules. No explicit Disallow rules.
adometrybot No explicit Allow rules. No explicit Disallow rules.
adsense-snapshot-google No explicit Allow rules. No explicit Disallow rules.
adstxtcrawler No explicit Allow rules. No explicit Disallow rules.
adyen No explicit Allow rules. No explicit Disallow rules.
ahrefsbot No explicit Allow rules. No explicit Disallow rules.
ahrefssiteaudit No explicit Allow rules. No explicit Disallow rules.
akismet No explicit Allow rules. No explicit Disallow rules.
algolia crawler No explicit Allow rules. No explicit Disallow rules.
amazonproductdiscovery No explicit Allow rules. No explicit Disallow rules.
aolbot-news No explicit Allow rules. No explicit Disallow rules.
apis-google No explicit Allow rules. No explicit Disallow rules.
appinsights No explicit Allow rules. No explicit Disallow rules.
applebot No explicit Allow rules. No explicit Disallow rules.
applenewsbot No explicit Allow rules. No explicit Disallow rules.
archive-it No explicit Allow rules. No explicit Disallow rules.
archive.org_bot No explicit Allow rules. No explicit Disallow rules.
archivebot No explicit Allow rules. No explicit Disallow rules.
archiveteam-archivebot No explicit Allow rules. No explicit Disallow rules.
aspiegelbot No explicit Allow rules. No explicit Disallow rules.
audisto crawler No explicit Allow rules. No explicit Disallow rules.
awario No explicit Allow rules. No explicit Disallow rules.
baidu-ads No explicit Allow rules. No explicit Disallow rules.
baiduspider No explicit Allow rules. No explicit Disallow rules.
barkrowler No explicit Allow rules. No explicit Disallow rules.
bingbot No explicit Allow rules. No explicit Disallow rules.
bingpreview No explicit Allow rules. No explicit Disallow rules.
bitlybot No explicit Allow rules. No explicit Disallow rules.
bl.uk_ldfc_bot No explicit Allow rules. No explicit Disallow rules.
blp_bbot No explicit Allow rules. No explicit Disallow rules.
bordermanager No explicit Allow rules. No explicit Disallow rules.
botify No explicit Allow rules. No explicit Disallow rules.
brandverity No explicit Allow rules. No explicit Disallow rules.
bravebot No explicit Allow rules. No explicit Disallow rules.
brightedge crawler No explicit Allow rules. No explicit Disallow rules.
brightedge-crawler No explicit Allow rules. No explicit Disallow rules.
bubing No explicit Allow rules. No explicit Disallow rules.
caliperbot No explicit Allow rules. No explicit Disallow rules.
capitalonebot No explicit Allow rules. No explicit Disallow rules.
catchpoint No explicit Allow rules. No explicit Disallow rules.
cf-qualys-scanner No explicit Allow rules. No explicit Disallow rules.
chrome-lighthouse No explicit Allow rules. No explicit Disallow rules.
cjbot No explicit Allow rules. No explicit Disallow rules.
claritybot No explicit Allow rules. No explicit Disallow rules.
clickagy intelligence bot v2 No explicit Allow rules. No explicit Disallow rules.
cloudflare-ai-search No explicit Allow rules. No explicit Disallow rules.
cloudflarebrowserrenderingcrawler No explicit Allow rules. No explicit Disallow rules.
coccocbot No explicit Allow rules. No explicit Disallow rules.
contextualbot No explicit Allow rules. No explicit Disallow rules.
cookiereports No explicit Allow rules. No explicit Disallow rules.
coveobot No explicit Allow rules. No explicit Disallow rules.
criteobot No explicit Allow rules. No explicit Disallow rules.
curly- No explicit Allow rules. No explicit Disallow rules.
cxensebot No explicit Allow rules. No explicit Disallow rules.
datadog No explicit Allow rules. No explicit Disallow rules.
dataforseobot No explicit Allow rules. No explicit Disallow rules.
daum No explicit Allow rules. No explicit Disallow rules.
demandbase No explicit Allow rules. No explicit Disallow rules.
discordbot No explicit Allow rules. No explicit Disallow rules.
dotbot No explicit Allow rules. No explicit Disallow rules.
doubleverifybot No explicit Allow rules. No explicit Disallow rules.
doximity-pipeline No explicit Allow rules. No explicit Disallow rules.
dragonbot No explicit Allow rules. No explicit Disallow rules.
dratabot No explicit Allow rules. No explicit Disallow rules.
duckassistbot No explicit Allow rules. No explicit Disallow rules.
duckduckbot No explicit Allow rules. No explicit Disallow rules.
duckduckgo-favicons-bot No explicit Allow rules. No explicit Disallow rules.
dvbot No explicit Allow rules. No explicit Disallow rules.
econtext No explicit Allow rules. No explicit Disallow rules.
ecurly webhook No explicit Allow rules. No explicit Disallow rules.
engagebdr No explicit Allow rules. No explicit Disallow rules.
europarchive.org No explicit Allow rules. No explicit Disallow rules.
evidon No explicit Allow rules. No explicit Disallow rules.
exaleadcloudview No explicit Allow rules. No explicit Disallow rules.
facebookbot No explicit Allow rules. No explicit Disallow rules.
facebookcatalog No explicit Allow rules. No explicit Disallow rules.
facebookexternalhit No explicit Allow rules. No explicit Disallow rules.
facebot No explicit Allow rules. No explicit Disallow rules.
fastdast No explicit Allow rules. No explicit Disallow rules.
feedburner No explicit Allow rules. No explicit Disallow rules.
feedfetcher-google No explicit Allow rules. No explicit Disallow rules.
flipboardproxy No explicit Allow rules. No explicit Disallow rules.
flippbot No explicit Allow rules. No explicit Disallow rules.
freshping No explicit Allow rules. No explicit Disallow rules.
geedoproductsearch No explicit Allow rules. No explicit Disallow rules.
google favicon No explicit Allow rules. No explicit Disallow rules.
google news No explicit Allow rules. No explicit Disallow rules.
google page speed insights No explicit Allow rules. No explicit Disallow rules.
google wireless transcoder No explicit Allow rules. No explicit Disallow rules.
google-apps-script No explicit Allow rules. No explicit Disallow rules.
google-certificates-bridge No explicit Allow rules. No explicit Disallow rules.
google-cws No explicit Allow rules. No explicit Disallow rules.
google-display-ads-bot No explicit Allow rules. No explicit Disallow rules.
google-firebase No explicit Allow rules. No explicit Disallow rules.
google-hoteladsverifier No explicit Allow rules. No explicit Disallow rules.
google-inspectiontool No explicit Allow rules. No explicit Disallow rules.
google-notebooklm No explicit Allow rules. No explicit Disallow rules.
google-pagerenderer No explicit Allow rules. No explicit Disallow rules.
google-physicalweb No explicit Allow rules. No explicit Disallow rules.
google-pinpoint No explicit Allow rules. No explicit Disallow rules.
google-read-aloud No explicit Allow rules. No explicit Disallow rules.
google-safety No explicit Allow rules. No explicit Disallow rules.
google-site-verification No explicit Allow rules. No explicit Disallow rules.
google-speakr No explicit Allow rules. No explicit Disallow rules.
google-structured-data-testing No explicit Allow rules. No explicit Disallow rules.
google-trust-services No explicit Allow rules. No explicit Disallow rules.
google_partner_monitoring No explicit Allow rules. No explicit Disallow rules.
googleassociationservice No explicit Allow rules. No explicit Disallow rules.
googleimageproxy No explicit Allow rules. No explicit Disallow rules.
googlemessages No explicit Allow rules. No explicit Disallow rules.
googleproducer No explicit Allow rules. No explicit Disallow rules.
googlesecurityscanner No explicit Allow rules. No explicit Disallow rules.
grafana/synthetic-monitoring No explicit Allow rules. No explicit Disallow rules.
groovinaadsbot No explicit Allow rules. No explicit Disallow rules.
guestpostsbot No explicit Allow rules. No explicit Disallow rules.
heritrix No explicit Allow rules. No explicit Disallow rules.
hotjar No explicit Allow rules. No explicit Disallow rules.
hubspot No explicit Allow rules. No explicit Disallow rules.
ia_archiver No explicit Allow rules. No explicit Disallow rules.
iabot No explicit Allow rules. No explicit Disallow rules.
ias-crawler No explicit Allow rules. No explicit Disallow rules.
ias_crawler No explicit Allow rules. No explicit Disallow rules.
ias_wombles No explicit Allow rules. No explicit Disallow rules.
ina dlweb No explicit Allow rules. No explicit Disallow rules.
infolink No explicit Allow rules. No explicit Disallow rules.
interactiveadvertisingbureau No explicit Allow rules. No explicit Disallow rules.
ip-label No explicit Allow rules. No explicit Disallow rules.
j-brw No explicit Allow rules. No explicit Disallow rules.
j-dlc No explicit Allow rules. No explicit Disallow rules.
james bot No explicit Allow rules. No explicit Disallow rules.
jobrapido No explicit Allow rules. No explicit Disallow rules.
jooblebot No explicit Allow rules. No explicit Disallow rules.
jumio No explicit Allow rules. No explicit Disallow rules.
kakaotalk-scrap No explicit Allow rules. No explicit Disallow rules.
kargobot-artemis No explicit Allow rules. No explicit Disallow rules.
leikibot No explicit Allow rules. No explicit Disallow rules.
liftoffdroid No explicit Allow rules. No explicit Disallow rules.
line-poker No explicit Allow rules. No explicit Disallow rules.
linguee bot No explicit Allow rules. No explicit Disallow rules.
linkchecker.pro No explicit Allow rules. No explicit Disallow rules.
lockss cache No explicit Allow rules. No explicit Disallow rules.
logicmonitor sitemonitor No explicit Allow rules. No explicit Disallow rules.
lyonl No explicit Allow rules. No explicit Disallow rules.
magpie-crawler No explicit Allow rules. No explicit Disallow rules.
mastodon No explicit Allow rules. No explicit Disallow rules.
maxpoint bot No explicit Allow rules. No explicit Disallow rules.
mbcrawler No explicit Allow rules. No explicit Disallow rules.
mediaboardbot No explicit Allow rules. No explicit Disallow rules.
mediamonitoringbot No explicit Allow rules. No explicit Disallow rules.
mediatoolkitbot No explicit Allow rules. No explicit Disallow rules.
meltwaternews No explicit Allow rules. No explicit Disallow rules.
meta-externalfetcher No explicit Allow rules. No explicit Disallow rules.
metorik No explicit Allow rules. No explicit Disallow rules.
mgidbot No explicit Allow rules. No explicit Disallow rules.
microsoftpreview No explicit Allow rules. No explicit Disallow rules.
mixrankbot No explicit Allow rules. No explicit Disallow rules.
mj12bot No explicit Allow rules. No explicit Disallow rules.
moatbot No explicit Allow rules. No explicit Disallow rules.
mojeekbot No explicit Allow rules. No explicit Disallow rules.
monsidobot No explicit Allow rules. No explicit Disallow rules.
moreover No explicit Allow rules. No explicit Disallow rules.
morningscore bot No explicit Allow rules. No explicit Disallow rules.
msnptc No explicit Allow rules. No explicit Disallow rules.
msrbot No explicit Allow rules. No explicit Disallow rules.
mtrobot No explicit Allow rules. No explicit Disallow rules.
netarkivindsamling No explicit Allow rules. No explicit Disallow rules.
netpeakcheckerbot No explicit Allow rules. No explicit Disallow rules.
neumobbot No explicit Allow rules. No explicit Disallow rules.
neustar No explicit Allow rules. No explicit Disallow rules.
nielsen No explicit Allow rules. No explicit Disallow rules.
nostocrawlerbot No explicit Allow rules. No explicit Disallow rules.
numeratorbot No explicit Allow rules. No explicit Disallow rules.
odklbot No explicit Allow rules. No explicit Disallow rules.
okx-dolphin-crawler No explicit Allow rules. No explicit Disallow rules.
oncrawl No explicit Allow rules. No explicit Disallow rules.
onetrust No explicit Allow rules. No explicit Disallow rules.
opbot No explicit Allow rules. No explicit Disallow rules.
oszkbot No explicit Allow rules. No explicit Disallow rules.
outbrain No explicit Allow rules. No explicit Disallow rules.
paddle No explicit Allow rules. No explicit Disallow rules.
pagefreezer No explicit Allow rules. No explicit Disallow rules.
pandalytics No explicit Allow rules. No explicit Disallow rules.
parsely.com No explicit Allow rules. No explicit Disallow rules.
parselysharesbot No explicit Allow rules. No explicit Disallow rules.
paypal No explicit Allow rules. No explicit Disallow rules.
peer39_crawler No explicit Allow rules. No explicit Disallow rules.
pinterest No explicit Allow rules. No explicit Disallow rules.
pinterestbot No explicit Allow rules. No explicit Disallow rules.
plukkie No explicit Allow rules. No explicit Disallow rules.
prerender No explicit Allow rules. No explicit Disallow rules.
pricespider No explicit Allow rules. No explicit Disallow rules.
projectshield-urlcheck No explicit Allow rules. No explicit Disallow rules.
proximic No explicit Allow rules. No explicit Disallow rules.
qualifiedbot No explicit Allow rules. No explicit Disallow rules.
quantcastbot No explicit Allow rules. No explicit Disallow rules.
qwantbot No explicit Allow rules. No explicit Disallow rules.
qwantify No explicit Allow rules. No explicit Disallow rules.
razorpay No explicit Allow rules. No explicit Disallow rules.
rigor No explicit Allow rules. No explicit Disallow rules.
riverglassscanner No explicit Allow rules. No explicit Disallow rules.
rkg url verifier No explicit Allow rules. No explicit Disallow rules.
rogerbot-crawler No explicit Allow rules. No explicit Disallow rules.
ruxitsynthetic No explicit Allow rules. No explicit Disallow rules.
scanalert No explicit Allow rules. No explicit Disallow rules.
search.marginalia.nu No explicit Allow rules. No explicit Disallow rules.
searchatlas bot No explicit Allow rules. No explicit Disallow rules.
seekportbot No explicit Allow rules. No explicit Disallow rules.
semanticjuice No explicit Allow rules. No explicit Disallow rules.
semrushbot No explicit Allow rules. No explicit Disallow rules.
semrushbot-ba No explicit Allow rules. No explicit Disallow rules.
semrushbot-ocob No explicit Allow rules. No explicit Disallow rules.
semrushbot-sa No explicit Allow rules. No explicit Disallow rules.
semrushbot-si No explicit Allow rules. No explicit Disallow rules.
semrushbot-swa No explicit Allow rules. No explicit Disallow rules.
sentry No explicit Allow rules. No explicit Disallow rules.
sentryuptimebot No explicit Allow rules. No explicit Disallow rules.
seo-audit-check-bot No explicit Allow rules. No explicit Disallow rules.
seobilitybot No explicit Allow rules. No explicit Disallow rules.
serankingbacklinksbot No explicit Allow rules. No explicit Disallow rules.
seznambot No explicit Allow rules. No explicit Disallow rules.
sincerasyntheticuser No explicit Allow rules. No explicit Disallow rules.
sistrix optimizer No explicit Allow rules. No explicit Disallow rules.
siteauditbot No explicit Allow rules. No explicit Disallow rules.
sitebulb No explicit Allow rules. No explicit Disallow rules.
sitecheckerbotcrawler No explicit Allow rules. No explicit Disallow rules.
siteimprove-sitecheck No explicit Allow rules. No explicit Disallow rules.
sitesearch360 No explicit Allow rules. No explicit Disallow rules.
skypeuripreview No explicit Allow rules. No explicit Disallow rules.
slack-imgproxy No explicit Allow rules. No explicit Disallow rules.
slackbot No explicit Allow rules. No explicit Disallow rules.
slurp No explicit Allow rules. No explicit Disallow rules.
smarshbot No explicit Allow rules. No explicit Disallow rules.
smartbriefbot No explicit Allow rules. No explicit Disallow rules.
snap url preview service No explicit Allow rules. No explicit Disallow rules.
snappreviewbot No explicit Allow rules. No explicit Disallow rules.
sogou No explicit Allow rules. No explicit Disallow rules.
solarwinds No explicit Allow rules. No explicit Disallow rules.
spbot No explicit Allow rules. No explicit Disallow rules.
splunk synthetics No explicit Allow rules. No explicit Disallow rules.
springbot No explicit Allow rules. No explicit Disallow rules.
ssl labs No explicit Allow rules. No explicit Disallow rules.
ssr.ias-lab.de No explicit Allow rules. No explicit Disallow rules.
stape No explicit Allow rules. No explicit Disallow rules.
steamchat No explicit Allow rules. No explicit Disallow rules.
storebot-google No explicit Allow rules. No explicit Disallow rules.
stripe No explicit Allow rules. No explicit Disallow rules.
sucuri No explicit Allow rules. No explicit Disallow rules.
taginspector No explicit Allow rules. No explicit Disallow rules.
telegrambot No explicit Allow rules. No explicit Disallow rules.
teoma No explicit Allow rules. No explicit Disallow rules.
trendictionbot No explicit Allow rules. No explicit Disallow rules.
trovitbot No explicit Allow rules. No explicit Disallow rules.
tumblr No explicit Allow rules. No explicit Disallow rules.
twibble.io No explicit Allow rules. No explicit Disallow rules.
twinwavescanner No explicit Allow rules. No explicit Disallow rules.
um-ln No explicit Allow rules. No explicit Disallow rules.
vaultpress No explicit Allow rules. No explicit Disallow rules.
vercel-screenshot No explicit Allow rules. No explicit Disallow rules.
viber No explicit Allow rules. No explicit Disallow rules.
viglink No explicit Allow rules. No explicit Disallow rules.
vocusbot No explicit Allow rules. No explicit Disallow rules.
w3c-checklink No explicit Allow rules. No explicit Disallow rules.
w3c_validator No explicit Allow rules. No explicit Disallow rules.
wappalyzer No explicit Allow rules. No explicit Disallow rules.
whatsapp No explicit Allow rules. No explicit Disallow rules.
woorankreview No explicit Allow rules. No explicit Disallow rules.
y!j-asr No explicit Allow rules. No explicit Disallow rules.
y!j-brj/yats crawler No explicit Allow rules. No explicit Disallow rules.
y!j-bru/vsidx No explicit Allow rules. No explicit Disallow rules.
y!j-brw No explicit Allow rules. No explicit Disallow rules.
y!j-bry/yatsh crawler No explicit Allow rules. No explicit Disallow rules.
y!j-brz/yatsha crawler No explicit Allow rules. No explicit Disallow rules.
y!j-mmp/dscv No explicit Allow rules. No explicit Disallow rules.
y!j-wsc No explicit Allow rules. No explicit Disallow rules.
yadirectfetcher No explicit Allow rules. No explicit Disallow rules.
yahoo ad monitoring No explicit Allow rules. No explicit Disallow rules.
yahoo link preview No explicit Allow rules. No explicit Disallow rules.
yahoo! slurp No explicit Allow rules. No explicit Disallow rules.
yahoo-japan-asr No explicit Allow rules. No explicit Disallow rules.
yahoocachesystem No explicit Allow rules. No explicit Disallow rules.
yahooexternalcache No explicit Allow rules. No explicit Disallow rules.
yahoofeedseeker No explicit Allow rules. No explicit Disallow rules.
yahoomailproxy No explicit Allow rules. No explicit Disallow rules.
yak No explicit Allow rules. No explicit Disallow rules.
yandex No explicit Allow rules. No explicit Disallow rules.
yeti No explicit Allow rules. No explicit Disallow rules.
yextbot No explicit Allow rules. No explicit Disallow rules.
yioopbot No explicit Allow rules. No explicit Disallow rules.
yj-sad
  • /_ngjs/resource/*/get/
  • /business/create/
  • /resource/*/get/
  • /*/*/*/_tools/*
  • /*/*/*/more_ideas/
  • /*/*/_tools/*
  • /*/*/activity/*
  • /*/*/group/
  • /*/*/invite/
  • /*/*/more_ideas/*
  • /*/?*amp_client_id*
  • /*/?z=1
  • /*/__wishlist__/*
  • /*/_activities/*
  • /*/_activity/*
  • /*/_community/*
  • /*/_created/*
  • /*/_followers/*
  • /*/_following/*
  • /*/_quick_saves/*
  • /*/_saved/*
  • /*/_shop/*
  • /*/_shopping_list/*
  • /*/communities/
  • /*/discovered/*
  • /*/followers/*
  • /*/following/*
  • /*/likes/*
  • /*/organize/*
  • /*/pins/
  • /*/profile-about/
  • /*/scheduled-pin/*
  • /*/scheduled-pins/*
  • /*/story_pins/*
  • /*/tagged/*
  • /*/tried/*
  • /*/video_pins/*
  • /?show_error=true
  • /_/_/*
  • /_/_/pixel/*
  • /_ngjs/resource/
  • /about/*
  • /addboard/
  • /admin/
  • /age-appeal/*
  • /amp/*
  • /appealed-pin/
  • /autocomplete/
  • /board/*
  • /board_activity/*
  • /board_activity_comment/*
  • /bookmarklet/
  • /branded-pins/
  • /business/ad_create/
  • /business/business-access/*
  • /business/business-hierarchy/*
  • /business/business-manager/*
  • /business/catalogs/*
  • /business/commerce-integrations/*
  • /business/community-information/
  • /business/convert/
  • /business/create-linked-account/
  • /business/hub/
  • /business/invite/*
  • /business/onboarding/
  • /business/pin_create/
  • /business/referral/*
  • /business/site/
  • /business/switch-account/
  • /business/top-ads/
  • /business/update/
  • /business/verified-merchant/status/
  • /christmas-spotlight/
  • /close-account/
  • /communities/*
  • /community/*
  • /community_comment/*
  • /community_post/*
  • /connect/*/
  • /content-claiming/*
  • /conversation/*
  • /conversations/*
  • /convert-business/
  • /convert-personal/
  • /copyright-reporting/*
  • /create_pin/
  • /creative-studio/
  • /creative_editor/
  • /creator-spotlight/*
  • /creator_hub/_earn
  • /creator_hub/_partnerships
  • /csrf_error/
  • /ct.html
  • /deactivate-account/
  • /delete_post/
  • /discover/*
  • /edit/*
  • /editorial/*/*/
  • /email/*
  • /email_verification_error/
  • /engagement/*
  • /explore/*/?p=*
  • /facebook/
  • /fb.html
  • /follow_board/
  • /follow_user/
  • /google_gdn.html
  • /google_search.html
  • /hanukkah-spotlight/
  • /holiday-spotlight/
  • /holidays-celebrations/
  • /homefeed/
  • /homefeed/*
  • /idea-ads-tool/*
  • /idea-pin-builder/*
  • /idea-pin-invite/
  • /install-shuffles/
  • /invite/
  • /invited/
  • /join/?next=*
  • /join/signup/?next=*
  • /kwanzaa-spotlight/
  • /lens-search/*
  • /linked/*
  • /live-session/*
  • /login/?next=*
  • /logout/
  • /m/
  • /new_invite/
  • /news_hub/*
  • /notifications/
  • /oauth/line/*
  • /oauth/login/*
  • /oauth_error/
  • /offsite/
  • /parental-consent/confirmation/
  • /parental-passcode/
  • /password/reset/
  • /password/reset/*
  • /pin-builder/*
  • /pin-communities/*
  • /pin-creation-tool/*
  • /pin-editor/
  • /pin/*/activities
  • /pin/*/activity/
  • /pin/*/analytics
  • /pin/*/brand-catalog/
  • /pin/*/brand-catalog/*
  • /pin/*/comments
  • /pin/*/email
  • /pin/*/feedback
  • /pin/*/idea-pin/related-products/*
  • /pin/*/likes
  • /pin/*/promote
  • /pin/*/reaction
  • /pin/*/related-products
  • /pin/*/related-products/*
  • /pin/*/repin
  • /pin/*/repins
  • /pin/*/share
  • /pin/*/shop-the-look/*
  • /pin/*/tag
  • /pin/*/takes
  • /pin/*/visual-search
  • /pin/*/visual-shop
  • /pin/create/*
  • /pin/find/
  • /pin/find?url=*
  • /pin_shop/*
  • /pinterest-predicts/
  • /pinterest-wellbeing/*
  • /pinterestwellbeing/*
  • /place/*
  • /prefs/
  • /product-catalogs/
  • /product-catalogs/*
  • /product-feed/
  • /pw/*
  • /quiz/*
  • /recently-viewed/
  • /refresh_stored_accounts
  • /refresh_token
  • /register/
  • /reports-and-violations/
  • /request-data/
  • /resource/
  • /safe-redirect/
  • /search/
  • /search?
  • /secure/*
  • /sendheaderearly/
  • /settings/*
  • /shop_pins/*
  • /signup/*
  • /socialmanager/*
  • /source/*
  • /sso/*
  • /story-pin-builder/*
  • /story-pin-invite/
  • /story_feed/
  • /story_pins/*
  • /suspension-appeal/*
  • /sw-shell.html
  • /taggingtool/*
  • /thanksgiving-spotlight/
  • /theme/*
  • /tv/*
  • /unauth-profile/
  • /unlink/
  • /upload-lens-image
  • /upload-lens-image-history
  • /upload-shuffle-draft
  • /v1/urls/count.json
  • /v3/pidgets/log/
  • /website/confirm/
  • /website/confirm/download*
  • /welcome/
  • /your-shop/
  • /your-shop/*
googlebot
  • /_ngjs/resource/*/get/
  • /business/create/
  • /resource/*/get/
  • /*/*/*/_tools/*
  • /*/*/*/more_ideas/
  • /*/*/_tools/*
  • /*/*/activity/*
  • /*/*/group/
  • /*/*/invite/
  • /*/*/more_ideas/*
  • /*/?*amp_client_id*
  • /*/?z=1
  • /*/__wishlist__/*
  • /*/_activities/*
  • /*/_activity/*
  • /*/_community/*
  • /*/_created/*
  • /*/_followers/*
  • /*/_following/*
  • /*/_quick_saves/*
  • /*/_saved/*
  • /*/_shop/*
  • /*/_shopping_list/*
  • /*/communities/
  • /*/discovered/*
  • /*/followers/*
  • /*/following/*
  • /*/likes/*
  • /*/organize/*
  • /*/pins/
  • /*/profile-about/
  • /*/scheduled-pin/*
  • /*/scheduled-pins/*
  • /*/story_pins/*
  • /*/tagged/*
  • /*/tried/*
  • /*/video_pins/*
  • /?show_error=true
  • /_/_/*
  • /_/_/pixel/*
  • /_ngjs/resource/
  • /about/*
  • /addboard/
  • /admin/
  • /age-appeal/*
  • /amp/*
  • /appealed-pin/
  • /autocomplete/
  • /board/*
  • /board_activity/*
  • /board_activity_comment/*
  • /bookmarklet/
  • /branded-pins/
  • /business/ad_create/
  • /business/business-access/*
  • /business/business-hierarchy/*
  • /business/business-manager/*
  • /business/catalogs/*
  • /business/commerce-integrations/*
  • /business/community-information/
  • /business/convert/
  • /business/create-linked-account/
  • /business/hub/
  • /business/invite/*
  • /business/onboarding/
  • /business/pin_create/
  • /business/referral/*
  • /business/site/
  • /business/switch-account/
  • /business/top-ads/
  • /business/update/
  • /business/verified-merchant/status/
  • /christmas-spotlight/
  • /close-account/
  • /communities/*
  • /community/*
  • /community_comment/*
  • /community_post/*
  • /connect/*/
  • /content-claiming/*
  • /conversation/*
  • /conversations/*
  • /convert-business/
  • /convert-personal/
  • /copyright-reporting/*
  • /create_pin/
  • /creative-studio/
  • /creative_editor/
  • /creator-spotlight/*
  • /creator_hub/_earn
  • /creator_hub/_partnerships
  • /csrf_error/
  • /ct.html
  • /deactivate-account/
  • /delete_post/
  • /discover/*
  • /edit/*
  • /editorial/*/*/
  • /email/*
  • /email_verification_error/
  • /engagement/*
  • /explore/*
  • /explore/*/?p=*
  • /facebook/
  • /fb.html
  • /follow_board/
  • /follow_user/
  • /google_gdn.html
  • /google_search.html
  • /hanukkah-spotlight/
  • /holiday-spotlight/
  • /holidays-celebrations/
  • /homefeed/
  • /homefeed/*
  • /idea-ads-tool/*
  • /idea-pin-builder/*
  • /idea-pin-invite/
  • /install-shuffles/
  • /invite/
  • /invited/
  • /join/?next=*
  • /join/signup/?next=*
  • /kwanzaa-spotlight/
  • /lens-search/*
  • /linked/*
  • /live-session/*
  • /login/?next=*
  • /logout/
  • /m/
  • /new_invite/
  • /news_hub/*
  • /notifications/
  • /oauth/line/*
  • /oauth/login/*
  • /oauth_error/
  • /offsite/
  • /parental-consent/confirmation/
  • /parental-passcode/
  • /password/reset/
  • /password/reset/*
  • /pin-builder/*
  • /pin-communities/*
  • /pin-creation-tool/*
  • /pin-editor/
  • /pin/*/activities
  • /pin/*/activity/
  • /pin/*/analytics
  • /pin/*/brand-catalog/
  • /pin/*/brand-catalog/*
  • /pin/*/comments
  • /pin/*/email
  • /pin/*/feedback
  • /pin/*/idea-pin/related-products/*
  • /pin/*/likes
  • /pin/*/promote
  • /pin/*/reaction
  • /pin/*/related-products
  • /pin/*/related-products/*
  • /pin/*/repin
  • /pin/*/repins
  • /pin/*/share
  • /pin/*/shop-the-look/*
  • /pin/*/tag
  • /pin/*/takes
  • /pin/*/visual-search
  • /pin/*/visual-shop
  • /pin/create/*
  • /pin/find/
  • /pin/find?url=*
  • /pin_shop/*
  • /pinterest-predicts/
  • /pinterest-wellbeing/*
  • /pinterestwellbeing/*
  • /place/*
  • /prefs/
  • /product-catalogs/
  • /product-catalogs/*
  • /product-feed/
  • /pw/*
  • /quiz/*
  • /recently-viewed/
  • /refresh_stored_accounts
  • /refresh_token
  • /register/
  • /reports-and-violations/
  • /request-data/
  • /resource/
  • /safe-redirect/
  • /search/
  • /search?
  • /secure/*
  • /sendheaderearly/
  • /settings/*
  • /shop_pins/*
  • /signup/*
  • /socialmanager/*
  • /source/*
  • /sso/*
  • /story-pin-builder/*
  • /story-pin-invite/
  • /story_feed/
  • /story_pins/*
  • /suspension-appeal/*
  • /sw-shell.html
  • /taggingtool/*
  • /thanksgiving-spotlight/
  • /theme/*
  • /tv/*
  • /unauth-profile/
  • /unlink/
  • /upload-lens-image
  • /upload-lens-image-history
  • /upload-shuffle-draft
  • /v1/urls/count.json
  • /v3/pidgets/log/
  • /website/confirm/
  • /website/confirm/download*
  • /welcome/
  • /your-shop/
  • /your-shop/*
twitterbot
  • /_ngjs/resource/*/get/
  • /business/create/
  • /pin/*/feedback
  • /pin/*/sent
  • /resource/*/get/
  • /*/*/*/_tools/*
  • /*/*/*/more_ideas/
  • /*/*/_tools/*
  • /*/*/activity/*
  • /*/*/group/
  • /*/*/invite/
  • /*/*/more_ideas/*
  • /*/?*amp_client_id*
  • /*/?z=1
  • /*/__wishlist__/*
  • /*/_activities/*
  • /*/_activity/*
  • /*/_community/*
  • /*/_created/*
  • /*/_followers/*
  • /*/_following/*
  • /*/_quick_saves/*
  • /*/_saved/*
  • /*/_shop/*
  • /*/_shopping_list/*
  • /*/communities/
  • /*/discovered/*
  • /*/followers/*
  • /*/following/*
  • /*/likes/*
  • /*/organize/*
  • /*/pins/
  • /*/profile-about/
  • /*/scheduled-pin/*
  • /*/scheduled-pins/*
  • /*/story_pins/*
  • /*/tagged/*
  • /*/tried/*
  • /*/video_pins/*
  • /?show_error=true
  • /_/_/*
  • /_/_/pixel/*
  • /_ngjs/resource/
  • /about/*
  • /addboard/
  • /admin/
  • /age-appeal/*
  • /amp/*
  • /appealed-pin/
  • /autocomplete/
  • /board/*
  • /board_activity/*
  • /board_activity_comment/*
  • /bookmarklet/
  • /branded-pins/
  • /business/ad_create/
  • /business/business-access/*
  • /business/business-hierarchy/*
  • /business/business-manager/*
  • /business/catalogs/*
  • /business/commerce-integrations/*
  • /business/community-information/
  • /business/convert/
  • /business/create-linked-account/
  • /business/hub/
  • /business/invite/*
  • /business/onboarding/
  • /business/pin_create/
  • /business/referral/*
  • /business/site/
  • /business/switch-account/
  • /business/top-ads/
  • /business/update/
  • /business/verified-merchant/status/
  • /christmas-spotlight/
  • /close-account/
  • /communities/*
  • /community/*
  • /community_comment/*
  • /community_post/*
  • /connect/*/
  • /content-claiming/*
  • /conversation/*
  • /conversations/*
  • /convert-business/
  • /convert-personal/
  • /copyright-reporting/*
  • /create_pin/
  • /creative-studio/
  • /creative_editor/
  • /creator-spotlight/*
  • /creator_hub/_earn
  • /creator_hub/_partnerships
  • /csrf_error/
  • /ct.html
  • /deactivate-account/
  • /delete_post/
  • /discover/*
  • /edit/*
  • /editorial/*/*/
  • /email/*
  • /email_verification_error/
  • /engagement/*
  • /explore/*
  • /explore/*/?p=*
  • /facebook/
  • /fb.html
  • /follow_board/
  • /follow_user/
  • /google_gdn.html
  • /google_search.html
  • /hanukkah-spotlight/
  • /holiday-spotlight/
  • /holidays-celebrations/
  • /homefeed/
  • /homefeed/*
  • /idea-ads-tool/*
  • /idea-pin-builder/*
  • /idea-pin-invite/
  • /install-shuffles/
  • /invite/
  • /invited/
  • /join/?next=*
  • /join/signup/?next=*
  • /kwanzaa-spotlight/
  • /lens-search/*
  • /linked/*
  • /live-session/*
  • /login/?next=*
  • /logout/
  • /m/
  • /new_invite/
  • /news_hub/*
  • /notifications/
  • /oauth/line/*
  • /oauth/login/*
  • /oauth_error/
  • /offsite/
  • /parental-consent/confirmation/
  • /parental-passcode/
  • /password/reset/
  • /password/reset/*
  • /pin-builder/*
  • /pin-communities/*
  • /pin-creation-tool/*
  • /pin-editor/
  • /pin/*/activities
  • /pin/*/activity/
  • /pin/*/analytics
  • /pin/*/brand-catalog/
  • /pin/*/brand-catalog/*
  • /pin/*/comments
  • /pin/*/email
  • /pin/*/idea-pin/related-products/*
  • /pin/*/likes
  • /pin/*/promote
  • /pin/*/reaction
  • /pin/*/related-products
  • /pin/*/related-products/*
  • /pin/*/repin
  • /pin/*/repins
  • /pin/*/share
  • /pin/*/shop-the-look/*
  • /pin/*/tag
  • /pin/*/takes
  • /pin/*/visual-search
  • /pin/*/visual-shop
  • /pin/create/*
  • /pin/find/
  • /pin/find?url=*
  • /pin_shop/*
  • /pinterest-predicts/
  • /pinterest-wellbeing/*
  • /pinterestwellbeing/*
  • /place/*
  • /prefs/
  • /product-catalogs/
  • /product-catalogs/*
  • /product-feed/
  • /pw/*
  • /quiz/*
  • /recently-viewed/
  • /refresh_stored_accounts
  • /refresh_token
  • /register/
  • /reports-and-violations/
  • /request-data/
  • /resource/
  • /safe-redirect/
  • /search/
  • /search?
  • /secure/*
  • /sendheaderearly/
  • /settings/*
  • /shop_pins/*
  • /signup/*
  • /socialmanager/*
  • /source/*
  • /sso/*
  • /story-pin-builder/*
  • /story-pin-invite/
  • /story_feed/
  • /story_pins/*
  • /suspension-appeal/*
  • /sw-shell.html
  • /taggingtool/*
  • /thanksgiving-spotlight/
  • /theme/*
  • /tv/*
  • /unauth-profile/
  • /unlink/
  • /upload-lens-image
  • /upload-lens-image-history
  • /upload-shuffle-draft
  • /v1/urls/count.json
  • /v3/pidgets/log/
  • /website/confirm/
  • /website/confirm/download*
  • /welcome/
  • /your-shop/
  • /your-shop/*
mediapartners-google No explicit Allow rules. No explicit Disallow rules.
amazonadbot
  • /pin/
  • /search/*
  • /
google-adstxt No explicit Allow rules. No explicit Disallow rules.
iab-tech-lab
  • /ads.txt
  • /app-ads.txt
  • /
adidxbot No explicit Allow rules. No explicit Disallow rules.
adsbot-google No explicit Allow rules. No explicit Disallow rules.
adsbot-google-mobile No explicit Allow rules. No explicit Disallow rules.
axonbot No explicit Allow rules. No explicit Disallow rules.
google web preview No explicit Allow rules. No explicit Disallow rules.
google-ads-overview No explicit Allow rules. No explicit Disallow rules.
google-adwords-express No explicit Allow rules. No explicit Disallow rules.
google-adwords-instant No explicit Allow rules. No explicit Disallow rules.
linkedinbot No explicit Allow rules. No explicit Disallow rules.
meta-externalads No explicit Allow rules. No explicit Disallow rules.
snapchatads No explicit Allow rules. No explicit Disallow rules.
taboolabot
  • /
 No explicit Disallow rules.
yandexadditional No explicit Allow rules. No explicit Disallow rules.
yandexadditionalbot No explicit Allow rules.
  • /
* No explicit Allow rules.
  • /

Blocked and Allowed Paths

Blocked paths
  • /*/*/*/_tools/*
  • /*/*/*/more_ideas/
  • /*/*/_tools/*
  • /*/*/activity/*
  • /*/*/group/
  • /*/*/invite/
  • /*/*/more_ideas/*
  • /*/?*amp_client_id*
  • /*/?z=1
  • /*/__wishlist__/*
  • /*/_activities/*
  • /*/_activity/*
  • /*/_community/*
  • /*/_created/*
  • /*/_followers/*
  • /*/_following/*
  • /*/_quick_saves/*
  • /*/_saved/*
  • /*/_shop/*
  • /*/_shopping_list/*
  • /*/communities/
  • /*/discovered/*
  • /*/followers/*
  • /*/following/*
  • /*/likes/*
  • /*/organize/*
  • /*/pins/
  • /*/profile-about/
  • /*/scheduled-pin/*
  • /*/scheduled-pins/*
  • /*/story_pins/*
  • /*/tagged/*
  • /*/tried/*
  • /*/video_pins/*
  • /?show_error=true
  • /_/_/*
  • /_/_/pixel/*
  • /_ngjs/resource/
  • /about/*
  • /addboard/
  • /admin/
  • /age-appeal/*
  • /amp/*
  • /appealed-pin/
  • /autocomplete/
  • /board/*
  • /board_activity/*
  • /board_activity_comment/*
  • /bookmarklet/
  • /branded-pins/
  • /business/ad_create/
  • /business/business-access/*
  • /business/business-hierarchy/*
  • /business/business-manager/*
  • /business/catalogs/*
  • /business/commerce-integrations/*
  • /business/community-information/
  • /business/convert/
  • /business/create-linked-account/
  • /business/hub/
  • /business/invite/*
  • /business/onboarding/
  • /business/pin_create/
  • /business/referral/*
  • /business/site/
  • /business/switch-account/
  • /business/top-ads/
  • /business/update/
  • /business/verified-merchant/status/
  • /christmas-spotlight/
  • /close-account/
  • /communities/*
  • /community/*
  • /community_comment/*
  • /community_post/*
  • /connect/*/
  • /content-claiming/*
  • /conversation/*
  • /conversations/*
  • /convert-business/
  • /convert-personal/
  • /copyright-reporting/*
  • /create_pin/
  • /creative-studio/
  • /creative_editor/
  • /creator-spotlight/*
  • /creator_hub/_earn
  • /creator_hub/_partnerships
  • /csrf_error/
  • /ct.html
  • /deactivate-account/
  • /delete_post/
  • /discover/*
  • /edit/*
  • /editorial/*/*/
  • /email/*
  • /email_verification_error/
  • /engagement/*
  • /explore/*/?p=*
  • /facebook/
  • /fb.html
  • /follow_board/
  • /follow_user/
  • /google_gdn.html
  • /google_search.html
  • /hanukkah-spotlight/
  • /holiday-spotlight/
  • /holidays-celebrations/
  • /homefeed/
  • /homefeed/*
  • /idea-ads-tool/*
  • /idea-pin-builder/*
  • /idea-pin-invite/
  • /install-shuffles/
  • /invite/
  • /invited/
  • /join/?next=*
  • /join/signup/?next=*
  • /kwanzaa-spotlight/
  • /lens-search/*
  • /linked/*
  • /live-session/*
  • /login/?next=*
  • /logout/
  • /m/
  • /new_invite/
  • /news_hub/*
  • /notifications/
  • /oauth/line/*
  • /oauth/login/*
  • /oauth_error/
  • /offsite/
  • /parental-consent/confirmation/
  • /parental-passcode/
  • /password/reset/
  • /password/reset/*
  • /pin-builder/*
  • /pin-communities/*
  • /pin-creation-tool/*
  • /pin-editor/
  • /pin/*/activities
  • /pin/*/activity/
  • /pin/*/analytics
  • /pin/*/brand-catalog/
  • /pin/*/brand-catalog/*
  • /pin/*/comments
  • /pin/*/email
  • /pin/*/feedback
  • /pin/*/idea-pin/related-products/*
  • /pin/*/likes
  • /pin/*/promote
  • /pin/*/reaction
  • /pin/*/related-products
  • /pin/*/related-products/*
  • /pin/*/repin
  • /pin/*/repins
  • /pin/*/share
  • /pin/*/shop-the-look/*
  • /pin/*/tag
  • /pin/*/takes
  • /pin/*/visual-search
  • /pin/*/visual-shop
  • /pin/create/*
  • /pin/find/
  • /pin/find?url=*
  • /pin_shop/*
  • /pinterest-predicts/
  • /pinterest-wellbeing/*
  • /pinterestwellbeing/*
  • /place/*
  • /prefs/
  • /product-catalogs/
  • /product-catalogs/*
  • /product-feed/
  • /pw/*
  • /quiz/*
  • /recently-viewed/
  • /refresh_stored_accounts
  • /refresh_token
  • /register/
  • /reports-and-violations/
  • /request-data/
  • /resource/
  • /safe-redirect/
  • /search/
  • /search?
  • /secure/*
  • /sendheaderearly/
  • /settings/*
  • /shop_pins/*
  • /signup/*
  • /socialmanager/*
  • /source/*
  • /sso/*
  • /story-pin-builder/*
  • /story-pin-invite/
  • /story_feed/
  • /story_pins/*
  • /suspension-appeal/*
  • /sw-shell.html
  • /taggingtool/*
  • /thanksgiving-spotlight/
  • /theme/*
  • /tv/*
  • /unauth-profile/
  • /unlink/
  • /upload-lens-image
  • /upload-lens-image-history
  • /upload-shuffle-draft
  • /v1/urls/count.json
  • /v3/pidgets/log/
  • /website/confirm/
  • /website/confirm/download*
  • /welcome/
  • /your-shop/
  • /your-shop/*
  • /explore/*
  • /
Allowed paths
  • /_ngjs/resource/*/get/
  • /business/create/
  • /resource/*/get/
  • /pin/*/feedback
  • /pin/*/sent
  • /pin/
  • /search/*
  • /ads.txt
  • /app-ads.txt
  • /
Crawl-delay No Crawl-delay directive detected.

Sitemaps Detected

AI Crawler Policy

No explicit blocks were detected for common AI crawlers (GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended).

Issues Found

  • At least one user-agent has Disallow: / which blocks the entire site.
  • robots.txt contains a very large number of Disallow rules; consider simplifying patterns.

Recommendations

  • Avoid blocking the entire site (Disallow: /); restrict only sensitive or low-value paths instead.
  • Consolidate overlapping Disallow rules into simpler patterns to keep robots.txt maintainable.
  • Document your AI crawler policy explicitly in robots.txt so future bots know how to treat your content.
  • Ensure important pages, CSS and JavaScript assets are crawlable so search engines can fully render your site.

Analyze this site with other tools

Want a website that actually generates leads?

Start a conversion-focused website project with a team that builds fast, SEO-optimized sites for real businesses.

Start project