About our crawler

We operate CompareDogBoardingPricesBot/1.0, a polite web crawler used to keep prices and contact details on this site accurate and current. If you operate a licensed dog boarding business and your website is in our directory, this page explains what we do and how you can opt out.

What we crawl

• Public pricing, services, and contact pages on operator websites.
• Council Animal Activity Licensing registers under UK Schedule 3 disclosure.

What we do not crawl

• Login areas, customer portals, booking calendars.
• Images at scale.
• Anything blocked by your robots.txt.

How to recognise us

Our requests carry the User-Agent:

CompareDogBoardingPricesBot/1.0 (+https://comparedogboardingprices.co.uk/crawler-info)

Rate: at most 1 request every 5 seconds per domain, with a single concurrent worker.

Opt out

Add this to your robots.txt:

User-agent: CompareDogBoardingPricesBot
Disallow: /

We honour this on the next scheduled fetch. To remove a profile from the directory entirely, see Corrections & takedowns.

Contact

Email crawler@comparedogboardingprices.co.uk with any concerns or to coordinate a more targeted opt-out.