Groundmarker crawler
Information for site owners and administrators.
Groundmarker operates a web crawler that visits public pages to check
technical SEO health. It is run by Brad Bond AI, a sole proprietorship
based in Nova Scotia, Canada.
User agent
Groundmarker/1.0 (+https://groundmarker.com/bot)
What it does
- Requests public HTML pages and reads their markup
- Checks titles, meta tags, headings, links, redirects and status codes
- Discards the page content once those checks are finished
What it does not do
- Submit forms or interact with your site in any way
- Log in, or request anything behind authentication
- Keep copies of your pages after checking them
- Collect or store personal information found on your pages
How it behaves
- Obeys
robots.txt, including Crawl-delay
- One request at a time per site, with a delay between requests
- Backs off automatically on
429 and 5xx responses
- Limits sites that are not operated by our customers to 100 pages
How to block it
Add this to your robots.txt:
User-agent: Groundmarker
Disallow: /
We honour it from the next crawl onward. You do not need to contact us.
Contact
If you have questions, or a problem with our crawling, email
brad@bradbond.org and we will
respond.