SeolinBot
SeolinBot is the crawler behind the Seolin SEO audit tool. If you've seen this name in your server logs, someone — most likely you or someone on your team — started a technical SEO audit of your site. SeolinBot is not a search engine: it doesn't index your pages or publish your content, and it only runs when an audit is requested.
How to identify it
All our requests use this User-Agent:
SeolinBot/1.0 (+https://seolin.io/bot)The name we match in robots.txt rules is SeolinBot; if there's no group for that name, we follow the User-agent: * group.
What it does on your site
- It reads robots.txt first (RFC 9309). If a path is disallowed, it never requests it. If robots.txt returns a server error (5xx), it treats the whole site as blocked and doesn't start the crawl.
- It's slow. It sends at most one request per second to the same site. That limit applies across all audits of your site combined, not per audit.
- It reads only a few pages. On a site without verified ownership, it crawls at most 25 pages and goes no deeper than 4 clicks from the homepage. If the site owner has verified ownership in Google Search Console, the limit rises to 250 pages. The limit is set at the start of each audit, based on the site's verification status at that moment, and doesn't change while the audit runs: the page count you see in your logs reflects the limit in place when that audit started.
- Audits are limited. A free audit (no account needed) can be started at most 3 times per hour for the same site, across all our visitors combined. Users who add the site to their account start audits themselves from the dashboard; only one audit runs at a time for the same site, and a new one waits for the previous one to finish.
- It only reads. It doesn't fill in forms, sign in or enter areas that require a login, and it only sends GET/HEAD requests. It doesn't crawl domains other than the one in the starting address.
- It stays off local networks. Requests that point to private IP ranges, local network addresses or cloud metadata services are refused before they're sent.
What we read: your pages' titles, meta tags, links, status codes and structured data, plus your robots.txt and XML sitemap files. We don't store the full content of pages (Privacy Policy, 2.d).
We don't currently measure speed (Google PageSpeed Insights), so your site won't get a request identified as Chrome-Lighthouse during an audit. Every request the audit sends to your site carries the SeolinBot identifier.
How to block it
To stop SeolinBot from crawling your site at all, add this to your robots.txt file:
User-agent: SeolinBot
Disallow: /robots.txt is read again at the start of every audit, so changes take effect from the next audit. To block specific directories, use the Disallow: /directory/ format.
Contact
If you think SeolinBot is causing problems on your site, write to us with the time of the request, the target URL and the User-Agent line from your logs: Contact. We don't repeat the address here — only one page knows whether an address has been published.