TypoMonitor
About TypoMonitorBot
TypoMonitorBot is the crawler that reads public pages for TypoMonitor customers. It identifies itself, obeys your robots.txt rules and keeps a gentle pace.
What TypoMonitorBot Does
The crawler requests public pages on behalf of a person who asked TypoMonitor to check a site. It reads visible text for spelling mistakes and requests the links and images on the page to see whether they respond. It does not log in, fill out forms or change anything.
You may see it in your server logs when a site owner runs a scan or the free demo. The requests are ordinary page loads, plus lightweight checks on links and images.
How It Identifies Itself
Every request carries a user agent that names TypoMonitorBot and points to this page, so you can recognize it in your logs.
User agent: TypoMonitorBot/1.0 (+https://typomonitor.com/bot)
The crawler requests only http and https addresses on the standard ports and does not scan private network addresses.
How to Block TypoMonitorBot
Add the following lines to the robots.txt file at the root of your domain. The crawler checks this file before it reads your pages and stops when it is disallowed.
User-agent: TypoMonitorBot
Disallow: /
To block only part of your site, replace the slash with the path you want to protect, for example Disallow: /private/.
How to Allow It and Limit Its Pace
If your robots.txt file allows all crawlers, you need to do nothing. To state your permission explicitly, add a group that leaves the disallow line empty.
User-agent: TypoMonitorBot
Disallow:
To limit the request rate, add a crawl delay in seconds. The crawler waits that long between requests to your site.
User-agent: TypoMonitorBot
Crawl-delay: 10
If your firewall blocks unknown crawlers, allow requests that carry the user agent above. If you still see unexpected traffic, or you want us to slow the crawler for your domain, write to [email protected] with the domain name and a sample of the log lines, and we will respond.