About the Website Monitor crawler
Last updated
If your server logs show requests from the user agent below, this page explains where they come from.
What these requests are
Website Monitor is a monitoring service. Its customers add the address of a website or API they want to watch, and our servers request it on a schedule to see whether it is up. The requests are made on behalf of that customer, or of someone using our free uptime checker. They are not a search-engine crawler and they do not follow links across your site.
User agent: WebsiteMonitor/1.0 (+https://websitemonitor.devcraftkit.com/bot)
What they do
- Send a single GET or HEAD request to the configured address, and follow a limited number of redirects.
- Record the status code, response time, response size and, for HTTPS, the certificate's validity dates. The page content is not stored.
- Run at the interval the customer chose, from one monitoring location. Source IP addresses depend on where the worker runs and can change, so identify requests by user agent.
- Refuse private, internal and metadata addresses, so these requests never target a network that is not publicly reachable.
Stopping them
The simplest way is to ask the person who runs the monitor to remove it. If you do not know who that is, you can refuse requests that carry the user agent above at your web server or firewall, or contact us and we will look into it.
Report a problem
If the traffic is excessive, unexpected or looks like misuse, write to (this deployment has not configured a contact address yet) with the address being requested and the times from your logs. See also the Acceptable Use Policy.