VerirunScan
If you are here because this name showed up in your server logs: someone scanned your site with Verirun, either from the box on our home page or with the verirun scan command on their own machine. This page says what the scanner does and how to keep it out.
How it identifies itself
Mozilla/5.0 (compatible; VerirunScan/1.0; +https://verirun.in/scanner)
Every request carries that user agent. It is never disguised as a browser or as another crawler.
What it does
- Reads
/robots.txtfirst and obeys it, includingCrawl-delay. - Loads the page it was given and follows links on the same origin: up to 20 pages, two links deep, by default; up to 5 pages, one link deep, from our home page.
- Checks whether the internal links, images, scripts and stylesheets those pages point to respond, using HEAD where the server supports it.
- Reports what failed: error responses, dead links, anchors that point at nothing. The command-line version runs a real browser and also reports JavaScript exceptions and console errors.
What it never does
- Send anything but GET and HEAD requests.
- Click a button, submit a form, sign in, or send cookies or credentials.
- Follow a link that looks destructive: logout, sign out, delete, remove, unsubscribe, cancel and similar.
- Request a path your robots.txt disallows.
- Leave the origin it was pointed at, apart from following a redirect to it.
The scan on our home page
That one runs from our server, so it is deliberately small: at most 5 pages and 80 requests per scan, a pause between requests, a 20 second limit, no JavaScript. Signed-in accounts get a deeper look, up to 20 pages and 2 links deep. Each visitor can run a limited number of scans an hour, and the page as a whole runs a fixed number of scans a day. It refuses private and internal addresses. Results are shown to the person who asked and are not stored, unless a signed-in user chooses to save a shareable report; those are kept for 90 days. Otherwise we keep only anonymous counters for the limits.
A scan run with the command-line tool comes from that person's own machine and network, not from us.
How to block it
Add this to your robots.txt. Both versions of the scanner obey it.
User-agent: VerirunScan Disallow: /
To keep it out of part of a site, disallow just those paths. To slow it down, set a Crawl-delay. You can also block the user agent at your firewall or CDN; the scanner will not try to get around it.
We ask people to scan only sites they own or have permission to scan.