For webmasters
About our crawler
You reached this page from a user agent string in your server log. Here is exactly what that request was, what our crawler does, and how to turn it off.
User agent
ConformTrailBot/1.0 (+https://conformtrail.com/bot)
What it does
- Fetches public pages of a website and records what is displayed on them: the text, the element it sits in, and the date it was seen.
- Reads robots.txt first and follows it. A disallowed path is not fetched.
- Keeps to at most one request per second per host, with a small number of pages per site, so the load is lower than a single human browsing the site.
- Sends the user agent above on every request, with a link back to this page.
- Lists documents and scripts that public pages link to or load, so an inventory can say where each of them comes from.
- Takes screenshots of public pages to show what was displayed at that place on that date.
What it never does
- Submit a form. Search boxes, contact forms and filters are left alone.
- Log in, or try to. No credentials, no password fields, no patient or member portals.
- Upload anything anywhere.
- Click cookie banners or consent dialogs to get past them.
- Ignore robots.txt, a rate limit, or a block.
- Collect personal data, protected health information, or screenshots of filled-in form fields.
- Attempt to bypass a paywall, a login wall or any access control.
Why your site was fetched
ConformTrail records what public web pages display and watches them for changes, so that the operator of a site has a dated record of its own pages. If your site was read you are either a customer, or a business whose public pages we read once to see whether there is anything worth writing to you about. Either way the rules on this page applied, and you can stop it below.
How to block it
Add this to your robots.txt and the crawler stops on its next run:
User-agent: ConformTrailBot
Disallow: /Or write to support@conformtrail.com with the domain and we will add it to our exclusion list by hand, which also removes any data we already hold about that site. Blocking is permanent until you ask us to lift it.
Contact
Operator: Keydams (Andreas Adams, Nueva Colombia, Paraguay). Email: support@conformtrail.com. Postal address: not yet published. See also the privacy notice and the operator page.