About our site checker
Visitors to dcwebapp.com can run a free check on a website. Our checker then reads that site's public pages once, the way a search engine does.
What it reads
- Your robots.txt file, first. We follow its rules.
- Your homepage.
- On WordPress sites, the page and post totals from WordPress's public data feed.
- Up to 5 of your sitemap files, to count pages.
It never logs in, fills in forms or sends attack tests.
How it identifies itself
User agent: Mozilla/5.0 (compatible; DCWebAppsCheck/1.0; +https://dcwebapp.com/bot). Requests come from Cloudflare's network.
How often
We keep each result for one hour, so repeat checks do not reach your site. Your site can be checked at most 10 times an hour in total.
If your firewall blocks it
We tell the visitor that your site blocked the check. We never retry or work around a block.
How to block it
Add this to your robots.txt:
User-agent: DCWebAppsCheck
Disallow: /