How the checker reads websites
The SEO & AI visibility checker reads a website with a small automated reader. The check now runs on clickzero.co, where it identifies itself as ClickZeroVisibilityBot; that crawler is documented on ClickZero's crawler page. Before, when the check ran on this site, it used the name below. If you saw DaniyalVisibilityBot in your logs, someone asked for a check of that website then, or I ran one for them.
DaniyalVisibilityBot/1.0 (+https://daniyalsherafat.com/bot)
What it does
- Fetches at most 12 HTML pages of one site, at most 30 requests in total, two at a time, once per check. Checks for the same site are not repeated within days.
- Reads robots.txt first and obeys rules for
DaniyalVisibilityBotand*, including Crawl-delay. - Does not run JavaScript, log in, submit forms, download media, or fetch anything outside the requested site.
- Stops after 45 seconds or 2 MB per page, whichever comes first.
How to block it
User-agent: DaniyalVisibilityBot Disallow: / User-agent: ClickZeroVisibilityBot Disallow: /
Requests from it will then stop at your robots.txt. The person who asked for the check will see that the site could not be read.
Questions or complaints: daniyal@clickzero.co.
FAQ
Questions about the crawler
Why is DaniyalVisibilityBot in my server logs?
Someone requested an SEO & AI visibility check of that website while the check still ran on this site, or I ran one for them. It reads at most twelve pages, once. New checks run on clickzero.co and read sites as ClickZeroVisibilityBot.
How do I block it?
Two lines in your robots.txt, shown above. It obeys rules written for its own name and for the wildcard, including Crawl-delay, and stops at the robots file.
Does blocking AI crawlers hurt my visibility?
Blocking training crawlers such as GPTBot, ClaudeBot or Google-Extended does not change whether assistants can find you when they search. Blocking the search crawlers, such as OAI-SearchBot, Claude-SearchBot, PerplexityBot or Googlebot, does. The check reports the two groups separately and never counts a blocked training crawler as a visibility problem.
Does it store my pages?
It keeps the excerpts used as evidence in the report and a log of what it fetched. Reports are private links that expire; the privacy notice says what is kept and for how long.