AI SEO specialist for local businessesDaniyal Sherafat

How the checker reads websites

The SEO & AI visibility checker reads a website with a small automated reader. The check now runs on clickzero.co, where it identifies itself as ClickZeroVisibilityBot; that crawler is documented on ClickZero's crawler page. Before, when the check ran on this site, it used the name below. If you saw DaniyalVisibilityBot in your logs, someone asked for a check of that website then, or I ran one for them.

DaniyalVisibilityBot/1.0 (+https://daniyalsherafat.com/bot)

What it does

  • Fetches at most 12 HTML pages of one site, at most 30 requests in total, two at a time, once per check. Checks for the same site are not repeated within days.
  • Reads robots.txt first and obeys rules for DaniyalVisibilityBot and *, including Crawl-delay.
  • Does not run JavaScript, log in, submit forms, download media, or fetch anything outside the requested site.
  • Stops after 45 seconds or 2 MB per page, whichever comes first.

How to block it

User-agent: DaniyalVisibilityBot
Disallow: /

User-agent: ClickZeroVisibilityBot
Disallow: /

Requests from it will then stop at your robots.txt. The person who asked for the check will see that the site could not be read.

Questions or complaints: daniyal@clickzero.co.

FAQ

Questions about the crawler

Why is DaniyalVisibilityBot in my server logs?

Someone requested an SEO & AI visibility check of that website while the check still ran on this site, or I ran one for them. It reads at most twelve pages, once. New checks run on clickzero.co and read sites as ClickZeroVisibilityBot.

How do I block it?

Two lines in your robots.txt, shown above. It obeys rules written for its own name and for the wildcard, including Crawl-delay, and stops at the robots file.

Does blocking AI crawlers hurt my visibility?

Blocking training crawlers such as GPTBot, ClaudeBot or Google-Extended does not change whether assistants can find you when they search. Blocking the search crawlers, such as OAI-SearchBot, Claude-SearchBot, PerplexityBot or Googlebot, does. The check reports the two groups separately and never counts a blocked training crawler as a visibility problem.

Does it store my pages?

It keeps the excerpts used as evidence in the report and a log of what it fetched. Reports are private links that expire; the privacy notice says what is kept and for how long.