SEO and AI marketing specialist for fitness studiosDaniyal Sherafat

How the checker reads websites

The SEO & AI visibility checker reads a website with a small automated reader called DaniyalVisibilityBot. If you saw this name in your logs, someone asked for an SEO & AI visibility check of that website on this site, or I ran one for them.

DaniyalVisibilityBot/1.0 (+https://daniyalsherafat.com/bot)

What it does

  • Fetches at most 12 HTML pages of one site, at most 30 requests in total, two at a time, once per check. Checks for the same site are not repeated within days.
  • Reads robots.txt first and obeys rules for DaniyalVisibilityBot and *, including Crawl-delay.
  • Does not run JavaScript, log in, submit forms, download media, or fetch anything outside the requested site.
  • Stops after 45 seconds or 2 MB per page, whichever comes first.

How to block it

User-agent: DaniyalVisibilityBot
Disallow: /

Requests from it will then stop at your robots.txt. The person who asked for the check will see that the site could not be read.

Questions or complaints: daniyal@clickzero.co.

FAQ

Questions about the crawler

Why is DaniyalVisibilityBot in my server logs?

Someone requested an SEO & AI visibility check of that website on this site, or I ran one for them. It reads at most twelve pages, once, and checks for the same site are not repeated within days.

How do I block it?

Two lines in your robots.txt, shown above. It obeys rules written for its own name and for the wildcard, including Crawl-delay, and stops at the robots file.

Does blocking AI crawlers hurt my visibility?

Blocking training crawlers such as GPTBot, ClaudeBot or Google-Extended does not change whether assistants can find you when they search. Blocking the search crawlers, such as OAI-SearchBot, Claude-SearchBot, PerplexityBot or Googlebot, does. The check reports the two groups separately and never counts a blocked training crawler as a visibility problem.

Does it store my pages?

It keeps the excerpts used as evidence in the report and a log of what it fetched. Reports are private links that expire; the privacy notice says what is kept and for how long.