KunatoCrawler
KunatoCrawler is blocked by 70 sites in the October 2026 survey, or 1.1% of readable files. Its operator is unclear in the community reference.
Who runs KunatoCrawler?
| Fact | KunatoCrawler reference entry |
|---|---|
| Operator | “Unclear at this time.” |
| Purpose | “Undocumented AI Agents” |
| Does KunatoCrawler obey robots.txt? | “Unclear at this time.” |
| Frequency | “Unclear at this time.” |
| Cloudflare managed list for KunatoCrawler | No |
These facts quote the stored community ai.robots.txt reference.
The reference leaves this agent’s purpose undocumented. Allowing people to find and read a page need not include permission to gather it for model training. Owners can express those choices in crawler-specific groups.
How many sites block it?
Our readable sample has 70 whole-site blocks, 1.1% of 6,171 files, with Disallow: / as the instruction. Of that full sample, 66 name this crawler, or 1.1%. The count without a whole-site block is 6,101.
For the top 1,000 ranks, its name appears in 21 files out of 552, or 3.8%. Whole-site blocks total 21. Blocking is more common among the leading sites, at 3.8%. Lower in the ranking, blocking reaches 49 files out of 5,619, a 0.9% share.
| Readable files | Named by | Named share | Blocked by | Blocked share |
|---|---|---|---|---|
| KunatoCrawler, all ranks | 66 | 1.1% | 70 | 1.1% |
| KunatoCrawler, top 1,000 | 21 | 3.8% | 21 | 3.8% |
| KunatoCrawler, remaining ranks | 45 | 0.8% | 49 | 0.9% |
This total covers whole-site bans recorded for this name. A blanket User-agent: * rule alone is outside this measure. Of 70 blocks, 6 do not also appear in our count of files naming it. Names and bans overlap in 64 files. We also found 2 files with a name and no whole-site ban, plus 6,105 files omitting the name. Case changes and repeated spellings are merged.
How to block or allow it
Place the group in your root robots.txt file. Per the robots.txt standard, a named group for KunatoCrawler overrides User-agent: *.
Block the whole site
User-agent: KunatoCrawler
Disallow: /Allow access
User-agent: KunatoCrawler
Allow: /It's the 93rd most-named crawler of the 171 we counted in the crawler index.
How we counted
For KunatoCrawler, our 19 October 2026 collection used Tranco’s top 10,000 sites. Files had an 8-second timeout and a 262,144-byte limit. Only available files we could read enter the percentages. Reading files again used scripts/robots_2026_08_06.py (robots.py at app commit 07104ff) as well. See the full survey method.
Common questions
Does a User-agent line mean it is blocked?
This survey includes 2 files with the name and no whole-site ban, out of 66 naming files.
What do the top-ranked sites show?
Within readable robots.txt files near the top of the ranking, 3.8% name it and 3.8% block it. Overall, naming reaches 1.1% and blocking 1.1%.
Which nearby entry can I compare?
The nearby CloudflareBrowserRenderingCrawler entry reports 65 files that name it and 68 whole-site blocks, 1.1% of readable files. Here, 66 files mention the name and 70 block access, or 1.1%.