Cotoyogi
Cotoyogi is blocked by 170 sites in the October 2026 survey, or 2.8% of readable files. The community reference lists its operator as ROIS.
Who runs Cotoyogi?
| Fact | Cotoyogi reference entry |
|---|---|
| Operator | “ROIS” |
| Purpose | “AI LLM Scraper.” |
| Does Cotoyogi obey robots.txt? | “Yes” |
| Frequency | “No information provided.” |
| Cloudflare managed list for Cotoyogi | No |
These facts quote the stored community ai.robots.txt reference.
“Scrapes data for AI training in Japanese language.”
This entry’s stated use is quoted above. Someone asking an assistant to open a page is using it for an immediate answer. An owner may permit that request and block automatic training collection.
How many sites block it?
A User-agent line names it in 177 files, 2.9% of 6,171 readable files. Whole-site bans, written Disallow: /, total 170, or 2.8%. That leaves 6,001 without a recorded ban.
Among 552 readable files from the top 1,000 sites, we found 27 files naming it, a 4.9% share, with 26 files blocking the whole site. Blocking is more common among the leading sites, at 4.7%. Outside this group, 5,619 files contribute 144 blocks, or 2.6%.
| Readable files | Named by | Named share | Blocked by | Blocked share |
|---|---|---|---|---|
| Cotoyogi, all ranks | 177 | 2.9% | 170 | 2.8% |
| Cotoyogi, top 1,000 | 27 | 4.9% | 26 | 4.7% |
| Cotoyogi, remaining ranks | 150 | 2.7% | 144 | 2.6% |
Blocking here counts whole-site bans recorded for it by name. A general ban for all crawlers is excluded. Names and bans overlap in 170 files. We also found 7 files with a name and no whole-site ban, plus 5,994 files omitting the name. Case changes and repeated spellings are merged.
How to block or allow it
These lines go in robots.txt at the root. User-agent: * yields to a group naming Cotoyogi under the robots.txt standard.
Block the whole site
User-agent: Cotoyogi
Disallow: /Allow access
User-agent: Cotoyogi
Allow: /It's the 44th most-named crawler of the 171 we counted in the crawler index.
How we counted
For Cotoyogi, the survey covered 10,000 top Tranco sites, collected on 19 October 2026. Requests could run for 8 seconds, with a 262,144-byte file limit. Missing, unreachable and oversized files do not contribute to these shares. Later readings are included in results from scripts/robots_2026_08_06.py (robots.py at app commit 07104ff). See the full survey method.
Common questions
Can a file name it and still allow it?
A name identifies the crawler addressed by a group. The survey found 7 files with that name and no recorded whole-site ban, out of 177.
How do the shares compare by rank?
At the top of the ranking, 4.9% of readable files name it and 4.7% block it. Across all ranks, those shares are 2.9% and 2.8%.
What other entry is close in the index?
The nearby meta-webindexer entry reports 174 files that name it and 154 whole-site blocks, 2.5% of readable files. Here, 177 files mention the name and 170 block access, or 2.8%.