YandexAdditionalBot
YandexAdditionalBot is blocked by 174 sites in the October 2026 survey, or 2.8% of readable files. The community reference lists its operator as Yandex.
Who runs YandexAdditionalBot?
| Fact | YandexAdditionalBot reference entry |
|---|---|
| Operator | “Yandex” |
| Purpose | “Scrapes/analyzes data for the YandexGPT LLM.” |
| Does YandexAdditionalBot obey robots.txt? | “Yes” |
| Frequency | “No information.” |
| Cloudflare managed list for YandexAdditionalBot | No |
These facts quote the stored community ai.robots.txt reference.
A matching description is used for 1 other entry. Counts below are specific to this crawler.
This entry’s stated use is quoted above. Search indexing is aimed at helping people find pages. Feeding text into model training is another use an owner may decline.
How many sites block it?
Our readable sample has 174 whole-site blocks, 2.8% of 6,171 files, with Disallow: / as the instruction. Of that full sample, 71 name this crawler, or 1.2%. The count without a whole-site block is 5,997.
At the top 1,000 ranks, we could read 552 files. Naming covers 13, a 2.4% share, and blocking covers 30. Blocking is more common among the leading sites, at 5.4%. Elsewhere, 5,619 readable files give 144 blocks, or 2.6%.
| Readable files | Named by | Named share | Blocked by | Blocked share |
|---|---|---|---|---|
| YandexAdditionalBot, all ranks | 71 | 1.2% | 174 | 2.8% |
| YandexAdditionalBot, top 1,000 | 13 | 2.4% | 30 | 5.4% |
| YandexAdditionalBot, remaining ranks | 58 | 1.0% | 144 | 2.6% |
Only whole-site blocks recorded against this crawler’s name count here. Rules addressed to every crawler are outside this count. Of 174 blocks, 107 do not also appear in our count of files naming it. We found 67 files naming it and blocking the whole site, along with 4 files naming it without that ban. Another 6,100 files omit the name. We ignore capitalization and repeated names.
How to block or allow it
Put these in robots.txt at the site root. Per the robots.txt standard, a group naming YandexAdditionalBot takes precedence over User-agent: *.
Block the whole site
User-agent: YandexAdditionalBot
Disallow: /Allow access
User-agent: YandexAdditionalBot
Allow: /It's the 83rd most-named crawler of the 171 we counted in the crawler index.
Which other crawlers does this operator run?
How we counted
For YandexAdditionalBot, on 19 October 2026, we requested robots.txt from Tranco’s top 10,000 sites. An 8-second wait or a file over 262,144 bytes ended a read. Missing, unreachable and oversized files do not contribute to these shares. Repeat readings are included, using scripts/robots_2026_08_06.py (robots.py at app commit 07104ff). See the full survey method.
Common questions
What does naming this crawler tell me?
We found 4 files without a whole-site ban among 71 that name it.
Are leading sites different?
Leading files record 2.4% with the name and 5.4% blocking it. Across all readable files, the corresponding shares are 1.2% and 2.8%.
How does the nearby crawler compare?
AI2Bot-DeepResearchEval is named by 70 files and blocked by 258, or 4.2%. For this crawler, 71 files name it and 174 block it, a 2.8% share.