AI2Bot-DeepResearchEval
AI2Bot-DeepResearchEval is blocked by 258 sites in the October 2026 survey, or 4.2% of readable files. The community reference lists its operator as Ai2, a non-profit AI research institute.
Who runs AI2Bot-DeepResearchEval?
| Fact | AI2Bot-DeepResearchEval reference entry |
|---|---|
| Operator | “Ai2, a non-profit AI research institute” |
| Purpose | “AI Assistants” |
| Does AI2Bot-DeepResearchEval obey robots.txt? | “Unclear at this time.” |
| Frequency | “Unclear at this time.” |
| Cloudflare managed list for AI2Bot-DeepResearchEval | No |
These facts quote the stored community ai.robots.txt reference.
“Ai2Bot-DeepResearchEval is operated by Ai2, a non-profit AI research institute. It's used to collect and scan resources used in deep research queries performed by Ai2's o…”
The stated role here is an AI assistant. Using a page as a search result can send people to it. Training models uses its contents for another purpose, which an owner may refuse.
How many sites block it?
Our readable sample has 258 whole-site blocks, 4.2% of 6,171 files, with Disallow: / as the instruction. Of that full sample, 70 name this crawler, or 1.1%. The count without a whole-site block is 5,913.
Breaking out the leading 1,000 sites gives 552 readable files, with 20 naming the crawler, or 3.6%. Whole-site blocking appears in 39 of them. Blocking is more common among the leading sites, at 7.1%. Beyond those ranks, 5,619 files have a blocking total of 219, 3.9% of that sample.
| Readable files | Named by | Named share | Blocked by | Blocked share |
|---|---|---|---|---|
| AI2Bot-DeepResearchEval, all ranks | 70 | 1.1% | 258 | 4.2% |
| AI2Bot-DeepResearchEval, top 1,000 | 20 | 3.6% | 39 | 7.1% |
| AI2Bot-DeepResearchEval, remaining ranks | 50 | 0.9% | 219 | 3.9% |
This total covers whole-site bans recorded for this name. A blanket User-agent: * rule alone is outside this measure. Of 258 blocks, 191 do not also appear in our count of files naming it. We found 67 files naming it and blocking the whole site, along with 3 files naming it without that ban. Another 6,101 files omit the name. We ignore capitalization and repeated names.
How to block or allow it
Edit the root robots.txt file on your site. The robots.txt standard gives a AI2Bot-DeepResearchEval group precedence over User-agent: * for this crawler.
Block the whole site
User-agent: AI2Bot-DeepResearchEval
Disallow: /Allow access
User-agent: AI2Bot-DeepResearchEval
Allow: /It's the 84th most-named crawler of the 171 we counted in the crawler index.
Which other crawlers does this operator run?
How we counted
For AI2Bot-DeepResearchEval, the survey covered 10,000 top Tranco sites, collected on 19 October 2026. Each file had 8 seconds to arrive, up to 262,144 bytes. Shares exclude unreachable, unavailable and oversized files. Repeat readings are included, using scripts/robots_2026_08_06.py (robots.py at app commit 07104ff). See the full survey method.
Common questions
Can a file name it and still allow it?
The 70 files naming it include 3 files without a whole-site ban.
How do the shares compare by rank?
Leading files record 3.6% with the name and 7.1% blocking it. Across all readable files, the corresponding shares are 1.1% and 4.2%.
What other entry is close in the index?
For comparison, Andibot has 70 files naming it and 54 blocks, or 0.9%. Our counts for this entry are 70 files with the name and 258 blocking the whole site, or 4.2%.