TongyiBot
TongyiBot has 27 recorded blocks in October 2026, or 0.4%, and 24 files naming it. The community reference lists its operator as Alibaba that fetches web content for the Tongyi Qianwen assistant and related Qwen-generated answers.
Who runs TongyiBot?
| Fact | TongyiBot reference entry |
|---|---|
| Operator | “Alibaba that fetches web content for the Tongyi Qianwen assistant and related Qwen-generated answers” |
| Purpose | “AI Assistants” |
| Does TongyiBot obey robots.txt? | “Unclear at this time.” |
| Frequency | “Unclear at this time.” |
| Cloudflare managed list for TongyiBot | No |
These facts quote the stored community ai.robots.txt reference.
“TongyiBot is a web crawler operated by Alibaba that fetches web content for the Tongyi Qianwen assistant and related Qwen-generated answers.”
The stated role here is an AI assistant. Indexing helps readers find pages, and a user’s request can fetch one. Training reuses the material in models, which an owner may choose to block.
How many sites block it?
Instructions to stay out of the whole site appear in 27 files, or 0.4% of 6,171 readable files. We counted 24 with its name in a User-agent line, a 0.4% share. Another 6,144 lack a recorded Disallow: / ban.
Tranco’s top 1,000 sites yielded 552 readable files, including 3 files with its name, or 0.5%, and 3 files blocking it. Blocking is more common among the leading sites, at 0.5%. Outside those ranks, 24 of 5,619 files block it, or 0.4%.
| Readable files | Named by | Named share | Blocked by | Blocked share |
|---|---|---|---|---|
| TongyiBot, all ranks | 24 | 0.4% | 27 | 0.4% |
| TongyiBot, top 1,000 | 3 | 0.5% | 3 | 0.5% |
| TongyiBot, remaining ranks | 21 | 0.4% | 24 | 0.4% |
Blocking here counts whole-site bans recorded for it by name. A general ban for all crawlers is excluded. Of 27 blocks, 5 do not also appear in our count of files naming it. The overlap between naming and blocking is 22 files. Naming without a whole-site ban accounts for 2, and 6,147 files never name it. We ignore capitalization and repeated names.
How to block or allow it
Edit the root robots.txt file on your site. The robots.txt standard gives a TongyiBot group precedence over User-agent: * for this crawler.
Block the whole site
User-agent: TongyiBot
Disallow: /Allow access
User-agent: TongyiBot
Allow: /It's the 144th most-named crawler of the 171 we counted in the crawler index.
Which other crawlers does this operator run?
How we counted
For TongyiBot, our 19 October 2026 collection used Tranco’s top 10,000 sites. Files had an 8-second timeout and a 262,144-byte limit. Shares exclude unreachable, unavailable and oversized files. Repeat readings are included, using scripts/robots_2026_08_06.py (robots.py at app commit 07104ff). See the full survey method.
Common questions
Can a file name it and still allow it?
The 24 files naming it include 2 files without a whole-site ban.
How do the shares compare by rank?
Its name appears in 0.5% of readable leading files and 0.4% overall. Blocking affects 0.5% in the leading group and 0.4% in all ranks.
What other entry is close in the index?
For comparison, GeistHaus-PageFetcher has 22 files naming it and 85 blocks, or 1.4%. Our counts for this entry are 24 files with the name and 27 blocking the whole site, or 0.4%.