Hunyuan
Hunyuan collects content for model training, and the community reference lists its operator as Tencent. Our October 2026 survey found 14 sites blocking it, or 0.2% of the files we could read.
Who runs Hunyuan?
| Fact | Hunyuan reference entry |
|---|---|
| Operator | “Tencent” |
| Purpose | “Hunyuan is a training crawler operated by Tencent.” |
| Does Hunyuan obey robots.txt? | “Unclear at this time.” |
| Frequency | “Unclear at this time.” |
| Cloudflare managed list for Hunyuan | No |
These facts quote the stored community ai.robots.txt reference.
“Hunyuan is a training crawler operated by Tencent. Its job is to read public web pages and feed that content into a machine-learning pipeline that trains future versions of the model.”
Model training is this crawler’s listed use. An owner may allow a search crawler to list a page or an assistant to retrieve it for someone, yet decline to supply the text for training.
How many sites block it?
The name occurs in 15 out of 6,171 readable files, a 0.2% share. Across the full sample, the whole-site Disallow: / block count is 14, or 0.2%. Files without that ban number 6,157.
Tranco’s top 1,000 sites yielded 552 readable files, including 1 file with its name, or 0.2%, and 2 files blocking it. Blocking is more common among the leading sites, at 0.4%. Outside those ranks, 12 of 5,619 files block it, or 0.2%.
| Readable files | Named by | Named share | Blocked by | Blocked share |
|---|---|---|---|---|
| Hunyuan, all ranks | 15 | 0.2% | 14 | 0.2% |
| Hunyuan, top 1,000 | 1 | 0.2% | 2 | 0.4% |
| Hunyuan, remaining ranks | 14 | 0.2% | 12 | 0.2% |
Only whole-site blocks recorded against this crawler’s name count here. Rules addressed to every crawler are outside this count. Of 14 blocks, 1 does not also appear in our count of files naming it. The counted overlap is 13 files, with 2 files naming it without banning all paths. Missing names account for 6,156 files. Repeating a name or changing its capitalization does not increase the naming total.
How to block or allow it
Put these in robots.txt at the site root. Per the robots.txt standard, a group naming Hunyuan takes precedence over User-agent: *.
Block the whole site
User-agent: Hunyuan
Disallow: /Allow access
User-agent: Hunyuan
Allow: /It's the 167th most-named crawler of the 171 we counted in the crawler index.
How we counted
For Hunyuan, on 19 October 2026, we requested robots.txt from Tranco’s top 10,000 sites. Files had an 8-second timeout and a 262,144-byte limit. Missing, unreachable and oversized files do not contribute to these shares. Repeat readings are included, using scripts/robots_2026_08_06.py (robots.py at app commit 07104ff). See the full survey method.
Common questions
Does a User-agent line mean it is blocked?
We found 2 files without a whole-site ban among 15 that name it.
What do the top-ranked sites show?
Within readable robots.txt files near the top of the ranking, 0.2% name it and 0.4% block it. Overall, naming reaches 0.2% and blocking 0.2%.
Which nearby entry can I compare?
The nearby Mozilla-Tabstack entry reports 15 files that name it and 17 whole-site blocks, 0.3% of readable files. Here, 15 files mention the name and 14 block access, or 0.2%.