PetalBot
PetalBot is listed as a search crawler, and the community reference lists its operator as Huawei. In October 2026, 433 sites block it, a 7.0% share of readable files.
Who runs PetalBot?
| Fact | PetalBot reference entry |
|---|---|
| Operator | “Huawei” |
| Purpose | “Used to provide recommendations in Hauwei assistant and AI search services.” |
| Does PetalBot obey robots.txt? | “Yes” |
| Frequency | “No explicit frequency provided.” |
| Cloudflare managed list for PetalBot | No |
These facts quote the stored community ai.robots.txt reference.
“Operated by Huawei to provide search and AI assistant services.”
The listed use here is search. A requested page visit can answer a person now, whereas training collects material for a model. Owners may apply different access rules.
How many sites block it?
Within 6,171 readable robots.txt files, the name appears in 487, or 7.9%. Instructions blocking every path, Disallow: /, appear in 433, a 7.0% share. No whole-site ban is recorded for 5,738 files.
Among 552 readable files from the top 1,000 sites, we found 68 files naming it, a 12.3% share, with 62 files blocking the whole site. Blocking is more common among the leading sites, at 11.2%. Outside this group, 5,619 files contribute 371 blocks, or 6.6%.
| Readable files | Named by | Named share | Blocked by | Blocked share |
|---|---|---|---|---|
| PetalBot, all ranks | 487 | 7.9% | 433 | 7.0% |
| PetalBot, top 1,000 | 68 | 12.3% | 62 | 11.2% |
| PetalBot, remaining ranks | 419 | 7.5% | 371 | 6.6% |
Only whole-site blocks recorded against this crawler’s name count here. Rules addressed to every crawler are outside this count. Looking just at named files gives 433 blocks and 54 without a whole-site block. For 5,684 readable files, we found no mention by name. We ignore capitalization and repeated names.
How to block or allow it
Put these in robots.txt at the site root. Per the robots.txt standard, a group naming PetalBot takes precedence over User-agent: *.
Block the whole site
User-agent: PetalBot
Disallow: /Allow access
User-agent: PetalBot
Allow: /It's the 17th most-named crawler of the 171 we counted in the crawler index.
Which other crawlers does this operator run?
How we counted
For PetalBot, the survey covered 10,000 top Tranco sites, collected on 19 October 2026. Requests could run for 8 seconds, with a 262,144-byte file limit. Only available files we could read enter the percentages. Repeat readings are included, using scripts/robots_2026_08_06.py (robots.py at app commit 07104ff). See the full survey method.
Common questions
Can a file name it and still allow it?
We found 54 files without a whole-site ban among 487 that name it.
How do the shares compare by rank?
Within readable robots.txt files near the top of the ranking, 12.3% name it and 11.2% block it. Overall, naming reaches 7.9% and blocking 7.0%.
What other entry is close in the index?
For comparison, FacebookBot has 452 files naming it and 370 blocks, or 6.0%. Our counts for this entry are 487 files with the name and 433 blocking the whole site, or 7.0%.