BixelBot
Few readable files block BixelBot in October 2026, at 16 sites or 0.3%. Its operator is unclear in the community reference.
Who runs BixelBot?
| Fact | BixelBot reference entry |
|---|---|
| Operator | “Unclear at this time.” |
| Purpose | “AI Data Providers” |
| Does BixelBot obey robots.txt? | “Unclear at this time.” |
| Frequency | “Unclear at this time.” |
| Cloudflare managed list for BixelBot | No |
These facts quote the stored community ai.robots.txt reference.
“BixelBot collects public company and market signals for Bixel's structured company-data platform, which supplies verified business information to AI agents and developers…”
Its listed role is supplying data for AI tools. A site can welcome a page fetch prompted by a person while declining the collection of that text to build future models.
How many sites block it?
The 16 files blocking the whole site account for 0.3% of 6,171 readable robots.txt files. We found its name in 16 User-agent lists, a 0.3% share. Without a whole-site Disallow: / block, 6,155 files remain.
For the top 1,000 ranks, its name appears in 1 file out of 552, or 0.2%. Whole-site blocks total 1. The leading sites have a lower block share, 0.2%. Lower in the ranking, blocking reaches 15 files out of 5,619, a 0.3% share.
| Readable files | Named by | Named share | Blocked by | Blocked share |
|---|---|---|---|---|
| BixelBot, all ranks | 16 | 0.3% | 16 | 0.3% |
| BixelBot, top 1,000 | 1 | 0.2% | 1 | 0.2% |
| BixelBot, remaining ranks | 15 | 0.3% | 15 | 0.3% |
Here, the total counts whole-site blocks recorded for this crawler. It leaves out general User-agent: * instructions. Of 16 blocks, 1 does not also appear in our count of files naming it. Looking just at named files gives 15 blocks and 1 without a whole-site block. For 6,155 readable files, we found no mention by name. We ignore capitalization and repeated names.
How to block or allow it
Edit the root robots.txt file on your site. The robots.txt standard gives a BixelBot group precedence over User-agent: * for this crawler.
Block the whole site
User-agent: BixelBot
Disallow: /Allow access
User-agent: BixelBot
Allow: /It's the 162nd most-named crawler of the 171 we counted in the crawler index.
How we counted
For BixelBot, the survey covered 10,000 top Tranco sites, collected on 19 October 2026. A request timed out after 8 seconds, with files capped at 262,144 bytes. Shares exclude unreachable, unavailable and oversized files. The file readings, including repeats, use scripts/robots_2026_08_06.py (robots.py at app commit 07104ff). See the full survey method.
Common questions
What does naming this crawler tell me?
This survey includes 1 file with the name and no whole-site ban, out of 16 naming files.
Are leading sites different?
Leading files record 0.2% with the name and 0.2% blocking it. Across all readable files, the corresponding shares are 0.3% and 0.3%.
How does the nearby crawler compare?
For comparison, Code has 16 files naming it and 15 blocks, or 0.2%. Our counts for this entry are 16 files with the name and 16 blocking the whole site, or 0.3%.