Awario
Few readable files block Awario in October 2026, at 26 sites or 0.4%. The community reference lists its operator as Awario.
Who runs Awario?
| Fact | Awario reference entry |
|---|---|
| Operator | “Awario” |
| Purpose | “AI Data Scrapers” |
| Does Awario obey robots.txt? | “Unclear at this time.” |
| Frequency | “Unclear at this time.” |
| Cloudflare managed list for Awario | No |
These facts quote the stored community ai.robots.txt reference.
“Awario is an AI data scraper operated by Awario. It's not currently known to be artificially intelligent or AI-related.”
This entry is classed as a crawler collecting data for AI. Helping people find a page through search is a different use from using its contents to train a model, so owners may allow those visits separately.
How many sites block it?
A User-agent line names it in 32 files, 0.5% of 6,171 readable files. Whole-site bans, written Disallow: /, total 26, or 0.4%. That leaves 6,145 without a recorded ban.
Tranco’s top 1,000 sites yielded 552 readable files, including 5 files with its name, or 0.9%, and 3 files blocking it. Blocking is more common among the leading sites, at 0.5%. Outside those ranks, 23 of 5,619 files block it, or 0.4%.
| Readable files | Named by | Named share | Blocked by | Blocked share |
|---|---|---|---|---|
| Awario, all ranks | 32 | 0.5% | 26 | 0.4% |
| Awario, top 1,000 | 5 | 0.9% | 3 | 0.5% |
| Awario, remaining ranks | 27 | 0.5% | 23 | 0.4% |
This is a count of blocks attached to the named crawler, covering the whole site. Blanket rules for every crawler do not enter it. We found 26 files naming it and blocking the whole site, along with 6 files naming it without that ban. Another 6,139 files omit the name. We ignore capitalization and repeated names.
How to block or allow it
Place the group in your root robots.txt file. Per the robots.txt standard, a named group for Awario overrides User-agent: *.
Block the whole site
User-agent: Awario
Disallow: /Allow access
User-agent: Awario
Allow: /It's the 135th most-named crawler of the 171 we counted in the crawler index.
How we counted
For Awario, on 19 October 2026, we requested robots.txt from Tranco’s top 10,000 sites. Each file had 8 seconds to arrive, up to 262,144 bytes. Missing, unreachable and oversized files do not contribute to these shares. Collection and repeat readings used scripts/robots_2026_08_06.py (robots.py at app commit 07104ff). See the full survey method.
Common questions
Does a User-agent line mean it is blocked?
The 32 files naming it include 6 files without a whole-site ban.
What do the top-ranked sites show?
Leading files record 0.9% with the name and 0.5% blocking it. Across all readable files, the corresponding shares are 0.5% and 0.4%.
Which nearby entry can I compare?
Google-Agent is named by 30 files and blocked by 19, or 0.3%. For this crawler, 32 files name it and 26 block it, a 0.4% share.