amazon-kendra
amazon-kendra is listed as a search crawler, and the community reference lists its operator as Amazon. In October 2026, 58 sites block it, a 0.9% share of readable files.
Who runs amazon-kendra?
| Fact | amazon-kendra reference entry |
|---|---|
| Operator | “Amazon” |
| Purpose | “Collects data for AI natural language search” |
| Does amazon-kendra obey robots.txt? | “Yes” |
| Frequency | “No information provided.” |
| Cloudflare managed list for amazon-kendra | No |
These facts quote the stored community ai.robots.txt reference.
The reference describes a search service for unstructured data. It says the service returns specific answers, works with AWS services such as Amazon S3 and Amazon Lex, and offers enterprise-grade security.
The listed use here is search. A requested page visit can answer a person now, whereas training collects material for a model. Owners may apply different access rules.
How many sites block it?
Within 6,171 readable robots.txt files, the name appears in 63, or 1.0%. Instructions blocking every path, Disallow: /, appear in 58, a 0.9% share. No whole-site ban is recorded for 6,113 files.
At the top 1,000 ranks, we could read 552 files. Naming covers 7, a 1.3% share, and blocking covers 6. Blocking is more common among the leading sites, at 1.1%. Elsewhere, 5,619 readable files give 52 blocks, or 0.9%.
| Readable files | Named by | Named share | Blocked by | Blocked share |
|---|---|---|---|---|
| amazon-kendra, all ranks | 63 | 1.0% | 58 | 0.9% |
| amazon-kendra, top 1,000 | 7 | 1.3% | 6 | 1.1% |
| amazon-kendra, remaining ranks | 56 | 1.0% | 52 | 0.9% |
Blocking here counts whole-site bans recorded for it by name. A general ban for all crawlers is excluded. Names and bans overlap in 58 files. We also found 5 files with a name and no whole-site ban, plus 6,108 files omitting the name. Case changes and repeated spellings are merged.
How to block or allow it
Edit the root robots.txt file on your site. The robots.txt standard gives a amazon-kendra group precedence over User-agent: * for this crawler.
Block the whole site
User-agent: amazon-kendra
Disallow: /Allow access
User-agent: amazon-kendra
Allow: /It's the 96th most-named crawler of the 171 we counted in the crawler index.
Which other crawlers does this operator run?
How we counted
For amazon-kendra, the survey covered 10,000 top Tranco sites, collected on 19 October 2026. A request timed out after 8 seconds, with files capped at 262,144 bytes. Only available files we could read enter the percentages. Reading files again used scripts/robots_2026_08_06.py (robots.py at app commit 07104ff) as well. See the full survey method.
Common questions
Does a User-agent line mean it is blocked?
A name identifies the crawler addressed by a group. The survey found 5 files with that name and no recorded whole-site ban, out of 63.
What do the top-ranked sites show?
Its name appears in 1.3% of readable leading files and 1.0% overall. Blocking affects 1.1% in the leading group and 0.9% in all ranks.
Which nearby entry can I compare?
wpbot is named by 63 files and blocked by 64, or 1.0%. For this crawler, 63 files name it and 58 block it, a 0.9% share.