AI crawlers / AmazonBuyForMe

AmazonBuyForMe

Few readable files block AmazonBuyForMe in October 2026, at 52 sites or 0.8%. The community reference lists its operator as Amazon.

Who runs AmazonBuyForMe?

FactAmazonBuyForMe reference entry
Operator“Amazon”
Purpose“AI Agents”
Does AmazonBuyForMe obey robots.txt?“Unclear at this time.”
Frequency“No information provided.”
Cloudflare managed list for AmazonBuyForMeNo

These facts quote the stored community ai.robots.txt reference.

“AmazonBuyForMe is an Amazon bot that crawls websites as part of the Amazon Buy For Me service. This bot visits product pages and e-commerce websites to gather product inf…”

The reference places this crawler among AI agents. Using a page as a search result can send people to it. Training models uses its contents for another purpose, which an owner may refuse.

How many sites block it?

Within 6,171 readable robots.txt files, the name appears in 56, or 0.9%. Instructions blocking every path, Disallow: /, appear in 52, a 0.8% share. No whole-site ban is recorded for 6,119 files.

Among 552 readable files from the top 1,000 sites, we found 8 files naming it, a 1.4% share, with 7 files blocking the whole site. Blocking is more common among the leading sites, at 1.3%. Outside this group, 5,619 files contribute 45 blocks, or 0.8%.

Readable filesNamed byNamed shareBlocked byBlocked share
AmazonBuyForMe, all ranks560.9%520.8%
AmazonBuyForMe, top 1,00081.4%71.3%
AmazonBuyForMe, remaining ranks480.9%450.8%

For this entry, we counted whole-site bans attached to its own name, leaving general rules for all crawlers out of the total. The counted overlap is 52 files, with 4 files naming it without banning all paths. Missing names account for 6,115 files. Repeating a name or changing its capitalization does not increase the naming total.

How to block or allow it

Add these lines to robots.txt at your site root. For AmazonBuyForMe, the robots.txt standard gives a named group priority over User-agent: *.

Block the whole site

User-agent: AmazonBuyForMe
Disallow: /

Allow access

User-agent: AmazonBuyForMe
Allow: /

It's the 112th most-named crawler of the 171 we counted in the crawler index.

Which other crawlers does this operator run?

How we counted

For AmazonBuyForMe, we surveyed Tranco’s top 10,000 sites on 19 October 2026. Requests could run for 8 seconds, with a 262,144-byte file limit. Only available files we could read enter the percentages. Repeat readings are included, using scripts/robots_2026_08_06.py (robots.py at app commit 07104ff). See the full survey method.

Common questions

What does naming this crawler tell me?

A name identifies the crawler addressed by a group. The survey found 4 files with that name and no recorded whole-site ban, out of 56.

Are leading sites different?

Within readable robots.txt files near the top of the ranking, 1.4% name it and 1.3% block it. Overall, naming reaches 0.9% and blocking 0.8%.

How does the nearby crawler compare?

GoogleOther-Video is named by 56 files and blocked by 177, or 2.9%. For this crawler, 56 files name it and 52 block it, a 0.8% share.