AI crawlers / ChatGPT Agent

ChatGPT Agent

Few readable files block ChatGPT Agent in October 2026, at 0 sites or 0.0%. The community reference lists its operator as OpenAI.

Who runs ChatGPT Agent?

FactChatGPT Agent reference entry
Operator“OpenAI”
Purpose“AI Agents”
Does ChatGPT Agent obey robots.txt?“Yes”
Frequency“Unclear at this time.”
Cloudflare managed list for ChatGPT AgentNo

These facts quote the stored community ai.robots.txt reference.

“ChatGPT Agent is an AI agent created by OpenAI that can use a web browser. It can intelligently navigate and interact with websites to complete multi-step tasks on behalf…”

The reference places this crawler among AI agents. Search indexing is aimed at helping people find pages. Feeding text into model training is another use an owner may decline.

How many sites block it?

No whole-site Disallow: / ban was recorded for it among 6,171 readable files. User-agent lines name it in 36, or 0.6%. The total without a recorded ban is 6,171.

For leading ranks, naming still appears in 4 files, 0.7% of 552 readable files from Tranco’s top 1,000. The remaining 32 naming files come from 5,619 readable lower-ranked files, a 0.6% share. Neither rank group contributes any recorded blocks.

Readable filesNamed byNamed shareBlocked byBlocked share
ChatGPT Agent, all ranks360.6%00.0%
ChatGPT Agent, top 1,00040.7%00.0%
ChatGPT Agent, remaining ranks320.6%00.0%

Only whole-site blocks recorded against this crawler’s name count here. Rules addressed to every crawler are outside this count. The naming total includes 0 files with a ban on every path and 36 files without that ban. Elsewhere, 6,135 files do not name it. We ignore capitalization and repeated names.

How to block or allow it

Edit the root robots.txt file on your site. The robots.txt standard gives a ChatGPT Agent group precedence over User-agent: * for this crawler.

Block the whole site

User-agent: ChatGPT Agent
Disallow: /

Allow access

User-agent: ChatGPT Agent
Allow: /

It's the 132nd most-named crawler of the 171 we counted in the crawler index.

Which other crawlers does this operator run?

How we counted

For ChatGPT Agent, we surveyed Tranco’s top 10,000 sites on 19 October 2026. An 8-second wait or a file over 262,144 bytes ended a read. Shares exclude unreachable, unavailable and oversized files. Repeat readings are included, using scripts/robots_2026_08_06.py (robots.py at app commit 07104ff). See the full survey method.

Common questions

Does a User-agent line mean it is blocked?

This survey includes 36 files with the name and no whole-site ban, out of 36 naming files.

What do the top-ranked sites show?

Its name appears in 0.7% of readable leading files and 0.6% overall. Blocking affects 0.0% in the leading group and 0.0% in all ranks.

Which nearby entry can I compare?

OAI-AdsBot is named by 36 files and blocked by 20, or 0.3%. For this crawler, 36 files name it and 0 block it, a 0.0% share.