Code
Few readable files block Code in October 2026, at 15 sites or 0.2%. Its operator is unclear in the community reference.
Who runs Code?
| Fact | Code reference entry |
|---|---|
| Operator | “Unclear at this time.” |
| Purpose | “AI Coding Agents” |
| Does Code obey robots.txt? | “Unclear at this time.” |
| Frequency | “Unclear at this time.” |
| Cloudflare managed list for Code | No |
These facts quote the stored community ai.robots.txt reference.
“Code (GitHub Copilot) is an AI coding agent that can autonomously plan, build, and execute development tasks, functioning as a collaborative AI pair programmer.”
The listed coding role concerns tools that help with software work. A site can welcome a page fetch prompted by a person while declining the collection of that text to build future models.
How many sites block it?
Within 6,171 readable robots.txt files, the name appears in 16, or 0.3%. Instructions blocking every path, Disallow: /, appear in 15, a 0.2% share. No whole-site ban is recorded for 6,156 files.
From the highest 1,000 ranks, 552 files could be read. Its naming count is 2, or 0.4%, and the block count is 2. Blocking is more common among the leading sites, at 0.4%. Compare 13 blocks among the 5,619 readable files below those ranks, or 0.2%.
| Readable files | Named by | Named share | Blocked by | Blocked share |
|---|---|---|---|---|
| Code, all ranks | 16 | 0.3% | 15 | 0.2% |
| Code, top 1,000 | 2 | 0.4% | 2 | 0.4% |
| Code, remaining ranks | 14 | 0.2% | 13 | 0.2% |
Blocking here counts whole-site bans recorded for it by name. A general ban for all crawlers is excluded. Looking just at named files gives 15 blocks and 1 without a whole-site block. For 6,155 readable files, we found no mention by name. We ignore capitalization and repeated names.
How to block or allow it
Use your site’s root file, robots.txt. Specific groups for Code take precedence over User-agent: *, according to the robots.txt standard.
Block the whole site
User-agent: Code
Disallow: /Allow access
User-agent: Code
Allow: /It's the 163rd most-named crawler of the 171 we counted in the crawler index.
How we counted
For Code, the survey covered 10,000 top Tranco sites, collected on 19 October 2026. Requests could run for 8 seconds, with a 262,144-byte file limit. Missing, unreachable and oversized files do not contribute to these shares. Later readings are included in results from scripts/robots_2026_08_06.py (robots.py at app commit 07104ff). See the full survey method.
Common questions
What does naming this crawler tell me?
The 16 files that mention its name do not all record a whole-site ban. Those without one total 1.
Are leading sites different?
At the top of the ranking, 0.4% of readable files name it and 0.4% block it. Across all ranks, those shares are 0.3% and 0.2%.
How does the nearby crawler compare?
The nearby MoonshotBot entry reports 16 files that name it and 16 whole-site blocks, 0.3% of readable files. Here, 16 files mention the name and 15 block access, or 0.2%.