Cursor
Few readable files block Cursor in October 2026, at 14 sites or 0.2%. Its operator is unclear in the community reference.
Who runs Cursor?
| Fact | Cursor reference entry |
|---|---|
| Operator | “Unclear at this time.” |
| Purpose | “AI Coding Agents” |
| Does Cursor obey robots.txt? | “Unclear at this time.” |
| Frequency | “Unclear at this time.” |
| Cloudflare managed list for Cursor | No |
These facts quote the stored community ai.robots.txt reference.
“Cursor is an AI coding agent that helps write, edit, and understand code.”
The listed coding role concerns tools that help with software work. An owner may permit an assistant to read a page for someone and deny bulk collection that would use it as training material.
How many sites block it?
A User-agent line names it in 17 files, 0.3% of 6,171 readable files. Whole-site bans, written Disallow: /, total 14, or 0.2%. That leaves 6,157 without a recorded ban.
From the highest 1,000 ranks, 552 files could be read. Its naming count is 2, or 0.4%, and the block count is 2. Blocking is more common among the leading sites, at 0.4%. Compare 12 blocks among the 5,619 readable files below those ranks, or 0.2%.
| Readable files | Named by | Named share | Blocked by | Blocked share |
|---|---|---|---|---|
| Cursor, all ranks | 17 | 0.3% | 14 | 0.2% |
| Cursor, top 1,000 | 2 | 0.4% | 2 | 0.4% |
| Cursor, remaining ranks | 15 | 0.3% | 12 | 0.2% |
For this entry, we counted whole-site bans attached to its own name, leaving general rules for all crawlers out of the total. The naming total includes 14 files with a ban on every path and 3 files without that ban. Elsewhere, 6,154 files do not name it. We ignore capitalization and repeated names.
How to block or allow it
Edit the root robots.txt file on your site. The robots.txt standard gives a Cursor group precedence over User-agent: * for this crawler.
Block the whole site
User-agent: Cursor
Disallow: /Allow access
User-agent: Cursor
Allow: /It's the 156th most-named crawler of the 171 we counted in the crawler index.
How we counted
For Cursor, the survey covered 10,000 top Tranco sites, collected on 19 October 2026. Files had an 8-second timeout and a 262,144-byte limit. Shares exclude unreachable, unavailable and oversized files. Reading files again used scripts/robots_2026_08_06.py (robots.py at app commit 07104ff) as well. See the full survey method.
Common questions
Does a User-agent line mean it is blocked?
We found 3 files without a whole-site ban among 17 that name it.
What do the top-ranked sites show?
Leading files record 0.4% with the name and 0.4% blocking it. Across all readable files, the corresponding shares are 0.3% and 0.2%.
Which nearby entry can I compare?
The nearby KeenableBot entry reports 17 files that name it and 17 whole-site blocks, 0.3% of readable files. Here, 17 files mention the name and 14 block access, or 0.2%.