SBIntuitionsBot

By Matt Kerr·Published 11 November 2026

SBIntuitionsBot is blocked by 105 sites in the October 2026 survey, or 1.7% of readable files. The community reference lists its operator as SB Intuitions.

Who runs SBIntuitionsBot?

These facts quote the stored community ai.robots.txt reference.

“AI development and information analysis”

This entry’s stated use is quoted above. Search referrals or a user’s question can give an owner a reason to allow access while declining collection of page text for training.

How many sites block it?

Within 6,171 readable robots.txt files, the name appears in 107, or 1.7%. Instructions blocking every path, Disallow: /, appear in 105, a 1.7% share. No whole-site ban is recorded for 6,066 files.

At the top 1,000 ranks, we could read 552 files. Naming covers 23, a 4.2% share, and blocking covers 23. Blocking is more common among the leading sites, at 4.2%. Elsewhere, 5,619 readable files give 82 blocks, or 1.5%.

This total covers whole-site bans recorded for this name. A blanket User-agent: * rule alone is outside this measure. Of 105 blocks, 1 does not also appear in our count of files naming it. The naming total includes 104 files with a ban on every path and 3 files without that ban. Elsewhere, 6,064 files do not name it. We ignore capitalization and repeated names.

How to block or allow it

Put these in robots.txt at the site root. Per the robots.txt standard, a group naming SBIntuitionsBot takes precedence over User-agent: *.

Block the whole site

User-agent: SBIntuitionsBot
Disallow: /

Allow access

User-agent: SBIntuitionsBot
Allow: /

It's the 59th most-named crawler of the 171 we counted in the crawler index.

How we counted

For SBIntuitionsBot, we surveyed Tranco’s top 10,000 sites on 19 October 2026. Files had an 8-second timeout and a 262,144-byte limit. Shares exclude unreachable, unavailable and oversized files. Reading files again used scripts/robots_2026_08_06.py (robots.py at app commit 07104ff) as well. See the full survey method.