LinerBot
LinerBot is blocked by 77 sites in the October 2026 survey, or 1.2% of readable files. Its operator is unclear in the community reference.
Who runs LinerBot?
| Fact | LinerBot reference entry |
|---|---|
| Operator | “Unclear at this time.” |
| Purpose | “AI Assistants” |
| Does LinerBot obey robots.txt? | “Unclear at this time.” |
| Frequency | “Unclear at this time.” |
| Cloudflare managed list for LinerBot | No |
These facts quote the stored community ai.robots.txt reference.
“LinerBot is the web crawler used by Liner AI assistant to gather information from academic sources and websites to provide accurate answers with line-by-line source citat…”
The stated role here is an AI assistant. Someone asking an assistant to open a page is using it for an immediate answer. An owner may permit that request and block automatic training collection.
How many sites block it?
A User-agent line names it in 83 files, 1.3% of 6,171 readable files. Whole-site bans, written Disallow: /, total 77, or 1.2%. That leaves 6,094 without a recorded ban.
From the highest 1,000 ranks, 552 files could be read. Its naming count is 10, or 1.8%, and the block count is 9. Blocking is more common among the leading sites, at 1.6%. Compare 68 blocks among the 5,619 readable files below those ranks, or 1.2%.
| Readable files | Named by | Named share | Blocked by | Blocked share |
|---|---|---|---|---|
| LinerBot, all ranks | 83 | 1.3% | 77 | 1.2% |
| LinerBot, top 1,000 | 10 | 1.8% | 9 | 1.6% |
| LinerBot, remaining ranks | 73 | 1.3% | 68 | 1.2% |
Here, the total counts whole-site blocks recorded for this crawler. It leaves out general User-agent: * instructions. Of 77 blocks, 1 does not also appear in our count of files naming it. The overlap between naming and blocking is 76 files. Naming without a whole-site ban accounts for 7, and 6,088 files never name it. We ignore capitalization and repeated names.
How to block or allow it
Put these in robots.txt at the site root. Per the robots.txt standard, a group naming LinerBot takes precedence over User-agent: *.
Block the whole site
User-agent: LinerBot
Disallow: /Allow access
User-agent: LinerBot
Allow: /It's the 71st most-named crawler of the 171 we counted in the crawler index.
How we counted
For LinerBot, we surveyed Tranco’s top 10,000 sites on 19 October 2026. Files had an 8-second timeout and a 262,144-byte limit. Only available files we could read enter the percentages. Repeat readings are included, using scripts/robots_2026_08_06.py (robots.py at app commit 07104ff). See the full survey method.
Common questions
Does a User-agent line mean it is blocked?
This survey includes 7 files with the name and no whole-site ban, out of 83 naming files.
What do the top-ranked sites show?
At the top of the ranking, 1.8% of readable files name it and 1.6% block it. Across all ranks, those shares are 1.3% and 1.2%.
Which nearby entry can I compare?
For comparison, Sidetrade indexer bot has 83 files naming it and 0 blocks, or 0.0%. Our counts for this entry are 83 files with the name and 77 blocking the whole site, or 1.2%.