Timpibot
Timpibot collects content for model training, and the community reference lists its operator as Timpi. Our October 2026 survey found 550 sites blocking it, or 8.9% of the files we could read.
Who runs Timpibot?
| Fact | Timpibot reference entry |
|---|---|
| Operator | “Timpi” |
| Purpose | “Scrapes data for use in training LLMs.” |
| Does Timpibot obey robots.txt? | “Unclear at this time.” |
| Frequency | “No information.” |
| Cloudflare managed list for Timpibot | No |
These facts quote the stored community ai.robots.txt reference.
“Makes data available for training AI models.”
Model training is this crawler’s listed use. Using a page as a search result can send people to it. Training models uses its contents for another purpose, which an owner may refuse.
How many sites block it?
Our readable sample has 550 whole-site blocks, 8.9% of 6,171 files, with Disallow: / as the instruction. Of that full sample, 349 name this crawler, or 5.7%. The count without a whole-site block is 5,621.
Breaking out the leading 1,000 sites gives 552 readable files, with 51 naming the crawler, or 9.2%. Whole-site blocking appears in 85 of them. Blocking is more common among the leading sites, at 15.4%. Beyond those ranks, 5,619 files have a blocking total of 465, 8.3% of that sample.
| Readable files | Named by | Named share | Blocked by | Blocked share |
|---|---|---|---|---|
| Timpibot, all ranks | 349 | 5.7% | 550 | 8.9% |
| Timpibot, top 1,000 | 51 | 9.2% | 85 | 15.4% |
| Timpibot, remaining ranks | 298 | 5.3% | 465 | 8.3% |
These totals cover both groups naming it and rules that apply to every crawler. Of 550 blocks, 219 come only from that general rule, without naming this crawler. We found 331 files naming it and blocking the whole site, along with 18 files naming it without that ban. Another 5,822 files omit the name. We ignore capitalization and repeated names.
Has that changed since August?
Between August and October, 19 sites that had blocked it stopped and 27 started, so 8 more of the same 5,889 sites block it. A further 487 blocked it in both months, and 5,356 did so in neither. Keeping the sites the same lets us count changes in their rules.
August’s full sample had 532 blocks among 6,236 readable files. October’s was 550 among 6,171. Those monthly totals also reflect which files we could read on each visit.
| August to October | Files |
|---|---|
| Started blocking | 27 |
| Stopped blocking | 19 |
| Blocked in both | 487 |
| Blocked in neither | 5,356 |
| Net change | +8 |
How to block or allow it
Use your site’s root file, robots.txt. Specific groups for Timpibot take precedence over User-agent: *, according to the robots.txt standard.
Block the whole site
User-agent: Timpibot
Disallow: /Allow access
User-agent: Timpibot
Allow: /It's the 25th most-named crawler of the 171 we counted in the crawler index.
How we counted
For Timpibot, our 19 October 2026 collection used Tranco’s top 10,000 sites. An 8-second wait or a file over 262,144 bytes ended a read. Only available files we could read enter the percentages. The file readings, including repeats, use scripts/robots_2026_08_06.py (robots.py at app commit 07104ff). See the full survey method.
Common questions
What does naming this crawler tell me?
The 349 files naming it include 18 files without a whole-site ban.
Are leading sites different?
At the top of the ranking, 9.2% of readable files name it and 15.4% block it. Across all ranks, those shares are 5.7% and 8.9%.
How does the nearby crawler compare?
ImagesiftBot is named by 332 files and blocked by 532, or 8.6%. For this crawler, 349 files name it and 550 block it, a 8.9% share.