GeistHaus-PageFetcher
GeistHaus-PageFetcher is blocked by 85 sites in the October 2026 survey, or 1.4% of readable files. The community reference lists its operator as GeistHaus, a company developing AI systems for therapy and psychological assessment.
Who runs GeistHaus-PageFetcher?
| Fact | GeistHaus-PageFetcher reference entry |
|---|---|
| Operator | “GeistHaus, a company developing AI systems for therapy and psychological assessment” |
| Purpose | “AI Assistants” |
| Does GeistHaus-PageFetcher obey robots.txt? | “Unclear at this time.” |
| Frequency | “Unclear at this time.” |
| Cloudflare managed list for GeistHaus-PageFetcher | No |
These facts quote the stored community ai.robots.txt reference.
“GeistHaus-PageFetcher is a web crawler operated by GeistHaus, a company developing AI systems for therapy and psychological assessment. This bot fetches web pages as part…”
The stated role here is an AI assistant. Using a page as a search result can send people to it. Training models uses its contents for another purpose, which an owner may refuse.
How many sites block it?
Instructions to stay out of the whole site appear in 85 files, or 1.4% of 6,171 readable files. We counted 22 with its name in a User-agent line, a 0.4% share. Another 6,086 lack a recorded Disallow: / ban.
For the top 1,000 ranks, its name appears in 4 files out of 552, or 0.7%. Whole-site blocks total 10. Blocking is more common among the leading sites, at 1.8%. Lower in the ranking, blocking reaches 75 files out of 5,619, a 1.3% share.
| Readable files | Named by | Named share | Blocked by | Blocked share |
|---|---|---|---|---|
| GeistHaus-PageFetcher, all ranks | 22 | 0.4% | 85 | 1.4% |
| GeistHaus-PageFetcher, top 1,000 | 4 | 0.7% | 10 | 1.8% |
| GeistHaus-PageFetcher, remaining ranks | 18 | 0.3% | 75 | 1.3% |
Blocking here counts whole-site bans recorded for it by name. A general ban for all crawlers is excluded. Of 85 blocks, 64 do not also appear in our count of files naming it. Looking just at named files gives 21 blocks and 1 without a whole-site block. For 6,149 readable files, we found no mention by name. We ignore capitalization and repeated names.
How to block or allow it
Use your site’s root file, robots.txt. Specific groups for GeistHaus-PageFetcher take precedence over User-agent: *, according to the robots.txt standard.
Block the whole site
User-agent: GeistHaus-PageFetcher
Disallow: /Allow access
User-agent: GeistHaus-PageFetcher
Allow: /It's the 145th most-named crawler of the 171 we counted in the crawler index.
How we counted
For GeistHaus-PageFetcher, the survey covered 10,000 top Tranco sites, collected on 19 October 2026. A request timed out after 8 seconds, with files capped at 262,144 bytes. Only available files we could read enter the percentages. Collection and repeat readings used scripts/robots_2026_08_06.py (robots.py at app commit 07104ff). See the full survey method.
Common questions
Can a file name it and still allow it?
The 22 files naming it include 1 file without a whole-site ban.
How do the shares compare by rank?
At the top of the ranking, 0.7% of readable files name it and 1.8% block it. Across all ranks, those shares are 0.4% and 1.4%.
What other entry is close in the index?
The nearby Reflectionbot entry reports 22 files that name it and 22 whole-site blocks, 0.4% of readable files. Here, 22 files mention the name and 85 block access, or 1.4%.