Does Wix block AI bots by default?
Wix crawler guide says: The Wix guide does not say whether these six bots are blocked by default. It shows how to add robots.txt rules, with GPTBot and CCBot among its examples. It warns that some crawlers may ignore those requests.
Use SEO & GEO > Tools and settings > Robots.txt Editor in the dashboard. Read the current file before adding or removing a rule. Save Changes, then Save, and fetch the public robots.txt to see what visitors receive.
Rules for each bot
GPTBot, ClaudeBot, PerplexityBot, Google-Extended, Applebot-Extended, CCBot
Wix crawler guide says: The docs do not say whether this name is blocked or allowed at the start. Read and edit its instructions in SEO & GEO > Tools and settings > Robots.txt Editor.
What we measured
We did not measure any customer site on this host.
Start with the current robots.txt
Wix crawler guide says: Wix places the editor in the site dashboard. Choose View File, then edit the current text. Its example lists CCBot, GPTBot, ChatGPT-User and BingAI, each with a request to stay out of the whole site. It also says you can add more known crawlers. That example shows what an owner can request. It does not describe the starting rules on every Wix site.
For the six bots on this page, read any named User-agent group and its Disallow lines. Also inspect the group for all crawlers. To request that GPTBot or CCBot stay out, the Wix example uses the two groups below. Add only the name you intend to restrict. Keep a copy of the current text so you can compare the file after saving.
User-agent: GPTBot
Disallow: /
User-agent: CCBot
Disallow: /What to change when access is unwanted
Wix crawler guide says: Use the Robots.txt Editor for a site-wide request. The guide does not name ClaudeBot, PerplexityBot, Google-Extended or Applebot-Extended in its examples. It gives no separate Wix firewall switch for any of the six. If you add another name using the same method, check the published output and the bot reference linked in the table before deciding what it affects.
Wix also has a page-specific option in the editor. Open Pages & Menu, then the page menu, SEO basics, Advanced SEO and Robots meta tag. The guide tells you to select nosnippet to prevent page content being a direct input for AI Overviews, then publish. That instruction concerns a page setting. It does not say that the setting sends a network refusal to these six bot names.
Test your Wix domain after saving
Wix crawler guide says: Use the public domain where the content is available. Replace example.com below, read robots.txt, and send the six names to the same public page. Keep the browser request as a comparison. This only checks how requests carrying those headers are handled from your machine. It cannot show whether a crawler follows the instructions it reads.
If you meant to allow a bot again, inspect and remove the exclusion you added for that name, save both editor steps, then read the live file again. Check other groups before calling the change complete. The guide says listing known crawlers can block most of them but cannot keep out every unauthorized crawler. Record the file result separately from the HTTP response.
curl -sS -L https://example.com/robots.txt
curl -sS -L -D - -o /dev/null -A 'Mozilla/5.0' https://example.com/
curl -sS -L -D - -o /dev/null -A 'GPTBot' https://example.com/
curl -sS -L -D - -o /dev/null -A 'ClaudeBot' https://example.com/
curl -sS -L -D - -o /dev/null -A 'PerplexityBot' https://example.com/
curl -sS -L -D - -o /dev/null -A 'Google-Extended' https://example.com/
curl -sS -L -D - -o /dev/null -A 'Applebot-Extended' https://example.com/
curl -sS -L -D - -o /dev/null -A 'CCBot' https://example.com/Common questions
Does the Wix guide give a different recipe for CCBot?
CCBot and GPTBot use the same whole-site Disallow recipe in the guide. They share this page because the steps to edit, save and check the rules are the same.
Can I add more names than the Wix example shows?
Yes. Wix says the example contains some known AI crawlers and you can add more as needed. Check the spelling and scope of each instruction in the public file.
Is nosnippet the same control as a robots.txt exclusion?
Wix puts nosnippet in a page setting and describes it in relation to direct input for AI Overviews. The robots.txt instructions apply to named crawlers across the site. Read the control for the outcome you want.
Can robots.txt completely block unauthorized scraping on Wix?
The guide says no. Some crawlers may ignore robots.txt and scrape anyway. A file that contains your exclusion shows the request you made, while an HTTP test shows the response to one visit.
Check your site
Start with the free AI crawler checker to read the rules for your address. Then download Check Engine for an audit on your computer.
Sources
- Wix crawler guide, read 12 November 2026 at 01:45 UTC