Check Engine / Checks / Reference

Can AI crawlers read your initial HTML?

It finds indexable pages marked as dependent on JavaScript for their content.

What Check Engine measures

The check reads which pages the crawler marked as needing JavaScript for their main content. It leaves out addresses recognised as intentionally excluded from search. If no pages remain, there is no finding. It uses the crawler's earlier observations. There is no separate word-count or timing limit here.

The check reads initial page content and whether the crawler marked it as needing JavaScript. It uses pages intended for search. Running an AI crawler or confirming a particular service's script support needs a separate test.

How to read the result

A finding is high severity and lists the affected URLs. Pages can match even when they work after scripts run. Review the document sent before those scripts run.

Why it matters

Browsers can show useful content that a plain document request does not contain. Comparing those views helps explain why a visitor's screenshot and the audit can disagree without either view being fabricated.

How to fix it

Open an affected URL and compare the page source with the content visible after loading. Put the main content in the HTML served by the server, using server rendering or a static output where suitable. Retest the actual URL after the change. Keep interactive features, but make the article or product details readable before those features run.

How to run a JavaScript SEO audit

What we found in field audits

Problems in AI search visibility were found on 14 of the 14 sites we audited. These are area totals. Read the field-audit method.

Method note

backend/seo_engine/checks/ai_visibility.py, rendering, revision 0bb8e8d3.

Common questions

Can my page look complete in a browser and still fail the AI HTML check?

Yes. Content marked as needing JavaScript can qualify despite appearing in a loaded browser. Review the original response alongside that view.

Are pages deliberately excluded from search counted as unreadable by AI?

No. Pages intentionally excluded from search are set aside before affected content is listed.

How serious is main content missing from the initial HTML for AI crawlers?

The result has high severity. It identifies affected URLs without testing a particular AI service's script support.