What text survives when JavaScript never runs?
Side by side: what your browser renders versus the raw text an AI crawler recovers. No headless browser tricks -- we fetch it exactly the way GPTBot does.
Why "it looks fine to me" isn't the test
Your browser runs JavaScript. GPTBot, ClaudeBot, and PerplexityBot largely don't. If your content only appears after a script populates the page, a completely normal-looking site can be close to blank to the crawlers deciding whether to cite it.
How the check works
We fetch once, as a bot, with no JavaScript
A single request under a real AI crawler user-agent (GPTBot) -- no headless browser, because that is the entire point: none of the major AI crawlers execute JavaScript either.
We run the same extractor the paid audit uses
The raw HTML goes through GetBotRank’s Readability-based extractor -- the same one used elsewhere in the product -- to recover the text a crawler would actually work with.
We measure the gap, not just show it
Word and character counts, heading structure, script-tag count, and the ratio of script markup to recovered text -- the signals that tell you whether this is a real problem or a non-issue.
Frequently asked questions
What counts as an "empty shell"?
Under roughly 200 words of recoverable text combined with a client-side mount node (like #root or #__next) dominating the body -- the signature of a single-page app that renders everything after JavaScript runs, which most AI crawlers never execute.
Why GPTBot specifically, and not another crawler?
None of the major AI crawlers execute JavaScript, so which one we use to fetch the page does not change what gets measured -- only which vendor name shows in the panel. GPTBot is the most widely recognized.
The left panel looks blank or broken -- is that a problem?
That panel is your own browser rendering the live page in an iframe. If a site blocks embedding (many do, deliberately, for security), the panel can appear blank even though the site works fine normally. It has no effect on the crawler-view result on the right.
Why do you need my email?
It doesn't require a signup, a credit card, or any GetBotRank credits -- just a URL and an email. The comparison renders on this page immediately after you submit, and we send you a copy plus a shareable link at the same time.
How is this different from the free audit?
The free audit scores five structural signals across a page. Crawler View goes deep on just one of them -- rendering -- and shows you the actual recovered text side by side with what your browser shows, rather than a pass/fail line item.