Can AI read your site? Free AI crawler check

When someone asks ChatGPT, Claude or Google a question about your line of work, the answer is built from pages those tools have read. If they can't get into your site, or can't make sense of it once they're in, you're not in the running.

Type in your website address and we'll look at it the way an AI crawler does: what your site lets in, what's there without JavaScript, and what it says about your business. It takes a few seconds, and there's no email to hand over.

What we check

That your site loads securely. The homepage opens over HTTPS without an error.
Which AI crawlers your robots.txt lets in. That's the file telling crawlers where they can go. We check each AI company's crawlers against it, and keep the ones that read pages to answer questions apart from the ones gathering material for training.
Whether your words are there without JavaScript. Most AI crawlers don't run it, so text that only appears once scripts have run is text they never see.
Structured data about your business. A short, machine-readable description of who you are, what you do and where.
Your page title, description and main heading. The basics that tell anything reading the page what it's about.
Your sitemap. Whether you have one, and whether your robots.txt points crawlers to it.
An llms.txt file. A newer idea: a plain summary of your site written for AI tools. We report it, but it isn't a proven factor, so it doesn't count towards your score.

Good to know

What can't this check tell me?

Whether AI tools actually quote you. It checks that they can get in and read your site, which has to be true first, but being read isn't the same as being named in an answer. For Google there's a way to see that side of it, which we wrote up in Does Google's AI mention your business?

My report says the site stopped the check. Are AI crawlers blocked?

Not necessarily. Plenty of hosts and security services screen automated visitors, and our check is one of those. The AI companies' own crawlers are judged separately, so a site that stops us can still let them in. Your web host's visitor logs will show which ones arrive.

Why does it only look at a few addresses?

Four (your homepage, robots.txt, llms.txt and sitemap.xml) are enough to answer the question without putting any load on your site. It's a quick look rather than a full audit.

What do you do with the address I type in?

We keep the address of the site you checked and how it scored, so we can see how the check gets used. Nothing about you: we don't ask for your name, and your IP address is only used, briefly, to stop the checker being overused. Your report sits at its own link for an hour, then it's gone.

If you ask us to email the report, we send it to the address you give and keep a copy of that email, so we can help if you reply. We won't email you again unless you do.

If something in your report needs sorting and you'd like a hand, get in touch. We're a small web and SEO agency in Sturminster Newton, north Dorset, working with businesses across southern England and the UK, and we'll tell you straight whether it's worth fixing.