Does the crawler change my site?

No. It only sends GET requests to public pages, like a search engine. It never submits forms or logs in.

My site is behind Cloudflare or another firewall. Will it work?

Usually yes. The crawler identifies itself as AISEOBot, backs off when a firewall pushes back, and reports blocked pages separately. If your firewall blocks it outright, allowlist the AISEOBot user agent.

How many pages can it crawl?

You set the limit per site, up to tens of thousands of pages. Scheduled audits re-crawl incrementally and reuse pages that didn't change.

Audit

Technical SEO audit

Crawl your site like a search engine and see exactly what holds it back.

Crawl your website, run 40+ deterministic SEO, structured data, AI-crawler and Core Web Vitals checks, and watch the whole audit happen live.

40+ deterministic checks, each with a plain-language fix
Renders JavaScript-only pages in a real browser
Live view: every page, finding and AI step as it happens

Audit · live

Illustration with sample data

Use cases

What you can do with it

Developers & agencies

Before a launch or migration

Crawl the staging or new site, fix broken links, redirect chains, missing canonicals and noindex mistakes before search engines see them.

In-house marketers

Monthly health check

Run an audit, sort issues by severity, and hand the critical ones to the team with the affected URLs and a clear fix.

SEO consultants

Taking on a new client

Get a scored baseline in minutes, export it as CSV or JSON, and show progress against it later.

Why it's strong

Built to be trusted

Facts, not guesses

Findings come from deterministic checks on the crawled HTML, not from an AI's opinion. Every issue lists the URLs and the evidence.

Real JavaScript rendering

Pages that arrive as an empty app shell are rendered in a headless browser before they are checked.

Firewall-aware

Recognises when a WAF or bot protection blocks the crawler, slows down, retries, and never reports a block as a broken page.

Watch it live

An animated live view and a saved activity log show every page fetched, check run and AI call, with timings and cost.

Structured data and AI search

JSON-LD is validated against the full schema.org vocabulary, and checks confirm AI crawlers can reach and read your pages.

Core Web Vitals

Real-user CrUX field data plus PageSpeed lab results, so performance findings reflect what visitors experience.

How it works

From setup to results

1
Crawl
Follows links and sitemaps, respects robots.txt and crawl-delay, and renders JavaScript-only pages.
2
Check
Runs technical, content, structured data, AI-crawler and performance checks on every page that loaded.
3
Score
A 0–100 score with technical, content, performance and structured-data subscores, and what cost the most points.
4
Track
Issues keep their identity across audits, so you see what is new, regressed or resolved.

Data it uses

Your website (crawled like a search engine, robots.txt respected)
Google PageSpeed Insights and the Chrome UX Report

FAQ

Good to know

Works well with

All features

See it on your own site

Add your site and run your first audit in a few minutes. No changes to your site, no setup beyond the URL.