Index vs sitemap check

The pages your index file leaves out

We name the pages that sit in your sitemap and in no index anywhere. The llms.txt draft comes with it, though we cannot point you at a measurement where the file earned a citation. One URL.

  • Can they read it
  • Free
  • ~3s

113 pages in the sitemap, in no index file at all Measured 2026-08-09

This check asks your server at most three times — llms.txt, sitemap.xml, llms-full.txt.

Sign in and you get 10 runs a day. Sign in or create an account

First, a screen we measured ourselves

113 pages in the sitemap, in no index file at all

  • in the index 10 pages
  • outside it 113 pages

The file itself is not what pays. What pays is the gap beside it, and our own site carries a gap this size.

10 of 123 sitemap pages are in the index · 8.1% · Measured 2026-08-09 · See the source

What is llms.txt?

An index file you leave at the root of your site. Jeremy Howard put the idea out in 2024: hand a language model a short reading list instead of making it crawl the lot. A good number of companies keep one now.

Search does not read it. Google says as much in its own documentation. Then there are the server logs. One study went through 137,210 sites. 38,360 of them had the file, and 97% of those saw a whole month pass without a single request for it. Crawlers do not even come looking: on sites with no file at all, AI bots asked for it zero times.

We hand you the draft and stop there. What is worth your time is the gap beside it — the pages sitting in your sitemap and in no index anywhere. That gap stays real whatever becomes of llms.txt.

97%

Sources: Google Search documentation · Ahrefs · server logs of 137,210 sites · measured May 2026

What you saw here / what the paid tier adds

Free ends here On the paid tier
  • The full index-against-sitemap comparison
  • The list of pages the index leaves out
  • A draft index file, up to twenty pages
  • Wiring the missing pages into the index for real
  • A lock, so a rebuild cannot quietly undo it

What splits them — How many pages, and who does the wiring

Where free ends

The verdict and the draft are both yours. What we sell is fixing the pages and keeping the index true as the site moves.

The first paid rung is $399. See the diagnostic ladder →

What this check misses

See the audit ladder → · Other free tools

Start the free check here

One minute, no card, no meeting. Three questions are on us — write the ones your buyers would put to an AI, and we run them exactly as you wrote them and mail you the results page.

Each question goes to 6 AI answer surfaces. Send 3 and that is 18 observations in all, and we count how many of them came back with your name.

One question is enough to start.

We start from what a marketing chief asks first.

Ready to turn US visibility evidence into a market plan? Tell us the US buyer, target state and decision date.

Request a written proposal