How-to steps · Chapter 6, S for Structure
Sort the pages Google hasn't indexed
You are here for this line in chapter 6 of the book:
☐ Classify noindex and 'crawled but not indexed' URLs as keep, fix or investigate using the Page indexing report.
Chapter 6, S for Structure
- Go to Indexing, then Pages.
- Scroll to Why pages aren't indexed. Each row is a reason (for example Excluded by 'noindex' tag or Crawled, currently not indexed) with the affected URLs behind it. A Source of Website means it is yours to fix.
- For every URL, write keep (it should stay out), fix (it should be indexed) or investigate. Fix staging leftovers first: a stray noindex or robots rule on a money page.
To check a single page fast, Hawk Academy's free Noindex Checker looks in all four places a page can be blocked: the meta robots tag, the X-Robots-Tag header, robots.txt and the canonical.
You're done when you have every excluded URL marked keep, fix or investigate, with staging leftovers fixed first.