Page indexing is the process by which search engines discover, analyse, and store web pages in their databases (the 'index') for potential inclusion in search results. When a page is indexed, it is eligible to appear in search results for relevant queries. Pages that are not indexed — because they are blocked in robots.txt, marked with noindex, inaccessible due to server errors, or not linked from anywhere — cannot appear in organic search results regardless of their content quality.
The indexing process has three stages: crawling (Googlebot discovers and downloads the page), rendering (Google processes the page's JavaScript to see the full content), and indexing (the processed content is analysed and stored in Google's index). Each stage is a potential point of failure — a page might be crawled but fail to render correctly, or render correctly but fail indexing quality checks. Google Search Console's URL Inspection tool shows the status of each stage for individual pages.
Why pages might not be indexed
- Robots.txt disallow — Googlebot instructed not to crawl the page
- Noindex meta tag — page crawled but excluded from the index by directive
- No internal links — orphan pages Googlebot cannot discover from other pages
- Soft 404 — pages returning 200 OK but displaying 'no results' or empty content
- Duplicate content — Google chooses a canonical version and may not index others
- Low quality — pages with thin, duplicate, or unhelpful content may be excluded
- Server errors — 5xx responses preventing Googlebot from accessing the page
- JavaScript rendering issues — content loaded by JavaScript not rendered correctly
The most reliable method is Google Search Console's Coverage report, which shows indexed pages and the reason for any exclusions. For individual pages, the URL Inspection tool in Search Console shows the indexing status, last crawl date, and any issues preventing indexing. A quick manual check is searching site:yourdomain.com in Google — the results show indexed pages (though this count is approximate). If important pages are not indexed, Search Console provides the most diagnostic information about why.
Indexing time varies from hours to weeks depending on: the site's crawl frequency (established sites with frequent new content are crawled more often), the page's position in the site architecture (pages with many internal links are discovered faster), and the page's quality signals. Submitting a URL through Google Search Console's URL Inspection tool and clicking 'Request Indexing' can accelerate discovery for important new pages. XML sitemap submission also helps Google discover new URLs more efficiently.