Deutsch
Indexing & index status

Indexing

Also known as: indexation, Google indexing

Indexing, in SEO, is the step in which a search engine analyzes a crawled page and stores it in its index, the database it draws search results from. Only indexed pages can appear in organic search results. The term is used differently in databases and programming, where an index speeds up lookups in a table or array.

At a glance

Type
analysis of a crawled page and its addition to the search index
Stage in Google Search
second of three (after crawling, before serving)
Guaranteed?
no, Google decides
Prevent with
noindex (meta tag or X-Robots-Tag), page must stay crawlable
Docs
Google: In-depth guide to how Google Search works

Last checked:

How does Google index pages?

Indexing follows crawling. Google processes the text, key tags and attributes such as the <title> element and alt text, and images and videos on the page. It then groups pages with similar content into clusters and picks the most representative one as the canonical, the version that may be shown in search results. The other pages in the cluster are alternates that may appear in specific contexts, for example on mobile. Google also stores signals about the canonical page, such as its language, the country it targets, and its usability.

Google states that indexing is not guaranteed and that not every page it processes will be indexed. Common reasons it names include low content quality, robots meta rules that disallow indexing, and a site design that makes indexing difficult.

From URL to search resultFive stations from left to right: discovery via links and sitemaps, crawling after checking robots.txt, rendering after waiting in the render queue, indexing with duplicate clustering and canonical selection, serving matching results. Links found in the rendered HTML lead back to discovery. Below each station are typical hurdles according to Google.1 · CRAWLING2 · INDEXING3 · SERVINGDiscoverlinks onknown pages,sitemapsCrawlcheck robots.txt,then fetchthe URLRenderrender queueChromium runsthe JavaScriptIndexcluster pages,pick canonical,storeServeresults fromthe index forthe querynew links from the rendered HTMLTYPICAL HURDLES ACCORDING TO GOOGLEno link,no sitemap*server ornetwork errors,robots.txt blocksno 200 statusor noindex: mayskip renderinglow quality,noindex, duplicateof another URLnot relevant,low quality,robots meta ruleSchematic. Google counts discovery and rendering as part of the crawling stage.* An inference, not a Google statement.
Schematic path of a URL through Google Search. Google describes three stages: crawling (including discovery and rendering), indexing and serving search results. Indexing is not guaranteed. Sources: Google Search Central: In-depth guide to how Google Search works; Google Search Central: Understand JavaScript SEO basics.

Crawling vs. indexing

The two steps are linked but controlled separately. A page can be crawled and still not indexed. The Page indexing report in Search Console calls this “Crawled - currently not indexed”. “Discovered - currently not indexed” means Google knows the URL but has not fetched it yet, often because crawling it was expected to overload the site.

Example

A store wants to keep its internal search result pages out of Google’s index. A robots.txt rule is not enough. Google notes that a URL blocked in robots.txt can still be indexed if other pages link to it. The reliable method is a noindex rule, and the page must stay crawlable so Google can read it:

HTML
<meta name="robots" content="noindex">

Common mistakes

  • Serving noindex in the HTML and removing it with JavaScript. When Google sees noindex, it may skip rendering. If the page should be indexed, Google says not to put noindex in the original page code.
  • Combining noindex with a robots.txt block. If robots.txt blocks the page, Google never sees the noindex. The URL can still appear in results if other pages link to it.
  • Treating duplicate statuses as errors. Search Console Help says a page marked as duplicate or alternate is usually a good sign. It means Google found the canonical page and indexed it.

FAQ

How do I check whether a page is indexed? Use the URL Inspection tool in Google Search Console. It shows whether a single URL is in the index and which canonical URL Google selected.

Why is my page not indexed? Typical technical causes are a noindex rule, a different URL chosen as canonical, server errors, or a redirect. If nothing technical is wrong, Google decides on its own whether to include the page.

How long does indexing take? There is no fixed time. Google says crawling alone can take anywhere from a few days to a few weeks after a request. You can request indexing for single URLs in the URL Inspection tool, subject to a quota. For many URLs, Google recommends a sitemap. Requesting the same URL again does not speed things up.

Sources

  1. In-depth guide to how Google Search works – Google Search Central (last updated 2025-12-18)developers.google.com
  2. Page indexing report – Search Console Helpsupport.google.com
  3. Introduction to robots.txt – Google Search Centraldevelopers.google.com
  4. Block search indexing with noindex – Google Search Centraldevelopers.google.com
  5. Ask Google to recrawl your URLs – Google Search Centraldevelopers.google.com
  6. Understand the JavaScript SEO basics – Google Search Centraldevelopers.google.com

Last updated: