---
title: "Indexing"
description: "The process by which a search engine stores and organizes crawled web pages in its database so they can be retrieved and displayed in search results."
url: "https://skribra.com/glossary/indexing"
type: "glossary-term"
category: "Technical SEO"
updated: "2026-06-08"
---

# Indexing

**Definition.** The process by which a search engine stores and organizes crawled web pages in its database so they can be retrieved and displayed in search results.

**In short.** Indexing is Google saving your page to its database. Only indexed pages can appear in search results — crawling gets Google to your page, indexing is Google deciding it's worth keeping.

## Key points

- A page must be crawled before it can be indexed, but not every crawled page gets indexed — Google may exclude thin, duplicate, or low-quality content
- You can check indexing status in Google Search Console using the URL Inspection tool or the Coverage report
- Common reasons for non-indexing: noindex tags, canonicalized to another URL, blocked by robots.txt, or deemed low-quality by Google's algorithms
- Submitting an XML sitemap speeds up indexing by directly telling Google which URLs to prioritize

## The Crawl-Index-Rank Pipeline

Getting a page to rank involves three sequential steps: Googlebot must discover and crawl the page (see [Crawlability](https://skribra.com/glossary/crawlability)), Google's systems must process and store it in the search index (indexing), and the page must be evaluated against hundreds of signals to determine its [ranking position](https://skribra.com/glossary/serp)[1]. A failure at any step prevents ranking. Many SEO problems that look like 'the page isn't ranking' are actually 'the page isn't indexed' — always check indexing status in Google Search Console before investigating ranking signals.

## Why Google Might Not Index a Page

Google doesn't index everything it crawls[1]. Pages with thin or duplicate content may be excluded in favor of the [canonical version](https://skribra.com/glossary/canonical-url). Pages behind login walls, with noindex meta tags, or blocked by [Robots.txt](https://skribra.com/glossary/robots-txt) won't be indexed. Soft 404 pages — pages that return a 200 HTTP status but display 'not found' or empty content — may also be excluded. Low [E-E-A-T signals](https://skribra.com/glossary/e-e-a-t) can also cause Google to de-prioritize indexing certain pages, particularly for health, finance, and other sensitive topics.

## Speeding Up Indexing

For new or recently updated pages, several tactics accelerate indexing[2]. Submitting the URL directly in Google Search Console's URL Inspection tool triggers a recrawl request. Ensuring your [XML sitemap](https://skribra.com/glossary/sitemap) includes the URL and is submitted in Search Console helps. Getting an external site (or high-authority internal page) to link to the new URL signals importance. For existing sites, regularly publishing fresh content trains Googlebot to crawl more frequently. Platforms like Skribra [publish on a consistent schedule](https://skribra.com/features/publishing) — maintaining crawl frequency that keeps new content indexed quickly.

## Related terms

- [Crawlability](https://skribra.com/glossary/crawlability): The ability of search engine bots to access, navigate, and read the pages on your website without encountering technical barriers.
- [Robots.txt](https://skribra.com/glossary/robots-txt): A plain text file at the root of a website (e.g., example.com/robots.txt) that instructs search engine crawlers which pages or sections they are and are not allowed to crawl.
- [Canonical URL](https://skribra.com/glossary/canonical-url): An HTML tag that tells search engines which version of a page is the preferred, authoritative URL when multiple URLs serve the same or very similar content.
- [XML Sitemap](https://skribra.com/glossary/sitemap): A file (typically in XML format) that lists all the important URLs on a website, helping search engines discover and crawl content more efficiently.

## Sources

1. [Google Search Central — How Google Search Works](https://developers.google.com/search/docs/fundamentals/how-search-works)
2. [Google Search Central — Crawling and Indexing Overview](https://developers.google.com/search/docs/crawling-indexing)

## Machine-readable index

- HTML version of this page: https://skribra.com/glossary/indexing
- Site index for agents: https://skribra.com/llms.txt
- Sitemap: https://skribra.com/sitemap.xml
- Public REST API: https://skribra.com/api/v1
- OpenAPI specification: https://skribra.com/openapi.json