# URL discovery

Category: [Crawling & Indexing](https://seo-geo-glossary.com/en/glossary/category/crawling-indexing/) › [Crawling & crawl budget](https://seo-geo-glossary.com/en/glossary/category/crawling-indexing/crawling-crawl-budget/) · Also known as: URL discovery

**URL discovery** is the step in which a search engine learns that a URL exists, before it fetches the page. In SEO, the term describes how Google finds new addresses on a website. Google's own documentation calls this process "URL discovery".

## How does Google discover URLs?

According to Google, there is no central registry of all web pages, so it has to look for new and updated pages continuously. It finds URLs in three ways: by revisiting pages it already knows, by following links from known pages, and by processing sitemaps that site owners submit.

Links are the main route. Google says every page you care about should have a link from at least one other page on your site. A page without internal links, an orphan page, can therefore only be found through a sitemap or an external link.

A test by searchVIU (2017) with a control page found that an internal link injected with JavaScript was enough for Google to find and index a page. In the same test, Google also indexed a URL that was mentioned only inside a JSON-LD block. Google doesn't document this as a discovery path, so it is best not to rely on it.

## Discovered, crawled, indexed

These are separate steps. Googlebot visits discovered URLs to crawl them, and Google states that indexing is not guaranteed. A sitemap helps discovery but does not guarantee that every listed URL is crawled or indexed. Google says sitemaps matter most for large sites of about 500 pages or more and for new sites with few external links.

## Example

A new product category is added to the main navigation. The next time Googlebot crawls the homepage, it finds the link. The category URL is now discovered and waits to be crawled.

*Diagram: From URL to search result.* Schematic path of a URL through Google Search. Google describes three stages: crawling (including discovery and rendering), indexing and serving search results. Indexing is not guaranteed.

## Related terms

- [Crawling](https://seo-geo-glossary.com/en/glossary/crawling/index.md)
- [Indexing](https://seo-geo-glossary.com/en/glossary/indexing/index.md)
- [XML sitemap](https://seo-geo-glossary.com/en/glossary/xml-sitemap/index.md)
- [Internal linking](https://seo-geo-glossary.com/en/glossary/internal-linking/index.md)
- [Orphan page](https://seo-geo-glossary.com/en/glossary/orphan-page/index.md)

## More on the searchVIU blog

- [More JavaScript SEO experiments with Google Tag Manager](https://www.searchviu.com/en/javascript-seo-experiments-google-tag-manager/)

## Sources

- [In-depth guide to how Google Search works – Google Search Central](https://developers.google.com/search/docs/fundamentals/how-search-works)
- [Build and submit a sitemap – Google Search Central](https://developers.google.com/search/docs/crawling-indexing/sitemaps/overview)
- [Link best practices for Google – Google Search Central](https://developers.google.com/search/docs/crawling-indexing/links-crawlable)
- [More JavaScript SEO experiments with Google Tag Manager – searchVIU blog (2017)](https://www.searchviu.com/en/javascript-seo-experiments-google-tag-manager/)
- [Understand the JavaScript SEO basics – Google Search Central](https://developers.google.com/search/docs/crawling-indexing/javascript/javascript-seo-basics)

---

Last updated: October 8, 2026
URL: https://seo-geo-glossary.com/en/glossary/url-discovery/