# Crawlability

Category: [Crawling & Indexing](https://seo-geo-glossary.com/en/glossary/category/crawling-indexing/) › [Indexing & index status](https://seo-geo-glossary.com/en/glossary/category/crawling-indexing/indexing-index-status/)

**Crawlability** describes whether a crawler such as Googlebot can reach and fetch a URL. It is the precondition for a page to enter a search index at all. Google does not guarantee that it crawls every page, even when a page is technically reachable.

## What does crawlability depend on?

Google finds pages through links on known pages and through submitted sitemaps. A crawlable link is an `<a>` element with an `href` attribute. Links that only work through script events cannot be reliably extracted. Important pages need at least one link from another page on the site.

Access can be blocked by robots.txt rules, logins or server problems. If a server returns errors or answers slowly, Googlebot lowers its crawling speed. If robots.txt cannot be fetched properly, Google may slow or stop crawling.

Crawlability does not tell whether the page ends up in the index. That depends on indexability, for example `noindex` or the canonical.

## Example

A menu opens categories through a JavaScript click handler with no `href` in the HTML. The category pages are then only discoverable through the sitemap.

```html
<a href="/shoes/">Shoes</a>
<span onclick="goto('/shoes/')">Shoes</span>
```

Google can parse the first link and cannot reliably use the second.

## Common mistakes

- a `Disallow` rule covering a whole directory tree
- pages with no internal links
- content behind a login

## FAQ

**How do I check crawlability?**
Check robots.txt, internal links and server responses. Search Console's Crawl Stats report shows host availability for Googlebot.

*Diagram: From URL to search result.* Schematic path of a URL through Google Search. Google describes three stages: crawling (including discovery and rendering), indexing and serving search results. Indexing is not guaranteed.

## Related terms

- [Crawling](https://seo-geo-glossary.com/en/glossary/crawling/index.md)
- [Indexability](https://seo-geo-glossary.com/en/glossary/indexability/index.md)
- [robots.txt](https://seo-geo-glossary.com/en/glossary/robots-txt/index.md)
- [Internal linking](https://seo-geo-glossary.com/en/glossary/internal-linking/index.md)
- [Crawl budget](https://seo-geo-glossary.com/en/glossary/crawl-budget/index.md)

## Sources

- [In-depth guide to how Google Search works – Google Search Central](https://developers.google.com/search/docs/fundamentals/how-search-works)
- [Link best practices for Google – Google Search Central](https://developers.google.com/search/docs/crawling-indexing/links-crawlable)
- [Crawl Stats report – Search Console Help](https://support.google.com/webmasters/answer/9679690?hl=en)

---

Last updated: October 8, 2026
URL: https://seo-geo-glossary.com/en/glossary/crawlability/