- Bot management
Bot management means detecting automated requests to a website, classifying them and deciding what happens next.
- Bot traffic
Bot traffic is any traffic to a website that comes from automated programs instead of people.
- Bot verification
Bot verification is the check whether a crawler really belongs to the operator named in its user agent.
- Crawler IP ranges
Crawler IP ranges are the IP address blocks from which a search engine operator runs its crawlers.
- Fake Googlebot
A fake Googlebot is a client that identifies itself as Googlebot in the user agent but does not come from Google.
- Rate limiting
Rate limiting controls how many requests a client may send to a server or API within a set time.