- AI crawler
An AI crawler is an automated program that fetches web pages for AI applications.
- AI search crawler
An AI search crawler is a crawler that fetches web pages for the search feature of an AI product, so the product can surface and link them …
- Browser agent
A browser agent is an AI system that operates a web browser the way a person does.
- Training crawler
A training crawler is an AI crawler that fetches web pages to collect content for training AI models.
- User-triggered fetcher
A user-triggered fetcher is an automated program that loads a web page because a person asked a product to do so.
- Web scraper
A web scraper is a program that automatically extracts data from web pages and converts it into a structured format such as a spreadsheet …