# Crawler

##### Summary

This glossary contains definitions of technical and marketing terms referenced across DAO.AD documentation.

##### Definition

<span style="color: rgb(86, 86, 106); background-color: rgb(255, 255, 255);">When we refer to a web crawler, we refer to software applications that discover new and updated content across the internet. Search engine crawlers do this by following links before sending this content to the indexer where interpretation of its context, relevancy and trustworthiness begins. Crawlers can also be referred to as “bots”, “robots”, “spiders” or “user-agents”.</span>

##### Used in

- [Statistics API](https://wiki.dao.ad/books/api-docs/page/statistics-api "Statistics API")
- [Campaign Management API](https://wiki.dao.ad/books/api-docs/page/campaign-management-api "Campaign Management API")

##### Last Updated

2026-07-05 · Owner: wiki@dao.ad