CRO
Summary
This glossary contains definitions of technical and marketing terms referenced across DAO.AD documentation.
Definition
When we refer to a web crawler, we refer to software applications that discover new and updated content across the internet. Search engine crawlers do this by following links before sending this content to the indexer where interpretation of its context, relevancy and trustworthiness begins. Crawlers can also be referred to as “bots”, “robots”, “spiders” or “user-agents”.
Used in
Last Updated
2026-07-05 · Owner: [email protected]