FAQ

What are "active" domains?

Active domains have at least one DNS record configured, and are therefore reachable on the internet.

How do you find new domains?

We use multiple ways to discover new domains:

How can I prevent my domain from being crawled?

To prevent your domain from being crawled by our crawler, you can place a robots.txt file on your website. This file contains instructions for web crawlers on which pages and content they are allowed to crawl.