FAQ
What are "active" domains?
Active domains have at least one DNS record configured, and are therefore reachable on the internet.
How do you find new domains?
We use multiple ways to discover new domains:
- We use crawlers to scan web pages and analyze the links we find.
- We monitor public zone files for changes. Zone files are lists of domains that are used by DNS servers to resolve hostnames to IP addresses.
- We use machine learning algorithms to predict new domain names based on patterns and trends. After that, we check if those domains have been registered or not.
How can I prevent my domain from being crawled?
To prevent your domain from being crawled by our crawler, you can place a robots.txt file on your website. This file contains instructions for web crawlers on which pages and content they are allowed to crawl.