Database
There are currently 332 real crawlers registered in the database.
| Nr. | Name | Host | Rating | Updated | Info |
|---|---|---|---|---|---|
| 41 | Dmbot/1.1 | - | Lower | 2026-01-29 21:07:03 | |
| 42 | DnBCrawler-Analytics | - | Lower | 2026-01-21 07:33:28 | |
| 43 | Domain Crawler | - | Lower | 2025-08-08 05:30:38 | |
| 44 | DomainScraper/1.0 | - | Lower | 2026-02-07 16:10:01 | |
| 45 | DomainStatsBot/1.0 | https://domainstats.com/pages/our-bot | Lower | 2026-01-25 07:24:42 | |
| 46 | Domainsbot.com/pandalytics | https://domainsbot.com/pandalytics/ | Lower | 2026-01-20 08:08:29 | |
| 47 | DotBot/1.1 | http://www.opensiteexplorer.org/dotbot | Lower | 2025-12-31 01:02:23 | |
| 48 | DotBot/1.2 | https://opensiteexplorer.org/dotbot | High | 2026-02-09 15:12:58 | |
| 49 | DuckAssistBot/1.2 | http://duckduckgo.com/duckassistbot.html | Lower | 2026-01-16 19:45:09 | |
| 50 | DuckDuckBot-Https/1.1 | https://duckduckgo.com/duckduckbot | Lower | 2025-12-17 14:49:29 | |
| 51 | DuckDuckBot/1.0 | http://duckduckgo.com/duckduckbot.html | Lower | 2025-11-23 08:48:00 | |
| 52 | DuckDuckBot/1.1 | http://duckduckgo.com/duckduckbot.html | Lower | 2026-02-09 05:40:37 | |
| 53 | DuckDuckGo-Favicons-Bot/1.0 | http://duckduckgo.com | Lower | 2025-04-18 08:35:07 | |
| 54 | EurolixBot/1.0 | https://eurolix.eu | Lower | 2025-06-27 23:36:28 | |
| 55 | Ev-crawler/1.0 | https://headline.com/legal/crawler | Lower | 2026-02-06 19:08:48 | |
| 56 | Everyfeed-spider/2.0 | http://www.everyfeed.com | Lower | 2025-11-09 15:22:21 | |
| 57 | Exabot/3.0 | http://www.exabot.com/go/robot | Lower | 2025-11-25 20:00:07 | |
| 58 | Expo-research-bot | - | Lower | 2026-01-31 03:12:55 | |
| 59 | Facebook-Crawler | https://developers.facebook.com/docs/sharing/webmasters/crawler | High | 2026-02-09 15:22:34 | |
| 60 | Facebot Twitterbot/1.0 | https://facebot.io/ | Lower | 2026-02-09 13:08:39 |
DomainStatsBot/1.0
Host:
https://domainstats.com/pages/our-bot
Rating:
Lower
Updated(UTC):
2026-01-25 07:24:42
Domainsbot.com/pandalytics
Host:
https://domainsbot.com/pandalytics/
Rating:
Lower
Updated(UTC):
2026-01-20 08:08:29
DotBot/1.1
Host:
http://www.opensiteexplorer.org/dotbot
Rating:
Lower
Updated(UTC):
2025-12-31 01:02:23
DuckAssistBot/1.2
Host:
http://duckduckgo.com/duckassistbot.html
Rating:
Lower
Updated(UTC):
2026-01-16 19:45:09
DuckDuckBot-Https/1.1
Host:
https://duckduckgo.com/duckduckbot
Rating:
Lower
Updated(UTC):
2025-12-17 14:49:29
DuckDuckBot/1.0
Host:
http://duckduckgo.com/duckduckbot.html
Rating:
Lower
Updated(UTC):
2025-11-23 08:48:00
DuckDuckBot/1.1
Host:
http://duckduckgo.com/duckduckbot.html
Rating:
Lower
Updated(UTC):
2026-02-09 05:40:37
DuckDuckGo-Favicons-Bot/1.0
Rating:
Lower
Updated(UTC):
2025-04-18 08:35:07
Ev-crawler/1.0
Host:
https://headline.com/legal/crawler
Rating:
Lower
Updated(UTC):
2026-02-06 19:08:48
Everyfeed-spider/2.0
Rating:
Lower
Updated(UTC):
2025-11-09 15:22:21
Facebook-Crawler
Host:
https://developers.facebook.com/docs/sharing/webmasters/crawler
Rating:
High
Updated(UTC):
2026-02-09 15:22:34