Database
There are currently 1289 real crawlers registered in the database.
21 - 40 of 1063 results
| Nr. | Name | Host | Rating | Updated | Info |
|---|---|---|---|---|---|
| 21 | Barkrowler/0.9 | https://babbar.tech/crawler | High | 2026-06-06 10:52:23 | |
| 22 | BilateralNavigator-PageFetch/1.0 | https://bilateralnavigator.com/bot | Lower | 2026-06-05 14:44:35 | |
| 23 | BingIndexCrawler/1.0 | - | Lower | 2026-03-11 01:12:23 | |
| 24 | Bingbot/2.0 | http://www.bing.com/bingbot.htm | High | 2026-06-11 12:33:11 | |
| 25 | BitSightBot/1.0 | https://www.bitsight.com/ | Lower | 2026-01-07 17:36:20 | |
| 26 | Bot/1.0 | - | Lower | 2026-02-22 18:34:17 | |
| 27 | Bot/1.1 | https://2ip.io/bot/ | Lower | 2026-06-10 01:58:26 | |
| 28 | BrandDiscoveryBot/1.0 | - | Lower | 2026-04-01 10:00:09 | |
| 29 | BrightEdge-Crawler/1.0 | https://brightedge.com | Lower | 2025-04-18 02:00:08 | |
| 30 | BrokenLinksBot/1.0 | https://brokenlinks.io/bot | Lower | 2026-05-08 07:00:08 | |
| 31 | BuscadorBot/0.1 | https://github.com/buscador | Lower | 2026-03-31 04:00:15 | |
| 32 | Bytespider | https://bytedance.com | High | 2026-06-11 10:57:33 | |
| 33 | CCBot/2.0 | https://commoncrawl.org/faq/ | High | 2026-06-09 00:18:47 | |
| 34 | CandidateCrawler/1.0 | https://example.local | Lower | 2026-04-26 10:14:25 | |
| 35 | CareerScraper/1.0 | - | Lower | 2026-01-16 12:34:03 | |
| 36 | ChatGPT Atlas/20251222192530000 | https://chatgpt.com/de-DE/atlas/ | Lower | 2026-01-11 12:25:05 | |
| 37 | ChatGPT-User/1.0 | https://openai.com/bot | High | 2026-06-11 12:21:08 | |
| 38 | CheckMarkNetwork/1.0 | http://www.checkmarknetwork.com/spider.html | Lower | 2026-05-27 14:50:29 | |
| 39 | Claude-SearchBot/1.0 | https://anthropic.com | Lower | 2025-04-18 08:40:08 | |
| 40 | ClaudeBot/1.0 | https://anthropic.com | High | 2026-06-11 11:08:40 |
BilateralNavigator-PageFetch/1.0
Host:
https://bilateralnavigator.com/bot
Rating:
Lower
Updated(UTC):
2026-06-05 14:44:35
BrightEdge-Crawler/1.0
Rating:
Lower
Updated(UTC):
2025-04-18 02:00:08
Bytespider
Rating:
High
Updated(UTC):
2026-06-11 10:57:33
CandidateCrawler/1.0
Rating:
Lower
Updated(UTC):
2026-04-26 10:14:25
ChatGPT Atlas/20251222192530000
Host:
https://chatgpt.com/de-DE/atlas/
Rating:
Lower
Updated(UTC):
2026-01-11 12:25:05
ChatGPT-User/1.0
Rating:
High
Updated(UTC):
2026-06-11 12:21:08
CheckMarkNetwork/1.0
Host:
http://www.checkmarknetwork.com/spider.html
Rating:
Lower
Updated(UTC):
2026-05-27 14:50:29
Claude-SearchBot/1.0
Rating:
Lower
Updated(UTC):
2025-04-18 08:40:08
ClaudeBot/1.0
Rating:
High
Updated(UTC):
2026-06-11 11:08:40