Database
There are currently 1587 real crawlers registered in the database.
| Nr. | Name | Host | Rating | Updated | Info |
|---|---|---|---|---|---|
| 41 | CareerScraper/1.0 | - | Lower | 2026-01-16 12:34:03 | |
| 42 | ChatGPT Atlas/20251222192530000 | https://chatgpt.com/de-DE/atlas/ | Lower | 2026-01-11 12:25:05 | |
| 43 | ChatGPT-User/1.0 | https://openai.com/bot | High | 2026-07-21 06:46:10 | |
| 44 | CheckMarkNetwork/1.0 | http://www.checkmarknetwork.com/spider.html | Lower | 2026-06-30 04:13:11 | |
| 45 | Claude-SearchBot/1.0 | https://anthropic.com | Lower | 2025-04-18 08:40:08 | |
| 46 | ClaudeBot/1.0 | https://anthropic.com | High | 2026-07-21 04:34:24 | |
| 47 | Coccocbot-web/1.0 | http://help.coccoc.com/searchengine | Lower | 2026-07-19 02:27:07 | |
| 48 | CodaBot/1.0 | - | High | 2026-07-04 23:29:08 | |
| 49 | CohereBot/1.0 | https://cohere.com/bot | Lower | 2026-05-17 05:00:55 | |
| 50 | CommonCrawl/Nutch-1.22-SNAPSHOT | - | Lower | 2026-03-13 08:00:20 | |
| 51 | Commoncrawl | https://commoncrawl.org/ | Lower | 2026-07-07 01:00:07 | |
| 52 | Companyspotter - 2.0.0.0 | https://companyspotter.com | Lower | 2026-05-15 13:21:52 | |
| 53 | Comscore.com/Web-Crawler | https://www.comscore.com/Web-Crawler | Lower | 2026-07-08 09:19:30 | |
| 54 | CoostiBot/1.0 | https://coosti.dk/bot-info | Lower | 2026-03-28 11:00:05 | |
| 55 | Crawl4AI/1.0 | - | Lower | 2026-02-16 11:00:17 | |
| 56 | Crawler | - | Lower | 2026-04-24 01:00:10 | |
| 57 | Crawler bot | https://llmstxtscan.org | Lower | 2026-07-16 16:00:07 | |
| 58 | CrawlmBot/1.0 | https://github.com/rodyherrera/Crawlm | Lower | 2026-07-16 09:30:12 | |
| 59 | Creditreform-ESG-Bot | - | Lower | 2026-01-28 14:00:12 | |
| 60 | DATABASE | http://78.29.56.26/antivirus/?s1=CU_sloboda-shop.de | Lower | 2026-06-27 03:39:07 |
ChatGPT Atlas/20251222192530000
Host:
https://chatgpt.com/de-DE/atlas/
Rating:
Lower
Updated(UTC):
2026-01-11 12:25:05
ChatGPT-User/1.0
Rating:
High
Updated(UTC):
2026-07-21 06:46:10
CheckMarkNetwork/1.0
Host:
http://www.checkmarknetwork.com/spider.html
Rating:
Lower
Updated(UTC):
2026-06-30 04:13:11
Claude-SearchBot/1.0
Rating:
Lower
Updated(UTC):
2025-04-18 08:40:08
ClaudeBot/1.0
Rating:
High
Updated(UTC):
2026-07-21 04:34:24
Coccocbot-web/1.0
Host:
http://help.coccoc.com/searchengine
Rating:
Lower
Updated(UTC):
2026-07-19 02:27:07
CohereBot/1.0
Rating:
Lower
Updated(UTC):
2026-05-17 05:00:55
CommonCrawl/Nutch-1.22-SNAPSHOT
Host:
-
Rating:
Lower
Updated(UTC):
2026-03-13 08:00:20
Commoncrawl
Rating:
Lower
Updated(UTC):
2026-07-07 01:00:07
Companyspotter - 2.0.0.0
Host:
https://companyspotter.com
Rating:
Lower
Updated(UTC):
2026-05-15 13:21:52
Comscore.com/Web-Crawler
Host:
https://www.comscore.com/Web-Crawler
Rating:
Lower
Updated(UTC):
2026-07-08 09:19:30
Crawler bot
Rating:
Lower
Updated(UTC):
2026-07-16 16:00:07
CrawlmBot/1.0
Host:
https://github.com/rodyherrera/Crawlm
Rating:
Lower
Updated(UTC):
2026-07-16 09:30:12
DATABASE
Host:
http://78.29.56.26/antivirus/?s1=CU_sloboda-shop.de
Rating:
Lower
Updated(UTC):
2026-06-27 03:39:07