Database
There are currently 1887 real crawlers registered in the database.
1 - 20 of 1561 results
| Nr. | Name | Host | Rating | Updated | Info |
|---|---|---|---|---|---|
| 1 | 2IP-Bot/1.1 | http://2ip.io | Lower | 2025-12-01 20:53:32 | |
| 2 | A11yScanBot/1.0 | http://46.62.237.229/bot | Lower | 2026-10-09 09:21:23 | |
| 3 | ABEvalBot/0.1 | - | Lower | 2026-07-18 06:14:36 | |
| 4 | AI2Bot | https://www.allenai.org/crawler | Lower | 2026-05-05 19:00:06 | |
| 5 | Academic crawler | https://wrenni.com | Lower | 2026-09-19 09:43:56 | |
| 6 | AcademicResearchBot/... | - | Lower | 2025-11-26 02:00:13 | |
| 7 | Addedlovely.com/craw... | https://addedlovely.com/crawler | Lower | 2026-07-17 04:00:05 | |
| 8 | Ads-txt-crawler/1.0 | - | Lower | 2026-08-24 13:00:08 | |
| 9 | Ads-txt-crawler/2.0 | - | Lower | 2026-08-27 19:00:08 | |
| 10 | AdsBot-Google | http://www.google.com/adsbot.html | Lower | 2026-01-07 22:14:21 | |
| 11 | AdsBot-Google-Mobile | http://www.google.com/mobile/adsbot.html | Lower | 2025-05-22 04:00:09 | |
| 12 | AdsNexusBot/1.0 | - | Lower | 2026-09-23 09:20:29 | |
| 13 | AdsNexusBot/1.3 | https://example.invalid/bot | Lower | 2026-09-29 22:00:08 | |
| 14 | Affsignal.com/bot | https://affsignal.com/bot | Lower | 2026-05-19 07:00:06 | |
| 15 | AgentDataBot/1.0 | https://agentdata.run/bot | Lower | 2026-10-07 03:16:38 | |
| 16 | AgentTrustBot/1.0 | https://agenttru.st/crawler | Lower | 2026-09-15 13:52:58 | |
| 17 | AhrefsBot/7.0 | https://ahrefs.com/robot/ | High | 2026-10-09 07:57:13 | |
| 18 | AiShoplistBot/1.0 | https://ai-shoplist.de/bot | Lower | 2026-09-11 01:00:07 | |
| 19 | AkoniLeadHuntBot/0.1 | https://www.recruiting-systems.com | Lower | 2026-10-06 08:13:33 | |
| 20 | AkoniLeadHuntBot/1.0 | https://www.recruiting-systems.com | Lower | 2026-08-27 23:15:05 |
A11yScanBot/1.0
Rating:
Lower
Updated(UTC):
2026-10-09 09:21:23
Addedlovely.com/craw...
Host:
https://addedlovely.com/crawler
Rating:
Lower
Updated(UTC):
2026-07-17 04:00:05
AdsBot-Google-Mobile
Host:
http://www.google.com/mobile/adsbot.html
Rating:
Lower
Updated(UTC):
2025-05-22 04:00:09
AkoniLeadHuntBot/0.1
Host:
https://www.recruiting-systems.com
Rating:
Lower
Updated(UTC):
2026-10-06 08:13:33
AkoniLeadHuntBot/1.0
Host:
https://www.recruiting-systems.com
Rating:
Lower
Updated(UTC):
2026-08-27 23:15:05