Database
There are currently 1754 real crawlers registered in the database.
| Nr. | Name | Host | Rating | Updated | Info |
|---|---|---|---|---|---|
| 1 | 2IP-Bot/1.1 | http://2ip.io | Lower | 2025-12-01 20:53:32 | |
| 2 | ABEvalBot/0.1 | - | Lower | 2026-07-18 06:14:36 | |
| 3 | AI2Bot | https://www.allenai.org/crawler | Lower | 2026-05-05 19:00:06 | |
| 4 | AcademicResearchBot/... | - | Lower | 2025-11-26 02:00:13 | |
| 5 | Addedlovely.com/craw... | https://addedlovely.com/crawler | Lower | 2026-07-17 04:00:05 | |
| 6 | Ads-txt-crawler/1.0 | - | Lower | 2026-08-24 13:00:08 | |
| 7 | Ads-txt-crawler/2.0 | - | Lower | 2026-08-27 19:00:08 | |
| 8 | AdsBot-Google | http://www.google.com/adsbot.html | Lower | 2026-01-07 22:14:21 | |
| 9 | AdsBot-Google-Mobile | http://www.google.com/mobile/adsbot.html | Lower | 2025-05-22 04:00:09 | |
| 10 | Affsignal.com/bot | https://affsignal.com/bot | Lower | 2026-05-19 07:00:06 | |
| 11 | AgentTrustBot/1.0 | https://agenttru.st/crawler | Lower | 2026-09-12 03:09:54 | |
| 12 | AhrefsBot/7.0 | https://ahrefs.com/robot/ | High | 2026-09-12 04:07:53 | |
| 13 | AiShoplistBot/1.0 | https://ai-shoplist.de/bot | Lower | 2026-09-11 01:00:07 | |
| 14 | AkoniLeadHuntBot/0.1 | https://www.recruiting-systems.com | Lower | 2026-08-15 19:00:07 | |
| 15 | AkoniLeadHuntBot/1.0 | https://www.recruiting-systems.com | Lower | 2026-08-27 23:15:05 | |
| 16 | AliyunSecBot/Aliyun | https://service.alibaba.com | Medium | 2026-08-11 04:03:45 | |
| 17 | Amazing-SearchBot/0.... | https://amazing.com/bot.html | Lower | 2026-02-25 23:14:11 | |
| 18 | Amazonbot/0.1 | https://developer.amazon.com/support/amazonbot | High | 2026-09-12 04:14:43 | |
| 19 | Amzn-SearchBot/1.0 | https://developer.amazon.com/support/amazonbot | Lower | 2026-08-29 16:11:52 | |
| 20 | App-ads-crawler/1.0 | - | Lower | 2026-08-27 22:00:06 |
Addedlovely.com/craw...
Host:
https://addedlovely.com/crawler
Rating:
Lower
Updated(UTC):
2026-07-17 04:00:05
AdsBot-Google-Mobile
Host:
http://www.google.com/mobile/adsbot.html
Rating:
Lower
Updated(UTC):
2025-05-22 04:00:09
AkoniLeadHuntBot/0.1
Host:
https://www.recruiting-systems.com
Rating:
Lower
Updated(UTC):
2026-08-15 19:00:07
AkoniLeadHuntBot/1.0
Host:
https://www.recruiting-systems.com
Rating:
Lower
Updated(UTC):
2026-08-27 23:15:05
AliyunSecBot/Aliyun
Host:
https://service.alibaba.com
Rating:
Medium
Updated(UTC):
2026-08-11 04:03:45
Amazing-SearchBot/0....
Host:
https://amazing.com/bot.html
Rating:
Lower
Updated(UTC):
2026-02-25 23:14:11
Amazonbot/0.1
Host:
https://developer.amazon.com/support/amazonbot
Rating:
High
Updated(UTC):
2026-09-12 04:14:43
Amzn-SearchBot/1.0
Host:
https://developer.amazon.com/support/amazonbot
Rating:
Lower
Updated(UTC):
2026-08-29 16:11:52