Database
There are currently 1289 real crawlers registered in the database.
| Nr. | Name | Host | Rating | Updated | Info |
|---|---|---|---|---|---|
| 1 | 2IP-Bot/1.1 | http://2ip.io | Lower | 2025-12-01 20:53:32 | |
| 2 | ABEvalBot/0.1 | - | Lower | 2026-05-18 19:00:09 | |
| 3 | AI2Bot | https://www.allenai.org/crawler | Lower | 2026-05-05 19:00:06 | |
| 4 | AcademicResearchBot/1.0 | - | Lower | 2025-11-26 02:00:13 | |
| 5 | Addedlovely.com/crawler | https://addedlovely.com/crawler | Lower | 2026-06-10 22:29:17 | |
| 6 | AdsBot-Google | http://www.google.com/adsbot.html | Lower | 2026-01-07 22:14:21 | |
| 7 | AdsBot-Google-Mobile | http://www.google.com/mobile/adsbot.html | Lower | 2025-05-22 04:00:09 | |
| 8 | Affsignal.com/bot | https://affsignal.com/bot | Lower | 2026-05-19 07:00:06 | |
| 9 | AhrefsBot/7.0 | https://ahrefs.com/robot/ | High | 2026-06-11 13:59:43 | |
| 10 | AliyunSecBot/Aliyun | https://service.alibaba.com | Medium | 2026-05-11 15:26:41 | |
| 11 | Amazing-SearchBot/0.1 | https://amazing.com/bot.html | Lower | 2026-02-25 23:14:11 | |
| 12 | Amazonbot/0.1 | https://developer.amazon.com/support/amazonbot | High | 2026-06-11 13:55:33 | |
| 13 | Applebot/0.1 | http://www.apple.com/go/applebot | High | 2026-06-11 13:49:34 | |
| 14 | Aranet-SearchBot/1.0 | https://aranet.ai/bot | Lower | 2026-05-01 19:00:05 | |
| 15 | Archive.org_bot | http://archive.org/details/archive.org_bot | Lower | 2025-04-18 01:35:07 | |
| 16 | AwarioBot/1.0 | https://awario.com/bots.html | High | 2026-06-07 09:45:54 | |
| 17 | BLEXBot/1.0 | http://webmeup-crawler.com/ | Medium | 2025-04-18 05:05:08 | |
| 18 | BacklinksExtendedBot | - | Lower | 2025-04-18 03:55:07 | |
| 19 | Baiduspider-render/2.0 | http://www.baidu.com/search/spider.html | Lower | 2026-03-19 02:33:25 | |
| 20 | Baiduspider/2.0 | http://www.baidu.com/search/spider.html | High | 2026-06-11 13:53:55 |
Addedlovely.com/crawler
Host:
https://addedlovely.com/crawler
Rating:
Lower
Updated(UTC):
2026-06-10 22:29:17
AdsBot-Google-Mobile
Host:
http://www.google.com/mobile/adsbot.html
Rating:
Lower
Updated(UTC):
2025-05-22 04:00:09
AliyunSecBot/Aliyun
Host:
https://service.alibaba.com
Rating:
Medium
Updated(UTC):
2026-05-11 15:26:41
Amazing-SearchBot/0.1
Host:
https://amazing.com/bot.html
Rating:
Lower
Updated(UTC):
2026-02-25 23:14:11
Amazonbot/0.1
Host:
https://developer.amazon.com/support/amazonbot
Rating:
High
Updated(UTC):
2026-06-11 13:55:33
Aranet-SearchBot/1.0
Rating:
Lower
Updated(UTC):
2026-05-01 19:00:05
Archive.org_bot
Host:
http://archive.org/details/archive.org_bot
Rating:
Lower
Updated(UTC):
2025-04-18 01:35:07
Baiduspider-render/2.0
Host:
http://www.baidu.com/search/spider.html
Rating:
Lower
Updated(UTC):
2026-03-19 02:33:25
Baiduspider/2.0
Host:
http://www.baidu.com/search/spider.html
Rating:
High
Updated(UTC):
2026-06-11 13:53:55