Database
There are currently 332 real crawlers registered in the database.
1 - 20 of 220 results
| Nr. | Name | Host | Rating | Updated | Info |
|---|---|---|---|---|---|
| 1 | 2IP-Bot/1.1 | http://2ip.io | Lower | 2025-12-01 20:53:32 | |
| 2 | AcademicResearchBot/1.0 | - | Lower | 2025-11-26 02:00:13 | |
| 3 | AdsBot-Google | http://www.google.com/adsbot.html | Lower | 2026-01-07 22:14:21 | |
| 4 | AdsBot-Google-Mobile | http://www.google.com/mobile/adsbot.html | Lower | 2025-05-22 04:00:09 | |
| 5 | AhrefsBot/7.0 | https://ahrefs.com/robot/ | High | 2026-02-09 15:22:42 | |
| 6 | AliyunSecBot/Aliyun | https://service.alibaba.com | Lower | 2026-02-01 18:31:37 | |
| 7 | Amazing-SearchBot/0.1 | https://amazing.com/bot.html | Lower | 2026-02-04 20:00:06 | |
| 8 | Amazonbot/0.1 | https://developer.amazon.com/support/amazonbot | High | 2026-02-07 23:45:02 | |
| 9 | Applebot/0.1 | http://www.apple.com/go/applebot | Medium | 2026-02-09 05:06:56 | |
| 10 | Archive.org_bot | http://archive.org/details/archive.org_bot | Lower | 2025-04-18 01:35:07 | |
| 11 | AwarioBot/1.0 | https://awario.com/bots.html | High | 2026-02-04 02:58:51 | |
| 12 | BLEXBot/1.0 | http://webmeup-crawler.com/ | Lower | 2025-04-18 05:05:08 | |
| 13 | BacklinksExtendedBot | - | Lower | 2025-04-18 03:55:07 | |
| 14 | Baiduspider-render/2.0 | http://www.baidu.com/search/spider.html | Lower | 2026-02-09 06:31:56 | |
| 15 | Baiduspider/2.0 | http://www.baidu.com/search/spider.html | Lower | 2026-02-09 14:59:58 | |
| 16 | Barkrowler/0.9 | https://babbar.tech/crawler | High | 2026-02-09 15:24:10 | |
| 17 | Bingbot/2.0 | http://www.bing.com/bingbot.htm | High | 2026-02-09 15:23:55 | |
| 18 | BitSightBot/1.0 | https://www.bitsight.com/ | Lower | 2026-01-07 17:36:20 | |
| 19 | BrightEdge-Crawler/1.0 | https://brightedge.com | Lower | 2025-04-18 02:00:08 | |
| 20 | Bytespider | https://bytedance.com | Medium | 2026-02-09 14:58:29 |
AdsBot-Google-Mobile
Host:
http://www.google.com/mobile/adsbot.html
Rating:
Lower
Updated(UTC):
2025-05-22 04:00:09
Amazing-SearchBot/0.1
Host:
https://amazing.com/bot.html
Rating:
Lower
Updated(UTC):
2026-02-04 20:00:06
Amazonbot/0.1
Host:
https://developer.amazon.com/support/amazonbot
Rating:
High
Updated(UTC):
2026-02-07 23:45:02
Archive.org_bot
Host:
http://archive.org/details/archive.org_bot
Rating:
Lower
Updated(UTC):
2025-04-18 01:35:07
Baiduspider-render/2.0
Host:
http://www.baidu.com/search/spider.html
Rating:
Lower
Updated(UTC):
2026-02-09 06:31:56
Baiduspider/2.0
Host:
http://www.baidu.com/search/spider.html
Rating:
Lower
Updated(UTC):
2026-02-09 14:59:58
BrightEdge-Crawler/1.0
Rating:
Lower
Updated(UTC):
2025-04-18 02:00:08
Bytespider
Rating:
Medium
Updated(UTC):
2026-02-09 14:58:29