Database
There are currently 826 real crawlers registered in the database.
1 - 20 of 677 results
| Nr. | Name | Host | Rating | Updated | Info |
|---|---|---|---|---|---|
| 1 | 2IP-Bot/1.1 | http://2ip.io | Lower | 2025-12-01 20:53:32 | |
| 2 | AI2Bot | https://www.allenai.org/crawler | Lower | 2026-05-05 19:00:06 | |
| 3 | AcademicResearchBot/1.0 | - | Lower | 2025-11-26 02:00:13 | |
| 4 | AdsBot-Google | http://www.google.com/adsbot.html | Lower | 2026-01-07 22:14:21 | |
| 5 | AdsBot-Google-Mobile | http://www.google.com/mobile/adsbot.html | Lower | 2025-05-22 04:00:09 | |
| 6 | AhrefsBot/7.0 | https://ahrefs.com/robot/ | High | 2026-05-11 13:42:10 | |
| 7 | AliyunSecBot/Aliyun | https://service.alibaba.com | Medium | 2026-05-11 11:32:06 | |
| 8 | Amazing-SearchBot/0.1 | https://amazing.com/bot.html | Lower | 2026-02-25 23:14:11 | |
| 9 | Amazonbot/0.1 | https://developer.amazon.com/support/amazonbot | High | 2026-05-11 14:05:43 | |
| 10 | Applebot/0.1 | http://www.apple.com/go/applebot | High | 2026-05-11 14:04:52 | |
| 11 | Aranet-SearchBot/1.0 | https://aranet.ai/bot | Lower | 2026-05-01 19:00:05 | |
| 12 | Archive.org_bot | http://archive.org/details/archive.org_bot | Lower | 2025-04-18 01:35:07 | |
| 13 | AwarioBot/1.0 | https://awario.com/bots.html | High | 2026-02-24 09:35:07 | |
| 14 | BLEXBot/1.0 | http://webmeup-crawler.com/ | Medium | 2025-04-18 05:05:08 | |
| 15 | BacklinksExtendedBot | - | Lower | 2025-04-18 03:55:07 | |
| 16 | Baiduspider-render/2.0 | http://www.baidu.com/search/spider.html | Lower | 2026-03-19 02:33:25 | |
| 17 | Baiduspider/2.0 | http://www.baidu.com/search/spider.html | High | 2026-05-11 13:55:18 | |
| 18 | Barkrowler/0.9 | https://babbar.tech/crawler | High | 2026-05-10 02:08:40 | |
| 19 | BingIndexCrawler/1.0 | - | Lower | 2026-03-11 01:12:23 | |
| 20 | Bingbot/2.0 | http://www.bing.com/bingbot.htm | High | 2026-05-11 14:17:32 |
AdsBot-Google-Mobile
Host:
http://www.google.com/mobile/adsbot.html
Rating:
Lower
Updated(UTC):
2025-05-22 04:00:09
AliyunSecBot/Aliyun
Host:
https://service.alibaba.com
Rating:
Medium
Updated(UTC):
2026-05-11 11:32:06
Amazing-SearchBot/0.1
Host:
https://amazing.com/bot.html
Rating:
Lower
Updated(UTC):
2026-02-25 23:14:11
Amazonbot/0.1
Host:
https://developer.amazon.com/support/amazonbot
Rating:
High
Updated(UTC):
2026-05-11 14:05:43
Aranet-SearchBot/1.0
Rating:
Lower
Updated(UTC):
2026-05-01 19:00:05
Archive.org_bot
Host:
http://archive.org/details/archive.org_bot
Rating:
Lower
Updated(UTC):
2025-04-18 01:35:07
Baiduspider-render/2.0
Host:
http://www.baidu.com/search/spider.html
Rating:
Lower
Updated(UTC):
2026-03-19 02:33:25
Baiduspider/2.0
Host:
http://www.baidu.com/search/spider.html
Rating:
High
Updated(UTC):
2026-05-11 13:55:18