Database
There are currently 1754 real crawlers registered in the database.
| Nr. | Name | Host | Rating | Updated | Info |
|---|---|---|---|---|---|
| 201 | MJ12bot/v2.0.4 | http://mj12bot.com/ | High | 2026-02-24 13:12:17 | |
| 202 | MJ12bot/v2.0.5 | http://mj12bot.com/ | High | 2026-09-12 04:07:31 | |
| 203 | MSIECrawler | - | Lower | 2025-12-31 11:00:10 | |
| 204 | MadeInGermanyBot/1.0 | - | Lower | 2026-08-19 07:00:05 | |
| 205 | Mail.RU_Bot/2.0 | https://help.mail.ru/webmaster/indexing/robots | Lower | 2025-04-18 08:45:06 | |
| 206 | Mail.RU_Bot/Favicons... | https://help.mail.ru/webmaster/indexing/robots | Lower | 2025-08-26 02:26:56 | |
| 207 | MapAtlasBot/1.0 | https://mapmetrics-atlas.net | Lower | 2026-08-22 07:00:05 | |
| 208 | Market-research-bot/... | - | Lower | 2026-08-02 16:00:08 | |
| 209 | MartinBot/1.0 | - | Lower | 2026-03-05 02:00:10 | |
| 210 | MartinGawronAuditBot... | https://martingawron.com/de/website-audit/transparenz/ | Lower | 2026-05-21 18:13:45 | |
| 211 | MartinGawronBot/1.0 | https://martingawron.de/bot | Lower | 2026-03-13 11:00:06 | |
| 212 | MeasureboardResearch... | https://measureboard.com/bot | Lower | 2026-08-18 16:00:06 | |
| 213 | MercuryLeads/1.0 | https://mercuryleads.io/crawler/ | Lower | 2025-12-08 11:43:03 | |
| 214 | Meta-ExternalAgent/1... | https://developers.facebook.com/docs/sharing/webmasters/crawler | High | 2026-09-11 16:28:29 | |
| 215 | Meta-Webindexer/1.1 | https://developers.facebook.com/docs/sharing/webmasters/crawler | Lower | 2026-07-08 08:44:08 | |
| 216 | Meta-externalads/1.1 | https://developers.facebook.com/docs/sharing/webmasters/crawler | Lower | 2026-08-06 22:39:20 | |
| 217 | Meta-webindexer/1.1 | https://developers.facebook.com/docs/sharing/webmasters/crawler | Medium | 2026-09-12 04:10:48 | |
| 218 | MetaJobBot | https://www.metajob.de/crawler | Lower | 2026-09-02 15:06:35 | |
| 219 | MetadataCrawler/1.0 | - | Lower | 2026-03-02 11:00:18 | |
| 220 | MindUpBot | https://datenbutler.de | Lower | 2026-08-29 08:07:52 |
Mail.RU_Bot/2.0
Host:
https://help.mail.ru/webmaster/indexing/robots
Rating:
Lower
Updated(UTC):
2025-04-18 08:45:06
Mail.RU_Bot/Favicons...
Host:
https://help.mail.ru/webmaster/indexing/robots
Rating:
Lower
Updated(UTC):
2025-08-26 02:26:56
MartinGawronAuditBot...
Host:
https://martingawron.com/de/website-audit/transparenz/
Rating:
Lower
Updated(UTC):
2026-05-21 18:13:45
MeasureboardResearch...
Host:
https://measureboard.com/bot
Rating:
Lower
Updated(UTC):
2026-08-18 16:00:06
MercuryLeads/1.0
Host:
https://mercuryleads.io/crawler/
Rating:
Lower
Updated(UTC):
2025-12-08 11:43:03
Meta-ExternalAgent/1...
Host:
https://developers.facebook.com/docs/sharing/webmasters/crawler
Rating:
High
Updated(UTC):
2026-09-11 16:28:29
Meta-Webindexer/1.1
Host:
https://developers.facebook.com/docs/sharing/webmasters/crawler
Rating:
Lower
Updated(UTC):
2026-07-08 08:44:08
Meta-externalads/1.1
Host:
https://developers.facebook.com/docs/sharing/webmasters/crawler
Rating:
Lower
Updated(UTC):
2026-08-06 22:39:20
Meta-webindexer/1.1
Host:
https://developers.facebook.com/docs/sharing/webmasters/crawler
Rating:
Medium
Updated(UTC):
2026-09-12 04:10:48
MindUpBot
Rating:
Lower
Updated(UTC):
2026-08-29 08:07:52