Bot Directory
Comprehensive database of 945+ web crawlers, AI agents, and monitoring bots. Track, identify, and manage bot traffic effectively.
008
Unknown
Advanced Web Ranking (Caphyon)'s miscellaneous & unknown
2Checkout (Webhooks)
2Checkout
2Checkout (now Verifone)'s api & integration bots
2ip bot
2ip.ru
2ip.ru's miscellaneous & unknown
2ip.ru bot
2ip.ru
2ip.ru's miscellaneous & unknown
360Monitoring
360Monitoring
360Monitoring's monitoring & uptime bots
360Spider
Qihoo 360
Qihoo 360 Technology Co.,Ltd's search engine crawlers
Accessible Web Bot
Unknown
Accessible Web's security & compliance bots
AccessStatus
Unknown
AccessStatus, Inc.'s accessibility bots
ActiveComply LLC
Unknown
ActiveComply's compliance & monitoring
Adagio Digital
Unknown
Adagio Digital's seo & analytics bots
Adbeat bot
Unknown
Adbeat's advertising & marketing bots
adbeat_bot
Unknown
Adbeat Inc.'s advertising & marketing bots
AdsBot-Google
Unknown
AdsBot-Google is a web crawler operated by Google, specifically designed to assess the quality and functionality of landing pages used in Google Ads campaigns. It systematically visits and analyzes these pages to ensure they meet Google's advertising policies and provide a good user experience.
AddSearch Oy
Unknown
AddSearch's seo & site search
AdminLabs
Unknown
Admin Labs Ltd.'s monitoring & uptime bots
AdsBot-Google
Google Ads quality crawler
AdsBot-Google-Mobile
Google's advertising & marketing bots
advanced_crawler
Unknown
Unknown Author's miscellaneous & unknown
Adventurer
Unknown
Unknown Author's miscellaneous & unknown
Adyen
Unknown
Adyen's payments & api
AGAKIDSBOT
Unknown
AGAKIDS's miscellaneous & unknown
Agency Analytics Crawler
Unknown
AgencyAnalytics's seo & analytics bots
AhrefsBot
Ahrefs
Ahrefs SEO crawler
AI2Bot
AI2
Allen Institute AI crawler
AlertSite by SmartBear
Unknown
SmartBear's monitoring & uptime bots
Alexabot
Amazon
Alexa Internet, Inc.'s miscellaneous & unknown
AlexandriaOrgBot
Amazon
Internet Archive (Alexandria.org)'s academic & research crawlers
Algolia
Unknown
Algolia's site search & analytics
alienfarm
Unknown
Unknown Author's miscellaneous & unknown
ALittle Client
Unknown
Unknown Author's miscellaneous & unknown
All Africa Crawler
Unknown
AllAfrica's content aggregators
allOrigins
Unknown
Gabriel Nunes's api & integration bots
alyze.com bot
Amazon
Alexandre Tourette's seo & analytics bots
Amazon Ad
Amazon
Amazon's advertising & marketing bots
Amazon Contx
Amazon
Amazon's advertising & marketing bots
Amazon Kendra
Amazon
Amazon's ai & llm crawlers
Amazonbot
Amazon
Amazon's web crawler for Alexa
AndersPinkBot
Unknown
Anders Pink's content aggregators & rss
Andibot
Unknown
Andi search AI crawler
AntBot
Unknown
Unknown Author's miscellaneous & unknown
Anthropic-AI
Anthropic
Anthropic's AI crawler
Applebot
Apple
Apple's search crawler for Siri
Applebot-Extended
Apple
Apple's AI training crawler
Aranea
Unknown
Vladimír Benko's miscellaneous & unknown
archive-org_bot
Internet Archive
Internet Archive's academic & research crawlers
ArchiveBot
Internet Archive
Internet Archive / Archive Team's content aggregators & rss
ArchiveBox
Unknown
Nick Sweeting's miscellaneous & unknown
archive.org_bot
Internet Archive
Internet Archive's content aggregators & rss
ArchiveTeam crawler
Unknown
Archive Team's content aggregators & rss
Arquivo-web-crawler
Unknown
Arquivo.pt (FCCN – Fundação para a Computação Científica Nacional)'s content aggregators & rss