- Home
- Bots
- Monitoring Tools
- Scrapy
Scrapy
OFFICIELUnknown
Scrapy Python framework
Score de légitimité
robots.txt
Respecté
Fréquence
Moyen
Impact serveur
Moyen
Recommandation
Surveiller
Données techniques
User-Agent Pattern
ScrapyDétection JS
const isScrapy = /Scrapy/i.test(navigator.userAgent);Qu'est-ce que Scrapy ?
Scrapy is a popular Python framework for web scraping. When you see Scrapy in logs, it means someone is using the Scrapy framework to crawl your site - this could be legitimate businesses, researchers, or scrapers.
Types de contenu ciblés
Bots similaires
Pingdom
Unknown
Pingdom monitoring bot
SEMrushBot
Semrush
Semrush Inc's seo & analytics bots
AI2Bot
AI2
Allen Institute AI crawler
HuggingFace-Bot
Unknown
HuggingFace bot
AddSearch Oy
Unknown
AddSearch's seo & site search
AlertSite by SmartBear
Unknown
SmartBear's monitoring & uptime bots
360Monitoring
360Monitoring
360Monitoring's monitoring & uptime bots
Autres bots de Unknown
magicsearchdev
Unknown
Unknown Author's miscellaneous & unknown
Pingdom
Unknown
Pingdom monitoring bot
Discordbot
Unknown
Discord link embed crawler
TactiScout
Unknown
Philippe Vincent's miscellaneous & unknown
ActiveComply LLC
Unknown
ActiveComply's compliance & monitoring
advanced_crawler
Unknown
Unknown Author's miscellaneous & unknown
HuggingFace-Bot
Unknown
HuggingFace bot