magpie-crawler
Unknown
Kasada's content aggregators & rss
Score de légitimité
robots.txt
Non respecté
Fréquence
Faible
Impact serveur
Faible
Recommandation
Surveiller
Données techniques
User-Agent Pattern
magpie-crawlerDétection JS
const ismagpiecrawler = /magpie-crawler/i.test(navigator.userAgent);Qu'est-ce que magpie-crawler ?
magpie-crawler is a content aggregators & rss.
Types de contenu ciblés
Bots similaires
Muck Rack Scraper
Unknown
Muck Rack's feed fetcher
Arquivo-web-crawler
Unknown
Arquivo.pt (FCCN – Fundação para a Computação CientÃfica Nacional)'s content aggregators & rss
Wikipedia Citoid
Wikimedia Foundation
Wikimedia Foundation Inc's content aggregators & rss
AndersPinkBot
Unknown
Anders Pink's content aggregators & rss
panscient.com
Unknown
Panscient, Inc.'s content aggregators & rss
BazQux
Unknown
BazQux's content aggregators & rss
WordPress.com bots
Automattic
Automattic Inc.'s content aggregators & rss
Autres bots de Unknown
magicsearchdev
Unknown
Unknown Author's miscellaneous & unknown
TactiScout
Unknown
Philippe Vincent's miscellaneous & unknown
Discordbot
Unknown
Discord link embed crawler
Pingdom
Unknown
Pingdom monitoring bot
ActiveComply LLC
Unknown
ActiveComply's compliance & monitoring
advanced_crawler
Unknown
Unknown Author's miscellaneous & unknown
HuggingFace-Bot
Unknown
HuggingFace bot
Documentation officielle
Voir la documentation de magpie-crawler