Ometrix

Monitoring Tools

121 bots documented

Directory of monitoring, SEO tools, and analytics crawlers. Identify traffic from Ahrefs, Semrush, GTmetrix, Pingdom, UptimeRobot and 30+ monitoring tools.

Complete documentationrobots.txt examples

Monitoring tool crawlers check your website's performance, uptime, and SEO metrics. These legitimate bots help you maintain site quality but should be tracked to avoid server overload. Common monitoring crawlers include: - SEO tools: AhrefsBot, SemrushBot, MJ12bot - Performance testing: GTmetrix, Pingdom, PageSpeed Insights - Uptime monitoring: UptimeRobot, StatusCake, Site24x7 - APM tools: Datadog, New Relic Our monitoring crawler directory helps you: - Identify legitimate monitoring traffic - Distinguish from malicious bots - Configure proper access rules - Optimize server resources for legitimate monitoring

All monitoring tools bots

00

008

Advanced Web Ranking (Caphyon)'s miscellaneous & unknown

Unknownmonitoring
36

360Monitoring

360Monitoring's monitoring & uptime bots

360Monitoringmonitoring
AD

AddSearch Oy

AddSearch's seo & site search

Unknownmonitoring
AD

AdminLabs

Admin Labs Ltd.'s monitoring & uptime bots

Unknownmonitoring
AH

AhrefsBot

Ahrefs SEO crawler

Ahrefsmonitoring
AI

AI2Bot

Allen Institute AI crawler

AI2monitoring
AL

AlertSite by SmartBear

SmartBear's monitoring & uptime bots

Unknownmonitoring
AM

Amazonbot

Amazon's web crawler for Alexa

Amazonmonitoring
AN

Andibot

Andi search AI crawler

Unknownmonitoring
AP

Applebot-Extended

Apple's AI training crawler

Applemonitoring
AP

Applebot

Apple's search crawler for Siri

Applemonitoring
BE

Better Uptime

Better Uptime's monitoring & uptime bots

Unknownmonitoring
BE

BetterStack bot

Better Stack, Inc.'s monitoring & uptime bots

Unknownmonitoring
BI

BinaryCanary

BinaryCanary LLC's monitoring & uptime bots

Unknownmonitoring
BI

BingPreview

Bing preview tool

Microsoftmonitoring
BL

BlogVault

BlogVault Inc.'s monitoring & uptime bots

Unknownmonitoring
BU

Bugsnag

Bugsnag (SmartBear Software)'s monitoring & uptime bots

Unknownmonitoring
CA

Catchpoint Bot

Catchpoint Systems's monitoring & uptime bots

Unknownmonitoring
CC

CCBot

Common Crawl bot

Unknownmonitoring
CH

Character-AI

Character.AI browser

Unknownmonitoring
CH

CheckHost

CheckHost monitoring

Unknownmonitoring
CH

Chrome-Lighthouse

Google Inc.'s seo & analytics bots

Googlemonitoring
CL

Claude-Web

AI

User-initiated Claude browsing

Anthropicmonitoring
CL

Cloudflare Browser Rendering

Cloudflare, Inc.'s cloud & cdn bots

Cloudflaremonitoring
CL

CloudFlare crawler

CloudFlare, Inc.'s cloud & cdn bots

Cloudflaremonitoring
CL

Cloudflare CSUP

Cloudflare, Inc.'s cloud & cdn / support diagnostics

Cloudflaremonitoring
CL

Cloudflare Custom Error Page Crawler

Cloudflare, Inc.'s cloud & cdn bots

Cloudflaremonitoring
CL

Cloudflare Custom Hostname Verification

Cloudflare, Inc.'s cloud & cdn bots

Cloudflaremonitoring
CL

Cloudflare Diagnostics

Cloudflare, Inc.'s cloud & cdn bots

Cloudflaremonitoring
CL

Cloudflare Digicert DCV

Cloudflare, Inc.'s cloud & cdn bots

Cloudflaremonitoring
CL

Cloudflare Healthchecks

Cloudflare, Inc.'s monitoring & uptime bots

Cloudflaremonitoring
CL

Cloudflare Prefetch

Cloudflare, Inc.'s cloud & cdn bots

Cloudflaremonitoring
CL

Cloudflare Purge

Cloudflare, Inc.'s cloud & cdn bots

Cloudflaremonitoring
CL

Cloudflare Radar URL Scanner

Cloudflare, Inc.'s cloud & cdn bots

Cloudflaremonitoring
CL

Cloudflare SpeedTest

Cloudflare, Inc.'s cloud & cdn bots

Cloudflaremonitoring
CL

Cloudflare SSLDetector

Cloudflare, Inc.'s cloud & cdn bots

Cloudflaremonitoring
CL

Cloudflare Stream Webhook

Cloudflare, Inc.'s cloud & cdn bots

Cloudflaremonitoring
CL

Cloudflare Traffic Manager

Cloudflare, Inc.'s cloud & cdn bots

Cloudflaremonitoring
CL

Cloudflare Validator

Cloudflare, Inc.'s cloud & cdn bots

Cloudflaremonitoring
CO

cognitiveSEO Crawler

cognitiveSEO's seo / web crawling

Unknownmonitoring
DA

DatadogAgent

Datadog synthetic monitoring

Datadogmonitoring
DI

Diffbot

Diffbot AI crawler

Unknownmonitoring
DO

DotBot

Moz/DotBot crawler

Mozmonitoring
DO

downnotifier.com monitoring

DownNotifier.com's monitoring & uptime bots

Unknownmonitoring
DO

DowntimeDetector

UpDownSideways, LLC's monitoring & uptime bots

Unknownmonitoring
DU

DuckAssistBot

DuckDuckGo AI assistant

DuckDuckGomonitoring
FI

FirecrawlAgent

Firecrawl agent

Unknownmonitoring
FU

FuseonBot

FuSEOn Pro Tool S.L.'s miscellaneous & unknown

Unknownmonitoring
GO

GoogleAgent-Mariner

Google's AI agent

Googlemonitoring
GO

Google Cloud Monitoring

Google Inc's cloud & cdn bots

Googlemonitoring
GO

Google-CloudVertexBot

Google Cloud Vertex AI crawler

Googlemonitoring
GO

Google-InspectionTool

Google's URL Inspection tool

Googlemonitoring
GO

GoogleOther

Google's other crawlers

Googlemonitoring
GR

Groq-Bot

AI

Groq AI crawler

Unknownmonitoring
GT

GTmetrix

GTmetrix performance tester

Unknownmonitoring
HE

HetrixTools

HetrixTools Inc's monitoring & uptime bots

Unknownmonitoring
HO

HostTracker

HostTracker, Ltd.'s monitoring & uptime bots

Unknownmonitoring
HU

HubSpot

HubSpot crawler

HubSpotmonitoring
HU

HuggingFace-Bot

HuggingFace bot

Unknownmonitoring
IM

img2dataset

LAION image dataset crawler

Unknownmonitoring
IN

internetVista monitor

InternetVista SA's monitoring & uptime bots

Unknownmonitoring
IR

Irokez.cz monitoring

Adam Haken's monitoring & uptime bots

Unknownmonitoring
KS

KStandBot

Keywords Standings Ltd.'s miscellaneous & unknown

Unknownmonitoring
LI

Lighthouse

Google Lighthouse crawler

Googlemonitoring
LI

LightspeedSystems Crawler

Lightspeed Systems, Inc.'s miscellaneous & unknown

Unknownmonitoring
LI

LightspeedSystemsCrawler

Lightspeed Systems's miscellaneous & unknown

Unknownmonitoring
ME

MediaMonitoring

MediaMonitoringBot's aggregator

Unknownmonitoring
ME

Meta-ExternalAgent

Meta's AI training crawler

Metamonitoring
ME

Meta-ExternalFetcher

Meta's fetcher crawler

Metamonitoring
ME

Meta-WebIndexer

Meta web indexer

Metamonitoring
MI

Miniature.io

Lukasz Cepowski's monitoring & uptime bots

Unknownmonitoring
MJ

MJ12bot

Majestic SEO crawler

Unknownmonitoring
MO

monitoring360bot

WebPros's monitoring & uptime bots

Qihoo 360monitoring
MO

montastic-monitor

Metadot Corporation's monitoring & uptime bots

Metamonitoring
MO

MonTools

MonTools.Com's monitoring & uptime bots

Unknownmonitoring
MO

Moz dot

Moz's search engine optimization

Mozmonitoring
MO

Moz roger

Moz, Inc.'s search engine optimization

Mozmonitoring
MO

Mozilla

Unknown Author's miscellaneous & unknown

Mozmonitoring
MX

MxToolbox bot

MXToolBox, Inc's monitoring & uptime bots

Unknownmonitoring
NE

NetcraftSurveyAgent

Netcraft's monitoring & uptime bots

Unknownmonitoring
NE

NewRelicPinger

NewRelic synthetic monitoring

NewRelicmonitoring
NI

NIXStatsbot

Animea B.V.'s monitoring & uptime bots

Unknownmonitoring
NO

NodePing

NodePing LLC's monitoring & uptime bots

Unknownmonitoring
OM

Omgili

Omgili crawler

Unknownmonitoring
ON

OnlineOrNot

Max Rozen's monitoring & uptime bots

Unknownmonitoring
PA

PagePeeker

PAGEPEEKER SRL's monitoring & uptime bots

Unknownmonitoring
PA

PageSpeed

Google PageSpeed Insights

Googlemonitoring
PI

PingAdmin.Ru

Segin's monitoring & uptime bots

Unknownmonitoring
PI

Pingdom

Pingdom monitoring bot

Unknownmonitoring
PR

Prometheus bot

Prometheus's monitoring & uptime bots

Unknownmonitoring
PU

pulsetic.com bot

Designmodo Inc.'s monitoring & uptime bots

Unknownmonitoring
RE

Replicate-Bot

Replicate bot

Unknownmonitoring
RO

Rogerbot

Moz Rogerbot crawler

Mozmonitoring
RU

RunPod-Bot

RunPod bot

Unknownmonitoring
SC

Scrapy

Scrapy Python framework

Unknownmonitoring
SC

ScreamingFrog

Screaming Frog SEO Spider

Unknownmonitoring
SE

SEMrushBot-BA

Semrush's seo & analytics bots

Semrushmonitoring
SE

SEMrushBot-CT

Semrush's seo & analytics bots

Semrushmonitoring
SE

SEMrushBot-SI

Semrush's seo & analytics bots

Semrushmonitoring
SE

SEMrushBot-SWA

Semrush's seo & analytics bots

Semrushmonitoring
SE

SEMrushBot

Semrush Inc's seo & analytics bots

Semrushmonitoring
SE

seo4ajax

Merkle's search engine optimization

Unknownmonitoring
SE

SeoulBot

Unknown Author's miscellaneous & unknown

Unknownmonitoring
SI

Site24x7

Site24x7 monitoring

Site24x7monitoring
ST

StatusCake

StatusCake monitoring

Unknownmonitoring
ST

Storebot-Google

Google's merchant crawler

Googlemonitoring
SY

Synthetic

DataDog's monitoring & analytics

Datadogmonitoring
TO

Together-Bot

Together.ai bot

Unknownmonitoring
UP

updown.io bot

Adrien Jarthon's monitoring & uptime bots

Unknownmonitoring
UP

Uptime-Kuma

Louis Lam's monitoring & uptime bots

Unknownmonitoring
UP

uptime.bot

Rawbot Inc's monitoring & uptime bots

Unknownmonitoring
UP

UptimeRobot

Uptime Robot Service Provider Ltd.'s monitoring & uptime bots

Unknownmonitoring
UP

Uptimia

UAB Baltic Online's monitoring & uptime bots

Unknownmonitoring
UR

Urlcheckr

Device Independent's monitoring & uptime bots

Unknownmonitoring
WE

webpagetest

Catchpoint's monitoring & analytics

Unknownmonitoring
WE

WebwikiBot

seobility GmbH's miscellaneous & unknown

Unknownmonitoring
WE

Webzio-Extended

Webz.io AI crawler

Unknownmonitoring
WE

WEDOS OnLine monitoring

Wedos Internet, a.s's monitoring & uptime bots

Unknownmonitoring
WO

woobot

WooRank SA's social media bots

Unknownmonitoring
YA

Yahoo Japan SEO Crawler

Yahoo Japan Corporation's search engine optimization

Yahoomonitoring
ZO

ZoomBot

SEO Cube S.r.l.'s miscellaneous & unknown

Unknownmonitoring

Related Categories

AI Crawlers

Complete directory of AI crawlers and LLM training bots. Track and manage access from ChatGPT, Claude, Gemini, Perplexity, and 50+ AI crawlers.

Search Engines

Complete directory of search engine crawlers. Documentation for Googlebot, Bingbot, DuckDuckBot, YandexBot, Baiduspider and traditional search engines.