AI agent directory
Resources
AI agent directory
A continuously updated directory of all the known AI agents currently active on the internet.
| Agent Name | Description |
|---|---|
| 2ip bot | Developer tool |
| 360Spider | Search index crawler |
| adbeat_bot | Data collector |
| AdsBot-Google | Search index crawler |
| AhrefsBot | SEO crawler |
| AhrefsSiteAudit | SEO crawler |
| AI2Bot | Data collector |
| aiHitBot | Data collector |
| AlexandriaOrgBot | Search index crawler |
| Amazonbot | Search index crawler |
| AndersPinkBot | Data collector |
| Applebot | Search index crawler |
| Applebot-Extended | Data collector |
| Arquivo-web-crawler | Content archiver |
| Atom Feed Robot | Data fetcher |
| AwarioBot | Data collector |
| Baiduspider | Search index crawler |
| Barkrowler bot | SEO crawler |
| BazQux bot | Data fetcher |
| bingbot | Search index crawler |
| BingPreview | Data fetcher |
| bitlybot | Data fetcher |
| BitSightBot | Data collector |
| Bytespider | Search index crawler |
| CCBot | Data collector |
| ChatGPT-User | AI assistant |
| Claude-SearchBot | AI search retriever |
| Claude-User | AI assistant |
| ClaudeBot | Data collector |
| cohere-training-data-crawler | Data collector |
| Daum bot | Search index crawler |
| dcrawl bot | Data fetcher |
| deadlinkchecker bot | SEO crawler |
| Diffbot | Data collector |
| Discordbot | Data fetcher |
| DomainStatsBot | Data collector |
| dotbot | SEO crawler |
| DuckAssistBot | AI assistant |
| DuckDuckBot | Search index crawler |
| Embedly | Data fetcher |
| EtaoSpider | Data fetcher |
| ev-crawler | Data collector |
| facebookexternalhit | Data fetcher |
| Feedfetcher-Google | Data fetcher |
| Feedly bot | Data fetcher |
| FlipboardProxy | Data fetcher |
| FreshRSS bot | Data fetcher |
| Friendica bot | Data fetcher |
| Google Web Preview | Data fetcher |
| Google-Extended | Data collector |
| Google-InspectionTool | Developer tool |
| Google-Read-Aloud | Data fetcher |
| Google-Safety bot | Security crawler |
| Googlebot | Search index crawler |
| Googlebot-Image | Search index crawler |
| Googlebot-Mobile | Search index crawler |
| Googlebot-News | Search index crawler |
| Googlebot-Video | Search index crawler |
| GoogleOther | Data fetcher |
| GPTBot | Data collector |
| HaoSouSpider | Search index crawler |
| Hatena bot | Content archiver |
| HeadlessChrome | Developer tool |
| heritrix | Content archiver |
| HTTrack bot | Content archiver |
| hypestat bot | SEO crawler |
| ia_archiver | Content archiver |
| Iframely bot | Data fetcher |
| ImagesiftBot | Data fetcher |
| inoreader bot | Data fetcher |
| IonCrawl | Data collector |
| Jugendschutzprogramm-Crawler | Data collector |
| Kangaroo Bot | Data collector |
| KStandBot | Data collector |
| LightspeedSystemsCrawler | Security crawler |
| linkdexbot | SEO crawler |
| LinkedInBot | SEO crawler |
| linkfluence bot | Data collector |
| magpie-crawler | Data collector |
| Mail.RU_Bot | Search index crawler |
| Mastodon bot | Data fetcher |
| Mediapartners-Google | Data fetcher |
| Mediatoolkitbot | Data collector |
| Meta-ExternalAgent | Data collector |
| Meta-ExternalFetcher | AI search retriever |
| MetaInspector bot | Data fetcher |
| Miniflux bot | Data fetcher |
| MJ12bot | SEO crawler |
| MojeekBot | Search index crawler |
| MuckRack bot | Data collector |
| NetcraftSurveyAgent | Data collector |
| Netvibes bot | Data fetcher |
| news-please bot | Data collector |
| NewsBlur bot | Data fetcher |
| NewsNow bot | Data fetcher |
| newspaper bot | Data fetcher |
| Nextcloud bot | Developer tool |
| Nicecrawler | Data collector |
| NovaAct bot | Data fetcher |
| Nutch bot | Search index crawler |
| OAI-SearchBot | AI search retriever |
| Offline Explorer bot | Content archiver |
| omgili bot | Data collector |
| online-webceo-bot | SEO crawler |
| OpenindexSpider | SEO crawler |
| Pandalytics bot | Data collector |
| PanguBot | Data collector |
| panscient.com bot | Data collector |
| peer39_crawler | Data collector |
| Perplexity-User | AI assistant |
| PerplexityBot | Data collector |
| PetalBot | Search index crawler |
| Pingdom.com bot | Data fetcher |
| Pinterestbot | Data fetcher |
| PocketParser | Data fetcher |
| proximic | Data collector |
| Quora-Bot | Search index crawler |
| Qwantbot | Search index crawler |
| redditbot | Data fetcher |
| rogerbot | SEO crawler |
| scoop.it bot | Content archiver |
| Scrapy bot | Developer tool |
| Screaming Frog SEO Spider | SEO crawler |
| SeekportBot | Search index crawler |
| SemanticScholarBot | Data fetcher |
| SemrushBot | SEO crawler |
| SemrushBot-BA | SEO crawler |
| SemrushBot-CT | SEO crawler |
| SemrushBot-SI | SEO crawler |
| SemrushBot-SWA | SEO crawler |
| SenutoBot | SEO crawler |
| SeobilityBot | SEO crawler |
| SEOkicks-Robot | SEO crawler |
| SEOlizer bot | SEO crawler |
| SerendeputyBot | Data fetcher |
| serpstatbot | SEO crawler |
| SeznamBot | Search index crawler |
| SimplePie bot | Data fetcher |
| SiteAuditBot | SEO crawler |
| SiteCheckerBotCrawler | SEO crawler |
| Slack-ImgProxy | Data fetcher |
| Slackbot | Data fetcher |
| Slackbot-LinkExpanding | Data fetcher |
| SMTBot | Data collector |
| Snap URL Preview Service | Data fetcher |
| Sogou web spider | Search index crawler |
| startmebot | Data fetcher |
| Superfeedr bot | Data fetcher |
| SurdotlyBot | Security crawler |
| Synapse bot | Data fetcher |
| t3versionsBot | Developer tool |
| TelegramBot | Data fetcher |
| teoma bot | Search index crawler |
| Timpibot | Data collector |
| TinEye-bot | Data fetcher |
| Tiny Tiny RSS bot | Data fetcher |
| trendictionbot | Data collector |
| TrendsmapResolver | Data collector |
| TurnitinBot | Data collector |
| TweetmemeBot | Data fetcher |
| Twingly Recon | Data collector |
| Twitterbot | Data fetcher |
| um-LN | Data collector |
| VelenPublicWebCrawler | Data collector |
| Viber bot | AI assistant |
| virustotal bot | Security crawler |
| vkShare | Data fetcher |
| W3C_CSS_Validator | Developer tool |
| W3C_Validator | Developer tool |
| Webzio bot | Data collector |
| WhatsApp bot | Data fetcher |
| yacybot | Search index crawler |
| YaDirectFetcher | Data fetcher |
| Yahoo Link Preview | Data fetcher |
| Yahoo! Slurp | Search index crawler |
| YandexAccessibilityBot | SEO crawler |
| YandexAdditional | Search index crawler |
| YandexAdditionalBot | Search index crawler |
| YandexAdNet bot | Data collector |
| YandexBlogs bot | Search index crawler |
| YandexBot | Search index crawler |
| YandexBot MirrorDetector | Data collector |
| YandexCalendar bot | Data fetcher |
| YandexComBot | Search index crawler |
| YandexDirect bot | Data fetcher |
| YandexDirectDyn bot | Data collector |
| YandexFavicons bot | Data fetcher |
| YandexForDomain bot | Data fetcher |
| YandexImageResizer | Data fetcher |
| YandexImages | Search index crawler |
| YandexMarket bot | Data fetcher |
| YandexMedia bot | Search index crawler |
| YandexMetrika bot | Data collector |
| YandexMobileBot | Search index crawler |
| YandexMobileScreenShotBot | Data fetcher |
| YandexNews bot | Search index crawler |
| YandexOntoDB bot | Data collector |
| YandexOntoDBAPI | Data fetcher |
| YandexPagechecker | SEO crawler |
| YandexPartner bot | Data fetcher |
| YandexRCA bot | Search index crawler |
| YandexRenderResourcesBot | Data fetcher |
| YandexScreenshotBot | Search index crawler |
| YandexSearchShop bot | Search index crawler |
| YandexSitelinks bot | Search index crawler |
| YandexSpravBot | SEO crawler |
| YandexTracker | Developer tool |
| YandexUserproxy | Data fetcher |
| YandexVerticals bot | Search index crawler |
| YandexVertis bot | Search index crawler |
| YandexVideo bot | Search index crawler |
| YandexVideoParser | Data fetcher |
| YandexWebmaster bot | Developer tool |
| Yeti bot | Search index crawler |
| YisouSpider | Search index crawler |
| YouBot | AI search retriever |
| ZoominfoBot | Data collector |
| ZumBot | Search index crawler |