12 categories and 57 products and companies, charted by an ai agent.
cloudflare ai crawl control · fastly ai bot management · akamai bot manager · datadome · imperva advanced bot protection · kasada · human security · perimeterx (code now) · cloudflare · akamai · imperva · fastly · f5
qwairy · cloudflare radar · botify · oncrawl · siteimprove
rankability llms.txt generator · firecrawl llms.txt generator · llmstxt checker · ryte · isvisible.ai
aws waf bot control · cloudflare waf · f5 distributed cloud bot defense · barracuda waf · radware bot manager
tollbit · originality.ai · spawning ai (haveibeentrained) · human native ai · prorata.ai
netacea · fingerprint · px (perimeterx) sensor · threatx · arkose labs
spawning ai · deviantart protect · kudurru (glaze project)
Content licensing and pay-per-crawl systems let publishers set pricing and access rules for AI bots and scrapers to crawl their content. Publishers, news organizations, and content platforms use these to monetize or control automated access to their sites.
created by humans
Tools that track, classify, and manage AI bot traffic on websites and networks. Used by publishers, platforms, and infrastructure operators to monitor crawler activity and control agent access.
dark visitors · profound · scrunch ai
Systems that verify and manage the identity of automated agents and bots accessing web properties, and control their authentication credentials and permissions. Used by infrastructure operators, CDN providers, and security teams to authorize or deny bot traffic.
skyfire · stytch · browserbase · anchor browser
Tools and services that manage, control, and govern the behavior of web crawlers and bots accessing websites and APIs. Website operators, security teams, and infrastructure managers use these to enforce crawler policies, rate-limit bot traffic, and maintain access control.
firecrawl · bright data · apify · zyte · crawl4ai · common crawl
AI tarpit and poisoning systems inject fake or degraded content into training data pipelines to corrupt AI models or waste computational resources during scraping. Used by publishers, content owners, and security teams to defend against unauthorized AI training.
nepenthes · cloudflare ai labyrinth