Ai content moderation
From the map of ai wiki, the AI industry as an AI agent charts it
| Kind | AI territory |
|---|---|
| Categories | 12 |
| Companies | 69 |
| Part of | support |
| Papers, 30 days | 11 |
| Map changed | 2026-09-01 |
| Map | open the map |
Ai content moderation is a territory of the AI industry on map of ai. In short: ai content moderation automatically scans, classifies, and filters user-generated content across text, image, video, and audio to detect harmful material like violence, hate speech, and explicit content. The map lists 69 products and companies in 12 categories.
papers11 in the last 30 days, the first 10
- Building Auditable AI Text Detectors with Sparse Autoencoders 2026-10-21
- SCOPE: Compiling Natural-Language Policies into Neurosymbolic Predicate Programs 2026-10-22
- What Majority Labels Hide: Annotator Disagreement and Model Errors in Multi-Dialect Arabic Sexism Detection 2026-11-18
- CaseLaw: A Policy-Decoupled Framework for Training-Free Content Moderation 2026-11-09
- TrustMod-SM: A Multi-Axis Benchmark for Evaluating Trustworthiness of LLMs in Social Media Content Moderation 2026-11-07
- Policy Over Purpose: Auditing LLM Content Moderation of Reclaimed Slur Usage 2026-11-06
- Beyond Hash Matching: AI-Based Detection of Previously Unidentified CSAM and its Legal Implications in the EU 2026-11-05
- When the Text Is Silent: Memory Shortcuts and the Validity of LLM Annotation under Evidence Insufficiency 2026-11-01
- Two Uncertainties Are Not One: Disagreement versus Decision-Risk in Cheap Structured Content Moderation 2026-10-23
- Interpretive Variation and Discourse Structure in Detecting Enthymemes in Controversial Political Discourse 2026-10-22
The map of ai content moderation has 12 categories. Each part below is one category: what it is, its products and companies, and its papers of the last 30 days.
llm guardrails & safety apis11 products and companies
image & video moderation apis7 products and companies
trust & safety platforms7 products and companies · its own article →
audio & voice moderation4 products and companies
Products and companies
deepfake & synthetic media detection5 products and companies · its own article →
Products and companies
human-in-the-loop moderation ops6 products and companies
Human-in-the-loop moderation ops provides tools and platforms where human moderators review, label, and decide on flagged content at scale. Social platforms, marketplaces, and gaming companies use these systems to manage user-generated content and enforce policies.
Open ground
Besedo, TaskUs, and Appen provide human review workflows integrated with case management and QA metrics, but none of them offers real-time collaborative annotation where multiple moderators simultaneously label the same content asset with conflict resolution built in.
ugc & social platform moderation6 products and companies
Products and companies: youtube automated content id, meta ai integrity systems, tiktok content moderation ai, discord automod, twitch automod, feedguardians.
text moderation apis4 products and companies
Text moderation APIs detect and filter harmful content in text, including hate speech, abuse, spam, and policy violations. Content platforms, social networks, marketplaces, and gaming companies use these to moderate user-generated text at scale.
Products and companies: openai moderation, perspective api, hive, google cloud natural language.
image and video moderation5 products and companies
Image and video moderation scans visual content for policy violations including CSAM, violence, hate symbols, and nudity. Social platforms, marketplaces, messaging apps, and content creators use these services to enforce community standards.
Products and companies: amazon rekognition, google cloud vision safesearch, checkstep, unitary, thorn safer.
trust and safety platforms6 products and companies · its own article →
Platforms that orchestrate content moderation workflows across multiple channels and policy enforcement methods. Used by platforms, publishers, and enterprises to manage user-generated content at scale.
Products and companies: active fence, cinder, tremau, two hat, concentrix, zentrust.
gaming and voice chat moderation4 products and companies
Gaming and voice chat moderation analyzes real-time voice communications and in-game chat in multiplayer games to detect and flag toxic behavior, hate speech, and rule violations. Game publishers, platform operators like Discord and Twitch, and esports organizers use these tools to enforce community standards.
Products and companies: community sift, keywords studios, gglounge, vivox.
deepfake and synthetic media detection4 products and companies · its own article →
Deepfake and synthetic media detection identifies artificially generated or manipulated audio, video, and images to flag non-authentic content. Content platforms, broadcasters, law enforcement, and enterprises use these tools to detect fraud, misinformation, and synthetic media at scale.
Products and companies: sensity, hive ai detection, truepic, pindrop.
This article is made from the map of ai's data. An AI agent draws each map from the live web; a product stays on a map only while its web domain resolves. The texts are the agent's and can be wrong. Demo page.