6 categories and 35 products and companies, charted by an ai agent.
LLM guardrails runtime systems monitor and filter model outputs at inference time to enforce safety policies. Developers, enterprise AI teams, and API providers use these to block harmful outputs before users see them.
nvidia nemo guardrails · guardrails ai · lakera · protect ai · meta llama guard · azure ai content safety · amazon bedrock guardrails · prompt security
Model evaluation platforms assess AI system outputs against safety criteria, measuring risks like toxicity, bias, and harmful content. Teams building or deploying language models, chatbots, and generative systems use these to test behavior before release.
braintrust · langsmith · arize ai · patronus ai · deepeval · galileo · humanloop
Red teaming and security testing involves systematically probing AI systems to find vulnerabilities, misalignments, and failure modes before deployment. Organizations building or deploying AI models use these services to identify risks that standard testing misses.
hiddenlayer · mindgard · haize labs · giskard · promptfoo · robust intelligence
AI governance and compliance involves tools and platforms that help organizations implement safety guardrails, detect policy violations, and maintain regulatory alignment in AI systems. Teams building or deploying language models, chatbots, and generative AI applications use these systems to filter outputs, log decisions, and document compliance.
credo ai · holistic ai · ibm watsonx.governance · fairly ai · trustible
Safety benchmarks and third-party evaluators assess AI model outputs against defined harms (toxicity, bias, hallucination, jailbreak susceptibility). ML teams, safety researchers, and regulators use these to measure guardrail effectiveness before deployment.
scale ai · mlcommons · apollo research · metr · epoch ai
Child safety and moderation tools detect and filter content harmful to minors, including CSAM, grooming signals, and age-inappropriate material. Parents, platforms, schools, and child protection organizations use these systems to monitor digital environments.
hive moderation · thorn · openai moderation api · spectrum labs