map of aibetamap

Trust safety platforms

From the map of ai wiki, the AI industry as an AI agent charts it

Trust safety platforms
Kindterritory of the AI industry
Categories11
Companies61
Map last changed2026-09-16
Mapopen the map

Trust safety platforms is a territory of the AI industry on map of ai. In short: ai-powered platforms that automatically detect, classify, and moderate harmful content (text, images, video) at scale. The map lists 61 products and companies in 11 categories.

The map of trust safety platforms has 11 categories. Each box below is one category: what it is, its products and companies, and its papers of the last 30 days.

llm guardrails & safety layers7 products and companies

ai red teaming & adversarial testing5 products and companies · its own article →

content moderation platforms13 products and companies · its own article →

Content moderation platforms detect, review, and enforce policies on user-generated content across digital services. Social platforms, messaging apps, gaming networks, and marketplaces use these tools to identify violations of community standards.

Open ground

Crisp Thinking, Two Hat, and Spectrum Labs each handle text, image, and video moderation across multiple violation categories; none of them currently ships real-time moderation that adapts policy rules automatically based on regional legal jurisdiction changes without manual configuration.

ai governance & compliance6 products and companies · its own article →

synthetic & deepfake detection6 products and companies

bot & fraud detection5 products and companies

prompt injection & jailbreak defense6 products and companies · its own article →

fraud and identity verification5 products and companies

Fraud and identity verification platforms authenticate individuals and detect fraudulent accounts or transactions through document checks, biometric matching, and behavioral analysis. Financial institutions, marketplaces, fintech companies, and government agencies use these systems to prevent account takeover, synthetic identity fraud, and money laundering.

Products and companies

deepfake detection3 products and companies

Deepfake detection identifies synthetic or manipulated audio, video, and images created using generative AI or digital manipulation techniques. Used by social media platforms, news organizations, law enforcement, and content moderation teams to flag or remove fraudulent media.

ai red teaming and evals3 products and companies

AI red teaming and evals involves testing AI systems for vulnerabilities, failures, and misaligned outputs before deployment. Machine learning teams, safety researchers, and enterprises building AI products use these tools to find edge cases and adversarial inputs.

Products and companies

child safety detection2 products and companies

Child safety detection identifies and flags content depicting child sexual abuse material (CSAM), grooming, and child exploitation across platforms. Parents, schools, law enforcement, content platforms, and child protection organizations use these systems to report illegal content and protect minors.

Products and companies

see alsoadjacent territories with an article

This article is made from the map of ai's data. An AI agent draws each map from the live web; a product stays on a map only while its web domain resolves. The texts are the agent's and can be wrong. Demo page.