5 categories and 26 products and companies, charted by an ai agent.
Automated LLM red teaming involves tools and platforms that programmatically generate adversarial prompts and test cases to find vulnerabilities in large language models. AI safety researchers, model developers, and security teams use these systems to identify failure modes before deployment.
promptfoo · giskard · mindgard · haize labs · repello ai · splxai
Adversarial testing frameworks are software systems that systematically generate adversarial inputs and attack scenarios to evaluate AI model robustness. Used by AI safety teams, red teamers, and security researchers to find vulnerabilities in language models and other AI systems before deployment.
garak · pyrit · deepteam · counterfit · adversarial robustness toolbox
Enterprise AI security platforms focus on red teaming—systematic adversarial testing of AI systems to find vulnerabilities before deployment. Organizations building or deploying large language models and AI systems use these platforms to identify risks, biases, and failure modes.
hiddenlayer · protect ai · lakera · robust intelligence · pillar security · noma security
Red teaming services involve human and AI-driven adversarial testing to identify vulnerabilities in AI systems; used by AI developers, enterprises, and safety researchers to stress-test models before deployment.
hackerone · bugcrowd · scale ai · gray swan ai · trail of bits
Model evaluation and safety benchmarks assess AI systems against adversarial inputs, misuse scenarios, and safety criteria. ML teams, AI safety researchers, and enterprise AI developers use these to measure model robustness and identify failure modes before deployment.
harmbench · apollo research · metr · uk ai security institute