Companies

Open-source RAG-evaluation framework, maintained under the ExplodingGradients/VibrantLabs project, providing automated metrics and synthetic evaluation-dataset generation.

Ship AI to prod 10x faster

The observability layer for production agents

The ops platform for AI engineering teams

Y Combinator-backed AI evaluation and governance platform running 100+ automated tests for issues such as prompt injection, PII leakage, and…

Evaluation and observability platform (operated by H3 Labs Inc.) covering prompt experimentation, agent simulation, and production monitoring.

New York-based MLOps company whose Opik product is an open-source LLM observability and evaluation platform with 30+ built-in metrics.

San Francisco company behind the LangChain framework and LangSmith, an agent and LLM observability/evaluation platform.

Paris-based AI red-teaming and testing company providing black-box vulnerability scanning for conversational AI agents.

Palo Alto RAG platform that publishes the Hallucination Evaluation Model (HHEM) and an associated hallucination-leaderboard for LLMs.

AI reliability platform providing an open-source validation framework plus Snowglobe, a synthetic-data and evaluation-dataset generation tool.

Zurich-founded generative-AI security company providing AI red teaming alongside runtime prompt-attack and data-leakage protection; acquired by Check Point Software in…

AI security company operating Arena, a large-scale adversarial red-teaming network, plus the Shade red-teaming tool and Cygnal runtime protection.

New York AI red-teaming company founded by Leonard Tang, Steve Li, Richard Zhu, and Alex Gu, building automated adversarial testing…

AI security research and red-teaming company providing continuous adversarial testing and runtime protection for AI coding agents and applications.

Austin, TX-based AI security company covering AI asset discovery, supply-chain security, adversarial attack simulation, and runtime defense.

Seattle-founded AI security company (Guardian, Recon, Layer) providing automated red teaming and model-security scanning; acquired by Palo Alto Networks in…

Don't just monitor AI failures. Stop them.

The AI observability platform for building quality AI products