About

RagMetrics is an AI evaluation and monitoring company focused on solving one of the most urgent challenges in enterprise AI adoption — trust. As organizations accelerate the deployment of Generative AI systems, they face a fundamental problem: they cannot easily measure, monitor, or prove that their AI outputs are accurate, reliable, and compliant.

RagMetrics was created to close this AI trust gap by enabling enterprises to evaluate and continuously monitor their Large Language Model (LLM) and Retrieval-Augmented Generation (RAG) applications with measurable, data-driven accuracy. The company’s mission is simple yet transformative — to make AI systems auditable, measurable, and accountable.


What RagMetrics Does

RagMetrics offers a comprehensive enterprise platform for AI evaluation and monitoring, enabling organizations to assess model performance before and after deployment. Its technology suite enables teams to measure and improve AI outputs across multiple dimensions, including accuracy, retrieval quality, and reliability.

Key features include:

* Evaluation Metrics Library: A rich set of predefined metrics for assessing model quality and performance.
* Retrieval Scoring & Hallucination Detection: Identifies inconsistencies and false responses, helping teams reduce hallucination rates in production systems.
* Custom Metric Builder: Allows organizations to create tailored evaluation criteria based on business or regulatory priorities.
* High Human–AI Agreement: RagMetrics achieves approximately 95% alignment between human evaluators and AI-based scoring, ensuring dependable automated assessments.
* On-Premise and SaaS Deployment: Supports regulated industries with flexible hosting models that meet data privacy and compliance needs.
* Upcoming Innovation — Live Hallucination Flagging: Currently in development, this feature will enable real-time AI assurance by identifying unreliable responses as they occur, moving AI evaluation from post-hoc analysis to continuous monitoring.

Market Need

Enterprises in sectors such as finance, pharmaceuticals, healthcare, industrial systems, and technology are deploying AI across mission-critical workflows — from customer support to document automation and analytics. However, the inability to measure and validate AI performance creates substantial risk.


Business Model

RagMetrics operates under a subscription-based SaaS model, with pricing tailored to usage volume, deployment model, and enterprise complexity.

Enterprise Contracts: Typically range from $150,000 to $250,000 Annual Contract Value (ACV), depending on deployment and customization.
Growth Strategy: Combining direct enterprise sales with co-sell and referral partnerships through system integrators and consulting firms.
Scalability: Recurring revenue and long-term enterprise retention through continuous evaluation and monitoring.

Market Recognition

RagMetrics was recently recognized in the IDC MarketScape: Worldwide Generative AI Evaluation Technology Products 2025 Vendor Assessment (IDC #US53015025). IDC identified RagMetrics as an emerging innovator helping enterprises measure the differences between models, prompts, and agentic configurations to architect efficient and reliable AI systems. The report highlighted RagMetrics’ use of synthetic data generation, fine-tuned LLM judge, and human–AI agreement framework as differentiators in the rapidly growing AI evaluation market.

This recognition from IDC establishes RagMetrics as one of the early companies defining the AI trust and governance infrastructure category.

Customers and Design Partners

RagMetrics has worked closely with design partners such as Tellen AI, Nighthawk, and Goodwin, validating its product through real-world enterprise environments. These collaborations have guided product development, ensuring that the platform directly addresses the practical challenges faced by enterprise AI teams.

The company is now expanding its reach across regulated industries and fast-growth AI organizations seeking to operationalize responsible AI governance.


Leadership Team

RagMetrics is led by a founding team with deep expertise in AI infrastructure, enterprise SaaS, and global go-to-market strategy:

Olivier Cohen, Founder & CEO – Technology entrepreneur with 15+ years leading global SaaS ventures, strategy, and partnerships.

Hernan Lardiez, COO – Over 25 years of experience scaling technology businesses and leading enterprise operations.

Michael Moreno, Founding CMO – Former marketing leader at Intel, Cloudflare, and Cloudera with a track record of driving $100M+ GTM growth.