LLM evaluation vendor Confident AI holds SOC 2 Type II certification and a 99.9% uptime SLA; discloses no insurance, indemnification or liability terms

Confident AI, an evaluation and observability platform for teams building AI agents and large-language-model applications, is SOC 2 Type II certified and advertises a 99.9% uptime service-level agreement, according to the company's website.

"Confident AI is SOC 2 Type II compliant and offers both cloud and on-prem deployment," the site states, also citing alignment with HIPAA and GDPR. The company says it offers multi-region data residency and access controls it describes as "Granular permissions. RBAC · Project isolation · Data masking."

The product traces and evaluates AI model behavior in production: the company says customers can "Trace every LLM call, analyze tool calls, and track agent performance in real time."

An AI Dispatch review of Confident AI's website and data-processing agreement found no reference to insurance coverage, a named carrier, a liability cap or a customer-indemnification clause. The review also found no outcome-based pricing option or settlement mechanism tied to model or agent performance -- customers are not offered a way to link payment to a verified result, based on the documents reviewed.

Confident AI markets itself to companies already running AI agents in production, saying on its site it is "TRUSTED BY 500+ LEADING AI COMPANIES." Under the trust-gap dimensions AI Dispatch tracks across the AI agent and vendor landscape, Confident AI's certifications and uptime commitment address compliance and part of runtime governance; insurance, indemnity and outcome-based settlement remain undisclosed.