TMCnet News
TestMu AI Launches Agent Assurance to Verify AI Agents Before They ShipThe new product verifies both the AI agents that talk to customers and the agents that act on systems, generating test scenarios directly from code, grading every action against real evidence, and reporting an assurance gap for everything it could not verify SAN FRANCISCO and NOIDA, India, Aug. 18, 2026 /PRNewswire/ -- TestMu AI (formerly LambdaTest), the world's first Agentic AI-native Quality Engineering platform, announces Agent Assurance, a product built to answer the question every engineering team shipping AI agents now faces: is this agent safe to ship? Agent Assurance covers both kinds of agent in one product: the Conversational Agent category - which evaluates human-facing agents across chat, voice, phone, video, and image; and the new Autonomous Agent category, which verifies agents that act on systems: calling tools, writing files, hitting APIs, and opening pull requests.
Most teams today test autonomous agents by reading the agent's own account of what it did: a transcript, or a judge's score over its final message. Agent Assurance grades the effect instead. Pointed at a codebase, it works out what the agent does, generates an end-to-end agent testing suite that spans agent functional testing, non-functional checks, and adversarial scenarios, invokes the agent for real, and judges every criterion against observed evidence: files that changed on disk, artifacts produced, and tool calls verified against the agent's own declared tool surface. Alongside pass and fail, Agent Assurance reports a third verdict, unable to verify, excluded from the pass rate and published as a number: the assurance gap. Every result in a report is one that was actually observed, andbecause the gap reflects how much an agent records about its own actions, teams can shrink it by making their agents more observable. "Engineering teams are accumulating validation debt at exactly the layer where the stakes are highest. An agent's account of what it did is the weakest evidence available about what it did - it is the one party with a reason to be wrong," said Vipul Verma, Group SVP Of Engineering, TestMu AI. "Every tool in this space reports a pass rate. Agent Assurance reports the pass rate and the size of its own blind spot, because that is the only way the number becomes one you can trust to move." With Agent Assurance, teams can:
The Conversational Agent category is also expanding to the newest surface where software meets people: agents that appear on camera. With the platform's new Video Agent Testing (Link) capability, a simulated human with a realistic face and voice joins a live video agent's session, holds a genuine conversation, and grades the agent against team-defined success criteria, with every verdict traced to the exact moment in the recording that earned it. Anything unverifiable from the recording is deliberately counted as not met, a strict standard for a category where the recording is the evidence: a video agent never earns credit for a moment the evaluator could not observe. The Conversational Agent category is generally available on the TestMu AI platform today. The Autonomous Agent category is available in early access and runs from the terminal as rook, with models executing in the TestMu AI controller so no provider API keys are needed locally. To get started, visit Link. About TestMu AI TestMu AI is the world's first Agentic AI-native Quality Engineering platform, designed to enable organizations to automate and scale testing with intelligence at its core. By combining autonomous capabilities with seamless integration across modern development workflows, TestMu AI empowers teams to deliver faster, more reliable, and secure software in an AI-first world. For more information, visit TestMu AI
|
