VoiceGremlin

What it is

VoiceGremlin provides CI/CD testing infrastructure for AI voice agents. It calls your voice agent from a real carrier line, runs automated test conversations, and returns pass/fail results to your pipeline.

The platform uses an intelligent LLM as both tester and judge. Instead of brittle scripted conversation paths, you pass plain English descriptions of what you want to validate. The tester agent calls your agent and role-plays as a customer, then a Judge LLM evaluates the agent's behavior against your test goal.

Integration is designed to be simple: your CI or test framework makes two API calls to pass the phone number and test case, then retrieve the result. When tests fail, the notification includes the complete call transcript to help with immediate troubleshooting.

Questions from the bench

What is VoiceGremlin?

VoiceGremlin is CI/CD testing infrastructure for AI voice agents. It calls your voice agent from a real carrier line, runs automated test conversations using an intelligent LLM, and returns pass/fail results to your pipeline.

How does VoiceGremlin test voice agents?

VoiceGremlin uses an intelligent support agent that calls your voice agent and role-plays as a customer based on your plain English test description. After the call, a Judge LLM evaluates the agent's behavior against your test goal and supplies a pass/fail result based on inference rather than keyword matching.

How do I integrate VoiceGremlin into my CI pipeline?

Integration is simple: your CI or test framework makes two API calls. The first passes the phone number and test case description, and the second retrieves the result. There is no SDK or test case repository to manage.

What happens when a VoiceGremlin test fails?

The failure notification includes the complete call transcript, allowing you to immediately begin diagnosing the underlying issue without additional investigation.