Skip to main content

Built by makers, shipped in public

Sign in

VoiceGremlin vs Rulebook

A side-by-side comparison built from both listings. Blank cells mean the company has not given that detail; we never guess.

VoiceGremlin compared with Rulebook
Detail VoiceGremlinRulebook logo Rulebook
What it doesCI/CD testing for AI voice agents that calls your agent and returns pass/fail results Take your AI support bot from 4/10 to 10/10
StageNot given MVP
FoundedNot given 2026
Based inNot given Not given
Pricing modelFree Free trial
Pricing100 free minutes. No credit card required. Free during beta. After beta: $29/month (your own AI keys, unlimited runs) or $59/month (AI included, 50 runs/month).
Key features
  • Real phone calls from real carrier lines for end-to-end validation
  • LLM-powered test agent that role-plays as a customer
  • Plain English test case descriptions without scripted paths
  • Simple two-call REST API integration
  • Complete call transcripts in failure notifications for troubleshooting
  • LLM as Judge for intelligent pass/fail evaluation
  • No SDK or test case repository to manage
  • Bot Score: rates bot performance across five dimensions (rules, facts, solutions, tone, trick resistance)
  • Break my bot: 15 adversarial customer scenarios test for vulnerabilities
  • Fix it for me: automatically rewrites rule sheet and tests against saved situations
  • Train my bot: 30-minute automated training on weak spots with test validation
  • GitHub integration: sends improvements as pull requests for engineer approval
  • Real chat analysis: identifies problems in actual customer conversations with privacy masking
  • Knowledge check: validates bot replies against FAQ and policy documents
  • AI comparison: test bot performance across Claude, ChatGPT, and Gemini with costs and speed
  • Open source engine: public GitHub implementation of scoring and testing algorithms
What makes it different
  • Real end-to-end validation with actual phone calls covering SIP integration, STT/TTS, and functional behavior
  • Intelligent LLM testing that understands intent instead of matching keywords or regex
  • Lightweight and unopinionated API design for fast integration
  • Complete call transcripts included in test failures for immediate troubleshooting
  • Nothing ships without engineer approval: all changes go through GitHub pull request review
  • Privacy by default: customer data anonymized, keys encrypted, uploads not stored
  • Open source testing engine: full algorithm transparency available on GitHub
  • Works with your existing AI: supports Claude, ChatGPT, and Gemini with user's own keys
  • Unified team experience: one plan covers support, product, and engineering roles
Community votes00
DR (Domain Rating by Ahrefs)7 no change since last checkNot checked yet no change since last check
Trust Flow (Majestic)30
Citation Flow (Majestic)220
Referring domains (Majestic)400

5 details filled in for both companies.

More alternatives to VoiceGremlin More alternatives to Rulebook

Ask us