| What it does | Managed AI trainers, LLM evaluators and benchmark authors for AI labs and data partners
| Test and guard AI agents with outcome verification, not reply verification
|
|---|
| Stage | Not given
| Not given
|
|---|
| Founded | Not given
| Not given
|
|---|
| Based in | IN
| IT
|
|---|
| Pricing model | Contact for pricing
| Freemium
|
|---|
| Pricing | Not given
| Free: €0/month with 100 test runs per month; Test: €19/month with 2,000 runs per month; Guard: €99/month with unlimited runs plus live guard features. AI usage is metered separately at cost.
|
|---|
| Key features | - Coding-agent benchmarks in Terminal-Bench and SWE-bench style
- Research reproduction in PaperBench style
- Model evaluation and RLHF with preference ranking
- Long-horizon agent tasks with planning and tool use
- STEM and expert reasoning questions at PhD level
- Trial task scoring before work begins
- Peer review on every item
- Senior reviewer calibration on each batch
- Product design and full-stack development for SaaS and AI
- LLM assistants and voice AI integration
| - Isolated sandbox with fresh fake accounts for testing
- 88 scenario templates for refunds, cancellations, pauses and plan changes
- CI gate and CLI with dependency-free deployment
- Policy gate with ALLOW/REVIEW/HOLD/DENY decisions
- Human approval for risky actions
- Independent verification of outcome against ground-truth state
- Guardrails with prompt injection and PII detection
- Per-end-user spending caps in rolling windows
- Append-only evidence log with JSON, CSV and PDF export
- GitHub Action integration for automated testing
|
|---|
| What makes it different | - One programme lead and point of contact instead of managing hundreds of individual profiles
- Scored trial on your rubric for every expert, not just CV and quiz screens
- Second review on every item plus senior calibration, not just spot checks
- Published quality numbers: 2,500+ tasks authored, 90% acceptance rate, 4.89/5 rating
- Pilot staffing in days with 5 to 10 experts
| - Deterministic verdicts from explicit state checks, not language model decisions
- No-cost deterministic testing; AI features are optional and separately metered
- Integrated sandbox testing and production guarding in one platform
- Idempotent and exactly-once action execution with retry safety
|
| Community votes | 0 | 0 |
| DR (Domain Rating by Ahrefs) | Not checked yet ● no change since last check | Not checked yet ● no change since last check |
| Trust Flow (Majestic) | 0 | 0 |
| Citation Flow (Majestic) | 0 | 0 |
| Referring domains (Majestic) | 1 | 0 |