Monitor
Sandbox observation for calls, STT confidence, traces, and release gates.
Active sandbox calls
3 needs attention| Scenario | Route | Agent | Status | MOS | STT | p95 | Time |
|---|---|---|---|---|---|---|---|
| angry_refund_call | LiveKit | prod-agent-v2 | pass | 4.1 | 90% | 1180ms | 2m 14s |
| plan_upgrade_hinglish | Vapi | prod-agent-v2 | fail | 3.4 | 90% | 1720ms | 3m 02s |
| urgent_clinic_booking | LiveKit | prod-agent-v2 | pass | 3.9 | 90% | 1410ms | 2m 41s |
| internet_outage_credit | Vapi | staging-agent-v3 | fail | 3.2 | 90% | 1980ms | 3m 35s |
| fraud_dispute_call | LiveKit | prod-agent-v2 | pass | 4.3 | 90% | 1040ms | 2m 52s |
| elderly_bill_payment | Vapi | staging-agent-v3 | running | 3.7 | 90% | 1340ms | 4m 11s |
Turn-level traces
callerplan_upgrade_hinglishMujhe unlimited data plan chahiye, but price clear batao.STT 740ms81%
agentplan_upgrade_hinglishI can help you upgrade. The unlimited plan starts at 899 per month.LLM 1180msok
callerinternet_outage_creditMy internet has been down for six hours. I work from home.STT 910ms73%
agentinternet_outage_creditI see the outage. I can check restoration ETA and billing credit.TTS 520msok
Regression alerts
| Metric | Scenario | Previous | Current | Delta | |
|---|---|---|---|---|---|
| MOS | plan_upgrade_hinglish | 3.9 | 3.4 | -12.8% | Investigate |
| Task completion | internet_outage_credit | 74% | 52% | -29.7% | Investigate |
| Latency p95 | urgent_clinic_booking | 1240ms | 1580ms | +27.4% | Investigate |