Voice Judge
Retrieve audio-native voice quality scores for your voice agent calls.
The Voice Judge evaluates voice agent calls directly from audio recordings, scoring each call across 10 quality dimensions. Scores measure the voice experience - pronunciation, clarity, pacing, interruption handling - independent of conversational logic or agent prompting.
Results become available through the per-service API after a call has been evaluated.
Endpoints
List Recent Voice Judge Results
Returns the most recent per-call voice-judge scores for one service, ordered newest first. Produced by the Databricks voice_judge job (stereo audio → Gemini 3.5 Flash → 10-dimension rubric). Used by the Agent Readiness page to populate Voice Quality criterion cards.
Latency: 500ms-2s (reads from analytics warehouse, not OLTP).
Default limit: 20. Max 100.
API key issued via POST /v1/{workspace_id}/api-keys. Pass the returned api_key value as a Bearer token.
Service UUID
Max rows to return (default 20, max 100)
20Offset for pagination (default 0)
0Voice judge rows (newest first)
Validation Error
Analytics warehouse not configured or transiently unavailable
GET /v1/{workspace_id}/services/{service_id}/voice-judge/recent HTTP/1.1
Host: platform.api-us.concurrence.com
Authorization: Bearer YOUR_SECRET_TOKEN
Accept: */*
{
"service_id": "123e4567-e89b-12d3-a456-426614174000",
"count": 1,
"items": [
{
"call_sid": "text",
"call_entity_id": "123e4567-e89b-12d3-a456-426614174000",
"service_id": "123e4567-e89b-12d3-a456-426614174000",
"latency_dead_air_score": 1,
"pronunciation_score": 1,
"clarity_score": 1,
"filler_silence_score": 1,
"interruption_handling_score": 1,
"audio_consistency_score": 1,
"pacing_score": 1,
"warmth_tone_score": 1,
"accent_quality_score": 1,
"voice_identity_score": 1,
"overall_score": 1,
"critical_count": 1,
"flag_count": 1,
"warning_count": 1,
"judge_json": "text",
"computed_at": "2026-01-01T00:00:00.000Z"
}
]
}Returns the most recent per-call voice quality scores for a service, ordered newest first.
Score Interpretation
All dimension scores range from 0.0 to 1.0:
0.75 - 1.0
None
Meets the bar
0.5 - 0.74
Warning
Minor quality pattern detected
0.25 - 0.49
Flag
Notable quality issue
0.0 - 0.24
Critical
Significant quality problem
Error Responses
404
Service not found in this workspace
503
Voice judge result data is temporarily unavailable
A 200 response with an empty items list means no evaluated calls are available for this service. For a 503 response, retry with backoff.
Dimensions
The voice judge evaluates 10 dimensions, grouped by priority:
P0 - Critical Quality
Latency and Dead Air - Response latency between turns. Flags prolonged silence (>3s between turns) and extended processing waits without verbal acknowledgment.
Pronunciation - Correct pronunciation of medical terms, drug names, dates, numbers, and patient names. Critical on any factual read-back error.
Clarity - Speech intelligibility and clean audio output. Critical on garbled or unintelligible speech.
P1 - Important Quality
Filler and Silence Management - Graceful handling of processing pauses. Verbal acknowledgment before a pause, no dead air during the wait, no repeated filler phrases, and filler that matches the result being delivered.
Interruption Handling - Clean barge-in behavior. Agent stops when the caller speaks, no false triggers on background noise, smooth recovery after being interrupted.
Audio Consistency - Absence of volume spikes, pitch anomalies, mid-word cutoffs, or inconsistent voice timbre across turns.
P2 - Quality Polish
Pacing - Conversational speech rate with appropriate pauses between pieces of information and slower delivery for sensitive content.
Warmth and Tone - Emotional appropriateness matched to the caller's state. Flags flat affect, tonal mismatches, or inappropriate emotional tone.
Accent and Language Quality - Language and accent match to the caller. Critical on wrong language delivery.
Voice Identity - Consistent agent voice and persona across the entire call.
Last updated
Was this helpful?

