Customer story
Lumen Health
·
Clinical summaries
212 regressions blocked before release in Q3
11 min median triage
3 judges calibrated
94% judge agreement
Regressions blocked per week · Q3
212
The challenge
Lumen writes visit summaries for clinicians. Every summary was reviewed by hand, and review time was the release bottleneck.
The setup
Three judges (omissions, dosage, tone) were calibrated against clinician labels, with disagreements routed to a human review queue.
The result
In Q3 the gate blocked 212 regressions before release, median triage fell to 11 minutes, and clinicians now review a 40-case sample each week.
Our clinicians review 40 cases a week instead of 400. The judges agree with them 94% of the time.
Priya Raman
ML Lead