One model, before and after
Version 3 scored 96% in testing.
Ravi signs it off for the roads team on Monday.
Better than version 2 on every test.
Then the clocks went back.
Residents’ photos came in after dark and in rain. It missed four in ten.
- missed
- missed
- missed
Night and rain photos: 4 in 10 potholes missed.
Now every version faces the hard cases.
Night, rain and glare are in the test set, labelled twice.
- DayDaylight, dry road97%
- NightAfter dark, street lights93%
- RainWet road, glare91%
- LabelsChecked by two peopleAgreed
Released with the evidence.
Ravi knows it works at night before the roads team relies on it.
An illustrative model, based on our applied AI work.
- After dark→ 58% to 93% foundBiggest gain
- Rain and glare→ 61% to 91% foundNew test cases
- Daylight→ 96% to 97% foundNo step back
Release decision
Version 4 is better in all six conditions.
Evidence kept with the releaseReleased
Better than version 2 on every test.
- missed
- missed
- missed
Night and rain photos: 4 in 10 potholes missed.
- DayDaylight, dry road97%
- NightAfter dark, street lights93%
- RainWet road, glare91%
- LabelsChecked by two peopleAgreed
- After dark→ 58% to 93% foundBiggest gain
- Rain and glare→ 61% to 91% foundNew test cases
- Daylight→ 96% to 97% foundNo step back
Release decision
Version 4 is better in all six conditions.
Evidence kept with the releaseReleased