Generated 2026-09-24T21:36:01+00:00 · corpus voice · 48 recordings (0 real voice, 48 synthetic) · conditions: clean, radio_snr10
Speech-to-text: Vosk (Apache-2.0) EN/FR offline models → spoken-form normaliser → assured extraction (confidence, evidence, abstain). type_acc counts an abstention on a non-message line as correct. coverage = required fields filled / required fields of the detected type.
| condition / lang / source | n | type acc | abstain | WER | ASR conf | coverage |
|---|---|---|---|---|---|---|
| clean/en/synthetic | 48 | 92% | 17% | 0.14 | 0.93 | 84% |
| radio_snr10/en/synthetic | 48 | 90% | 19% | 0.32 | 0.84 | 80% |
| speaker | n | type acc | abstain | WER | ASR conf |
|---|---|---|---|---|---|
| tts-david-r+0 | 12 | 92% | 17% | 0.15 | 0.93 |
| tts-david-r-2 | 12 | 92% | 17% | 0.16 | 0.93 |
| tts-zira-r+0 | 12 | 92% | 17% | 0.14 | 0.93 |
| tts-zira-r-2 | 12 | 92% | 17% | 0.13 | 0.94 |
| file | lang | expected | detected | ok | conf | WER | missing |
|---|---|---|---|---|---|---|---|
| tts-david-r-2_EN01.wav | en | MEDEVAC | MEDEVAC | ✓ | 1.0 | 0.18 | |
| tts-david-r-2_EN02.wav | en | MEDEVAC | MEDEVAC | ✓ | 1.0 | 0.23 | |
| tts-david-r-2_EN03.wav | en | CTC | CTC | ✓ | 0.88 | 0.08 | CONTACT.dtg |
| tts-david-r-2_EN04.wav | en | CTC | CTC | ✓ | 0.88 | 0.06 | CONTACT.dtg |
| tts-david-r-2_EN05.wav | en | SITREP | SITREP | ✓ | 0.8 | 0.26 | PERIOD.from_dtg, PERIOD.to_dtg |
| tts-david-r-2_EN06.wav | en | RFI | RFI | ✓ | 0.7 | 0.24 | REQUEST.rfi_id, REQUEST.ltiov |
| tts-david-r-2_EN07.wav | en | FRAGO | abstain | ✗ | 0.0 | 0.16 | message type |
| tts-david-r-2_EN08.wav | en | CFF | CFF | ✓ | 0.9 | 0.15 | OBSERVER.id |
| tts-david-r-2_EN09.wav | en | CYBERINC | CYBERINC | ✓ | 0.76 | 0.07 | INCIDENT.incident_id, INCIDENT.dtg |
| tts-david-r-2_EN10.wav | en | SPACEEVT | SPACEEVT | ✓ | 0.7 | 0.25 | EVENT.object_id, EVENT.dtg |
| tts-david-r-2_EN11.wav | en | LOGSTAT | LOGSTAT | ✓ | 0.743 | 0.07 | SUPPLY.on_hand_pct, SUPPLY.on_hand_pct, SUPPLY.days_of_suppl |
| tts-david-r-2_EN12.wav | en | — | abstain | ✓ | 0.0 | 0.13 | message type |
| tts-david-r_0_EN01.wav | en | MEDEVAC | MEDEVAC | ✓ | 1.0 | 0.18 | |
| tts-david-r_0_EN02.wav | en | MEDEVAC | MEDEVAC | ✓ | 1.0 | 0.16 | |
| tts-david-r_0_EN03.wav | en | CTC | CTC | ✓ | 0.88 | 0.10 | CONTACT.dtg |
| tts-david-r_0_EN04.wav | en | CTC | CTC | ✓ | 0.88 | 0.09 | CONTACT.dtg |
| tts-david-r_0_EN05.wav | en | SITREP | SITREP | ✓ | 0.8 | 0.22 | PERIOD.from_dtg, PERIOD.to_dtg |
| tts-david-r_0_EN06.wav | en | RFI | RFI | ✓ | 0.7 | 0.19 | REQUEST.rfi_id, REQUEST.ltiov |
| tts-david-r_0_EN07.wav | en | FRAGO | abstain | ✗ | 0.0 | 0.16 | message type |
| tts-david-r_0_EN08.wav | en | CFF | CFF | ✓ | 0.9 | 0.15 | OBSERVER.id |
| tts-david-r_0_EN09.wav | en | CYBERINC | CYBERINC | ✓ | 0.76 | 0.05 | INCIDENT.incident_id, INCIDENT.dtg |
| tts-david-r_0_EN10.wav | en | SPACEEVT | SPACEEVT | ✓ | 0.85 | 0.14 | EVENT.dtg |
| tts-david-r_0_EN11.wav | en | LOGSTAT | LOGSTAT | ✓ | 0.743 | 0.21 | SUPPLY.on_hand_pct, SUPPLY.on_hand_pct, SUPPLY.days_of_suppl |
| tts-david-r_0_EN12.wav | en | — | abstain | ✓ | 0.0 | 0.13 | message type |
| tts-zira-r-2_EN01.wav | en | MEDEVAC | MEDEVAC | ✓ | 1.0 | 0.20 | |
| tts-zira-r-2_EN02.wav | en | MEDEVAC | MEDEVAC | ✓ | 1.0 | 0.18 | |
| tts-zira-r-2_EN03.wav | en | CTC | CTC | ✓ | 0.88 | 0.08 | CONTACT.dtg |
| tts-zira-r-2_EN04.wav | en | CTC | CTC | ✓ | 0.88 | 0.06 | CONTACT.dtg |
| tts-zira-r-2_EN05.wav | en | SITREP | SITREP | ✓ | 0.7 | 0.22 | PERIOD.from_dtg, PERIOD.to_dtg, OWNSIT.unit |
| tts-zira-r-2_EN06.wav | en | RFI | RFI | ✓ | 0.7 | 0.10 | REQUEST.rfi_id, REQUEST.ltiov |
| tts-zira-r-2_EN07.wav | en | FRAGO | abstain | ✗ | 0.0 | 0.16 | message type |
| tts-zira-r-2_EN08.wav | en | CFF | CFF | ✓ | 0.9 | 0.13 | OBSERVER.id |
| tts-zira-r-2_EN09.wav | en | CYBERINC | CYBERINC | ✓ | 0.76 | 0.05 | INCIDENT.incident_id, INCIDENT.dtg |
| tts-zira-r-2_EN10.wav | en | SPACEEVT | SPACEEVT | ✓ | 0.7 | 0.18 | EVENT.object_id, EVENT.dtg |
| tts-zira-r-2_EN11.wav | en | LOGSTAT | LOGSTAT | ✓ | 0.743 | 0.11 | SUPPLY.on_hand_pct, SUPPLY.on_hand_pct, SUPPLY.days_of_suppl |
| tts-zira-r-2_EN12.wav | en | — | abstain | ✓ | 0.0 | 0.13 | message type |
| tts-zira-r_0_EN01.wav | en | MEDEVAC | MEDEVAC | ✓ | 1.0 | 0.18 | |
| tts-zira-r_0_EN02.wav | en | MEDEVAC | MEDEVAC | ✓ | 1.0 | 0.18 | |
| tts-zira-r_0_EN03.wav | en | CTC | CTC | ✓ | 0.88 | 0.08 | CONTACT.dtg |
| tts-zira-r_0_EN04.wav | en | CTC | CTC | ✓ | 0.76 | 0.09 | CONTACT.track_id, CONTACT.dtg |
| tts-zira-r_0_EN05.wav | en | SITREP | SITREP | ✓ | 0.7 | 0.17 | PERIOD.from_dtg, PERIOD.to_dtg, OWNSIT.unit |
| tts-zira-r_0_EN06.wav | en | RFI | RFI | ✓ | 0.7 | 0.10 | REQUEST.rfi_id, REQUEST.ltiov |
| tts-zira-r_0_EN07.wav | en | FRAGO | abstain | ✗ | 0.0 | 0.14 | message type |
| tts-zira-r_0_EN08.wav | en | CFF | CFF | ✓ | 0.9 | 0.22 | OBSERVER.id |
| tts-zira-r_0_EN09.wav | en | CYBERINC | CYBERINC | ✓ | 0.76 | 0.05 | INCIDENT.incident_id, INCIDENT.dtg |
| tts-zira-r_0_EN10.wav | en | SPACEEVT | SPACEEVT | ✓ | 0.7 | 0.18 | EVENT.object_id, EVENT.dtg |
| tts-zira-r_0_EN11.wav | en | LOGSTAT | LOGSTAT | ✓ | 0.743 | 0.18 | SUPPLY.on_hand_pct, SUPPLY.on_hand_pct, SUPPLY.days_of_suppl |
| tts-zira-r_0_EN12.wav | en | — | abstain | ✓ | 0.0 | 0.13 | message type |
Real-voice rows are the relevant-environment evidence; synthetic rows are the regression baseline. Lines EN12 / FR06 must abstain.