Skip to content

Add diar_vad_demo: voice activity detection offline, as it arrives, and over many files - #65

Draft
sw005320 wants to merge 3 commits into
masterfrom
demos/diar-vad
Draft

sw005320 wants to merge 3 commits into
masterfrom
demos/diar-vad

Conversation

@sw005320

@sw005320 sw005320 commented Nov 8, 2026 •

Copy link
Copy Markdown
Contributor

What

Demos/diar_vad_demo.ipynb: voice activity detection with the two
frontia_vad_v1 models from espnet (egs2/frontia_vad_v1/diar1) through
espnet2.bin.diar_inference (offline, batches) and diar_inference_streaming (online):

  • the offline model (espnet/frontia_vad_v1_offline)
    over a recording with pauses, drawn on the waveform;
  • the online model (espnet/frontia_vad_v1_online)
    fed 100 ms at a time, compared with the whole recording;
  • a batch of files with diarize_batch;
  • what the threshold and the median filter do.

VAD_MODEL and VAD_ONLINE_MODEL take other tags or packed .zips.

With its workflow (diar_vad_demo.yml) and a row in both READMEs;
tools/check_layout.py passes.

Release

It pins espnet==202612, the release that will carry the VAD classes in espnet2.bin.diar_inference
(espnet/espnet#7001), so the workflow sets allow_unreleased_pin: true.

Run end to end with tools/run_notebook.py against that branch, with the
published models.

🤖 Generated with Claude Code

…nd over many files

The two frontia_vad_v1 models (egs2/frontia_vad_v1/diar1 in espnet) through
espnet2.bin.vad: the offline model over a recording, the online (causal)
model fed 100 ms at a time, and a batch of files with diarize_batch, then the
effect of the threshold and the median filter. VAD_MODEL and VAD_ONLINE_MODEL
take other tags or packed .zips.

It pins the espnet release that will carry espnet2.bin.vad, so its workflow
sets allow_unreleased_pin until that release is out.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Shinji Watanabe and others added 2 commits November 8, 2026 09:58
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The online cell feeds the recording 200 ms at a time at the pace a
microphone would, and redraws the waveform so far with the speech found
shaded green, the probability and a line at now.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant