Repository navigation
Support known speaker counts in MSDD diarization - #379
ciklois-neo wants to merge 1 commit into
Conversation
|
Hello and thank you for your contribution
|
|
Thanks for the clarification. I checked the NeMo 2.8.0rc2 execution path again. Given the planned MSDD deprecation, would you prefer that I close this PR and explore known-speaker-count support on Sortformer instead? If so, is there a supported way to constrain or otherwise guide the speaker count in the current Sortformer path? |
|
Yes exploring it on sortformer is more realistic, since it will eventually be replaced by another sortformer model that supports up to 8 speakers |
|
Thanks, that makes sense. I will treat the current MSDD implementation as a transitional downstream compatibility path in Buzz rather than relying on it as a long-term upstream production API. Since it is opt-in and has solved a real under-counting case, Buzz can keep it while the MSDD backend remains available, with automatic detection still the default. In parallel, I will explore known-speaker guidance in Sortformer and the future Sortformer model you mentioned that supports up to eight speakers. The MSDD-specific option can be removed when that backend is retired. Separately, I have completed the backend-independent speaker workflow in Buzz in PR #1587: speaker labels are stored separately from transcript text, can be edited or assigned to multiple rows, shown in a colored and filterable Speakers view, and exported to a colored Word document with optional timestamps. That layer will remain useful regardless of whether the diarizer is MSDD, Sortformer, or a future model. Thank you for pointing me toward the realistic long-term direction. |
Summary
num_speakersargument toMSDDDiarizer.diarizeNeuralDiarizer._initialize_configs, which enables NeMo's oracle speaker-count pathMotivation
Automatic clustering can under-count speakers when voices are similar or some participants are quieter or farther from the microphone. Allowing downstream applications to provide a known count avoids that failure mode while preserving the existing automatic behavior when the argument is omitted.
Validation
Validated through a downstream Buzz integration with focused tests covering the manifest and NeMo configuration path. It was also tested successfully on a 30-minute Hungarian room recording with three participants, where automatic detection previously found only two speakers.