The Cone of Silence: Speech Separation by Localization

The Cone of Silence: Speech Separation by Localization

Asset Type
Research
Tags
Date
Dec 1, 2021
The Cone of Silence: Speech Separation by Localization
Given a multi-microphone recording of an unknown number of speakers talking concurrently, we simultaneously localize the sources and separate the individual speakers. At the core of our method is a deep network, in the waveform domain, which isolates sources within an angular region , given an angle of interest and angular window size . By exponentially decreasing , we can perform a binary search to localize and separate all sources in logarithmic time. Our algorithm also allows for an arbitrary number of potentially moving speakers at test time, including more speakers than seen during training. Experiments demonstrate state of the art performance for both source separation and source localization, particularly in high levels of background noise.
notion image
The Cone of Silence: Speech Separation by Localization Proceedings of the 33rd International Conference on Neural Information Processing Systems (NeurIPS), pp. 20925-20938. 2020. PDF: https://arxiv.org/pdf/2010.06007.pdf