Audio Source Separation and Speech Enhancement

Learn the technology behind hearing aids, Siri, and Echo 

Audio source separation and speech enhancement aim to extract one or more source signals of interest from an audio recording involving several sound sources. These technologies are among the most studied in audio signal processing today and bear a critical role in the success of hearing aids, hands–free phones, voice command and other noise–robust audio analysis systems, and music post–production software.

Research on this topic has followed three convergent paths, starting with sensor array processing, computational auditory scene analysis, and machine learning based approaches such as independent component analysis, respectively. This book is the first one to provide a comprehensive overview by presenting the common foundations and the differences between these techniques in a unified setting.

Key features:

Consolidated perspective on audio source separation and speech enhancement. Both historical perspective and latest advances in the field, e.g. deep neural networks. Diverse disciplines: array processing, machine learning, and statistical signal processing. Covers the most important techniques for both single–channel and multichannel processing.

This book provides both introductory and advanced material suitable for people with basic knowledge of signal processing and machine learning. Thanks to its comprehensiveness, it will help students select a promising research track, researchers leverage the acquired cross–domain knowledge to design improved techniques, and engineers and developers choose the right technology for their target application scenario. It will also be useful for practitioners from other fields (e.g., acoustics, multimedia, phonetics, and musicology) willing to exploit audio source separation or speech enhancement as pre–processing tools for their own needs.

Emmanuel Vincent is a Senior Research Scientist with Inria, Nancy, France. His research focuses on machine learning for speech and audio signal processing. He has been working on audio source separation for 15 years and co–authored over 150 publications in this field. His contributions include harmonic nonnegative matrix factorization, full–rank spatial covariance modeling, joint spatial/spectral estimation, and objective performance metrics for source separation. He has given several keynotes, tutorials and summer school lectures, including at Interspeech 2012 and 2016, WASPAA 2015 and LVA/ICA 2015. He is a founding chair of the series of Signal Separation Evaluation Campaigns (SiSEC) and CHiME Speech Separation and Recognition Challenges and the chair of ISCA s special interest group on Robust Speech Processing.

Tuomas Virtanen is an Academy Research Fellow and Associate Professor with the Department of Signal Processing, Tampere University of Technology, Finland, where he is leading the Audio Research Group. He has been active in the field since 2000 and he is known for his pioneering work on single–channel sound source separation using nonnegative matrix factorization, and its application to noise–robust speech recognition, music content analysis, and sound event detection. His research interests also include content analysis of audio signals in general and machine learning. He has authored more than 100 publications and received the IEEE Signal Processing Society 2012 best paper award and three other best paper awards. He was an editor of the book Techniques for Noise Robustness in Automatic Speech Recognition published by Wiley.

Sharon Gannot is a Full Professor at the Faculty of Engineering, Bar–Ilan University, Israel, where he is heading the Speech and Signal Processing laboratory and the Signal Processing Track. His research interests include multi–microphone speech processing; distributed algorithms for noise reduction and speaker separation; array processing on manifold; dereverberation; single–microphone speech enhancement; and speaker localization and tracking. He received the Bar–Ilan University s outstanding lecturer award for 2010 and 2014. He has co–authored 200 publications and lectured tutorials at ICASSP 2012, EUSIPCO 2012, ICASSP 2013, and EUSIPCO 2013 and a keynote address at IWAENC 2012. He was a co–editor of the book Speech Processing in Modern Communication: Challenges and Perspectives. Starting in January 2017, he will serve as the vice–chair of the IEEE Audio and Acoustic Signal Processing (AASP) technical committee.