This paper deals with speech enhancement in dual-microphone smartphones using beamforming along with postfiltering techniques. The performance of these algorithms relies on a good estimation of the acoustic channel and speech and noise statistics. This paper presents a speech enhancement system that combines the estimation of the relative transfer function (RTF) between microphones using an extended Kalman filter framework with a novel speech presence probability estimator intended to track the variability of noise statistics. The available dual-channel information is exploited to obtain more reliable estimates of clean speech statistics. Noise reduction is further improved by means of postfiltering techniques that take advantage of the speech presence estimation. Our proposal was evaluated in different reverberant and noisy environments in which the smartphone is used in both close-talk and far-talk positions. The experimental results show that our system achieves improvements in terms of noise reduction, low speech distortion, and better speech intelligibility compared to other state-of-the-art approaches.
Python Code (06-06-2019)
Accepted in Applied Sciences (MDPI).
Some example audios below.
Noisy speech signal from primary and secondary microphones, and enhanced speech signals using our framework: standalone MVDR, Wiener postfiter (wf), parametric WF (pwf) and OMLSA postfilter. Comparison with PLD and SPPC dual-channel speech enhancement algorithms.
Contact: Juan M. Martín-Doñas
CLOSE-TALK
SNR 10 dB
Noise | Clean | Noisy 1ch | Noisy 2ch | MVDR | wf_MVDR | omlsa_MVDR | PLD |
---|---|---|---|---|---|---|---|
Car | |||||||
Street | |||||||
Pedestrian street | |||||||
Bus | |||||||
Cafe | |||||||
Bus station | |||||||
Babble | |||||||
Mall |
SNR 0 dB
Noise | Clean | Noisy 1ch | Noisy 2ch | MVDR | wf_MVDR | omlsa_MVDR | PLD |
---|---|---|---|---|---|---|---|
Car | |||||||
Street | |||||||
Pedestrian street | |||||||
Bus | |||||||
Cafe | |||||||
Bus station | |||||||
Babble | |||||||
Mall |
FAR-TALK
SNR 10 dB
Noise | Clean | Noisy 1ch | Noisy 2ch | MVDR | wf_MVDR | pwf_MVDR | SPPC |
---|---|---|---|---|---|---|---|
Car | |||||||
Street | |||||||
Pedestrian street | |||||||
Bus | |||||||
Cafe | |||||||
Bus station | |||||||
Babble | |||||||
Mall |
SNR 0 dB
Noise | Clean | Noisy 1ch | Noisy 2ch | MVDR | wf_MVDR | pwf_MVDR | SPPC |
---|---|---|---|---|---|---|---|
Car | |||||||
Street | |||||||
Pedestrian street | |||||||
Bus | |||||||
Cafe | |||||||
Bus station | |||||||
Babble | |||||||
Mall |