Dual-channel postfiltering and eKF-RTF estimation: Source code and audio examples

Juan M. Martín-Doñas, Antonio M. Peinado, Iván López-Espejo, Angel M. Gomez

Dual-Channel Speech Enhancement based on Extended Kalman Filter RTF Estimation

This paper deals with speech enhancement in dual-microphone smartphones using beamforming along with postfiltering techniques. The performance of these algorithms relies on a good estimation of the acoustic channel and speech and noise statistics. This paper presents a speech enhancement system that combines the estimation of the relative transfer function (RTF) between microphones using an extended Kalman filter framework with a novel speech presence probability estimator intended to track the variability of noise statistics. The available dual-channel information is exploited to obtain more reliable estimates of clean speech statistics. Noise reduction is further improved by means of postfiltering techniques that take advantage of the speech presence estimation. Our proposal was evaluated in different reverberant and noisy environments in which the smartphone is used in both close-talk and far-talk positions. The experimental results show that our system achieves improvements in terms of noise reduction, low speech distortion, and better speech intelligibility compared to other state-of-the-art approaches.

Paper

Python Code (06-06-2019)

Accepted in Applied Sciences (MDPI).

Some example audios below.

Noisy speech signal from primary and secondary microphones, and enhanced speech signals using our framework: standalone MVDR, Wiener postfiter (wf), parametric WF (pwf) and OMLSA postfilter. Comparison with PLD and SPPC dual-channel speech enhancement algorithms.

Contact: Juan M. Martín-Doñas

CLOSE-TALK

SNR 10 dB

Noise Clean Noisy 1ch Noisy 2ch MVDR wf_MVDR omlsa_MVDR PLD
Car
Street
Pedestrian street
Bus
Cafe
Bus station
Babble
Mall

SNR 0 dB

Noise Clean Noisy 1ch Noisy 2ch MVDR wf_MVDR omlsa_MVDR PLD
Car
Street
Pedestrian street
Bus
Cafe
Bus station
Babble
Mall

FAR-TALK

SNR 10 dB

Noise Clean Noisy 1ch Noisy 2ch MVDR wf_MVDR pwf_MVDR SPPC
Car
Street
Pedestrian street
Bus
Cafe
Bus station
Babble
Mall

SNR 0 dB

Noise Clean Noisy 1ch Noisy 2ch MVDR wf_MVDR pwf_MVDR SPPC
Car
Street
Pedestrian street
Bus
Cafe
Bus station
Babble
Mall