Publication Date

3-10-2020

Document Type

Article

Publication Title

The Journal of the Acoustical Society of America

Volume

147

Issue

3

DOI

10.1121/10.0000737

First Page

246

Last Page

251

Abstract

The nature of the visual input that integrates with the audio signal to yield speech processing advantages remains controversial. This study tests the hypothesis that the information extracted for audiovisual integration includes co-occurring suprasegmental dynamic changes in the acoustic and visual signal. English sentences embedded in multi-talker babble noise were presented to native English listeners in audio-only and audiovisual modalities. A significant intelligibility enhancement with the visual analogs congruent to the acoustic amplitude envelopes was observed. These results suggest that dynamic visual modulation provides speech rhythmic information that can be integrated online with the audio signal to enhance speech intelligibility.

Keywords

speech communication, phonetics, auditory perception, acoustics, speech intelligibility, speech perception, speech processing systems, speech production, MATLAB, amplitude modulation

Creative Commons License

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.

Department

Audiology

Download

Share

COinS