کد مقاله کد نشریه سال انتشار مقاله انگلیسی نسخه تمام متن
926789 921902 2010 8 صفحه PDF دانلود رایگان
عنوان انگلیسی مقاله ISI
Cross-modal facilitation in speech prosody
موضوعات مرتبط
علوم زیستی و بیوفناوری علم عصب شناسی علوم اعصاب شناختی
پیش نمایش صفحه اول مقاله
Cross-modal facilitation in speech prosody
چکیده انگلیسی

Speech prosody has traditionally been considered solely in terms of its auditory features, yet correlated visual features exist, such as head and eyebrow movements. This study investigated the extent to which visual prosodic features are able to affect the perception of the auditory features. Participants were presented with videos of a speaker pronouncing two words, with visual features of emphasis on one of these words. For each trial, participants saw one video where the two words were identical in both pitch and amplitude, and another video where there was a difference in either pitch or amplitude that was congruent or incongruent with the visual changes. Participants were asked to decide which video contained the sound difference. Thresholds were obtained for the congruent and incongruent videos, and for an auditory-alone condition. It was found that the congruent thresholds were better than the incongruent thresholds for both pitch and amplitude changes. Interestingly, the congruent thresholds for amplitude were better than for the auditory-alone condition, which implies that the visual features improve sensitivity to loudness changes. These results demonstrate that visual stimuli can affect auditory thresholds for changes in pitch and amplitude, and furthermore support the view that visual prosodic features enhance speech processing.

ناشر
Database: Elsevier - ScienceDirect (ساینس دایرکت)
Journal: Cognition - Volume 115, Issue 1, April 2010, Pages 71–78
نویسندگان
, , ,