Design and evaluation of prosody-based non-speech audio feedback for physical training application

Methodological support for the design of non-speech user interface sounds for human–computer interaction is still fairly scarce. To meet this challenge, this paper presents a sound design case which, as a practical design solution for a wrist-computer physical training application, outlines a prosody-based method for designing non-speech user interface sounds. The principles used in the design are based on nonverbal communicative functions of prosody in speech acts, exemplifying an interpersonal approach to sonic interaction design. The stages of the design process are justified with a theoretical analysis and three empirical sub-studies, which comprise production and recognition tasks involving four communicative functions. The final evaluation study indicates that the resulting sounds of the design process successfully served these functions. In all, this study suggests that prosody-based sound design provides widely applicable means to attribute meaningful, interaction-derived qualities to non-speech sounds for interactive applications.

► This paper outlines a prosody-based method for designing user interface sounds.
► A complete sound design case for a physical training application is presented.
► The design process is justified with a theoretical analysis and empirical sub-studies.
► According to the results, prosodic forms are coupled with communicative functions.
► Implemented sounds successfully communicated the intended meanings.