Using music[al] knowledge to represent expressions of emotions

- Visually representing the conversation could provide an effective tool for medical interventions.
- Music notation & piano roll are two ways researchers can integrate linguistics and paralinguistics.
- Musical notation allows researchers to “see” how communication evolves in clinical encounters.
- Piano roll software helps visualize the sonic elements of paralinguistic expression.

ObjectiveBeing able to identify expressions of emotion is crucial to effective clinical communication research. However, traditional linguistic coding systems often cannot represent emotions that are expressed nonlexically or phonologically (i.e., not through words themselves but through vocal pitch, speed/rhythm/tempo, and volume).MethodsUsing audio recording of a palliative care consultation in the natural hospital setting, two experienced music scholars employed Western musical notation, as well as the graphic realization of a digital audio program (Piano roll visualization), to visually represent the sonic features of conversation where a patient has an emotional “choke” moment.ResultsWestern musical notation showed the ways that changes in pitch and rate correspond to the patient's emotion: rising sharply in intensity before slowly fading away. Piano roll visualization is a helpful supplement.ConclusionsUsing musical notation to illustrate palliative care conversations in the hospital setting can render visible for analysis several aspects of emotional expression that researchers otherwise experience as intuitive or subjective. Various forms and formats of musical notation techniques and sonic visualization technologies should be considered as fruitful and complementary alternatives to traditional coding tools in clinical communications research.Practice implicationsMusical notation offers opportunity for both researchers and learners to “see” how communication evolves in clinical encounters, particularly where the lexical and phonological features of interpersonal communication are concordant and discordant with one another.