EmoLexPros: A database of prosodically incongruent emotional words in European Portuguese

Rui Gomes, São Luís Castro, Susana Silva

Abstract


In this study, we validated a set of audio stimuli addressing emotional lexico-prosodic congruence. Positive, neutral and negative words classified as such in European Portuguese lexical databases were recorded with matching and mismatching emotional prosodic patterns (positive, neutral and negative). The produced set was submitted to behavioral validation, where each utterance was rated for lexico-prosodic match. Word pairs showing maximal differences across match and mismatch versions were selected (n=55) and subjected to prosody-related acoustic validation. The three types of prosodic patterns, positive, negative and neutral, differenced in F0, amplitude, duration and timbral parameters. Finally, items were catalogued for their psycholinguistic properties. The present validated set may be used for emotional prosody research in European Portuguese. Since it is compatible with passive listening tasks, it is particularly relevant to research and clinical practice engaging populations who are limited in their ability to provide explicit responses.


Keywords


Emotional prosody, Incongruence detection, Speech processing, European Portuguese. Introduction In everyday social interactions, humans rely on multiple sources of information to successfully communicate with one another. Visual, auditory, and contextual

Full Text:

PDF

References


Altarriba, J., & Bauer, L. (2004). The distinctiveness of emotion concepts: A comparison between emotion, abstract, and concrete words. The American Journal of Psychology, 117(3), 389-410. https://doi.org/10.2307/4149007

Bąk, H. (2016). The state of emotional prosody research – A meta-analysis. In R. Heredia & A. Cieslicka (Eds.), Emotional prosody processing for non-native english speakers: Towards an integrative emotion paradigm (pp. 79-105). Springer International Publishing. https://doi.org/10.1007/978-3-319-44042-2

Banse, R., & Scherer, K. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70(3), 614-636. https://doi.org/10.1037/0022-3514.70.3.614

Bostanov, V., & Kotchoubey, B. (2004). Recognition of affective prosody: Continuous wavelet measures of event-related brain potentials to emotional exclamations. Psychophysiology, 41(2), 259-268. https://doi.org/10.1111/j.1469-8986.2003.00142.x

Bradley, M. M., & Lang, P. J. (1999). Affective Norms for English Words (ANEW): Instruction manual and affective ratings (Technical Report C-1). The Center for Research in Psychophysiology, University of Florida.

Brück, C., Kreifelts, B., & Wildgruber, D. (2011). Emotional voices in context: A neurobiological model of multimodal affective information processing. Physics of Life Reviews, 8(4), 383-403.

https://doi.org/10.1016/j.plrev.2011.10.002

Castro, S., & Lima, C. (2014). Age and musical expertise influence emotion recognition in music. Music Perception, 32(2), 125-142. https://doi.org/10.1525/mp.2014.32.2.125

Correia, A., Branco, P., Martins, M., Reis, A., Martins, N., Castro, S., & Lima, C. (2019). Resting-state connectivity reveals a role for sensorimotor systems in vocal emotional processing in children. Neuroimage, 201, 116052. https://doi.org/10.1016/j.neuroimage.2019.116052

Costa, S. (2012). Adaptação e teste de uma base lexical de palavras emocionais para o português europeu: EMOTAIX.PT [Dissertação de mestrado não publicada, Faculdade de Psicologia e de Ciências da Educação, Universidade do Porto, Porto, Portugal]. https://sigarra.up.pt/fpceup/pt/pub_geral.pub_view?pi_pub_base_id=30055

Cowen, A., Laukka, P., Elfenbein, H., Liu, R., & Keltner, D. (2019). The primacy of categories in the recognition of 12 emotions in speech prosody across two cultures. Nature Human Behaviour, 3(4), 369-382. https://doi.org/10.1038/s41562-019-0533-6

Dowling, W. J., & Harwood, D. L. (1986). Music Cognition. Academic Press.

Filipe, M., Branco, P., Frota, S., Castro, S., & Vicente, S. (2015). Affective prosody in European Portuguese: Perceptual and acoustic characterization of one-word utterances. Speech Communication, 67, 58-64. https://doi.org/10.1016/j.specom.2014.09.007

Giordano, B., Whiting, C., Kriegeskorte, N., Kotz, S., Gross, J., & Belin, P. (2021). The representational dynamics of perceived voice emotions evolve from categories to dimensions. Nature Human Behaviour. https://doi.org/10.1038/s41562-021-01073-0

Goudbeek, M., & Scherer, K. (2010). Beyond arousal: Valence and potency/control cues in the vocal expression of emotion. The Journal of the Acoustical Society of America, 128(3), 1322. https://doi.org/10.1121/1.3466853

Hamann, S. (2012). Mapping discrete and dimensional emotions onto the brain: Controversies and consensus. Trends in Cognitive Sciences, 16(9), 458-466. https://doi.org/10.1016/j.tics.2012.07.006

Handel, S. (1995). Timbre perception and auditory object identification. In B. C. J. Moore (Ed.), Handbook of perception and cognition Hearing (2nd ed., pp. 425-461). Academic Press. https://doi.org/10.1016/B978-012505626-7/50014-5

Hickok, G., & Poeppel, D. (2007). The cortical organization of speech processing. Nature Reviews Neuroscience, 8(5), 393-402. https://doi.org/10.1038/nrn2113

Juslin, P. N., & Laukka, P. (2003). Communication of emotions in vocal expression and music performance: Different channels, same code?. Psychological Bulletin, 129(5), 770-814. https://doi.org/10.1037/0033-2909.129.5.770

Kotz, S., & Paulmann, S. (2007). When emotional prosody and semantics dance cheek to cheek: ERP evidence. Brain Research, 1151, 107-118. https://doi.org/10.1016/j.brainres.2007.03.015

Kousta, S., Vinson, D., & Vigliocco, G. (2009). Emotion words, regardless of polarity, have a processing advantage over neutral words. Cognition, 112(3), 473-481. https://doi.org/10.1016/j.cognition.2009.06.007

Kousta, S., Vigliocco, G., Vinson, D. P., Andrews, M., & Del Campo, E. (2011). The representation of abstract words: Why emotion matters. Journal of Experimental Psychology: General, 140(1), 14-34. https://doi.org/10.1037/a0021446

Lausen, A., & Hammerschmidt, K. (2020). Emotion recognition and confidence ratings predicted by vocal stimulus type and prosodic parameters. Humanities and Social Sciences Communications, 7(1). https://doi.org/10.1057/s41599-020-0499-z

Lima, C. F., & Castro, S. L. (2010). Recognizing emotions in spoken language: A validated set of Portuguese sentences and pseudosentences for research on emotional prosody. Behavior Research Methods, 42(1), 74-81.

Lima, C. F., Garrett, C., & Castro, S. (2013). Not all sounds sound the same: Parkinson’s disease affects differently emotion processing in music and in speech prosody. Journal of Clinical and Experimental Neuropsychology, 35(4), 373-392. https://doi.org/10.1080/13803395.2013.776518

Lin, Y., Ding, H., & Zhang, Y. (2020). Prosody dominates over semantics in emotion word processing: Evidence from cross-channel and cross-modal stroop effects. Journal of Speech, Language, and Hearing Research, 63(3), 896-912. https://doi.org/10.1044/2020_jslhr-19-00258

Mitchell, R., Elliott, R., Barry, M., Cruttenden, A., & Woodruff, P. (2003). The neural response to emotional prosody, as revealed by functional magnetic resonance imaging. Neuropsychologia, 41(10), 1410-1421. https://doi.org/10.1016/s0028-3932(03)00017-4

Montenegro, C. S., & Maravillas, E. A. (2015). Acoustic-prosodic recognition of emotion in speech. Paper presented at the 8th IEEE International Conference Humanoid, Nanotechnology, Information

Technology Communication and Control, Environment and Management (HNICEM). Cebu, Philippines.

https://doi.org/10.1109/HNICEM.2015.7393229

Paulmann, S. (2016). Neurocognition of prosody. In G. Hickok & S. L. Small (Eds.), Neurobiology of language (pp. 1109-120). Academic Press.

https://doi.org/10.1016/B978-0-12-407794-2.00088-2

Paulmann, S., & Kotz, S. (2008). Early emotional prosody perception based on different speaker voices. Neuroreport, 19(2), 209-213. https://doi.org/10.1097/wnr.0b013e3282f454db

Paulmann, S., & Pell, M. (2011). Is there an advantage for recognizing multi-modal emotional stimuli?. Motivation and Emotion, 35(2), 192-201.

https://doi.org/10.1007/s11031-011-9206-0

Peeters, G., Giordano, B., Susini, P., Misdariis, N., & McAdams, S. (2011). The timbre toolbox: Extracting audio descriptors from musical signals. The Journal of the Acoustical Society of America, 130(5), 2902-2916. https://doi.org/10.1121/1.3642604

Pell, M., & Kotz, S. (2011). On the time course of vocal emotion recognition. Plos ONE, 6(11), e27256.

https://doi.org/10.1371/journal.pone.0027256

Pell, M. D., & Skorup, V. (2008). Implicit processing of emotional prosody in a foreign versus native language. Speech Communication, 50(6), 519-530. https://doi.org/10.1016/j.specom.2008.03.006

Pinheiro, A., Rezaii, N., Nestor, P., Rauber, A., Spencer, K., & Niznikiewicz, M. (2016). Did you or I say pretty, rude or brief? An ERP study of the effects of speaker’s identity on emotional word processing. Brain and Language, 153-154, 38-49. https://doi.org/10.1016/j.bandl.2015.12.003

Piolat, A., & Bannour, R. (2009). EMOTAIX: Un scénario de tropes pour l’identification automatisée du lexique émotionnel et affectif. L’Année Psychologique, 109, 655-698. https://doi.org/10.4074/S0003503309004047

Preti, E., Suttora, C., & Richetin, J. (2015). Can you hear what I feel? A validated prosodic set of angry, happy, and neutral Italian pseudowords. Behavior Research Methods, 48(1), 259-271. https://doi.org/10.3758/s13428-015-0570-7

Schirmer, A., & Kotz, S. (2003). ERP evidence for a sex-specific stroop effect in emotional speech. Journal of Cognitive Neuroscience, 15(8), 1135-1148. https://doi.org/10.1162/089892903322598102

Schirmer, A., & Kotz, S. (2006). Beyond the right hemisphere: Brain mechanisms mediating vocal emotional processing. Trends in Cognitive Sciences, 10(1), 24-30. https://doi.org/10.1016/j.tics.2005.11.009

Soares, A., Comesaña, M., Pinheiro, A., Simões, A., & Frade, C. (2011). The adaptation of the Affective Norms for English Words (ANEW) for European Portuguese. Behavior Research Methods, 44(1), 256-269. https://doi.org/10.3758/s13428-011-0131-7

Soares, A., Costa, A., Machado, J., Comesaña, M., & Oliveira, H. (2016). The Minho Word Pool: Norms for imageability, concreteness, and subjective frequency for 3.800 Portuguese words. Behavior Research Methods, 49(3), 1065-1081. https://doi.org/10.3758/s13428-016-0767-4

Tursunov, A., Kwon, S., & Pang, H. (2019). Discriminating emotions in the valence dimension from speech using timbre features. Applied Sciences, 9(12), 2470. https://doi.org/10.3390/app9122470

Wright, A., Saxena, S., Sheppard, S., & Hillis, A. (2018). Selective impairments in components of affective prosody in neurologically impaired individuals. Brain and Cognition, 124, 29-36.

https://doi.org/10.1016/j.bandc.2018.04.00




DOI: https://doi.org/10.14417/ap.1936

Refbacks

  • There are currently no refbacks.


Nº ERC: 107494 | ISSN (in print): 0870-8231 | ISSN (online): 1646-6020 | Copyright © ISPA - CRL, 2012 | Rua Jardim do Tabaco, 34, 1149-041 Lisboa | NIF: 501313672 | The portal and metadata are licensed under the license Creative Commons CC BY-NC