Progress in facial expression based affective speech translation

Abstract:

Speech-to-speech translation is an emerging field for applications in spoken language technology. Translation systems currently focus on the processing of linguistic content, without taking into account the significance of paralinguistic information conveyed by visual gestures in human face-to-face communication. In the project presented in this paper, we have implemented a speech-to-speech translation system which preserves information about the user’s affective state by transmitting it through the processing pipeline to the output component, which renders the translated content in the appropriate speaking style using expressive speech synthesis.


Year: 2013
In session: Prosodischer und multimodaler Ausdruck in der Mensch-Maschine Interaktion
Pages: 189 to 196