ESSV Konferenz Elektronische Sprachsignalverarbeitung

Title: Hesitation processing analysis using mouse-tracking and gamification

Authors: Simon Betz, Éva Székely, Sina Zarrieß, Marin Schröer, Leonie Schade, Petra Wagner


We present a new take on mouse-tracking to analyze online processing of speech. We expand current paradigms by embedding the task into a drag & drop game that awards a score as feedback for performance. The contribution of this paper is twofold: On the one hand, we describe the setup and design of a gamified graphical user interface to elicit data indicating online speech processing in general, on the other hand we provide preliminary results obtained in a smallscale pilot study concerned with the processing of hesitations in speech. Our results serve only to deduce first tendencies which may serve as hypotheses for subsequent analyses, but are sufficient as a proof of concept that our gamified mouse-tracking setup is suitable for studying the online processing of speech.

Year: 2020
In session: Paralinguistics
Pages: 85 to 92