Multimodal Information Processing: The Ticket Purchase – a Demonstration Scenario of the SFB/TRR-62

Authors: Ingo Siegert, Stephan Reuter, Felix Schüssel, Georg Layher, Thilo Hörnle, Sascha Meudt, Andreas Wendemuth

Abstract:

The demonstration scenario of the SFB/TRR-62 shows multimodal, dynamic interactions between a human being and a technical system that are adaptive to the situation and the emotional state. It uses the example of purchasing a train ticket to demonstrate how a companion system is able to adapt its dialog with the user according to the situational context and the emotions of the user. One special feature of this scenario are the simultaneous analyses and evaluations of explicit and implicit input data. The scenario demonstrates further how background knowledge about the user can be included; for example often visited destinations, the user’s timetable or the number of travelers.