Metalogue – Multiperspective Multimodal Dialogue


In this talk, I’ll present the EU FP7 project Metalogue – Multiperspective Multimodal Dialogue. Metalogue brings together three research communities, 1. Cognitive Models & Theory of Mind; 2. Multimodal & Multiparty HCI; 3. Technology-Enhance Learning in order to research, develop and evaluate tools that allow citizens to improve their metacognitive skills. The foundation of the project’s prototypes is the large corpus collection and annotation (available via LDC in Q1/2017). In addition to the R&D methodology, the talk will particularly present the project’s multimodal system and their components, including a KALDI-based ASR, a robust semantic interpreter, dialogue management and, finally the metacognitive engine. In addition to the evaluation results several tools will be presented and additionally demonstrated at the conference.

Year: 2017
In session: Hauptvortrag
Pages: 227 to 227