Multimodal conversational agent for older adults' behavioral change

El Kamali, Mira (School of Engineering and Architecture (HEIA-FR), HES-SO // University of Applied Sciences Western Switzerland) ; Angelini, Leonardo (School of Engineering and Architecture (HEIA-FR), HES-SO // University of Applied Sciences Western Switzerland) ; Lalanne, Denis (University of Fribourg, Fribourg, Switzerland) ; Abou Khaled, Omar (School of Engineering and Architecture (HEIA-FR), HES-SO // University of Applied Sciences Western Switzerland) ; Mugellini, Elena (School of Engineering and Architecture (HEIA-FR), HES-SO // University of Applied Sciences Western Switzerland)

Recently, research in the multimodal interaction area has shown a rapid development and users have been embracing their experience of multimodal technologies. In fact, having a multimodal system means allowing the user to choose one or more communication channel to access the system. While, on the contrary, unimodal systems do not have this option and can only settle to one-way of communication. Particularly, conversational agents are also in rapid increment and older adults are becoming more and more exposed to such agents. NESTORE is a virtual coach that aims to follow older adults in their wellbeing journey. It comes in two forms of interfaces: (i) a chatbot which is a text-based messaging application and (ii) a tangible coach which is a vocal assistant. This virtual coach is multimodal, due to the fact that it can depict or send information and even receive the user’s input through two different interfaces which are the chatbot and the tangible coach. Our aim is then to explore the modality that the user prefers in terms of user experience. We experimented with older adults five different types of scenarios where the virtual coach was interacting with a user through different modalities, used individually or combined. The virtual coach was asking a set of questions derived from a behavioral change model called HAPA. We measured the perceived user experience for each scenario with the UEQ-S questionnaire, and asked to rank the scenarios according to the users’ preferences.


Keywords:
Conference Type:
published full paper
Faculty:
Ingénierie et Architecture
School:
HEIA-FR
Institute:
HumanTech - Technology for Human Wellbeing Institute
Publisher:
The Netherlands, 25-29 October 2020
Date:
2020-10
The Netherlands
25-29 October 2020
Pagination:
5 p.
Published in:
Proceedings of ICMI '20 Companion : International Conference on Multimodal Interaction, 25-29 October 2020, Virtual event, Netherlands
DOI:
ISBN:
9781450380027
Appears in Collection:

Note: The status of this file is: restricted


 Record created 2021-01-19, last modified 2021-01-20

Fulltext:
Download fulltext
PDF

Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)