An event-based architecture to manage virtual human non-verbal communication in 3D chatting environment

Gobron, Stéphane (School of Engineering – HE-Arc Ingénierie, HES-SO // University of Applied Sciences Western Switzerland ; Immersive Interaction Group, EPFL, Lausanne, Switzerland) ; Ahn, Junghyun (Immersive Interaction Group, EPFL, Lausanne, Switzerland) ; Garcia, David (Chair of Systems Design, ETHZ, Zurich, Switzerland) ; Silvestre, Quentin (Immersive Interaction Group, EPFL, Lausanne, Switzerland) ; Thalmann, Daniel (Immersive Interaction Group, EPFL, Lausanne, Switzerland ; Instiute for Media Innovation, NTU, Singapore) ; Boulic, Ronan (Immersive Interaction Group, EPFL, Lausanne, Switzerland)

Non-verbal communication (NVC) makes up about two-thirds of all communication between two people or between one speaker and a group of listeners. However, this fundamental aspect of communicating is mostly omitted in 3D social forums or virtual world oriented games. This paper proposes an answer by presenting a multi-user 3D-chatting system enriched with NVC relative to motion. This event-based architecture tries to recreate a context by extracting emotional cues from dialogs and derives virtual human potential body expressions from that event triggered context model. We structure the paper by expounding the system architecture enabling the modeling NVC in a multi-user 3D-chatting environment. There, we present the transition from dialog-based emotional cues to body language, and the management of NVC events in the context of a virtual reality client-server system. Finally, we illustrate the results with graphical scenes and a statistical analysis representing the increase of events due to NVC.


Keywords:
Faculty:
Ingénierie et Architecture
School:
HE-Arc Ingénierie
Institute:
Aucun institut
Subject(s):
Ingénierie
Publisher:
Berlin, Heidelberg, Springer
Date:
2012-06
Berlin, Heidelberg
Springer
Pagination:
11 p.
Published in:
Lecture Notes in Computer Science
Author of the book:
Perales, F.J. ; editor
Fischer, R.B. ; editor
Moeslund, T.B. ; editor
DOI:
ISSN:
0302-9743
ISBN:
978-3-642-31566-4
Appears in Collection:



 Record created 2019-05-21, last modified 2019-06-11


Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)