Multisource sonification for visual substitution in an auditory memory game : one, or two fingers?

Gomez, Juan Diego (Computer Science Department, University of Geneva, Carouge, Switzerland) ; Bologna, Guido (Computer Science Department, University of Geneva, Carouge, Switzerland) ; Deville, Benoît (Computer Science Department, University of Geneva, Carouge, Switzerland) ; Pun, Thierry (Computer Science Department, University of Geneva, Carouge, Switzerland)

The See ColOr project aims at developing a mobility system for blind persons based on image color sonification. Within this project the present work addresses the optimal use of auditory-multi-touch interaction, and in particular the matter of the number of fingers needed for efficient exploration. To determine the actual significance of mono and multi-touch interaction onto the auditory feedback, a color matching memory game was implemented. Sounds of this game were generated by touching a tablet with one or two fingers. A group of 20 blindfolded users was tasked to find color matches into an image grid represented on the tablet by listening to their associated color-sound representation. Our results show that for an easy task aiming at matching few objects, the use of two fingers is moderately more efficient than the use of one finger. Whereas, against our intuition, this cannot be statistically confirmed in the case of similar tasks of increasing difficulty.


Note: BOLOGNA, Guido est un chercheur à la HES-SO, HEPIA, depuis 2011.


Keywords:
Conference Type:
full paper
Faculty:
Ingénierie et Architecture
School:
HEPIA - Genève
Institute:
inIT - Institut d'Ingénierie Informatique et des Télécommunications
Publisher:
Budapest, Hungary, 20-24 June 2011
Date:
2011-06
Budapest, Hungary
20-24 June 2011
Pagination:
8 p.
Published in:
Proceedings of the 17th International Conference on Auditory Display (ICAD-2011), 20-24 June 2011, Budapest, Hungary
Appears in Collection:



 Record created 2020-06-26, last modified 2020-07-17

Fulltext:
Download fulltext
PDF

Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)