Spatial awareness and intelligibility for the blind : audio-touch interfaces

Gomez, Juan Diego (University of Geneva, Geneva, Switzerland) ; Bologna, Guido (University of Geneva, Geneva, Switzerland) ; Pun, Thierry (University of Geneva, Geneva, Switzerland)

Many people with visual disabilities mainly use audio feedback as a primary modality for interaction. Representing the visual environment with appropriate sounds contributes to make it intelligible to the blind. This audio-encoded environment still needs to be accessed in the same way as sighted people scan visual contents with their gaze. A finger-based scanning could be seen as a gaze-like strategy for those with visual impairments to be able of sensing an audio-represented context. We present in this work a computational interface that meets both, the visual-audio codification and the multi-touch interaction, so as to enlarge legibility of the environment for the blind and to facilitate navigating to desired locations, exploration, and serendipitous discovery. The core of this interface is the color and depth codification into musical instruments sounds, which effectively provides spatial awareness, audio revealing of boundaries and obstacles detection. The main contribution of our work is the assistance provided by this interface toward an active interaction of the user with his fingers that makes it possible to selectively explore, to discover points of interest, develop personalized strategies for navigating, and, in general, enjoy a greater sense of independence.


Note: BOLOGNA, Guido est chercheur à la HES-SO, HEPIA, depuis 2011.


Keywords:
Conference Type:
full paper
Faculty:
Ingénierie et Architecture
School:
HEPIA - Genève
Institute:
inIT - Institut d'Ingénierie Informatique et des Télécommunications
Publisher:
Austin, Texas, USA, 5-10 May 2012
Date:
2012-05
Austin, Texas, USA
5-10 May 2012
Pagination:
6 p.
Published in:
Proceedings of CHIA EA'12, CHI'12, ACM SIGCHI Conference on Human Factors in Computing Systems, 5-10 May 2011, Austin, Texas, USA
DOI:
ISBN:
9781450310161
Appears in Collection:

Note: The status of this file is: restricted


 Record created 2020-06-26, last modified 2020-07-17

Fulltext:
Download fulltext
PDF

Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)