Mental rotation of digitally-rendered haptic objects

Tivadar, Ruxandra I. (The Laboratory for Investigative Neurophysiology (LINE), Swizerland) ; Rouillard, Tom (Hap2u, Saint-Martin-d’Hères, France) ; Chappaz, Cédrick (Hap2u, Saint-Martin-d’Hères) ; Knebel, Jean-François (The Laboratory for investigative neurophysiology (LINE), Switzerland; Electroencephalography Brain Mapping Core, Switzerland) ; Turoman, Nora (The Laboratory for Investigative Neurophysiology (LINE), Switzerland) ; Anaflous, Fatima (Department of Ophthalmology, Fondation Asile des Aveugles, Lausanne, Switzerland) ; Roche, Jean (Department of Ophthalmology, Fondation Asile des Aveugles, Lausanne, Switzerland) ; Matusz, Pawel J. (University of Applied Sciences and Arts Western Switzerland (HES-SO Valais-Wallis)) ; Murray, Micah M. (The Laboratory for Investigative Neurophysiology (LINE), Switzerland)

Sensory substitution is an effective means to rehabilitate many visual functions after visual impairment or blindness. Tactile information, for example, is particularly useful for functions such as reading, mental rotation, shape recognition, or exploration of space. Extant haptic technologies typically rely on real physical objects or pneumatically driven renderings and thus provide a limited library of stimuli to users. New developments in digital haptic technologies now make it possible to actively simulate an unprecedented range of tactile sensations. We provide a proof-of-concept for a new type of technology (hereafter haptic tablet) that renders haptic feedback by modulating the friction of a flat screen through ultrasonic vibrations of varying shapes to create the sensation of texture when the screen is actively explored. We reasoned that participants should be able to create mental representations of letters presented in normal and mirror-reversed haptic form without the use of any visual information and to manipulate such representations in a mental rotation task. Healthy sighted, blindfolded volunteers were trained to discriminate between two letters (either L and P, or F and G; counterbalanced across participants) on a haptic tablet. They then tactually explored all four letters in normal or mirror-reversed form at different rotations (0°, 90°, 180°, and 270°) and indicated letter form (i.e., normal or mirror-reversed) by pressing one of two mouse buttons. We observed the typical effect of rotation angle on object discrimination performance (i.e., greater deviation from 0° resulted in worse performance) for trained letters, consistent with mental rotation of these haptically-rendered objects. We likewise observed generally slower and less accurate performance with mirror-reversed compared to prototypically oriented stimuli. Our findings extend existing research in multisensory object recognition by indicating that a new technology simulating active haptic feedback can support the generation and spatial manipulation of mental representations of objects. Thus, such haptic tablets can offer a new avenue to mitigate visual impairments and train skills dependent on mental object-based representations and their spatial manipulation.

Article Type:
Economie et Services
Institut Informatique de gestion
9 p.
Published in:
Frontiers in integrative neuroscience
Numeration (vol. no.):
March 2019, vol.13
Appears in Collection:

 Record created 2019-10-24, last modified 2020-10-27

Download fulltext

Rate this document:

Rate this document:
(Not yet reviewed)