An augmented reality environment to provide visual feedback to amputees during sEMG Data Acquisitions

Palermo, Francesca (University of Applied Sciences and Arts Western Switzerland (HES-SO Valais-Wallis); Queen Mary University of London, UK) ; Cognolato, Matteo (Queen Mary University of London, UK; Swiss Federal Institute of Technology Zurich (ETH), Zurich, Switzerland) ; Eggel, Ivan (University of Applied Sciences and Arts Western Switzerland (HES-SO Valais-Wallis)) ; Atzori, Manfredo (University of Applied Sciences and Arts Western Switzerland (HES-SO Valais-Wallis)) ; Müller, Henning (University of Applied Sciences and Arts Western Switzerland (HES-SO Valais-Wallis))

Myoelectric hand prostheses have the potential to improve the quality of life of hand amputees. Still, the rejection rate of functional prostheses in the adult population is high. One of the causes is the long time for fitting the prosthesis and the lack of feedback during training. Moreover, prosthesis control is often unnatural and requires mental effort during the training. Virtual and augmented reality devices can help to improve these difficulties and reduce phantom limb pain. Amputees can start training the residual limb muscles with a weightless virtual hand earlier than possible with a real prosthesis. When activating the muscles related to a specific grasp, the subjects receive a visual feedback from the virtual hand. To the best of our knowledge, this work presents one of the first portable augmented reality environment for transradial amputees that combines two devices available on the market: the Microsoft HoloLens and the Thalmic labs Myo. In the augmented environment, rendered by the HoloLens, the user can control a virtual hand with surface electromyography. By using the virtual hand, the user can move objects in augmented reality and train to activate the right muscles for each movement through visual feedback. The environment presented represents a resource for rehabilitation and for scientists. It helps hand amputees to train using prosthetic hands right after the surgery. Scientists can use the environment to develop real time control experiments, without the logistical disadvantages related to dealing with a real prosthetic hand but with the advantages of a realistic visual feedback.


Keywords:
Faculty:
Economie et Services
School:
HEG-VS
Institute:
Institut Informatique de gestion
Subject(s):
Informatique
Publisher:
Cham, Springer
Date:
2019-07
Cham
Springer
Pagination:
12 p.
Published in:
Towards autonomous robotic systems : 20th annual conference, TAROS 2019, London, UK, July 3–5, 2019, Proceedings, Part II
Series Statement:
Lecture Notes in Computer Science book series, v. 11650
Author of the book:
Althoefer, Kaspar ; ed.
Konstantinova, Jelizaveta ; ed.
Zhang, Ketao ; ed.
DOI:
ISSN:
0302-9743
ISBN:
978-3-030-25331-8
Appears in Collection:

Note: The status of this file is: restricted


 Record created 2019-10-07, last modified 2019-10-14

Fulltext:
Download fulltext
PDF

Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)