Holographic visualisation and interaction of fused CT, PET and MRI volumetric medical imaging data using dedicated remote GPGPU ray casting

Fröhlich, Magali (School of Engineering – HE-Arc Ingénierie, HES-SO // University of Applied Sciences Western Switzerland) ; Bolinhas, Christophe (School of Engineering – HE-Arc Ingénierie, HES-SO // University of Applied Sciences Western Switzerland) ; Depeursinge, Adrien (University of Applied Sciences and Arts Western Switzerland (HES-SO Valais-Wallis) ; Biomedical Imaging Group (BIG), Ecole polytechnique fédérale de Lausanne (EPFL), Switzerland) ; Widmer, Antoine (University of Applied Sciences and Arts Western Switzerland (HES-SO Valais-Wallis)) ; Chevrey, Nicolas (School of Health – HE-Arc Santé, HES-SO // University of Applied Sciences Western Switzerland) ; Hagmann, Patric (Departement of Radiology Lausanne University Hospital (CHUV-UNIL), Lausanne, Switzerland) ; Simon, Christian (Departement of Otolaryngology Head and Neck Surgery, CHUV, Lausanne, Switzerland) ; Kokje, Vivianne (Departement of Otolaryngology Head and Neck Surgery, CHUV, Lausanne, Switzerland) ; Gobron, Stéphane (School of Engineering – HE-Arc Ingénierie, HES-SO // University of Applied Sciences Western Switzerland)

Medical experts commonly use imaging including Computed Tomography (CT), Positron-Emission Tomography (PET) and Magnetic Resonance Imaging (MRI) for diagnosis or to plan a surgery. These scans give a highly detailed representation of the patient anatomy, but the usual Three-Dimensional (3D) separate visualisations on screens does not provide an convenient and performant understanding of the real anatom-ical complexity. This paper presents a computer architecture allowing medical staff to visualise and interact in real-time holographic fused CT, PET, MRI of patients. A dedicated workstation with a wireless connec-tion enables real-time General-Purpose Processing on Graphics Process-ing Units (GPGPU) ray casting computation through the mixed reality (MR) headset. The hologram can be manipulated with hand gestures and voice commands through the following interaction features: instan-taneous visualisation and manipulation of 3D scans with a frame rate of 30 fps and a delay lower than 120 ms. These performances give a seamless interactive experience for the user.


Keywords:
Conference Type:
full paper
Faculty:
Economie et Services
Ingénierie et Architecture
Santé
School:
HE-Arc Ingénierie
HE-Arc Santé
HEG-VS
Institute:
Institut Informatique de gestion
Subject(s):
Informatique
Ingénierie
Santé
Publisher:
Granada, Spain, 16-20 September 2018
Date:
2018-09
Granada, Spain
16-20 September 2018
Pagination:
8 p.
Published in:
Proceedings of the 21st international Conference on MICCAI 2018
Appears in Collection:

Note: The status of this file is: restricted


 Record created 2018-11-16, last modified 2019-06-11

Fulltext:
Download fulltext
PDF

Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)