Overview of ImageCLEF 2018 : challenges, datasets and evaluation

Ionescu, Bogdan (University Politehnica of Bucharest, Romania) ; Müller, Henning (University of Applied Sciences and Arts Western Switzerland (HES-SO Valais-Wallis)) ; Villegas, Mauricio (omni:us, Berlin, Germany) ; García Seco de Herrera, Alba (University of Essex, Colchester, UK) ; Eickhoff, Carsten (Brown University, Providence RI, USA) ; Andrearczyk, Vincent (University of Applied Sciences and Arts Western Switzerland (HES-SO Valais-Wallis)) ; Dicente Cid, Yashin (University of Applied Sciences and Arts Western Switzerland (HES-SO Valais-Wallis)) ; Liauchuk, Vitali (United Institute of Informatics Problems, Minsk, Belarus) ; Kovalev, Vassili (United Institute of Informatics Problems, Minsk, Belarus) ; Hasan, Sadid A. (Artificial Intelligence Lab, Philips Research North America, Cambridge, MA, USA) ; Ling, Yuan (Artificial Intelligence Lab, Philips Research North America, Cambridge, MA, USA) ; Farri, Oladimeji (Artificial Intelligence Lab, Philips Research North America, Cambridge, MA, USA) ; Liu, Joey (Artificial Intelligence Lab, Philips Research North America, Cambridge, MA, USA) ; Lungren, Matthew (Department of Radiology, Stanford University, Stanford, CA, USA) ; Dang-Nguyen, Duc-Tien (Dublin City University, Dublin, Ireland) ; Piras, Luca (University of Cagliari & Pluribus One, Cagliari, Italy) ; Riegler, Michael (University of Oslo, Norway ; Simula Metropolitan Center for Digital Engineering, Oslo, Norway) ; Zhou, Liting (Dublin City University, Dublin, Ireland) ; Lux, Mathias (Klagenfurt University, Klagenfurt, Austria) ; Gurrin, Cathal (Dublin City University, Dublin, Ireland)

Abstract. This paper presents an overview of the ImageCLEF 2018 evaluation campaign, an event that was organized as part of the CLEF (Conference and Labs of the Evaluation Forum) Labs 2018. ImageCLEF is an ongoing initiative (it started in 2003) that promotes the evalua-tion of technologies for annotation, indexing and retrieval with the aim of providing information access to collections of images in various us-age scenarios and domains. In 2018, the 16th edition of ImageCLEF ran three main tasks and a pilot task: 1) a caption prediction task that aims at predicting the caption of a figure from the biomedical literature based only on the figure image; 2) a tuberculosis task that aims at detecting the tuberculosis type, severity and drug resistance from CT (Computed Tomography) volumes of the lung; 3) a LifeLog task (videos, images and other sources) about daily activities understanding and moment re-trieval, and 4) a pilot task on visual question answering where systems are tasked with answering medical questions. The strong participation, with over 100 research groups registering and 31 submitting results for the tasks, shows an increasing interest in this benchmarking campaign.


Faculty:
Economie et Services
School:
HEG-VS
Institute:
Institut Informatique de gestion
Subject(s):
Informatique
Publisher:
Cham, Springer
Date:
2018-09
Cham
Springer
Pagination:
Pp. 309-334
Published in:
Experimental IR meets multilinguality, multimodality, and interaction : 9th International Conference of the CLEF Association, CLEF 2018, Avignon, France, September 10-14, 2018, Proceedings
Author of the book:
Bellot, P. ; (ed.)
Appears in Collection:

Note: The status of this file is: restricted


 Record created 2018-10-30, last modified 2018-12-20

Fulltext:
Download fulltext
PDF

Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)