The IR task at the CLEF eHealth evaluation lab 2016: : user-centred health information retrieval

Müller, Henning (University of Applied Sciences and Arts Western Switzerland (HES-SO Valais-Wallis)) ; et al.

This paper details the collection, systems and evaluation methods used in the IR Task of the CLEF 2016 eHealth Evaluation Lab. This task investigates the e↵ectiveness of web search engines in providing access to medical information for common people that have no or little medical knowledge. The task aims to foster advances in the development of search technologies for consumer health search by providing resources and evaluation methods to test and validate search systems. The problem considered in this year’s task was to retrieve web pages to support the information needs of health consumers that are faced by a medical condition and that want to seek relevant health information online through a search engine. As part of the evaluation exercise, we gathered 300 queries users posed with respect to 50 search task scenarios. The scenarios were developed from real cases of people seeking health information through posting requests of help on a web forum. The presence of query variations for a single scenario helped us capturing the variable quality at which queries are posed. Queries were created in English and then translated into other languages. A total of 49 runs by 10 di↵erent teams were submitted for the English query topics; 2 teams submitted 29 runs for the multilingual topics.


Mots-clés:
Type de conférence:
full paper
Faculté:
Economie et Services
Ecole:
HEG VS HES-SO Valais-Wallis - Haute Ecole de Gestion & Tourisme
Institut:
Institut Informatique de gestion
Classification:
Informatique
Adresse bibliogr.:
Evora, Portugal, 5-8 September 2016
Date:
Evora, Portugal
5-8 September 2016
2016
Pagination:
13 p.
Titre du document hôte:
Proceedings of the 7th International Conference of CLEF Association (CLEF) 2016
Ressource(s) externe(s):
Le document apparaît dans:



 Notice créée le 2016-09-28, modifiée le 2018-02-15

Fichiers:
Télécharger le document
PDF

Évaluer ce document:

Rate this document:
1
2
3
 
(Pas encore évalué)