Report on the cloud-based evaluation approaches workshop 2015

Müller, Henning (University of Applied Sciences and Arts Western Switzerland (HES-SO Valais-Wallis)) ; et al.

Data analysis requires new approaches in many domains for evaluating tools and techniques, particularly when the data sets grow large and more complex. Evaluation–as–a– service (EaaS) was coined as a term to represent evaluation approaches based on APIs, virtual machines or source code submission, different from the common paradigm of evaluating techniques on a distributed test collection, tasks and submitted results files. Such new approaches become necessary when data sets become extremely large, contain confidential information or might change quickly over time. The workshop on cloud–based evaluation (CBE) took place in Boston, MA, USA on November 5, 2015 and explored several approaches for data analysis evaluation and frameworks in this field. The objective was to include several stakeholders from academic partners, companies to funding agencies to cover various interests and viewpoints in the discussion of evaluation infrastructures. The workshop focused on the biomedical domain but the results are easily applicable to many domains of information analysis and retrieval.

Type de conférence:
full paper
HEG VS HES-SO Valais-Wallis - Haute Ecole de Gestion & Tourisme
Institut Informatique de gestion
Adresse bibliogr.:
Pisa, Italy, 17-21 July 2016
Pisa, Italy
17-21 July 2016
7 p.
Titre du document hôte:
Proceedings of the ACM Special Interest Group on Information Retrievel (SIGIR) Forum 2016
Numérotation (vol. no.):
June 2016, vol. 50, no. 1, pp. 35-41
Ressource(s) externe(s):
Le document apparaît dans:

 Notice créée le 2016-10-01, modifiée le 2017-12-07

Télécharger le document

Évaluer ce document:

Rate this document:
(Pas encore évalué)