000001724 001__ 1724
000001724 005__ 20190611210128.0
000001724 0247_ $$2DOI$$a10.1145/2964797.2964804
000001724 037__ $$aCONFERENCE
000001724 041__ $$aeng
000001724 245__ $$aReport on the cloud-based evaluation approaches workshop 2015
000001724 260__ $$c2016$$b17-21 July 2016$$aPisa, Italy
000001724 269__ $$a2016-06
000001724 300__ $$a7 p.
000001724 506__ $$avisible
000001724 520__ $$aData analysis requires new approaches in many domains for evaluating tools and techniques, particularly when the data sets grow large and more complex. Evaluation–as–a– service (EaaS) was coined as a term to represent evaluation approaches based on APIs, virtual machines or source code submission, different from the common paradigm of evaluating techniques on a distributed test collection, tasks and submitted results files. Such new approaches become necessary when data sets become extremely large, contain confidential information or might change quickly over time. The workshop on cloud–based evaluation (CBE) took place in Boston, MA, USA on November 5, 2015 and explored several approaches for data analysis evaluation and frameworks in this field. The objective was to include several stakeholders from academic partners, companies to funding agencies to cover various interests and viewpoints in the discussion of evaluation infrastructures. The workshop focused on the biomedical domain but the results are easily applicable to many domains of information analysis and retrieval.$$9eng
000001724 592__ $$aHEG-VS
000001724 592__ $$bInstitut Informatique de gestion
000001724 592__ $$cEconomie et Services
000001724 65017 $$aInformatique
000001724 655_7 $$afull paper
000001724 700__ $$aMüller, Henning$$uUniversity of Applied Sciences and Arts Western Switzerland (HES-SO Valais-Wallis)
000001724 700__ $$aet al.
000001724 711__ $$d17/07/2016 / 21/07/2016$$cPisa, Italy$$aACM Special Interest Group on Information Retrievel (SIGIR) Forum 2016
000001724 773__ $$tProceedings of the  ACM Special Interest Group on Information Retrievel (SIGIR) Forum 2016$$gJune 2016, vol. 50, no. 1, pp. 35-41
000001724 8564_ $$uhttps://hesso.tind.io/record/1724/files/muller_reportonthecloudbased_2016.pdf$$s485414
000001724 85641 $$zOnline version$$uhttp://sigir.org/files/forum/2016J/p035.pdf
000001724 909CO $$pDOMAINE_ECONOMIESERVICE_CONFERENCE$$pECONOMIESERVICES_CONFERENCE$$pGLOBAL_SET$$ooai:hesso.tind.io:1724
000001724 906__ $$aGREEN
000001724 950__ $$aI1
000001724 980__ $$aconference