Effect of the named entity recognition and sliding window on the HONcode automated detection of HONcode criteria for mass health online content

Boyer, Celia ( Health On the Net Foundation, Switzerland) ; Dolamic, Ljiljana ( Health On the Net Foundation, Switzerland) ; Ruch, Patrick ( Haute école de gestion de Genève, HES-SO // Haute Ecole Spécialisée de Suisse Occidentale) ; Falquet, Gilles ( University of Geneva, Switzerland)

The Health On the Net’s Foundation (HON) Code of Conduct, HONcode, is the oldest and the most used ethical and trustworthy code for medical and health related information available on the Internet. Until recently, websites voluntarily applying for the HONcode seal were evaluated manually by an expert medical team according to 8 principles, referred to as criteria, and associated published guidelines. In the scope of the European project Kconnect, HON is developing an automated system to identify the 8 HONcode criteria within health webpages. When the research on the development of such a system evolved from simple algorithmic testing to a real full-content setting, it revealed a number of issues. The preceding study consisted in taking a set of 27 health-related websites and having them assessed for their compliance to each of the 8 HONcode criterion, first manually by senior HONcode experts, and then through supervised machine learning by the automated system. The results showed disc repancies mainly for two criteria: “submerged content” under the Complementarity criterion and “extremely low recall” under the Date Attribution criterion. In this article, the authors investigate different approaches to solve the problems related to each of these criteria, namely a customized Named Entity Recognition Model instead of a machine learning component for Date Attribution, and a sliding window instead of the whole document as a unit of detection for Complementarity. The results obtained show that the newly adapted automated system greatly improves accuracy: 74% vs. 41% for the Date Attribution criterion and 74% vs. 22% for the Complementarity criterion.


Mots-clés:
Type de conférence:
full paper
Faculté:
Economie et Services
Ecole:
HEG GE Haute école de gestion de Genève
Institut:
CRAG - Centre de Recherche Appliquée en Gestion
Classification:
Sciences de l’information
Adresse bibliogr.:
Rome, Italy , 21-23 February 2016
Date:
Rome, Italy
21-23 February 2016
2016
Pagination:
8 p.
Titre du document hôte:
Proceedings of the 9th International Joint Conference on Biomedical Engineering Systems and Technologies
Numérotation (vol. no.):
2016
DOI:
Ressource(s) externe(s):
Le document apparaît dans:



 Notice créée le 2016-11-24, modifiée le 2018-04-09

Fichiers:
Télécharger le document
PDF

Évaluer ce document:

Rate this document:
1
2
3
 
(Pas encore évalué)