A two-step rule-extraction technique for a CNN

Bologna, Guido (School of Engineering, Architecture and Landscape (hepia), HES-SO // University of Applied Sciences Western Switzerland ; University of Geneva, Geneva, Switzerland) ; Fossati, Silvio (Geneva, Switzerland)

The explanation of the decisions provided by a model are crucial in a domain such as medical diagnosis. With the advent of deep learning, it is very important to explain why a classification is reached by a model. This work tackles the transparency problem of convolutional neural networks(CNNs). We propose to generate propositional rules from CNNs, because they are intuitive to the way humans reason. Our method considers that a CNN is the union of two subnetworks: a multi-layer erceptron (MLP) in the fully connected layers; and a subnetwork including several 2D convolutional layers and max-pooling layers. Rule extraction exhibits two main steps, with each step generating rules from each subnetwork of the CNN. In practice, we approximate the two subnetworks by two particular MLP models that makes it possible to generate propositional rules. We performed the experiments with two datasets involving images: MNISTdigit recognition; and skin-cancer diagnosis. With high fidelity, the extracted rules designated the location of discriminant pixels, as well as the conditions that had to be met to achieve the classification. We illustrated several examples of rules by their centroids and their discriminant pixels.


Keywords:
Article Type:
scientifique
Faculty:
Ingénierie et Architecture
School:
HEPIA - Genève
Institute:
inIT - Institut d'Ingénierie Informatique et des Télécommunications
Date:
2020-06
Pagination:
21 p.
Published in:
Electronics
Numeration (vol. no.):
2020, vol. 9, no. 6, article no. 990
DOI:
ISSN:
2079-9292
Appears in Collection:



 Record created 2021-05-04, last modified 2021-05-07

Fulltext:
Download fulltext
PDF

Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)