Coordination model with reinforcement learning for ensuring reliable on-demand services in collective adaptive systems

Ben Mahfoudh, Houssem (University of Geneva, Geneva, Switzerland ; School of Engineering, Architecture and Landscape (hepia), HES-SO // University of Applied Sciences Western Switzerland) ; Di Marzo Serugendo, Giovanna (University of Geneva, Geneva, Switzerland) ; Boulmier, Anthony (University of Geneva, Geneva, Switzerland ; School of Engineering, Architecture and Landscape (hepia), HES-SO // University of Applied Sciences Western Switzerland) ; Abdennadher, Nabil (School of Engineering, Architecture and Landscape (hepia), HES-SO // University of Applied Sciences Western Switzerland)

Context-aware and pervasive systems are growing in the market segments. This is due to the expansion of Internet of things (IoT) devices. Current solutions rely on centralized services provided by servers gathering all requests and performing pre-defined computations involving pre-defined devices. Large-scale IoT scenarios, involving adaptation and unanticipated devices, call for alternative solutions. We propose here a new type of services, built and composed on-demand, arising from the interaction of multiple sensors and devices working together as a decentralized collective adaptive system. Our solution relies on a bio-inspired coordination model providing a communication platform among multi-agent systems working on behalf of these devices. Each device provides few simple services and data regarding its environment. On-demand services derive from the collective interactions among multiple sensors and devices. In this article, we investigate the design and implementation of such services and define a new approach that combines coordination model and reinforcement learning, in order to ensure reliable services and expected quality of services (QoS), namely convergence of composition, of coherent result and convergence of learning. We present an IoT scenario showing the feasibility of the approach and preliminary results.


Keywords:
Conference Type:
full paper
Faculty:
Ingénierie et Architecture
School:
HEPIA - Genève
Institute:
inIT - Institut d'Ingénierie Informatique et des Télécommunications
Publisher:
Limassol, Cyprus, 5-9 November 2018
Date:
2018-10
Limassol, Cyprus
5-9 November 2018
Pagination:
pp. 257-273
Published in:
Lecture Notes in Computer Science ; Proceedings of International Symposium on Leveraging Applications of Formal Methods (ISoLA 2018), 5-9 November 2018, Limassol, Cyprus
Series Statement:
Lecture notes in computer science (LNCS), vol. 11246
DOI:
ISSN:
0302-9743
ISBN:
978-3-030-03423-8
Appears in Collection:



 Record created 2020-08-25, last modified 2020-10-27


Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)