In-time explainability in multi-agent systems : challenges, opportunities, and roadmap

Alzetta, Francesco (University of Trento, Italy) ; Giorgini, Paolo (University of Trento, Italy) ; Najjar, Amro (University of Luxembourg) ; Schumacher, Michael (University of Applied Sciences and Arts Western Switzerland (HES-SO Valais-Wallis)) ; Calvaresi, Davide (University of Applied Sciences and Arts Western Switzerland (HES-SO Valais-Wallis))

In the race for automation, distributed systems are required to perform increasingly complex reasoning to deal with dynamic tasks, often not controlled by humans. On the one hand, systems dealing with strict-timing constraints in safety-critical applications mainly focused on predictability, leaving little room for complex planning and decision-making processes. Indeed, real-time techniques are very efficient in predetermined, constrained, and controlled scenarios. Nevertheless, they lack the necessary flexibility to operate in evolving settings, where the software needs to adapt to the changes of the environment. On the other hand, Intelligent Systems (IS) increasingly adopted Machine Learning (ML) techniques (e.g., subsymbolic predictors such as Neural Networks). The seminal application of those IS started in zero-risk domains producing revolutionary results. However, the ever-increasing exploitation of ML-based approaches generated opaque systems, which are nowadays no longer socially acceptable—calling for eXplainable AI (XAI). Such a problem is exacerbated when IS tend to approach safety-critical scenarios. This paper highlights the need for on-time explainability. In particular, it proposes to embrace the Real-Time Beliefs Desires Intentions (RT-BDI) framework as an enabler of eXplainable Multi-Agent Systems (XMAS) in time-critical XAI.


Keywords:
Conference Type:
published full paper
Faculty:
Economie et Services
School:
HEG-VS
Institute:
Institut Informatique de gestion
Subject(s):
Informatique
Publisher:
Auckland, New Zealand,, 9-13 May 2020
Date:
2020-05
Auckland, New Zealand,
9-13 May 2020
Pagination:
Pp. 39-53
Published in:
Proceedings of the EXTRAAMAS: International Workshop on Explainable, Transparent Autonomous Agents and Multi-Agent Systems 2020
Series Statement:
Lecture Notes in Computer Science, vol. 12175
DOI:
ISBN:
978-3-030-51923-0
Appears in Collection:

Note: The status of this file is: restricted


 Record created 2020-11-18, last modified 2020-11-20

Fulltext:
Download fulltext
PDF

Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)