Safety design concepts for statistical machine learning components toward accordance with functional safety standards

08/04/2020
by   Akihisa Morikawa, et al.
0

In recent years, curial incidents and accidents have been reported due to un-intended control caused by misjudgment of statistical machine learning (SML), which include deep learning. The international functional safety standards for Electric/Electronic/Programmable (E/E/P) systems have been widely spread to improve safety. However, most of them do not recom-mended to use SML in safety critical systems so far. In practical the new concepts and methods are urgently required to enable SML to be safely used in safety critical systems. In this paper, we organize five kinds of technical safety concepts (TSCs) for SML components toward accordance with functional safety standards. We discuss not only quantitative evaluation criteria, but also development process based on XAI (eXplainable Artificial Intelligence) and Automotive SPICE to improve explainability and reliability in development phase. Fi-nally, we briefly compare the TSCs in cost and difficulty, and expect to en-courage further discussion in many communities and domain.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/04/2021

Towards the adoption of model-based engineering for the development of safety-critical systems in industrial practice

Model-based engineering promises to boost productivity and quality of co...
research
07/11/2022

From Correlation to Causation: Formalizing Interpretable Machine Learning as a Statistical Process

Explainable AI (XAI) is a necessity in safety-critical systems such as i...
research
03/26/2018

Design Assurance Evaluation of Microcontrollers for safety critical Avionics

Dealing with Commercial off-the-shelf (COTS) com- ponents is a daily bus...
research
09/06/2022

An Optimized and Safety-aware Maintenance Framework: A Case Study on Aircraft Engine

The COVID-19 pandemic has recently exacerbated the fierce competition in...
research
12/07/2018

Open Problems in Engineering and Quality Assurance of Safety Critical Machine Learning Systems

Fatal accidents are a major issue hindering the wide acceptance of safet...
research
01/16/2016

Engineering Safety in Machine Learning

Machine learning algorithms are increasingly influencing our decisions a...

Please sign up or login with your details

Forgot password? Click here to reset