Technology Readiness Levels for Machine Learning Systems

06/21/2020
by   Alexander Lavin, et al.
0

The development and deployment of machine learning systems can be executed easily with modern tools, but the process is typically rushed and means-to-an-end. The lack of diligence can lead to technical debt, scope creep and misaligned objectives, model misuse and failures, and expensive consequences. Engineering systems, on the other hand, follow well-defined processes and testing standards to streamline development for high-quality, reliable results. The extreme is spacecraft systems, where mission critical measures and robustness are ingrained in the development process. Drawing on experience in both spacecraft engineering and AI/ML (from research through product), we propose a proven systems engineering approach for machine learning development and deployment. Our Technology Readiness Levels for ML (TRL4ML) framework defines a principled process to ensure robust systems while being streamlined for ML research and product, including key distinctions from traditional software engineering. Even more, TRL4ML defines a common language for people across the organization to work collaboratively on ML technologies.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/15/2021

Machine Learning Model Development from a Software Engineering Perspective: A Systematic Literature Review

Data scientists often develop machine learning models to solve a variety...
research
02/19/2021

Mutation Testing framework for Machine Learning

This is an article or technical note which is intended to provides an in...
research
03/29/2022

Achieving Guidance in Applied Machine Learning through Software Engineering Techniques

Development of machine learning (ML) applications is hard. Producing suc...
research
07/01/2018

Machine learning 2.0 : Engineering Data Driven AI Products

ML 2.0: In this paper, we propose a paradigm shift from the current prac...
research
12/05/2022

Continual learning on deployment pipelines for Machine Learning Systems

Following the development of digitization, a growing number of large Ori...
research
10/16/2020

On Automatic Feasibility Study for Machine Learning Application Development with ease.ml/snoopy

In our experience working with domain experts who are using today's Auto...
research
05/08/2021

Chameleon: A Semi-AutoML framework targeting quick and scalable development and deployment of production-ready ML systems for SMEs

Developing, scaling, and deploying modern Machine Learning solutions rem...

Please sign up or login with your details

Forgot password? Click here to reset