Optimizing the AI Development Process by Providing the Best Support Environment

04/29/2023
by   Taha Khamis, et al.
0

The purpose of this study is to investigate the development process for Artificial inelegance (AI) and machine learning (ML) applications in order to provide the best support environment. The main stages of ML are problem understanding, data management, model building, model deployment and maintenance. This project focuses on investigating the data management stage of ML development and its obstacles as it is the most important stage of machine learning development because the accuracy of the end model is relying on the kind of data fed into the model. The biggest obstacle found on this stage was the lack of sufficient data for model learning, especially in the fields where data is confidential. This project aimed to build and develop a framework for researchers and developers that can help solve the lack of sufficient data during data management stage. The framework utilizes several data augmentation techniques that can be used to generate new data from the original dataset which can improve the overall performance of the ML applications by increasing the quantity and quality of available data to feed the model with the best possible data. The framework was built using python language to perform data augmentation using deep learning advancements.

READ FULL TEXT

page 27

page 28

page 29

page 39

research
08/31/2021

Towards Observability for Machine Learning Pipelines

Software organizations are increasingly incorporating machine learning (...
research
01/28/2021

Machine learning for cloud resources management – An overview

Nowadays, an important topic that is considered a lot is how to integrat...
research
10/11/2019

Orchestrating Development Lifecycle of Machine Learning Based IoT Applications: A Survey

Machine Learning (ML) and Internet of Things (IoT) are complementary adv...
research
03/11/2020

Towards CRISP-ML(Q): A Machine Learning Process Model with Quality Assurance Methodology

We propose a process model for the development of machine learning appli...
research
08/21/2022

Performance, Opaqueness, Consequences, and Assumptions: Simple questions for responsible planning of machine learning solutions

The data revolution has generated a huge demand for data-driven solution...
research
04/17/2023

Memento: Facilitating Effortless, Efficient, and Reliable ML Experiments

Running complex sets of machine learning experiments is challenging and ...
research
12/16/2022

Azimuth: Systematic Error Analysis for Text Classification

We present Azimuth, an open-source and easy-to-use tool to perform error...

Please sign up or login with your details

Forgot password? Click here to reset