DeepAI AI Chat
Log In Sign Up

Datamorphic Testing: A Methodology for Testing AI Applications

by   Hong Zhu, et al.

With the rapid growth of the applications of machine learning (ML) and other artificial intelligence (AI) techniques, adequate testing has become a necessity to ensure their quality. This paper identifies the characteristics of AI applications that distinguish them from traditional software, and analyses the main difficulties in applying existing testing methods. Based on this analysis, we propose a new method called datamorphic testing and illustrate the method with an example of testing face recognition applications. We also report an experiment with four real industrial application systems of face recognition to validate the proposed approach.


page 8

page 12

page 19

page 20

page 31

page 32

page 36

page 37


Adapting SQuaRE for Quality Assessment of Artificial Intelligence Systems

More and more software practitioners are tackling towards industrial app...

Measuring Bias in AI Models with Application to Face Biometrics: An Statistical Approach

The new regulatory framework proposal on Artificial Intelligence (AI) pu...

Challenge AI Mind: A Crowd System for Proactive AI Testing

Artificial Intelligence (AI) has burrowed into our lives in various aspe...

The AIQ Meta-Testbed: Pragmatically Bridging Academic AI Testing and Industrial Q Needs

AI solutions seem to appear in any and all application domains. As AI be...

Systematic Literature Review of Validation Methods for AI Systems

Context: Artificial intelligence (AI) has made its way into everyday act...

AI Tax: The Hidden Cost of AI Data Center Applications

Artificial intelligence and machine learning are experiencing widespread...

Four Principles of Explainable AI as Applied to Biometrics and Facial Forensic Algorithms

Traditionally, researchers in automatic face recognition and biometric t...