Multimodal Classification: Current Landscape, Taxonomy and Future Directions

09/18/2021
by   William C. Sleeman IV, et al.
0

Multimodal classification research has been gaining popularity in many domains that collect more data from multiple sources including satellite imagery, biometrics, and medicine. However, the lack of consistent terminology and architectural descriptions makes it difficult to compare different existing solutions. We address these challenges by proposing a new taxonomy for describing such systems based on trends found in recent publications on multimodal classification. Many of the most difficult aspects of unimodal classification have not yet been fully addressed for multimodal datasets including big data, class imbalance, and instance level difficulty. We also provide a discussion of these challenges and future directions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/07/2022

Foundations and Recent Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions

Multimodal machine learning is a vibrant multi-disciplinary research fie...
research
07/29/2021

Multimodal Co-learning: Challenges, Applications with Datasets, Recent Advances and Future Directions

Multimodal deep learning systems which employ multiple modalities like t...
research
07/26/2023

Decoding ChatGPT: A Taxonomy of Existing Research, Current Challenges, and Possible Future Directions

Chat Generative Pre-trained Transformer (ChatGPT) has gained significant...
research
06/13/2022

Multimodal Learning with Transformers: A Survey

Transformer is a promising neural network learner, and has achieved grea...
research
07/24/2021

Imbalanced Big Data Oversampling: Taxonomy, Algorithms, Software, Guidelines and Future Directions

Learning from imbalanced data is among the most challenging areas in con...
research
07/26/2023

Sources of Opacity in Computer Systems: Towards a Comprehensive Taxonomy

Modern computer systems are ubiquitous in contemporary life yet many of ...

Please sign up or login with your details

Forgot password? Click here to reset