Generative AI for Medical Imaging: extending the MONAI Framework

by   Walter H. L Pinaya, et al.

Recent advances in generative AI have brought incredible breakthroughs in several areas, including medical imaging. These generative models have tremendous potential not only to help safely share medical data via synthetic datasets but also to perform an array of diverse applications, such as anomaly detection, image-to-image translation, denoising, and MRI reconstruction. However, due to the complexity of these models, their implementation and reproducibility can be difficult. This complexity can hinder progress, act as a use barrier, and dissuade the comparison of new methods with existing works. In this study, we present MONAI Generative Models, a freely available open-source platform that allows researchers and developers to easily train, evaluate, and deploy generative models and related applications. Our platform reproduces state-of-art studies in a standardised way involving different architectures (such as diffusion models, autoregressive transformers, and GANs), and provides pre-trained models for the community. We have implemented these models in a generalisable fashion, illustrating that their results can be extended to 2D or 3D scenarios, including medical images with different modalities (like CT, MRI, and X-Ray data) and from different anatomical areas. Finally, we adopt a modular and extensible approach, ensuring long-term maintainability and the extension of current applications for future features.


page 8

page 11

page 12

page 17

page 18

page 19

page 20


Exploring the Power of Generative Deep Learning for Image-to-Image Translation and MRI Reconstruction: A Cross-Domain Review

Deep learning has become a prominent computational modeling tool in the ...

medigan: A Python Library of Pretrained Generative Models for Enriched Data Access in Medical Imaging

Synthetic data generated by generative models can enhance the performanc...

Fast Unsupervised Brain Anomaly Detection and Segmentation with Diffusion Models

Deep generative models have emerged as promising tools for detecting arb...

Generative Adversarial Network in Medical Imaging: A Review

Generative adversarial networks have gained a lot of attention in genera...

Structurally aware bidirectional unpaired image to image translation between CT and MR

Magnetic Resonance (MR) Imaging and Computed Tomography (CT) are the pri...

Morphology-preserving Autoregressive 3D Generative Modelling of the Brain

Human anatomy, morphology, and associated diseases can be studied using ...

Regulating ChatGPT and other Large Generative AI Models

Large generative AI models (LGAIMs), such as ChatGPT or Stable Diffusion...

Please sign up or login with your details

Forgot password? Click here to reset