Cross-Modality Synthesis from CT to PET using FCN and GAN Networks for Improved Automated Lesion Detection

by   Avi Ben-Cohen, et al.

In this work we present a novel system for generation of virtual PET images using CT scans. We combine a fully convolutional network (FCN) with a conditional generative adversarial network (GAN) to generate simulated PET data from given input CT data. The synthesized PET can be used for false-positive reduction in lesion detection solutions. Clinically, such solutions may enable lesion detection and drug treatment evaluation in a CT-only environment, thus reducing the need for the more expensive and radioactive PET/CT scan. Our dataset includes 60 PET/CT scans from Sheba Medical center. We used 23 scans for training and 37 for testing. Different schemes to achieve the synthesized output were qualitatively compared. Quantitative evaluation was conducted using an existing lesion detection software, combining the synthesized PET as a false positive reduction layer for the detection of malignant lesions in the liver. Current results look promising showing a 28 positive per case from 2.9 to 2.1. The suggested solution is comprehensive and can be expanded to additional body organs, and different modalities.


page 1

page 5

page 6


Virtual PET Images from CT Data Using Deep Convolutional Networks: Initial Results

In this work we present a novel system for PET estimation using CT scans...

Lesion Conditional Image Generation for Improved Segmentation of Intracranial Hemorrhage from CT Images

Data augmentation can effectively resolve a scarcity of images when trai...

Modeling the Intra-class Variability for Liver Lesion Detection using a Multi-class Patch-based CNN

Automatic detection of liver lesions in CT images poses a great challeng...

3D Aggregated Faster R-CNN for General Lesion Detection

Lesions are damages and abnormalities in tissues of the human body. Many...

Improving Segmentation and Detection of Lesions in CT Scans Using Intensity Distribution Supervision

We propose a method to incorporate the intensity information of a target...

Extraction of Pulmonary Airway in CT Scans Using Deep Fully Convolutional Networks

Accurate, automatic and complete extraction of pulmonary airway in medic...

Please sign up or login with your details

Forgot password? Click here to reset