Tensor Radiomics: Paradigm for Systematic Incorporation of Multi-Flavoured Radiomics Features

03/12/2022
by   Arman Rahmim, et al.
4

Radiomics features extract quantitative information from medical images, towards the derivation of biomarkers for clinical tasks, such as diagnosis, prognosis, or treatment response assessment. Different image discretization parameters (e.g. bin number or size), convolutional filters, segmentation perturbation, or multi-modality fusion levels can be used to generate radiomics features and ultimately signatures. Commonly, only one set of parameters is used; resulting in only one value or flavour for a given RF. We propose tensor radiomics (TR) where tensors of features calculated with multiple combinations of parameters (i.e. flavours) are utilized to optimize the construction of radiomics signatures. We present examples of TR as applied to PET/CT, MRI, and CT imaging invoking machine learning or deep learning solutions, and reproducibility analyses: (1) TR via varying bin sizes on CT images of lung cancer and PET-CT images of head neck cancer (HNC) for overall survival prediction. A hybrid deep neural network, referred to as TR-Net, along with two ML-based flavour fusion methods showed improved accuracy compared to regular rediomics features. (2) TR built from different segmentation perturbations and different bin sizes for classification of late-stage lung cancer response to first-line immunotherapy using CT images. TR improved predicted patient responses. (3) TR via multi-flavour generated radiomics features in MR imaging showed improved reproducibility when compared to many single-flavour features. (4) TR via multiple PET/CT fusions in HNC. Flavours were built from different fusions using methods, such as Laplacian pyramids and wavelet transforms. TR improved overall survival prediction. Our results suggest that the proposed TR paradigm has the potential to improve performance capabilities in different medical imaging tasks.

READ FULL TEXT

page 7

page 9

page 10

research
06/12/2021

DeepMMSA: A Novel Multimodal Deep Learning Method for Non-small Cell Lung Cancer Survival Analysis

Lung cancer is the leading cause of cancer death worldwide. The critical...
research
09/06/2021

Generative Models Improve Radiomics Performance in Different Tasks and Different Datasets: An Experimental Study

Radiomics is an active area of research focusing on high throughput feat...
research
03/09/2022

Metastatic Cancer Outcome Prediction with Injective Multiple Instance Pooling

Cancer stage is a large determinant of patient prognosis and management ...
research
04/03/2023

CT Multi-Task Learning with a Large Image-Text (LIT) Model

Large language models (LLM) not only empower multiple language tasks but...
research
02/08/2020

Introducing anisotropic Minkowski functionals and quantitative anisotropy measures for local structure analysis in biomedical imaging

The ability of Minkowski Functionals to characterize local structure in ...
research
10/13/2019

Radiomic Feature Stability Analysis based on Probabilistic Segmentations

Identifying image features that are robust with respect to segmentation ...

Please sign up or login with your details

Forgot password? Click here to reset