Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Images

by   Ming Y. Lu, et al.

The rapidly emerging field of computational pathology has the potential to enable objective diagnosis, therapeutic response prediction and identification of new morphological features of clinical relevance. However, deep learning-based computational pathology approaches either require manual annotation of gigapixel whole slide images (WSIs) in fully-supervised settings or thousands of WSIs with slide-level labels in a weakly-supervised setting. Moreover, whole slide level computational pathology methods also suffer from domain adaptation and interpretability issues. These challenges have prevented the broad adaptation of computational pathology for clinical and research purposes. Here we present CLAM - Clustering-constrained attention multiple instance learning, an easy-to-use, high-throughput, and interpretable WSI-level processing and learning method that only requires slide-level labels while being data efficient, adaptable and capable of handling multi-class subtyping problems. CLAM is a deep-learning-based weakly-supervised method that uses attention-based learning to automatically identify sub-regions of high diagnostic value in order to accurately classify the whole slide, while also utilizing instance-level clustering over the representative regions identified to constrain and refine the feature space. In three separate analyses, we demonstrate the data efficiency and adaptability of CLAM and its superior performance over standard weakly-supervised classification. We demonstrate that CLAM models are interpretable and can be used to identify well-known and new morphological features. We further show that models trained using CLAM are adaptable to independent test cohorts, cell phone microscopy images, and biopsies. CLAM is a general-purpose and adaptable method that can be used for a variety of different computational pathology tasks in both clinical and research settings.


page 5

page 12

page 14

page 16

page 30

page 31

page 32

page 33


Federated Learning for Computational Pathology on Gigapixel Whole Slide Images

Deep Learning-based computational pathology algorithms have demonstrated...

Weakly Supervised AI for Efficient Analysis of 3D Pathology Samples

Human tissue and its constituent cells form a microenvironment that is f...

Detecting Histologic Glioblastoma Regions of Prognostic Relevance

Glioblastoma is the most common and aggressive malignant adult tumor of ...

Weakly-supervised learning for image-based classification of primary melanomas into genomic immune subgroups

Determining early-stage prognostic markers and stratifying patients for ...

Preparing data for pathological artificial intelligence with clinical-grade performance

[Purpose] The pathology is decisive for disease diagnosis, but relies he...

Pan-Cancer Integrative Histology-Genomic Analysis via Interpretable Multimodal Deep Learning

The rapidly emerging field of deep learning-based computational patholog...

Multi-Stain Self-Attention Graph Multiple Instance Learning Pipeline for Histopathology Whole Slide Images

Whole Slide Images (WSIs) present a challenging computer vision task due...

Please sign up or login with your details

Forgot password? Click here to reset