SCALP – Supervised Contrastive Learning for Cardiopulmonary Disease Classification and Localization in Chest X-rays using Patient Metadata

by   Ajay Jaiswal, et al.

Computer-aided diagnosis plays a salient role in more accessible and accurate cardiopulmonary diseases classification and localization on chest radiography. Millions of people get affected and die due to these diseases without an accurate and timely diagnosis. Recently proposed contrastive learning heavily relies on data augmentation, especially positive data augmentation. However, generating clinically-accurate data augmentations for medical images is extremely difficult because the common data augmentation methods in computer vision, such as sharp, blur, and crop operations, can severely alter the clinical settings of medical images. In this paper, we proposed a novel and simple data augmentation method based on patient metadata and supervised knowledge to create clinically accurate positive and negative augmentations for chest X-rays. We introduce an end-to-end framework, SCALP, which extends the self-supervised contrastive approach to a supervised setting. Specifically, SCALP pulls together chest X-rays from the same patient (positive keys) and pushes apart chest X-rays from different patients (negative keys). In addition, it uses ResNet-50 along with the triplet-attention mechanism to identify cardiopulmonary diseases, and Grad-CAM++ to highlight the abnormal regions. Our extensive experiments demonstrate that SCALP outperforms existing baselines with significant margins in both classification and localization tasks. Specifically, the average classification AUCs improve from 82.8 DenseNet-121) to 83.9 improve on average by 3.7


page 1

page 6


MedAug: Contrastive learning leveraging patient metadata improves representations for chest X-ray interpretation

Self-supervised contrastive learning between pairs of multiple views of ...

Cross-Modal Contrastive Learning for Abnormality Classification and Localization in Chest X-rays with Radiomics using a Feedback Loop

Building a highly accurate predictive model for these tasks usually requ...

Learning Better Contrastive View from Radiologist's Gaze

Recent self-supervised contrastive learning methods greatly benefit from...

Using Radiomics as Prior Knowledge for Abnormality Classification and Localization in Chest X-rays

Chest X-rays become one of the most common medical diagnoses due to its ...

Semi-self-supervised Automated ICD Coding

Clinical Text Notes (CTNs) contain physicians' reasoning process, writte...

Clinical Contrastive Learning for Biomarker Detection

This paper presents a novel positive and negative set selection strategy...

Please sign up or login with your details

Forgot password? Click here to reset