Learnable Ophthalmology SAM

04/26/2023
by   Zhongxi Qiu, et al.
0

Segmentation is vital for ophthalmology image analysis. But its various modal images hinder most of the existing segmentation algorithms applications, as they rely on training based on a large number of labels or hold weak generalization ability. Based on Segment Anything (SAM), we propose a simple but effective learnable prompt layer suitable for multiple target segmentation in ophthalmology multi-modal images, named Learnable Ophthalmology Segment Anything (SAM). The learnable prompt layer learns medical prior knowledge from each transformer layer. During training, we only train the prompt layer and task head based on a one-shot mechanism. We demonstrate the effectiveness of our thought based on four medical segmentation tasks based on nine publicly available datasets. Moreover, we only provide a new improvement thought for applying the existing fundamental CV models in the medical field. Our codes are available at \href{https://github.com/Qsingle/LearnablePromptSAM}{website}.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 6

research
05/18/2023

Segment Any Anomaly without Training via Hybrid Prompt Regularization

We present a novel framework, i.e., Segment Any Anomaly + (SAA+), for ze...
research
06/15/2023

Winning Solution for the CVPR2023 Visual Anomaly and Novelty Detection Challenge: Multimodal Prompting for Data-centric Anomaly Detection

This technical report introduces the winning solution of the team \texti...
research
08/05/2022

Deep Feature Learning for Medical Acoustics

The purpose of this paper is to compare different learnable frontends in...
research
04/14/2022

LEFM-Nets: Learnable Explicit Feature Map Deep Networks for Segmentation of Histopathological Images of Frozen Sections

Accurate segmentation of medical images is essential for diagnosis and t...
research
06/15/2023

Learnable Weight Initialization for Volumetric Medical Image Segmentation

Hybrid volumetric medical image segmentation models, combining the advan...
research
05/21/2023

Advancing Referring Expression Segmentation Beyond Single Image

Referring Expression Segmentation (RES) is a widely explored multi-modal...
research
06/13/2022

Fitting Segmentation Networks on Varying Image Resolutions using Splatting

Data used in image segmentation are not always defined on the same grid....

Please sign up or login with your details

Forgot password? Click here to reset