ConTrack: Contextual Transformer for Device Tracking in X-ray

by   Marc Demoustier, et al.
Siemens Healthineers

Device tracking is an important prerequisite for guidance during endovascular procedures. Especially during cardiac interventions, detection and tracking of guiding the catheter tip in 2D fluoroscopic images is important for applications such as mapping vessels from angiography (high dose with contrast) to fluoroscopy (low dose without contrast). Tracking the catheter tip poses different challenges: the tip can be occluded by contrast during angiography or interventional devices; and it is always in continuous movement due to the cardiac and respiratory motions. To overcome these challenges, we propose ConTrack, a transformer-based network that uses both spatial and temporal contextual information for accurate device detection and tracking in both X-ray fluoroscopy and angiography. The spatial information comes from the template frames and the segmentation module: the template frames define the surroundings of the device, whereas the segmentation module detects the entire device to bring more context for the tip prediction. Using multiple templates makes the model more robust to the change in appearance of the device when it is occluded by the contrast agent. The flow information computed on the segmented catheter mask between the current and the previous frame helps in further refining the prediction by compensating for the respiratory and cardiac motions. The experiments show that our method achieves 45 and tracking when compared to state-of-the-art tracking models.


Robust Landmark-based Stent Tracking in X-ray Fluoroscopy

In clinical procedures of angioplasty (i.e., open clogged coronary arter...

Dynamic Coronary Roadmapping via Catheter Tip Tracking in X-ray Fluoroscopy with Deep Learning Based Bayesian Filtering

Percutaneous coronary intervention (PCI) is typically performed with ima...

CXTrack: Improving 3D Point Cloud Tracking with Contextual Information

3D single object tracking plays an essential role in many applications, ...

Temporal extrapolation of heart wall segmentation in cardiac magnetic resonance images via pixel tracking

In this study, we have tailored a pixel tracking method for temporal ext...

Target-Aware Tracking with Long-term Context Attention

Most deep trackers still follow the guidance of the siamese paradigms an...

3-D/2-D Registration of Cardiac Structures by 3-D Contrast Agent Distribution Estimation

For augmented fluoroscopy during cardiac catheter ablation procedures, a...

Vessel Segmentation and Catheter Detection in X-Ray Angiograms Using Superpixels

Coronary artery disease (CAD) is the leading causes of death around the ...

Please sign up or login with your details

Forgot password? Click here to reset