Vision-Based Assessment of Parkinsonism and Levodopa-Induced Dyskinesia with Deep Learning Pose Estimation

by   Michael H. Li, et al.

Objective: To apply deep learning pose estimation algorithms for vision-based assessment of parkinsonism and levodopa-induced dyskinesia (LID). Methods: Nine participants with Parkinson's disease (PD) and LID completed a levodopa infusion protocol, where symptoms were assessed at regular intervals using the Unified Dyskinesia Rating Scale (UDysRS) and Unified Parkinson's Disease Rating Scale (UPDRS). A state-of-the-art deep learning pose estimation method was used to extract movement trajectories from videos of PD assessments. Features of the movement trajectories were used to detect and estimate the severity of parkinsonism and LID using random forest. Communication and drinking tasks were used to assess LID, while leg agility and toe tapping tasks were used to assess parkinsonism. Feature sets from tasks were also combined to predict total UDysRS and UPDRS Part III scores. Results: For LID, the communication task yielded the best results for dyskinesia (severity estimation: r = 0.661, detection: AUC = 0.930). For parkinsonism, leg agility had better results for severity estimation (r = 0.618), while toe tapping was better for detection (AUC = 0.773). UDysRS and UPDRS Part III scores were predicted with r = 0.741 and 0.530, respectively. Conclusion: This paper presents the first application of deep learning for vision-based assessment of parkinsonism and LID and demonstrates promising performance for the future translation of deep learning to PD clinical practices. Significance: The proposed system provides insight into the potential of computer vision and deep learning for clinical application in PD.


Estimating Parkinsonism Severity in Natural Gait Videos of Older Adults with Dementia

Drug-induced parkinsonism affects many older adults with dementia, often...

A Video-Based Method for Objectively Rating Ataxia

For many movement disorders, such as Parkinson's disease and ataxia, dis...

Exploring Motion Boundaries in an End-to-End Network for Vision-based Parkinson's Severity Assessment

Evaluating neurological disorders such as Parkinson's disease (PD) is a ...

Preterm Infants’ Pose Estimation With Spatio-Temporal Features

Objective: Preterm infants’ limb monitoring in neonatal intensive care u...

Towards Automated and Marker-less Parkinson Disease Assessment: Predicting UPDRS Scores using Sit-stand videos

This paper presents a novel deep learning enabled, video based analysis ...

CPFES: Physical Fitness Evaluation Based on Canadian Agility and Movement Skill Assessment

In recent years, the assessment of fundamental movement skills integrate...

Vision-based Perimeter Defense via Multiview Pose Estimation

Previous studies in the perimeter defense game have largely focused on t...

Please sign up or login with your details

Forgot password? Click here to reset