TY - JOUR
T1 - Screening of Parkinsonian subtle fine-motor impairment from touchscreen typing via deep learning
AU - Iakovakis, Dimitrios
AU - Chaudhuri, K. Ray
AU - Klingelhoefer, Lisa
AU - Bostantjopoulou, Sevasti
AU - Katsarou, Zoe
AU - Trivedi, Dhaval
AU - Reichmann, Heinz
AU - Hadjidimitriou, Stelios
AU - Charisis, Vasileios
AU - Hadjileontiadis, Leontios J.
N1 - Funding Information:
The authors would like to acknowledge George Ntakakis and Fotis Karayiannis, Microsoft Innovation Center, Greece, and Konstantinos Kyritsis and Anastasios Delopoulos, Multimedia Understanding Group, Aristotle University of Thessaloniki, Greece, for their help in iPrognosis app development. Moreover, the authors thank all collaborators within the i-PROGNOSIS project for their efforts in iPrognosis app dissemination and users’ recruitment. The research leading to these results has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 690494 - i-PROGNOSIS: Intelligent Parkinson early detection guiding novel supportive interventions.
Publisher Copyright:
© 2020, The Author(s).
PY - 2020/12/1
Y1 - 2020/12/1
N2 - Fine-motor impairment (FMI) is progressively expressed in early Parkinson’s Disease (PD) patients and is now known to be evident in the immediate prodromal stage of the condition. The clinical techniques for detecting FMI may not be robust enough and here, we show that the subtle FMI of early PD patients can be effectively estimated from the analysis of natural smartphone touchscreen typing via deep learning networks, trained in stages of initialization and fine-tuning. In a validation dataset of 36,000 typing sessions from 39 subjects (17 healthy/22 PD patients with medically validated UPDRS Part III single-item scores), the proposed approach achieved values of area under the receiver operating characteristic curve (AUC) of 0.89 (95% confidence interval: 0.80–0.96) with sensitivity/specificity: 0.90/0.83. The derived estimations result in statistically significant (p< 0.05) correlation of 0.66/0.73/0.58 with the clinical standard UPDRS Part III items 22/23/31, respectively. Further validation analysis on 9 de novo PD patients vs. 17 healthy controls classification resulted in AUC of 0.97 (0.93–1.00) with 0.93/0.90. For 253 remote study participants, with self-reported health status providing 252.000 typing sessions via a touchscreen typing data acquisition mobile app (iPrognosis), the proposed approach predicted 0.79 AUC (0.66–0.91) with 0.76/0.71. Remote and unobtrusive screening of subtle FMI via natural smartphone usage, may assist in consolidating early and accurate diagnosis of PD.
AB - Fine-motor impairment (FMI) is progressively expressed in early Parkinson’s Disease (PD) patients and is now known to be evident in the immediate prodromal stage of the condition. The clinical techniques for detecting FMI may not be robust enough and here, we show that the subtle FMI of early PD patients can be effectively estimated from the analysis of natural smartphone touchscreen typing via deep learning networks, trained in stages of initialization and fine-tuning. In a validation dataset of 36,000 typing sessions from 39 subjects (17 healthy/22 PD patients with medically validated UPDRS Part III single-item scores), the proposed approach achieved values of area under the receiver operating characteristic curve (AUC) of 0.89 (95% confidence interval: 0.80–0.96) with sensitivity/specificity: 0.90/0.83. The derived estimations result in statistically significant (p< 0.05) correlation of 0.66/0.73/0.58 with the clinical standard UPDRS Part III items 22/23/31, respectively. Further validation analysis on 9 de novo PD patients vs. 17 healthy controls classification resulted in AUC of 0.97 (0.93–1.00) with 0.93/0.90. For 253 remote study participants, with self-reported health status providing 252.000 typing sessions via a touchscreen typing data acquisition mobile app (iPrognosis), the proposed approach predicted 0.79 AUC (0.66–0.91) with 0.76/0.71. Remote and unobtrusive screening of subtle FMI via natural smartphone usage, may assist in consolidating early and accurate diagnosis of PD.
UR - http://www.scopus.com/inward/record.url?scp=85088653377&partnerID=8YFLogxK
U2 - 10.1038/s41598-020-69369-1
DO - 10.1038/s41598-020-69369-1
M3 - Article
C2 - 32724210
AN - SCOPUS:85088653377
SN - 2045-2322
VL - 10
JO - Scientific Reports
JF - Scientific Reports
IS - 1
M1 - 12623
ER -