Online Urdu Speech to text
This project is aimed at early prediction of Parkinson’s disease through computerized analysis of online handwriting samples. While a number of clinical evaluations are carried out to diagnose the Parkinson’s disease, most of these tests are effective only once the disease is at a relatively advanced stage. Studies have shown that analysis of handwriting can be used as a valuable tool for prediction of Parkinson’s disease at very early stages. In the proposed research, we have employed raw signals captured by a digitizer tablet while attempting several writing and drawing templates, to compute various kinematic, temporal, and pen-based attributes. In addition to these online dynamic attributes, static offline visual features are also extracted using state-of-the-art Convolutional Neural Networks (CNNs). The developed tools allow practitioners to collect handwriting and drawing samples of subjects and employ a combination of different types of features (online and offline) for the analysis and prediction.

A speech-to-text, also known as automatic speech recognition (ASR) software, is a type of software application that uses advanced algorithms to convert spoken words into text. This technology has made it possible to transcribe large volumes of spoken language into written form, without the need for human intervention. In this project a useful software has been developed to convert spoken urdu speech to text.
Publications
- Moetesum, M., Diaz, M., Masroor, U., Siddiqi, I., & Vessio, G. (2022). A survey of visual and procedural handwriting analysis for neuropsychological assessment. Neural Computing and Applications, 1-18.
- Diaz, M., Moetesum, M., Siddiqi, I., & Vessio, G. (2021). Sequence-based dynamic handwriting analysis for Parkinson’s disease detection with one-dimensional convolutions and BiGRUs. Expert Systems with Applications, 168, 114405.
- Moetesum, M., Siddiqi, I., Javed, F., & Masroor, U. (2020, September). Dynamic Handwriting Analysis for Parkinson’s Disease Identification using C-BiGRU Model. In 2020 17th International Conference on Frontiers in Handwriting Recognition (ICFHR) (pp. 115-120). IEEE.
Project Demo

Project Demo

