HomeProjectsInformation and Communication TechnologiesA Bilingual Speech Recognition System for the Elderly and Disabled Population with Speech Disorders

A Bilingual Speech Recognition System for the Elderly and Disabled Population with Speech Disorders

Project Quick Facts

Principal Investigator

  • Prof. LIU Xunying

    Department of Systems Engineering & Engineering Management

  • Funding

    Innovation and Technology Commission, Research Grants Council

This project aims to develop a bilingual speech recognition system that can accurately recognize continuous sentence level Cantonese and English speech inputs from impaired adult speakers with varying forms of speech disorders. The system targets both conversational speech that is essential for daily use, and more formal style speech. The recognition vocabulary covers over 80 thousand common and uncommon words. The average recognition error rates will be below half of those obtained using the Google speech recognition engine. This system can aid the communication of the elderly and disabled people with speech disorders, improve their quality of life, social inclusion and the cost-effectiveness of the care they require.
CUHK English Dysarthric Speech Recognition Demo System
CUHK Cantonese Dysarthric Speech Recognition Demo System

Uniqueness and Competitive Advantages:

  • Large accuracy improvements over commercial speech recognition systems
  • Robust performance across varying forms of speech dysarthria
  • Fast user adaptation using minimum data
  • Audio-visual disordered speech recognition
  • Low published word error rate

Do you like our project?

MORE TO EXPLORE