HomeProjectsInformation and Communication TechnologiesSemantic Image-Based Cloud Augmentative and Alternative Communication (Cloud AAC) System

Semantic Image-Based Cloud Augmentative and Alternative Communication (Cloud AAC) System

Project Quick Facts

Principal Investigator

  • Prof. CHAN Yuen Yan Rosanna

    Department of Information Engineering

  • Funding

    Innovation and Technology Commission

  • Collaboration

    SAHK

People with complex communication needs, such as those with cerebral palsy, dementia, aphasia, developmental disorders, and those in acquired medical conditions, do not possess the necessary cognitive abilities and/or motor skills to conduct daily verbal communication. They often need to rely on augmentative and alternative communication (AAC) to express their thoughts, feelings, and needs. This project aims at enabling end users with complex communication needs to conduct real-time telephone-like conversations. We have developed the world’s first-of-its-kind cloud AAC system, and piloted it with people with severe communication disabilities, so as to help developing and promoting their communication competence.

Uniqueness and Competitive Advantages:

  • Successfully applied artificial intelligence and cloud communications to AAC to enable daily mobile communication in people with complex communication needs.
  • The system will gather anonymized AAC usage data, and can inform speech therapy practices with big data analytics.
  • The project technology will be transferred to SAHK and productized into EasyDial for usage in regular rehabilitation service.
User interface of the system prototype of EasyDial and semantic recommendation function of AAC symbols.

Do you like our project?

MORE TO EXPLORE

Handheld High-Resolution Short-Wave Infrared Spectrometer

Spectrometers are widely used in many different aspects, such as food and environmental inspection etc. However, it is necessary to have a portable and high-resolution spectrometer for real-time on-site inspection at remote farm or factory. CUHK team invented two new technologies, which broke the traditional boundary. We develop a handheld high-resolution short-wave infrared (SWIR) spectrometer […]

Read more >