AIdoscopist: A Real-Time Computer-aided Diagnosis System for Cancer Screening during Colonoscopy

Project Description

Prof. POON Chung Yan, Carmen
Prof. MAK Wing Chung, Tony
Prof. WONG Hei, Sunny
Prof. LAU Yun Wong, James
Department of Surgery, Endoscopy Centre


Colonoscopy is one of the most effective ways to prevent colorectal cancer. It allows doctors to examine the colonic wall for polyp(s) and remove those that are adenomatous. Nevertheless, two major difficulties are encountered by endoscopists during colonoscopy: namely missed polyps and misclassified polyps. To solve the issues, we develop a real-time computer-aided diagnosis system for polyp detection and classification during colonoscopy. The system, named AIdoscopist, displays the diagnosed result of each polyp to doctors in real time and assists doctors in making instant decision of whether a polyp should be resected or not. The ultimate goal is to make colonoscopy a safer and more cost-effective procedure. Currently, the system has been:

  • Built with advanced deep learning method and incorporated both spatial and temporal information in the prediction model;
  • Tested with full colonoscopy videos collected from 300 patients and achieved comparable results with a group of endoscopists; and
  • Evaluated on two patients for real-time processing and displaying the results.

Project Gallery

Project Info


Innovation and Technology Commission


The 1st prize of IEEE EMBS Hong Kong-Macau Joint Chapter Postgraduate Student Competition.
The 2nd place (out of 59 participants) of EndoVisSub2017-GIANA Endoscopic Vision Challenge on Polyp Localization.


Back to Top