HKUMed has developed an innovative artificial intelligence (AI) software system that can turn an ordinary smartphone into a medical-grade stethoscope, allowing users to detect heart disease symptoms at their fingertips. (From left) Professor Joseph Wu Tsz-kei, Professor Joshua Ho Wing-kei, Mr Wong who has received transcatheter aortic valve implantation, and Dr Wong Chun-ka.
An interdisciplinary team from the Li Ka Shing Faculty of Medicine of the University of Hong Kong (HKUMed) has developed an innovative artificial intelligence (AI) software system that can turn an ordinary mobile phone into a medical-grade stethoscope, allowing anyone to use a smartphone to detect heart disease symptoms at their fingertips, and subsequently seek immediate medical attention, without the need for other specialised devices. This patented AI technology enables the detection of valvular heart disease, with an estimated accuracy of 81% – a level comparable to a doctor's assessment using a stethoscope. This invention promotes early detection of valvular heart disease, personalised health management, heart disease screening, the use of telemedicine, and remote disease monitoring.
'AI doctor in your pocket' receives international accolade
This research leading to the invention was led by Professor Joshua Ho Wing-kei, Associate Professor in the School of Biomedical Sciences, HKUMed, and Lead Scientist of the HKU Laboratory of Data Discovery for Health (D24H). Professor Ho pointed out there are many digital health devices in the market that can measure pulse and cardiac electrical activity, but very few can collect and analyse heart sounds: 'Analysing heart sounds provides important health data comparable to that obtained by a doctor using a stethoscope. Our AI system, "Vitogram®", uses AI to turn a regular smartphone into an AI doctor in your pocket, allowing anyone to conveniently assess their own heart health.'
Professor Ho explained that the invention was inspired by challenges during the COVID-19 pandemic, when a lot of 'hidden patients' avoided going out and seeking medical care for seemingly minor ailments, thus missing the opportunity for early detection of heart disease symptoms. He said he is glad that this initial research idea has become a reality. This innovative breakthrough was globally recognised, winning a top award – Gold Medal with Congratulations of the Jury – at the recent 49th International Exhibition of Inventions of Geneva.
Clinical trial shows promising results
Cardiologist Dr Wong Chun-ka, Clinical Assistant Professor in the Department of Medicine, School of Clinical Medicine, HKUMed, has led a clinical study since December 2023 to validate the utility of this phone-based AI system at a local public hospital. Based on preliminary analysis of the first 363 participants enrolled in this ongoing study, the system achieves 97% accuracy in terms of heart rate estimation and 81% in terms of detection of significant valvular heart disease. This is an accuracy level comparable to the classification accuracy achieved using sound collected by a standard medical-grade stethoscope and assessment conducted by cardiologists. 'This breakthrough technology has the potential to discover "hidden" valvular heart disease patients in the community, alerting them to seek early medical care,' said Dr Wong. 'The general public can also perform self-checks regularly, which may help prevent progression to more serious heart disease, reduce the risks and recovery time associated with subsequent heart surgeries.'
The team is planning the next phase of the study, with the aim of testing its use in a larger, more diverse population, covering more heart disease symptoms, Dr Wong added.
Accelerating commercialisation locally and internationally
The D24H registered 'Vitogram®' in the medical device listing of the United States Food and Drug Administration (FDA), and established a spin-off company, called Vitome Limited, to commercialise the product. Professor Joseph Wu Tsz-kei, Professor in the School of Public Health, HKUMed, and Managing Director of D24H, remarked that funding support received from the AIR@InnoHK platform of the Hong Kong Innovation and Technology Commission was critical for enabling the rapid translation of the project from fundamental scientific research to clinical translation and commercialisation. 'In addition to Hong Kong, we are working with partner healthcare organisations to launch the AI platform in overseas countries, like Singapore and Malaysia, in addition to extending the service to individual users,' said Professor Wu. 'We hope this simple, portable medical-grade AI platform will make a positive contribution to people's health across the globe,' said Professor Wu.
About the Laboratory of Data Discovery for Health
The Laboratory of Data Discovery for Health (D²4H) aims to gather and curate massive, unique data resources and develop deep frontier analytics to protect global public health while improving individual healthcare through precision medicine. The D²4H brings together a multi-disciplinary team of some of the world's leading scientists to apply AI and big data in ways that will transform their approaches to understanding and treating diseases.
Spearheaded by the University of Hong Kong with support from other world-renowned national and international academic institutions, D²4H is keen to work with health authorities, such as the World Health Organization and the China Centre for Disease Control and Prevention. By arranging collaboration across multiple disciplines and sectors, D²4H aims to advance the frontiers of healthcare technology in Hong Kong, the Greater Bay Area and beyond to produce 'moonshots', which will have tremendous healthcare benefits for global health.
