Shanghai Zhongshan Hospital develops first-of-its-kind smart endoscope

Developed by Zhongshan Hospital Affiliated with Fudan University in Shanghai, Jingguan, or "MirrorView", a smart endoscope combining three roles, made its debut at an international academic conference of the digestive endoscopy industry in Shanghai on Saturday.

The hospital said it is the world's first comprehensive intelligent agent in the digestive endoscopy field driven by a multimodal large model.

Zhou Pinghong, director of the endoscopy center at Zhongshan Hospital, said that "MirrorView" combines big data, AI technology and medical resources, and integrated over a million endoscopic images.

Zhou said "MirrorView" first serves as the patient's personal medical consultant, providing one-on-one detailed explanations for checkup reports and delving into disease-related information through a knowledge graph and specialized disease database.

Its second role is as a smart surgical partner for doctors, enabling them to obtain real-time lesion analysis during surgery through eye-tracking and voice interaction functions.

Also, the system can automatically generate structured reports, reducing at least half of the documentation time for healthcare workers.

Its third role is as a steward assisting hospital management and decision-making. Developed based on a domestic AI computing platform, the system integrates data resources, conducts intelligent analysis, and achieves precise control over departmental operations, Zhou said.

"We plan to connect the platform with 300 medical institutions nationwide over the next three years and train 2,000 grassroots doctors. It will be an effort to facilitate the equitable distribution of medical resources and diagnostic and treatment capabilities," Zhou said.