Telemedicine system based on mixed reality technology and operation method thereof

Abstract

The invention relates to the technical field of telemedicine, in particular to a telemedicine system based on mixed reality technology and an operation method thereof. A MR (mixed reality) intelligent terminal in space where a patient is in automatically recognizes information of physical environment in which a wearer is and models the physical environment to generate a physical environment model; the MR intelligent terminal projects medical data into the physical environment model in a holographic image form to generate a mixed reality scene; the wearer of the MR intelligent terminal edits and processes the medical data in the mixed reality scene through different control modes. A hospital or a medical institution does not need to build a special tele-consultation room and set up complex hardware environment, and telemedicine can be performed by only wearing the MR intelligent terminal. The telemedicine system has wireless and mobile characteristics, thereby enabling participation personnel to perform telemedicine at any time and any place, so that time cost is lowered greatly. Holographic projection technology is used, so that spatial limitation can be broken through, more effective content can be displayed, and expanding of more terminal display equipment is avoided.

Description

technical field [0001] The invention relates to the technical field of telemedicine, in particular to a telemedicine system based on mixed reality technology and an operation method thereof. Background technique [0002] Mixed reality technology (MR) is a further development of virtual reality technology. This technology presents virtual scene information in real scenes, and builds an interactive feedback information loop between the virtual world, the real world and users to enhance the authenticity of user experience. feel. Mixed reality (MR), which includes both augmented reality and augmented virtuality, refers to new visualization environments resulting from the merging of real and virtual worlds. Physical and digital objects coexist and interact in real time in a new visual environment. [0003] Mixed reality technology has brought great convenience to human life, and it has been greatly reflected in the medical field. For example, the invention patent with the publi...

AI Technical Summary

Problems solved by technology

[0004] Although the application of mixed reality technology has greatly improved the work efficiency and accuracy of surgical operators, and is more efficient and intuitive, the transformation of remote consultation has not yet been reflected. The main shortcomings of the existing telemedicine system are:

The hardware cost and maintenance cost of building the system are very high

The consultation location is limited to the consultation room, which not only makes the consultation organizer spend more energy on the coordination of participation, but also consumes a lot of time costs for the participants

Participants watch the content displayed on the monitor together. When specialist doctors need to know the examination report or related medical information of the patient in their own medical field, they cannot project all of them on the monitor, so they can only expand more terminal display devices.

Images