Image-guided virtuality and reality fusion processing method and apparatus

Abstract

Embodiments of the invention disclose an image-guided virtuality and reality fusion processing method and apparatus. The method comprises the steps of obtaining to-be-processed images, and preprocessing the to-be-processed images to obtain plane position information of sub-objects of a target object; obtaining image data of the target image, and performing calculation according to the image data to obtain three-dimensional position information of the sub-objects of the target object; according to the plane position information and the three-dimensional position information, building a virtualmodel of the target object; and according to the virtual model, establishing a mapping relationship between a real coordinate system of augmented reality glasses and a virtual coordinate system of thevirtual model, and realizing virtuality and reality fusion of the target object according to the mapping relationship. The virtuality and reality fusion of the target object is realized in combination with the plane position information and the three-dimensional position information of the sub-objects of the target object, so that the localization after the virtuality and reality fusion is quicker and more accurate.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of image processing, and in particular to an image-guided virtual-real fusion processing method and device. Background technique [0002] Virtual-real fusion technology is a technology that combines virtual objects and real objects to form a new environment. Augmented reality technology is usually used to construct a virtual-real fusion environment. Augmented reality technology applies virtual information to the real world, real environment and virtual objects are superimposed on the same picture or space in real time, and virtual and real information complement and superimpose each other. , thus providing more perceptual information than in the real world. [0003] Nowadays, virtual reality fusion technology is more and more widely used, such as in medical treatment, maintenance, construction, cultural heritage protection and life entertainment. For example, it is difficult to locate...

AI Technical Summary

Problems solved by technology

For example, it is difficult to locate small pulmonary nodules in the medical field, especially under thoracoscopy. The current navigation system display interface is separated from the operation area, which is not intuitive and accurate.

[0004] In the process of realizing the embodiment of the present invention, the inventor found that the existing virtual-real fusion method positioning is not accurate

Images