Virtual-real fusion implementation method and system and electronic equipment

Abstract

The invention discloses a virtual-real fusion implementation method and system and electronic equipment. According to a virtual-real fusion implementation method, a virtual three-dimensional scene isaccurately copied and constructed according to a real scene through a digital twinning technology, the position and motion of a human body / object in the real scene are positioned, tracked and capturedin real time based on a motion capture technology, an obtained real image is fused into the virtual scene to obtain a virtual-real fusion image which is presented to a user. By applying the virtual-real fusion implementation method provided by the invention, a user can synchronously experience a real interactive operation feeling while obtaining a good visual angle immersion feeling.

Description

technical field [0001] The present invention relates to the field of virtual reality / augmented reality, in particular to a method, system and electronic equipment for realizing fusion of virtual reality. Background technique [0002] At present, virtual reality / augmented reality, as an advanced digital simulation and three-dimensional display technology, has been widely used in the field of education and training, especially in the medical education and training industry. Clinicians, medical staff, etc. need to carry out professional technical practice and training after officially entering the post. Technical practice and practical training are important links in the transition from medical students to doctors and medical care roles. The practical training part is a key link for individual clinical medical staff to learn and improve their own clinical experience. [0003] At present, there are two ways of clinical training for clinical medical personnel: one way is to carr...

AI Technical Summary

Problems solved by technology

[0004] However, when operating in a pure virtual scene, such as treating a virtual wounded on a virtual battlefield (medical staff's operating object is a virtual wounded soldier), although a good sense of immersion in the virtual scene can be obtained, the medical staff cannot obtain a real sense of operation

However, if it is in a real scene such as a hospital or a hospital training center, the operating object of the medical staff may be a rubber man or a human body soaked in formalin. Although a real sense of operation can be obtained, a good sense of immersion in a virtual scene cannot be obtained. , so that a good training effect cannot be obtained

Images