Mixed reality virtual rendering method and device

Abstract

An embodiment of the invention discloses a mixed reality virtual rendering method and device. The method comprises the steps of, performing mobile shooting via a camera to obtain at least two plane determining images matching a user's field of view; according to the at least two plane determining images, drawing a spatial grid plane included in the user's field of view; according to the spatial grid plane, determining a virtual scene corresponding to a 3D object to be displayed; outputting the virtual scene to a pair of mixed reality glasses so that a user observes a mixed reality scene formed by combination of the virtual scene and a real scene obtained by the mixed reality glasses. The embodiment is advantageous in that, via the images collected by the camera, a spatial plane corresponding to the real scene is determined, and the 3D object and the spatial plane are combined to form a virtual image, and therefore, sense of reality of the formed virtual image is high, the purpose of lying to the human brain is reached to some extent, distinguishing the real scene from the virtual scene is hard, and realization cost is reduced.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of mixed reality, and in particular, to a method and device for virtual presentation of mixed reality. Background technique [0002] MR (Mixed Reality, mixed reality technology) is a technology that mixes and superimposes real world information and virtual world information, involving new technologies and technologies such as multimedia processing, 3D modeling, real-time video display and control, real-time tracking, and scene fusion. new means. The MR system has three outstanding features: ① Information integration between the real world and the virtual world; ② Real-time interactivity; ③ Adding and positioning virtual objects in the three-dimensional scale space. MR technology can be widely used in military, medical, construction, education, engineering, film and television, entertainment and other fields. [0003] In order to achieve the effect of mixed reality, the current common ...

AI Technical Summary

Problems solved by technology

[0003] In order to achieve the effect of mixed reality, the current common presentation methods, such as Google glasses and Microsoft hololens, etc., directly superimpose the virtual constructed display image on the real image for mixed display. However, the content of the displayed image is often complex and requires complex algorithms. Calculate the superposition position of the virtual image and the real image, and the zooming, rotation and other processing required for the virtual image, in order to maximize the realism of the superimposed mixed image

Therefore, the disadvantages of the prior art are that the MR system is technically complicated, the cost is high, and the sense of reality is not good.

Images