Real character and mixed reality dynamic superposition positioning method and system

Abstract

The invention discloses a real figure and mixed reality dynamic superposition positioning method and system, and the method comprises the following steps: a human body collection module obtains a real figure image through camera shooting, and obtains the three-dimensional data information and position information of a figure, establishing a human body three-dimensional model of the real figure image, wherein the human body three-dimensional model comprises three-dimensional data information and position information; enabling the virtual generation module to generate a virtual content; adjusting the display change of the virtual content at the corresponding position according to the real-time change of the position information of the real figure image to obtain a final three-dimensional scene; and displaying the final three-dimensional scene, and realizing real-time dynamic activity and change of a plurality of real figure images shot by the camera in a virtual content according with a visual rule. The user is positioned by acquiring the position information of the real person, and the real user and the virtual three-dimensional scene content are dynamically combined and displayed in real time according to the positioning information, so that the real-time interaction between the real person and the virtual three-dimensional scene content is realized.

Description

technical field [0001] The invention relates to the technical field of computer vision, in particular to a positioning method and system for dynamic superimposition of real characters and mixed reality. Background technique [0002] At present, AR (augmented reality), VR (virtual reality) and MR (mixed reality) have driven the rapid development of related fields. Some shopping malls, banks and other places will have games made with related technologies to attract customers to interact with machines to play games, which will give customers a sense of participation and improve the brand image. Furthermore, its essence is to digitally synthesize the virtual three-dimensional scene produced by the computer and the moving images of the characters captured by the camera in real time, so that the characters and the virtual background can change synchronously, so as to realize the seamless fusion of the two to obtain a perfect composite picture. [0003] In order to achieve this ef...

AI Technical Summary

Problems solved by technology

[0004] But the current existing technology has many shortcomings: the virtual object is above the character, and the virtual object blocks the real character by default, which does not conform to the visual rules of the real world and the front-back position relationship

At present, most of the AR and MR technologies have this problem, including Hololens, which will greatly affect the customer's sense of substitution in the program scene, and the sense of reality is poor, which cannot give users a real feeling and experience.

Images