Reality augmenting method with real environment estimation and reality augmenting system

Abstract

The invention discloses a reality augmenting method with real environment estimation and a reality augmenting system. The method comprises the following steps: initializing a system environment and configuring system parameters; selecting or extracting one marker front view and training a marker to obtain training data; calculating and correcting camera inner parameters of a marker image; correcting each frame of a real environment shot by a camera, and based on the training data, identifying the marker and calculating a relative position matrix of the marker in a camera coordinate system; and searching a corresponding virtual model by the identified marker, determining the position of the model by utilizing the position matrix of the extracted marker, drawing the virtual model, estimating illumination information of the environment in which the marker is positioned by comparing the brightness of the identified marker and brightness of the marker front view, performing real environment light source estimation to estimate the position of the real light source and generate shadow. The method and the system greatly reduce the limitation on the marker and can be used for marking maps and complex two-dimensional images.

Description

technical field [0001] The invention belongs to the field of augmented reality technology, in particular to a method and system of augmented reality, which is applied to the fields of virtual reality and computer vision, and uses pattern recognition and virtual reality technology to add content and enhance effects to the real image frames collected by video . Background technique [0002] Augmented reality (AR, Augmented Reality) is a technology that uses virtual objects to enhance the reality of real scenes. Augmented reality is based on the real physical environment collected by acquisition devices such as cameras, by annotating virtual generated information such as text, two-dimensional images, and three-dimensional models on objects in the real physical environment displayed on the display screen, so as to realize the user's physical environment Notes, descriptions, or enhancements and emphasis on certain effects of the real-world environment. For example, when a user ...

AI Technical Summary

Problems solved by technology

[0013] The disadvantage is that the requirements for markers are relatively high, and the shape of markers is required to be simple. The contrast between the edge of the shape and the background color is very clear and obvious, and there must be a quadrilateral frame composed of four straight sides as a clear boundary, otherwise the recognition effect will be affected.

Images