Method and system for tracking, three-dimensionally superposing and interacting target object without special mark

Abstract

The invention belongs to the technical field of computer application, and provides a method and a system for tracking, three-dimensionally superposing and interacting a target object without a special mark. The method comprises the following steps of: firstly, segmenting the target object from an image shot by a camera, and creating a characteristic template of the target object automatically; next, directly identifying the target object by utilizing the characteristics of the target object, and calculating three-dimensional information (relative to the camera) of the target object; and finally, superposing a virtual object or an animated picture in a three-dimensional coordinate system in a realistic space through a graphics engine in real time. According to the method disclosed by the invention, video images and template images are subjected to characteristic matching via a surf algorithm so as to finish the calibration on the camera, so that real-time tracking and real-time three-dimensional superposing of the target object without the special mark are realized; for each frame of video image, three-dimensional coordinate information of the target is calculated in real time, so that interaction of a person or an object in reality with a virtual person or a virtual object is realized; and therefore, the method and the system disclosed by the invention are relatively high in degree of automation and have relatively popularization and application values.

Description

technical field [0001] The invention belongs to the field of augmented reality technology, and in particular relates to a method and system for tracking, three-dimensional superposition and interaction of a target object without a specific mark. Background technique [0002] Augmented reality technology is referred to as AR technology, also known as augmented reality, which combines physical information (visual information, sound, taste, touch, etc.) Then it is superimposed on the real world to be perceived by human senses, so as to achieve a sensory experience beyond reality. This technology is called augmented reality technology, or AR technology for short. [0003] Augmented reality can be divided into indoor type and outdoor type according to the scope of application. In a broad sense, indoor augmented reality includes various practices that cover the physical space inside a building with data layers, and is concerned by architects, muralists, exhibition designers and n...

AI Technical Summary

Problems solved by technology

[0005] The present invention provides a method for directly identifying, extracting and tracking three-dimensional coordinate information of target objects existing in reality, aiming at solving the need to place reference marks on known positions in advance in the augmented reality technology provided by the prior art. And tracking these marks to indirectly track the target object, it cannot automatically create a template for the target object, and cannot directly identify the target object in reality, extract 3D coordinate information, and track the problem

Images