A system for placing virtual objects in augmented reality combined with saliency detection

Abstract

The invention relates to a system for placing a virtual object in an augmented reality by combining with significance detection. The system comprises an image frame collecting module, a 3D (three-dimensional) object generation object, a display module, a tracing identification module and an image processing module, wherein the image frame collecting module is used for reading a static image, the 3D object generation module is used for generating the virtual object, the display model is used for displaying a virtual and real combining image, the tracing identification module is used for detecting the significance of each frame of image collected by the image frame collecting module and quickly generating the significance diagram of each image frame, the image processing module is respectively connected with the image frame collecting module, the tracing identification module, the 3D object generation module and the displaying module, and is used for placing the virtual object in the real scene on the basis of the significance detection. The system has the advantages that for a strange field or a strange image, the size and position of the virtual object can be automatically adjusted; a visual attention mechanism of human eyes is fully considered, and the generated augmented reality scene is dynamically converted, so the defects of the existing virtual object placing method are overcome, and the visual experience of an observer is improved.

Description

technical field [0001] The invention relates to a system for placing virtual objects in augmented reality. In particular it relates to a system for placing virtual objects in augmented reality combined with saliency detection. Background technique [0002] Saliency detection technology and augmented reality technology are involved in image processing. in: [0003] Saliency detection techniques: [0004] The attention and understanding of a scene by the human visual system is determined by a series of potentially different factors, among which the saliency of objects in an image is an important decisive factor. In image analysis and understanding, the salient area of ​​the image is usually only a small part of the image, while the image background occupies a larger part of the image. The so-called salient area can be understood as the main target in the image, which means that human vision can focus on a certain area in the image that can stimulate people's interest in a ...

AI Technical Summary

Problems solved by technology

[0012] The above two methods have their own suitable application fields, and have achieved good results in some special occasions. However, in some scenarios where augmented reality needs to be applied, the two methods also have their own shortcomings.

When using the first method to place virtual objects, if there is no pre-set target object or pattern in the real scene, or the detected target or pattern is not clear enough, the virtual object will not appear in the real scene when displayed On the other hand, when detecting a predetermined target in a real scene, such as a human hand, the technology for detecting and identifying the target is often more complicated, and sometimes the calculation time is longer, which affects real-time performance. When the preset target changes, it will also False detection or missed detection will affect the effect of augmented reality

When the second method of placing virtual objects is adopted, since the virtual objects are in a fixed position of the display window, on the one hand, the virtual objects may block some important content in the real scene and affect the observation effect; on the other hand, due to the location of the virtual objects, It has been fixed, so when the real scene changes, the virtual object does not change with the real scene, and there is no virtual-real interaction effect, so it cannot produce a good combination with the real scene

Images