Scene graph optimization method based on relationship constraints in virtual reality and augmented reality scenes

Abstract

The invention discloses a scene graph optimization method based on relation constraints in virtual reality and augmented reality scenes, and relates to the field of scene graphs. The method comprisesthe following steps: inputting a scene atlas sample data set which comprises image information and object relation group information; extracting relationship constraints by utilizing the object relationship group, wherein the relationship constraints comprise 1-m relationship constraints, m-1 relationship constraints and 1-1 relationship constraints; training a scene graph generation model based on the relationship constraints; detecting an object contained in the virtual reality and augmented reality scene graph by using a target detection model; generating an initial scene graph of the virtual reality and augmented reality scene graph by using a trained scene graph generation model based on the detected object; and further optimizing the initial scene graph by using the relationship constraints, and removing the object relationship group violating the relationship constraints to obtain a final scene graph. According to the invention, for the images captured in virtual reality and augmented reality scenes, the scene graph generated based on the relation constraint optimization model is proposed for the first time, and the quality of the scene graph is effectively improved.

Description

technical field [0001] The present invention relates to the field of artificial intelligence, and more specifically, to a scene map optimization method based on relationship constraints in virtual reality and augmented reality scenes. Background technique [0002] Both virtual reality technology and augmented reality technology are representatives of contemporary digital technology. Virtual reality can generate an interactive three-dimensional environment for users through the comprehensive use of computer graphics systems and various control devices. Augmented reality augments reality by superimposing computer-generated virtual objects, scenes or information onto real ones. In order to make the scenes under virtual reality and augmented reality better perceived by humans, it is necessary for the system to understand the scene, and building a scene map is a key step in understanding the scene. [0003] A scene graph is an abstract, structured representation of the scene de...

AI Technical Summary

Problems solved by technology

[0005] However, there is currently no good technical solution that can generate high-quality scene graphs, specifically:

[0006] (1) The existing scene graph generation methods only use image information, resulting in the generated scene graph containing many conflicting object relationship groups, which is not practical

[0007] (2) The object relation group of the scene graph itself implies relational constraints, which can help improve the quality of the scene graph, but the existing methods do not fully consider and utilize these relational constraints, which limit the expressive ability of the scene graph

Images