A scene graph optimization method based on relational constraints in virtual reality and augmented reality scenarios

Abstract

The present invention relates to a scene graph optimization method based on relationship constraints in virtual reality and augmented reality scenarios, and relates to the field of scene graphs; it includes: inputting a scene graph sample data set, including image information and object relation group information; using object relation groups to extract relation constraints, Including 1-m relationship constraints, m-1 relationship constraints and 1-1 relationship constraints; training scene graph generation model based on relationship constraints; using target detection model to detect objects contained in virtual reality and augmented reality scene graphs; based on detected The object uses the trained scene graph generation model to generate the initial scene graph of the virtual reality and augmented reality scene graph; the initial scene graph is further optimized by using the relationship constraints, and the object relationship group that violates the relationship constraints is removed to obtain the final scene graph. Aiming at images captured in virtual reality and augmented reality scenes, the present invention proposes for the first time a scene map generated based on a relational constraint optimization model, which effectively improves the quality of the scene map.

Description

technical field [0001] The present invention relates to the field of artificial intelligence, and more specifically, to a scene map optimization method based on relationship constraints in virtual reality and augmented reality scenes. Background technique [0002] Both virtual reality technology and augmented reality technology are representatives of contemporary digital technology. Virtual reality can generate an interactive three-dimensional environment for users through the comprehensive use of computer graphics systems and various control devices. Augmented reality augments reality by superimposing computer-generated virtual objects, scenes or information onto real ones. In order to make the scenes under virtual reality and augmented reality better perceived by humans, it is necessary for the system to understand the scene, and building a scene map is a key step in understanding the scene. [0003] A scene graph is an abstract, structured representation of the scene de...

AI Technical Summary

Problems solved by technology

[0005] However, there is currently no good technical solution that can generate high-quality scene graphs, specifically:

[0006] (1) The existing scene graph generation methods only use image information, resulting in the generated scene graph containing many conflicting object relationship groups, which is not practical

[0007] (2) The object relation group of the scene graph itself implies relational constraints, which can help improve the quality of the scene graph, but the existing methods do not fully consider and utilize these relational constraints, which limit the expressive ability of the scene graph

Images