Multi-layer AR Image Composition for Depth and Immersion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality technologies suffer from low 3D effects, inferior depth of field, and unrealistic augmented effects due to the blocking of real-world objects by virtually created content, which limits the immersion and realism of AR experiences.
Innovation Solution
The creation of multi-layered augmented reality images in real-time, involving a background image layer, an AR content layer, and an object layer, where the object layer is extracted and overlaid on the background layer with a predetermined distance to enhance 3D effects and depth of field, and the overlaying order is dynamically determined based on user inputs and conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single-layer AR image is used to simplify the system, then device complexity is reduced, but the 3D effect and depth of field are degraded
Solution Approach 1:
The AR image is segmented into multiple independent layers including background layer, AR content layer, and object layer. Each layer can be processed and displayed separately, allowing complex visual effects to be achieved through composition of simpler individual layers, thus resolving the contradiction between system complexity and visual quality.
Solution Approach 2:
The patent introduces a new dimension of layering in the Z-axis (depth dimension) by creating multiple image layers at different depths. The background layer, AR content layer, and object layer are positioned at different Z-values, enabling realistic 3D effects and depth of field without requiring complex hardware modifications.
2Quantity of substance
If virtually created content is overlaid on real-world images, then AR content is added, but real-world objects are blocked and visibility is reduced
Solution Approach 1:
The image is segmented into background layer, AR content layer, and object layer. By extracting specific objects from the background and placing them in a separate object layer, these objects remain visible even when AR content is displayed, preventing complete occlusion and maintaining information visibility.
Solution Approach 2:
The patent introduces transparency as an intermediary property that allows AR content to be overlaid on real-world objects without complete occlusion. The AR content layer can be rendered with adjustable transparency, enabling users to see through virtual content to the real objects behind it, thus maintaining visibility while adding AR information.
3Manufacturing precision
If multiple image layers are created and processed, then 3D effect and depth of field are enhanced, but processing power requirements increase
Solution Approach 1:
Processing is segmented into distinct stages: background layer processing, object extraction, AR content generation, and layer composition. Each stage processes only the necessary data for that specific layer, avoiding redundant computations and reducing overall processing power requirements compared to processing a single complex image.
Solution Approach 2:
Objects are extracted from the background image in advance during the object extraction phase, before the final composition stage. This preliminary action allows the system to work with pre-processed object data rather than performing complex extraction operations during real-time rendering, significantly reducing processing power requirements.
Data Source
AI summary
Provided is a method and a device for creating and displaying a multilayer augmented reality image. The device may include a photographing circuit configured to capture images of a real environment and an image processor configured to create an AR content, extract at least one object from the captured images of the real environment, display the captured images of real environment as a first layer, display the created AR content as a second layer and overlay the second layer on the first layer, and display the extracted object as an object image layer and overlay the object image layer on the second layer.