AR Display Layering for Real-Object Adaptability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional augmented reality (AR) technologies limit the display of virtual objects to a simple upper layer, making it inflexible for various application environments and unable to adapt to diverse user experiences.

Innovation Solution

A method and device for displaying images in AR video processes, which involves receiving setting instructions, determining image range information of target real objects, acquiring their images, and setting both virtual and real object images based on this information to create a dynamic AR image frame, allowing for flexible display modes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If virtual objects are displayed only on the upper layer of the scene image, then the display structure is simple, but the adaptability to various application environments is poor

Engineering Contradiction:
Improveadaptability to application environmentsVSAvoiddisplay structure complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The display structure is segmented into multiple independent layers: the scene image layer, the virtual object layer, and the real object image layer. This segmentation allows each layer to be independently controlled and positioned, enabling flexible adaptation to different application environments while maintaining clear structural organization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from a single-layer display to a multi-layer spatial structure by adding the real object image layer between the scene image and virtual objects. This dimensional change creates depth information and enables more versatile display modes without significantly increasing overall system complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If virtual objects are displayed only on the upper layer of the scene image, then the display mode is simple, but the flexibility for various application environments is limited

Engineering Contradiction:
Improveflexibility of display modeVSAvoiddisplay mode complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The display mode becomes dynamic by allowing real object images to be selectively extracted and positioned at different locations within the scene image. The system can adaptively adjust which real objects are captured, their positions, and their relationships with virtual objects, providing flexible display modes for various applications.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The multi-layer display structure serves multiple functions: it can display virtual objects on the scene, extract and display real objects from the scene, position virtual objects relative to real objects, and adapt to different application scenarios. This universal structure replaces the single-function simple overlay with a multi-functional system.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If real object images are extracted and displayed on multiple layers, then display diversity is enhanced, but the processing complexity increases

Engineering Contradiction:
Improvedisplay diversityVSAvoidimage processing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by pre-processing the scene image to identify and extract real objects before final display composition. Image range information is determined in advance, and real object images are pre-acquired and stored, which simplifies the final assembly process and manages processing complexity effectively.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces image range information as an intermediary data structure that mediates between the original scene image and the final multi-layer display. This intermediary contains extracted real object images and their positioning information, simplifying the complex task of real-time object extraction and positioning by breaking it into manageable steps.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10783684B2Method and device for displaying image
Publication Date: 2020.09.22 BEIJING XIAOMI MOBILE SOFTWARE CO LTD
  • US10783684B2 patent drawing
  • US10783684B2 patent drawing
  • US10783684B2 patent drawing

AI summary

A method for displaying an image includes: receiving a setting instruction for performing upper layer display on an image of a target real object; determining image range information of the image of the target real object in a scene image frame upon the scene image frame is captured; acquiring the image of the target real object in the scene image frame based on the image range information; and setting an image of a preset target virtual object on an upper layer of the scene image frame, and setting the image of the target real object on an upper layer of the image of the target virtual object and the scene image frame based on the image range information.