AR Virtual Object Positioning via Importance-Based Superimposition Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality techniques struggle to appropriately display virtual objects in real spaces due to the restriction of superimposition-prohibited real objects, often resulting in virtual objects being displayed at positions far from their intended location when surrounded by such objects.

Innovation Solution

An information processing apparatus that recognizes real objects, determines the allowable degree of superimposition based on importance and distance, and adjusts the display position of virtual objects using a combination of importance and position maps to ensure appropriate placement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the display position of a virtual object is controlled to avoid superimposition-prohibited real objects, then the real objects are not hidden, but the virtual object may be displayed in a position far from the original position

Engineering Contradiction:
Improvedisplay accuracyVSAvoiddisplay position control
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent changes the parameter of superimposition control from binary (prohibited/allowed) to continuous (allowable degree of superimposition). By introducing an importance value that ranges continuously, the system can adjust the display position of virtual objects based on the degree of overlap with real objects, rather than simply avoiding all prohibited regions. This resolves the contradiction by allowing flexible position control that maintains display accuracy while respecting real object visibility requirements.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent makes the superimposition control dynamic by calculating an allowable degree of superimposition that varies depending on the importance value of each real object. Instead of using fixed prohibited zones, the system dynamically adjusts the display position based on real-time evaluation of importance values and virtual object positions, enabling adaptive control that balances display accuracy with real object visibility.

Inventive Principle:
Principle #15Dynamics

2Loss of information

If a virtual object is displayed in association with a real object, then the virtual object provides relevant information, but it may obscure important real objects

Engineering Contradiction:
Improveinformation deliveryVSAvoidocclusion of real objects
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent applies local quality by assigning different importance values to different real objects based on their specific characteristics and contexts. Each real object is evaluated individually, allowing the system to permit greater superimposition on less important objects while protecting more important objects from occlusion. This enables selective information delivery that preserves critical real object visibility while maintaining association with relevant objects.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system uses feedback by continuously evaluating the importance values of real objects and adjusting the display position of virtual objects accordingly. The determination unit calculates the allowable degree of superimposition based on the importance values, creating a feedback loop that ensures virtual objects are displayed in positions that minimize occlusion of important real objects while maintaining information delivery.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10043313B2Information processing apparatus, information processing method, information processing system, and storage medium
Publication Date: 2018.08.07 CANON KK
  • US10043313B2 patent drawing
  • US10043313B2 patent drawing
  • US10043313B2 patent drawing

AI summary

To appropriately superimpose and display a virtual object on an image of a real space, an information processing apparatus according to exemplary embodiment of the present invention determines the display position of the virtual object based on information indicating an allowable degree of superimposition of a virtual object on each real object in the image of the real space, and a distance from a real object for which a virtual object is to be displayed in association with the real object.