AR Virtual Object Positioning via Reference Object Intermediary

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies for displaying virtual objects in relation to real objects in augmented or mixed reality environments do not effectively handle scenarios where the reference object and target object are not in the same view field, leading to inconsistencies and difficulties in maintaining accurate positional relationships.

Innovation Solution

An information processing apparatus that uses AR glasses or HMDs to set a first reference object and, if a second reference object identical or similar is recognized, virtually displays a target object in relation to the second reference object, employing image recognition and positional analysis to correct and maintain the display position of the virtual object based on the relative relationship between the first and second reference objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If virtual objects are displayed in augmented reality environments, then the integration of virtual and real-world elements is enhanced, but positional relationship inconsistencies occur when reference objects are not in the same view field

Engineering Contradiction:
Improvevirtual object display capabilityVSAvoidpositional relationship accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent introduces a reference object as an intermediary element to establish and maintain positional relationships. When a target object is not directly visible, the system uses a reference object (which is visible) as a mediator to infer the target object's position through pre-stored spatial relationships, thereby resolving the positional inconsistency problem

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary actions by pre-storing the positional relationships between reference objects and target objects in a database before the actual display operation. This advance preparation allows the system to quickly determine correct positional relationships during runtime without requiring real-time measurement of all objects

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If target objects not in the same view field are handled, then the system can display virtual objects based on reference objects, but the complexity of maintaining accurate positional relationships increases

Engineering Contradiction:
Improveobject recognition rangeVSAvoidpositional relationship maintenance
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a virtual copy of the target object's positional information by storing the relationship between the reference object and target object in advance. This copied spatial data allows the system to reconstruct the correct position without physically measuring or tracking the target object in real-time, simplifying the complexity

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The reference object serves as an intermediary that bridges the gap between the visible and invisible objects. By establishing relationships through the reference object, the system can maintain accurate positional relationships for target objects that are not directly observable, reducing the complexity of direct tracking

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20210279531A1Information processing apparatus and non-transitory computer readable medium storing program
Publication Date: 2021.09.09 FUJIFILM BUSINESS INNOVATION CORP
  • US20210279531A1 patent drawing
  • US20210279531A1 patent drawing
  • US20210279531A1 patent drawing

AI summary

An information processing apparatus includes a processor configured to set a first reference object, and if a second reference object identical or similar to the first reference object is recognized, virtually display a target object in relation to the second reference object. The target object is recognized in advance together with the first reference object.