AR Virtual Object Position Hold Beyond Marker Tracking Limits

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality techniques restrict the display of virtual objects by features in a real space, requiring markers to maintain a predetermined state, making it difficult to display virtual objects without them.

Innovation Solution

An image processing program that updates and interrupts the display reference information of virtual objects based on real-space information, allowing users to fix the display reference as desired, enabling the display of virtual objects without reliance on specific markers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a virtual object is displayed based on a marker position and posture, then the virtual object can be accurately positioned in the real space, but the marker must be maintained in a predetermined state which restricts the display flexibility

Engineering Contradiction:
Improveposition accuracyVSAvoiddisplay flexibility
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies dynamics by making the display reference information update mechanism adaptable rather than fixed. The system dynamically adjusts whether to update display reference information based on predetermined conditions (marker detection status and update permission flags). When update permission is disabled, the system maintains the last valid reference information, allowing the virtual object to be displayed flexibly even when marker conditions change, thus resolving the contradiction between position accuracy and display flexibility.

Inventive Principle:
Principle #15Dynamics

2Reliability

If display reference information is continuously updated based on marker tracking, then the virtual object position remains accurate, but it becomes difficult to display virtual objects when marker conditions are not met

Engineering Contradiction:
Improvedisplay accuracyVSAvoiddisplay capability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent applies preliminary action by pre-configuring update permission flags and predetermined conditions before display operations. The system prepares multiple display reference information sets and update permissions in advance, allowing it to switch between different update modes based on marker detection status. This enables the system to maintain display capability even when marker conditions are not met, as the pre-prepared reference information can be used without requiring real-time marker tracking.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If the system requires marker detection to update virtual object position, then positioning accuracy is maintained, but the system cannot display virtual objects without markers

Engineering Contradiction:
Improveposition precisionVSAvoidmarker independence
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies copying by creating and storing multiple display reference information copies that can be used independently of real-time marker detection. The system maintains reference information from previous valid marker detections and can reuse these copies when markers are not detected or when update permission is disabled. This allows the virtual object to be displayed without requiring continuous marker presence, achieving marker independence while maintaining positioning precision through the use of validated reference information.

Inventive Principle:
Principle #26Copying

Data Source

PatentEP2717227B1Image processing program, image processing device, image processing system, and image processing method
Publication Date: 2026.02.18 NINTENDO CO LTD
  • EP2717227B1 patent drawingFigure 1
  • EP2717227B1 patent drawingFigure 2
  • EP2717227B1 patent drawingFigure 3

AI summary

[Object] Easing a restriction imposed on a display of a virtual object by a feature in a real space in augmented reality techniques. [Means for Solution] An image processing program causes a computer to function as: a display reference information updating unit 23 which updates at least any of a position and a posture of a virtual object in a virtual space based on information obtained from a real space; an image generating unit 25 which generates an image of a virtual space including the virtual object; a display control unit 26 which causes a display device 16 to display an image so that the image of the virtual space is superimposed on the real space so as to be viewed by a user; and an update interrupting unit 27 which interrupts an update of at least any of a position and a posture of the virtual object in the virtual space when predetermined conditions are met.