AR Content Positioning After Marker Loss

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality (AR) technologies based on marker detection face challenges in continuing the display of AR content naturally after a marker is lost from the image, leading to unnatural and disjointed AR experiences.

Innovation Solution

An information processing system that acquires video data, detects objects and conditions related to the image pickup unit, and controls the display to show AR content associated with detected objects at positions other than their detected positions, based on conditions such as camera position and posture.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If AR content is displayed based on marker detection, then the AR content can be accurately positioned at the marker location, but the AR content cannot be continued to be displayed naturally after the marker is lost from the image

Engineering Contradiction:
Improvepositioning accuracyVSAvoidcontent display continuity
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system performs preliminary actions by detecting and tracking the marker while it is visible, establishing the spatial relationship between the marker and the camera before the marker is lost. This preliminary detection data is stored and used to continue displaying AR content at the last known position even after the marker disappears from the image, ensuring continuous and natural AR content display.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If AR content is continued to be displayed after marker loss, then the content display continuity is maintained, but the displayed content does not reflect the real space state and appears unnatural

Engineering Contradiction:
Improvecontent display continuityVSAvoidpositioning accuracy
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The system dynamically adjusts the AR content display based on the current state of marker detection. When the marker is detected, the AR content is positioned at the detected marker location. When the marker is lost, the system transitions to displaying AR content at the last known position, creating a dynamic adaptation that maintains natural appearance throughout the process.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12327324B2Image processing apparatus, image processing method, and program
Publication Date: 2025.06.10 SONY GROUP CORP
  • US12327324B2 patent drawing
  • US12327324B2 patent drawing
  • US12327324B2 patent drawing

AI summary

An information processing system that acquires video data captured by an image pickup unit; detects an object from the video data; detects a condition corresponding to the image pickup unit; and controls a display to display content associated with the object at a position other than a detected position of the object based on the condition corresponding to the image pickup unit.