AR Display Alignment for Movable Real Objects

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing augmented reality display systems struggle to accurately position and display AR objects when the arrangement of objects in a space changes, particularly with movable objects, leading to user discomfort due to misalignment or improper display.

Innovation Solution

An augmented reality display device equipped with a camera, distance measuring sensor, position and orientation sensor, and a controller that recognizes real objects, determines their movability, and adjusts the position of AR objects accordingly to match the current position of the real objects, ensuring proper alignment and display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Stability of the object's composition

If AR objects are arranged using absolute coordinates in space, then the AR object position is fixed and stable, but the system cannot adapt when the arrangement of real objects changes, leading to misalignment and user discomfort

Engineering Contradiction:

ImproveAR object position stabilityVSAvoidAdaptability to object arrangement changes

Core Design Contradiction:

Stability of the object's compositionVSAdaptability or versatility

Solution Approach 1:

The patent applies dynamics by transitioning from static absolute coordinate-based AR object positioning to dynamic relative position tracking. The system continuously monitors the positions of real objects and automatically adjusts AR object positions to maintain proper alignment, enabling the system to adapt to changing object arrangements while providing stable visual experience to users.

Inventive Principle:

Principle #15Dynamics

2Ease of operation

If the system uses markless AR with feature point extraction, then the system is more flexible and easier to operate, but the positioning precision deteriorates when objects move, causing incorrect AR object placement

Engineering Contradiction:

ImproveEase of AR object additionVSAvoidPositioning precision of AR objects

Core Design Contradiction:

Ease of operationVSMeasurement precision

Solution Approach 1:

The patent implements feedback mechanisms by continuously detecting the positions of real objects and using this information to adjust AR object positions. The system extracts feature points from camera images, tracks object movements, and provides feedback control to maintain accurate alignment between AR objects and their corresponding real objects, thereby preserving positioning precision despite object mobility.

Inventive Principle:

Principle #23Feedback

3Productivity

If the system displays AR objects based on initial object positions, then the display is simple and fast, but the system fails to account for movable objects, resulting in incorrect display when layout changes

Engineering Contradiction:

ImproveSpeed of AR object displayVSAvoidAccuracy of AR object display

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The patent ensures continuity of useful action by implementing continuous position detection and AR object position adjustment. Rather than performing discrete updates, the system continuously monitors real object positions and maintains accurate AR object alignment in real-time, ensuring both rapid response to layout changes and sustained display accuracy throughout the observation period.

Inventive Principle:

Principle #20Continuity of useful action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system allows for comfortable AR object display by maintaining alignment with movable objects, reducing user discomfort and ensuring accurate positioning even when the layout changes.

Implementation Method 1

a distance measuring sensor that measures a distance to a real object in the background image

Methodology Applied

Scientific EffectTime of Flight: Time of Flight

Implementation Method 2

a camera that captures a background image

Methodology Applied

Scientific EffectLight detection: Photoelectric Effect

Data Source

PatentUS20250378661A1Augmented reality display device and augmented reality display method

Publication Date: 2025.12.11 MAXELL LTD

AI summary

An augmented reality (AR) display device includes a camera that captures a background image; a distance measuring sensor that measures a distance to a real object in the background image; a position and orientation sensor that detects the position of the camera and the shooting direction of the camera; a controller that recognizes the real object from the background image captured by the camera and associates the predetermined AR object with the recognized real object; a display displaying an image of the associated AR object; and a memory that stores data of the real object and the AR object associated with each other. The controller determines whether or not the real object is movable from the measurement result of the distance measuring sensor, and arranges the AR object according to the current position of the real object when the position of the real object associated with the AR object moves.