AR Display Continuity via Movement-Compensated Projection Timing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In augmented reality applications, objects with three-dimensional information are often presented as two-dimensional displays, leading to delays in processing and potential blurring or discontinuity when the viewpoint's position or orientation changes, causing a gap between intended and actual display information.

Innovation Solution

An information processing apparatus and method that acquires object movement information and projects the object at specific timing intervals, correcting display information to maintain continuity by adjusting second display information based on first projection results, ensuring smooth presentation even during object movement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the object is projected and drawn at a lower frame rate to reduce processing load, then processing speed and energy consumption are improved, but the position or orientation of the viewpoint may change during processing, causing a gap between intended and actual display information

Engineering Contradiction:
Improveprocessing speedVSAvoiddisplay accuracy
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by predicting the viewpoint position at the display timing based on movement information acquired before projection. This allows the system to pre-calculate the correct projection parameters in advance, ensuring that even when processing takes time, the displayed information corresponds to the actual viewpoint position at display time rather than causing a gap or blur.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If the frame rate is increased to reduce the gap between intended and actual display information, then display accuracy is improved, but processing load and energy consumption increase

Engineering Contradiction:
Improvedisplay accuracyVSAvoidenergy consumption
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent changes the parameter of projection timing from fixed frame-based intervals to movement-compensated timing. By acquiring movement information and adjusting projection timing based on actual viewpoint changes, the system maintains high display accuracy without needing to increase frame rate, thus avoiding excessive energy consumption while still preventing the gap between intended and actual display information.

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If projection processing is performed at regular intervals, then processing simplicity is maintained, but blurring or discontinuity occurs when the object moves autonomously

Engineering Contradiction:
Improveprocessing simplicityVSAvoidpresentation continuity
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent implements feedback by continuously acquiring movement information of the viewpoint and using this information to adjust subsequent projection operations. This closed-loop approach ensures that projection timing and parameters are continuously adapted to actual movement, maintaining presentation continuity and preventing blurring while keeping the processing logic relatively simple through systematic feedback integration.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11615767B2Information processing apparatus, information processing method, and recording medium
Publication Date: 2023.03.28 SONY GROUP CORP
  • US11615767B2 patent drawing
  • US11615767B2 patent drawing
  • US11615767B2 patent drawing

AI summary

Even under a situation where an object to be presented has movement, the object can be presented as display information in a more favorable mode. An information processing apparatus includes an acquisition unit (111) that acquires information regarding movement of an object, and a control unit (111) that projects the object in a display region at a projection timing set according to a first period, and corrects display information according to a result of the projection in accordance with a plurality of display timings each set for each second period shorter than the first period, and the control unit controls correction of second display information to maintain continuity according to the movement of the object between first display information displayed according to a first projection result of the object in accordance with a first display timing, and the second display information displayed according to a second projection result of the object in accordance with a second display timing immediately after the first display timing.