AR Display Region Segmentation for Reduced Latency

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Augmented reality (AR) images displayed using existing technologies often fail to track user or object movement accurately, resulting in display delays and discomfort due to the raster scanning system's timing variations, which are not effectively addressed by existing solutions like TimeWarp or Reprojection.

Innovation Solution

An information processing apparatus with a control unit that manages adjacent display regions with different timing, using position posture information to transform AR images in real-time, ensuring seamless superimposition over real space by forecasting and calculating transformation amounts for each slice of the display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a raster scanning system is used to display AR images, then the display device can cover a wide field of view, but display delays occur due to timing variations across different regions

Engineering Contradiction:

Improvefield of view coverageVSAvoiddisplay delay

Core Design Contradiction:

Area of stationary objectVSLoss of time

Solution Approach 1:

The display device is divided into multiple display regions (first display region and second display region) that are scanned at different timings. The control unit independently controls the display timing for each region, allowing asynchronous display operations that reduce overall display delays while maintaining wide field of view coverage.

Inventive Principle:

Principle #1Segmentation

2Productivity

If AR images are displayed in real-time, then user experience is improved, but tracking accuracy deteriorates due to movement between frames

Engineering Contradiction:

Improvereal-time display speedVSAvoidtracking accuracy

Core Design Contradiction:

ProductivityVSMeasurement precision

Solution Approach 1:

The control unit predicts the user's head position and posture at future time points based on current position posture information. By performing preliminary transformation calculations for multiple display regions at different future timings, the system maintains tracking accuracy even as the user moves, while still achieving real-time display updates.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts the display timing and transformation parameters for each display region based on predicted user movement. The control unit modifies display timing and image transformation in real-time according to forecasted position changes, maintaining both real-time performance and tracking accuracy.

Inventive Principle:

Principle #15Dynamics

3Measurement precision

If image transformation is applied to each display region, then tracking accuracy is improved, but computational complexity increases

Engineering Contradiction:

Improvetracking accuracyVSAvoidcomputational complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The control unit divides the display into multiple regions and applies image transformation independently to each region based on its specific display timing and predicted user position. This segmented approach improves tracking accuracy for each region while managing computational complexity through localized processing.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system changes display parameters (timing, transformation amounts) for each display region based on predicted user movement. By adjusting these parameters dynamically, the system achieves high tracking accuracy without requiring overly complex computational models for the entire display at once.

Inventive Principle:

Principle #35Parameter changes

4Productivity

If display timing varies across adjacent regions, then real-time display is achieved, but image continuity deteriorates due to tearing effects

Engineering Contradiction:

Improvereal-time display capabilityVSAvoidimage continuity

Core Design Contradiction:

ProductivityVSStability of the object's composition

Solution Approach 1:

The display is segmented into multiple regions with independent timing control. The control unit carefully coordinates the display timing and image transformation for each segment to maintain overall image continuity, reducing tearing effects while preserving real-time display capabilities.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system dynamically synchronizes the display timing and image transformation parameters across different regions based on predicted user movement. This dynamic coordination ensures that images displayed in adjacent regions remain continuous and coherent, preventing tearing artifacts while maintaining real-time performance.

Inventive Principle:

Principle #15Dynamics

Data Source

PatentUS11354874B2Information processing apparatus and information processing method

Publication Date: 2022.06.07 SONY GROUP CORP

AI summary

Provided is an information processing apparatus, including a control unit that controls a display device to display a first image in a first display region and a second display region, respectively, which are adjacent to each other and have mutually different display timing, so that the first image is superimposed over a real space as seen by a user of the display device, and that controls the display device to transform the first image in the first display region and the first image in the second display region on the basis of changes in position posture information relating to the display device.