XR Image Deformation for Delay and Optical Distortion Correction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing XR HMD technologies fail to account for optical system distortion when correcting images for delay compensation, leading to image distortion and user discomfort.

Innovation Solution

An information processing device and method that estimates device position and posture using sensors, and performs image deformation based on both sensor data and optical system distortion information to correct for both delay and distortion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image deformation is performed multiple times using sensor data for delay compensation, then the image correction accuracy improves, but optical system distortion is not accounted for causing image distortion

Engineering Contradiction:

Improveimage correction accuracyVSAvoidimage display accuracy

Core Design Contradiction:

Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent combines delay compensation processing and optical distortion correction processing into a single integrated image deformation step. Instead of performing these as separate operations, the system merges both corrections into one comprehensive transformation that accounts for both temporal delay and optical system characteristics simultaneously, resolving the contradiction between improved correction frequency and optical distortion accuracy.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The patent creates a composite correction approach by integrating multiple correction methodologies (delay compensation based on sensor data and optical distortion correction based on optical system information) into a unified image processing pipeline. This composite approach ensures that both temporal and optical factors are addressed together, achieving accurate image display without the distortion issues that arise from separate processing steps.

Inventive Principle:

Principle #40Composite materials

2Productivity

If distortion correction is performed after or at the same time as delay compensation, then processing efficiency is maintained, but light emission time difference between pixels is not accounted for leading to image distortion

Engineering Contradiction:

Improveprocessing efficiencyVSAvoidimage display accuracy

Core Design Contradiction:

ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by incorporating optical distortion correction parameters into the image deformation process before actual display. By pre-calculating and integrating the distortion correction transformation with the delay compensation transformation, the system ensures that light emission time differences are accounted for in advance, preventing image distortion while maintaining processing efficiency.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent changes the parameters of the image deformation process by incorporating optical system distortion information as an additional transformation parameter. This allows the system to adjust the deformation calculations to account for both temporal delay and optical distortion, achieving accurate image display without sacrificing processing speed through inefficient sequential operations.

Inventive Principle:

Principle #35Parameter changes

3Loss of time

If image deformation is performed based only on sensor data, then delay compensation is achieved, but optical system distortion causes the image to be distorted

Engineering Contradiction:

Improvedisplay delayVSAvoidimage display accuracy

Core Design Contradiction:

Loss of timeVSManufacturing precision

Solution Approach 1:

The patent merges delay compensation and optical distortion correction into a single integrated image deformation operation. By combining these two previously separate processing steps into one unified transformation that uses both sensor data and optical system information, the system achieves both timely display and accurate image representation simultaneously.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces an intermediary transformation step that bridges sensor-based delay compensation and optical distortion correction. This intermediary process integrates both types of information into a comprehensive image deformation calculation, ensuring that neither delay nor distortion compromises image display accuracy.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS20250363588A1Information processing device, information processing method, and program

Publication Date: 2025.11.27 SONY GROUP CORP

AI summary

An information processing device includes: an own position/posture estimation unit that estimates a position and a posture of a device based on sensing information acquired by a sensor unit, and outputs own position/posture information; and an image deformation unit that performs deformation processing on an image based on the own position/posture information and distortion of an optical system included in the device.