Image Shift Correction for MR Display Lag and Stability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In Mixed Reality (MR) and Virtual Reality (VR) systems, the delay between head movement and image processing causes discomfort due to lag in displaying images, with existing solutions like shifting the timing of synchronizing signals leading to image disturbances.

Innovation Solution

An image processing device that includes an input unit for receiving image signals and synchronizing signals, an acceptance unit for vertical image shift instructions, and a correction unit that adjusts the synchronizing signal based on the shift amount, ensuring the image shift does not exceed a predetermined limit to prevent image disturbance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If the timing of a synchronizing signal is shifted to reduce display delay, then the image can follow head direction more quickly, but image disturbance such as image discontinuation or deviation occurs

Engineering Contradiction:
Improvedisplay delayVSAvoidimage stability
Core Design Contradiction:
Loss of timeVSReliability

Solution Approach 1:

The patent applies partial action by shifting the synchronizing signal timing only within a controlled range that does not exceed one horizontal scanning period. This partial shift is sufficient to reduce display delay and improve responsiveness to head movements, while remaining within bounds that prevent image disturbance and maintain image stability.

Inventive Principle:
Principle #16Partial or excessive action

2Loss of time

If image processing and CG rendering are performed simultaneously to reduce delay, then the system complexity increases

Engineering Contradiction:
Improveprocessing delayVSAvoidsystem complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The patent implements preliminary action by performing image processing on the captured camera image before CG rendering. The processed image is stored in a buffer, and CG rendering is subsequently performed using this pre-processed image as a background. This sequencing allows simultaneous operation of image processing and CG rendering without increasing system complexity, while still reducing overall display delay.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11263999B2Image processing device and control method therefor
Publication Date: 2022.03.01 CANON KK
  • US11263999B2 patent drawing
  • US11263999B2 patent drawing
  • US11263999B2 patent drawing

AI summary

Enabling generation of a display image giving less uncomfortable feeling. An image processing device comprises: an input unit configured to receive, as an image signal and a synchronizing signal, a frame image constituting a moving image; an acceptance unit configured to accept an image shift instruction instructing a change of a display position of the frame image in a vertical direction of a given display unit; a correction unit configured to correct the synchronizing signal on the basis of the image shift instruction; and an output unit configured to output the image signal and the corrected synchronizing signal in association with each other. If an image shift amount in the vertical direction included in the image shift instruction exceeds a predetermined amount, the correction unit performs correction corresponding to an image shift amount not more than the predetermined amount.