Head-Mount Display Image Correction Using Motion Vector Interpolation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Head-mount displays face challenges in providing a clear image at a wide angle of view due to lens distortion in the eyepiece optical system, with existing correction methods either increasing device weight or requiring large correction tables for complex distortion patterns.

Innovation Solution

A display device with an image correction unit that uses motion vectors to correct distortion at representative pixels, interpolating these vectors for other pixels and applying them in opposite directions to counteract eyepiece optical system distortions, allowing for clear wide-angle viewing without significant weight increase or large correction data storage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If the number of lenses is increased to ensure wide angle of view, then the angle of view is improved, but the weight of the head-mount display increases

Engineering Contradiction:
Improveangle of viewVSAvoidweight of head-mount display
Core Design Contradiction:
Area of stationary objectVSWeight of moving object

Solution Approach 1:

The patent replaces the mechanical/optical correction system (additional lenses) with a signal processing system. The image correction unit processes image signals to correct distortion caused by the eyepiece optical system, eliminating the need for additional physical lenses while maintaining wide angle of view and reducing weight.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent applies preliminary correction to the image signal before it reaches the display elements. The image correction unit pre-distorts the image in the opposite direction of the expected optical distortion, so that when the light passes through the eyepiece lenses, the final image appears undistorted to the user.

Inventive Principle:
Principle #10Preliminary action

2Weight of moving object

If the number of lenses is decreased for weight saving, then the weight of the head-mount display is reduced, but the distortion generated in each lens is enlarged and correction capability is lost

Engineering Contradiction:
Improveweight of head-mount displayVSAvoidimage distortion correction
Core Design Contradiction:
Weight of moving objectVSManufacturing precision

Solution Approach 1:

The patent substitutes optical correction mechanisms with electronic signal processing. The image correction unit uses computational algorithms to correct distortion in the image signal, replacing the need for complex multi-lens optical correction systems and reducing overall device weight.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a corrected version of the image signal that compensates for optical distortion. By generating a pre-corrected image signal that accounts for the distortion characteristics of the eyepiece lenses, the system maintains image quality without requiring additional physical correction components.

Inventive Principle:
Principle #26Copying

3Weight of moving object

If signal processing is used to correct distortion, then the weight is reduced, but large correction tables are required for complex distortion patterns

Engineering Contradiction:
Improveweight of head-mount displayVSAvoidcorrection data storage
Core Design Contradiction:
Weight of moving objectVSQuantity of substance

Solution Approach 1:

The patent divides the correction process into discrete correction values for different regions of the display. Instead of storing complete correction tables for all pixels, the system uses a limited set of correction values corresponding to specific display elements, reducing storage requirements while maintaining correction effectiveness.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the approach from storing complete image correction tables to storing only essential correction parameters. By identifying and correcting distortion at key representative points in the optical system, the system reduces the quantity of correction data needed while effectively handling complex distortion patterns.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables clear and distortion-free wide-angle viewing in head-mount displays by effectively correcting eyepiece optical system distortions using motion vector interpolation, reducing the need for heavy lenses and minimizing correction data storage.

Implementation Method 1

an eyepiece optical unit configured to project the display surface of the image display unit in a manner that a predetermined angle of view is obtained

Methodology Applied
Scientific EffectRefraction: Refraction

Implementation Method 2

an image correction unit configured to correct a display image on the display surface at a position of each of representative pixels which are discretely located on the display surface, on the basis of distortion generated due to the eyepiece optical unit

Methodology Applied
Scientific EffectGeometric transformation:

Data Source

PatentUS10356375B2Display device, image processing device and image processing method, and computer program
Publication Date: 2019.07.16 SONY GROUP CORP
  • US10356375B2 patent drawing
  • US10356375B2 patent drawing
  • US10356375B2 patent drawing

AI summary

Provided is a display device including an image display unit configured to display an image with a plurality of pixels arranged on a display surface, an eyepiece optical unit configured to project the display surface of the image display unit in a manner that a predetermined angle of view is obtained, and an image correction unit configured to correct a display image on the display surface at a position of each of representative pixels which are discretely located on the display surface, on the basis of distortion generated due to the eyepiece optical unit.