Head-Mounted Display Lens Distortion Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing head-mounted display systems with lenses that cause distortion issues due to misalignment between the optical axis and the display center, leading to incorrect presentation of depth perception.

Innovation Solution

An information processing system that includes a head-mounted display with sub-pixels and lenses, which measures assembly errors and produces corrected image data to align pixel positions with the optical axis, ensuring accurate depth perception by canceling lens distortion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If lenses with strong distortion are used to widen the viewing angle, then the viewing angle is improved, but the manufacturing precision deteriorates due to alignment errors between the optical axis and display center

Engineering Contradiction:
Improveviewing angleVSAvoidalignment precision
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by pre-calculating and applying reverse distortion correction to the images before they are displayed. The correction amount is determined based on the strong distortion characteristics of the lenses, and the corrected images are stored in advance. This ensures that when the images pass through the distorted lenses, the distortion effects are canceled out, achieving accurate depth perception without requiring perfect manual alignment of the lenses.

Inventive Principle:
Principle #10Preliminary action

2Ease of manufacture

If manual alignment of lenses and displays is performed, then the assembly process is simple, but the manufacturing precision deteriorates due to mounting position errors

Engineering Contradiction:
Improveassembly simplicityVSAvoidmounting position accuracy
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The patent implements feedback by measuring the actual position of each lens relative to its corresponding display, determining the specific distortion characteristics for each lens, and then adjusting the correction amount for each lens's image accordingly. This individualized correction approach compensates for mounting position errors, allowing simple manual assembly while achieving precise optical alignment through software-based distortion correction.

Inventive Principle:
Principle #23Feedback

3Manufacturing precision

If distortion correction is applied to compensate for lens errors, then the manufacturing precision is improved, but the device complexity increases due to additional correction processing

Engineering Contradiction:
Improveoptical alignment accuracyVSAvoidcorrection processing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent reduces device complexity by performing distortion correction in advance during the image preparation stage. The correction amounts are calculated based on measured lens positions and distortion characteristics, and the corrected images are stored for direct display. This eliminates the need for real-time complex calculations during operation, simplifying the overall system while maintaining high optical alignment accuracy.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system effectively presents an intended sense of distance to the user by correcting image data based on assembly errors, ensuring proper alignment and reducing distortion, thus enhancing the virtual reality experience.

Implementation Method 1

a lens disposed on a display surface side of the display portion

Methodology Applied
Scientific EffectRefraction: Refraction

Data Source

PatentUS10672110B2Information processing system, information processing apparatus, output apparatus, program, and recording medium
Publication Date: 2020.06.02 SONY INTERACTIVE ENTERTAINMENT LLC
  • US10672110B2 patent drawing
  • US10672110B2 patent drawing
  • US10672110B2 patent drawing

AI summary

To solve a problem that when there is an error in a mounting position in mounting a lens and thus an optical axis of the lens and a center of a display is shifted, centers of images seen by the left and right eyes of a user individually, are shifted and thus an intended sense of distance cannot be presented to the user. An output apparatus includes a display portion including a plurality of sub-pixels every pixel, and a lens arranged on a display surface side of the display portion, and outputs information on an assembly error representing position shift between an optical axis of the lens and a center of the display portion. An information processing apparatus produces corrected image data obtained by correcting image data becoming an object of display based on the information on the assembly error output from the output apparatus.