Sub-pixel Correction for Head-Mounted Display Color Aberration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing head-mounted display systems face challenges in correcting image distortion caused by lenses, leading to color aberration issues due to the assumption that sub-pixels emit light at a single point within a pixel, which becomes problematic as the viewing angle increases, affecting image quality, especially at the periphery.

Innovation Solution

An information processing system that includes a control portion to receive source image data, apply a conversion expression to correct lens distortion, and output corrected image data, taking into account the positions of sub-pixels within each pixel, using a graphics processing unit to calculate and interpolate pixel values for accurate color representation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If lenses with strong distortion are used to widen the viewing angle, then the viewing angle is increased, but color aberration occurs due to incorrect sub-pixel position correction

Engineering Contradiction:
Improveviewing angleVSAvoidcolor accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent applies different correction approaches to different regions of the display. Specifically, it calculates sub-pixel position corrections based on the local position within each pixel (using fractional parts of pixel coordinates), allowing the correction to vary locally across the display surface. This enables accurate color correction at each location while maintaining the wide viewing angle provided by strong lens distortion.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent changes the correction parameters dynamically based on the pixel position. By using the fractional parts of pixel coordinates (px, py) as correction amounts, the system adapts the correction parameters to match the local distortion characteristics at each position on the display, thereby maintaining color accuracy across the entire wide viewing angle range.

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If correction is performed assuming sub-pixels are at the pixel center, then the correction process is simple, but color aberration occurs at peripheral pixels

Engineering Contradiction:
Improvecorrection process complexityVSAvoidimage quality
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent segments the correction process into two parts: integer pixel coordinates determine the base correction, while fractional parts determine the sub-pixel position correction. This segmentation allows the system to maintain simplicity by using integer coordinates for overall positioning while adding only a fractional correction component for sub-pixel accuracy, avoiding the need for completely complex correction algorithms.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent adds a new dimension to the correction process by introducing fractional coordinate-based correction amounts. Instead of using only integer pixel coordinates, the system incorporates the fractional parts (decimal portions) as an additional correction dimension, enabling precise sub-pixel level correction without significantly increasing overall system complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentEP3349475B1Information processing system, information processing device, output device, program and recording medium
Publication Date: 2023.11.15 SONY INTERACTIVE ENTERTAINMENT LLC
  • EP3349475B1 patent drawingFigure 1~2
  • EP3349475B1 patent drawingFigure 3(a)~3(b)
  • EP3349475B1 patent drawingFigure 4

AI summary

An information processing apparatus provided with a display portion including a plurality of sub-pixels every pixel, connected to an output apparatus for presenting an image displayed on the display portion to a user through a lens, and producing the image to be displayed on the display portion receives source image data becoming an object of display, obtains a corresponding pixel on the source image data by information on a position of the sub-pixel and a predetermined conversion expression every sub-pixel included in a pixel with respect to the respective pixels constituting corrected image data, and determines luminances of the respective sub-pixels based on a pixel value of the pixel on the source image obtained every sub-pixel, thereby producing the corrected image data.