Image Processing Scaling for HMD Chromatic Aberration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Head-mounted display devices suffer from the screen door effect, where pixels are visible to the user due to the lens enlargement, causing artifacts like visible colors at the edges of objects in the image.

Innovation Solution

An image processing device with a scaling unit and rendering unit that resizes and formats image data to prevent color visibility at edges, using sub-filters and scaling variables to correct chromatic aberration and reduce load in normal and wearable modes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a lens is used to enlarge the image in a head mounted display device, then the image can be provided directly to the user's eyes, but pixels become visible causing screen door effect and artifacts

Engineering Contradiction:
Improveimage provision to userVSAvoidpixel visibility and artifacts
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The image data is divided into multiple blocks, and each block is processed independently by assigning different scaling factors to different regions. This segmentation allows selective refinement of areas prone to artifacts while maintaining overall image quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different scaling factors are applied to different blocks of image data based on their specific characteristics. Blocks likely to produce artifacts use refinement scaling factors, while other blocks use standard scaling factors, optimizing quality locally where needed.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If image data is processed to prevent artifacts at edges, then display quality improves, but processing complexity increases

Engineering Contradiction:
Improvedisplay qualityVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The image is divided into blocks that are processed independently with different scaling strategies. This segmentation simplifies the overall processing by breaking down a complex global operation into manageable local operations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Refinement scaling is applied only to specific blocks where artifacts are likely to occur, rather than processing the entire image with maximum refinement. This partial action reduces processing complexity while maintaining quality where it matters most.

Inventive Principle:
Principle #16Partial or excessive action

3Manufacturing precision

If chromatic aberration is compensated by resizing image data, then color accuracy improves, but processing time increases

Engineering Contradiction:
Improvecolor accuracyVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The image processing is segmented into blocks that can be resized independently and in parallel. This segmentation enables simultaneous processing of multiple blocks, reducing total processing time while maintaining color accuracy through appropriate scaling factors.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Scaling factors are predetermined for different blocks based on their characteristics and chromatic aberration susceptibility. This preliminary preparation allows direct application of pre-calculated scaling without real-time computation, reducing processing time.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10455170B2Image processing device, display device, and head mounted display device
Publication Date: 2019.10.22 SAMSUNG DISPLAY CO LTD
  • US10455170B2 patent drawing
  • US10455170B2 patent drawing
  • US10455170B2 patent drawing

AI summary

An image processor includes a scaling unit configured to output converted data by resizing first image data; and a rendering unit configured to receive second image data, to output rendering data by rendering the second image data, and to calculate a target rendering data value based on data values corresponding to a first block of M*N among the second image data, where each of M and N is an integer greater than or equal to 2. Here, the second image data is the converted data, or the first image data is the rendering data.