VR Image Distortion Correction via Depth-Based Pixel Interpolation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

VR images corrected using typical image processing techniques suffer from low image quality due to distortion caused by lenses in VR devices, leading to user fatigue and reduced immersion.

Innovation Solution

A method and device for processing images that calculate and apply distortion correction ratios and depth values of pixels based on interpolation, effectively correcting lens-induced distortions such as pincushion distortion by determining and adjusting pixel locations and depth values, thereby generating high-quality distortion-corrected images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If typical image processing techniques are used to correct lens distortion, then distortion correction is achieved, but image quality deteriorates

Engineering Contradiction:
Improvedistortion correction accuracyVSAvoidimage quality
Core Design Contradiction:
Manufacturing precisionVSMeasurement precision

Solution Approach 1:

The patent segments the image into multiple regions based on depth information, applying different distortion correction parameters to each region. This allows precise correction for each depth layer while maintaining overall image quality, resolving the contradiction between correction accuracy and image quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by using depth-dependent distortion correction parameters, where different regions of the image receive customized correction based on their depth values. This ensures high correction accuracy for each local region while preserving global image quality.

Inventive Principle:
Principle #3Local quality

2Reliability

If distortion correction is applied to VR images, then user immersion is improved, but computational complexity increases

Engineering Contradiction:
Improveuser immersionVSAvoidcomputational complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent performs preliminary action by pre-calculating depth information and distortion correction parameters before the actual distortion correction process. This preparation reduces the computational burden during real-time rendering, maintaining user immersion while lowering computational complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent substitutes complex mechanical distortion correction with a computational approach using depth-based parameter modulation. This replaces traditional iterative optimization methods with direct parameter application, reducing computational complexity while maintaining immersion quality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentEP3523961B1Method, device and recording medium for processing image
Publication Date: 2024.02.14 SAMSUNG ELECTRONICS CO LTD
  • EP3523961B1 patent drawingFigure 1
  • EP3523961B1 patent drawingFigure 2
  • EP3523961B1 patent drawingFigure 3~4

AI summary

A method of processing an image in a device, and the device thereof are provided. The method includes determining a distortion correction ratio of each of a plurality of vertices included in a source image, based on information about a lens through which the source image is projected, determining corrected location information of pixels located between the plurality of vertices, based on the distortion correction ratio of each of the plurality of vertices and interpolation ratios of the pixels, and rendering a distortion-corrected image including pixels determined as a result of performing interpolation on the plurality of vertices based on the corrected location information.