Inverse Distortion Rendering in Head-Mounted Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional inverse distortion rendering methods in Head-Mounted Devices (HMDs) consume high power and degrade image quality, especially during 3D gaming and motion recognition, due to the need for a 2-pass rendering process that recalculates pixels and increases heat generation.

Innovation Solution

An electronic device and method that predicts the number of surfaces in image data to determine an optimal inverse distortion rendering mode, switching between 1-pass and 2-pass rendering based on the surface partition degree and vertex count to reduce power consumption and maintain image quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a 2-pass rendering process is used for inverse distortion rendering, then image quality can be maintained, but power consumption increases and heat generation occurs

Engineering Contradiction:
Improveimage qualityVSAvoidpower consumption
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent implements dynamic switching between 1-pass and 2-pass rendering modes based on real-time detection of image content characteristics. When the image contains simple geometric shapes or low-detail regions, the system selects 1-pass mode for power efficiency. When complex details or high-distortion regions are detected, the system switches to 2-pass mode to maintain image quality. This dynamic adaptation resolves the contradiction by optimizing the balance between power consumption and image quality based on actual rendering needs.

Inventive Principle:
Principle #15Dynamics

2Manufacturing precision

If a 2-pass rendering process is used for inverse distortion rendering, then distortion correction can be achieved, but rendering speed decreases due to double calculation

Engineering Contradiction:
Improvedistortion correction accuracyVSAvoidrendering speed
Core Design Contradiction:
Manufacturing precisionVSSpeed

Solution Approach 1:

The patent segments the rendering process into two distinct passes, each optimized for specific tasks. The first pass performs preliminary rendering and distortion analysis, identifying regions that require correction. The second pass focuses only on correcting identified distortion regions rather than re-rendering the entire image. This segmentation approach maintains distortion correction accuracy while reducing overall rendering time compared to traditional 2-pass rendering that processes all pixels through both passes.

Inventive Principle:
Principle #1Segmentation

3Manufacturing precision

If inverse distortion rendering is performed on 3D game images with complex surfaces, then image quality can be maintained, but power consumption and heat generation increase significantly

Engineering Contradiction:
Improveimage qualityVSAvoidheat generation
Core Design Contradiction:
Manufacturing precisionVSTemperature

Solution Approach 1:

The patent applies local quality analysis by examining specific regions of the image to determine the appropriate rendering mode. Instead of uniformly applying 2-pass rendering to the entire image, the system analyzes local image characteristics such as surface complexity, distortion magnitude, and detail density. Only regions requiring high-quality correction are processed with 2-pass rendering, while other regions use 1-pass rendering. This localized approach maintains image quality in critical areas while significantly reducing overall power consumption and heat generation.

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP3092613B1Image processing method and electronic device implementing the same
Publication Date: 2020.03.04 SAMSUNG ELECTRONICS CO LTD
  • EP3092613B1 patent drawingFigure 1
  • EP3092613B1 patent drawingFigure 2~3
  • EP3092613B1 patent drawingFigure 4~5a

AI summary

A method and electronic device for processing an image in an electronic device. The method includes predicting the number of surfaces which can be partitioned in image data; determining an inverse distortion rendering method corresponding to the predicted number of surfaces as a method for inverse distortion rendering of the image data; rendering the image data to a distorted image based on the determined inverse distortion rendering method; and displaying the distorted image.