Depth Value Correction Using Pixel Contribution Ratios

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for calculating depth values from stereo images or image plane phase difference pixels often result in inaccurate depth values due to the assumption that all pixels are at the same distance, leading to pseudo depth errors when pixels at different distances are included in the calculation.

Innovation Solution

An image processing device that calculates a contribution ratio for each pixel or region in the input image and uses this ratio to correct the depth value, distributing the depth value based on the contribution of each pixel to improve accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If depth value is calculated using conventional methods assuming all pixels are at the same distance, then calculation process is simple, but depth accuracy deteriorates when pixels at different distances are included

Engineering Contradiction:
Improvecalculation process complexityVSAvoiddepth value accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent segments the calculation process into two distinct stages: first calculating initial depth values using conventional methods, then performing correction by calculating contribution ratios for each pixel. This segmentation allows the system to maintain simple initial calculation while adding targeted correction only where needed, resolving the contradiction between simplicity and accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by calculating contribution ratios specifically for pixels that may be at different distances, rather than uniformly processing all pixels. The correction is applied locally to affected regions based on their specific contribution ratios, maintaining accuracy where needed while preserving simplicity in regions where conventional methods suffice.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If contribution ratio calculation and depth correction are performed for all pixels, then depth accuracy is improved, but calculation time increases

Engineering Contradiction:
Improvedepth value accuracyVSAvoidcalculation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent implements partial action by performing contribution ratio calculation and depth correction only for pixels that are likely to be affected by distance variations, rather than uniformly processing all pixels. This selective approach achieves sufficient depth accuracy improvement while minimizing the additional calculation time required.

Inventive Principle:
Principle #16Partial or excessive action

3Quantity of substance

If pixels at different distances are included in depth calculation, then more pixels contribute to depth value, but pseudo depth errors occur

Engineering Contradiction:
Improvenumber of contributing pixelsVSAvoiddepth calculation reliability
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent changes the parameter of pixel contribution by introducing contribution ratios that vary for each pixel based on its distance characteristics. Pixels at different distances are assigned different contribution ratios, allowing more pixels to contribute to the depth calculation while maintaining reliability through weighted contribution rather than uniform treatment.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12136193B2Image processing device and image processing method for correcting a depth value of a pixel or region of an image based on a contribution ratio
Publication Date: 2024.11.05 SONY GROUP CORP
  • US12136193B2 patent drawing
  • US12136193B2 patent drawing
  • US12136193B2 patent drawing

AI summary

An image processing device includes: a contribution ratio calculation unit that calculates a contribution ratio of a predetermined pixel or a predetermined region in depth calculation in each of a plurality of pixels or a plurality of regions included in an input image; and a correction unit that corrects a depth value of the predetermined pixel or the predetermined region based on the contribution ratio.