Depth-Based Image Sharpening to Reduce Haloing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image sharpening techniques often result in haloing or outlining effects due to color bleeding between pixels, which detract from the realism of the image.

Innovation Solution

The approach involves using depth-based image sharpening, where pixel depth values determine the relative relationship between pixels, allowing for the omission or weighting of pixels that exceed a threshold distance from the selected pixel, thereby reducing the bleeding effect and minimizing haloing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional color-based sharpening techniques are applied to enhance image contrast and make features stand out, then image sharpness and contrast are improved, but haloing or outlining effects occur due to color bleeding between pixels

Engineering Contradiction:
Improveimage sharpnessVSAvoidhaloing effect
Core Design Contradiction:
Measurement precisionVSObject-generated harmful factors

Solution Approach 1:

The patent applies different sharpening weights to different pixels based on their depth values. Pixels at depth boundaries receive different treatment compared to pixels within uniform depth regions, creating local quality variations that prevent color bleeding while maintaining sharpness enhancement where appropriate.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent changes the sharpening parameter (weight) dynamically based on depth information. By adjusting the sharpening weight according to depth values and depth thresholds, the system adapts the sharpening intensity to prevent haloing while maintaining edge definition.

Inventive Principle:
Principle #35Parameter changes

2Object-generated harmful factors

If depth-based weighting is applied to reduce color bleeding between pixels, then haloing effects are reduced, but the complexity of the sharpening process increases due to additional depth threshold calculations

Engineering Contradiction:
Improvecolor bleedingVSAvoidsharpening process complexity
Core Design Contradiction:
Object-generated harmful factorsVSDevice complexity

Solution Approach 1:

The patent performs preliminary depth threshold calculations and pixel classification before applying the sharpening operation. By pre-determining which pixels should receive full sharpening and which should receive reduced or no sharpening based on depth values, the system simplifies the actual sharpening computation while maintaining effectiveness.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240127409A1Depth based image sharpening
Publication Date: 2024.04.18 NVIDIA CORP
  • US20240127409A1 patent drawing
  • US20240127409A1 patent drawing
  • US20240127409A1 patent drawing

AI summary

Pixel depth information is used to determine a weight to apply to neighboring pixels when using a sharpening filter. A difference between neighboring pixel depths is evaluated and pixels with pixel depths that exceed a threshold are given less weight than other pixels. A sharpening mask may be generated using adjusted pixel colors.