Content-Adaptive Edge Enhancement for Image Sharpness and Noise Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing edge and detail enhancement techniques for digital video processing, such as LTI/CTI and peaking, often introduce artifacts or fail to effectively enhance images with soft transitions or complex textures, particularly on human faces and in noisy environments.

Innovation Solution

A content-adaptive edge and detail enhancement algorithm that uses image analysis to create masks for controlling LTI/CTI and peaking techniques, incorporating a skin tone detection module to adjust LTI/CTI gain and applying negative coring to reduce noise in flat areas without compromising edge and detail enhancement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If LTI/CTI technique is used to steepen the Luma/Chroma transition slope, then image sharpness is improved, but unexpected artifacts and false contours are introduced

Engineering Contradiction:
Improveimage sharpnessVSAvoidartifacts and false contours
Core Design Contradiction:
Manufacturing precisionVSObject-generated harmful factors

Solution Approach 1:

The patent applies different enhancement strengths to different regions of the image based on edge strength detection. Areas with strong edges receive higher LTI/CTI gain for sharpness enhancement, while areas with weak or no edges receive reduced or no enhancement to avoid artifacts. This local adaptation resolves the contradiction by making the enhancement quality-dependent rather than uniform.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent dynamically adjusts the LTI/CTI gain parameter based on the detected edge strength at each pixel location. The gain is not fixed but varies continuously based on local image characteristics, allowing the system to optimize sharpness where needed while avoiding artifacts in flat or texture-rich regions.

Inventive Principle:
Principle #15Dynamics

2Manufacturing precision

If peaking technique is used to amplify high frequency information, then image sharpness is improved, but noise is amplified in flat areas

Engineering Contradiction:
Improveimage sharpnessVSAvoidnoise in flat areas
Core Design Contradiction:
Manufacturing precisionVSObject-affected harmful factors

Solution Approach 1:

The patent applies content-adaptive masking to control peaking operation. A mask is generated based on edge strength detection to identify regions where peaking should be applied (areas with edges and textures) versus regions where it should be suppressed (flat areas). This ensures high frequency amplification occurs only where it improves sharpness without amplifying noise in flat regions.

Inventive Principle:
Principle #3Local quality

3Manufacturing precision

If LTI/CTI technique is applied to human faces, then edge transitions are steepened, but false contours are introduced on skin tones

Engineering Contradiction:
Improveedge transition sharpnessVSAvoidfalse contours on faces
Core Design Contradiction:
Manufacturing precisionVSObject-generated harmful factors

Solution Approach 1:

The patent detects skin tone regions and applies reduced LTI/CTI gain specifically to those areas. By identifying the unique color characteristics of human skin and applying different enhancement parameters to those regions compared to other areas, the system preserves edge sharpness in non-face regions while avoiding false contours on faces.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9031321B2Content adaptive edge and detail enhancement for image and video processing
Publication Date: 2015.05.12 TEXAS INSTRUMENTS INC
  • US9031321B2 patent drawing
  • US9031321B2 patent drawing
  • US9031321B2 patent drawing

AI summary

A content-adaptive edge and detail enhancement apparatus is described for image/video processing. Both 2D peaking and LTI/CTI are used in sharpening pictures. Image analysis is performed to generate a blending factor to control the use of the two peaking techniques. The strength or likelihood of edges or transitions is measured and such a strength or likelihood measurement will be transformed into the blending factor controlling the blending of the LTI/CTI and peaking outputs.