Image Enhancement via Region-Controlled Texture Synthesis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image enhancement techniques, such as sharpening and deep-learning methods, fail to effectively restore lost textures and edges in compressed videos due to high computational requirements and the generation of unnatural artifacts.

Innovation Solution

An image processing system utilizing a material image generating circuit and texture generating circuits to create texture images with specific directionalities and densities, which are regionally controlled based on source image characteristics for enhanced detail restoration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If deep learning image enhancement is used to restore lost textures and edges, then image enhancement quality is improved, but computing power requirements increase and control over regenerated textures becomes difficult

Engineering Contradiction:
Improveimage enhancement qualityVSAvoidcomputing power requirements
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the image enhancement process into distinct functional modules: a material image generating circuit that creates base texture patterns, and one or more texture generating circuits that apply these patterns to specific regions. This segmentation replaces the monolithic deep learning model with modular, computationally efficient components that can be independently controlled and optimized.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different texture synthesis strategies to different regions of the image based on local characteristics. The system analyzes regional features such as edge density, texture complexity, and semantic content, then adapts the texture generation parameters accordingly. This local quality approach allows precise control over regenerated textures in different areas without requiring global deep learning processing.

Inventive Principle:
Principle #3Local quality

2Productivity

If sharpening techniques are used to enhance high-frequency details, then processing speed is improved, but completely destroyed textures and edges cannot be restored

Engineering Contradiction:
Improveprocessing speedVSAvoidtexture restoration capability
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent performs preliminary action by generating material images with appropriate texture characteristics before applying them to the compressed image. The material image generating circuit creates texture patterns with controlled frequency, orientation, and density properties in advance, allowing rapid application through simple synthesis operations rather than requiring complex post-processing of completely lost details.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent changes key parameters of the texture generation process including frequency spectrum characteristics, orientation angles, and spatial density to match the original image content. By adjusting these parameters in the texture generating circuits, the system can restore various types of details (edges, textures, patterns) without requiring computationally intensive deep learning inference.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20230130835A1Image processing system and related image processing method for image enhancement based on region control and texture synthesis
Publication Date: 2023.04.27 REALTEK SEMICON CORP
  • US20230130835A1 patent drawing
  • US20230130835A1 patent drawing
  • US20230130835A1 patent drawing

AI summary

An image processing system includes: a material image generating circuit, at least one texture generating circuit and an output controller. The material image generating circuit is configured to generate a material image. The at least one texture generating circuit is coupled to the material image generating circuit, and configured to adjust texture characteristics of the material image to generate at least one texture image. The output controller is coupled to the at least one texture generating circuit, and configured to analyze regional characteristics of a source image to generate an analysis result, determine a region weight according to the analysis result, and synthesize the source image with the at least one texture image according to the region weight, thereby to generate an output image.