Texture Synthesis Method for Video Detail Preservation and Flicker Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current texture synthesis methods fail to effectively maintain image details during scaling and compression, particularly in dynamic video frames, leading to flickering issues due to inadequate alignment of global and local motions.
Innovation Solution
A method involving feature extraction, application of criteria to derive positive and negative results, detail alignment, and blending of adjusted mapping results to generate single and multi-scale detail images, ensuring proper alignment and minimizing flicker.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If texture synthesis is applied to increase image details after scaling or compression, then image detail preservation is improved, but flickering occurs in dynamic video frames due to misalignment of synthesized details with global and local motions
Solution Approach 1:
The patent performs preliminary motion estimation and compensation before texture synthesis by estimating global motion between frames and local motion within blocks, then using these motion parameters to guide the synthesis process. This preliminary action ensures that synthesized details are pre-aligned with expected motion patterns, preventing flickering in dynamic sequences
Solution Approach 2:
The patent implements a feedback mechanism where motion estimation results from previous frames inform the current frame's texture synthesis. The global motion vector and local motion vectors are calculated from frame differences and fed back into the synthesis process to continuously adapt and maintain alignment of synthesized details with actual motion, eliminating flickering artifacts
2Manufacturing precision
If detail synthesis is applied to all image regions, then image detail enhancement is improved, but plain locations generate inappropriate textures that were not present in the original image
Solution Approach 1:
The patent applies local quality by differentiating between regions with high frequency content (edges, textures) and plain regions. Motion compensation is selectively applied based on local motion vector magnitude and image gradient analysis. In plain locations where motion is minimal and gradients are low, the patent suppresses texture synthesis to avoid generating inappropriate textures, while in regions with significant motion or existing texture, full synthesis is applied
Solution Approach 2:
The patent dynamically adjusts synthesis parameters based on local image characteristics. The synthesis strength parameter is modulated by local motion magnitude and frequency content analysis. In plain regions, the synthesis parameter is reduced or set to zero to prevent inappropriate texture generation, while in textured regions, full synthesis strength is maintained to preserve and enhance details
3Manufacturing precision
If multiple frames are processed for video texture synthesis, then video quality is improved, but computational complexity increases due to motion alignment requirements across frames
Solution Approach 1:
The patent segments the video processing into independent frame-wise operations with shared motion estimation. Each frame is processed separately for texture synthesis, but motion parameters are estimated once per frame and reused throughout the synthesis process. This segmentation allows parallel processing of multiple frames while minimizing redundant computations, maintaining video quality without excessive complexity
Solution Approach 2:
The patent implements a universal motion estimation and compensation framework that serves multiple functions: global motion estimation for overall frame alignment, local motion estimation for block-level details, and temporal consistency maintenance. This multi-functional approach eliminates the need for separate processing pipelines for different video quality aspects, reducing overall computational complexity while maintaining high video quality
Data Source
AI summary
The disclosure proposes a method of texture synthesis and an apparatus using the same. In one of the exemplary embodiments, the step of generating the first single scale detail image would include not limited to: performing a feature extraction of a first pixel block of an image frame to derive a first pixel feature, applying a first criteria to the first pixel feature to derive a positive result, performing a first detail alignment and a maximum extension of the positive result to derived an adjusted positive mapping result, applying a second criteria, which is opposite to the first criteria, to the first pixel feature to derive a negative result, performing a second detail alignment and a minimum extension of the negative result to derived an adjusted negative mapping result, and blending the adjusted positive mapping result and the adjusted negative mapping result to generate the first single scale detail image.