Active Mask for Patch Synthesis Processing Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional patch synthesis techniques in digital image editing require substantial processing time and resources, making them non-interactive and unsuitable for devices with limited computing power, as they continue to process pixels that have already converged, offering no further improvement.

Innovation Solution

The implementation of an active mask to differentiate between active and converged pixels within a target region, limiting further processing only to active pixels, thereby reducing unnecessary computations and optimizing resource usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If conventional patch synthesis techniques process all pixels in the target region during each iteration, then complete coverage of the target region is achieved, but processing time and computing resources are substantially increased

Engineering Contradiction:
Improvesynthesis completenessVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent segments the target region pixels into two distinct groups using an active mask: active pixels that require processing and inactive pixels that have converged. This segmentation allows the synthesis algorithm to selectively process only the necessary portion of pixels in each iteration, thereby reducing overall processing time while maintaining complete coverage of the target region.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of processing all pixels uniformly, the patent applies partial action by limiting processing to only those pixels marked as active in the active mask. This partial processing approach prevents unnecessary computations on converged pixels while ensuring that all necessary pixels receive the required processing attention across multiple iterations.

Inventive Principle:
Principle #16Partial or excessive action

2Measurement precision

If conventional patch synthesis techniques perform iterative analysis on all pixels, then accurate correspondence identification is achieved, but computing resources are excessively consumed

Engineering Contradiction:
Improvecorrespondence accuracyVSAvoidcomputing resources
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The active mask segments pixels based on their convergence status, separating those that have achieved accurate correspondence from those that still require analysis. This segmentation enables the system to maintain high correspondence accuracy for pixels that need it while avoiding wasteful consumption of computing resources on pixels that have already converged.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The active mask serves as a self-updating mechanism that automatically identifies which pixels require further processing based on their own convergence status. This self-service approach allows the system to dynamically adjust its processing requirements without external intervention, optimizing resource allocation while maintaining accuracy.

Inventive Principle:
Principle #25Self-service

3Reliability

If patch synthesis continues processing all pixels through multiple iterations, then convergence is ensured, but processing efficiency is significantly reduced

Engineering Contradiction:
Improveconvergence assuranceVSAvoidprocessing efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The active mask introduces dynamics into the processing system by continuously updating its state based on pixel convergence status. This dynamic approach allows the system to adaptively adjust which pixels require processing in each iteration, ensuring convergence is maintained while significantly improving processing efficiency compared to static full-pixel processing.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The active mask functions as a feedback mechanism that monitors pixel convergence status and uses this information to control subsequent processing. This feedback loop ensures that processing continues only where necessary, maintaining convergence assurance while eliminating redundant computations that would otherwise reduce processing efficiency.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9710898B2Image synthesis utilizing an active mask
Publication Date: 2017.07.18 ADOBE INC
  • US9710898B2 patent drawing
  • US9710898B2 patent drawing
  • US9710898B2 patent drawing

AI summary

Embodiments of the present invention provide systems, methods, and computer storage media directed at image synthesis utilizing an active mask. In one embodiment, input is received that identifies a target region within an image that is to be synthesized. A patch synthesis technique can then be performed to synthesize the target region based on portions of a source region that are identified by the patch synthesis technique. In embodiments, the patch synthesis technique includes, for at least one iteration, generating an active mask that indicates one or more portions of the target region as inactive. This active mask can be utilized by at least one process of the patch synthesis technique to ignore the one or more portions indicated as inactive by the active mask for the at least one iteration of the patch synthesis technique. Other embodiments may be described and/or claimed.