Appearance Transfer for Fluid Animation Coherence

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional techniques for generating fluid animations, such as those involving fire or water, often result in a 'washed out' appearance due to biased patch transfer and lack of temporal coherence, leading to jerking motion and artifacts between frames.

Innovation Solution

The proposed solution involves an appearance transfer technique that selects dynamic patches from an image exemplar using a search and vote process, employs a patch usage counter to ensure uniform patch usage, differentiates between boundary and interior portions, and uses temporal coherence methods to maintain consistent motion and color across frames, thereby preserving a realistic and dynamic appearance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional patch transfer techniques are used to generate fluid animations, then the process is simple and fast, but the appearance becomes 'washed out' and loses dynamic characteristics

Engineering Contradiction:
Improveanimation generation speedVSAvoidappearance realism
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent inverts the conventional patch transfer approach by selecting patches from the image exemplar first and then searching for their locations in the target image, rather than selecting target patches and finding matching exemplar patches. This inversion ensures dynamic patch selection and prevents the washed-out appearance while maintaining computational efficiency

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The patent implements a patch usage counter that tracks how many times each patch from the image exemplar has been used. This feedback mechanism ensures uniform patch usage across the animation, preventing overuse of certain patches that would cause the washed-out effect while maintaining realistic dynamic appearance

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If patch selection varies significantly between frames, then dynamic appearance is maintained, but temporal coherence is lost causing jerking and pulsing artifacts

Engineering Contradiction:
Improvedynamic appearanceVSAvoidtemporal coherence
Core Design Contradiction:
Adaptability or versatilityVSStability of the object's composition

Solution Approach 1:

The patch usage counter provides frame-to-frame feedback by tracking patch usage across the animation sequence. This ensures that patches are used uniformly over time, maintaining temporal coherence and preventing jerking artifacts while still allowing dynamic appearance through the inverted selection process

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent dynamically adjusts patch selection by using the patch usage counter to modulate which patches are selected in each frame. This dynamic approach maintains temporal coherence by preventing excessive variation between frames while still preserving the dynamic appearance of the fluid animation

Inventive Principle:
Principle #15Dynamics

3Device complexity

If boundary portions are not specifically handled, then processing is simpler, but the edge of the flame and boundary appearance becomes unrealistic

Engineering Contradiction:
Improveprocessing complexityVSAvoidboundary realism
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent applies local quality by treating boundary portions differently from interior portions of the image exemplar. Boundary patches are selectively transferred to maintain realistic edge appearance of the flame, while interior patches are handled differently. This localized approach enhances boundary realism without significantly increasing overall processing complexity

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9870638B2Appearance transfer techniques
Publication Date: 2018.01.16 ADOBE INC
  • US9870638B2 patent drawing
  • US9870638B2 patent drawing
  • US9870638B2 patent drawing

AI summary

Appearance transfer techniques are described in the following. In one example, a search and vote process is configured to select patches from the image exemplar and then search for a location in the target image that is a best fit for the patches. As part of this selection, a patch usage counter may also be employed in an example to ensure that selection of each of the patches from the image exemplar does not vary by more than one, one to another. In another example, transfer of an appearance of a boundary and interiors regions from the image exemplar to a target image is preserved.