Hybrid Animation System Integrating Hand-Drawn Line Work with 3D CGI

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing animated video creation methods face challenges in maintaining consistent line work across frames, especially in hand-drawn animation, and struggle to seamlessly integrate computer-generated imagery (CGI) with hand-drawn elements, leading to inconsistencies in subtle motions and appearances.

Innovation Solution

A method that generates a screen space velocity map to determine the dynamic velocity of pixels in animation frames, allowing for consistent animation of hand-drawn line work and CGI elements, and creates a 2D silhouette feature that remains stable over time, enabling coherent artistic effects across frames.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If hand-drawn animation is used to create animated video, then artistic flexibility and aesthetic quality are improved, but consistency of line work and appearance across frames deteriorates

Engineering Contradiction:

Improveartistic flexibilityVSAvoidconsistency of line work

Core Design Contradiction:

Ease of manufactureVSStability of the object's composition

Solution Approach 1:

The patent combines hand-drawn animation frames with CGI-generated elements to create a hybrid animation system. The CGI components provide consistent geometric references and motion data, while hand-drawn elements maintain artistic flexibility. This merging allows the system to leverage the strengths of both approaches: the artistic quality of hand-drawn frames and the consistency of computer-generated imagery.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The system uses motion estimation algorithms to analyze hand-drawn animation frames and generate CGI components that feedback into the overall animation. This feedback mechanism ensures that CGI elements adapt to the artistic style and motion patterns of hand-drawn frames, maintaining consistency while preserving artistic flexibility. The system continuously adjusts CGI parameters based on analysis of hand-drawn frame characteristics.

Inventive Principle:

Principle #23Feedback

2Stability of the object's composition

If CGI rendering is used to create animated video, then consistency of appearance and shading is improved, but artistic flexibility and hand-drawn aesthetic quality deteriorates

Engineering Contradiction:

Improveconsistency of appearanceVSAvoidartistic flexibility

Core Design Contradiction:

Stability of the object's compositionVSEase of manufacture

Solution Approach 1:

The patent segments the animation into distinct components: hand-drawn frames providing artistic foundation and CGI-generated elements providing consistent shading and geometric detail. By dividing the animation into separable components with different generation methods, the system achieves both artistic flexibility from hand-drawn portions and consistency from CGI portions, resolving the contradiction between these two requirements.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system creates a composite animation by combining hand-drawn frame data with CGI-generated imagery. This composite approach allows different materials (hand-drawn lines and CGI shading) to coexist in the same animation sequence, leveraging the artistic quality of hand-drawn elements and the consistency of CGI rendering to achieve both artistic flexibility and appearance consistency simultaneously.

Inventive Principle:

Principle #40Composite materials

3Adaptability or versatility

If motion estimation is performed on hand-drawn animation frames, then integration between hand-drawn and CGI elements is improved, but computational complexity and processing time increase

Engineering Contradiction:

Improveintegration of elementsVSAvoidcomputational complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system applies motion estimation selectively to key frames or critical regions of hand-drawn animation rather than processing every frame in full detail. This partial action approach maintains adequate integration between hand-drawn and CGI elements while reducing overall computational complexity. The motion estimation is performed at sufficient precision for integration purposes without excessive processing overhead.

Inventive Principle:

Principle #16Partial or excessive action

Solution Approach 2:

The patent performs preliminary motion analysis and extraction on hand-drawn frames before generating CGI components. By pre-processing the hand-drawn frames to extract motion vectors and transformation parameters in advance, the system reduces the computational burden during the actual CGI generation and integration phases. This preliminary action enables smoother integration with lower real-time processing requirements.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS9710951B2Techniques for processing image data generated from three-dimensional graphic models

Publication Date: 2017.07.18 DISNEY ENTERPRISES INC

AI summary

Techniques are disclosed for creating animated video frames which include both computer generated elements and hand drawn elements. For example, a software tool may allows an artist to draw line work (or supply other 2D image data) to composite with an animation frame rendered from a three dimensional (3D) graphical model of an object. The software tool may be configured to determine how to animate such 2D image data provided for one frame in order to appear in subsequent (or prior) frames in a manner consistent with changes in rendering the underlying 3D geometry.