Morphing Animation Generation via Hue Preprocessing and Feature Point Warping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image warping technologies for morphing animations from multiple images face challenges in achieving controllable and high-quality morphing effects, with existing methods being either too complex or lacking in intuitive control over the morphing process.

Innovation Solution

The method involves performing hue preprocessing on adjacent images to reduce hue differences and determining the quantity of intermediate frames based on feature point differentials, using image warping technology to generate intermediate frame images, which are then inserted between the adjacent images to improve the morphing animation's smoothness and naturalness.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If block-based image warping is used to achieve high warping speed, then processing efficiency is improved, but the complexity of image preprocessing and block division increases

Engineering Contradiction:
Improvewarping speedVSAvoidpreprocessing complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent divides the image into multiple blocks and processes each block independently through hue preprocessing and feature point detection. This segmentation approach enables parallel processing of different blocks, maintaining high warping speed while reducing the overall preprocessing complexity through modularization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs hue preprocessing on each block before conducting feature point detection and warping operations. This preliminary action of adjusting hue values in advance simplifies subsequent processing steps by reducing color variations within blocks, thereby maintaining efficiency while managing preprocessing complexity.

Inventive Principle:
Principle #10Preliminary action

2Ease of operation

If point-based warping with radial basis function is used to achieve intuitive spatial mapping, then warping control is improved, but warping speed decreases due to complicated functions

Engineering Contradiction:
Improvewarping control intuitivenessVSAvoidwarping speed
Core Design Contradiction:
Ease of operationVSSpeed

Solution Approach 1:

The patent segments the image into blocks and performs point-based warping with radial basis function on each block independently. This segmentation reduces the computational burden by limiting the complex calculations to smaller regions, thereby maintaining warping control intuitiveness while improving overall warping speed through localized processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies the computationally intensive radial basis function warping only to selected feature points within each block rather than all pixels. This partial action approach maintains the intuitive control benefits of point-based warping while significantly reducing the computational complexity and improving processing speed.

Inventive Principle:
Principle #16Partial or excessive action

3Adaptability or versatility

If radial basis function warping is used to achieve spatial mapping, then warping flexibility is improved, but warping speed decreases and border stability is compromised

Engineering Contradiction:
Improvewarping flexibilityVSAvoidwarping speed
Core Design Contradiction:
Adaptability or versatilityVSSpeed

Solution Approach 1:

The patent divides the image into blocks and applies radial basis function warping separately to each block. This segmentation maintains the flexibility and adaptability of point-based warping within each local region while improving overall processing speed by reducing the computational domain. It also helps maintain border stability by treating each block independently with its own feature points.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs hue preprocessing and feature point detection locally within each block, allowing different blocks to have different warping characteristics based on their local content. This local quality approach maintains warping flexibility for diverse image regions while improving speed through localized processing, and ensures border stability by independently controlling each block's transformation.

Inventive Principle:
Principle #3Local quality

4Manufacturing precision

If more intermediate frames are generated to improve morphing smoothness, then morphing quality is improved, but processing time and computational load increase

Engineering Contradiction:
Improvemorphing qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent generates intermediate frames by processing each block independently through hue preprocessing and feature point warping. This segmentation allows for efficient generation of multiple intermediate frames by parallel processing different blocks, thereby improving morphing quality through smoother transitions while minimizing the increase in processing time through distributed computation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs hue preprocessing on all blocks before generating intermediate frames. This preliminary action of standardizing color values across blocks enables more efficient subsequent warping operations, allowing for the generation of multiple high-quality intermediate frames with reduced computational overhead and processing time.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP2706507B1Method and apparatus for generating morphing animation
Publication Date: 2017.03.01 HUAWEI TECH CO LTD
  • EP2706507B1 patent drawingFigure 1~2
  • EP2706507B1 patent drawingFigure 3
  • EP2706507B1 patent drawingFigure 4

AI summary

Embodiments of the present invention provide a method and a device for generating a morphing animation from multiple images, where the method includes: performing hue preprocessing on adjacent images among multiple images; determining the quantity of intermediate frames between the adjacent images according to a feature point differential of the adjacent images on which the hue preprocessing has been performed, generating, between the adjacent images through an image warping technology, intermediate frame images, the quantity of which is the same as that of the intermediate frames, insert the intermediate frame images between the adjacent images, and generate a morphing animation from the multiple images and the intermediate frame images that are inserted between all adjacent images among the multiple images. The morphing animation generated in the present invention is smooth and natural, thereby improving a morphing effect of the morphing animation.