Real-Time Image Fusion via Feature-Based Shape Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image fusion technologies fail to achieve sufficient precision in merging objects from one image with those from another, leading to suboptimal results in applications like selfie editing and video sharing.

Innovation Solution

An image processing method that recognizes and adjusts the orientation, size, and shape of objects in both images based on matching features and average shapes, ensuring alignment and consistency before fusion, using processors and memory in mobile terminals to perform real-time image fusion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional image fusion methods are used, then the fusion process can be completed, but the fusion precision cannot satisfy use requirements

Engineering Contradiction:
Improvefusion precisionVSAvoiduse requirement satisfaction
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent applies preliminary action by adjusting the orientation, size, and shape of formed images of objects in both the source and target images before performing the fusion operation. Specifically, the system determines the orientation and size of formed images based on feature points, adjusts these parameters according to matching relationships between the two images, and modifies shapes according to average shapes. This preliminary adjustment ensures that when fusion is performed, the objects are properly aligned and positioned, thereby achieving high fusion precision that satisfies use requirements.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If real-time fusion is implemented, then operation efficiency is improved, but fusion precision may be compromised

Engineering Contradiction:
Improveoperation efficiencyVSAvoidfusion precision
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent resolves this contradiction by performing all necessary adjustments to orientation, size, and shape parameters before the fusion operation. By determining feature points, calculating matching relationships, and adjusting formed image parameters in advance, the system prepares the images for fusion in a way that maintains high precision. The actual fusion then becomes a straightforward alignment operation based on pre-computed parameters, enabling real-time processing without sacrificing precision.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If objects in non-frontal orientation are fused, then adaptability is improved, but alignment accuracy deteriorates

Engineering Contradiction:
Improveorientation handling capabilityVSAvoidalignment accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent applies parameter changes by dynamically adjusting the orientation, size, and shape parameters of formed images based on the actual orientation of objects in the source and target images. The system determines orientation from feature points, calculates matching relationships between corresponding objects in both images, and adjusts the formed image parameters accordingly. This allows the system to handle objects in any orientation (including non-frontal views) while maintaining alignment accuracy through parameter optimization.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11120535B2Image processing method, apparatus, terminal, and storage medium
Publication Date: 2021.09.14 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US11120535B2 patent drawing
  • US11120535B2 patent drawing
  • US11120535B2 patent drawing

AI summary

The present disclosure provides an image processing method, including: recognizing a source object in a source image, and determining, according to feature points of the source object, an orientation and a size of the source object; adjusting, according to matching relationships between the orientation and the size of the source object and the orientation and the size of the target object, the orientation and the size of the source object; adjusting a shape of the source object and a shape of the target object according to an average shape of the source object and an average shape of the target object; and fusing, in real time, the source image and the target image in a manner of aligning the shape of the source object with the shape of the target object.