Face Exchange Using Representation Vectors for Image Quality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing face exchange technologies produce images with unsatisfactory effects due to differences in facial features between the exchanged and original images, leading to poor image quality and user dissatisfaction.

Innovation Solution

An image processing method that acquires a face image, extracts its features, determines a representation vector, and uses this vector to select a target face image from a library for face-exchange processing, ensuring the output image has improved matching and quality by using algorithms like Histogram of Oriented Gradients, deep learning, and neural networks for feature extraction and matching, followed by preprocessing and rectification to enhance the image effect.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If face recognition is performed on a static image and face region is extracted and placed in a target image, then face exchange function is achieved, but the image effect is dissatisfied due to differences in facial features between exchanged and original images

Engineering Contradiction:
Improveimage effect qualityVSAvoidface exchange processing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent transforms the face image into a representation vector space where facial features are parameterized. By changing the parameter space from pixel domain to feature vector domain, the system can accurately match and exchange faces while maintaining image quality. The representation vector captures essential facial characteristics, enabling precise control over the exchange process.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces traditional mechanical image manipulation (cutting, pasting, blending) with a mathematical transformation approach. Instead of directly manipulating image pixels, the system uses representation vectors and neural networks to achieve face exchange, substituting mechanical processing with computational modeling.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If traditional face exchange methods are used, then face exchange function is provided, but user intervention is required and operational convenience is reduced

Engineering Contradiction:
Improveoperational convenienceVSAvoidautomatic face matching
Core Design Contradiction:
Ease of operationVSExtent of automation

Solution Approach 1:

The system performs automatic face matching and selection based on representation vectors without requiring user intervention. The neural network automatically identifies the most suitable target face from the library, and the system self-completes the entire exchange process, making the operation convenient and automated.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system uses representation vectors as feedback to evaluate and select the best matching face. The vector comparison provides quantitative feedback on facial feature similarity, enabling automatic selection of the most appropriate target face without user input.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10733715B2Image processing method and apparatus, electronic device and storage medium
Publication Date: 2020.08.04 JUPITER PALACE PTE LTD
  • US10733715B2 patent drawing
  • US10733715B2 patent drawing
  • US10733715B2 patent drawing

AI summary

Embodiments of the present disclosure provide an image processing method, an image processing apparatus, an electronic device and a storage medium, in order to improve a poor image effect when an image processing is performed for exchanging faces. The image processing method comprises: acquiring a first face image in an input image; extracting facial features of the first face image; determining a representation vector of the first face image according to the facial features; determining a target face image in a preset face image library according to the representation vector; and performing a face-exchange processing on the first face image according to the target face image, so as to obtain an output image.