Unlock instant, AI-driven research and patent intelligence for your innovation.

Image processing method and device and electronic equipment

An image processing and image technology, applied in the field of image processing, can solve problems such as face distortion, poor generalization ability of image face-changing schemes, and unnaturalness

Pending Publication Date: 2020-12-08
ALIBABA GRP HLDG LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Therefore, the generalization ability of the existing image face-swapping schemes is poor, and it is impossible to realize the face-swapping of face images under large-angle poses. When it is large, it is easy to make the face distortion after exchange more serious and unnatural, which cannot meet the needs of actual application scenarios

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image processing method and device and electronic equipment
  • Image processing method and device and electronic equipment
  • Image processing method and device and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0085] Image 6 The flow of the image processing method provided for the embodiment of the present invention Figure 1 ,Can achieve figure 1 The image processing logic shown in the image processing method includes the following steps:

[0086] S610. Acquire a first face image and a second face image.

[0087] Wherein, in order to facilitate unified processing of the face images, the acquired face images have the same size. E.g figure 1 Image A and Image B in .

[0088] S620. Determine mapping relationship information between pixels in the face area in the first face image and in the second face image and pixel positions in the set face image, respectively.

[0089] The most important thing for image face swapping is the position of the facial features. Therefore, in order to make the calculation of the facial features as accurate as possible and reduce the amount of data calculation, in this scheme, the face area in the face image (the area where the facial features are c...

Embodiment 2

[0116] Figure 9 The flow of the image processing method provided for the embodiment of the present invention Figure four , the method can be used as Figure 6 ~ Figure 8 The supplementary processing process of any one of the image processing methods is used to perform skin color fusion processing on the generated transformed second face image, that is, according to the image skin color pairing in the first face image and / or the second face image The transformed second human face image is subjected to skin color fusion processing to obtain a skin color fusion image corresponding to the transformed second human face image. like Figure 9 As shown, the image processing method may specifically include the following steps:

[0117] S910, respectively forming Laplacian pyramids corresponding to the first face image and the second face image.

[0118] like image 3 As shown, taking the above-mentioned Image B as an example, the process of establishing its corresponding Laplaci...

Embodiment 3

[0146] like Figure 11 Shown is the structure of the image processing device of the embodiment of the present invention Figure 1 , the image processing device can be controlled to execute as Image 6 The method steps shown in, it comprises:

[0147] Facial image acquisition module 111, used to obtain the first facial image and the second facial image;

[0148] The mapping information determining module 112 is used to respectively determine the mapping relationship information between the pixel points of the face area in the first face image and the second face image and the pixel point positions in the set face image;

[0149] Human face conversion processing module 113, for according to the first human face image and in the second human face image the pixel point of the human face area and the mapping relationship information of the pixel point position in the set human face image, the person in the second human face image The pixels in the face area are correspondingly r...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides an image processing method, device and system and electronic equipment, and the method comprises the steps: obtaining a first face image and a second face image; respectively determining mapping relation information between face area pixel points in the first face image and the second face image and pixel point positions in a set face image; and correspondingly replacing the face region pixel points in the second face image with the face region pixel points in the first face image according to the mapping relationship information of the face region pixel points in the first face image and the second face image and the pixel point positions in the set face image, thereby forming a transformed second face image. According to the scheme provided by theembodiment of the invention, face image face changing under a large-angle posture can be realized, so that the exchanged face posture and expression are more natural, and the generalization ability of image face changing is improved.

Description

technical field [0001] The present application relates to the field of image processing, in particular to an image processing method, device and electronic equipment. Background technique [0002] Image face-changing means assuming that there are two face images respectively face image A and face image B, the task of image face-changing is to replace the face in face image B with the face in face image A, and at the same time The face image formed after the replacement still maintains the posture, expression, etc. of the face in the original face image B. Image face-swapping has a broad application prospect. For example, in film and television production, the entire TV series or movie is shot through a substitute, and the image face-swapping technology is used in the later stage to change the face of the protagonist of the video to reduce shooting costs; in terms of user entertainment, users You can choose your favorite TV series and replace the characters you are intereste...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/00
CPCG06T3/04
Inventor 吕江靖李晓波
Owner ALIBABA GRP HLDG LTD