Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image face changing method based on local occlusion condition

A partial occlusion, conditional technique used in image processing and computer graphics

Active Publication Date: 2019-11-15
NORTHWESTERN POLYTECHNICAL UNIV
View PDF6 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the main problem of this technology is that there may be some partial occlusions in the target face image, such as glasses, hair, clothing or accessories, etc. Due to the complexity and unpredictability of partial occlusion in the face image, based on partial occlusion conditions The image face-swapping technology needs to restore the image effect of the transition area between the occluded object and the face, improve the robustness of transplantation between target face images, and make the resulting synthetic photos more realistic

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image face changing method based on local occlusion condition
  • Image face changing method based on local occlusion condition
  • Image face changing method based on local occlusion condition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0074] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0075] The resolution of the test image is selected as 800×600, and the corresponding hardware test environment is memory 16G, CPU 4.0Hz, and the development platform Matlab.

[0076] Step 1: Preprocessing the input image and the target image;

[0077] For the input image I S and target image I T Mark the occluders in , and then use the marked points to extract the occluders, that is, to divide the occluders according to their contours, and respectively divide the input image I S and target image I T Carry out occlusion and face area segmentation. When there is no occlusion, no occlusion segmentation is performed and only face area segmentation is performed. When the face image has image occlusions other than the face itself, the shape of the occlusion is used as the segmentation contour , the occluder is segmented, and thus the occluder area and th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an image face changing method based on a local occlusion condition. An input face image and a target face image are described by two-dimensional feature points, related face areas are divided on the input image and the target image. A pixel feature function corresponding to the face areas is established, and seamless fusion is performed in the face area migration process toeliminate splicing boundaries. A final output image is synethisized through Laplacian pyramid reconstruction by using an idea of image layered superposition. The finally synthesized image has no obvious modification splicing trace. Compared with a Poisson fusion method commonly used for image face changing at present, image effect of an edge of the shielding object is well restored, especially when the shielding object has projection shadows in the face area, the details of the edge area of the shielding object are obviously different from those of a Poisson fusion method, and the image effectof the whole image after face changing is harmonious and natural and has no obvious defects.

Description

technical field [0001] The invention relates to the technical fields of image processing and computer graphics, and mainly relates to a face-changing method of a target image based on partial occlusion. Background technique [0002] Image face-swapping technology refers to automatically transplanting the user's face in the input image to the target image, replacing the specified face in the target image, so that the image's face is automatically fused into the target image. The process of image face-changing requires keeping the facial appearance and expression features of the input image unchanged, but it must match the pose of the target face, and the final synthesized face image must have a natural overall effect, that is, it is required that the facial features after face-changing The skin color, makeup, and lighting environment of the input face can be matched with the target image. This technology can make the user who inputs the image have a sense of substitution and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T3/00G06K9/00G06K9/32G06T7/33G06T17/00G06T15/04G06T15/60G06T5/00
CPCG06T7/344G06T17/00G06T15/04G06T15/60G06T2207/20016G06T2207/30201G06T2207/20221G06V40/169G06V40/171G06V10/255G06T3/04G06T5/70
Inventor 樊养余刘洋黄炎辉郭哲吕国云齐敏李文星殷丽丽
Owner NORTHWESTERN POLYTECHNICAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products