Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A human face image stylization method based on spatial constraint

A face image and space-constrained technology, applied in image analysis, image data processing, graphics and image conversion, etc., can solve problems such as lack of style transfer ability, no appearance, etc.

Active Publication Date: 2019-05-31
SOUTHEAST UNIV
View PDF1 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The previous style transfer methods need to consume a lot of computing resources to solve the numerical optimization problem between the style image and the reference image. In recent years, some fast style transfer methods have emerged. These methods are mostly based on a large number of images of the same type for long-term training. , extract a specific style model and render it on the reference image. This type of method can only transfer the overall color and texture features of the image indiscriminately, and does not have the ability to transfer styles at the semantic level.
So far, no fast, accurate, semantic-level arbitrary style transfer method has emerged

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A human face image stylization method based on spatial constraint
  • A human face image stylization method based on spatial constraint
  • A human face image stylization method based on spatial constraint

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0067] The technical solutions of the present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0068] A face image stylization method based on space constraints disclosed by the present invention, such as figure 1 As shown, the steps of the fast feature block matching method are as follows figure 2 As shown, the result of face stylization is as follows image 3 As shown, the detailed steps are as follows:

[0069] (1) Input image normalization

[0070] First, given two face images with different styles, one of them is selected as the style image, and the other is the original image to be stylized. Preprocess the input style image and the original image, such as using the face detection and cropping functions provided by the image processing library opencv to crop the face part in the two images into a rectangular image, and the image width and height range is 200-600 between pixels.

[0071] (2) Extract feature ma...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a human face image stylization method based on spatial constraint, and the method comprises the following steps: firstly, carrying out the normalization of an input style imageand an original image, extracting a multi-layer depth feature map of a human face through a feature encoder, and extracting human face spatial feature points through a human face modeling network; Then, at each layer of the depth feature map, executing a feature block matching method by utilizing spatial constraint and Platts transform of face spatial feature points to obtain mapping from the style image to the original image; And carrying out feature fusion on the mapped style image and the original image to obtain a new depth feature map, and finally obtaining a stylized original image through a pre-trained feature decoder. The invention belongs to the field of computer vision, fully utilizes the space corresponding relation of a human face, designs a rapid feature block matching method, and can effectively improve the speed and accuracy of human face image stylization.

Description

technical field [0001] The invention belongs to the field of computer vision and image processing, in particular to a method for stylizing human face images based on space constraints. Background technique [0002] Face image style transfer is an image processing method. Preprocessing, analysis and encoding, feature fusion and decoding of the input image can apply the given style features to the original face image to obtain a stylized face image. The previous style transfer methods need to consume a lot of computing resources to solve the numerical optimization problem between the style image and the reference image. In recent years, some fast style transfer methods have appeared. These methods are mostly based on a large number of images of the same type for long-term training. , to extract a specific style model and then render it on the reference image. This type of method can only perform indiscriminate transfer of the overall color and texture features of the image, an...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06N3/04G06T3/00G06T7/11G06F17/16
CPCY02D10/00
Inventor 郑程耀夏思宇
Owner SOUTHEAST UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products