Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Rapid image style migration method based on group normalization

A normalization and style technology, applied in the field of image processing, can solve the problems of slow model convergence, fuzziness, constraints, etc., and achieve the effects of faster convergence, enhanced learning, and improved performance

Pending Publication Date: 2019-12-13
LIAONING TECHNICAL UNIVERSITY
View PDF4 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

With the rapid development of mobile phone digital functions, the pixels of mobile phone cameras are getting higher and higher, and the resolution of the photos taken is also improved. In the case of inputting high-resolution photos, the resulting pictures obtained by the previous methods often appear Blurring, the resolution of the photo taken by the mobile phone is inconsistent, and the color layout of the converted picture will be inconsistent with the original style picture, and the extraction of fine texture features is not obvious
Because it is applied to mobile phone filters, it is necessary to provide more different types of styles for people to choose from. The previous method converges slowly in training models of different styles, and the time and cost are too large, which restricts the actual application.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Rapid image style migration method based on group normalization
  • Rapid image style migration method based on group normalization
  • Rapid image style migration method based on group normalization

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] The invention provides a real-time fast image style transfer method, such as figure 1 As shown, the present invention adopts a framework structure combining generator network and loss network, and the specific steps include:

[0039] (1) The size of the input image is transformed to 256*256, which is convenient for training the generator network.

[0040] (2). Start adding extra borders on the top, bottom, left, and right of the input image to eliminate edge effects.

[0041] (3) Combination figure 2 As shown, the input content image x is input into the generator network, and converted into an output image y through y=fw(x) mapping.

[0042] (4) Eliminate the extra border that was added to prevent edge effects at the beginning, and get the final output image y k .

[0043] (5), the image y output through the generator network k And the original content image y c Input to the pre-trained vgg16 network model.

[0044] (6) Use image y k The feature map and original content image y ...

Embodiment 2

[0065] The present invention also provides a fast image style transfer method that uses group normalization instead of batch normalization and instance normalization in the generator network. The specific steps include:

[0066] (1) The size of the input image is transformed to 256*256, which is convenient for training the generator network.

[0067] (2). Start adding extra borders on the top, bottom, left, and right of the input image to eliminate edge effects.

[0068] (3) Input the input image x into the generator network. The generator network is set as a deep residual network, and the network structure is two down-sampling convolutional layers, five residual units, two up-sampling deconvolution layers, and finally an output layer. The main principle of the generator network is to perform convolution calculation and deconvolution calculation on the input image. Using down-sampling convolutional layer and up-sampling deconvolutional layer can reduce the complexity of calculation...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a rapid image style migration method based on group normalization, and the method comprises the steps: inputting an input image x into a generator network, generating an imageyk, and outputting the image yk; inputting the output image yk and the original content image yc into a loss network, and calculating to obtain a content loss function; inputting the output image yk and the original style image ys into a loss network, and calculating to obtain a style loss function; linearly combining the content loss function and the style loss function into a new loss function as a total loss function; using an MS-COCO data set as a content image for training; and obtaining a result image after style migration. According to the method, batch normalization is replaced by group normalization, the performance of the deep neural network is remarkably improved, the convergence speed of the model is increased in image style migration work, a high-quality image is obtained, anda framework combining a generator network and a loss network is adopted when the rapid image style migration model is constructed, so that the purpose of real-time performance is achieved.

Description

Technical field [0001] The invention belongs to the technical field of image processing, and in particular relates to a fast image style transfer method based on group normalization. Background technique [0002] Image style transfer refers to the use of algorithms to learn the style features of a painting, and then apply this style feature to another picture. Before 2015, most image style transfer methods were realized by manually establishing physical models, mainly using mathematical modeling and mathematical formula induction to generate texture. Efros et al. proposed a simple texture synthesis algorithm that stitched together small pieces of existing texture images and then synthesized new texture images. Hertzmann et al. proposed a new framework for image analogy, which achieved good results in texture synthesis and texture migration. Qian Xiaoyan and others improved the classic Ashikhmin algorithm and proposed a new neighborhood measurement method, which effectively real...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T5/00G06N3/08
CPCG06N3/08G06T5/92
Inventor 王亮欧阳俊
Owner LIAONING TECHNICAL UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products