Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image style migration method, system and device and storage medium

A style and image technology, applied in devices, storage media, systems, and image style transfer methods based on deep learning, can solve problems such as background distortion and weak background recognition ability, and achieve the effect of avoiding background distortion.

Pending Publication Date: 2020-03-27
广东开放大学(广东理工职业学院)
View PDF5 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Johnson's stylized network, as a landmark achievement in the field of deep learning, has been proven to measure the difference between images from the high-dimensional visual perception level through the fixed loss network pre-trained by the ImageNet dataset, but its fixed The loss network (VGG16) has certain limitations
The VGG16 network was originally trained for classification, so it can clearly identify the main body of the picture (human and animal), but its ability to identify the background is weak, so the background is usually distorted

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image style migration method, system and device and storage medium
  • Image style migration method, system and device and storage medium
  • Image style migration method, system and device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] like figure 1 As shown, the present embodiment provides a method for image style transfer, comprising the following steps:

[0053] S1. Training the image transfer network model. During training, the image conversion network and the discriminative network are alternately updated according to the perceptual adversarial loss function.

[0054] S2. Acquiring the content picture.

[0055] S3. Input the content image into the pre-trained image style transfer model for style transfer processing, and output a target image with a specific style and unchanged original content.

[0056] Both the discriminant network and the image conversion model are deep convolutional networks. In Johnson's stylized network, the loss function used is a fixed function, so the obtained image conversion model has certain limitations. Therefore, in the method of this embodiment, during the training process, the discriminant network and the image conversion network form a generative adversarial ne...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an image style migration method, system and device and a storage medium. The method comprises the following steps: obtaining a content picture; inputting the content picture into a pre-trained image style migration model for style migration processing, and outputting a target picture which has a specific style and retains the original content; enabling the image conversionnetwork and the discrimination network to form a generative adversarial network (GAN), and carrying out alternate updating in the model training process. According to the method, the network is continuously updated and optimized by sensing the adversarial loss function until the loss is minimized, and the image style migration model with a better effect is obtained, so that the output picture closer to the content picture and the style picture can be obtained, the problem of picture background distortion is effectively avoided, and the method, system and device can be widely applied to the field of data image processing.

Description

technical field [0001] The present invention relates to the field of data and image processing, in particular to an image style transfer method, system, device and storage medium based on deep learning. Background technique [0002] In recent years, deep learning, as the hottest direction in the field of artificial intelligence, has shown powerful learning and processing capabilities, and even surpasses human performance in some fields. Image style transfer is a typical application of deep learning, and it is also a popular research direction at home and abroad. Image style migration is to replace an image with another style while keeping the content unchanged, so that ordinary people or scenery pictures can be converted into various artistic style effects. This technology can be widely used in image processing, computer picture synthesis and computer vision etc. [0003] The initial image style transfer is an optimization-based method proposed by Gatys et al., which uses ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/00G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06T3/04
Inventor 李君艺尧雪娟郑莹莹陈明君
Owner 广东开放大学(广东理工职业学院)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products