Video image optimization-based style transformation method

A style transfer, video image technology, applied in the field of style transfer based on video image optimization, can solve problems such as long running time

Inactive Publication Date: 2017-12-15
SHENZHEN WEITESHI TECH
View PDF0 Cites 32 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] For problems such as long running time, the purpose of the present invention is to provide a style transfer method based on video image optimization, use random Gaussian noise for initialization, define content loss function and style loss function, and solve the energy minimizati

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video image optimization-based style transformation method
  • Video image optimization-based style transformation method
  • Video image optimization-based style transformation method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0059] It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The present invention will be further described in detail below in conjunction with the drawings and specific embodiments.

[0060] figure 1 It is a system frame diagram of a style conversion method based on video image optimization in the present invention. Mainly including style transfer in still images, optimization-based coherent video style transfer and training.

[0061] Style transfer in still images, where the goal is to generate a stylized image x that displays the content of image p in the style of image a; φ l ( ) represents the function that is input to the l layer by the part of the convolutional network; use P l = φ l (p), S l = φ l (a) and F l = φ l (x) respectively represent the feature maps extracted by the network from the original image p, style image a and stylized image x; use N ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a video image optimization-based style transformation method. The method mainly comprises style transformation in a still image, optimization-based coherent video style transfer and training. According to the process of the method, random Gaussian noises are adopted to perform initialization, a content loss function and a style loss function are defined, and therefore, the energy minimization problem of the video style transfer method can be solved, long-term consistency and image quality during the movement of a camera can be improved; and a network with parameters is adopted as input frames, previously generated frames are distorted and masked by blocking masks, output is generated, and the function is adopted to obtain a video recursively. With the method of the invention adopted, the loss functions of the short-term consistency and long-term consistency of the stylized video and the multi-channel mode of the stylized video can be realized, namely, and a stable result is generated under fast motion and intensive blocking conditions; operating time is greatly reduced; and the quality of images can be improved.

Description

technical field [0001] The invention relates to the field of image and video style conversion, in particular to a style conversion method based on video image optimization. Background technique [0002] Video image processing is one of the hot topics in the field of computer vision research. This year, a new technology based on deep learning-video image style conversion has attracted more and more attention. It uses computer as a tool to simulate the drawing styles of different art forms with algorithms, and enhances the expression of visual information in video images. This technology that effectively combines computer technology and artistic aesthetics is more and more popular among users. It has a wide range of applications, such as providing inspiration or creative help for artists, image editing of various artistic styles on mobile devices, stylization of video images in entertainment industries such as movies, games, and animation, as well as in the fields of scientifi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T3/00G06T7/269
CPCG06T3/0012G06T2207/10016G06T7/269
Inventor 夏春秋
Owner SHENZHEN WEITESHI TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap