Perceptual loss and deep convolutional neural network-based sketch simplifying method

A neural network and deep convolution technology, applied in the field of sketch simplification of deep convolutional neural network, can solve problems such as blurring, line deformation, distortion, loss, etc., and achieve the effect of good visual effect, wide applicability and strong robustness

Active Publication Date: 2018-09-07
SOUTH CHINA UNIV OF TECH
View PDF4 Cites 30 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to overcome the shortcomings and deficiencies of the prior art, and provide a sketch simplification method based on a deep convolutional neural network based on perceptual loss, which can well simplify sketches of any size and break through the previous sketch simplification Problems such as loss, blur, line deformation and distortion in the method, insufficient simplification ability, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Perceptual loss and deep convolutional neural network-based sketch simplifying method
  • Perceptual loss and deep convolutional neural network-based sketch simplifying method
  • Perceptual loss and deep convolutional neural network-based sketch simplifying method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0056] like figure 1 As shown, the sketch simplification method of the deep convolutional neural network based on perceptual loss described in this embodiment, the specific method is as follows:

[0057] 1) Obtain the sketch data set, and then obtain its corresponding manual annotation, that is, manually draw a clean line draft on the basis of the sketch, and divide it into a training data set and a verification data set.

[0058] The obtained sketches and corresponding manual annotations are shown in Figure 2(a) and Figure 2(b):

[0059] 2) Convert the image and label data of the image data set into the format required for training the deep convolutional neural network through preprocessing, including the following steps:

[0060] 2.1) Convert the image into a grayscale image;

[0061] 2.2) Flip the images in the data set horizontally, vertically, and diagonally, and do the same flip operation for the corresponding line drawings;

[0062] 2.3) Add tone transformation, noi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a perceptual loss and deep convolutional neural network-based sketch simplifying method. The method comprises the steps of: 1) obtaining data: obtain the data by using a sketchmap and corresponding label data; 2) processing data: transforming the sketch map and corresponding line sketch map of an image data set into a format required for training a deep convolutional neural network through preprocessing; 3) constructing a model: constructing a deep convolutional neural network suitable for sketch simplification according to a training objective; 4) defining a loss function; 5) training the model: calculating the loss value of the network according to the loss function, calculating the gradient of each network layer parameter through back propagation and updating parameters of each layer of the network through a random gradient descent method; and 6) verifying the model: verifying the trained model by using a verification data set and testing the generalizationperformance. The method disclosed by the invention has the advantages that sketches with rougher miscellaneous lines and unclear main structure lines can be processed by a sketch simplifying network;and the network has strong robustness to the influence of illumination.

Description

technical field [0001] The invention relates to the technical field of computer image processing, in particular to a sketch simplification method based on a deep convolutional neural network based on perceptual loss. Background technique [0002] Sketching is the first step in creating art. In this step, creators usually only want to express the concept and composition, rather than focusing on the details. After creating the sketch, the creator needs to draw a clean line draft on the basis of the sketch, which is a tedious and labor-intensive job. [0003] In recent years, with the rapid development of deep learning, deep convolutional neural networks can be used to learn the characteristics of clean line drawings, thereby transforming sketches with many messy lines into simplified line drawings with the characteristics of line drawings. However, the existing problem is that the current deep learning method directly measures the loss by calculating the Euclidean distance b...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00G06N3/04G06N3/08
CPCG06N3/08G06T5/001G06N3/045
Inventor 徐雪妙谢敏珊缪佩琦
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products