Unlock instant, AI-driven research and patent intelligence for your innovation.

Image texture synthesis method based on convolutional neural network feature map matching

A technology of convolutional neural network and synthesis method, which is applied in the application field of deep learning for image texture synthesis, and can solve problems such as different, parameter uncertainty, and no texture generation

Active Publication Date: 2019-10-01
TIANJIN UNIV
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the procedural texture synthesis algorithm has a serious problem: different parameters need to be adjusted for different textures in nature, that is, parameters need to be adjusted every time a new texture is generated, and the parameter adjustment is uncertain. If If the adjusted parameters are not appropriate, the corresponding texture may not be generated
However, the texture image generated by their method is basically the same as the original image, which deviates from the original purpose of texture synthesis.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image texture synthesis method based on convolutional neural network feature map matching
  • Image texture synthesis method based on convolutional neural network feature map matching
  • Image texture synthesis method based on convolutional neural network feature map matching

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] In order to make the object, technical solution and advantages of the present invention more clear, the present invention will be described in detail below with reference to the accompanying drawings and examples. Apparently, the described implementation is only a part of the embodiments of the present invention, rather than an exhaustive list of all the embodiments. And in the case of no conflict, the implementations in this description and the features in the embodiments can be combined with each other.

[0035] The processing steps of the present invention include: data preparation and processing, extracting feature maps in the model and using the swap algorithm for processing, setting loss functions, training convolutional neural networks and other main steps. The present invention uses a DTD (DescribableTextures Dataset) texture data set for testing and training, thereby obtaining better results.

[0036] Step 1: Data preparation and processing. Prepare the DTD d...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an image texture synthesis method based on convolutional neural network feature map matching, and the method comprises the steps: preparing a data set, and carrying out the preprocessing of the data set; establishing a model based on the VGG-19; testing by using the pre-training weight; processing the feature map by using a feature space nearest neighbor exchange matchingalgorithm, namely a swap algorithm; setting a loss function, and using the loss function to measure the similarity between the generated image and the original texture image; and updating the parameters through a back propagation algorithm to generate a final texture image.

Description

technical field [0001] The aspects involved in the present invention include computer vision, computer image processing, deep learning and other computer fields, and the present invention is more focused on the application of deep learning to image texture synthesis. Background technique [0002] Texture synthesis is a proposed method to solve problems such as seam aliasing in mapping. Texture synthesis algorithms can be divided into two categories, the first is Process Texture Synthesis (PTS), and the other is Texture Synthesis From Samples (TSFS). [0003] The procedural texture synthesis method is a simulation method, that is, texture synthesis is performed by imitating realistic textures, such as our common wood textures, hair and other textures. However, the procedural texture synthesis algorithm has a serious problem: different parameters need to be adjusted for different textures in nature, that is, parameters need to be adjusted every time a new texture is generated...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T11/00
CPCG06T11/001G06T2207/20081G06T2207/20084
Inventor 潘刚王启航梅怡静孙迪
Owner TIANJIN UNIV
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More