Unlock instant, AI-driven research and patent intelligence for your innovation.

An Image Semantic Segmentation Method Based on Adversarial Training

A semantic segmentation and image technology, applied in the field of computer vision, can solve the problems such as the inability to realize the meaningful fusion of image global information and local information, ignoring the local features of the image, etc., to achieve the effect of increasing interpretability and training stability.

Active Publication Date: 2021-12-03
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the most successful network structure convolutional neural network (Convolutional Neural Network, CNN) in the field of computer vision has a major disadvantage for image semantic segmentation: due to the large number of maximum pooling layers stacked in the network structure, CNN finally obtains The feature is the information of the whole picture, while ignoring the local features of the picture, such as the edge and position of the object in the picture
[0005] (1) The cross-layer connection is too simple for the fusion of different layers of information, and cannot realize the meaningful fusion of global information and local information of the image

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An Image Semantic Segmentation Method Based on Adversarial Training
  • An Image Semantic Segmentation Method Based on Adversarial Training
  • An Image Semantic Segmentation Method Based on Adversarial Training

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0044] combined with figure 1 , the image semantic segmentation method based on adversarial training of the present embodiment, comprises the following steps:

[0045] Step 1: Input the original image to the convolutional neural network (i.e., the generation network G) for forward transfer to obtain a low-resolution segmented image;

[0046] Specifically: set the size of the original image as H×W×3, input the original image to the convolutional neural network (that is, the generation network G) for convolution pooling operation, and obtain the first downsampling feature layer with a size of H / the s 1 ×W / s 1 ×C down1 , and then perform convolution and pooling operations on the first downsampled feature layer again to obtain the second downsampled feature layer with a size of H / (s 1 ×s 2 )×W / (s 1 ×s 2 )×C down2 , repeating this process, the third downsampling feature layer, the fourth downsampling feature layer, etc. can be obtained in turn. For the sake of simplicity, ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of computer vision and discloses an image semantic segmentation method based on adversarial training, which is used to solve the problem that the existing semantic segmentation method cannot realize the meaningful fusion of image global information and local information and cannot learn high-level information in images. The question of potential. Since the present invention defines the loss function of the entire network based on the adversarial training network, the adversarial network as a general function approximator can not only learn how to combine information of different layers, but also "force" the generation network to learn a single point in the segmented picture , pairing, high-order potential energy and other information, realize the organic fusion of image local features and all features, and obtain more realistic segmentation images; at the same time, the method of layer-by-layer training avoids the complicated process of network initialization parameters, so that the entire network can be used Method of random initialization.

Description

technical field [0001] The invention belongs to the technical field of computer vision and relates to image semantic segmentation and confrontation training, in particular to an image semantic segmentation method based on confrontation training. Background technique [0002] With the development and popularization of artificial intelligence, the important position of image semantic segmentation in the field of computer vision has become increasingly prominent. Many applications require accurate and efficient segmentation techniques, such as autonomous driving, indoor navigation, human-computer interaction, and more. In the past five years, deep learning methods have achieved great success in the field of computer vision, and various network structures have been proposed to solve different problems in this field, such as image classification and positioning. However, the most successful network structure convolutional neural network (Convolutional Neural Network, CNN) in the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T7/11G06K9/62G06N3/04
CPCG06T7/11G06N3/045G06F18/2415G06F18/214
Inventor 高建彬邓泽露
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More