Image semantic segmentation network continuous learning method, system, device and storage medium

A technology of semantic segmentation and learning method, applied in the field of image semantic segmentation, it can solve the problems of unable to prove generalization and universality, unable to solve the challenge of semantic segmentation, unable to directly apply image semantic segmentation, etc., to achieve strong generalization ability and Practical value, the effect of preventing confusion between classes, and reducing the cost of labeling

Active Publication Date: 2022-07-15
UNIV OF SCI & TECH OF CHINA
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, it still cannot solve the unique challenges in the aforementioned continuous learning task of semantic segmentation, so it cannot be directly applied in image semantic segmentation
The Chinese patent application with publication number CN103366163A "Face Detection System and Method Based on Incremental Learning", the Chinese patent application with publication number CN106897705A "A Method for Distribution of Ocean Observation Big Data Based on Incremental Learning", and the publication number is The Chinese patent application of CN103593680A "A Dynamic Gesture Recognition Method Based on Hidden Markov Model Incremental Learning" is a method dedicated to a specific field, and it cannot be proved that it has generalization and universality

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image semantic segmentation network continuous learning method, system, device and storage medium
  • Image semantic segmentation network continuous learning method, system, device and storage medium
  • Image semantic segmentation network continuous learning method, system, device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0031] The embodiment of the present invention provides a continuous learning method for image semantic segmentation network, which is a continuous learning method for semantic segmentation based on category structure keeping alignment with features. The current mainstream image semantic segmentation network consists of a feature extractor, a decoder and a classifier. The main process flow is: extract the input feature map of the image to be segmented through the feature extractor, obtain the corresponding feature vector through the decoder, and finally classify the Semantic segmentation is performed by the processor, and the classification result of each pixel (ie, the segmentation result) is obtained. The present invention designs corresponding modules for the image semantic segmentation network to prevent old knowledge from being forgotten. Specifically, the core content of the method includes four parts: feature transformation module, category structure information retenti...

Embodiment 2

[0123] The present invention also provides an image semantic segmentation network continuous learning system, which is mainly implemented based on the method provided in the foregoing embodiment 1, such as Figure 5 As shown, the system mainly includes:

[0124] The data collection and preliminary training unit is used to obtain the newly added semantic segmentation data set and the labels corresponding to the newly added categories, use the original image semantic segmentation network to extract the original feature map of the image data in the newly added semantic segmentation data set, and pass the feature transformation module. Transforming the original feature map, and preliminarily training the feature transformation module by using the difference between the reconstructed feature map and the original feature map from the transformation result;

[0125] The learning unit is used to initialize an identical image semantic segmentation network and feature transformation mod...

Embodiment 3

[0129] The present invention also provides a processing device, such as Image 6 As shown, it mainly includes: one or more processors; a memory for storing one or more programs; wherein, when the one or more programs are executed by the one or more processors, the One or more processors implement the methods provided by the foregoing embodiments.

[0130] Further, the processing device further includes at least one input device and at least one output device; in the processing device, the processor, the memory, the input device, and the output device are connected through a bus.

[0131] In this embodiment of the present invention, the specific types of the memory, input device, and output device are not limited; for example:

[0132] The input device can be a touch screen, an image capture device, a physical button or a mouse, etc.;

[0133] The output device can be a display terminal;

[0134] The memory may be random access memory (Random Access Memory, RAM), or may be n...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a continuous learning method, system, equipment and storage medium for image semantic segmentation network. On the one hand, the method of extracting old knowledge representations and aligning them through nonlinear transformation in feature space effectively maintains the invariance of old knowledge and improves the Ability to learn new knowledge. On the other hand, the topology of the new category is optimized in the embedding space, and the invariance of the topology of the old category is maintained to reduce forgetting and prevent confusion between classes. This makes it unnecessary to provide labels of old categories in the continuous learning of semantic segmentation, reducing the cost of labeling. In general, as a universal semantic segmentation continuous learning method, the present invention has no restrictions on application scenarios, and has strong generalization ability and practical value.

Description

technical field [0001] The present invention relates to the technical field of image semantic segmentation, in particular to a continuous learning method, system, device and storage medium for image semantic segmentation network. Background technique [0002] In recent years, deep neural networks have achieved great success in semantic segmentation tasks. However, the traditional semantic segmentation network training method needs to obtain all the training data at one time, and it is difficult to update after the training is completed. In practical applications, the network is often required to gradually learn and update the learned knowledge from the data stream, thereby effectively reducing the cost of data storage and training. But having deep neural networks learn directly on new data can lead to severe forgetting of what has been learned. The continuous learning technology imposes additional constraints on the learning process to achieve the purpose of learning new k...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06V10/26G06V10/30G06V10/774G06V10/82G06K9/62G06N3/04
Inventor 王子磊林子涵
Owner UNIV OF SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products