Image semantic segmentation network continuous learning method, system, device and storage medium
A technology of semantic segmentation and learning method, applied in the field of image semantic segmentation, it can solve the problems of unable to prove generalization and universality, unable to solve the challenge of semantic segmentation, unable to directly apply image semantic segmentation, etc., to achieve strong generalization ability and Practical value, the effect of preventing confusion between classes, and reducing the cost of labeling
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0031] The embodiment of the present invention provides a continuous learning method for image semantic segmentation network, which is a continuous learning method for semantic segmentation based on category structure keeping alignment with features. The current mainstream image semantic segmentation network consists of a feature extractor, a decoder and a classifier. The main process flow is: extract the input feature map of the image to be segmented through the feature extractor, obtain the corresponding feature vector through the decoder, and finally classify the Semantic segmentation is performed by the processor, and the classification result of each pixel (ie, the segmentation result) is obtained. The present invention designs corresponding modules for the image semantic segmentation network to prevent old knowledge from being forgotten. Specifically, the core content of the method includes four parts: feature transformation module, category structure information retenti...
Embodiment 2
[0123] The present invention also provides an image semantic segmentation network continuous learning system, which is mainly implemented based on the method provided in the foregoing embodiment 1, such as Figure 5 As shown, the system mainly includes:
[0124] The data collection and preliminary training unit is used to obtain the newly added semantic segmentation data set and the labels corresponding to the newly added categories, use the original image semantic segmentation network to extract the original feature map of the image data in the newly added semantic segmentation data set, and pass the feature transformation module. Transforming the original feature map, and preliminarily training the feature transformation module by using the difference between the reconstructed feature map and the original feature map from the transformation result;
[0125] The learning unit is used to initialize an identical image semantic segmentation network and feature transformation mod...
Embodiment 3
[0129] The present invention also provides a processing device, such as Image 6 As shown, it mainly includes: one or more processors; a memory for storing one or more programs; wherein, when the one or more programs are executed by the one or more processors, the One or more processors implement the methods provided by the foregoing embodiments.
[0130] Further, the processing device further includes at least one input device and at least one output device; in the processing device, the processor, the memory, the input device, and the output device are connected through a bus.
[0131] In this embodiment of the present invention, the specific types of the memory, input device, and output device are not limited; for example:
[0132] The input device can be a touch screen, an image capture device, a physical button or a mouse, etc.;
[0133] The output device can be a display terminal;
[0134] The memory may be random access memory (Random Access Memory, RAM), or may be n...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com