Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image semantic segmentation method based on multi-feature fusion

A technology of semantic segmentation and feature fusion, applied in image analysis, image enhancement, image data processing and other directions, can solve the problems of difficult to meet computing performance, huge computing resources, and cannot improve the effect of image semantic segmentation, and achieve reasonable parameters. , the effect of improving the accuracy and reducing the descending speed

Active Publication Date: 2021-02-26
JINAN UNIVERSITY
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in complex image semantic segmentation scenarios, the dilated convolutional neural network is affected by the differences in light, angle, and state in the image, as well as the high similarity between different types of objects, making the dilated convolutional neural network change a variety of In the case of empty convolutional layer parameters, it does not improve the segmentation effect of image semantics very well.
[0003] In addition, in the process of designing a neural network, it is usually chosen to provide more parameters than required, so that the convolutional layer and the dilated convolutional layer require huge computing resources, and it is difficult to meet the requirements for computing performance in practical applications or computing platforms. , which requires the image semantic segmentation method to reduce redundant parameters in the neural network while maintaining a good segmentation effect

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image semantic segmentation method based on multi-feature fusion
  • Image semantic segmentation method based on multi-feature fusion
  • Image semantic segmentation method based on multi-feature fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0031] figure 1 It is a flow chart of a method for image semantic segmentation based on fusion of multiple features disclosed in the embodiment of the present invention, such as figure 1 As shown, the embodiment of the present invention provides a kind of hole-dense network fusion model method suitable for image semantic segmentation, comprising the following steps:

[0032] S1. Input the image to be segmented into the hole-dense structure that combines enhanced image features and image edge features;

[0033] S2. In the hole-dense structure image enhancement channel, hole convolution channel and image edge feature extraction channel, respectively perform feature map extraction on the image to be segmented;

[0034] S3. Merge the feature maps extracted by the image enhancement channel, the atrous convolution channel and the image edge feature extraction channel through dense connection;

[0035] S4. Input the feature map obtained after merging into a feature extractor compos...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an image semantic segmentation method based on multi-feature fusion. The method comprises the following steps: firstly, constructing a cavity dense structure fusing enhanced features and image edge features; respectively inputting a to-be-segmented image into the image enhancement channel, the cavity convolution channel and the image edge feature extraction channel for feature extraction; combining the extracted features in a dense connection mode; transmitting the combined features to a plurality of dense blocks formed by convolution of three layers of holes, and finally obtaining a result after pixel classification through a deconvolution layer. According to the method, the smoothness of the L1 norm is improved by using a variance fitting method, and redundant convolution kernels existing in a convolution layer are cut off by using the improved L1 norm. According to the image semantic segmentation method, the image semantic segmentation effect is improved under the condition of moderate convolution layer parameters.

Description

technical field [0001] The invention relates to the technical fields of image processing and machine vision, in particular to an image semantic segmentation method based on fusion of multiple features. Background technique [0002] Image Semantic Segmentation (ISS, Image Semantic Segmentation) can obtain image information according to the characteristics of the image, and is one of the focuses of digital image processing research. At present, the general neural network model can show a good segmentation effect for objects with obvious category attributes, but for some objects with similar attribute categories or complex image backgrounds, the common image semantic segmentation method will generate more Features often result in unsatisfactory model segmentation due to problems such as resolution degradation and insufficient local feature extraction. At present, in many image semantic segmentation methods, dilated convolution layers (Dilated Convolution) are often used to con...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/34G06K9/62G06T7/13G06T5/40G06N3/04G06N3/08
CPCG06T7/13G06T5/40G06N3/08G06V10/267G06N3/045G06F18/253Y02T10/40
Inventor 石敏蔡少委易清明
Owner JINAN UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products