Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Small target semantic segmentation method and system based on low-rank mixed attention mechanism

A semantic segmentation and attention technology, applied in neural learning methods, computer components, instruments, etc., can solve the problems of large computational complexity of non-local matrix operations and unfavorable model landing, so as to reduce computational complexity and expand the receptive field. Effect

Active Publication Date: 2021-11-16
SHANDONG JIANZHU UNIV
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, since the operation of non-local matrix operations is easy to introduce large computational complexity, it is also not conducive to the landing of the model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Small target semantic segmentation method and system based on low-rank mixed attention mechanism
  • Small target semantic segmentation method and system based on low-rank mixed attention mechanism
  • Small target semantic segmentation method and system based on low-rank mixed attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0049] This embodiment discloses a small target semantic segmentation method based on a low-rank mixed attention mechanism, such as figure 1 As shown, a specific implementation process of a calcified plaque segmentation method and system based on a low-rank mixed attention mechanism in an embodiment of the present invention includes the following steps:

[0050] Step (1): Data preprocessing

[0051] Data preprocessing: Due to differences in operating habits and equipment models, normalization (natural images) or resampling (medical images) operations have been performed on image data. For medical images, first of all, because there are some parts of the data where the HU (Hounsfield Unit) value is too high, we set a threshold to suppress the situation where the HU value of some parts of the data is too high, so as to avoid the occurrence of After the normalization, the value distribution of the data is too concentrated to cause the characteristics to be unobvious; secondly, i...

Embodiment 2

[0108] The purpose of this embodiment is to provide a computing device, which includes a memory, a processor, and a computer program stored in the memory and operable on the processor. The processor implements the steps of the above method when executing the program.

Embodiment 3

[0110] The purpose of this embodiment is to provide a computer-readable storage medium.

[0111] A computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the steps of the above-mentioned method are executed.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a small target semantic segmentation method and system based on a low-rank mixed attention mechanism, and the method comprises the steps: constructing a segmentation model, specifically, constructing a segmentation data set, and carrying out the data preprocessing; performing feature extraction on the preprocessed segmented data set: expanding a receptive field based on expansion convolution; as the substitution of a pooling layer, adding a low-rank mixed attention mechanism in the network to aggregate feature information and extract high-order semantic features; for the extracted features, calculating weighted cross entropy loss and Dice loss, and training the network by using a mixed loss function to obtain a network model; and for the to-be-segmented object, outputting a small target segmentation result by using the segmentation model. The method effectively solves the problem that a relatively small target size in an image data set is easy to cause serious class imbalance, and the problem that accurate reconstruction of an image is difficult to realize in a decoder due to information loss in a feature learning process.

Description

technical field [0001] The invention belongs to the technical field of image segmentation, and in particular relates to a small target semantic segmentation method and system based on a low-rank mixed attention mechanism. Background technique [0002] The statements in this section merely provide background information related to the present invention and do not necessarily constitute prior art. [0003] With the continuous development of deep learning technology, the semantic segmentation methods of images have made remarkable progress. As a fundamental topic in computer vision, the goal of semantic segmentation is to assign a semantic class label to each pixel in an image. In recent years, deep learning-based semantic segmentation has been actively studied by many scholars in various challenging tasks, such as autonomous driving, virtual reality, and computer-aided diagnosis, etc. Among them, semantic segmentation can usually achieve satisfactory results for the segmenta...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/34G06K9/46G06K9/62G06N3/04G06N3/08
CPCG06N3/04G06N3/08G06F18/253G06F18/24
Inventor 宁阳聂秀山魏珑尹习林王大伟张云峰张彩明
Owner SHANDONG JIANZHU UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products