A Method of Infrared Road Scene Segmentation Based on Class Prototype Regression

A scene segmentation and category technology, applied in the field of image processing, can solve problems such as difficult to distinguish, difficult to achieve high precision in algorithms, and difficult to achieve zero errors in intelligent driving, so as to achieve the effect of tight overall features and improved image segmentation accuracy

Active Publication Date: 2021-05-28
NANJING UNIV OF SCI & TECH
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] At present, the most complex vehicle-mounted road scene is the urban street scene, because in the street, the scene is complex and changeable, the background and the target are mixed together, it is difficult to distinguish, and the traffic volume on the road is large, sometimes there is dense situation, the general algorithm is difficult To achieve higher precision, at present, it is difficult for intelligent driving to achieve zero errors

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Method of Infrared Road Scene Segmentation Based on Class Prototype Regression
  • A Method of Infrared Road Scene Segmentation Based on Class Prototype Regression
  • A Method of Infrared Road Scene Segmentation Based on Class Prototype Regression

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] The present invention is described in further detail now in conjunction with accompanying drawing. These drawings are all simplified schematic diagrams, which only illustrate the basic structure of the present invention in a schematic manner, so they only show the configurations related to the present invention.

[0056] Such as figure 1 As shown, the infrared road scene segmentation method based on category prototype regression of the present invention, the input image is set as P and after the feature extractor composed of convolutions, the depth features of each position are obtained , . After getting the features, use the category feature prototype proto Construct a relationship matrix with deep features; after obtaining the relationship matrix, use the relationship matrix to calculate the attention map, and obtain the final feature map through the feature fusion mechanism. It is worth noting that two paths are used to calculate the spatial attention map and ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method for segmenting infrared road scenes based on category prototype regression, comprising the following steps: 1. Category prototype feature regression: using a large number of data labels and depth features to obtain category feature prototypes through regression; 2. Constructing a relationship matrix: obtaining After obtaining the category feature prototype, construct a relationship matrix through the depth feature and category feature prototype; 3. Attention enhancement: construct different attention maps through the relationship matrix to achieve feature enhancement; 4. Build attention modules: establish category attention modules and space Attention module, which aggregates the functions of two attention modules. The present invention proposes a category prototype regression strategy to regress the entire data set to obtain representative category prototype features, and at the same time cluster network depth features to make the global category features more compact; at the same time, the differences between categories are enlarged, and corresponding construction The relationship matrix and attention module make the overall features more compact and improve the final image segmentation accuracy.

Description

technical field [0001] The invention relates to an infrared road scene segmentation method based on category prototype regression, and belongs to the technical field of image processing. Background technique [0002] Compared with other scenes, vehicle road scenes are more complex, and many problems may occur in complex scenes, such as complex backgrounds that make target recognition more difficult, or similarities between targets that interfere with visual features , Different targets are misclassified, especially in the infrared vehicle road scene, the edge of the target is weak, and the boundary line between the background and the foreground is not obvious, which will lead to the accuracy of visual features. Therefore, in order to achieve higher recognition accuracy, the segmentation model needs to have stronger discriminative ability for weak edges and similar objects. At present, image semantic segmentation technology is mainly aimed at classification tasks at the pixe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/34G06K9/00G06K9/62G06N3/04
CPCG06V20/56G06V10/267G06N3/045G06F18/23G06F18/22G06F18/24G06F18/214
Inventor 韩静陈霄宇李端阳张权滕之杰魏驰恒李怡然
Owner NANJING UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products