Road scene semantic segmentation method based on category grouping in abnormal weather

A semantic segmentation and abnormal weather technology, applied in character and pattern recognition, instruments, biological neural network models, etc., can solve problems such as inability to complete, not considering the importance of categories, and not considering the importance of categories to tasks, etc., to ensure safety Good effect of sex and segmentation effect

Pending Publication Date: 2022-04-08
NANJING UNIV OF SCI & TECH
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

These methods have solved the problem of road scenes under some abnormal weather conditions to a certain extent, but there are still problems: all categories are considered equally, regardless of the importance of the category to the task
The above methods do not consider the importance of the category to the task when segmenting, and under abnormal weather conditions, it is impossible to guarantee the segmentation effect of all categories, and it is meaningless to guarantee the segmentation accuracy of some irrelevant categories.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Road scene semantic segmentation method based on category grouping in abnormal weather
  • Road scene semantic segmentation method based on category grouping in abnormal weather
  • Road scene semantic segmentation method based on category grouping in abnormal weather

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] The overall operation process of the present invention is as figure 1 shown. Below in conjunction with the description of the accompanying drawings of specification 4, the present invention is described in detail:

[0048] Step 1: Prepare data; prepare data under abnormal weather as training set and test set. Using the method of rain and fog simulation generation to generate rain and fog weather data on the Cityscapes dataset, and at the same time obtain two real scene datasets under abnormal weather: BDD100K dataset and ACDC dataset. figure 2 Shown is the display of some data. The generated data set includes 4 types of rainy data of different intensities and 4 types of foggy data of different visibility.

[0049] Step 2: Group the road scene categories according to the importance of autonomous driving safety in abnormal weather to ensure that important categories are separated from non-important categories, and build a road scene semantic segmentation model based on...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a road scene semantic segmentation method based on category grouping in abnormal weather. The method comprises the following steps: (1) preparing data; (2) road scene categories are grouped according to the importance of automatic driving safety in abnormal weather, it is guaranteed that important categories are separated from non-important categories, and a road scene semantic segmentation model is constructed according to the grouping result; (21) grouping the categories according to the importance of the automatic driving safety in the abnormal weather; (22) constructing a model according to a category grouping result; (3) inputting data into the model to obtain a segmentation result; (31) inputting data, and extracting data features; (32) acquiring full-category features; (33) encoding the category relationship by using the full-category features to obtain category relationship features; (34) completing category relationship feature decoding to obtain a segmentation result; (4) carrying out model iteration training; and (5) model testing. According to the method, the segmentation effect of important groups in abnormal weather can be ensured, and safe proceeding of an automatic driving task is ensured to the greatest extent. And meanwhile, an overall segmentation effect equivalent to that of a normal model can be obtained under the condition that the abnormal degree is relatively small.

Description

technical field [0001] The invention relates to the technical field of computer vision image segmentation, in particular to a road scene semantic segmentation method based on category grouping under abnormal weather. Background technique [0002] For autonomous driving tasks, most of the existing road scene semantic segmentation methods are based on normal weather conditions, without considering the more difficult and common abnormal weather conditions. Moreover, due to the difficulty of data collection and labeling under abnormal weather, various related data sets are lacking. Therefore, the general semantic segmentation model can only deal with scenes under normal weather conditions, and it is difficult to function under abnormal weather conditions. The segmentation effect is very poor, and it cannot be applied to the semantic segmentation task of road scenes under abnormal weather conditions. Considering that in abnormal weather, the most important thing to guarantee for...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06V10/26G06V10/764G06V10/774G06V10/82G06N3/04G06K9/62
Inventor 刘亚洲王明
Owner NANJING UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products