A method for integrating driving scene target recognition and traveling area segmentation

A target recognition and scene segmentation technology, applied in the field of vehicle vision systems, can solve problems such as poor robustness and portability, and difficult recognition of unstructured road boundaries, so as to achieve robustness and accuracy improvement, improve accuracy, and reduce cost effect

Active Publication Date: 2019-01-04
ZHEJIANG LEAPMOTOR TECH CO LTD
View PDF20 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The effect of this type of method depends on the design of the image feature description operator, and the robustness and portability of the application are poor
Its limitations and application difficulties lie in that different types of target detection, such as pedestrians, vehicles, and traffic signs, require the design of different image feature description operators. The algorithmic target detection architecture and methods for day and night need to be adjusted separately. For unstructured road boundaries Difficult to identify etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for integrating driving scene target recognition and traveling area segmentation
  • A method for integrating driving scene target recognition and traveling area segmentation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The present invention will be described in detail below in conjunction with the accompanying drawings.

[0025] The invention proposes a multi-task deep convolutional neural network driving scene perception method based on vehicle visual input, which can be applied to data fusion, early warning and control module input of assisted driving and automatic driving systems. The input of the deep network adopted by the present invention is a 3-channel vehicle-mounted visual image, and outputs various target lists and a drivable area Mask (which can be post-processed as left and right boundaries). Detailed description will be given below.

[0026] refer to figure 1 , which is a schematic flowchart of a method for integrating driving scene target recognition and drivable area segmentation in the present invention,

[0027] Step S1, the shared feature module obtains the parameter configuration information and image information of the input vehicle vision system, and down-sampl...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a driving scene target recognition and traveling area segmentation integration method. The method comprises the following steps: S1, a shared feature module obtains parameter configuration information and image information of an input vehicle vision system; S2, the target detection network module outputs the target category, the abscissa of the upper left corner of the target, the ordinate of the upper left corner of the target, the width of the target and the height of the target according to the three target detection features of different sizes inputted in the targetdetection ROI area; S3, carrying out confidence threshold filtering and maximum suppression on that target category, the abscissa of the upper left corn of the target, the ordinate of the upper leftcorner of the target, the width of the target and the height of the target by the target detection network module, and merging and outputting a target detection list; S4, the scene segmentation network module outputting a single-channel passable area binary output map corresponding to the scene segmentation feature according to three scene segmentation features of different sizes inputted in the scene segmentation ROI area. By adopting the invention, the robustness and the accuracy are greatly improved.

Description

technical field [0001] The invention relates to a vehicle vision system, in particular to a method for integrating driving scene object recognition and drivable region segmentation in the vehicle vision system. Background technique [0002] The perception functions of existing commercial vehicle vision systems mainly include the detection and recognition of pedestrians, vehicles, traffic signs and structured road marking lines. Most of its algorithm levels are based on traditional visual processing and its learning methods, including basic image feature operators, Hough transform, adaboost or SVM classifiers, etc. The effect of this kind of method depends on the design of the image feature description operator, and the robustness and portability of the application are poor. Its limitations and application difficulties lie in that different types of target detection, such as pedestrians, vehicles, and traffic signs, require the design of different image feature description o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/34G06N3/04
CPCG06V20/588G06V10/267G06N3/045
Inventor 缪其恒吴长伟苏志杰孙焱标王江明许炜
Owner ZHEJIANG LEAPMOTOR TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products