A road detection method and device based on disparity map

A technology of road detection and disparity map, applied in the field of image processing, can solve problems such as mistakenly deleted obstacle parallax, complex and unpredictable road conditions, and influence on obstacle detection results, etc., to achieve the effect of improving accuracy

Active Publication Date: 2020-06-23
HISENSE
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, the above method of deleting the road surface is only suitable for ideally flat roads, and the roads in actual scenarios are likely to be undulating, such as from flat roads to downhill roads, from uphill roads to flat roads, and even other more complex roads. For this type of road conditions, it is difficult to use a straight line for fitting because the transition zone of different road sections usually manifests as a circular arc transition. Therefore, if a Hough straight line is used to detect the parallax point of the road surface, it is easy to cause The obstacle parallax is deleted by mistake in the road section, or the distant road surface parallax cannot be deleted, resulting in inaccurate obstacle detection results in the later stage
[0004] Based on this, it is proposed in the prior art to segment the road according to the distance and the undulations of the road surface, and each section corresponds to a Hough straight line to detect the road surface parallax point on the section of the road. However, the more times the Hough line fits, the longer it will take, resulting in the consumption of computing resources; at the same time, due to the complex and unpredictable road conditions in practical applications, it is inevitable to appear in the Undulations appear on a pre-divided section of the road; in addition, in the case of less parallax on the road surface, if the road is divided into multiple sections for detection, it may not be possible to fit the straight line equation of the road surface
It can be seen that the existing technology is not suitable for the actual scene of uneven roads, and it is easy to cause the accuracy of determining the parallax of the road surface to be low, which will affect the result of obstacle detection in the later stage.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A road detection method and device based on disparity map
  • A road detection method and device based on disparity map
  • A road detection method and device based on disparity map

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0040] See Figure 1A , is a flowchart of an embodiment of the road detection method based on the disparity map of the present application, the method includes the following steps:

[0041] Step 101: Determine the sparse disparity map and V disparity map of the image to be detected.

[0042] In the embodiment of the present application, for the convenience of description, the two original images collected by the binocular camera can be referred to as images to be detected, such as Figure 1B Shown is an example of the grayscale image of the image to be detected.

[0043] In related technologies, stereo matching algorithms can be classified according to different primitives used, one of which is feature-based stereo matching algorithms. In the feature-based stereo matching algorithm, the disparity estimation is mainly based on geometric feature information, such as edges, contours, points of interest, lines, corners, etc. Therefore, in the disparity map obtained by the feature...

Embodiment 2

[0051] See figure 2 , which is a flow chart of another embodiment of the road detection method based on the disparity map of the present application, figure 2 The illustrated method focuses on the above step 102 and step 103, that is, the process of determining the road parallax point in the sparse disparity map by processing the V disparity map. The method may include the following steps:

[0052] Step 201: For each column in the V-disparity map, obtain the number of effective pixels in the column and the row range corresponding to the effective pixels according to the preset pixel threshold.

[0053] In the embodiment of the present application, taking one column of the V disparity map as an example, the pixels in the column can be detected line by line from top to bottom, and the pixel value of the detected pixel point can be compared with the preset pixel threshold value. If the pixel value of the detected pixel is greater than the preset pixel threshold, the detected p...

Embodiment 3

[0079] See image 3 , is a flow chart of another embodiment of the road detection method based on the disparity map of the present application, the image 3 The illustrated embodiment focuses on how to determine the row search range in the column, which may include the following steps:

[0080] Step 301: Multiply the preset truncation ratio by the number of effective pixels in the column to obtain the number S of effective parallax.

[0081] In this step, the number S of effective parallaxes can be calculated according to the following formula (3).

[0082] S=A[0][0]*R Formula (3)

[0083] In the above formula (3), R is a preset truncation ratio.

[0084] Those skilled in the art can understand that the above-mentioned number of effective parallaxes S should be an integer. If S calculated by the formula (3) is not an integer, the calculation result can be further "rounded" to obtain the number of effective parallaxes number S.

[0085] Step 302 : In the column, start from...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present application provides a road detection method and device based on a disparity map, which relates to the technical field of image processing. The method includes: determining a sparse disparity map and a V disparity map of an image to be detected; obtaining the V disparity according to a preset pixel threshold The number of effective pixels in the columns of the graph and the row range corresponding to the effective pixels determine the row to which the road surface belongs in the V disparity map; according to the row to which the road surface belongs in the V disparity map, in the sparse disparity The road surface parallax point is determined in the figure, wherein the parallax value of the road surface parallax point is the parallax value corresponding to the column. By applying this method, the accuracy and efficiency of determining road parallax points in the parallax image can be improved, and at the same time, the method can be applied to scenes with rough and uneven road surfaces.

Description

technical field [0001] The present application relates to the technical field of image processing, in particular to a road detection method and device based on a disparity map. Background technique [0002] In recent years, the obstacle detection method based on binocular stereo vision (Binocular Stereo Vision) technology has become a research hotspot in the field of automobile assisted driving. Especially important for obstacle detection results. In the prior art, a sparse disparity map is first generated based on the road image collected by a binocular camera, and then a V disparity map is generated based on the sparse disparity map, and one or more straight lines are detected in the V disparity map by using the Hough line detection method To fit the straight line equation of the road surface in the V disparity map, and then find the disparity points satisfying the straight line equation in the sparse disparity map. The road pavement is deleted. [0003] However, the ab...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00
CPCG06V20/588G06V20/58
Inventor 冯谨强
Owner HISENSE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products