Binocular vision obstacle detection system and method based on convolutional neural network

A convolutional neural network and obstacle detection technology, applied in the field of binocular vision image processing, can solve problems such as insufficient robustness of obstacle detection accuracy system, and achieve over-fitting phenomenon, high detection accuracy and detection robustness. The effect of stable and stable extraction

Active Publication Date: 2017-12-22
JIANGSU UNIV OF SCI & TECH
View PDF7 Cites 29 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In view of the above problems, the object of the present invention is to provide a binocular visual obstacle detection system and its detection method based on convolutional neural network, to solve the problem of obstacle detection accuracy and system robustness of the traditional binocular visual obstacle detection method. Deficiencies in other aspects

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Binocular vision obstacle detection system and method based on convolutional neural network
  • Binocular vision obstacle detection system and method based on convolutional neural network
  • Binocular vision obstacle detection system and method based on convolutional neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0057] The present invention will be described in detail below in conjunction with the accompanying drawings and embodiments.

[0058] refer to figure 1 , is a schematic structural diagram of a binocular visual obstacle detection system based on a convolutional neural network of the present invention. The binocular visual obstacle detection system based on convolutional neural network includes: an image acquisition module and an obstacle detection module. In an embodiment, two horizontally parallel industrial cameras of the model Pike F-100 are used in the image acquisition module of the present invention to collect the left and right optical images in the actual scene, and the image data is transmitted through the acquisition card with the IEEE-1394b interface to the computer for subsequent processing. In the embodiment of the present invention, the obstacle detection module uses a computer equipped with a NVIDIA GTX 1070 GPU to process the collected binocular image data to...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a binocular vision obstacle detection system and a binocular vision obstacle detection method based on a convolutional neural network. The binocular vision obstacle detection system consists of an image acquisition module and an obstacle detection module. The image acquisition module acquires a binocular image and transmits the binocular image to the obstacle detection module to perform corresponding data processing on acquired image data, so as to obtain a precise obstacle region. The binocular vision obstacle detection method comprises the steps of: firstly, subjecting the acquired original image to median filtering processing; then correcting the binocular image according to camera parameters; designing a new convolution kernel to be used in a convolutional neural network structure for generating a precise disparity map; and finally, detecting the precise obstacle region in the image by adopting an improved V-parallax method. The binocular vision obstacle detection system and the binocular vision obstacle detection method have the advantage of being high in obstacle detection precision under conditions such as complicated light and small obstacles, and showing good robustness.

Description

technical field [0001] The present invention relates to the technical field of binocular vision image processing, in particular to a binocular vision obstacle detection system based on a convolutional neural network and a detection method thereof. Background technique [0002] With the advancement of computer technology, smart cars have developed rapidly and are widely used in fields such as national defense, scientific research and daily life. Among them, obstacle detection is the core issue in smart car navigation. [0003] The convolutional neural network is a feed-forward network whose artificial neurons can respond to the units within the coverage area, including convolutional layers and pooling layers, and has excellent performance in image processing. In recent years, it has received more and more attention from people, and its application fields have become more and more extensive. [0004] At present, the obstacle detection method based on binocular vision has gra...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V20/58G06F18/214
Inventor 马国军胡颖夏健卫春军郑威
Owner JIANGSU UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products