Automatic driving system and method based on monocular camera and raspberry pie

A technology of monocular camera and automatic driving, which is applied in the field of automatic driving system of deep convolutional neural network, which can solve the problems of increasing hardware cost, monocular camera cannot provide more detailed road condition information, and cannot provide computing power of unmanned driving technology. , to achieve the effect of small cost and price

Inactive Publication Date: 2019-06-18
SHANDONG UNIV
View PDF11 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] At present, the rapid development of autonomous driving technology is generally based on multi-eye cameras or lidar, and needs to be run on high-configuration servers. However, the traditional Raspberry Pi provides less computing power and cannot provide traditional driverless technology The required computing power, when the hardware is not rich, that is, only one monocular camera is provided, because the monocular camera cannot provide more detailed road condition information when the model car is driving, so it is necessary to realize automatic driving A more complex neural network is required to process images captured by a monocular camera. However, as mentioned above, the computing power provided by the Raspberry Pi is limited, so more complex neural networks cannot run on the Raspberry Pi. At present, there is no suitable neural network model that can achieve the balance between the two. In the existing network models, binocular cameras or trinocular cameras are generally used, and radar and other auxiliary equipment are used to assist simple multi-layer convolutional neural networks. To realize the automatic driving on the computing power of the Raspberry Pi, but this increases the hardware cost, so the automatic driving cannot be realized at this stage based on the hardware of the monocular camera and the Raspberry Pi

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic driving system and method based on monocular camera and raspberry pie
  • Automatic driving system and method based on monocular camera and raspberry pie

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0047] An autopilot system based on a monocular camera and a Raspberry Pi, such as figure 1 As shown, it includes a data collection unit, a data preprocessing unit, a deep convolutional neural network, and a control unit connected in sequence;

[0048] The data collection unit is used to obtain the road condition information when the model car (the model car is a 4WD smart model car with a monocular camera and a raspberry pie) running, the road condition information refers to the road condition picture, and sends the obtained road condition information to the data Pre-processing unit; the data pre-processing unit is used to pre-process the received road condition pictures, which refers to successively perform grayscale, noise reduction, binarization, character segmentation and normalization processing; the deep convolutional neural network in In the training, the data set composed of multiple pre-processed road conditions pictures is used to obtain a mature deep convolutional ...

Embodiment 2

[0068] A self-driving method based on a monocular camera and a raspberry pie, such as figure 2 As shown, it is used to realize the automatic driving of the model car on the model lane, including the following steps:

[0069] (1) Collect data sets; the data sets include about 100,000 pictures of road conditions;

[0070] (2) Data set preprocessing;

[0071] (3) Use the preprocessed data set in step (2) to train the deep convolutional neural network, and obtain a mature deep convolutional neural network after training; the mature deep convolutional neural network inputs the captured road condition pictures and outputs the control of the model car Information, the control information of the model car includes the steering direction (turn left or right), the steering angle (how many degrees to turn left or right), and the size of the accelerator;

[0072] (4) Use the mature deep convolutional neural network trained in step (3) to make the model car drive automatically on the mo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an automatic driving system and method based on a monocular camera and the raspberry pie. The automatic driving system comprises a data collecting unit, a data preprocessing unit, a deep convolutional neural network and a control unit connected in sequence. The data collecting unit is used for collecting a data set. The data preprocessing unit is used for preprocessing thecollected data set. The deep convolutional neural network is used for training the preprocessed data set to obtain a mature model. The control unit is used for training the obtained mature model to enable the model vehicle to run automatically on a model lane. According to the invention, the expensive hardware like the complicated deep network model and radar are abandoned; automatic driving under conditions of low computing power and poor hardware condition is realized; and thus the unmanned driving is realized by using an end-to-end neural network and relying on the pure visual recognitionwith low costs while only the monocular camera and the raspberry pie are used.

Description

technical field [0001] The invention belongs to the technical field of image processing, and in particular relates to an automatic driving system and method based on a deep convolutional neural network of a monocular camera running on a raspberry pie. Background technique [0002] At present, the rapid development of autonomous driving technology is generally based on multi-eye cameras or lidar, and needs to be run on high-configuration servers. However, the traditional Raspberry Pi provides less computing power and cannot provide traditional driverless technology The required computing power, when the hardware is not rich, that is, only one monocular camera is provided, because the monocular camera cannot provide more detailed road condition information when the model car is driving, so it is necessary to realize automatic driving A more complex neural network is required to process images captured by a monocular camera. However, as mentioned above, the computing power prov...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G05D1/02G06N3/04G06N3/08
Inventor 戴鸿君张继刚鞠雷许信顺
Owner SHANDONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products