Agricultural park scene lane departure early warning control method and system based on end-to-end convolutional neural network

A technology of convolutional neural network and lane deviation, which is applied in the field of early warning and control of lane deviation in agricultural garden scenes based on end-to-end convolutional neural network. Manual testing and other issues

Active Publication Date: 2020-07-24
成都睿芯行科技有限公司
View PDF11 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In addition, the above-mentioned patented technology also has the following problems: it requires image preprocessing to enhance edge features to improve the accuracy of edge detection, preprocessing plays a decisive role in the system, and it is necessary to manually try various image preprocessing methods and adjust various preprocessing The threshold parameter, and the robustness of the fixed preprocessing method to light changes, climate changes, road occluders, etc. is difficult to achieve good results
[0007] Second, if traditional computer vision is used to extract road edge features of agricultural dirt roads, it will not only require a lot of manual testing, but also it is difficult to get a good result

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Agricultural park scene lane departure early warning control method and system based on end-to-end convolutional neural network
  • Agricultural park scene lane departure early warning control method and system based on end-to-end convolutional neural network
  • Agricultural park scene lane departure early warning control method and system based on end-to-end convolutional neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0059] like Figure 1 to Figure 3 As shown, the present embodiment provides an end-to-end convolutional neural network-based lane deviation early warning control system for agricultural garden scenes, which consists of an image acquisition module 101, an end-to-end semantic segmentation neural network 102, and post-neural network data processing module 103, state classifier 104 and bottom vehicle control module 105. The data stream consists of input monocular RGB image 111 , semantic segmentation result 112 , road edge graph 113 , line detection result set 114 , edge detection, line detection and filtering result 115 , and control signal 116 . An imaging device capable of capturing images of the current road surface and both sides of the road surface is installed on the central axis of the vehicle.

[0060] In this embodiment, an end-to-end convolutional neural network-based lane deviation early warning control method for an agricultural garden scene includes the following st...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an agricultural park scene lane departure early warning control method based on an end-to-end convolutional neural network. The method comprises the following steps: collectinga real-time road image, transmitting the real-time road image to an efficient semantic segmentation convolutional neural network, and performing pixel-level marking; performing region-of-interest selection on the image marked by the neural network; extracting an edge image of the road image in the region-of-interest selection by adopting differential edge detection; obtaining a coordinate point set corresponding to edge pixels in the edge image in an image coordinate system; detecting a road edge fitting straight line from the coordinate point set corresponding to the edge pixel by adopting aHough transform straight line detection algorithm; obtaining an optimal fitting straight line through screening and fusion; and according to the optimal fitting straight line result, extracting the relative distance between the vehicle body and the left and right edges of the road in the real-time road image and the characteristics of the focus of the vehicle-mounted camera to distinguish the vehicle pose state, and carrying out corresponding vehicle body adjustment to realize centered driving of the vehicle.

Description

technical field [0001] The invention relates to the technical field of early warning of lane deviation in agricultural garden scenes, in particular to an early warning control method and system for lane deviation in agricultural garden scenes based on an end-to-end convolutional neural network. Background technique [0002] At present, the labor force in modern China is gradually concentrated in the cities, while the agricultural labor force is getting less and less, and there are large areas of barren land in the countryside; this phenomenon is particularly prominent in Xinjiang, where the land is sparsely populated. The development of large-scale and centralized management requires a large number of modern agricultural machinery and equipment. However, most of the agricultural machinery and equipment in the existing technology are almost driven by humans. This driving process is a typical simple and repetitive labor. Therefore, the need to liberate manpower from agricultur...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): B60W30/12B60W50/14G06K9/00G06K9/32G06K9/34G06K9/62G06N3/04G06N3/08
CPCB60W30/12B60W50/14G06N3/08G06V20/588G06V10/25G06V10/267G06N3/045G06F18/2431
Inventor 周军肖剑彪龙羽徐菱
Owner 成都睿芯行科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products