Vehicle detection method and system based on monocular vision and deep learning

A vehicle detection and deep learning technology, applied in the field of vehicle detection, can solve the problem that the 4G network bandwidth cannot meet the real-time transmission of high-quality video images, cannot predict and warn of primary accidents and secondary accidents, and cannot guarantee the real-time performance of vehicle speed measurement and distance measurement and other issues to achieve the effect of minimizing reprojection error, improving accuracy, and accurate real-time tracking

Pending Publication Date: 2022-04-29
山东奥邦交通设施工程有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The safety of highway vehicles has always been the focus of social attention. The initial monitoring system of the highway required personnel to view the video in the monitoring background. Make predictions and early warnings for primary accidents and secondary accidents, and cannot avoid the occurrence of primary accidents and secondary accidents
[0005] The inventors found that with the increase of video image quality, the existing 5G network infrastructure does not cover all, and the 4G network bandwidth cannot meet the real real-time transmission of high-quality video images. Carry out further computer vision processing to measure vehicle speed and distance, and it is even more impossible to guarantee the real-time performance of vehicle speed measurement and distance measurement

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Vehicle detection method and system based on monocular vision and deep learning
  • Vehicle detection method and system based on monocular vision and deep learning
  • Vehicle detection method and system based on monocular vision and deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0058] Such as figure 1 As shown, Embodiment 1 of the present invention provides a vehicle detection method based on monocular vision and deep learning, including the following process:

[0059] Obtain the video monitoring data of the expressway, optimize the camera parameters of the back projection from the two-dimensional space to the three-dimensional space by the evolutionary algorithm, carry out the calibration of the video monitoring camera of the expressway, and obtain the calibrated camera parameters;

[0060] Use the neural network for vehicle detection to obtain the vehicle type and two-dimensional bounding box, use the calibrated camera parameters to trace the foot of the two-dimensional bounding box of the vehicle back to the three-dimensional space, and obtain the vehicle coordinate point in the world coordinate system;

[0061] According to the vehicle coordinate point in the world coordinate system and the zero point coordinate established by the camera, the veh...

Embodiment 2

[0085] Such as figure 2 As shown, Embodiment 2 of the present invention provides a vehicle detection method based on monocular vision and deep learning, including the following process:

[0086] Obtain the video monitoring data of the expressway, optimize the camera parameters of the back projection from the two-dimensional space to the three-dimensional space by the evolutionary algorithm, carry out the calibration of the video monitoring camera of the expressway, and obtain the calibrated camera parameters;

[0087] Use the neural network for vehicle detection to obtain the vehicle type and two-dimensional bounding box, use the calibrated camera parameters to trace the foot of the two-dimensional bounding box of the vehicle back to the three-dimensional space, and obtain the vehicle coordinate point in the world coordinate system;

[0088] According to the vehicle coordinate point in the world coordinate system and the zero point coordinate established by the camera, the ve...

Embodiment 3

[0110] Such as image 3 As shown, Embodiment 3 of the present invention provides a vehicle detection method based on monocular vision and deep learning, including the following process:

[0111] Obtain the video monitoring data of the expressway, optimize the camera parameters of the back projection from the two-dimensional space to the three-dimensional space by the evolutionary algorithm, carry out the calibration of the video monitoring camera of the expressway, and obtain the calibrated camera parameters;

[0112] Use the neural network for vehicle detection to obtain the vehicle type and two-dimensional bounding box, use the calibrated camera parameters to trace the foot of the two-dimensional bounding box of the vehicle back to the three-dimensional space, and obtain the vehicle coordinate point in the world coordinate system;

[0113] According to the vehicle coordinate point in the world coordinate system and the zero point coordinate established by the camera, the veh...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a vehicle detection method and system based on monocular vision and deep learning, and the method comprises the steps: obtaining expressway video frame image data, employing an evolutionary algorithm to optimize camera parameters of back projection from a two-dimensional space to a three-dimensional space, carrying out the camera calibration, and obtaining the calibrated camera parameters; a neural network is adopted to carry out vehicle detection, a vehicle type and a two-dimensional bounding box are obtained, the calibrated camera parameters are adopted to track back foot points of the vehicle two-dimensional bounding box to a three-dimensional space, and vehicle coordinate points in a world coordinate system are obtained; calculating a vehicle distance by adopting Euclidean distance according to a vehicle coordinate point under a world coordinate system and a zero point coordinate determined by a camera, calculating a vehicle speed according to the vehicle distance based on a sliding time window algorithm, judging whether a speed variance is smaller than a given threshold value or not, and judging the vehicle with too low speed as a stopped vehicle; rapid detection of the vehicle distance and the vehicle speed is realized, and the real-time performance of detection is improved.

Description

technical field [0001] The invention relates to the technical field of vehicle detection, in particular to a vehicle detection method and system based on monocular vision and deep learning. Background technique [0002] The statements in this section merely provide background art related to the present invention and do not necessarily constitute prior art. [0003] The safety of highway vehicles has always been the focus of social attention. The initial highway monitoring system required personnel to view the video in the monitoring background. After a traffic accident occurred, the personnel reported to the monitoring background to learn of the accident and then make emergency treatment; Prediction and early warning of primary accidents and secondary accidents cannot avoid the occurrence of primary accidents and secondary accidents. With the rise and development of new technologies such as big data and artificial intelligence, intelligent traffic management systems have be...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06V20/52G06V20/64G06V10/762G06V10/82G06K9/62G06N3/04G06N3/08G06T7/246G06T7/73G06T7/80
CPCG06N3/04G06N3/086G06T7/85G06T7/73G06T7/246G06T2207/20081G06T2207/20084G06F18/23
Inventor 杨哲王晓东滕广华张英孙思芹陈曦刘文晓邵强王超颜正凯
Owner 山东奥邦交通设施工程有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products