Light-vision fusion integrated system

Abstract

The invention provides a light-vision fusion integrated system, and the system comprises a laser radar, a camera and a data processing unit, the laser radar and the camera are connected with the data processing unit, and the data of the laser radar and the camera are subjected to the preliminary data analysis through a point cloud processing algorithm module and an image processing algorithm module; the PTP timing service device performs timing on the laser radar, the camera sensor and the core processor to realize synchronous calibration of frame rates of the laser radar, the camera sensor and the core processor; then space calibration is carried out through a space calibration algorithm module, and bottom layer fusion of data detected by the laser radar and the camera sensor is achieved; the event analysis logic module compares the traffic participant information with preset traffic event logic information, and if the information is inconsistent, parking practice is automatically reported; and the data configuration and forwarding module is used for uploading the original data of the sensor and the sensed event information to a terminal user platform.

Description

technical field [0001] The present invention relates to the technical field of intelligent transportation, and more specifically, to an integrated system for optical and visual fusion. Background technique [0002] With the continuous development of network communication technology, the entire field of intelligent transportation is also evolving from an intelligent transportation system to an intelligent collaboration system. That is to say, from the current bicycle intelligence to the coordinated development of vehicles and roads. In the whole process, in addition to improving the intelligence of bicycles, the entire road traffic must also be transformed into intelligent high-speed and intelligent transportation. The first thing that needs to be solved for smart roads is to improve the road perception network, develop vehicle-road coordination and automatic driving. At present, bicycle intelligence can satisfy conditional automatic driving, but due to factors such as the s...

AI Technical Summary

Problems solved by technology

The above multi-sensor fusion technology is currently a post-fusion event detection method commonly used in the construction of smart expressways and intelligent transportation. This method mainly has the following problems in practical applications: 1. The deep fusion between sensors cannot be fully realized. 2. The accuracy of event detection is relatively low and the data output delay is long, which makes it difficult to meet the relevant requirements of subsequent vehicle-road coordination; 3. It is necessary to deploy a large number of acquisition devices and data processors, and the overall project construction Large volume, large amount of follow-up maintenance, difficult to achieve large-scale promotion

Images