Panoramic auxiliary driving system and method for large truck

Abstract

The invention provides a panoramic auxiliary driving system and method for a large truck. Image collecting and calibrating are respectively conducted through a first camera, a second camera, a third camera, a fourth camera, a fifth camera and a sixth camera, inner parameters and outer parameters of all the cameras are acquired, the collected images are corrected through the inner parameters and the outer parameters, and a mapping model of the collected images and the corrected images is constructed; the collected images are subjected to affine transformation, perspective transformation and zooming transformation to obtain overlook images; the overlook images are subjected to image matching through a speed up robust feature registration algorithm to obtain local feature points; image splicing fusion is conducted according to the local feature points; a panoramic image after splicing is subjected to image processing to obtain a preprocessed panoramic image; a main control processing module conducts barrier detection on the preprocessed panoramic image according to the running state of a vehicle; the main control processing module automatically switches to a one-way camera image or amulti-way camera image according to the state of the vehicle, and early-warning is achieved according to the barrier detection result.

Description

technical field [0001] The invention belongs to the field of digital image processing, and in particular relates to a panoramic auxiliary driving system and method for large trucks. Background technique [0002] With the rapid development of the freight industry, the demand for large trucks is increasing, and people's requirements for the safety of truck driving are also getting higher and higher. When driving a traditional truck, the driver usually judges whether there are obstacles around the truck by looking at the rearview mirrors on both sides of the column. This method of relying on traditional rearview mirrors to assist driving has many disadvantages: traditional rearview mirrors cannot completely cover the road conditions around the truck, that is, when the driver is driving, there is a blind spot in the field of vision, which is likely to cause traffic accidents. When driving a traditional truck, the driver needs to look at too many mirrors, which is prone to visua...

AI Technical Summary

Problems solved by technology

This method of relying on traditional rearview mirrors to assist driving has many disadvantages: traditional rearview mirrors cannot completely cover the road conditions around the truck, that is, the driver has a blind spot when driving, which is likely to cause traffic accidents

However, the camera it uses is not a fisheye camera, so it cannot cover the entire area around the truck when the large truck is running on different road conditions

And the obstacle detection device is radar. Compared with visual obstacle detection, the cost is relatively high, it is not intuitive enough, and the early warning information is not rich enough. Similarly, it is only suitable for vehicles such as small cars or cars.

[0007] To sum up, there are problems in the patents invented at present: they fail to completely solve the problem of blind spots in the process of driving trucks; they all only display the road conditions around the truck in a panoramic view, without further visually detecting obstacles around the truck, real-time Provide warning information to drivers

Images