Monitoring method and system for large unmanned transport vehicle

Abstract

The invention discloses a large unmanned transport vehicle monitoring method and system. The method comprises the steps: calibrating a camera, and obtaining parameters participating in distortion in the camera; collecting parameters of the image projected to the cylindrical surface according to the image view field angle and the image width; obtaining a first image coordinate mapping table; extracting image features, calculating a matching relationship between different images, and obtaining a second image coordinate mapping table; setting the size of an image fusion area, and obtaining a weighted fusion matrix; obtaining a third image coordinate mapping table; collecting image information of the surrounding environment when the unmanned transport vehicle runs; according to the third imagecoordinate mapping table, mapping all the images to the same fusion space in a unified manner, and according to the weighted fusion matrix, performing weighted fusion on the overlapping regions amongthe images to obtain an all-round view; and performing pedestrian detection on the surround view by adopting a pedestrian detection algorithm based on deep learning to complete pedestrian position detection. According to the invention, abnormal conditions can be discovered and handled in time, and the safety risk of the large unmanned transport vehicle is greatly reduced.

Description

technical field [0001] The invention relates to the field of unmanned driving technology, in particular to a monitoring method and system for a large unmanned transport vehicle. Background technique [0002] With the continuous improvement of my country's economic development and opening to the outside world, my country's port throughput has increased year by year, and it has become the country with the largest annual port throughput. At the same time, due to the high threshold of driving skills, there is a serious shortage of large transport vehicle drivers in the port, which cannot meet the growing transport demand. [0003] The use of large unmanned transport vehicles to participate in transportation can help solve this problem, which can not only reduce operating costs and improve operational efficiency, but also reduce transportation safety risks. [0004] When a large unmanned transport vehicle is working, if its surrounding environment is not effectively monitored, i...

AI Technical Summary

Problems solved by technology

[0004] When the large-scale unmanned transport vehicle is working, if its surrounding environment is not effectively monitored, it will not be able to detect abnormal conditions in time, which may cause safety accidents

Due to the high body size of large unmanned transport vehicles, traditional monitoring solutions for small vehicles, such as the use of panoramic camera monitoring solutions, cannot meet the monitoring needs of large unmanned transport vehicles

At present, there is no good technical solution to help solve the problem of monitoring the surrounding environment of large unmanned transport vehicles

Images