Integrated environment perception and multi-target tracking system

Abstract

The invention discloses an integrated environment perception and multi-target tracking system. The system comprises an image acquisition system, which is used for acquiring images around a maneuvering target in real time for preprocessing and sending the images to an image splicing projection system and a target identification tracking system; an image splicing projection system, which is used for splicing the received images and performing 3D projection to form a 3D panoramic image and sending the 3D panoramic image to the display control system; a target recognition and tracking system, which is used for recognizing sensitive targets from the received images, carrying out frame selection on the recognized sensitive targets and outputting the selected sensitive targets to the 3D panoramic image in a superposed manner, and is used for carrying out continuous recognition and tracking on the recognized sensitive targets, locking the selected specific targets and carrying out continuous recognition and tracking; and a display control system which is used for displaying the 3D panoramic image and used for selecting a specific target in a touch control mode. The system environment sensing distance can be effectively improved, the visual field of maneuvering target passengers is expanded, and the capacity of the passengers for recognizing the field complex environment is comprehensively improved.

Description

technical field [0001] The invention belongs to the technical field of automobile intelligent assisted driving, and in particular relates to an integrated environment perception and multi-target tracking system, in particular to computer vision technology for image splicing, recognition and tracking. Background technique [0002] In recent years, with the rise of the artificial intelligence research boom, intelligent equipment has gradually entered into daily life, and the mobile target is a good carrier for the application of intelligent technology. For example, systems such as panoramic surround view, forward collision warning, and traffic sign recognition use computer vision technology, especially involving the application of image stitching, target recognition and tracking algorithms. Image mosaic technology is mainly to splice and fuse multiple small-scale images with overlapping fields of view to form a large field of view image in a panoramic range, which can effectiv...

AI Technical Summary

Problems solved by technology

However, the existing panoramic surround view technology is mostly limited to the surrounding and short-distance applications of maneuvering targets, and only shows the imaging of the field of view in the global range, which cannot be zoomed in, or for tracking and imaging of local or specific targets, but this is precisely in the field of complex environment observation Has great application value

[0003] The existing vehicle-mounted panoramic view systems mostly use 4-way fisheye cameras or wide-angle cameras, which are respectively arranged around the maneuvering target. Although this type of vehicle-mounted panoramic view system has a wide field of view, the pixels occupied by distant objects are relatively low, so it cannot be effectively detected. Long-distance target observation; and does not have target recognition and tracking functions, does not have specific target locking and zoom-in tracking functions

Images