Vehicle-mounted real-time video information intelligent identification device based on MPSoC

Abstract

The invention discloses a vehicle-mounted real-time video information intelligent identification device based on an MPSoC. The vehicle-mounted real-time video information intelligent identification device comprises an image input module, a video cache module, an MPSoC core processing module, a driving information acquisition module, an information display module, a mobile terminal communication module, a cloud control module and a power supply part. An edge computing technology is adopted, full-automatic detection and recognition of real-time road conditions are achieved by processing video data collected from the image input module in real time, and motion information such as the position and time information of a recognition image or video and the direction and speed of a vehicle is obtained through the driving information obtaining module and serves as driving record information. The recognized image and driving record information can be displayed on the recognition display module and transmitted to the cloud or the mobile terminal, so that the control center adjusts and controls the moving posture of the vehicle in real time. The device can be applied to a driver assistance system and an automatic driving control system in a traffic road environment.

Description

technical field [0001] The invention relates to the fields of MPSoC system design, high-speed off-chip storage design, image sensor data acquisition, video image processing, edge computing, etc., and in particular to an MPSoC-based vehicle real-time video information intelligent recognition device. Background technique [0002] With the continuous development of society, the number of cars is increasing rapidly, and the traffic accidents caused by cars are also multiplying. Therefore, driver assistance systems and automatic driving systems that can reduce and avoid traffic accidents have attracted widespread attention. As an important part of the automatic driving system, the video vision system includes traffic signal recognition, road traffic sign recognition, road obstacle recognition and pedestrian recognition. How to accurately and quickly realize the detection and identification of road condition information, and make timely response instructions is the key to the effe...

AI Technical Summary

Problems solved by technology

A large amount of video data transmission and real-time analysis of various traffic information not only occupy a large amount of network resources, but also bring a heavy burden to the cloud computing center

In addition, traditional cloud services have high latency and poor ability to handle emergencies

For the real-time analysis of surveillance video, when it comes to privacy requirements, the cloud computing platform cannot make any guarantees

Images