Real-time remote driving system and method for monitoring states of multiple vehicles

Abstract

The invention discloses a real-time remote driving system for monitoring the states of multiple vehicles. The system comprises a plurality of vehicle end devices and a cloud simulation platform; each vehicle end device is used for generating operation state information of a current vehicle and environment perception result information representing a recognition result of each obstacle around the current vehicle, and outputting the information through a wireless communication link; and the cloud simulation platform is used for generating a vehicle model and a virtual environment model for each vehicle end device according to the operation state information and the environment perception result information, fusing model data of all the vehicle end devices on the basis, obtaining a data fusion video including driving of all the vehicles in the corresponding driving environment, and displaying the data fusion video. The requirement for monitoring multiple vehicles at the same time is met, the requirement for bandwidth is low, the popularization rate is high, the cost is low, the link of manually judging the obstacle characteristics is eliminated, and high safety and reliability are achieved.

Description

Technical field [0001] The present invention relates to the field of mine automatic driving technology, in particular, to a real-time remote driving system and method for multi-vehicle state monitoring. Background technique [0002] In recent years, automatic driving technology has developed rapidly. Since the vehicle itself calculates the resource, power consumption limits, the single vehicle is difficult to perform real-time and efficient processing sensor data and the automatic driving decision planning calculation, leading to the development of automatic driving functions, and the proposal of remote driving can solve some problems; on the other hand , Using the virtual environment and the vehicle model constructed by the automatic driving simulation technology, the automatic driving scene is realized, providing security for automatic driving. [0003] Disclosed in the prior art driving method of remote control, the vehicle often instantaneous feedback on a video display havin...

AI Technical Summary

Problems solved by technology

[0003] In the remote control driving method disclosed in the prior art, the real-time returned video of the vehicle is often displayed on the cloud and / or the driving simulator end with driving control capability, as the basis for remote control driving, and the real-time returned video occupies less bandwidth. Large, high requirements for network communication, poor promotion, high cost

Secondly, the video sent back from driving can only display the environmental conditions in front, left, right, and rear of the vehicle, as well as the analysis data of the vehicle bus protocol, and does not include the perception result information such as the size, shape, position, speed, and type of obstacles. The human driver at the remote end makes judgments on the returned video through human eyes, which is highly subjective and less secure

In addition, under normal circumstances, the human-operated driving simulator can only remotely control one autonomous vehicle at the same time, and it is difficult to simultaneously control and supervise multiple vehicles.

Images