General-purpose remote data monitoring and control system and method for unmanned vehicles

The universal remote data monitoring and control system for unmanned vehicles solves the problem of insufficient real-time monitoring of unmanned vehicle information, realizes full-system data monitoring and visualization, improves the safety and efficiency of task execution, supports multi-band communication and autonomous control, and ensures the accuracy and real-time nature of data recording.

CN117331372BActive Publication Date: 2026-11-17ZHONGBING INTELLIGENT INNOVATION RES INST CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202311316304.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-10-12
Publication Date
2026-11-17
Estimated Expiration
2043-10-12

AI Technical Summary

Technical Problem

The existing autonomous vehicles lack the ability to monitor and visualize information in real time, and cannot provide a universal remote real-time data monitoring and control system for different types of autonomous vehicles, resulting in insufficient task execution capability and accuracy.

Method used

This invention provides a generalized remote data monitoring and control system for unmanned vehicles, including a remote communication system, an environmental video monitoring system, a perception and planning remote monitoring system, a vehicle status remote monitoring system, and a vehicle function control system. It enables two-way wireless information communication between the unmanned vehicle and the monitoring system, displays vehicle status and parameters in real time, supports multi-band, multi-frequency, and high-bandwidth communication design, integrates information status estimation and diagnostic tools, and supports fully autonomous or semi-autonomous control.

Benefits of technology

It enables full-system data monitoring and visualization of unmanned vehicle mission execution, improving safety and mission execution capabilities. It can quickly handle faults and anomalies, ensure communication quality in complex environments, provide automated data recording and storage, and reduce the burden of manual monitoring.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117331372B_ABST
    Figure CN117331372B_ABST
Patent Text Reader

Abstract

This invention belongs to the field of unmanned vehicle environmental perception and automatic control technology, specifically relating to a generalized remote data monitoring and control system and method for unmanned vehicles. The system includes a remote communication system, an environmental video monitoring system, a perception and planning remote monitoring system, a vehicle status remote monitoring system, and a vehicle function control system. These systems are integrated into a monitoring system, enabling real-time display and recording of environmental video, perception maps, control commands, and vehicle status data during unmanned vehicle mission execution. Through integrated state estimation capabilities, the system provides alarms for data anomalies or fault conditions, or autonomously suspends the mission to enhance safety. This invention, based on the display and recording of all data, provides a robust monitoring environment for unmanned vehicle testing, debugging, and mission execution. The fault or anomaly detection and warning functions reduce the workload of personnel monitoring unmanned vehicles.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention belongs to the field of environmental perception and automatic control technology for unmanned vehicles, specifically relating to a generalized remote data monitoring and control system and method for unmanned vehicles, which can efficiently and accurately judge and adjust the status of unmanned vehicles. Background Technology

[0002] With the development and promotion of autonomous driving, unmanned vehicles have been put into use and played a role in civilian and military fields, especially in typical scenarios such as material transportation and disaster relief. However, due to the complexity and variability of these typical mission scenarios, and the fact that unmanned driving technology is still under development, most equipment still requires human monitoring and timely handling. This has led to the need for faster and clearer real-time data monitoring and configuration capabilities for unmanned vehicles in experimental testing and actual application scenarios.

[0003] Patent CN109167703B discloses a "data monitoring method, device, equipment, and storage medium for unmanned vehicles," which uses data recording and storage to determine and identify the working status of unmanned vehicles. Patents CN106990784B and CN115092075A respectively describe the path planning and environmental information collection and recording methods for "unmanned rescue vehicles" and the functional data recording and collection methods for "unmanned intelligent epidemic prevention vehicles," analyzing and recording specific tasks of unmanned vehicles and storing necessary functional data. Therefore, there is an urgent need for a generalized solution based on the typical characteristics of various unmanned vehicle tasks and vehicle layouts, and a communication system solution for complex outdoor environments. This method would enable a generalized data monitoring system for unmanned vehicles, allowing for real-time display of data curves and status assessments, and remote configuration and control of unmanned vehicle parameters and tasks based on their working status. This would achieve a generalized monitoring and control system for all scenarios and all functions. Summary of the Invention

[0004] (a) Technical problems to be solved

[0005] The technical problem to be solved by this invention is: given the insufficient real-time monitoring and visualization analysis capabilities of unmanned vehicles in the existing technology, how to provide a generalized remote real-time data monitoring and control system and method that takes into account the different data characteristics of the use tasks of unmanned vehicles with different functions, encompassing all data of the task, perception and control vehicle system, realizing data visualization monitoring and function configuration, and improving the task execution capability and accuracy of unmanned vehicles.

[0006] (II) Technical Solution

[0007] To address the aforementioned technical problems, this invention provides a universal remote data monitoring and control system for unmanned vehicles. The system includes: a remote communication system, an environmental video monitoring system, a perception and planning remote monitoring system, a vehicle status remote monitoring system, and a vehicle function control system; wherein, the environmental video monitoring system, the perception and planning remote monitoring system, the vehicle status remote monitoring system, and the vehicle function control system constitute a monitoring system.

[0008] The remote communication system is used to realize two-way wireless information communication transmission between the unmanned vehicle and the monitoring system;

[0009] The environmental video monitoring system is used to receive multi-mode video information from unmanned vehicles through a remote communication system and display it in real time.

[0010] The perception and planning remote monitoring system will visualize and display in real time the road surface concave and convex obstacle information, the planned task driving path information, the positioning and navigation information status, and the calculated target vehicle speed and turning angle command information, which are fused based on the environmental sensor information on the unmanned vehicle.

[0011] The vehicle status monitoring system is used to display all information related to the driving, steering, braking, and electrical systems of the vehicle in motion, and can be viewed and monitored in real time through multiple window interfaces; at the same time, it is used to plot and process the key status parameters of the unmanned vehicle such as speed, turning angle, and acceleration in real time.

[0012] The vehicle function control system is used to modify and adjust vehicle commands and system configurations in real time, and can change parameters of auxiliary systems such as vehicle task speed limit, power, drive torque, vehicle posture, and lights; operators or monitoring personnel can make changes in real time based on task status by combining data judgment.

[0013] The remote communication system adopts a multi-band, multi-frequency, and high-bandwidth design, is compatible with satellite communication and civilian communication, ensures the real-time transmission of video and data information, and performs autonomous frequency switching and searching by judging communication quality parameters, effectively guaranteeing high-quality information transmission in complex environments.

[0014] The vehicle condition monitoring system integrates information condition estimation and diagnostic tools to collect and logically process the condition information of each subsystem of the vehicle, perform timely diagnosis of the vehicle's working condition, provide prominent prompts for abnormal conditions and data, and give corresponding fault level warnings.

[0015] In the event of an emergency or unmanned vehicle during its mission, the vehicle function control system allows operators to quickly switch permissions, change commands, or operate modes in real time to ensure the safety of the unmanned vehicle and its surrounding environment.

[0016] The vehicle function control system and its controller equipment are capable of fully manual takeover, semi-autonomous takeover, and fully autonomous takeover. This can ensure the execution of unmanned vehicle tasks while processing different modes according to the monitoring system, thereby improving the efficiency of task and work execution.

[0017] The data monitoring and control system records data according to the transmission frequency of each piece of information, ensuring the accuracy of the information without omissions or gaps.

[0018] Furthermore, the present invention also provides a universal remote data monitoring and control method for unmanned vehicles, the method being implemented using the aforementioned universal remote data monitoring and control system for unmanned vehicles, the method comprising the following steps:

[0019] Step S1: The remote communication system establishes a stable connection, and the unmanned vehicle receives the task from the superior. The monitoring software of the environmental video monitoring system, the perception and planning remote monitoring system, and the vehicle status remote monitoring system can display the current task status and vehicle parameters.

[0020] Step S2: The task is confirmed and issued through the controller device of the vehicle function control system, and the unmanned vehicle executes the task; each monitoring system will display the important information transmitted back by the vehicle in real time.

[0021] Step S3: While the system data is being transmitted through the remote communication system, it will be classified and recorded locally at the frequency of the control cycle of each piece of information.

[0022] Step S4: The autonomous task is executed by combining the planned path and road obstacle information displayed by the monitoring system with the vehicle control system; the accuracy of the autonomous vehicle's perception and planning results can be judged by comparing the real-time images with the environmental video monitoring system; the vehicle status remote monitoring system will draw the key control parameter curves of vehicle speed and turning angle in real time and compare the gap between the command and the status feedback.

[0023] Step S5: When the perception planning or control result is incorrect, or the vehicle is in an abnormal or faulty state, the vehicle function control system controller can perform operations such as task suspension and permission result to ensure vehicle safety.

[0024] Step S6: Based on the abnormal situation displayed by the monitoring software, each system can be remotely checked and reset via the controller and control interface function buttons. After the status is restored, task permissions can be restored, and work can continue.

[0025] Step S7: After driving to the task point, the vehicle autonomously executes the task sequence and waits for the next task command from the vehicle control system.

[0026] Step S8: Complete all tasks and return. After completing the tasks, a return command will be received. The vehicle will return according to its previous data records and plans, ending all work and stopping data recording. The stored data files will be automatically named according to the date format, and all data can be reproduced and viewed.

[0027] In step S3, while the data is being monitored and displayed in real time, all data is recorded in real time autonomously, allowing for data review and retrospection.

[0028] In step S4, the information results are displayed clearly and visually on the monitoring system, and the system provides security alerts for anomalies and faults based on the judgment logic of the data status, which provides great convenience for viewing and monitoring large amounts of data.

[0029] In step S5, the control function system will automatically or manually switch control permissions and parameter configurations.

[0030] (III) Beneficial Effects

[0031] Compared with the prior art, the present invention has the following beneficial effects:

[0032] (1) This invention provides a universal data monitoring system for the entire unmanned vehicle system and real-time visualization of the data, which can effectively perform accurate status assessment and judgment of each system of the unmanned vehicle during task execution, and greatly improve safety and task execution capability;

[0033] (2) While monitoring data in real time, this invention integrates and opens up control functions such as electrical, permission, and parameter configuration for each system’s possible faults and anomalies. In the event of a fault, it can quickly perform operations such as permission switching and takeover, and system reset, effectively eliminating faults.

[0034] (3) In terms of communication system, the present invention has implemented a multi-band, multi-frequency, and high-bandwidth design for typical unmanned vehicle mission environments such as field rescue and exploration, and maintains good communication capabilities in complex environments;

[0035] (4) The monitoring software of this invention integrates system fault assessment and status judgment capabilities, and immediately displays warning reminders in abnormal states, which can be fast and effective when viewing big data.

[0036] (5) The present invention can provide automated, high real-time data recording and storage while monitoring data, and all data can be clearly traced back during task execution. Attached Figure Description

[0037] Figure 1 This is a schematic diagram of the system of the present invention;

[0038] Figure 2 This is a schematic diagram of the data interaction process of the present invention;

[0039] Figure 3 This is a schematic diagram of the control flow of the present invention;

[0040] Figure 4 This is a flowchart of the system method according to a specific embodiment of the present invention. Detailed Implementation

[0041] To make the objectives, contents, and advantages of the present invention clearer, the specific embodiments of the present invention will be described in further detail below with reference to the accompanying drawings and examples.

[0042] To address the aforementioned technical problems, this invention provides a universal remote data monitoring and control system for unmanned vehicles. The system includes: a remote communication system, an environmental video monitoring system, a perception and planning remote monitoring system, a vehicle status remote monitoring system, and a vehicle function control system; wherein, the environmental video monitoring system, the perception and planning remote monitoring system, the vehicle status remote monitoring system, and the vehicle function control system constitute a monitoring system.

[0043] The remote communication system is used to realize two-way wireless information communication transmission between the unmanned vehicle and the monitoring system;

[0044] The environmental video monitoring system is used to receive multi-mode video information from unmanned vehicles through a remote communication system and display it in real time.

[0045] The perception and planning remote monitoring system will visualize and display in real time the road surface concave and convex obstacle information, the planned task driving path information, the positioning and navigation information status, and the calculated target vehicle speed and turning angle command information, which are fused based on the environmental sensor information on the unmanned vehicle.

[0046] The vehicle status monitoring system is used to display all information related to the driving, steering, braking, and electrical systems of the vehicle in motion, and can be viewed and monitored in real time through multiple window interfaces; at the same time, it is used to plot and process the key status parameters of the unmanned vehicle such as speed, turning angle, and acceleration in real time.

[0047] The vehicle function control system is used to modify and adjust vehicle commands and system configurations in real time, and can change parameters of auxiliary systems such as vehicle task speed limit, power, drive torque, vehicle posture, and lights; operators or monitoring personnel can make changes in real time based on task status by combining data judgment.

[0048] The remote communication system adopts a multi-band, multi-frequency, and high-bandwidth design, is compatible with satellite communication and civilian communication, ensures the real-time transmission of video and data information, and performs autonomous frequency switching and searching by judging communication quality parameters, effectively guaranteeing high-quality information transmission in complex environments.

[0049] The vehicle condition monitoring system integrates information condition estimation and diagnostic tools to collect and logically process the condition information of each subsystem of the vehicle, perform timely diagnosis of the vehicle's working condition, provide prominent prompts for abnormal conditions and data, and give corresponding fault level warnings.

[0050] In the event of an emergency or unmanned vehicle during its mission, the vehicle function control system allows operators to quickly switch permissions, change commands, or operate modes in real time to ensure the safety of the unmanned vehicle and its surrounding environment.

[0051] The vehicle function control system and its controller equipment are capable of fully manual takeover, semi-autonomous takeover, and fully autonomous takeover. This can ensure the execution of unmanned vehicle tasks while processing different modes according to the monitoring system, thereby improving the efficiency of task and work execution.

[0052] The data monitoring and control system records data according to the transmission frequency of each piece of information, ensuring the accuracy of the information without omissions or gaps.

[0053] Furthermore, the present invention also provides a universal remote data monitoring and control method for unmanned vehicles, the method being implemented using the aforementioned universal remote data monitoring and control system for unmanned vehicles, the method comprising the following steps:

[0054] Step S1: The remote communication system establishes a stable connection, and the unmanned vehicle receives the task from the superior. The monitoring software of the environmental video monitoring system, the perception and planning remote monitoring system, and the vehicle status remote monitoring system can display the current task status and vehicle parameters.

[0055] Step S2: The task is confirmed and issued through the controller device of the vehicle function control system, and the unmanned vehicle executes the task; each monitoring system will display the important information transmitted back by the vehicle in real time.

[0056] Step S3: While the system data is being transmitted through the remote communication system, it will be classified and recorded locally at the frequency of the control cycle of each piece of information.

[0057] Step S4: The autonomous task is executed by combining the planned path and road obstacle information displayed by the monitoring system with the vehicle control system; the accuracy of the autonomous vehicle's perception and planning results can be judged by comparing the real-time images with the environmental video monitoring system; the vehicle status remote monitoring system will draw the key control parameter curves of vehicle speed and turning angle in real time and compare the gap between the command and the status feedback.

[0058] Step S5: When the perception planning or control result is incorrect, or the vehicle is in an abnormal or faulty state, the vehicle function control system controller can perform operations such as task suspension and permission result to ensure vehicle safety.

[0059] Step S6: Based on the abnormal situation displayed by the monitoring software, each system can be remotely checked and reset via the controller and control interface function buttons. After the status is restored, task permissions can be restored, and work can continue.

[0060] Step S7: After driving to the task point, the vehicle autonomously executes the task sequence and waits for the next task command from the vehicle control system.

[0061] Step S8: Complete all tasks and return. After completing the tasks, a return command will be received. The vehicle will return according to its previous data records and plans, ending all work and stopping data recording. The stored data files will be automatically named according to the date format, and all data can be reproduced and viewed.

[0062] In step S3, while the data is being monitored and displayed in real time, all data is recorded in real time autonomously, allowing for data review and retrospection.

[0063] In step S4, the information results are displayed clearly and visually on the monitoring system, and the system provides security alerts for anomalies and faults based on the judgment logic of the data status, which provides great convenience for viewing and monitoring large amounts of data.

[0064] In step S5, the control function system will automatically or manually switch control permissions and parameter configurations.

[0065] Example 1

[0066] like Figure 1 As shown in this embodiment, a universal remote data monitoring and control system for unmanned vehicles includes a remote communication system 1, an environmental video monitoring system 2, a perception and planning remote monitoring system 3, a vehicle status remote monitoring system 4, and a vehicle function control system 5. Wherein:

[0067] The remote communication system 1 is responsible for two-way wireless information transmission between the unmanned vehicle and the monitoring software.

[0068] The environmental video monitoring system 2 receives multi-mode unmanned vehicle video information through a remote communication system and displays it in real time;

[0069] The perception and planning remote monitoring system 3 will visualize and display in real time the road surface concave and convex obstacle information, the planned task driving path information, the positioning and navigation information status, and the calculated target vehicle speed, turning angle, and other main command information fused based on the environmental sensor information of the unmanned vehicle.

[0070] The vehicle status remote monitoring system 4 primarily displays all information about the driving, steering, braking, and electrical systems during vehicle operation, allowing for real-time viewing and monitoring through multiple window interfaces. Simultaneously, it can plot and process key status parameters such as vehicle speed, turning angle, and acceleration in real time. The system integrates information status estimation and diagnostic capabilities, collecting and logically processing status information from various subsystems of the vehicle, promptly diagnosing the overall vehicle operating status, providing prominent alerts for abnormal states and data, and issuing corresponding fault level warnings.

[0071] The vehicle function control system 5 modifies and adjusts vehicle commands and system configurations in real time, changing parameters such as vehicle task speed limits, power, drive torque, vehicle posture, and auxiliary systems like lights. Operators or monitoring personnel can make real-time changes based on the task status by combining data analysis. During unmanned vehicle missions, in case of emergencies or urgent situations, operators can quickly switch permissions, change commands, or operate modes to ensure the safety of the unmanned vehicle and its surrounding environment.

[0072] All of the above-mentioned monitoring and control systems are embedded and integrated within the monitoring software. They exchange information via UDP or TCP / IP protocols, enabling information transmission and real-time display on the interface.

[0073] like Figure 2 As shown, in order to realize a fully integrated remote monitoring and control system for unmanned vehicles during mission execution, information interaction and transmission among the internal systems is the main technical implementation approach.

[0074] The environmental video monitoring system 2 receives data from the unmanned vehicle after it is coded and sent through the remote communication system 1. The system decodes the data and displays it in the corresponding video window. This process uses standard video communication protocols (such as H264, H265, etc.) to be applicable to the camera types that the unmanned vehicle may use.

[0075] The perception and planning remote monitoring system 3 uses network protocols such as UDP or TCP / IP to receive the environmental information fused and analyzed by the unmanned vehicle, obtain its road obstacle information, and display the path planned by the unmanned vehicle. This interface is laid out together with the aforementioned video interface to compare the scene status, providing convenience for personnel to judge the vehicle's autonomous capabilities. In addition, the system will send control quantities based on the planning information, such as throttle, braking, and steering, to the vehicle status monitoring system for intuitive comparison between vehicle commands and status data.

[0076] The vehicle status remote monitoring system 4 receives status data from all sub-modules on the unmanned vehicle bus. After parsing, the data is displayed on the interface. By combining the data's changing trends and numerical conditions, and through the system's internal information status estimation and diagnostic capabilities, it outputs the abnormal status of the corresponding system or the entire vehicle. It provides alarms and prompts through clear methods such as color differentiation and outputs the fault level to assist personnel in operation and adjustment. In addition, it compares the command control quantities given by the perception and planning remote monitoring system with the vehicle status feedback quantities in real time. Through information processing and drawing, it draws real-time curves of interface information and provides the difference between the control quantities and status quantities. This data monitoring function will provide a strong basis for judging the status of unmanned vehicles, reduce the complexity of personnel judgment, and can be used for a large number of unmanned vehicle debugging and testing work, improve the debugging efficiency of unmanned vehicles, and quickly put them into application tasks.

[0077] The vehicle function control system 5 modifies and adjusts vehicle commands and system configurations in real time, such as... Figure 3 As shown, the system mainly includes: a task permission interface, a parameter configuration interface, an electrical system interface, and a map navigation interface. Operators can switch between vehicle driving tasks and driving modes through the task permission interface. The parameter configuration interface allows for limiting the amplitude of changes in vehicle torque, power, and speed output. The electrical system interface allows for real-time control of power distribution and lighting functions in some systems. The map navigation interface allows for adjustments and changes to the task path, location points, and task information. Relevant information is transmitted to the autonomous vehicle via a network interface using TCP / IP or UDP protocols. The autonomous vehicle's bus will parse the information and execute the corresponding functions. When the remote vehicle status monitoring system detects a serious fault or abnormal condition, it will autonomously issue a permission command to urgently stop the autonomous vehicle's task. The task can be resumed after personnel confirm the status.

[0078] Through the information interaction and interface design of the above-mentioned monitoring and control systems, real-time monitoring of the entire system data of the unmanned vehicle is realized. It can effectively indicate the current status and working conditions, provide operators with sufficient information for comparison and judgment, and intervene or interact in a timely manner through the control system to correct problems or errors in a timely manner. This improves the safety and task execution capability of the unmanned vehicle, and alleviates the workload of monitoring and operation personnel to a certain extent. It effectively solves the problem of instability and uncertainty of unmanned vehicles when subjected to complex environments and state interference.

[0079] This embodiment describes a generalized remote data monitoring and control method, which is implemented using a generalized remote data monitoring and control system described in the above embodiment. For example... Figure 4 As shown, the method includes the following steps:

[0080] Step S1: The remote communication system establishes a stable connection, and the unmanned vehicle receives the task from the superior. The monitoring software, which includes the environmental video monitoring system, the perception and planning remote monitoring system, and the vehicle status remote monitoring system, can display the current task status and vehicle parameters.

[0081] Step S2: The task is confirmed and issued through the controller device of the vehicle function control system, and the unmanned vehicle executes the task; each monitoring system will display the important information transmitted back by the vehicle in real time.

[0082] Step S3: While the system data is being transmitted through the remote communication system, it will be classified and recorded locally at the frequency of the control cycle of each piece of information.

[0083] Step S4: The autonomous task is executed by combining the planned path and road obstacle information displayed by the monitoring software with the vehicle control system; the accuracy of the autonomous vehicle's perception and planning results can be judged by comparing the real-time images with the environmental video monitoring system; the vehicle status remote monitoring system will draw curves of key control parameters such as vehicle speed and turning angle in real time and compare the gap between the command and the status feedback.

[0084] Step S5: If the perception planning or control result is incorrect, or the vehicle is in an abnormal or faulty state, the vehicle function control system controller can perform operations such as task suspension and permission result to ensure vehicle safety.

[0085] Step S6: Based on the abnormal situation displayed by the monitoring software, each system can be remotely checked and reset via the controller and control interface function buttons. After the status is restored, task permissions can be restored, and work can continue.

[0086] Step S7: In the fault-free state, after the unmanned vehicle drives to the task point, it autonomously executes the task sequence and waits for the next task command from the vehicle control system.

[0087] Step S8: Complete all tasks and return. After completing the tasks, a return command will be received. The vehicle will return according to its previous data records and plans, ending all work and stopping data recording. The stored data files will be automatically named according to the date format, and all data can be reproduced and viewed.

[0088] In this embodiment, in step S1, the remote communication system will automatically connect after the system starts. Before connecting, the system needs to be configured with frequency band, communication mode and related network interface address. The system can have functions such as automatic frequency hopping in different environments according to the configuration to ensure the quality of the communication system.

[0089] In addition, the remote communication system will also provide feedback on key parameters such as current communication quality and signal-to-noise ratio. If any abnormality occurs or the parameter deviation is too drastic, data alerts and task suspension will be implemented.

[0090] In this embodiment, in steps S5 and S6, once the unmanned vehicle experiences an abnormal or faulty state, a system icon will be highlighted in a prominent color in the data display in step S4 to warn the driver. The corresponding system parameter interface can be opened to view detailed data to determine the specific fault or abnormality. In addition, the system can be remotely reset or restarted in conjunction with changes to system parameters or electrical configuration to eliminate the faulty state and enable the unmanned vehicle to continue performing its tasks.

[0091] If the fault in step S5 is relatively serious and has a very serious impact on task execution and unmanned vehicle safety, the system can autonomously perform safety protection operations such as pausing the task and shutting down the unmanned vehicle by combining the system information state estimation and diagnostic capabilities.

[0092] In summary, through the integration of various monitoring systems and the comprehensive processing and display of data, this system can record and monitor data throughout the entire process of various types of unmanned vehicle (UAV) missions. It also enables real-time data comparison and anomaly alerts, significantly improving the success rate of UAV testing and trials, mission execution, and the safety of UAV use and testing. Furthermore, the system's integrated information state estimation and diagnostic capabilities allow for autonomous mission pauses, further enhancing the safe usability of the UAV system. The local area network (wireless) networking and transmission capabilities ensure smooth and real-time information monitoring in complex and changing environments. Even in poor network conditions, the system can reproduce states through locally recorded data packets, providing convenient conditions for troubleshooting and improving UAV malfunctions.

[0093] In summary, this invention belongs to the field of unmanned vehicle environmental perception and automatic control technology, specifically relating to a generalized remote data monitoring and control system and method for unmanned vehicles. The system includes a remote communication system, an environmental video monitoring system, a perception and planning remote monitoring system, a vehicle status remote monitoring system, and a vehicle function control system. These systems are integrated into a monitoring system, enabling real-time display and recording of environmental video, perception maps, control commands, and vehicle status data during unmanned vehicle task execution. Through the integrated state estimation capabilities, the system provides alarm prompts for data anomalies or fault states, or autonomously suspends the task to enhance safety. This invention, based on the display and recording of all data, provides a good monitoring scenario for unmanned vehicle testing, debugging, and task execution. The fault or anomaly judgment and warning functions reduce the workload of personnel monitoring unmanned vehicles. Furthermore, through the multi-frequency point remote communication system and the integrated design of the control system, permission changes and parameter adjustments can be made under different circumstances, achieving semi-autonomous control of the unmanned vehicle, overcoming the limitations of fully manual control, and improving the safety of fully autonomous control.

[0094] The above description is only a preferred embodiment of the present invention. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the technical principles of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A universal remote data monitoring and control system for unmanned vehicles, characterized in that, The system includes: a remote communication system, an environmental video monitoring system, a perception and planning remote monitoring system, a vehicle status remote monitoring system, and a vehicle function control system; wherein, the environmental video monitoring system, the perception and planning remote monitoring system, the vehicle status remote monitoring system, and the vehicle function control system constitute a monitoring system; The remote communication system is used to realize two-way wireless information communication transmission between the unmanned vehicle and the monitoring system; The environmental video monitoring system is used to receive multi-mode video information from unmanned vehicles through a remote communication system and display it in real time. The perception and planning remote monitoring system will visualize and display in real time the road surface concave and convex obstacle information, the planned task driving path information, the positioning and navigation information status, and the calculated target vehicle speed and turning angle command information, which are fused based on the environmental sensor information on the unmanned vehicle. The vehicle status remote monitoring system is used to display all information related to the driving, steering, braking, and electrical systems of the vehicle in motion, and can be viewed and monitored in real time through multiple window interfaces; at the same time, it is used to plot and process the key status parameters of the unmanned vehicle such as speed, turning angle, and acceleration in real time. The vehicle function control system is used to modify and adjust vehicle commands and system configurations in real time, and can change the parameters of auxiliary systems such as vehicle task speed limit, power, drive torque, vehicle posture, and lights; operators or monitoring personnel can make changes in real time based on task status by combining data judgment. The remote communication system adopts a multi-band, multi-frequency, and high-bandwidth design, is compatible with satellite communication and civilian communication, ensures the real-time transmission of video and data information, and performs autonomous frequency switching and searching by judging communication quality parameters, effectively guaranteeing high-quality information transmission in complex environments. The vehicle status remote monitoring system integrates information status estimation and diagnostic tools to collect and logically process the status information of each subsystem of the vehicle, perform timely diagnosis of the vehicle's working status, provide prominent prompts for abnormal status and data, and give corresponding fault level warnings. Among them, the vehicle function control system allows operators to quickly switch permissions, change commands or operating modes in real time in case of emergencies or emergency situations during the unmanned vehicle's mission, ensuring the safety of the unmanned vehicle and the surrounding environment. The vehicle function control system and its controller equipment are capable of fully manual takeover, semi-autonomous takeover and fully autonomous takeover. This can ensure the execution of unmanned vehicle tasks while processing different modes according to the monitoring system, thereby improving the efficiency of task and work execution. The data monitoring and control system records data according to the transmission frequency of each piece of information, ensuring the accuracy of the information without omissions or gaps.

2. A method for remote data monitoring and control for generalization of unmanned vehicles, characterized in that, The method is implemented using the universal remote data monitoring and control system for unmanned vehicles as described in claim 1, and the method includes the following steps: Step S1: The remote communication system establishes a stable connection, and the unmanned vehicle receives the task from the superior. The monitoring software of the environmental video monitoring system, the perception and planning remote monitoring system, and the vehicle status remote monitoring system can display the current task status and vehicle parameters. Step S2: The task is confirmed and issued through the controller device of the vehicle function control system, and the unmanned vehicle executes the task; each monitoring system will display the important information transmitted back by the vehicle in real time. Step S3: While the system data is being transmitted through the remote communication system, it will be classified and recorded locally at the frequency of the control cycle of each piece of information. Step S4: The autonomous task is executed by combining the planned path and road obstacle information displayed by the monitoring system with the vehicle control system; the accuracy of the autonomous vehicle's perception and planning results can be judged by comparing the real-time images with the environmental video monitoring system; the vehicle status remote monitoring system will draw the key control parameter curves of vehicle speed and turning angle in real time and compare the gap between the command and the status feedback. Step S5: When the perception planning or control result is incorrect, or the vehicle is in an abnormal or faulty state, the vehicle function control system controller performs task suspension and permission switching operations to ensure vehicle safety. Step S6: Based on the abnormal situation displayed by the monitoring software, each system can be remotely checked and reset via the controller and control interface function buttons; after the status is restored, task permissions can be restored and work can continue to be performed. Step S7: After driving to the task point, the vehicle autonomously executes the task sequence and waits for the next task command from the vehicle control system. Step S8: Complete all tasks and return. After completing the tasks, a return command will be received. The vehicle will return according to its previous data records and plans, ending all work and stopping data recording. The stored data files will be automatically named according to the date format, and all data can be reproduced and viewed. In step S3, while the data is being monitored and displayed in real time, all data is recorded in real time autonomously, allowing for data review and retrospection. In step S4, the information results are displayed on the monitoring system in a clear and visual manner, and the system provides security alerts for anomalies and faults based on the judgment logic of data status, which provides good convenience for viewing and monitoring large amounts of data. In step S5, the vehicle function control system will automatically or manually switch control permissions and parameter configurations.

Citation Information

Patent Citations

  • A system and method for monitoring and controlling unmanned rescue vehicles

    CN106990784B

  • Unmanned vehicle data monitoring methods, devices, equipment and storage media

    CN109167703B

  • Intelligent epidemic prevention vehicle control system and method, system and equipment, storage medium and vehicle

    CN115092075A

  • Real-time remote driving system and method for monitoring states of multiple vehicles

    CN113022540A