Unmanned aerial vehicle remote control system for traffic accident warning and acousto-optic early warning

Abstract

The invention discloses an unmanned aerial vehicle remote control system for traffic accident warning and acousto-optic early warning. The unmanned aerial vehicle remote control system comprises an unmanned aerial vehicle subsystem used for collecting road condition information in real time; the remote control display device is used for remotely displaying the road condition information acquired by the unmanned aerial vehicle; the ground control subsystem is used for displaying the road condition video and the infrared thermal image returned by the unmanned aerial vehicle subsystem, providing a real-time monitoring picture for a traffic command center and analyzing the real-time monitoring picture; and the sound-light alarm device is used for giving an alarm to field personnel according to an analysis result of the ground control subsystem. According to the invention, timely discovery and effective processing of traffic accidents are realized.

Description

Technical Field

[0001] The present invention relates to the field of intelligent transportation technology, and in particular to an unmanned aerial vehicle remote control system for traffic accident warning and sound and light early warning. Background Art

[0002] Traffic accidents are common in daily life and seriously affect people's daily safety. When encountering a traffic accident, secondary accidents are often caused by untimely warnings. For example, when the traffic police are handling a traffic accident, if the vehicle behind cannot promptly identify the accident scene in front, the rear vehicle will not have a timely warning and cannot make an effective judgment in time, resulting in a secondary accident.

[0003] In the current traffic management system, timely response and effective warning of traffic accidents are key links to ensure road safety and reduce secondary accidents and casualties. However, traditional traffic accident warning methods have several significant limitations:

[0004] Slow response: Traditional traffic accident handling methods rely on manual alarms (such as telephone alarms) and on-site inspections by patrol officers, which often takes a long time to convey the alarm to the relevant departments and dispatch personnel to handle it. During this period of time, the accident scene may have caused serious consequences such as traffic congestion and secondary accidents.

[0005] Limited coverage: Manual warning methods, such as traffic police’s hand gestures and roadside warning signs, are often limited to a small area around the accident scene. In the case of poor visibility or complex roads, it may be difficult for drivers far away to detect the accident and respond in time.

[0006] Incomplete information acquisition: In the traditional way of handling traffic accidents, the acquisition of accident information mainly relies on on-site investigation and eyewitness descriptions. This method is often subjective and inaccurate, and it is difficult to fully and objectively reflect the real situation at the accident scene.

[0007] Lack of intelligent support: With the development of intelligent transportation systems, higher requirements are placed on the handling of traffic accidents. However, traditional traffic accident warning methods lack intelligent support and cannot achieve real-time monitoring of the accident scene, data analysis, and intelligent decision-making.

[0008] Limited warning effect: Traditional warning methods, such as changes in traffic lights and roadside warning lights, can alert drivers to a certain extent, but they often lack intuitiveness and shocking power, making it difficult to quickly attract the driver's attention and prompt them to take risk avoidance measures.

[0009] With the continuous increase in traffic volume, traffic accidents occur frequently, and rapid response and effective warning to the accident scene have become urgent problems to be solved. Traditional manual warning methods have defects such as slow response speed and limited coverage. Drone technology has shown great potential in traffic accident warning due to its strong flexibility, wide field of view, and rapid response. However, there is a lack of a comprehensive system that integrates drone remote control, real-time video monitoring, and sound and light warning in the current market. Therefore, it is particularly important to develop a new traffic accident warning system that can overcome the above limitations. Summary of the invention

[0010] In order to solve the above technical problems, the present invention proposes a UAV remote control system for traffic accident warning and sound and light warning, which realizes rapid positioning, real-time monitoring and efficient warning of the traffic accident scene by integrating UAV, remote control display device, ground control system and sound and light alarm system.

[0011] To achieve the above-mentioned purpose, the present invention provides a UAV remote control system for traffic accident warning and sound and light early warning, comprising:

[0012] UAV subsystem: used to collect road condition information in real time;

[0013] Remote control display device: used to remotely display the road condition information collected by the drone;

[0014] Ground control subsystem: used to display the road condition video and infrared thermal imaging image sent back by the UAV subsystem, provide real-time monitoring images for the traffic command center, and conduct analysis;

[0015] Sound and light alarm device: used to issue an alarm to on-site personnel based on the analysis results of the ground control subsystem.

[0016] Preferably, the drone subsystem collects road conditions in real time by carrying a sensor kit, wherein the sensor kit includes:

[0017] Visual sensing device: used for visual navigation, obstacle avoidance and real-time image capture, and the real-time collected images are transmitted to the remote control display device;

[0018] Ultrasonic sensor: used to detect obstacles at close range and avoid collision with other obstacles;

[0019] Inertial measurement unit: used to measure and track the acceleration, angular velocity and direction of the drone to ensure stable flight of the drone;

[0020] GPS device: used to determine the location of the drone, and perform navigation and track planning to ensure that the drone flies according to the preset route;

[0021] Infrared sensor device: used to collect infrared thermal images at night or in low-light environments, and send them to the remote control display device in real time.

[0022] Preferably, the drone subsystem further includes a flight control unit, which is used to receive data transmitted by the sensor suite, control the speed and direction of the motor, and achieve stable flight and precise control of the drone.

[0023] Preferably, the remote control display device comprises:

[0024] High-resolution display screen: used to ensure that the traffic control center can accurately receive real-time images and videos sent back by drones;

[0025] Touch panel: used by the traffic control center to directly control the flight trajectory of the drone, adjust the shooting angle or perform other tasks;

[0026] Network interface unit: used to realize the communication between the remote control display device and the ground control subsystem, UAV subsystem and other network equipment.

[0027] Preferably, the remote control display device further includes:

[0028] Main processor: used to process data from the drone subsystem and ground control subsystem, manage screen display, touch input and data communication;

[0029] Graphics processing unit: used to accelerate the rendering of images and videos to ensure smooth playback and display of videos or images on the high-resolution display screen;

[0030] Power management unit: used to supply and manage power to the remote control display device, including a battery charging circuit, a voltage regulating circuit and a power protection circuit.

[0031] Preferably, the ground control subsystem comprises:

[0032] Flight data display unit: used to display the flight status of the drone in real time, including altitude, speed, heading and position;

[0033] Data processing unit: used to process and analyze the raw data sent back by the drone;

[0034] Data link unit: used to realize real-time data transmission using wireless communication technology;

[0035] Data storage unit: used to store processed data and conduct real-time analysis to provide decision support for the traffic command center.

[0036] Preferably, the data processing unit is used to clean the raw data and perform target detection and trajectory tracking based on the cleaned data, wherein the target detection locates the target area based on a trained deep learning model, and classifies and identifies the located target, determines the target type, and outputs and stores the detected target position and type in a database.

[0037] Preferably, the process of performing the trajectory tracking includes:

[0038] After the target is determined in the target detection stage, the detected target is initialized; in the subsequent frames, the most matching target area is found by comparing the features of the target in the current frame with the features of the target in the initial frame to obtain the feature matching result;

[0039] According to the feature matching result, the position information of the target in the current frame is updated; during the tracking process, the target is processed by using occlusion detection or deformation model to maintain the stability and robustness of the tracked target;

[0040] The position information of the target in consecutive frames is connected to generate the target's motion trajectory, and the tracked target trajectory is output or stored in the database to achieve continuous tracking and monitoring of the target.

[0041] Preferably, when the system detects a traffic accident risk or an accident has occurred, the sound and light alarm device mounted on the drone subsystem is automatically activated to attract the attention of surrounding vehicles and pedestrians through high-brightness LED warning lights and flashing warning lights.

[0042] Preferably, the system also includes a warning information release subsystem, which is used to transmit the warning information to relevant departments, drivers and the public through a wireless communication network; wherein, the information release methods include mobile phone APP, text messages, and emails, and the system supports customized warning templates and message push strategies to meet the warning needs in different scenarios.

[0043] Compared with the prior art, the present invention has the following advantages and technical effects:

[0044] The present invention realizes the timely discovery and effective handling of traffic accidents through the real-time monitoring of the drone subsystem and the rapid response of the remote control system; the combination of the sound and light alarm device and the early warning information release subsystem ensures the timely transmission and wide coverage of the early warning information, and improves the public's safety awareness; the application of the data processing unit enables the system to automatically analyze and process massive data, providing intelligent decision-making support.

[0045] The present invention has the advantages of real-time monitoring, rapid response, efficient early warning and intelligent analysis, and is of great significance for improving the level of traffic safety and reducing losses caused by traffic accidents. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] The drawings constituting a part of the present application are used to provide a further understanding of the present application. The illustrative embodiments and descriptions of the present application are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0047] Figure 1 The figure is a schematic structural diagram of a UAV remote control system for traffic accident warning and sound and light early warning according to an embodiment of the present invention. DETAILED DESCRIPTION

[0048] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0049] It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and that, although a logical order is shown in the flowcharts, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0050] The present invention proposes that the present invention provides a UAV remote control system for traffic accident warning and sound and light early warning, such as Figure 1 ,include:

[0051] UAV subsystem: used to collect road condition information in real time;

[0052] Remote control display device: used to remotely display the road condition information collected by the drone;

[0053] Ground control subsystem: used to display the road condition video and infrared thermal imaging image sent back by the UAV subsystem, provide real-time monitoring images for the traffic command center, and conduct analysis;

[0054] Sound and light alarm device: used to issue an alarm to on-site personnel based on the analysis results of the ground control subsystem.

[0055] Furthermore, the drone subsystem collects road conditions in real time by carrying a sensor kit, wherein the sensor kit includes:

[0056] Visual sensing device: used for visual navigation, obstacle avoidance and real-time image capture, and the real-time collected images are transmitted to the remote control display device;

[0057] Ultrasonic sensor: used to detect obstacles at close range and avoid collision with other obstacles;

[0058] Inertial measurement unit: used to measure and track the acceleration, angular velocity and direction of the drone to ensure stable flight of the drone;

[0059] GPS device: used to determine the location of the drone, and perform navigation and track planning to ensure that the drone flies according to the preset route;

[0060] Infrared sensor device: used to collect infrared thermal images at night or in low-light environments, and send them to the remote control display device in real time.

[0061] The drone subsystem also includes a flight control unit, which is used to receive data transmitted by the sensor suite, control the speed and direction of the motor, and achieve stable flight and precise control of the drone.

[0062] The drone has built-in flight control software, which is responsible for receiving sensor data, calculating the drone's position, speed and direction, and controlling the speed and direction of the motor, thereby achieving stable flight and precise control of the drone. The data collected by the drone is transmitted to the ground control subsystem in real time for processing and analysis. The ground control subsystem conducts in-depth mining of the returned data by running complex algorithms, including image recognition, target detection and tracking, to identify traffic accident risks or accidents that have already occurred.

[0063] Furthermore, the remote control display device comprises:

[0064] High-resolution display screen: used to ensure that the traffic control center can accurately receive real-time images and videos sent back by drones;

[0065] Touch panel: used by the traffic control center to directly control the flight trajectory of the drone, adjust the shooting angle or perform other tasks;

[0066] Network interface unit: used to realize the communication between the remote control display device and the ground control subsystem, UAV subsystem and other network equipment.

[0067] Main processor: used to process data from the drone subsystem and ground control subsystem, manage screen display, touch input and data communication;

[0068] Graphics processing unit: used to accelerate the rendering of images and videos to ensure smooth playback and display of videos or images on the high-resolution display screen;

[0069] Power management unit: used to supply and manage power to the remote control display device, including battery charging circuit, voltage regulation circuit and power protection circuit.

[0070] In the remote control display device, the graphics processing unit can process the high-definition video stream sent back by the drone to ensure smooth playback and high-quality display of the video on the display screen. Although some basic or low-cost systems may not directly include an independent graphics processing unit, the graphics processing function may be implemented by the integrated GPU of the main processor or software acceleration technology. The remote control display device supports multi-screen split-screen display function, which can simultaneously display the real-time situation of multiple monitoring points and improve monitoring efficiency. By designing a friendly operation interface, including flight control buttons, parameter setting options, task execution instructions, etc., the traffic command center can easily get started and quickly complete various operations.

[0071] Furthermore, the ground control subsystem includes:

[0072] Flight data display unit: used to display the flight status of the drone in real time, including altitude, speed, heading and position;

[0073] Data processing unit: used to process and analyze the raw data sent back by the drone;

[0074] Specifically, the data processing unit is used to clean the raw data and perform target detection and trajectory tracking based on the cleaned data, wherein the target detection locates the target area based on the trained deep learning model, and classifies and identifies the located target, determines the target type, and outputs and stores the detected target position and type in a database.

[0075] The process of trajectory tracking includes:

[0076] After the target is determined in the target detection stage, the detected target is initialized; in the subsequent frames, the most matching target area is found by comparing the features of the target in the current frame with the features of the target in the initial frame to obtain the feature matching result;

[0077] According to the feature matching results, the position information of the target in the current frame is updated; during the tracking process, the target is processed using occlusion detection or deformation model to maintain the stability and robustness of the tracked target;

[0078] The position information of the target in consecutive frames is connected to generate the target's motion trajectory, and the tracked target trajectory is output or stored in the database to achieve continuous tracking and monitoring of the target.

[0079] Data link unit: used to achieve real-time data transmission using wireless communication technology; the data link unit is the bridge for communication between the drone and the ground control subsystem, and uses wireless communication technology (such as 4G, 5G, Wi-Fi, etc.) to achieve real-time data transmission. It ensures that the drone can receive instructions from the ground control station and transmit the collected video, pictures, flight parameters and other data back to the ground station.

[0080] Data storage unit: used to store processed data and conduct real-time analysis to provide decision support for the traffic command center;

[0081] When the system detects a traffic accident risk or an accident has already occurred, it automatically activates the sound and light alarm device mounted on the drone subsystem to attract the attention of surrounding vehicles and pedestrians through high-brightness LED warning lights and flashing warning lights.

[0082] The sound and light alarm device uses a high-fidelity audio generator that can produce clear and loud alarm sounds. These sounds can be customized as needed, such as setting different tones, volumes and rhythms to ensure that they can be effectively identified even in noisy environments. The alarm sound is amplified and spread to the surrounding area through a high-power speaker or loudspeaker. This helps to ensure that the sound can cover a wider range and improve the coverage and effect of the alarm. The sound and light alarm device combines the flight status of the drone and the surrounding environment information to intelligently control the start and stop of the sound alarm device. In this embodiment, the alarm is automatically started when the drone approaches the accident scene or finds potential danger, and the alarm is automatically stopped when the danger is eliminated or the drone leaves the scene.

[0083] The sound and light alarm device uses a high-brightness LED lamp as a light source, which can generate a bright and stable light signal. The LED lamp has the characteristics of low power consumption, long life and good shock resistance, and is suitable for use on mobile platforms such as drones. By controlling the flashing frequency and mode of the LED lamp, a light signal with a warning effect is generated. In this embodiment, a red or yellow LED lamp is used for high-frequency flashing to attract the attention of people around and convey emergency information. According to the flight posture of the drone and the surrounding environment information, the direction and angle of the light signal are adjusted. It helps to ensure that the light signal can accurately point to the accident scene or potential danger area, and improve the pertinence and effectiveness of the alarm. It is also possible to shout artificially to remind the vehicle's driving speed. When the driving speed exceeds the set warning speed, the ground control system will be alarmed through camera recognition, reminding traffic handling personnel to manually intervene in the vehicle to slow down and avoid the risk of secondary accidents.

[0084] The system also includes a warning information release subsystem, which is used to transmit the warning information to relevant departments, drivers and the public through a wireless communication network; the information release methods include mobile phone APP, text messages, and emails, and the system supports customized warning templates and message push strategies to meet the warning needs in different scenarios.

[0085] The above are only preferred specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A UAV remote control system for traffic accident warning and sound and light warning, characterized in that: include: UAV subsystem: used to collect road condition information in real time; Remote control display device: used to remotely display the road condition information collected by the drone; Ground control subsystem: used to display the road condition video and infrared thermal imaging image sent back by the UAV subsystem, provide real-time monitoring images for the traffic command center, and conduct analysis; Sound and light alarm device: used to issue an alarm to on-site personnel based on the analysis results of the ground control subsystem.

2. The UAV remote control system for traffic accident warning and sound and light early warning according to claim 1 is characterized in that: The drone subsystem collects road conditions in real time by carrying a sensor kit, wherein the sensor kit includes: Visual sensing device: used for visual navigation, obstacle avoidance and real-time image capture, and the real-time collected images are transmitted to the remote control display device; Ultrasonic sensor: used to detect obstacles at close range and avoid collision with other obstacles; Inertial measurement unit: used to measure and track the acceleration, angular velocity and direction of the drone to ensure stable flight of the drone; GPS device: used to determine the location of the drone, and perform navigation and track planning to ensure that the drone flies according to the preset route; Infrared sensor device: used to collect infrared thermal images at night or in low-light environments, and send them to the remote control display device in real time.

3. The UAV remote control system for traffic accident warning and sound and light early warning according to claim 2 is characterized in that: The drone subsystem also includes a flight control unit, which is used to receive data transmitted by the sensor suite, control the speed and direction of the motor, and achieve stable flight and precise control of the drone.

4. The UAV remote control system for traffic accident warning and sound and light early warning according to claim 1 is characterized in that: The remote control display device comprises: High-resolution display screen: used to ensure that the traffic control center can accurately receive real-time images and videos sent back by drones; Touch panel: used by the traffic control center to directly control the flight trajectory of the drone, adjust the shooting angle or perform other tasks; Network interface unit: used to realize the communication between the remote control display device and the ground control subsystem, UAV subsystem and other network equipment.

5. The UAV remote control system for traffic accident warning and sound and light early warning according to claim 4 is characterized in that: The remote control display device also includes: Main processor: used to process data from the drone subsystem and ground control subsystem, manage screen display, touch input and data communication; Graphics processing unit: used to accelerate the rendering of images and videos to ensure smooth playback and display of videos or images on the high-resolution display screen; Power management unit: used to supply and manage power to the remote control display device, including a battery charging circuit, a voltage regulating circuit and a power protection circuit.

6. The UAV remote control system for traffic accident warning and sound and light early warning according to claim 1 is characterized in that: The ground control subsystem includes: Flight data display unit: used to display the flight status of the drone in real time, including altitude, speed, heading and position; Data processing unit: used to process and analyze the raw data sent back by the drone; Data link unit: used to realize real-time data transmission using wireless communication technology; Data storage unit: used to store processed data and conduct real-time analysis to provide decision support for the traffic command center.

7. The UAV remote control system for traffic accident warning and sound and light early warning according to claim 6 is characterized in that: The data processing unit is used to clean the raw data and perform target detection and trajectory tracking based on the cleaned data, wherein the target detection locates the target area based on the trained deep learning model, and classifies and identifies the located target, determines the target type, and outputs and stores the detected target position and type in a database.

8. The UAV remote control system for traffic accident warning and sound and light early warning according to claim 7 is characterized in that: The process of performing the trajectory tracking includes: After the target is determined in the target detection stage, the detected target is initialized; in the subsequent frames, the most matching target area is found by comparing the features of the target in the current frame with the features of the target in the initial frame to obtain the feature matching result; According to the feature matching result, the position information of the target in the current frame is updated; during the tracking process, the target is processed by using occlusion detection or deformation model to maintain the stability and robustness of the tracked target; The position information of the target in consecutive frames is connected to generate the target's motion trajectory, and the tracked target trajectory is output or stored in the database to achieve continuous tracking and monitoring of the target.

9. The UAV remote control system for traffic accident warning and sound and light early warning according to claim 1 is characterized in that: When the system detects a traffic accident risk or an accident has already occurred, it generates a warning message and automatically starts the sound and light alarm device mounted on the drone subsystem, attracting the attention of surrounding vehicles and pedestrians through high-brightness LED warning lights and flashing warning lights.

10. The UAV remote control system for traffic accident warning and sound and light early warning according to claim 9, characterized in that: The system also includes a warning information release subsystem, which is used to transmit the warning information to relevant departments, drivers and the public through a wireless communication network; wherein, information release methods include mobile phone APP, text messages, and emails, and the system supports customized warning templates and message push strategies to meet warning needs in different scenarios.

Images