Monitoring and early warning system and method for highway emergencies

Abstract

The invention discloses a monitoring and early warning system and method for expressway emergencies, and belongs to the technical field of expressway monitoring. The early warning system comprises a data monitoring unit, an emergency processing unit and an event visualization unit; the data monitoring unit is used for collecting multi-source monitoring data of the expressway, analyzing the monitoring data of each source and identifying event-related monitoring data according to the sources of the multi-source monitoring data, and performing identification endowing on the identified event-related monitoring data; the multi-source monitoring data comprises a monitoring video of the expressway, radar monitoring data of the expressway, mobile phone signaling data and network feedback information data; the emergency processing unit is used for receiving and analyzing the event-related monitoring data so as to match and identify emergencies; and the event visualization unit is used for performing display and early warning on the recognized emergencies. According to the invention, emergencies can be monitored in all directions, so that rapid and effective emergency disposal is facilitated.

Description

Technical Field

[0001] The invention belongs to the technical field of highway monitoring, and in particular relates to a monitoring and early warning system and method for highway emergencies. Background Art

[0002] The rapid development of highways has also brought many challenges. On the one hand, the surge in traffic volume has increased the carrying pressure of highways. Any minor failure or emergency may quickly cause large-scale congestion, affecting people's travel efficiency and the smooth progress of economic activities. On the other hand, traffic accidents caused by natural factors such as extreme weather and geological disasters, as well as human factors, occur from time to time, which not only threatens the safety of people's lives and property, but also poses a severe challenge to the safe operation of highways. Therefore, under such a background, how to effectively monitor and warn of highway emergencies has become an important issue that needs to be solved urgently.

[0003] In recent years, domestic and foreign scholars have conducted a lot of research in the field of highway emergency monitoring and early warning, and have achieved certain results. However, there are still many shortcomings in the existing research. First, most studies focus on the application of a single technical means, such as relying only on video surveillance or traffic flow data, lacking the fusion analysis of multi-source data, resulting in limited accuracy and timeliness of monitoring and early warning. Second, some studies are too idealistic in the construction of early warning models, and fail to fully consider the complexity and variability of actual road conditions, resulting in unsatisfactory early warning effects. Summary of the invention

[0004] The purpose of the present invention is to provide a monitoring and early warning system and method for highway emergencies, which can monitor emergencies in an all-round way, thereby facilitating rapid and effective emergency response.

[0005] The present invention provides the following technical solutions:

[0006] In a first aspect, a monitoring and early warning system for highway emergencies is provided, comprising a data monitoring unit, an emergency processing unit and an event visualization unit;

[0007] The data monitoring unit is used to collect multi-source monitoring data of the expressway, analyze the monitoring data of each source and identify the event-related monitoring data according to the source of the multi-source monitoring data, and assign an identifier to the identified event-related monitoring data; the multi-source monitoring data includes: monitoring videos of the expressway, radar monitoring data of the expressway, mobile phone signaling data and network feedback information data;

[0008] The emergency processing unit is used to receive the event-related monitoring data and analyze the event-related monitoring data to match and identify the emergency event;

[0009] The event visualization unit is used to display and warn the identified emergency events.

[0010] Optionally, the data monitoring unit includes a data acquisition module, a data analysis module, an identification assignment module and a first communication module;

[0011] The data acquisition module is used to collect multi-source monitoring data;

[0012] The data analysis module includes a video analysis submodule, a radar-visual fusion submodule, a signaling analysis submodule and a feedback information analysis submodule; the video analysis submodule is used to identify and locate abnormal objects that stray into the highway based on the collected surveillance video; the radar-visual fusion submodule is used to identify and locate abnormal driving behavior based on the collected surveillance video and radar monitoring data; the signaling analysis submodule is used to identify signaling data anomalies based on the collected mobile phone signaling data; the feedback information analysis submodule is used to identify potential risks of highway emergencies based on the collected network feedback information;

[0013] The identification and assignment module is used to independently monitor the surveillance video, radar monitoring data, mobile phone signaling data and network feedback information data in real time, and assign timestamps and source identifiers when the video analysis submodule, radar and visual fusion submodule, signaling analysis submodule or feedback information analysis submodule identifies event-related monitoring data;

[0014] The first communication module is used to upload the event-related monitoring data of the video analysis submodule, the radar and vision fusion submodule, the signaling analysis submodule or the feedback information analysis submodule after being assigned a timestamp and a source identifier to the emergency processing unit.

[0015] Optionally, the video analysis submodule uses an RT-DETR algorithm to identify and locate abnormal objects in highway surveillance videos;

[0016] The radar-visual fusion submodule uses the ByteTrack algorithm to identify and locate abnormal driving behaviors from highway surveillance videos and radar monitoring data;

[0017] The signaling analysis submodule uses the LSTM algorithm to capture abnormalities of network protocols and communication events in the mobile phone signaling data;

[0018] The feedback information analysis submodule uses the BERT algorithm to analyze the textual intent of network feedback information data to identify potential risks of highway emergencies.

[0019] Optionally, the identification assignment module uses CEP technology to independently monitor surveillance video, radar monitoring data, mobile phone signaling data and network feedback information data in real time.

[0020] Optionally, the emergency processing unit includes a second communication module, a data processing module and a matching identification module;

[0021] The second communication module is used to realize information interaction between the emergency processing unit and the data monitoring unit and the event visualization unit;

[0022] The data processing module is used to analyze and integrate the event-related monitoring data output by the data monitoring unit;

[0023] The matching and identifying module is used to match and identify emergencies based on the integration results of the data processing module and the set rules.

[0024] Optionally, the emergency processing unit includes an isolation protection module; the isolation protection module has a constructed virtual firewall, which will abnormally block all the event-related monitoring data to ensure the security and reliability of the event-related monitoring data.

[0025] Optionally, the emergency processing unit includes a log recording module and a database module; the log recording module is used to log the received event-related monitoring data, and the database module is used to store the received event-related monitoring data, analysis data of the event-related monitoring data, and identification results of emergencies.

[0026] Optionally, the event visualization unit includes a third communication module, a display module and a warning module; the third communication module is used to realize information interaction between the event visualization unit and the emergency processing unit; the display module is used to display the received information, and the display module is connected to the third communication module; the warning module is used to issue warning information of emergencies, and the warning module is connected to the display module and the third communication module.

[0027] Optionally, the event visualization unit includes a log retrieval module, and the log retrieval module is used to retrieve event-related monitoring data of the emergency event.

[0028] In a second aspect, a method for monitoring and early warning of highway emergencies is provided, comprising the following steps:

[0029] Acquire multi-source monitoring data of the expressway; analyze the monitoring data of each source and identify event-related monitoring data according to the source of the multi-source monitoring data, and assign a label to the identified event-related monitoring data; the multi-source monitoring data includes: monitoring videos of the expressway, radar monitoring data of the expressway, mobile phone signaling data, and network feedback information data;

[0030] Analyze the monitoring data related to the identified events to match and identify the emergencies;

[0031] The identified emergencies are displayed and early warning information is issued.

[0032] Compared with the prior art, the present invention has the following beneficial effects:

[0033] (1) The present invention collects monitoring data in real time and assigns timestamps and source identifiers to the collected event-related monitoring data. The collection time of each event-related monitoring data is determined by assigning timestamps, and the source of the collected data is determined by assigning source identifiers, thereby obtaining monitoring data with time and source identifiers to ensure the reliability of the uploaded data and facilitate the tracing of the monitoring data. In addition, the present invention utilizes the collection of multi-source monitoring data to analyze and identify anomalies from data from different sources, thereby ensuring the comprehensiveness of the monitoring data, thereby enabling more accurate and comprehensive monitoring of emergencies.

[0034] (2) The event-related monitoring data uploaded by the present invention will pass through the virtual firewall, which can block external abnormal data to ensure the reliability and security of the received and stored data. The present invention can also retrieve the event-related monitoring data of the emergency for management personnel to view, thereby achieving the effect of automatic analysis, reporting and data tracing of the emergency. In addition, the event-related monitoring data processed by the virtual firewall will be logged and stored in the database to facilitate subsequent retrieval of the corresponding monitoring data and ensure the security of the stored data, that is, to comprehensively improve the information security of the collected data, and to achieve emergency event tracing through log auditing, so as to provide the safest monitoring guarantee for database information. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 It is the overall structural block diagram of the monitoring and early warning system for highway emergencies of the present invention.

[0036] Figure 2 It is a structural block diagram of the data monitoring unit of the present invention.

[0037] Figure 3 It is a structural block diagram of the emergency processing unit of the present invention.

[0038] Figure 4 It is a structural block diagram of the event visualization unit of the present invention.

[0039] Marked in the figure: 100 is a data monitoring unit, 200 is an emergency processing unit, 300 is an event visualization unit, 110 is a data acquisition module, 120 is a data analysis module, 130 is an identification module, 140 is a first communication module, 121 is a video analysis submodule, 122 is a radar and vision fusion submodule, 123 is a signaling analysis submodule, 124 is a feedback information analysis submodule, 210 is a second communication module, 220 is an isolation and protection module, 230 is a data processing module, 240 is a matching and identification module, 250 is a log recording module, 260 is a database module, 310 is a third communication module, 320 is a display module, 330 is a log retrieval module, and 340 is an early warning module. DETAILED DESCRIPTION

[0040] The present invention will be further described below in conjunction with the accompanying drawings. The following embodiments are only used to more clearly illustrate the technical solution of the present invention, and cannot be used to limit the protection scope of the present invention.

[0041] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0042] Example 1

[0043] like Figure 1 As shown, a monitoring and early warning system for highway emergencies is provided, including a data monitoring unit 100, an emergency processing unit 200 and an event visualization unit 300.

[0044] like Figure 2 As shown, the data monitoring unit 100 is used to collect multi-source monitoring data of the highway, analyze the monitoring data from each source and identify event-related monitoring data according to the source of the multi-source monitoring data, and assign a label to the identified event-related monitoring data.

[0045] Multi-source monitoring data includes: highway surveillance videos, highway radar monitoring data, mobile phone signaling data and network feedback information data.

[0046] The collection of multi-source monitoring data can be carried out through existing technologies. Specifically, monitoring videos can be obtained by calling the data of monitoring cameras, radar monitoring data can be obtained by calling the monitoring data of radars. The structure and installation method of radars and monitoring cameras can adopt existing technologies. The acquisition scope of mobile phone signaling and network feedback information can be determined by expert experience or existing technologies.

[0047] The emergency processing unit 200 is used to receive event-related monitoring data and perform event-related monitoring data analysis to match and identify emergencies;

[0048] The event visualization unit 300 is used to display and warn the identified emergency events; the emergency processing unit 200 is connected to the data monitoring unit 100, and the event visualization unit 300 is connected to the emergency processing unit 200.

[0049] The monitoring data of the present invention is multi-source and multi-modal data. The data from different sources are analyzed and anomalies are identified, which can ensure the comprehensiveness of the monitoring data, so that the monitoring of emergencies can be more accurate and comprehensive.

[0050] Specifically, Figure 2 As shown, the data monitoring unit 100 includes a data acquisition module 110 , a data analysis module 120 , an identification module 130 and a first communication module 140 .

[0051] The data collection module 110 is used to collect multi-source monitoring data.

[0052] The data analysis module 120 includes a video analysis submodule 121 , a radar and vision fusion submodule 122 , a signaling analysis submodule 123 and a feedback information analysis submodule 124 .

[0053] The video analysis submodule 121 is used to identify and locate abnormal objects that have strayed into the highway based on the collected surveillance videos.

[0054] Specifically, the RT-DETR algorithm is used to identify and locate pedestrians, motorcycles or animals that enter the highway in the highway surveillance video, and output the category and location information of the pedestrians, motorcycles or animals.

[0055] The radar-visual fusion submodule 122 is used to identify and locate abnormal driving behavior based on the collected surveillance video and radar monitoring data.

[0056] Specifically, the radar-vision fusion submodule 122 uses the ByteTrack algorithm to identify and locate abnormal driving behaviors in the highway surveillance video and radar monitoring data; the ByteTrack algorithm is used to stably track vehicles within the monitoring range under changing environments, detect abnormal driving behaviors such as illegal parking, reversing, low-speed driving, and illegal occupation of emergency lanes, and output related location and abnormal behavior information, that is, when the set abnormal driving behavior is identified, the location and abnormal behavior information of the abnormal driving behavior are output.

[0057] The signaling analysis submodule 123 is used to identify abnormal signaling data based on the collected mobile phone signaling data.

[0058] Specifically, the signaling analysis submodule 123 uses the LSTM algorithm to capture anomalies of network protocols and communication events in the mobile phone signaling data; the LSTM algorithm is used to effectively capture anomalies of network protocols and communication events in the signaling data, and output information such as the type of abnormal event, related parameters and abnormal index, so as to ensure the security and efficiency of the network.

[0059] The LSTM algorithm uses its efficient processing capabilities for time series data to accurately identify key events and abnormal behaviors in massive signaling data, providing strong support for security monitoring and efficiency optimization of network communications.

[0060] The feedback information analysis submodule 124 is used to identify potential risks of highway emergencies based on the collected network feedback information.

[0061] Specifically, the feedback information analysis submodule 124 uses the BERT algorithm to analyze the textual intent of network feedback information data to identify potential risks of highway emergencies. The BERT algorithm is used to solve the category imbalance problem through its deep natural language processing capabilities and accurately analyze network feedback information. By deeply analyzing text data from social media, news, forums, etc., the BERT algorithm outputs detailed reports including potential risk assessments in real time, providing accurate data support for decision makers.

[0062] That is, event-related monitoring data identification includes the identification and positioning of abnormal objects, the identification and positioning of abnormal driving behaviors, the identification of abnormalities in signaling data, and the identification of potential risks of highway emergencies.

[0063] The identification and assignment module 130 is used to independently monitor the surveillance video, radar monitoring data, mobile phone signaling data and network feedback information data in real time. When the video analysis submodule 121, the radar and vision fusion submodule 122, the signaling analysis submodule 123 or the feedback information analysis submodule 124 identifies event-related monitoring data, a timestamp and source identifier are assigned.

[0064] Specifically, the identification module 130 uses CEP technology to independently monitor the surveillance video, radar monitoring data, mobile phone signaling data and network feedback information data in real time; CEP technology greatly improves the speed and accuracy of data processing, provides reliable support for data traceability and subsequent applications, and significantly optimizes the overall performance and response efficiency of the system. Of course, time identification and source identification can also be assigned through some other existing technologies.

[0065] The first communication module 140 is used to upload the event-related monitoring data of the video analysis submodule 121, the radar and vision fusion submodule 122, the signaling analysis submodule 123 or the feedback information analysis submodule 124 after being given a timestamp and a source identifier to the emergency processing unit 200.

[0066] The first communication module 140 is used to realize information interaction between the data monitoring unit 100 and the emergency processing unit 200 . The first communication module 140 is connected to the identification assigning module 130 .

[0067] The data acquisition module 110 collects multi-source monitoring data of the highway in real time, and the data analysis module 120 analyzes the collected multi-source monitoring data separately to identify event-related monitoring data. At the same time, the identification and assignment module 130 monitors the monitoring data from each source separately to assign timestamps and source identifiers when event-related monitoring data are identified. Finally, the event-related data assigned with timestamps and source identifiers are uploaded to the emergency processing unit 200 by the first communication module 140.

[0068] like Figure 3 As shown, the emergency processing unit 200 includes a second communication module 210 , a data processing module 230 and a matching identification module 240 .

[0069] The second communication module 210 is used to implement information interaction between the emergency processing unit 200 and the data monitoring unit 100 and the event visualization unit 300 .

[0070] The data processing module 230 is used to analyze and integrate the event-related monitoring data output by the data monitoring unit 100 .

[0071] The matching identification module 240 is used to match and identify emergencies based on the integration results of the data processing module 230 and the set rules. Specifically, the set rules can be determined based on expert experience, and the analysis method of the data processing module 230 can refer to the existing technology, such as data fusion, multimodal data analysis, deep learning or graph computing, etc. It is worth noting that when the matching identification module 240 matches the corresponding emergencies according to the set rules, it will also determine whether an emergencies occurs, that is, there are matching rules in which no emergencies occur. The matching identification module 240 is connected to both the data processing module 230 and the second communication module 210.

[0072] Of course, in some other embodiments, event-related monitoring data may also be analyzed through a deep learning algorithm to achieve matching of emergencies.

[0073] Furthermore, the emergency handling unit 200 includes an isolation protection module 220; the isolation protection module 220 has a constructed dotted line firewall, which will block abnormalities of all the event-related monitoring data to ensure the security and reliability of the event-related monitoring data, that is, the second communication module 210 receives the data uploaded by the data monitoring unit 100, and then passes it to the isolation protection module 220. The dotted line firewall constructed by the isolation protection module 220 will process all uploaded event-related monitoring data, block external abnormal data, and ensure the reliability and security of the stored and subsequently processed data; the event-related monitoring data processed by the isolation protection module 220 will be transmitted to the data processing module 230, which will be analyzed and classified by the data processing module 230 for subsequent emergency event matching.

[0074] Furthermore, the emergency processing unit 200 includes a log recording module 250 and a database module 260 ; the log recording module 250 is used to log the received event-related monitoring data, and the log recording module 250 is connected to both the second communication module 210 and the isolation protection module 220 .

[0075] The database module 260 is used to store the received event-related monitoring data, analysis data of the event-related monitoring data and identification results of sudden events; the database module 260 is connected to the data processing module 230, the matching identification module 240 and the log recording module 250.

[0076] It should be further explained that the matching identification module 240 will match the corresponding emergency events according to the analysis structure of the monitoring data. When an emergency event occurs, the emergency event will be uploaded to the event visualization unit 300 through the second communication module 210 for the management personnel to view. At the same time, the set log recording module 250 will also log the received event-related monitoring data, and store the log records in the database module 260 for storage, so as to facilitate the subsequent tracing of the event-related monitoring data.

[0077] like Figure 4 As shown, the event visualization unit 300 includes a third communication module 310 , a display module 320 and an early warning module 340 .

[0078] The third communication module 310 is used to implement information interaction between the event visualization unit 300 and the emergency processing unit 200 .

[0079] The display module 320 is used to display the received information. The display module 320 is connected to the third communication module 310. The display module 320 displays emergency events and warning information.

[0080] The warning module 340 is used to issue warning information of emergencies. The warning module 340 is connected to the display module 320 and the third communication module 310. The warning information can be issued in the form of sound or text. Similarly, different warning levels can be designed according to the urgency of the emergencies identified by the matching identification module 240.

[0081] As a further step, the event visualization unit 300 includes a log retrieval module 330 , which is used to retrieve event-related monitoring data of the emergency event. The log retrieval module 330 is connected to both the third communication module 310 and the display module 320 .

[0082] The third communication module 310 receives information from the emergency processing unit 200, the display module 320 displays information about the emergency, and the log retrieval module 330 retrieves log record information of the corresponding event. At the same time, when an emergency is received, the early warning module 340 issues an early warning to facilitate management personnel to check and respond to the emergency in a timely manner.

[0083] Example 2

[0084] A method for monitoring and early warning of highway emergencies is provided, comprising the following steps:

[0085] S1: Obtain multi-source monitoring data of expressways; according to the sources of the multi-source monitoring data, analyze the monitoring data of each source and identify the event-related monitoring data, and assign labels to the identified event-related monitoring data; the multi-source monitoring data includes: monitoring videos of expressways, radar monitoring data of expressways, mobile phone signaling data and network feedback information data;

[0086] S2: Analyze the monitoring data related to the identified events to match and identify the emergencies;

[0087] S3: Display the identified emergencies and issue warning information.

[0088] Furthermore, in step S2, before analyzing the identified event-related monitoring data, it is necessary to use the constructed firewall to block the upload of abnormal data; at the same time, it is also necessary to log the event-related monitoring data, and store the log record data, analysis data of the event-related monitoring data, and identification results of the emergency.

[0089] Furthermore, in step S3, the event-related monitoring data of the emergency can be retrieved and displayed so that management personnel can view and respond.

[0090] For more specific processes of the above method, please refer to the corresponding contents disclosed in the aforementioned embodiments, which will not be repeated here.

[0091] The present invention collects monitoring data in real time and assigns time identification and source identification to the collected event-related monitoring data. The acquisition time of each event-related monitoring data is determined by assigning a timestamp, and the source of the collected data is determined by assigning a source identification, so that monitoring data with time and source identification is obtained to ensure the reliability of the uploaded data and facilitate the tracing of the monitoring data. The uploaded event-related monitoring data will pass through a virtual firewall, and the firewall can block external abnormal data to ensure the reliability and security of the received and stored data. At the same time, the monitoring data is analyzed and matched with corresponding emergencies. When an emergency occurs, the emergency is uploaded, and the event visualization unit 300 issues an early warning to provide management personnel with the occurrence of an emergency. In addition, the monitoring data of the emergency can be retrieved for management personnel to view, achieving the effect of automatic analysis, reporting and data tracing of the emergency. In addition, the event-related monitoring data processed by the virtual firewall will be logged and stored in the database, so that the corresponding monitoring data can be retrieved later, and the security of the stored data can be guaranteed, that is, the information security of the collected data can be comprehensively improved, and the security event can be traced through log auditing, so as to provide the safest monitoring guarantee for database information.

[0092] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the system disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

[0093] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention or some parts of the embodiments.

[0094] The above are only preferred embodiments of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the present invention should be regarded as the protection scope of the present invention.

Claims

1. A monitoring and early warning system for highway emergencies, characterized in that: It comprises a data monitoring unit (100), an emergency processing unit (200) and an event visualization unit (300); The data monitoring unit (100) is used to collect multi-source monitoring data of the expressway, analyze the monitoring data from each source and identify event-related monitoring data according to the source of the multi-source monitoring data, and assign a label to the identified event-related monitoring data; The multi-source monitoring data includes: highway surveillance video, highway radar monitoring data, mobile phone signaling data and network feedback information data; The emergency processing unit (200) is used to receive the event-related monitoring data and analyze the event-related monitoring data to match and identify the emergency event; The event visualization unit (300) is used to display and warn the identified emergency events.

2. The monitoring and early warning system for highway emergencies according to claim 1 is characterized in that: The data monitoring unit (100) comprises a data acquisition module (110), a data analysis module (120), an identification assignment module (130) and a first communication module (140); The data acquisition module (110) is used to collect multi-source monitoring data; The data analysis module (120) comprises a video analysis submodule (121), a radar-visual fusion submodule (122), a signaling analysis submodule (123) and a feedback information analysis submodule (124); the video analysis submodule (121) is used to identify and locate abnormal objects that have strayed into the expressway based on the collected surveillance video; the radar-visual fusion submodule (122) is used to identify and locate abnormal driving behavior based on the collected surveillance video and radar monitoring data; The signaling analysis submodule (123) is used to identify abnormal signaling data based on the collected mobile phone signaling data; The feedback information analysis submodule (124) is used to identify potential risks of highway emergencies based on the collected network feedback information; The identification and assignment module (130) is used to independently monitor the monitoring video, radar monitoring data, mobile phone signaling data and network feedback information data in real time, and when the video analysis submodule (121), the radar and visual fusion submodule (122), the signaling analysis submodule (123) or the feedback information analysis submodule (124) identifies the event-related monitoring data, it assigns a timestamp and a source identifier; The first communication module (140) is used to upload event-related monitoring data of the video analysis submodule (121), the radar and visual fusion submodule (122), the signaling analysis submodule (123) or the feedback information analysis submodule (124) after being assigned a timestamp and a source identifier to the emergency processing unit (200).

3. The highway emergency monitoring and early warning system according to claim 2 is characterized in that: The video analysis submodule (121) uses the RT-DETR algorithm to identify and locate abnormal objects in the highway monitoring video; The radar-visual fusion submodule (122) uses the ByteTrack algorithm to identify and locate abnormal driving behavior on the highway surveillance video and radar monitoring data; The signaling analysis submodule (123) uses an LSTM algorithm to capture abnormalities in network protocols and communication events in the mobile phone signaling data; The feedback information analysis submodule (124) uses the BERT algorithm to analyze the textual intent of network feedback information data to identify potential risks related to highway emergencies.

4. The highway emergency monitoring and early warning system according to claim 2 is characterized in that: The identification assignment module (130) uses CEP technology to independently monitor the surveillance video, radar monitoring data, mobile phone signaling data and network feedback information data in real time.

5. The monitoring and early warning system for highway emergencies according to claim 1 is characterized in that: The emergency processing unit (200) comprises a second communication module (210), a data processing module (230) and a matching identification module (240); The second communication module (210) is used to realize information interaction between the emergency processing unit (200) and the data monitoring unit (100) and the event visualization unit (300); The data processing module (230) is used to analyze and integrate event-related monitoring data output by the data monitoring unit (100); The matching and identifying module (240) is used to match and identify emergencies based on the integration results of the data processing module (230) and set rules.

6. The highway emergency monitoring and early warning system according to claim 1 is characterized in that: The emergency processing unit (200) comprises an isolation protection module (220); the isolation protection module (220) is provided with a constructed virtual firewall, which will perform abnormal blocking on all the monitoring data related to the event, so as to ensure the safety and reliability of the monitoring data related to the event.

7. The highway emergency monitoring and early warning system according to claim 1 is characterized in that: The emergency processing unit (200) comprises a log recording module (250) and a database module (260); the log recording module (250) is used to log the received event-related monitoring data, and the database module (260) is used to store the received event-related monitoring data, analysis data of the event-related monitoring data, and identification results of emergency events.

8. The highway emergency monitoring and early warning system according to claim 1 is characterized in that: The event visualization unit (300) comprises a third communication module (310), a display module (320) and an early warning module (340); the third communication module (310) is used to realize information interaction between the event visualization unit (300) and the emergency processing unit (200); the display module (320) is used to display the received information, and the display module (320) is connected to the third communication module (310); the early warning module (340) is used to issue early warning information of an emergency event, and the early warning module (340) is connected to the display module (320) and the third communication module (310).

9. The highway emergency monitoring and early warning system according to claim 1 is characterized in that: The event visualization unit (300) comprises a log retrieval module (330), and the log retrieval module (330) is used to retrieve event-related monitoring data of an emergency event.

10. A method for monitoring and early warning of highway emergencies, characterized in that: The following steps are involved: Obtain multi-source monitoring data of the expressway; analyze the monitoring data from each source and identify event-related monitoring data based on the source of the multi-source monitoring data, and assign labels to the identified event-related monitoring data; The multi-source monitoring data includes: highway surveillance video, highway radar monitoring data, mobile phone signaling data and network feedback information data; Analyze the monitoring data related to the identified events to match and identify the emergencies; The identified emergencies are displayed and early warning information is issued.

Images