A method for handling abnormal events and a road handling system

Abstract

The present application is applicable to the field of road monitoring technology, and provides a method for handling abnormal events and a road handling system. In response to an abnormal event occurring in a target road, the method determines a first event handling strategy corresponding to the abnormal event, and the first event handling strategy is used to specify a first processing device to handle the abnormal event; sends the first event handling strategy to a control server; in response to the abnormal event continuing for a set duration, determines a second event handling strategy corresponding to the abnormal event, and the second event handling strategy is used to specify a second processing device to continue to handle the abnormal event on the basis of the first processing device handling the abnormal event; sends the second event handling strategy to the control server. The method achieves effective handling of abnormal events and ensures road safety by controlling different processing devices to handle the same abnormal event in conjunction with each other according to the duration of the abnormal event.

Description

Technical Field

[0001] The present application belongs to the technical field of road monitoring, and in particular, relates to a method for processing abnormal events and a road processing system. Background Art

[0002] Road traffic accident prevention is the top priority of road traffic safety assurance, especially the handling of abnormal events on highways or expressways that have not yet caused safety accidents.

[0003] However, the current methods for handling abnormal events in road traffic are relatively simple and cannot effectively handle abnormal events. Summary of the invention

[0004] The embodiments of the present application provide a method for processing abnormal events and a road processing system to enrich the method for processing abnormal events and ensure effective processing of abnormal events.

[0005] In a first aspect, an embodiment of the present application provides a method for processing abnormal events, which is applied to a road monitoring platform, and the road monitoring platform is configured in a road processing system. The method includes:

[0006] In response to an abnormal event occurring in the target road, determining a first event processing strategy corresponding to the abnormal event, the first event processing strategy being used to specify a first processing device to process the abnormal event;

[0007] Sending the first event processing strategy to the control server, the control server is used to control the first processing device to process the abnormal event;

[0008] In response to the abnormal event continuing for a set time, determining a second event processing strategy corresponding to the abnormal event, the second event processing strategy is used to specify a second processing device to continue processing the abnormal event based on the processing of the abnormal event by the first processing device;

[0009] The second event processing strategy is sent to the control server, and the control server is used to control the second processing device to continue processing the abnormal event based on the processing of the abnormal event by the first processing device.

[0010] In a possible implementation of the first aspect, different event processing strategies can be determined according to the specific circumstances of the abnormal event, so as to control different processing devices to process the abnormal event; further, the processing process of the processing device on the abnormal event can be continuously monitored to determine whether to continue to send different event processing strategies to control different processing devices to continue to process the abnormal event.

[0011] In a second aspect, an embodiment of the present application provides a road processing system, which includes at least a road monitoring platform, a control server and a processing device.

[0012] A road monitoring platform, for responding to an abnormal event occurring in a target road, determining a first event processing strategy corresponding to the abnormal event, and sending the first event processing strategy to a control server, wherein the first event processing strategy is used to specify a first processing device to process the abnormal event;

[0013] A control server, used to control the first processing device to process the abnormal event;

[0014] The road monitoring platform is used to determine a second event processing strategy corresponding to the abnormal event in response to the abnormal event continuing for a set time, and send the second event processing strategy to the control server, wherein the second event processing strategy is used to specify a second processing device to continue processing the abnormal event based on the processing of the abnormal event by the first processing device;

[0015] The control server is used to control the second processing device to continue processing the abnormal event based on the processing of the abnormal event by the first processing device.

[0016] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0017] By controlling different processing equipment according to the duration of the abnormal event, the same abnormal event can be processed in a linked manner. For example, different processing equipment can be controlled to conduct relay tracking, continuous warnings and abnormal cause tracing of abnormal events according to the actual road conditions and the occurrence of abnormal events. In terms of on-site reconnaissance and disposal capabilities, the linked processing of the same abnormal event by different processing equipment is fully realized, which realizes the effective handling of abnormal events and ensures road safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0019] Figure 1 It is a flowchart of a method for handling abnormal events provided by an embodiment of the present application;

[0020] Figure 2 is a flowchart of a method for handling abnormal events provided by another embodiment of the present application;

[0021] Figure 3It is a structural block diagram of a road processing system provided by an embodiment of the present application;

[0022] Figure 4 It is a structural block diagram of another road processing system provided in one embodiment of the present application. DETAILED DESCRIPTION

[0023] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0024] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0025] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0026] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0027] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0028] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0029] Figure 1 It is a flowchart of a method for processing abnormal events provided in one embodiment of the present application. As an example but not a limitation, the method can be applied to a road monitoring platform, which is configured in a road processing system.

[0030] It can be considered that with the construction of smart cities and smart transportation, highway monitoring facilities have reached a certain scale and density. Therefore, at present, highways mainly use video patrols to conduct daily traffic situation inspections and traffic accident prevention. For example, relying on "human eyes" to patrol a large number of videos in the background, the video patrols on the large screen of the command center can only display a fixed number of video images per unit time, and the duty officer observes and judges the content of the video images. The above scheme has a large number of time and space monitoring gaps, and the probability of abnormal road traffic events not being discovered in time is high.

[0031] On the other hand, with the development of the low-altitude economy, drones are gradually becoming an important supplement to road traffic safety inspections due to their maneuverability and flexibility. For example, professional pilots can operate drones and observe traffic situations and abnormal conditions within the range of their cameras. The supplementary advantages of drones are mainly reflected in the coverage of road conditions and handling capabilities. They can realize reconnaissance and intelligent recognition and warning of abnormalities in blind spots of existing surveillance videos, as well as on-site immediate handling based on warning events, such as license plate number recognition, illegal evidence collection, and shouting, which will further improve the efficiency of handling abnormal events and reduce the probability of accidents or secondary accidents. However, as a separate inspection carrier, drones are inspected through the eyes of pilots, so their work efficiency and coverage are limited.

[0032] Therefore, road monitoring and drones each serve as a separate road traffic patrol warning tool, which makes the current method of handling abnormal events relatively simple. It cannot be linked and coordinated with the actual road environment and road safety hazard inspection scenarios. The efficiency of safety patrols needs to be improved, and it cannot effectively complete the handling of abnormal events.

[0033] Based on this, the embodiment of the present application provides a method for handling abnormal events, which identifies abnormal events by superimposing the background intelligent recognition algorithm of video resources, and only tracks and inspects after identifying abnormal events, and controls different processing devices to handle abnormal events in a linked manner. This can solve the problem that road video surveillance patrols and drone mobile video patrols operate independently, and there is no complement or linkage in coverage, abnormal event tracking and tracing, and on-site disposal capabilities. It can realize the intelligent identification, early warning, and reconnaissance of abnormal events in road traffic safety, and have a certain degree of autonomous disposal capabilities, which greatly improves the timeliness of abnormal event discovery and reduces the labor cost of inspections. Figure 1 As shown, the method includes:

[0034] S101. In response to an abnormal event occurring on a target road, determine a first event processing strategy corresponding to the abnormal event, where the first event processing strategy is used to specify a first processing device to process the abnormal event.

[0035] The target road can be considered as a road that needs to be monitored, such as a highway and / or an expressway; an abnormal event can refer to an event that poses a safety hazard to the traffic on the target road, which can be specified in advance by relevant personnel. For example, the abnormal event can be at least one of an abnormal parking event, a non-motor vehicle driving event, a pedestrian event, a congestion event, a non-motor vehicle riding without a helmet event, a motor vehicle slow driving event, and an illegal license plate event.

[0036] Among them, an abnormal parking event can be understood as an event when a motor vehicle is stationary on the target road for a period of time that exceeds the preset abnormal parking threshold, a non-motor vehicle driving event can be understood as an event when a non-motor vehicle appears on the target road, a pedestrian event can be understood as an event when a pedestrian appears on the target road, a congestion event can be understood as an event when the number of vehicles in the same lane on the target road is greater than or equal to the vehicle threshold, a non-motor vehicle riding without a helmet event can be understood as an event when a non-motor vehicle appears on the target road and its driver does not wear a helmet, a motor vehicle slow-moving event can be understood as an event when the speed of a motor vehicle on the target road is less than the minimum speed threshold, and an illegal license plate event can be understood as an event when the license plate of a motor vehicle on the target road is illegal, such as when the vehicle deliberately covers the license plate, the vehicle does not have a license plate, the vehicle's license plate is a suspected registered license plate, etc.

[0037] In some embodiments, the source of the abnormal event is not limited. For example, it can be monitored by different servers and sent to the road monitoring platform, or it can be detected by the road monitoring platform itself. This embodiment does not limit this.

[0038] The first event processing strategy may be a preliminary processing strategy corresponding to an abnormal event, which is used to specify a first processing device to process the abnormal event. The specific content of the first processing device may be determined by relevant information of the abnormal event. For example, the first processing device may be a drone, a traffic guidance screen, or other device capable of processing abnormal events.

[0039] In this embodiment, the road monitoring platform can respond to an abnormal event occurring in the target road and determine the first event processing strategy corresponding to the abnormal event. The specific steps for determining the first event processing strategy are not limited. For example, multiple pre-stored processing plans can be called, and one of the multiple processing plans is selected based on the specific information of the abnormal event to determine the first event processing strategy. Exemplarily, the multiple processing plans can be plans for rapid handling of different abnormal events, including sending warning text messages to car owners, automatically dialing car owners, automatically calling drones to persuade them to leave, automatically calling drones to guide them, and collecting evidence for illegal parking. Multiple processing plans can be pre-stored in the server or in the road monitoring platform.

[0040] S102: Send a first event processing strategy to a control server, where the control server is used to control a first processing device to process an abnormal event.

[0041] The control server can be used to control the first processing device to process abnormal events. The specific type and configuration location of the control server are not limited. For example, the control server may include an edge server, and the edge server may be configured on the target road. For example, the edge server may be a multifunctional smart pole configured near the target road; the control server may also be configured in the cloud, etc.

[0042] After the road monitoring platform determines the first event processing strategy corresponding to the abnormal event, the determined first event processing strategy can be sent to the control server so that the control server controls the corresponding first processing device to process the abnormal event.

[0043] In a specific implementation, an abnormal event may be, for example, a pedestrian incident on a highway. The first event handling strategy may include specifying a drone to speak out to handle the abnormal event. The road monitoring platform may then send the first event handling strategy to the control server, which controls the drone to fly to or hover at the location of the abnormal event for immediate reconnaissance and disposal. The control server may be responsible for controlling the start-up of the drone, setting drone routes, controlling drone flight, speaking out to persuade or guide the drone, and conducting reconnaissance of the drone's surrounding conditions.

[0044] S103: In response to the abnormal event continuing for a set time, determine a second event processing strategy corresponding to the abnormal event, where the second event processing strategy is used to specify a second processing device to continue processing the abnormal event based on the processing of the abnormal event by the first processing device.

[0045] The set duration may be a duration pre-set by relevant personnel, which may be determined based on actual needs. The second event processing strategy may be a subsequent processing strategy corresponding to the abnormal event, which is used to specify that the second processing device continues to process the abnormal event based on the processing of the abnormal event by the first processing device. The second processing device may be considered as a processing device different from the first processing device, which is used to process the abnormal event, which may be determined based on actual conditions.

[0046] In this step, the abnormal event can be continuously monitored according to the processing status of the abnormal event. Assuming that the abnormal event continues for a set time, it means that the abnormal event has spatiotemporal continuity, that is, after the first processing device processes the abnormal event, the abnormal event still exists. In this case, the road monitoring platform can further determine a second event processing strategy corresponding to the abnormal event, so as to specify the second processing device to continue processing the abnormal event based on the processing of the abnormal event by the first processing device.

[0047] Among them, the timing of determining the second event processing strategy is not limited. For example, the second event processing strategy can be determined immediately when the abnormal event continues for a set time, or the corresponding second event processing strategy can be determined only when the abnormal event continues for a set time and the operation of the first processing device is affected, and so on.

[0048] In some embodiments, when the first processing device is a drone, in response to the abnormal event continuing for a set time, determining a second event processing strategy corresponding to the abnormal event includes:

[0049] In response to an abnormal event continuing for a set period of time and the drone is in a restricted state, a second event processing strategy corresponding to the abnormal event is determined. The second event processing strategy is used to specify the second processing device as a roadside monitoring device, and continue to process the abnormal event based on the drone's processing of the abnormal event.

[0050] Roadside monitoring equipment may refer to monitoring equipment configured on the target road, such as monitoring cameras.

[0051] In a specific implementation, the first processing device may be a drone, and the timing for determining the second event processing strategy may be, for example, when the abnormal event continues for a set time and the drone is in a restricted state. For example, after the drone is controlled to shout at the non-motor vehicle driving event on the highway, the non-motor vehicle is still driving on the highway, and the drone will continue to track and process the non-motor vehicle driving event. At this time, if the drone encounters trees, foreign objects or other meteorological, geographical, and management factors that restrict the operation of the drone, the road monitoring platform can determine the second event processing strategy corresponding to the abnormal event, and specify the roadside monitoring device to continue to process the abnormal event on the basis of the drone's processing of the abnormal event. For example, a corresponding signal can be sent to control the road video monitoring to relay warning, and the details of the abnormal event can be confirmed at a closer distance, such as the linkage tracking of the high-position camera to the low-point camera, etc., to monitor the abnormal event in a targeted manner. On this basis, when the abnormal event continues for a set time and the drone is in a restricted state, the roadside monitoring device can be quickly controlled to relay the same abnormal event, thereby ensuring the effective processing of the abnormal event.

[0052] In some embodiments, when the first processing device is a roadside monitoring device, in response to the abnormal event continuing for a set time, determining a second event processing strategy corresponding to the abnormal event includes:

[0053] In response to an abnormal event continuing for a set period of time and the roadside monitoring device entering a blind spot, a second event processing strategy corresponding to the abnormal event is determined. The second event processing strategy is used to specify that the second processing device is a drone, and the abnormal event continues to be processed based on the processing of the abnormal event by the roadside monitoring device.

[0054] In a specific implementation, the first processing device may be a roadside monitoring device, and the timing for determining the second event processing strategy may be, for example, when an abnormal event continues for a set time and the roadside monitoring device enters a blind spot. For example, in the process of controlling the roadside monitoring device to continuously monitor the slow-moving motor vehicle event on the highway, the motor vehicle continues to travel at a low speed on the highway. If the direction of travel of the roadside monitoring device will enter the blind spot at this time, the road monitoring platform may determine the second event processing strategy corresponding to the abnormal event, and specify that the drone continue to process the abnormal event on the basis of the roadside monitoring device processing the abnormal event. For example, the drone may be controlled to relay tracking and continuous warning of the abnormal event, such as shouting, warning sound, etc., until the safety hazard is eliminated. On this basis, when the abnormal event continues for a set time and the roadside monitoring device enters a blind spot, the drone can be quickly controlled to relay processing of the same abnormal event, thereby ensuring effective processing of the abnormal event.

[0055] S104: Send a second event processing strategy to a control server, where the control server is used to control the second processing device to continue processing the abnormal event based on the processing of the abnormal event by the first processing device.

[0056] After the road monitoring platform determines the second event processing strategy corresponding to the abnormal event, the determined second event processing strategy can be sent to the control server so that the control server controls the corresponding second processing device to process the abnormal event.

[0057] In some embodiments, different event handling strategies can be sent to the control server in sequence according to the actual situation of the abnormal event. For example, different event handling strategies can be sent to the control server in sequence based on the duration of the abnormal event to control different processing devices to perform joint processing on the abnormal event. Among them, different event handling strategies can be sent according to priority. For example, when the abnormal event is a motor vehicle slow-moving event, and the motor vehicle slow-moving event has not continued for a set duration, only the above steps S101-S102 can be executed, such as controlling a drone to shout at abnormally parked vehicles; or when it is detected that the abnormal event has continued for a set duration, steps S103-S104 can be executed on the basis of executing the above steps S101-S102, such as designating front-line duty personnel to conduct on-site disposal through a command system; further, steps S103-S104 can be executed cyclically on the basis of the above, such as pushing the motor vehicle slow-moving event to a violation disposal system for processing until the abnormal event is handled.

[0058] In some embodiments, different event processing strategies can be sent to the control server at the same time according to the actual situation of the abnormal event, so as to control different processing devices to process the abnormal event. For example, when the received abnormal event is an illegal license plate event, the road monitoring platform can specify the roadside monitoring equipment or drone to process the illegal license plate event. At the same time, the illegal license plate event can also be pushed to the illegal handling system. For example, after the designated roadside monitoring equipment continuously monitors the vehicle involved in the illegal license plate event, if the roadside monitoring equipment encounters a blind spot, other event processing strategies corresponding to the illegal license plate event can be further determined, and the designated drone can continue to process the illegal license plate event on the basis of processing the abnormal event.

[0059] The present embodiment provides a method for handling abnormal events. In response to an abnormal event occurring in a target road, a first event handling strategy corresponding to the abnormal event is determined, and the first event handling strategy is used to specify a first processing device to handle the abnormal event; the first event handling strategy is sent to a control server, and the control server is used to control the first processing device to handle the abnormal event; in response to the abnormal event lasting for a set time, a second event handling strategy corresponding to the abnormal event is determined, and the second event handling strategy is used to specify a second processing device to continue to handle the abnormal event on the basis of the first processing device handling the abnormal event; the second event handling strategy is sent to the control server, and the control server is used to control the second processing device to continue to handle the abnormal event on the basis of the first processing device handling the abnormal event. By using this method, by controlling different processing devices to perform linkage processing on the same abnormal event according to the duration of the abnormal event, effective handling of abnormal events is achieved, ensuring road safety.

[0060] In some embodiments, the control server includes a central server, and before determining a first event processing strategy corresponding to the abnormal event in response to the abnormal event occurring in the target road, further includes:

[0061] The receiving center server identifies abnormal events from the surveillance video of the target road. The surveillance video is collected by the roadside monitoring equipment installed on the target road and the drone patrolling over the target road.

[0062] The control server may include a central server, which may be configured in the cloud and have a communication connection with the road monitoring platform. The monitoring video of the target road may be collected by the roadside monitoring equipment installed on the target road and the drone patrolling over the target road. For example, the roadside monitoring equipment of the target road and / or the drone patrolling over the target road may send the collected monitoring video to the central server in real time, or the roadside monitoring equipment of the target road and / or the drone patrolling over the target road may uniformly send the collected monitoring video to the video aggregation terminal, which forwards the monitoring video to the central server.

[0063] In this embodiment, the central server can be used to receive the surveillance video of the target road, perform abnormal identification on the received surveillance video to obtain abnormal events, and send the abnormal events to the road monitoring platform. The road monitoring platform can then receive the abnormal events obtained by the abnormal identification of the central server and perform subsequent processing operations. The specific method of abnormal identification of the central server is not further expanded here. On this basis, the surveillance videos collected by roadside monitoring equipment and drones can be used as a common resource for road traffic safety hazard inspections, complementing each other in terms of coverage, increasing the probability of timely discovery of abnormal events, and thus ensuring the safety of the target road.

[0064] Figure 2 It is a flow chart of a method for handling abnormal events provided by another embodiment of the present application. This embodiment further optimizes the situation before responding to an abnormal event occurring in a target road and determining a first event handling strategy corresponding to the abnormal event as follows: receiving an abnormal event for a target road sent by a network server.

[0065] At the same time, in response to an abnormal event occurring in the target road, determining the first event processing strategy corresponding to the abnormal event is further optimized as follows: matching the event geographic coordinates of the abnormal event with at least one pre-stored geographic coordinate to obtain a matching result, wherein the at least one pre-stored geographic coordinate is the geographic coordinate of at least one roadside monitoring device; and determining the first event processing strategy corresponding to the abnormal event according to the matching result. Figure 2 As shown, the method includes:

[0066] S201: Receive an abnormal event for a target road sent by a network server.

[0067] A network server can be considered as a server related to the Internet. The network server can receive road data from various applications or other information carriers. Each application can, for example, be a navigation software related to roads. Other information carriers can, for example, obtain data related to road information, etc. The road data may include accident data, road congestion data and / or other road-related data, etc.

[0068] For example, after the network server obtains the accident data of the target road, it can send the abnormal events for the target road to the road monitoring platform, so that the road monitoring platform can receive the abnormal events sent by the network server and perform subsequent processing operations.

[0069] S202: Match the event geographic coordinates of the abnormal event with at least one pre-stored geographic coordinate to obtain a matching result, where the at least one pre-stored geographic coordinate is the geographic coordinates of at least one roadside monitoring device.

[0070] The event geographic coordinates may refer to the geographic coordinates of the abnormal event; the at least one pre-stored geographic coordinate may be the geographic coordinates of at least one roadside monitoring device, such as the geographic coordinates of a configured road monitoring device.

[0071] Specifically, after the road monitoring platform receives the abnormal event sent by the network server, the event geographic coordinates of the abnormal event can be matched with at least one pre-stored geographic coordinate, such as matching the event geographic coordinates with each pre-stored geographic coordinate, so as to obtain a specific matching result.

[0072] Among them, the specific matching method can be, for example, by calculating the distance between the event geographic coordinates and each pre-stored geographic coordinate respectively to obtain specific distance data, so as to achieve position matching of the event geographic coordinates according to the size of each specific distance data, such as the pre-stored geographic coordinates corresponding to the distance data less than the preset distance can be considered to be successfully matched with the event geographic coordinates. Alternatively, the event geographic coordinates and at least one pre-stored geographic coordinate can be input into a preset matching model to output the corresponding matching result. The size of the preset distance can be configured according to the actual situation; the preset matching model can be used to match the geographic coordinates, and the specific content is not limited.

[0073] S203: Determine a first event processing strategy corresponding to the abnormal event according to the matching result.

[0074] After obtaining the matching results through the above steps, the first event processing strategy corresponding to the abnormal event can be determined according to the matching results. For example, the first event processing strategies determined by different matching results may be different.

[0075] In some embodiments, determining a first event processing strategy corresponding to the abnormal event according to the matching result includes:

[0076] If the event geographic coordinates successfully match the target geographic coordinates in at least one of the pre-stored geographic coordinates, a first event processing strategy corresponding to the abnormal event is determined, and the first event processing strategy is used to specify that the first processing device is a roadside monitoring device corresponding to the target geographic coordinates to process the abnormal event;

[0077] If the event geographic coordinates fail to match at least one pre-stored geographic coordinate, a first event processing strategy corresponding to the abnormal event is determined, and the first event processing strategy is used to specify that the first processing device is a drone to process the abnormal event.

[0078] The target geographic coordinates may be considered to be one or more geographic coordinates in at least one pre-stored geographic coordinate that successfully matches the event geographic coordinates.

[0079] In a specific implementation, if the event geographic coordinates successfully match the target geographic coordinates in at least one pre-stored geographic coordinates, it means that the target geographic coordinates are within the vicinity of the event geographic coordinates. At this time, the first event processing strategy corresponding to the abnormal event can be determined. The first event processing strategy is used to specify the first processing device as a roadside monitoring device corresponding to the target geographic coordinates to process the abnormal event, such as controlling the road monitoring corresponding to the target geographic coordinates to view the real-time traffic situation of the abnormal event.

[0080] If the event geographic coordinates fail to match at least one pre-stored geographic coordinate, it means that at least one pre-stored geographic coordinate is outside the vicinity of the event geographic coordinates, that is, there is no configured roadside monitoring equipment around the abnormal event. Then, the first event processing strategy corresponding to the abnormal event can be determined. The first event processing strategy can be used to specify the first processing device as a drone to process the abnormal event.

[0081] Furthermore, the central server can also control the first processing device differently according to the distance between the drone and the abnormal event to process the abnormal event. For example, the central server can determine the distance between the drone and the abnormal event by calculation. If the distance is short, the drone can be immediately started to go to the event geographic coordinates of the abnormal event for confirmation; if the distance is long, the police car with a drone in the trunk can be controlled to drive close to the event geographic coordinates of the abnormal event, and then the drone can be started for real-time reconnaissance and confirmation. On this basis, the abnormal event can be quickly processed according to the event geographic coordinates, which improves the efficiency of handling abnormal events.

[0082] S204: Send the first event processing strategy to the control server, where the control server is used to control the first processing device to process the abnormal event.

[0083] S205. In response to the abnormal event continuing for a set time, determine a second event processing strategy corresponding to the abnormal event, the second event processing strategy is used to specify a second processing device to continue processing the abnormal event based on the processing of the abnormal event by the first processing device.

[0084] S206: Send a second event processing strategy to a control server, where the control server is used to control the second processing device to continue processing the abnormal event based on the processing of the abnormal event by the first processing device.

[0085] The present embodiment provides a method for handling abnormal events. By receiving abnormal events for a target road from a network server, the method can achieve effective handling of the abnormal events based on the matching results of the event geographic coordinates of the abnormal event with at least one pre-stored geographic coordinates, thereby expanding the handling scope of abnormal events and further ensuring road safety.

[0086] Corresponding to the method for handling abnormal events in the above embodiment, Figure 3 This is a structural block diagram of a road processing system provided in one embodiment of the present application. For ease of explanation, only the parts related to the embodiment of the present application are shown.

[0087] Reference Figure 3 The road processing system at least includes: a road monitoring platform 1, a control server 2, a first processing device 3 and a second processing device 4,

[0088] The road monitoring platform 1 is used to determine a first event processing strategy corresponding to the abnormal event in response to an abnormal event occurring in a target road, and send the first event processing strategy to the control server 2, wherein the first event processing strategy is used to specify a first processing device 3 to process the abnormal event;

[0089] The control server 2 is used to control the first processing device 3 to process the abnormal event;

[0090] The road monitoring platform 1 is used to determine a second event processing strategy corresponding to the abnormal event in response to the abnormal event continuing for a set time, and send the second event processing strategy to the control server 2, the second event processing strategy is used to specify the second processing device 4 to continue processing the abnormal event on the basis of the first processing device 3 processing the abnormal event;

[0091] The control server 2 is used to control the second processing device 4 to continue processing the abnormal event based on the processing of the abnormal event by the first processing device 3.

[0092] Among them, the road monitoring platform 1 can refer to a platform responsible for monitoring the target road and controlling the processing equipment to handle abnormal events; the specific type and configuration location of the control server 2 are not limited, such as different types of control servers 2 can be specifically configured with different modules.

[0093] In some embodiments, the road processing system further includes a network server.

[0094] A network server, used for acquiring abnormal events for a target road and sending the abnormal events to a road monitoring platform;

[0095] The road monitoring platform is used to receive abnormal events sent by the network server.

[0096] A road processing system provided in this embodiment realizes effective processing of abnormal events and ensures road safety by controlling different processing devices to perform linkage processing on the same abnormal event according to the duration of the abnormal event.

[0097] Figure 4 is a structural block diagram of another road processing system provided by an embodiment of the present application, such as Figure 4As shown, the road processing system may include a central server, a video aggregation terminal, an intelligent patrol application platform (i.e., a road monitoring platform), an edge computing server (i.e., an edge server), and a network server. Among them, the central server may include an intelligent identification module for hidden danger events, an event library archive management module, a rapid disposal plan module, and an immediate disposal control module; the video aggregation terminal may include the aggregation of real-time videos from roadside monitoring cameras and drone cameras; the intelligent patrol application platform may include an intelligent early warning module, an event rapid disposal module, and an event statistical analysis module.

[0098] Specifically, the intelligent recognition module for hidden danger events in the central server can further include an abnormal parking intelligent recognition module, a non-motor vehicle intelligent recognition module, a pedestrian intelligent recognition module, a congestion intelligent recognition module, an electric bicycle riding without a helmet intelligent recognition module, a slow-moving intelligent recognition module, and a license plate intelligent recognition module.

[0099] The abnormal parking intelligent identification module can be used to identify stationary vehicles and their stationary duration within the full video field of view or a specified field of view. When the stationary duration exceeds the preset abnormal parking threshold, the abnormal parking event is pushed to the intelligent patrol application platform.

[0100] The non-motor vehicle intelligent recognition module can be used to identify non-motor vehicles within the full video field of view or the specified field of view. When a non-motor vehicle appears, the non-motor vehicle intrusion event (i.e. non-motor vehicle driving event) is pushed to the intelligent patrol application platform.

[0101] The pedestrian intelligent recognition module can be used to identify pedestrians in the full video field of view or in a specified field of view. When a pedestrian appears, the pedestrian intrusion event (i.e. pedestrian event) is pushed to the intelligent patrol application platform.

[0102] The congestion intelligent identification module can be used to identify congestion in the entire video field or a specified field of view. When the number of vehicles in the same lane is greater than or equal to the threshold, the congestion event is pushed to the intelligent patrol application platform.

[0103] The intelligent identification module for electric bicycles without helmets can be used to identify electric bicycle drivers without helmets in the full video field of view or the specified field of view. When an electric bicycle is detected and its driver is not wearing a helmet, the non-motor vehicle riding without a helmet event is pushed to the intelligent patrol application platform;

[0104] The slow-moving intelligent recognition module can be used to identify slow-moving motor vehicles in the full video field of view or the specified field of view. When the speed of a motor vehicle is detected to be lower than the minimum speed limit of the road in the area and exceeds the threshold, the slow-moving motor vehicle event is pushed to the intelligent patrol application platform;

[0105] The license plate intelligent recognition module can be used to identify the license plates of motor vehicles within the full video field of view or the specified field of view. For example, the license plates of vehicles determined to have abnormal parking incidents can be automatically recognized at a certain camera focal length, and the corresponding license plate information can be pushed to the intelligent patrol application platform together with the abnormal parking incident.

[0106] The event library archive management module in the central server can be used to store information from the occurrence to the elimination of the warning event, including the time and location of the abnormal event, the camera type (including the number), the event type, the event picture, the short video of the event process, the handling personnel, the handling time, the handling method, and the handling duration.

[0107] The rapid response plan module in the central server can be used to create and store rapid response plans for different abnormal events, including sending warning text messages to vehicle owners, automatically dialing vehicle owners, automatically shouting to persuade drivers to leave, automatically shouting to guide drivers, and enforcing parking regulations and collecting evidence.

[0108] The instant handling control module in the central server can be used to control the drone to fly to or hover at the event location for instant reconnaissance and handling, including drone startup, drone route planning, drone flight control, drone shouting to persuade or guide, and drone surrounding situation reconnaissance.

[0109] The intelligent early warning module in the intelligent patrol application platform can include early warning pop-up windows and sound alerts for abnormal events, display the time and location of the event, camera type (including number), event type, event pictures, and short videos of the event process, and can check the situation of related cameras in a certain area with one click.

[0110] The event rapid handling module in the intelligent patrol application platform may include a handling module, a background attention module, and a false alarm module. Among them, the handling module may further include an instant reconnaissance and shouting module, a remote command module, and a module for pushing other business systems.

[0111] Among them, the real-time reconnaissance and shouting module can be used to control drones to reconnaissance the location of the incident and related surrounding conditions, or to shout at close range about non-motor vehicle intrusions, pedestrian intrusions, electric bicycle riders without helmets, and slow-moving incidents. For example, it can specifically warn non-motor vehicles and pedestrians to immediately leave the motor vehicle lane and retreat to a safe area; warn electric bicycle drivers to immediately put on helmets or get off and push; warn slow-moving vehicle drivers not to drive while tired, and to go to the nearest service station to rest if they have been driving for a long time.

[0112] The remote command module can be used by video patrol personnel at the command center to contact the parties involved in the incident by phone to warn and persuade them, or to conduct on-site disposal deployment for front-line duty personnel through the command system.

[0113] Pushing other business system modules can include pushing event information to other business systems for next-level processing, such as pushing event information to illegal processing systems, command systems, etc. as evidence or clues.

[0114] The background attention module can be used to include some normalized congestion and abnormal events that have been immediately handled and eliminated into the background attention data, which can be used for subsequent statistical analysis.

[0115] The false alarm module can be used to provide false alarm reminders during routine situations such as worker operations and road maintenance.

[0116] The event statistics analysis module in the intelligent patrol application platform can be used to conduct single-dimensional or multi-dimensional, graphical, and tabular statistical analysis of the time, location, camera type (including number), event type, handling personnel, handling time, handling method, and handling duration of abnormal events, including ranking, distribution, and change trends.

[0117] The edge computing server can be configured with a locking relay control module, which can be used for abnormal traffic events with spatiotemporal continuity, such as non-motor vehicle intrusion, pedestrian intrusion, congestion, electric bicycle riding without a helmet, slow driving, etc. When the direction of the road monitoring video is about to enter the blind spot, the event rapid disposal module of the intelligent patrol application platform calls the roadside edge computing server, and quickly uses the road monitoring video warning signal to trigger the drone intelligent patrol of the same event, and relay tracking and continuous warning of the situation of abnormal events, such as shouting, warning sound, etc. For congestion events, it can also realize the reverse abnormal cause tracing in the direction of the oncoming vehicle until the safety hazard is eliminated;

[0118] It is also used to deal with abnormal traffic events with temporal and spatial continuity, such as non-motor vehicle intrusion, pedestrian intrusion, congestion, electric bicycle riding without helmet, slow walking, etc. When the direction of the drone is blocked or restricted by trees, foreign objects or other meteorological, geographical, and management factors, the event rapid disposal module of the intelligent patrol application platform calls the roadside edge computing server to quickly use the drone intelligent patrol warning signal to trigger the road surveillance video in the direction of the same event to zoom in on the details and relay tracking, so as to ensure the real-time location for corresponding disposal; for congestion events, it can also trace the cause of the abnormality from the video surveillance in the direction of the oncoming vehicle until the safety hazard is eliminated.

[0119] In addition, after the congestion or accident data of the navigation software is warned based on the Internet (i.e., the network server), the intelligent patrol application platform can receive this abnormal event, associate the latitude and longitude address, and use the established camera to view the real-time traffic situation (match the event geographic coordinates of the abnormal event with at least one pre-stored geographic coordinates to obtain a matching result; if the event geographic coordinates successfully match the target geographic coordinates in at least one pre-stored geographic coordinates, then determine the first event processing strategy corresponding to the abnormal event, and the first event processing strategy is used to specify that the first processing device is a roadside monitoring device corresponding to the target geographic coordinates to process the abnormal event). If the latitude and longitude address cannot be associated with the traffic conditions that need to be verified within the corresponding range, it can be determined to start a drone to go to the scene of the incident for confirmation; if the flight distance is long, a police car with a drone airport in the trunk can be dispatched to drive close to the origin of the abnormal event, and start the drone for real-time reconnaissance and confirmation (i.e., if the event geographic coordinates fail to match at least one pre-stored geographic coordinate, then determine the first event processing strategy corresponding to the abnormal event, and the first event processing strategy is used to specify that the first processing device is a drone to process the abnormal event).

[0120] In addition, the road processing system can also be applied to control scenarios, such as patrol drones can be deployed near highway toll stations, such as on roads near highways or near roads near highways. The drones collect monitoring videos or monitoring photos of vehicles on the road in real time, and send the collected monitoring videos or monitoring photos to the central server, so that the license plate intelligent recognition module of the central server can recognize and / or compare the license plate of each vehicle. For example, the license plate intelligent recognition module can recognize the license plate of each vehicle, and compare the recognized license plate with the illegal registered license plate to output abnormal events, and can also send the recognized license plates to the illegal handling system for license plate comparison to identify illegal license plate events and illegal vehicles in this illegal license plate event. On this basis, the vehicle license plate inspection process can be simplified and the monitoring efficiency of illegal vehicles can be improved.

[0121] To sum up, the present embodiment provides a method for handling abnormal events and a road handling system. On the one hand, they use road video surveillance and drone mobile video inspections as common resources for road traffic safety hazard inspections, complementing each other in terms of coverage. According to the actual road conditions and the occurrence of events, drone cameras and road monitoring facilities are controlled to conduct relay tracking, continuous warnings and abnormal cause tracing of potential traffic safety events. As a whole, the road video surveillance warning and drone inspection warning are used to handle the same abnormal event, fully linking the on-site reconnaissance and disposal capabilities.

[0122] On the other hand, the intelligent identification and early warning capabilities of road monitoring and real-time drone video can further improve the timeliness of the discovery and handling of road safety hazards, prevent them before they occur, and reduce the probability of accidents or secondary accidents.

[0123] For example, for abnormal events, such as non-motor vehicle intrusion, pedestrian intrusion, congestion, electric bicycle riding without helmet, slow walking and other traffic hazards with event identity and spatiotemporal continuity, it is possible to quickly realize the road video surveillance warning signal triggering drone patrol warning lock relay tracking, continuous warning, and abnormal cause tracing; it is also possible to quickly realize the drone patrol warning signal triggering road video surveillance relay warning, confirm the details of the abnormal event at a closer distance, and conduct linkage tracking from high-position cameras to low-point cameras. For example, when drones patrol and handle abnormal non-motor vehicle intrusion events, if there are trees, foreign objects or other meteorological, geographical, and management factors that block or restrict the intelligent identification of drones, the roadside video surveillance in the direction of the abnormal event can be switched to conduct intelligent relay tracking and abnormal cause tracing.

[0124] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0125] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0126] In the embodiments provided in the present application, it should be understood that the disclosed systems and methods can be implemented in other ways. For example, the system embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0127] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0128] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A method for handling abnormal events, characterized in that: Applied to a road monitoring platform, the road monitoring platform is configured in a road processing system, and the method includes: In response to an abnormal event occurring in a target road, determining a first event processing strategy corresponding to the abnormal event, wherein the first event processing strategy is used to specify a first processing device to process the abnormal event; Sending the first event processing strategy to a control server, wherein the control server is used to control the first processing device to process the abnormal event; In response to the abnormal event continuing for a set time, determining a second event processing strategy corresponding to the abnormal event, wherein the second event processing strategy is used to specify a second processing device to continue processing the abnormal event based on the processing of the abnormal event by the first processing device; The second event processing strategy is sent to a control server, where the control server is used to control the second processing device to continue processing the abnormal event based on the processing of the abnormal event by the first processing device.

2. The method for handling abnormal events according to claim 1, characterized in that: In the case where the first processing device is a drone, in response to the abnormal event continuing for a set time, determining a second event processing strategy corresponding to the abnormal event includes: In response to the abnormal event continuing for a set period of time and the drone being in a restricted state, a second event processing strategy corresponding to the abnormal event is determined, and the second event processing strategy is used to specify the second processing device as a roadside monitoring device, and continue to process the abnormal event based on the drone's processing of the abnormal event.

3. The method for handling abnormal events according to claim 1, characterized in that: In the case where the first processing device is a roadside monitoring device, in response to the abnormal event continuing for a set time, determining a second event processing strategy corresponding to the abnormal event includes: In response to the abnormal event continuing for a set period of time and the roadside monitoring device entering a blind spot, a second event processing strategy corresponding to the abnormal event is determined. The second event processing strategy is used to specify that the second processing device is a drone, and the abnormal event continues to be processed based on the processing of the abnormal event by the roadside monitoring device.

4. The method for handling abnormal events according to claim 1, characterized in that: The control server includes a central server, and before determining a first event processing strategy corresponding to an abnormal event in response to the abnormal event occurring in the target road, further includes: An abnormal event is received by the central server through abnormality identification of a surveillance video of a target road, where the surveillance video is collected by a roadside surveillance device installed on the target road and a drone patrolling over the target road.

5. The method for handling abnormal events according to claim 1, characterized in that: Before determining a first event processing strategy corresponding to an abnormal event in response to the abnormal event occurring in the target road, the method further includes: Receiving abnormal events for a target road sent by a network server; In response to an abnormal event occurring in the target road, determining a first event processing strategy corresponding to the abnormal event includes: Matching the event geographic coordinates of the abnormal event with at least one pre-stored geographic coordinate to obtain a matching result, wherein the at least one pre-stored geographic coordinate is the geographic coordinate of at least one roadside monitoring device; A first event processing strategy corresponding to the abnormal event is determined according to the matching result.

6. The method for handling abnormal events according to claim 5, characterized in that: The determining, according to the matching result, a first event processing strategy corresponding to the abnormal event includes: If the event geographic coordinates successfully match the target geographic coordinates in the at least one pre-stored geographic coordinates, determining a first event processing strategy corresponding to the abnormal event, wherein the first event processing strategy is used to specify a first processing device as a roadside monitoring device corresponding to the target geographic coordinates to process the abnormal event; If the event geographic coordinates fail to match the at least one pre-stored geographic coordinates, a first event processing strategy corresponding to the abnormal event is determined, and the first event processing strategy is used to specify that the first processing device is a drone to process the abnormal event.

7. The method for handling abnormal events according to any one of claims 1 to 6, characterized in that: The control server includes an edge server, and the edge server is configured on the target road.

8. The method for handling abnormal events according to any one of claims 1 to 6, characterized in that: The abnormal event is at least one of an abnormal parking event, a non-motor vehicle driving event, a pedestrian event, a congestion event, a non-motor vehicle riding without a helmet event, a motor vehicle slow driving event, and an illegal license plate event.

9. A road processing system, characterized in that: The road processing system at least includes a road monitoring platform, a control server and a processing device. The road monitoring platform is used to determine a first event processing strategy corresponding to an abnormal event in response to the occurrence of an abnormal event in a target road, and send the first event processing strategy to the control server, wherein the first event processing strategy is used to specify a first processing device to process the abnormal event; The control server is used to control the first processing device to process the abnormal event; The road monitoring platform is used to determine a second event processing strategy corresponding to the abnormal event in response to the abnormal event continuing for a set time, and send the second event processing strategy to the control server, wherein the second event processing strategy is used to specify a second processing device to continue processing the abnormal event on the basis of the first processing device processing the abnormal event; The control server is used to control the second processing device to continue processing the abnormal event based on the processing of the abnormal event by the first processing device.

10. The road processing system according to claim 9, characterized in that: The road processing system also includes a network server, The network server is used to obtain abnormal events for a target road and send the abnormal events to the road monitoring platform; The road monitoring platform is used to receive abnormal events sent by the network server.

Images