Coordinated management and control method and device for expressway emergency events

Abstract

The invention relates to a road traffic congestion relief technology, and discloses a highway emergency event coordination control method and device, and the method comprises the steps: collecting images of lanes in response to different road sections in a highway, carrying out the recognition of the images, and at least obtaining the driving condition information of the lanes; based on the driving condition, determining that the vehicle driving speed in a lane is lower than a first threshold value, or the vehicle density exceeds a second threshold value, or the distance between vehicles in a plurality of lanes is smaller than a third threshold value; determining that corresponding road sections of the expressway need to be subjected to traffic intervention; based on the collected image of the to-be-intervened road section, identifying a congestion reason; determining an intervention mode according to the position information of the to-be-intervened road section and the congestion reason; and according to the intervention modes of the to-be-intervened road section, each local unit is notified of each intervention mode, and each unit intervenes the traffic mode of the expressway according to the intervention modes. According to the invention, the traffic efficiency of the expressway is ensured, and the accident rate is reduced.

Description

Technical Field

[0001] The present application relates to road traffic congestion relief technology, and in particular to a method and device for coordinating and controlling emergency events on expressways. Background Art

[0002] At present, there are always emergencies on highways, such as traffic accidents occupying some lanes, or some lanes being occupied by low-speed vehicles for a long time, and multiple vehicles driving in parallel causing road congestion, etc. This will reduce the efficiency of highway traffic and cause traffic jams. Due to the closed nature of highways, it is generally difficult to deal with them through conventional diversion methods. In particular, when an accident causes serious traffic jams, it is generally difficult to carry out rescue intervention in the same direction, which not only fails to achieve road diversion in time, but also causes casualties in serious cases. Summary of the invention

[0003] In view of this, the present application proposes a method and device for coordinating and controlling emergency events on highways to solve the problem in the prior art that emergency events on highways cannot be responded to in a timely manner.

[0004] According to a first aspect of the present application, a method for coordinating and controlling emergency events on a highway is provided, comprising: In response to images of lanes collected at different sections of the highway, the images are recognized to obtain at least driving condition information of the lanes; Based on the driving conditions, determining that the speed of vehicles in the lane is lower than a first threshold, or the vehicle density exceeds a second threshold, or the spacing between vehicles in multiple lanes is less than a third threshold; determining that a traffic intervention is required for the corresponding section of the expressway; Identify the cause of congestion based on the images collected on the road section to be intervened; Determine the intervention method based on the location information of the road section to be intervened and the cause of congestion; According to the intervention method of the road section to be intervened, each intervention method will be notified to each local unit respectively, and each unit will intervene in the traffic mode of the expressway according to the intervention method.

[0005] In some exemplary embodiments, the step of recognizing the image to at least obtain the driving condition information of the lane includes: Acquire feature points in the image, and determine corresponding vehicle information based on the feature points; Determine the relative position relationship between vehicles at different time points and the driving speed of the vehicles based on vehicle information; Based on the relative position relationship between vehicles, changes in the relative position relationship and vehicle speed, the driving condition information of different lanes is determined.

[0006] In some exemplary embodiments, the step of identifying the cause of congestion based on collecting images of the road section to be intervened includes: When it is determined that the speeds of two or more vehicles in adjacent lanes are similar and the distance between the two or more vehicles is less than the fourth threshold, and the duration exceeds the fifth threshold, it is determined that the road section is congested due to vehicles running in parallel and with speeds lower than the set threshold.

[0007] In some exemplary embodiments, the step of identifying the cause of congestion based on collecting images of the road section to be intervened includes: When it is determined that two or more vehicles in the same lane have similar speeds and the distance between the two or more vehicles is less than the sixth threshold, and the duration exceeds the seventh threshold, it is determined that the lane is congested due to the series of vehicles and the short distance between them.

[0008] In some exemplary embodiments, determining the intervention method includes: Identify relevant vehicles in the same lane or adjacent lanes, generate reminder information to prompt the vehicle to speed up and increase the driving distance, or generate reminder information to prompt relevant vehicles to change lanes, and output reminder information through vehicle driving reminder signs or voice broadcast systems in the direction of the vehicle and the nearest reminder sign or voice broadcast system according to the location information of the road section; Alternatively, based on the position information of the road section to be intervened, determine whether there is a duty vehicle in the opposite lane, and the distance from the road section to be intervened is less than the eighth threshold, and send a prompt message to the duty vehicle to prompt the relevant vehicles to change lanes, change the distance between vehicles or speed up, so that the duty vehicle intervenes in the relevant vehicles.

[0009] In some exemplary embodiments, the step of identifying the cause of congestion based on collecting images of the road section to be intervened includes: Determine that the vehicle speeds in all lanes of the road section to be intervened are lower than a ninth set threshold, determine that an accident has occurred or that congestion has been caused by lane narrowing; and when it is determined that an accident has occurred, identify the cause of the accident.

[0010] In some exemplary embodiments, determining the intervention method includes: Determine whether there is an on-duty vehicle in the opposite lane or the same-direction lane, and determine the time it takes for the on-duty vehicle to arrive at the road section to be intervened; Obtain the location information of the organization in the road section to be intervened, and determine the time it takes for the organization to arrive at the road section to be intervened; Based on the cause of congestion and the time it takes for on-duty vehicles and agencies to arrive at the section to be intervened, it is determined whether the agency or on-duty vehicle will intervene, and information on the cause of the accident, intervention method, and route will be sent to the agency or on-duty vehicle to intervene in the congestion on the section to be intervened.

[0011] According to a second aspect of the present application, a highway emergency event coordination and control device is provided, comprising: A collection unit, used for collecting images of lanes in different sections of the expressway; A first recognition unit, used to recognize the image and obtain at least the driving condition information of the lane; A first determination unit is used to determine, based on the driving condition, that a vehicle speed in a lane is lower than a first threshold, or a vehicle density exceeds a second threshold, or a distance between vehicles in multiple lanes is less than a third threshold; and determine that a traffic intervention is required for a corresponding section of the expressway; A second identification unit is used to identify the cause of congestion based on the image of the road section to be intervened; A second determination unit is used to determine the intervention method according to the location information of the road section to be intervened and the cause of congestion; The notification unit is used to notify each local unit of each intervention method according to the intervention method of the road section to be intervened, and each unit intervenes in the traffic mode of the expressway according to the intervention method.

[0012] In some exemplary embodiments, the first identification unit is further configured to: When it is determined that the speeds of two or more vehicles in adjacent lanes are similar and the distance between the two or more vehicles is less than the fourth threshold, and the duration exceeds the fifth threshold, it is determined that the road section is congested due to vehicles running in parallel and with speeds lower than the set threshold.

[0013] In some exemplary embodiments, the first identification unit is further configured to: Extracting second feature points in the vehicle image, and determining a contour area of ​​the vehicle based on the second feature points; Extracting an image of the vehicle based on the contour area of ​​the vehicle, and sending the image of the vehicle to a traffic system via wireless communication to trigger the traffic system to perform image comparison based on the image of the vehicle to determine vehicle type information of the vehicle; The vehicle type information sent by the traffic system is received.

[0014] The highway emergency coordination and control method and device of the present application collects images of vehicles traveling in all lanes in the monitored section through an image acquisition unit to identify sections that may be congested and use them as sections to be intervened. For example, when the vehicle speed in some lanes in some sections is low, the vehicle density is high, or the distance between vehicles is small, it is considered that the highway section needs human intervention. The present application will determine the intervention method according to the cause of congestion, directly combine the distribution of units, whether the on-duty vehicle can turn around and intervene in the section to be intervened, etc., determine the intervention plan, and hand it over to the organization for congestion intervention, so as to minimize the congestion possibility of the highway. The present application automatically obtains the vehicle driving conditions of the relevant sections based on image recognition technology, and can automatically determine the intervention method based on the specific recognition results, which greatly reduces the possibility of congestion on the highway, improves its traffic efficiency, and resolves possible congestion at the initial stage, which ensures the traffic efficiency of the highway and reduces the accident rate. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 A schematic diagram of the process of the highway emergency coordination and control method according to an embodiment of the present application; Figure 2 This is a schematic diagram of the structure of a highway emergency coordination and control device according to an embodiment of the present application; Figure 3 A schematic diagram of the structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0016] Various aspects and features of the present application are described herein with reference to the accompanying drawings.

[0017] It should be understood that various modifications may be made to the embodiments of the present application. Therefore, the above description should not be considered as limiting, but only as an example of an embodiment. Other modifications within the scope and spirit of the present application will occur to those skilled in the art.

[0018] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the present application and, together with the general description of the present application given above and the detailed description of the embodiments given below, serve to explain the principles of the present application.

[0019] These and other characteristics of the present application will become apparent from the following description of a preferred form of embodiment given as a non-limiting example with reference to the accompanying drawings.

[0020] It should also be understood that although the present application has been described with reference to some specific examples, those skilled in the art will be able to readily implement many other equivalent forms of the present application.

[0021] The above and other aspects, features and advantages of the present application will become more apparent in view of the following detailed description when taken in conjunction with the accompanying drawings.

[0022] Specific embodiments of the present application are described hereinafter with reference to the accompanying drawings; however, it should be understood that the embodiments applied for are merely examples of the present application, which may be implemented in a variety of ways. Well-known and / or repeated functions and structures are not described in detail to avoid unnecessary or redundant details that obscure the present application. Therefore, the specific structural and functional details applied for herein are not intended to be limiting, but merely to teach those skilled in the art to use the present application in a variety of ways with substantially any suitable detailed structure.

[0023] This specification may use the phrases "in one embodiment," "in another embodiment," "in yet another embodiment," or "in other embodiments," all of which may refer to one or more of the same or different embodiments according to the present application.

[0024] Figure 1 Schematic diagram of the process of the highway emergency coordination and control method of the embodiment of the present application, such as Figure 1 As shown, the highway emergency event coordination and control method of the embodiment of the present application includes the following processing steps: Step 101 , in response to images of lanes collected from different sections of a highway, the images are recognized to at least obtain driving condition information of the lanes.

[0025] In the embodiment of the present application, a camera is installed on a height limit pole or a traffic light frame to collect images of vehicle driving conditions on a set road section. After collecting images of vehicle driving conditions, the collected images are identified to obtain information on vehicle driving conditions in different lanes on the road section.

[0026] In an embodiment of the present application, as an implementation method, feature points in an image are acquired, and corresponding vehicle information is determined based on the feature points; the relative position relationship between vehicles at different time points and the driving speed of the vehicles are determined based on the vehicle information; and the driving condition information of different lanes is determined based on the relative position relationship between vehicles, the change in the relative position relationship and the speed. In an embodiment of the present application, the information of the vehicle can be determined based on the shape of the vehicle, the difference between the lane color and the color of the vehicle, or based on the license plate image of the vehicle, and the relative position relationship between vehicles at different acquisition times, the change in the relative position relationship and the speed are determined based on the position change information of the vehicle and the time taken for the position change. In an embodiment of the present application, the driving information of the vehicle can also be determined by identifying the license plate number of the vehicle, and the license plate can be associated with the vehicle to more accurately determine the driving condition of the vehicle.

[0027] Step 102, based on the driving conditions, determine that the vehicle speed in the lane is lower than a first threshold, or the vehicle density exceeds a second threshold, or the distance between vehicles in multiple lanes is less than a third threshold; determine that traffic intervention is required on the corresponding section of the highway.

[0028] In the embodiment of the present application, the speed of the vehicle is determined based on the maximum speed limit of the expressway, and the first threshold value may be 80 km / hour, 70 km / hour, or 60 km / hour, etc. The vehicle density may be determined based on the number of vehicles in the captured image. For example, if a highway with a maximum speed limit of 120 km / hour is taken as an example, if there are 100 vehicles in the normal viewing range, when the number of vehicles in the viewing range reaches 300 or more, it is considered that congestion has occurred or may cause congestion. The second threshold value is set according to the viewing range of the camera, the number of lanes, and the speed limit, and may be 300, 350, or 400, etc. The third threshold value may be 1 meter, 2 meters, 5 meters, or 10 meters, etc.

[0029] Step 103, identifying the cause of congestion based on the collected image of the road section to be intervened.

[0030] In the embodiment of the present application, when it is determined that the speeds of two or more vehicles in adjacent lanes are similar, and the distance between the two or more vehicles is less than the fourth threshold value, and the duration exceeds the fifth threshold value, it is determined that the road section is congested due to the parallel vehicles and the speed is lower than the set threshold. By identifying the collected image, if it is determined that there are two or more vehicles in the adjacent lanes, their speeds are similar, and the interval between the two or more vehicles is less than the set distance, such as less than 5 meters, it is determined that the vehicles in the different lanes are traveling in parallel. If there is a situation where overtaking fails or unconscious parallel driving occurs, this situation may cause congestion in the road section for highways with fewer lanes, and it is necessary to intervene in the relevant vehicles. In the embodiment of the present application, it is necessary to judge whether to intervene based on the driving situation. If it is caused by traffic jams in all lanes, it will be intervened according to other intervention methods of the embodiment of the present application. If the congestion is caused by parallel occupation of the road, it will be very necessary to intervene. Here, the duration of parallel driving needs to be considered. That is, if it is only an occasional situation, there is no need to intervene in driving behavior. If there is a long period of parallel occupation of the road, such as more than 10 minutes, the driving behavior of the relevant vehicles on the relevant road section should be intervened according to the current distribution of vehicles or organizations to avoid possible road congestion. Here, the fourth threshold can be 10 meters, 8 meters or 12 meters. The fifth threshold can be 10 minutes, 12 minutes or 15 minutes, etc.

[0031] As an implementation method, the method of identifying the cause of congestion based on collecting images of the road section to be intervened may also include: determining that when two or more vehicles in the same lane have similar speeds and the distance between the two or more vehicles is less than a sixth threshold, and the duration exceeds a seventh threshold, it is determined that the lane is congested due to the series of vehicles and the short distance between vehicles.

[0032] In the embodiment of the present application, when it is determined that the distance between vehicles in the passing vehicles is small and they keep driving in the same direction for a long time, intervention is also required. Especially on highways with fewer lanes, when the distance between vehicles in the same direction is close and they drive at the same speed, it may cause other vehicles to change lanes unfavorably, thus causing road congestion. In particular, the distance between multiple vehicles driving in the same direction is short, and it is easy for them to drive parallel with vehicles in other lanes. In this case, it is necessary to intervene in the driving behavior of vehicles driving in the same direction with a small distance to avoid their driving behavior in the same direction with a small distance for a long time.

[0033] In the embodiment of the present application, the fifth threshold may be 20 meters, 15 meters or 30 meters, etc., and the sixth threshold may be 10 minutes, 8 minutes, 5 minutes or 15 minutes.

[0034] Step 104, determining the intervention method according to the location information of the road section to be intervened and the cause of congestion.

[0035] In the embodiment of the present application, relevant vehicles in the same lane or adjacent lanes are identified, and reminder information is generated to prompt the vehicle to speed up and increase the distance between vehicles, or reminder information is generated to prompt the relevant vehicles to change lanes. According to the location information of the road section, the reminder information is output through the vehicle driving reminder sign or voice broadcast system in the direction of the vehicle and the nearest reminder sign or voice broadcast system. In the embodiment of the present application, the voice broadcast system set beside the highway can directly output voice prompt information to the relevant vehicles traveling in the same lane or parallel lane in the road section to be intervened, directly prompting them to change lanes or speed up. Specifically, according to the driving section and driving speed of the vehicle, the prompt information can be directly sent to the voice broadcast system in the direction of the vehicle, and the voice intervention information can be directly output to intervene in lane driving. Or through the output display screen on the vehicle's route, the relevant information prompting it to change lanes or speed up is output to the relevant vehicle.

[0036] In the embodiment of the present application, as an implementation method, according to the location information of the section to be intervened, it is determined whether there is a duty vehicle in the reverse lane, and the distance from the section to be intervened is less than the eighth threshold, and a prompt message is sent to the duty vehicle to prompt the relevant vehicle to change lanes, change the distance between vehicles or speed up, so that the duty vehicle intervenes in the relevant vehicle. Due to the particularity of the highway, when the section is congested, it is difficult for the rear vehicle to reach the congested section, especially the congested core section. At this time, the reverse vehicle or the reverse traffic agency can take the reverse arrival or turn on the U-turn device on the highway to reach the congested section as soon as possible. However, the current highway congestion method generally does not find congestion. When it is found, it is generally quite serious and difficult to intervene. However, the embodiment of the present application uses image recognition technology to determine the possible congested sections in advance, and through pre-intervention, the congestion is minimized, and the possible congestion is eliminated in the bud to avoid serious congestion. In addition, by taking advantage of the characteristics of highway road closures, we can intervene in possible congested sections as early as possible by reversing or calling on reverse agencies to avoid congestion.

[0037] Step 105, according to the intervention method of the road section to be intervened, each intervention method is notified to each local unit respectively, and each unit intervenes in the traffic mode of the expressway according to the intervention method.

[0038] In the embodiment of the present application, the unit can be a highway management structure or a local transportation department. The embodiment of the present application does not consider the administrative relationship between the transportation unit and the congested road section, but only considers the distance between the unit and the road section to be intervened, and the possible route and time for the unit to reach the road section to be intervened.

[0039] In the embodiment of the present application, it is determined that the speed of vehicles in all lanes of the road section to be intervened is lower than the ninth set threshold, and it is determined that an accident has occurred or congestion has been caused by lane narrowing; when it is determined that an accident has occurred, the cause of the accident is identified. Here, the ninth threshold can be 30Km / hour, 25Km / hour, etc. When it is determined that the speed of vehicles in all lanes is low, it is determined that an accident has occurred. At this time, it is necessary to collect relevant information about the accident vehicle. First, the severity of the accident is determined by automatic identification, and the accident situation is sent to the traffic system through a wireless communication antenna. According to the severity of the accident, the nearest agency or on-duty vehicle that can intervene in the traffic accident is determined, so that the traffic accident vehicle can be assisted to leave the scene as soon as possible in the most effective intervention method, and the rescue or ambulance vehicle arrives at the scene of the accident as soon as possible to avoid more serious consequences caused by the accident.

[0040] In an embodiment of the present application, it is determined whether there is an on-duty vehicle in the opposite lane or the same-direction lane, and the time it takes for the on-duty vehicle to arrive at the section to be intervened is determined; the location information of the agency in the section to be intervened is obtained, and the time it takes for the agency to arrive at the section to be intervened is determined; based on the cause of congestion and the time it takes for the on-duty vehicle and the agency to arrive at the section to be intervened, it is determined whether the agency will intervene or the on-duty vehicle will intervene, and the cause of the accident, the intervention method, and the information of the route of travel are sent to the agency or the on-duty vehicle to intervene in the section to be intervened. In an embodiment of the present application, the arrival time of the vehicle or agency when intervening in the section to be intervened can be determined through an electronic map such as a navigation map, so as to determine which vehicle or agency will intervene in the section to be intervened. When there are many sections to be intervened, the intervention method and intervention order can be sent to the same agency or on-duty vehicle to actively reduce the possibility of congestion on the highway.

[0041] The embodiment of the present application uses an image acquisition unit to collect images of vehicles traveling in all lanes in the monitored section to identify sections that may be congested and use them as sections to be intervened. For example, when the vehicle speed in certain lanes in certain sections is low, the vehicle density is high, or the distance between vehicles is small, it is considered that the highway section needs human intervention. The present application will determine the intervention method based on the cause of congestion, directly combine the distribution of units, whether the on-duty vehicle can turn around and intervene in the section to be intervened, etc., determine the intervention plan, and hand it over to the organization for congestion intervention, so as to minimize the congestion possibility of the highway. The present application automatically obtains the vehicle driving conditions of the relevant sections based on image recognition technology, and can automatically determine the intervention method based on the specific recognition results, which greatly reduces the possibility of congestion on the highway, improves its traffic efficiency, and resolves possible congestion at the initial stage, that is, it ensures the traffic efficiency of the highway and reduces the accident rate.

[0042] Figure 2 Schematic diagram of the structure of the highway emergency coordination and control device according to the embodiment of the present application. Figure 2 As shown, the highway emergency event coordination and control device of the embodiment of the present application includes: A collection unit 20, used to collect images of lanes in different sections of the highway; A first recognition unit 21 is used to recognize the image and at least obtain the driving condition information of the lane; The first determination unit 22 is used to determine, based on the driving conditions, that a vehicle speed in a lane is lower than a first threshold, or a vehicle density exceeds a second threshold, or a distance between vehicles in multiple lanes is less than a third threshold; and determine that a traffic intervention is required for a corresponding section of the highway; A second identification unit 23, configured to identify the cause of congestion based on the image of the road section to be intervened; A second determination unit 24 is used to determine the intervention method according to the location information of the road section to be intervened and the cause of congestion; The notification unit 25 is used to notify each local unit of each intervention method according to the intervention method of the road section to be intervened, and each unit intervenes in the traffic mode of the expressway according to the intervention method.

[0043] In some exemplary embodiments, the first identification unit 21 is further configured to: When it is determined that the speeds of two or more vehicles in adjacent lanes are similar and the distance between the two or more vehicles is less than the fourth threshold, and the duration exceeds the fifth threshold, it is determined that the road section is congested due to vehicles running in parallel and with speeds lower than the set threshold.

[0044] In some exemplary embodiments, the first identification unit 21 is further configured to: Extracting second feature points in the vehicle image, and determining a contour area of ​​the vehicle based on the second feature points; Extracting an image of the vehicle based on the contour area of ​​the vehicle, and sending the image of the vehicle to a traffic system via wireless communication to trigger the traffic system to perform image comparison based on the image of the vehicle to determine vehicle type information of the vehicle; The vehicle type information sent by the traffic system is received.

[0045] In some exemplary embodiments, the second identification unit 23 is also used to determine that when two or more vehicles in the same lane have similar speeds and the distance between the two or more vehicles is less than a sixth threshold, and the duration exceeds a seventh threshold, it is determined that the lane is congested due to the series of vehicles and the short distance between them.

[0046] In some exemplary embodiments, the second identification unit 23 is also used to determine that when the speeds of two or more vehicles in adjacent lanes are similar and the distance between the two or more vehicles is less than a fourth threshold, and the duration exceeds a fifth threshold, it is determined that the road section is congested due to vehicles running in parallel and with speeds lower than a set threshold.

[0047] In some exemplary embodiments, the second determination unit 24 is further used to identify related vehicles in the same lane or adjacent lanes, generate reminder information prompting the vehicle to speed up and increase the driving distance, or generate reminder information prompting the related vehicle to change lanes, and output the reminder information through the vehicle driving reminder sign or voice broadcast system in the direction of the vehicle and the nearest reminder sign or voice broadcast system according to the position information of the road section; Alternatively, based on the position information of the road section to be intervened, determine whether there is a duty vehicle in the opposite lane, and the distance from the road section to be intervened is less than the eighth threshold, and send a prompt message to the duty vehicle to prompt the relevant vehicles to change lanes, change the distance between vehicles or speed up, so that the duty vehicle intervenes in the relevant vehicles.

[0048] In some exemplary embodiments, the second identification unit 23 is also used to determine that the vehicle speed in all lanes of the road section to be intervened is lower than a ninth set threshold, and to determine that an accident has occurred or congestion has occurred due to lane narrowing; when it is determined that an accident has occurred, the cause of the accident is identified.

[0049] In some exemplary embodiments, the second determining unit 24 is further configured to: Determine whether there is an on-duty vehicle in the opposite lane or the same-direction lane, and determine the time it takes for the on-duty vehicle to arrive at the road section to be intervened; Obtain the location information of the organization in the road section to be intervened, and determine the time it takes for the organization to arrive at the road section to be intervened; Based on the cause of congestion and the time it takes for on-duty vehicles and agencies to arrive at the section to be intervened, it is determined whether the agency or on-duty vehicle will intervene, and information on the cause of the accident, intervention method, and route will be sent to the agency or on-duty vehicle to intervene in the congestion on the section to be intervened.

[0050] In an exemplary embodiment, the aforementioned units and the like may be implemented by one or more central processing units (CPU), graphics processing units (GPU), application specific integrated circuits (ASIC), DSPs, programmable logic devices (PLD), complex programmable logic devices (CPLD), field programmable gate arrays (FPGA), general-purpose processors, controllers, microcontrollers (MCU), microprocessors, or other electronic components.

[0051] Regarding the device in the above embodiment, the specific manner in which each module and unit performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0052] The technical solution of the embodiment of the present application uses an image acquisition module to collect images of respective acquisition areas, and then performs person object recognition on the collected images to determine the relevant person objects in the images, and obtains their identity information by obtaining the biological characteristics. The display content of the display unit is determined based on its identity information, so that the corresponding display content is displayed through different display units, so that different visitors can be shown the content they are concerned about based on their own needs. The embodiment of the present application can determine the display content for the visitor based on his or her identity and points of interest, thereby improving the experience of the visitor and the exhibition display effect.

[0053] Figure 3 Schematic diagram of the structure of the electronic device according to the embodiment of the present application. Figure 3 As shown, the electronic device 800 supports multi-screen output, and the electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0054] The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0055] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0056] The power component 806 provides power to the various components of the electronic device 800. The power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 800.

[0057] The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0058] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the electronic device 800 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0059] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0060] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the electronic device 800. For example, the sensor assembly 814 can detect the open / closed state of the device 800, the relative positioning of components, such as the display and keypad of the electronic device 800, and the sensor assembly 814 can also detect the position change of the electronic device 800 or a component of the electronic device 800, the presence or absence of contact between the user and the electronic device 800, the orientation or acceleration / deceleration of the electronic device 800, and the temperature change of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0061] The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as Wi-Fi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0062] In an exemplary embodiment, the electronic device 800 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to execute the steps of the booth-based highway emergency coordination and control method of the above-mentioned embodiment.

[0063] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, and the instructions can be executed by a processor 820 of an electronic device 800 to complete the steps of the highway emergency coordination and control method of the above embodiment. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0064] The embodiment of the present application also records a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the steps of the highway emergency event coordination and control method of the embodiment are implemented.

[0065] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present invention. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present invention, the size of the sequence number of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The above-mentioned sequence numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments.

[0066] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0067] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or do not exist.

[0068] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0069] The above description is only an implementation mode of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.

Claims

1. A method for coordinating and controlling emergency events on a highway, characterized in that: The method comprises: In response to images of lanes collected at different sections of the highway, the images are recognized to obtain at least driving condition information of the lanes; Based on the driving conditions, determining that the speed of vehicles in the lane is lower than a first threshold, or the vehicle density exceeds a second threshold, or the spacing between vehicles in multiple lanes is less than a third threshold; determining that a traffic intervention is required for the corresponding section of the expressway; Identify the cause of congestion based on the images collected on the road section to be intervened; Determine the intervention method based on the location information of the road section to be intervened and the cause of congestion; According to the intervention method of the road section to be intervened, each intervention method will be notified to each local unit respectively, and each unit will intervene in the traffic mode of the expressway according to the intervention method.

2. The highway emergency coordination and control method according to claim 1 is characterized in that: The step of recognizing the image to at least obtain the driving condition information of the lane includes: Acquire feature points in the image, and determine corresponding vehicle information based on the feature points; Determine the relative position relationship between vehicles at different time points and the driving speed of the vehicles based on vehicle information; Based on the relative position relationship between vehicles, changes in the relative position relationship and vehicle speed, the driving condition information of different lanes is determined.

3. The highway emergency coordination and control method according to claim 1 is characterized in that: The method of identifying the cause of congestion based on collecting images of the road section to be intervened includes: When it is determined that the speeds of two or more vehicles in adjacent lanes are similar and the distance between the two or more vehicles is less than the fourth threshold, and the duration exceeds the fifth threshold, it is determined that the road section is congested due to vehicles running in parallel and with speeds lower than the set threshold.

4. The highway emergency coordination and control method according to claim 1 is characterized in that: The method of identifying the cause of congestion based on collecting images of the road section to be intervened includes: When it is determined that two or more vehicles in the same lane have similar speeds and the distance between the two or more vehicles is less than the sixth threshold, and the duration exceeds the seventh threshold, it is determined that the lane is congested due to the series of vehicles and the short distance between them.

5. The highway emergency coordination and control method according to claim 3 or 4, characterized in that: The intervention methods described include: Identify relevant vehicles in the same lane or adjacent lanes, generate reminder information to prompt the vehicle to speed up and increase the driving distance, or generate reminder information to prompt relevant vehicles to change lanes, and output reminder information through vehicle driving reminder signs or voice broadcast systems in the direction of the vehicle and the nearest reminder sign or voice broadcast system according to the location information of the road section; Alternatively, based on the position information of the road section to be intervened, determine whether there is a duty vehicle in the opposite lane, and the distance from the road section to be intervened is less than the eighth threshold, and send a prompt message to the duty vehicle to prompt the relevant vehicles to change lanes, change the distance between vehicles or speed up, so that the duty vehicle intervenes in the relevant vehicles.

6. The highway emergency coordination and control method according to claim 1 is characterized in that: The method of identifying the cause of congestion based on collecting images of the road section to be intervened includes: Determine that the vehicle speeds in all lanes of the road section to be intervened are lower than a ninth set threshold, determine that an accident has occurred or that congestion has been caused by lane narrowing; and when it is determined that an accident has occurred, identify the cause of the accident.

7. The highway emergency coordination and control method according to claim 6 is characterized in that: The intervention methods described include: Determine whether there is an on-duty vehicle in the opposite lane or the same-direction lane, and determine the time it takes for the on-duty vehicle to arrive at the road section to be intervened; Obtain the location information of the organization in the road section to be intervened, and determine the time it takes for the organization to arrive at the road section to be intervened; Based on the cause of congestion and the time it takes for on-duty vehicles and agencies to arrive at the section to be intervened, it is determined whether the agency or on-duty vehicle will intervene, and information on the cause of the accident, intervention method, and route will be sent to the agency or on-duty vehicle to intervene in the congestion on the section to be intervened.

8. A highway emergency coordination and control device, characterized in that: The device comprises: A collection unit, used for collecting images of lanes in different sections of the expressway; A first recognition unit, used to recognize the image and obtain at least the driving condition information of the lane; A first determination unit is used to determine, based on the driving condition, that a vehicle speed in a lane is lower than a first threshold, or a vehicle density exceeds a second threshold, or a distance between vehicles in multiple lanes is less than a third threshold; and determine that a traffic intervention is required for a corresponding section of the expressway; A second identification unit is used to identify the cause of congestion based on the image of the road section to be intervened; A second determination unit is used to determine the intervention method according to the location information of the road section to be intervened and the cause of congestion; The notification unit is used to notify each local unit of each intervention method according to the intervention method of the road section to be intervened, and each unit intervenes in the traffic mode of the expressway according to the intervention method.

9. The highway emergency coordination and control device according to claim 8, characterized in that: The first identification unit is further used for: When it is determined that the speeds of two or more vehicles in adjacent lanes are similar and the distance between the two or more vehicles is less than the fourth threshold, and the duration exceeds the fifth threshold, it is determined that the road section is congested due to vehicles running in parallel and with speeds lower than the set threshold.

10. The highway emergency coordination and control device according to claim 8, characterized in that: The first identification unit is further used for: Extracting second feature points in the vehicle image, and determining a contour area of ​​the vehicle based on the second feature points; Extracting an image of the vehicle based on the contour area of ​​the vehicle, and sending the image of the vehicle to a traffic system via wireless communication to trigger the traffic system to perform image comparison based on the image of the vehicle to determine vehicle type information of the vehicle; The vehicle type information sent by the traffic system is received.

Images