Method and device for coordinating and controlling highway emergency events

Abstract

This application relates to road traffic congestion relief technology and discloses a method and apparatus for coordinating and controlling emergency events on highways, comprising: capturing lane images from different sections of a highway, identifying the images, and obtaining at least lane traffic condition information; determining, based on the traffic conditions, whether the vehicle speed in the lane is below a first threshold, or the vehicle density exceeds a second threshold, or the spacing between vehicles in multiple lanes is less than a third threshold; determining that traffic intervention is required on the corresponding section of the highway; identifying the cause of congestion based on the captured images of the section to be intervened; determining an intervention method based on the location information and the cause of congestion of the section to be intervened; and notifying each local unit of the intervention method based on the intervention method for the section to be intervened, and having each unit intervene in the traffic on the highway according to the intervention method. This application ensures highway traffic efficiency and reduces the accident rate.

Description

Technical Field

[0001] The present application relates to road traffic congestion relief technology, and in particular to a method and device for coordinating and controlling emergency events on highways. Background Art

[0002] Currently, unexpected situations frequently occur on highways, such as traffic accidents that block lanes, or lanes occupied for extended periods by slow-speed vehicles, resulting in congestion caused by multiple vehicles traveling side by side. This reduces highway efficiency and leads to traffic jams. Due to the closed nature of highways, conventional traffic diversion methods are often difficult to manage. In particular, when an accident causes a severe traffic jam, it is often difficult to intervene in the same direction, resulting in not only delayed traffic diversion but also, in severe cases, casualties. Summary of the Invention

[0003] In view of this, the present application proposes a method and device for coordinating and controlling emergency events on highways to solve the problem in the prior art of being unable to respond in a timely manner to emergency events occurring on highways.

[0004] According to a first aspect of the present application, a method for coordinating and controlling highway emergency events is provided, comprising:

[0005] In response to images of lanes collected at different sections of the highway, the images are recognized to obtain at least driving condition information of the lanes;

[0006] Based on the driving conditions, determining that a vehicle speed in a lane is lower than a first threshold, or a vehicle density exceeds a second threshold, or a spacing between vehicles in multiple lanes is less than a third threshold; and determining that a traffic intervention is required on the corresponding section of the highway;

[0007] Identify the cause of congestion based on the collected images of the road section to be intervened;

[0008] Determine the intervention method based on the location information of the road section to be intervened and the cause of congestion;

[0009] According to the intervention method of the road section to be intervened, each intervention method will be notified to each local unit respectively, and each unit will intervene in the traffic mode of the expressway according to the intervention method.

[0010] In some exemplary embodiments, recognizing the image to obtain at least lane driving condition information includes:

[0011] Acquire feature points in the image, and determine corresponding vehicle information based on the feature points;

[0012] Determine the relative position relationship between vehicles at different time points and the driving speed of the vehicles based on vehicle information;

[0013] Based on the relative position relationship between vehicles, changes in relative position relationship and vehicle speed, the driving condition information of different lanes is determined.

[0014] In some exemplary embodiments, the step of identifying the cause of congestion based on collecting images of the road section to be intervened includes:

[0015] When it is determined that the speeds of two or more vehicles in adjacent lanes are similar and the distance between the two or more vehicles is less than the fourth threshold, and the duration exceeds the fifth threshold, it is determined that the road section is congested due to vehicles running in parallel and with speeds lower than the set threshold.

[0016] In some exemplary embodiments, the step of identifying the cause of congestion based on collecting images of the road section to be intervened includes:

[0017] When it is determined that two or more vehicles in the same lane have similar speeds and the distance between the two or more vehicles is less than the sixth threshold, and the duration exceeds the seventh threshold, it is determined that the lane is congested due to the series of vehicles and the short distance between them.

[0018] In some exemplary embodiments, determining the intervention method includes:

[0019] Identify relevant vehicles in the same lane or adjacent lanes and generate reminders prompting vehicles to speed up and increase driving distance, or generate reminders prompting relevant vehicles to change lanes. Based on the location information of the road section, the reminder information is output through the vehicle driving reminder sign or voice broadcast system, and is output in the direction of the vehicle's travel and the nearest reminder sign or voice broadcast system;

[0020] Alternatively, based on the location information of the road section to be intervened, determine whether there is a duty vehicle in the opposite lane, and the distance from the road section to be intervened is less than the eighth threshold, and send a prompt message to the duty vehicle to prompt the relevant vehicle to change lanes, change the distance between vehicles or speed up, so that the duty vehicle intervenes in the relevant vehicle.

[0021] In some exemplary embodiments, the step of identifying the cause of congestion based on collecting images of the road section to be intervened includes:

[0022] Determine that the vehicle speeds in all lanes of the road section to be intervened are lower than a ninth set threshold, determine that an accident has occurred or that congestion has been caused by lane narrowing; and when it is determined that an accident has occurred, identify the cause of the accident.

[0023] In some exemplary embodiments, determining the intervention method includes:

[0024] Determine whether there is an on-duty vehicle in the opposite lane or the same-direction lane, and determine the time it takes for the on-duty vehicle to arrive at the road section to be intervened;

[0025] Obtain the location information of the agency within the road section to be intervened and determine the time it takes for the agency to arrive at the road section to be intervened;

[0026] Based on the cause of congestion and the time it takes for on-duty vehicles and agencies to arrive at the road section to be intervened, it is determined whether the agency or on-duty vehicle will intervene, and information about the cause of the accident, intervention method, and route will be sent to the agency or on-duty vehicle to intervene in the congestion on the road section to be intervened.

[0027] According to a second aspect of the present application, a highway emergency coordination and control device is provided, comprising:

[0028] An acquisition unit, used for acquiring images of lanes in different sections of the highway;

[0029] a first recognition unit, configured to recognize the image and obtain at least lane driving condition information;

[0030] a first determining unit configured to determine, based on the driving condition, that a vehicle speed in a lane is lower than a first threshold, or a vehicle density exceeds a second threshold, or a distance between vehicles in multiple lanes is less than a third threshold; and determine that a traffic intervention is required on the corresponding section of the expressway;

[0031] A second recognition unit is used to identify the cause of congestion based on the image of the road section to be intervened;

[0032] The second determining unit is used to determine the intervention method according to the location information of the road section to be intervened and the cause of congestion;

[0033] The notification unit is used to notify each local unit of each intervention method according to the intervention method of the road section to be intervened, and each unit intervenes in the traffic mode of the expressway according to the intervention method.

[0034] In some exemplary embodiments, the first recognition unit is further configured to:

[0035] When it is determined that the speeds of two or more vehicles in adjacent lanes are similar and the distance between the two or more vehicles is less than the fourth threshold, and the duration exceeds the fifth threshold, it is determined that the road section is congested due to vehicles running in parallel and with speeds lower than the set threshold.

[0036] In some exemplary embodiments, the first recognition unit is further configured to:

[0037] extracting second feature points from the vehicle image, and determining a contour area of ​​the vehicle based on the second feature points;

[0038] Extracting an image of the vehicle based on a contour area of ​​the vehicle, and transmitting the image of the vehicle to a traffic system via wireless communication to trigger the traffic system to perform image comparison based on the image of the vehicle to determine vehicle type information of the vehicle;

[0039] Receive vehicle type information sent by the traffic system.

[0040] The highway emergency coordination and control method and device of the present application uses an image acquisition unit to collect images of vehicles traveling in all lanes of a monitored section to identify sections that may be congested and use them as sections to be intervened. For example, when the vehicle speed in certain lanes of certain sections is low, the vehicle density is high, or the distance between vehicles is small, it is considered that the highway section requires human intervention. The present application will determine the intervention method based on the cause of the congestion, directly combining the distribution of units, whether the on-duty vehicle can turn around and intervene in the section to be intervened, etc., to determine the intervention plan and hand it over to the agency for congestion intervention, thereby minimizing the possibility of congestion on the highway. The present application uses image recognition technology to automatically obtain the vehicle driving conditions of the relevant sections and can automatically determine the intervention method based on the specific recognition results, greatly reducing the possibility of congestion on the highway, improving its traffic efficiency, and resolving possible congestion at the initial stage, thereby ensuring the traffic efficiency of the highway and reducing the accident rate. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 A flowchart of a method for coordinating and controlling highway emergency events according to an embodiment of the present application;

[0042] Figure 2 This is a schematic diagram of the structure of a highway emergency coordination and control device according to an embodiment of the present application;

[0043] Figure 3 This is a schematic diagram of the composition structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0044] Various aspects and features of the present application are described herein with reference to the accompanying drawings.

[0045] It should be understood that various modifications may be made to the embodiments of the present application. Therefore, the above description should not be considered as limiting, but merely as an example of an embodiment. Other modifications within the scope and spirit of the present application will occur to those skilled in the art.

[0046] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the present application and, together with the general description of the present application given above and the detailed description of the embodiments given below, serve to explain the principles of the present application.

[0047] These and other characteristics of the present application will become apparent from the following description of a preferred form of embodiment given as a non-limiting example with reference to the accompanying drawings.

[0048] It should also be understood that although the present application has been described with reference to certain specific examples, those skilled in the art will readily be able to implement many other equivalent forms of the present application.

[0049] The above and other aspects, features and advantages of the present application will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings.

[0050] Specific embodiments of the present application will be described below with reference to the accompanying drawings; however, it should be understood that the embodiments described are merely examples of the present application and may be implemented in a variety of ways. Well-known and / or repetitive functions and structures are not described in detail to avoid obscuring the present application with unnecessary or redundant detail. Therefore, the specific structural and functional details described herein are not intended to be limiting, but rather to teach those skilled in the art to variously utilize the present application with substantially any suitable detailed structure.

[0051] This specification may use the phrases "in one embodiment," "in another embodiment," "in yet another embodiment," or "in other embodiments," which may all refer to one or more of the same or different embodiments according to the present application.

[0052] Figure 1 This is a flow chart of the highway emergency event coordination and control method according to an embodiment of the present application. Figure 1 As shown, the highway emergency coordination and control method of the embodiment of the present application includes the following processing steps:

[0053] Step 101 : In response to images of lanes collected from different sections of a highway, the images are recognized to obtain at least driving condition information of the lanes.

[0054] In the embodiment of the present application, a camera installed on a height limit pole or a traffic light tower is used to capture images of vehicle driving conditions on a set road section. After the images of vehicle driving conditions are captured, the captured images are recognized to obtain information about the vehicle driving conditions in different lanes on the road section.

[0055] In an embodiment of the present application, as an implementation method, feature points in an image are acquired, and corresponding vehicle information is determined based on the feature points; the relative position relationship between vehicles at different time points, as well as the vehicle's driving speed, are determined based on the vehicle information; and the driving condition information of different lanes is determined based on the relative position relationship between vehicles, the change in the relative position relationship, and the vehicle speed. In an embodiment of the present application, the vehicle information can be determined based on the shape of the vehicle, the difference between the lane color and the vehicle color, or based on the license plate image of the vehicle, and the relative position relationship between vehicles at different acquisition times, the change in the relative position relationship, and the vehicle speed can be determined based on the vehicle's position change information and the time taken for the position change. In an embodiment of the present application, the vehicle's driving information can also be determined by identifying the vehicle's license plate number, and the license plate can be associated with the vehicle to more accurately determine the vehicle's driving condition.

[0056] Step 102: Based on the driving conditions, determine that the vehicle speed in the lane is lower than a first threshold, or the vehicle density exceeds a second threshold, or the distance between vehicles in multiple lanes is less than a third threshold; and determine that traffic intervention is required on the corresponding section of the highway.

[0057] In the embodiment of the present application, the vehicle's speed is determined based on the maximum speed limit of the highway. The first threshold value can be 80 km / h, 70 km / h, or 60 km / h, etc. The vehicle density can be determined based on the number of vehicles in the captured image. For example, if there are 100 vehicles in the normal viewing range of a highway with a maximum speed limit of 120 km / h, when the number of vehicles in the viewing range reaches 300 or more, it is considered that congestion has occurred or is likely to occur. The second threshold value is set based on the camera's viewing range, the number of lanes, and the speed limit, and can be 300, 350, or 400, etc. The third threshold value can be 1 meter, 2 meters, 5 meters, or 10 meters, etc.

[0058] Step 103: Identify the cause of congestion based on the collected image of the road section to be intervened.

[0059] In an embodiment of the present application, when it is determined that the speeds of two or more vehicles in adjacent lanes are similar, and the distance between the two or more vehicles is less than the fourth threshold value, and the duration exceeds the fifth threshold value, it is determined that the road section is congested due to vehicles running in parallel and the speed being lower than the set threshold. By identifying the collected image, if it is determined that there are two or more vehicles in adjacent lanes, their speeds are similar, and the distance between the two or more vehicles is less than the set distance, such as less than 5 meters, it is determined that the vehicles in the different lanes are traveling in parallel. If there is an unsuccessful overtaking or unconscious parallel driving, this situation may cause congestion in the road section for highways with fewer lanes, and it is necessary to intervene to relieve the relevant vehicles. In an embodiment of the present application, it is necessary to judge whether to intervene based on the driving situation. If it is caused by traffic jams in all lanes, intervention will be carried out according to other intervention methods of the embodiment of the present application. If the congestion is caused by parallel lane occupation, it will be very necessary to intervene. The duration of parallel driving needs to be considered. If it's only an occasional occurrence, no driver intervention is required. However, if parallel driving occurs for an extended period, such as more than 10 minutes, then intervention is required on the relevant road sections based on the current distribution of vehicles or organizations to avoid potential traffic congestion. The fourth threshold can be 10 meters, 8 meters, or 12 meters. The fifth threshold can be 10 minutes, 12 minutes, or 15 minutes, etc.

[0060] As an implementation method, the method of identifying the cause of congestion based on collecting images of the road section to be intervened can also include: determining that when the speeds of two or more vehicles in the same lane are similar and the distance between the two or more vehicles is less than a sixth threshold, and the duration exceeds a seventh threshold, it is determined that the lane is congested due to the series of vehicles and the short distance between vehicles.

[0061] In the embodiments of the present application, when it is determined that the spacing between vehicles in the traffic flow is small and they maintain the same direction for an extended period of time, intervention is also required. This is especially true on highways with fewer lanes. When vehicles traveling in the same direction are close together and at the same speed, this can hinder lane changes for other vehicles, leading to traffic congestion. In particular, when the spacing between multiple vehicles traveling in the same direction is short, it is very easy for them to run parallel to vehicles in other lanes. In this case, intervention is required for vehicles traveling in the same direction with close spacing to prevent them from continuing to travel in the same direction with close spacing for an extended period of time.

[0062] In the embodiment of the present application, the fifth threshold may be 20 meters, 15 meters or 30 meters, etc., and the sixth threshold may be 10 minutes, 8 minutes, 5 minutes or 15 minutes.

[0063] Step 104: Determine the intervention method based on the location information of the road section to be intervened and the cause of congestion.

[0064] In an embodiment of the present application, relevant vehicles in the same lane or adjacent lanes are identified, and a reminder message is generated prompting the vehicle to speed up and increase the distance between them, or a reminder message is generated prompting the relevant vehicle to change lanes. Based on the location information of the road section, the reminder message is output through a vehicle driving reminder sign or voice broadcast system, and is located in the direction of the vehicle and closest to the vehicle. In an embodiment of the present application, a voice broadcast system installed next to the highway can directly output voice prompts to relevant vehicles traveling in the same lane or parallel lanes on the road section to be intervened, directly prompting them to change lanes or increase speed. Specifically, based on the vehicle's driving section and driving speed, the prompt message can be sent directly to the voice broadcast system in the direction of the vehicle's travel, which can directly output voice intervention information to intervene in lane driving. Alternatively, relevant information prompting the relevant vehicle to change lanes or increase speed can be output to the output display screen on the vehicle's route.

[0065] In one embodiment of the present application, based on the location information of the road section to be intervened, it is determined whether there is an on-duty vehicle in the opposite lane, and whether the vehicle is on duty and the distance from the road section to be intervened is less than an eighth threshold. A prompt message is then sent to the on-duty vehicle, prompting the relevant vehicle to change lanes, change the distance between vehicles, or increase speed, so that the on-duty vehicle can intervene. Due to the special characteristics of highways, when a section is congested, it is difficult for the following vehicle to reach the congested section, especially the core congested section. In this case, the on-duty vehicle or the on-duty traffic agency can take the opposite route or activate the U-turn device on the highway to reach the congested section as soon as possible. However, current highway congestion methods generally do not detect congestion. When it is discovered, the congestion is usually quite severe and difficult to intervene. However, the embodiments of the present application use image recognition technology to pre-determine the possible congested sections. Through pre-emptive intervention, the congestion is minimized, eliminating possible congestion in the bud and preventing serious congestion from occurring. In addition, by taking advantage of the characteristics of highway road closures, we can intervene in possible congested sections as early as possible by reversing or calling reverse agencies to avoid congestion.

[0066] Step 105 , according to the intervention method of the road section to be intervened, each intervention method is respectively notified to each local unit, and each unit intervenes in the traffic mode of the expressway according to the intervention method.

[0067] In this embodiment of the application, the unit can be a highway management structure or a local transportation department. This embodiment of the application does not consider the administrative relationship between the transportation unit and the congested road section, but only considers the distance between the unit and the road section to be intervened, as well as the possible routes and time required for the unit to reach the road section to be intervened.

[0068] In the embodiment of the present application, it is determined that the speed of vehicles in all lanes of the road section to be intervened is lower than the ninth set threshold value, and it is determined that an accident has occurred or congestion has been caused by lane narrowing; when it is determined that an accident has occurred, the cause of the accident is identified. Here, the ninth threshold value can be 30 km / hour, 25 km / hour, etc. When it is determined that the speed of vehicles in all lanes is low, it is determined that an accident has occurred. At this time, it is necessary to collect relevant information about the accident vehicle. First, the severity of the accident is determined by automatic identification, and the accident situation is sent to the traffic system through a wireless communication antenna. According to the severity of the accident, the nearest agency or on-duty vehicle that can intervene in the traffic accident is determined, so that the traffic accident vehicle can be assisted to leave the scene as soon as possible in the most effective intervention manner, and the rescue or ambulance vehicle can arrive at the scene of the accident as soon as possible to avoid more serious consequences caused by the accident.

[0069] In an embodiment of the present application, it is determined whether there is an on-duty vehicle in the opposite lane or the same-direction lane, and the time it takes for the on-duty vehicle to arrive at the section to be intervened is determined; the location information of the agency in the section to be intervened is obtained, and the time it takes for the agency to arrive at the section to be intervened is determined; based on the cause of congestion and the time it takes for the on-duty vehicle and agency to arrive at the section to be intervened, it is determined whether the agency will intervene or the on-duty vehicle will intervene, and the cause of the accident, the intervention method, and the information on the route of travel are sent to the agency or the on-duty vehicle to intervene in the section to be intervened. In an embodiment of the present application, the arrival time of the vehicle or agency when intervening in the section to be intervened can be determined through an electronic map such as a navigation map, so as to determine which vehicle or agency will intervene in the section to be intervened. When there are many sections to be intervened, the intervention method and intervention order can be sent to the same agency or on-duty vehicle to actively reduce the possibility of congestion on the highway.

[0070] The embodiment of the present application uses an image acquisition unit to collect images of vehicles traveling in all lanes of a monitored road section to identify sections that may be congested and use them as sections to be intervened. For example, when the vehicle speed in certain lanes of certain sections is low, the vehicle density is high, or the distance between vehicles is small, it is considered that the highway section requires human intervention. The present application will determine the intervention method based on the cause of the congestion, directly combining the distribution of units, whether the on-duty vehicle can turn around and intervene in the section to be intervened, etc., to determine the intervention plan and hand it over to the agency for congestion intervention, thereby minimizing the possibility of congestion on the highway. The present application uses image recognition technology to automatically obtain the vehicle driving conditions of the relevant sections and can automatically determine the intervention method based on the specific recognition results, greatly reducing the possibility of congestion on the highway, improving its traffic efficiency, and resolving possible congestion at the initial stage, thereby ensuring the traffic efficiency of the highway and reducing the accident rate.

[0071] Figure 2 This is a schematic diagram of the structure of the highway emergency coordination and control device according to an embodiment of the present application. Figure 2As shown, the highway emergency coordination and control device of the embodiment of the present application includes:

[0072] an acquisition unit 20 for acquiring images of lanes of different sections of the highway;

[0073] A first recognition unit 21 is used to recognize the image and obtain at least the driving condition information of the lane;

[0074] a first determining unit 22 configured to determine, based on the driving conditions, whether a vehicle speed in a lane is lower than a first threshold, or a vehicle density exceeds a second threshold, or a distance between vehicles in multiple lanes is less than a third threshold, and determine that a traffic intervention is required on the corresponding section of the highway;

[0075] A second recognition unit 23 is configured to identify the cause of congestion based on the image of the road section to be intervened;

[0076] The second determining unit 24 is configured to determine an intervention method based on the location information of the road section to be intervened and the cause of congestion;

[0077] The notification unit 25 is used to notify each local unit of the intervention method according to the intervention method of the road section to be intervened, and each unit intervenes in the traffic mode of the expressway according to the intervention method.

[0078] In some exemplary embodiments, the first recognition unit 21 is further configured to:

[0079] When it is determined that the speeds of two or more vehicles in adjacent lanes are similar and the distance between the two or more vehicles is less than the fourth threshold, and the duration exceeds the fifth threshold, it is determined that the road section is congested due to vehicles running in parallel and with speeds lower than the set threshold.

[0080] In some exemplary embodiments, the first recognition unit 21 is further configured to:

[0081] extracting second feature points from the vehicle image, and determining a contour area of ​​the vehicle based on the second feature points;

[0082] Extracting an image of the vehicle based on a contour area of ​​the vehicle, and transmitting the image of the vehicle to a traffic system via wireless communication to trigger the traffic system to perform image comparison based on the image of the vehicle to determine vehicle type information of the vehicle;

[0083] Receive vehicle type information sent by the traffic system.

[0084] In some exemplary embodiments, the second identification unit 23 is also used to determine that when two or more vehicles in the same lane have similar speeds and the distance between the two or more vehicles is less than a sixth threshold, and the duration exceeds a seventh threshold, it is determined that the lane is congested due to the series movement of vehicles and the short distance between them.

[0085] In some exemplary embodiments, the second identification unit 23 is also used to determine that when two or more vehicles in adjacent lanes have similar speeds and the distance between the two or more vehicles is less than a fourth threshold, and the duration exceeds a fifth threshold, it is determined that the road section is congested due to vehicles running in parallel and with speeds lower than a set threshold.

[0086] In some exemplary embodiments, the second determining unit 24 is further configured to identify related vehicles in the same lane or adjacent lanes, generate a reminder message prompting the vehicle to speed up and increase the driving distance, or generate a reminder message prompting the related vehicle to change lanes, and output the reminder message based on the position information of the road section via a vehicle driving reminder sign or voice broadcast system, in the direction of the vehicle's travel and the nearest reminder sign or voice broadcast system.

[0087] Alternatively, based on the location information of the road section to be intervened, determine whether there is a duty vehicle in the opposite lane, and the distance from the road section to be intervened is less than the eighth threshold, and send a prompt message to the duty vehicle to prompt the relevant vehicle to change lanes, change the distance between vehicles or speed up, so that the duty vehicle intervenes in the relevant vehicle.

[0088] In some exemplary embodiments, the second identification unit 23 is further used to determine whether the vehicle speed in all lanes of the road section to be intervened is lower than a ninth set threshold, and to determine whether an accident has occurred or congestion has occurred due to lane narrowing; when it is determined that an accident has occurred, the cause of the accident is identified.

[0089] In some exemplary embodiments, the second determining unit 24 is further configured to:

[0090] Determine whether there is an on-duty vehicle in the opposite lane or the same-direction lane, and determine the time it takes for the on-duty vehicle to arrive at the road section to be intervened;

[0091] Obtain the location information of the agency within the road section to be intervened and determine the time it takes for the agency to arrive at the road section to be intervened;

[0092] Based on the cause of congestion and the time it takes for on-duty vehicles and agencies to arrive at the road section to be intervened, it is determined whether the agency or on-duty vehicle will intervene, and information about the cause of the accident, intervention method, and route will be sent to the agency or on-duty vehicle to intervene in the congestion on the road section to be intervened.

[0093] In an exemplary embodiment, the aforementioned units may be implemented by one or more central processing units (CPUs), graphics processing units (GPUs), application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers (MCUs), microprocessors, or other electronic components.

[0094] Regarding the device in the above embodiment, the specific manner in which each module and unit performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0095] The technical solution of the embodiment of the present application uses an image acquisition module to capture images of the respective acquisition areas, then performs person object recognition on the captured images to determine the relevant person objects present in the images, and obtains their identity information by obtaining their biometric characteristics. The display content of the display unit is determined based on their identity information, so that the corresponding display content is displayed through different display units, allowing different visitors to be presented with content of interest based on their own needs. The embodiment of the present application can determine the display content for the visitor based on their identity and points of interest, thereby improving the visitor's experience and the exhibition display effect.

[0096] Figure 3 This is a schematic diagram of the structure of the electronic device according to the embodiment of the present application. Figure 3 As shown, the electronic device 800 supports multi-screen output, and the electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0097] The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 802 may include one or more modules to facilitate interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

[0098] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0099] The power component 806 provides power to the various components of the electronic device 800. The power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 800.

[0100] The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, it may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensors can not only sense the boundaries of a touch or slide action, but also detect the duration and pressure associated with the touch or slide action. In some embodiments, the multimedia component 808 includes a front-facing camera and / or a rear-facing camera. When the device 800 is in an operating mode, such as a capture mode or a video mode, the front-facing camera and / or the rear-facing camera can receive external multimedia data. Each front-facing camera and the rear-facing camera can have a fixed optical lens system or have focal length and optical zoom capabilities.

[0101] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC) that is configured to receive external audio signals when the electronic device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0102] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.

[0103] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the electronic device 800. For example, the sensor assembly 814 can detect the open / closed state of the device 800, the relative positioning of components, such as the display and keypad of the electronic device 800. The sensor assembly 814 can also detect changes in the position of the electronic device 800 or a component of the electronic device 800, the presence or absence of user contact with the electronic device 800, the orientation or acceleration / deceleration of the electronic device 800, and temperature changes of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0104] The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as Wi-Fi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0105] In an exemplary embodiment, the electronic device 800 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to execute the steps of the booth-based highway emergency coordination and control method of the above-mentioned embodiment.

[0106] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as memory 804 including instructions. The instructions are executable by processor 820 of electronic device 800 to complete the steps of the highway emergency coordination and management method of the above embodiment. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

[0107] The embodiment of the present application also describes a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the steps of the highway emergency event coordination and control method of the embodiment are implemented.

[0108] It should be understood that “one embodiment” or “an embodiment” mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present invention. Therefore, “in one embodiment” or “in an embodiment” appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present invention, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. The serial numbers of the embodiments of the present application mentioned above are for description only and do not represent the advantages and disadvantages of the embodiments.

[0109] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0110] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of the units is merely a logical functional division. In actual implementation, other division methods may be used, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not exist.

[0111] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0112] The above description is only an embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with this technical field can easily think of changes or replacements within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.

Claims

1. A method for coordinating and controlling highway emergency events, characterized in that: The method comprises: In response to lane images collected at different sections of the highway, the images are recognized to obtain at least lane driving condition information. Specifically, vehicle information is determined based on the shape of the vehicle, the difference between the lane color and the vehicle color, or based on the license plate image of the vehicle. Based on the vehicle's position change information and the duration of the position change, the relative position relationship between the vehicles at different collection times, the change in the relative position relationship, and the vehicle speed are determined. Alternatively, the license plate number of the vehicle is recognized to determine the vehicle's driving information, the license plate is associated with the vehicle, and the vehicle's driving condition is determined. Based on the driving conditions, determining that a vehicle speed in a lane is lower than a first threshold, or a vehicle density exceeds a second threshold, or a spacing between vehicles in multiple lanes is less than a third threshold; and determining that a traffic intervention is required on the corresponding section of the highway; Based on the collected images of the road section to be intervened, the cause of the congestion is identified, including: determining that the traffic congestion on the road section is caused by vehicles running in parallel and with speeds below a set threshold when two or more vehicles in adjacent lanes have similar speeds and the distance between the two or more vehicles is less than a fourth threshold, and the duration exceeds a fifth threshold; or determining that the traffic congestion on the road section is caused by vehicles running in series and with a short distance between vehicles when two or more vehicles in the same lane have similar speeds and the distance between the two or more vehicles is less than a sixth threshold, and the duration exceeds a seventh threshold; Determine the intervention method based on the location information of the road section to be intervened and the cause of congestion; According to the intervention method of the section to be intervened, each intervention method will be notified to each local unit respectively, and each unit will intervene in the traffic mode of the expressway according to the intervention method; when it is determined that the vehicle speed in all lanes is low, it is determined that an accident has occurred, and the severity of the accident and the cause of the accident are determined by automatic recognition, and the intervention method is determined. The accident situation and intervention method are sent to the traffic system through the wireless communication antenna. According to the severity and cause of the accident, the nearest agency or on-duty vehicle that can intervene in the traffic accident is determined, so that congestion intervention can be carried out on the section to be intervened in the most effective way, and the traffic accident vehicle is assisted to leave the scene.

2. The highway emergency coordination and control method according to claim 1 is characterized in that: The step of recognizing the image to obtain at least lane driving condition information includes: Acquire feature points in the image, and determine corresponding vehicle information based on the feature points; Determine the relative position relationship between vehicles at different time points and the driving speed of the vehicles based on vehicle information; Based on the relative position relationship between vehicles, changes in relative position relationship and vehicle speed, the driving condition information of different lanes is determined.

3. The highway emergency coordination and control method according to claim 2 is characterized in that: The intervention methods described include: Identify relevant vehicles in the same lane or adjacent lanes, generate reminder information to prompt vehicles to speed up and increase the driving distance, or generate reminder information to prompt relevant vehicles to change lanes. Based on the location information of the road section, the reminder information is output through the vehicle driving reminder sign or voice broadcast system in the direction of the vehicle's travel and the nearest reminder sign or voice broadcast system.

4. The highway emergency coordination and control method according to claim 1 is characterized in that: The method of identifying the cause of congestion based on collecting images of the road section to be intervened includes: Determine that the vehicle speeds in all lanes of the road section to be intervened are lower than a ninth set threshold, determine that an accident has occurred or that congestion has been caused by lane narrowing; and when it is determined that an accident has occurred, identify the cause of the accident.

5. The highway emergency coordination and control method according to claim 4 is characterized in that: The intervention methods described include: Determine whether there is an on-duty vehicle in the opposite lane or the same-direction lane, and determine the time it takes for the on-duty vehicle to arrive at the road section to be intervened; Obtain the location information of the agency within the road section to be intervened and determine the time it takes for the agency to arrive at the road section to be intervened; Based on the cause of congestion and the time it takes for on-duty vehicles and agencies to arrive at the road section to be intervened, it is determined whether the agency or on-duty vehicle will intervene, and information about the cause of the accident, intervention method, and route will be sent to the agency or on-duty vehicle to intervene in the congestion on the road section to be intervened.

6. A highway emergency coordination and control device, characterized in that: The device comprises: An acquisition unit, used for acquiring images of lanes in different sections of the highway; a first recognition unit configured to recognize the image and obtain at least lane driving condition information; specifically, determining vehicle information based on the shape of the vehicle, the difference between the lane color and the vehicle color, or based on the license plate image of the vehicle; and determining the relative position relationship between the vehicles at different acquisition times, the change in the relative position relationship, and the vehicle speed based on the vehicle's position change information and the duration of the position change; or, recognizing the vehicle's license plate number, determining the vehicle's driving information, associating the license plate with the vehicle, and determining the vehicle's driving condition; a first determining unit configured to determine, based on the driving condition, that a vehicle speed in a lane is lower than a first threshold, or a vehicle density exceeds a second threshold, or a distance between vehicles in multiple lanes is less than a third threshold; and determine that a traffic intervention is required on the corresponding section of the expressway; The second recognition unit is configured to identify the cause of congestion based on the collected image of the road section to be intervened, including: determining that the traffic congestion on the road section is caused by vehicles running in parallel and with speeds below a set threshold when two or more vehicles in adjacent lanes have similar speeds and the distance between the two or more vehicles is less than a fourth threshold, and the duration of the determination exceeds a fifth threshold; or determining that the traffic congestion on the road section is caused by vehicles running in series and with a short distance between vehicles when two or more vehicles in the same lane have similar speeds and the distance between the two or more vehicles is less than a sixth threshold, and the duration of the determination exceeds a seventh threshold; a second determining unit, configured to determine an intervention method based on the location information of the road section to be intervened and the cause of congestion, wherein determining the intervention method includes: determining, based on the location information of the road section to be intervened, whether there is an on-duty vehicle in the opposite lane, and whether the on-duty vehicle is at a distance from the road section to be intervened and the distance is less than an eighth threshold, and sending a prompt message to the on-duty vehicle to prompt the relevant vehicle to change lanes, change the distance between vehicles, or increase speed, so that the on-duty vehicle intervenes with the relevant vehicle; a notification unit, configured to notify each local unit of the intervention method according to the intervention method of the road section to be intervened, and each unit shall intervene in the traffic mode of the expressway according to the intervention method; When the first determination unit determines that the vehicle speeds in all lanes are low, it determines that an accident has occurred. The second identification unit determines the severity and cause of the accident through automatic identification, determines the intervention measures, and sends the accident situation and intervention measures to the traffic system through the notification unit. The second determination unit determines the nearest agency or on-duty vehicle that can intervene in the traffic accident based on the severity of the accident, so as to be able to intervene in the congestion of the intervention section in the most effective way and assist the traffic accident vehicle to leave the scene.

7. The highway emergency coordination and control device according to claim 6, characterized in that: The first recognition unit is further configured to: extracting second feature points from the vehicle image, and determining a contour area of ​​the vehicle based on the second feature points; Extracting an image of the vehicle based on a contour area of ​​the vehicle, and transmitting the image of the vehicle to a traffic system via wireless communication to trigger the traffic system to perform image comparison based on the image of the vehicle to determine vehicle type information of the vehicle; Receive vehicle type information sent by the traffic system.

Images