Toll gate passing abnormity identification method and device

Abstract

The invention discloses a toll gate passing abnormity identification method and device, and relates to the technical field of driving environment identification. The method comprises the following steps: acquiring an environment image around a vehicle, and identifying the environment image; in response to the recognition result of the environment image, representing that the charging display device in the preset range in front of the vehicle indicates successful charging, obtaining vehicle key data, and performing analysis based on the vehicle key data; and under the condition that the analysis result of the vehicle key data represents that collision occurs, or under the condition that the analysis result of the vehicle key data represents that no collision occurs and the recognition result of the environment image represents that the toll gate indicating that charging succeeds does not have the passing condition, generating passing abnormity prompt information. According to the embodiment, whether the current vehicle has the problem of abnormal traffic is accurately judged, the detailed situation of the abnormal traffic of the vehicle is determined, and the abnormal traffic prompt information is generated in time.

Description

Technical Field

[0001] The present invention relates to the technical field of driving environment recognition, and in particular to a method and device for recognizing abnormal traffic at a toll gate. Background Art

[0002] Due to the dense traffic at toll booths, when a car passes through a toll gate on the road, it is inevitable that a rear-end collision, a collision or an ETC (Electronic Toll Collection) collision will occur, which will affect the normal passage of the vehicle through the toll gate. These accidents are currently mainly identified by the driver's observation of the surrounding environment. However, the driver's energy and vision range are limited, and they often cannot observe the accident in a timely or comprehensive manner. With the development of intelligent automobiles, there is an urgent need for a toll gate abnormality identification method to enable vehicles to identify abnormal traffic in a timely manner. Summary of the invention

[0003] In view of this, an embodiment of the present invention provides a method and device for identifying abnormal traffic at a toll gate, which can simultaneously analyze environmental images and vehicle key data, accurately determine whether the current vehicle has abnormal traffic, determine the details of the vehicle's abnormal traffic, and generate abnormal traffic prompt information in a timely manner.

[0004] To achieve the above objective, according to one aspect of an embodiment of the present invention, a method for identifying abnormal traffic at a toll gate is provided.

[0005] A method for identifying abnormal traffic at a toll gate according to an embodiment of the present invention includes:

[0006] Acquire the environmental image around the vehicle and identify the environmental image;

[0007] In response to the recognition result of the environmental image indicating that the toll display device in the preset range in front of the vehicle indicates successful charging, key vehicle data is obtained, and analysis is performed based on the key vehicle data;

[0008] When the analysis results of the key vehicle data indicate that a collision has occurred, or when the analysis results of the key vehicle data indicate that no collision has occurred and the recognition results of the environmental image indicate that the toll gate where the billing was successful does not meet the conditions for passage, a passage abnormality prompt message is generated.

[0009] Optionally, obtain key vehicle data, including:

[0010] For new energy vehicles, real-time monitoring data and collision signals of new energy vehicles are obtained and combined as key vehicle data;

[0011] If the vehicle is a fuel vehicle, obtain the radar data and collision signal of the fuel vehicle and combine them as the key data of the vehicle;

[0012] The collision signal is used to indicate whether a collision occurs in the vehicle.

[0013] Optionally, if the vehicle is a new energy vehicle, after obtaining the key data of the vehicle, the method further includes:

[0014] Get the normal sending frequency of real-time monitoring data;

[0015] The normal sending frequency is adjusted to the target sending frequency, and the vehicle key data is sent to the enterprise backend database based on the target sending frequency, so that the emergency service center can identify traffic anomalies based on the vehicle key data received by the enterprise backend database; wherein the target sending frequency is higher than the normal sending frequency.

[0016] Optionally, when the recognition result of the environmental image indicates that the barrier pole is raised and there are no other vehicles within a preset range in front of the vehicle, it is determined that the toll gate has the conditions for passage;

[0017] If the recognition result of the environmental image indicates that the barrier pole is not raised or the barrier pole is raised and there are other vehicles within a preset range in front of the vehicle, it means that the toll gate does not meet the conditions for passage.

[0018] Optionally, a traffic abnormality prompt message is generated, including:

[0019] When the key data of the vehicle indicates that no collision has occurred and the recognition result of the environmental image indicates that the barrier pole has not been lifted, a traffic abnormality prompt message is generated indicating that the toll collection device is abnormal or the vehicle is abnormal.

[0020] Optionally, a traffic abnormality prompt message is generated, including:

[0021] When the key data of the vehicle indicates that no collision has occurred and the recognition result of the environmental image indicates that the barrier pole has been raised and there are other vehicles within a preset range in front of the vehicle, an abnormal traffic prompt message indicating that the ETC has been hit is generated.

[0022] Optionally, the method further comprises:

[0023] When the vehicle key data indicates a collision, obtain the vehicle's current location information;

[0024] Generate and send out an alarm signal including the vehicle's current location information.

[0025] To achieve the above objective, according to another aspect of an embodiment of the present invention, a toll gate traffic abnormality identification device is provided.

[0026] A toll gate traffic abnormality recognition device according to an embodiment of the present invention comprises:

[0027] A recognition module is used to obtain the environmental image around the vehicle and recognize the environmental image;

[0028] An analysis module, for obtaining key vehicle data in response to the recognition result of the environmental image indicating that the charging display device in the preset range in front of the vehicle indicates successful charging, and performing analysis based on the key vehicle data;

[0029] A generation module is used to generate a traffic abnormality prompt message when the analysis results of the vehicle's key data indicate that a collision has occurred, or when the analysis results of the vehicle's key data indicate that no collision has occurred and the recognition results of the environmental image indicate that the toll gate where the billing was successful does not meet the conditions for passage.

[0030] To achieve the above objective, according to another aspect of an embodiment of the present invention, an electronic device for identifying abnormal passage at a toll gate is provided.

[0031] An electronic device for identifying abnormal traffic at a toll gate according to an embodiment of the present invention comprises: one or more processors; a storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement a method for identifying abnormal traffic at a toll gate according to an embodiment of the present invention.

[0032] To achieve the above objective, according to another aspect of an embodiment of the present invention, a computer-readable storage medium is provided.

[0033] A computer-readable storage medium according to an embodiment of the present invention stores a computer program, and when the program is executed by a processor, a method for identifying abnormal passage at a toll gate according to an embodiment of the present invention is implemented.

[0034] An embodiment of the above invention has the following advantages or beneficial effects: by identifying the environmental images around the vehicle and analyzing the vehicle's key data, the environmental images and the vehicle's key data can be integrated to analyze the traffic conditions of the vehicle at the toll gate, and it can be accurately determined whether the current vehicle has any traffic abnormality problems, determine the details of the vehicle's traffic abnormality, and generate traffic abnormality prompt information in a timely manner.

[0035] At the same time, in the event of abnormal traffic, environmental images can be used as evidence of the abnormal traffic to assist in handling the accident.

[0036] The further effects of the above-mentioned non-conventional optional manner will be described below in conjunction with the specific implementation manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] The accompanying drawings are used to better understand the present invention and do not constitute an improper limitation of the present invention.

[0038] Figure 1 is a flow chart of a method for identifying abnormal traffic at a toll gate according to an embodiment of the present invention;

[0039] Figure 2 is a flow chart of a method for identifying abnormal traffic at a toll gate according to another embodiment of the present invention;

[0040] Figure 3 is a schematic diagram of a scenario of a method for identifying abnormal traffic at a toll gate according to an embodiment of the present invention;

[0041] Figure 4 is a schematic diagram of main modules of a toll gate traffic abnormality identification device according to an embodiment of the present invention;

[0042] Figure 5 is an exemplary system architecture diagram to which embodiments of the present invention may be applied;

[0043] Figure 6 It is a schematic diagram of the structure of a computer system of a terminal device or a server suitable for implementing an embodiment of the present invention. DETAILED DESCRIPTION

[0044] The following is a description of exemplary embodiments of the present invention in conjunction with the accompanying drawings, including various details of the embodiments of the present invention to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present invention. Similarly, for clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0045] It should be pointed out that the embodiments of the present invention and the technical features therein may be combined with each other without conflict.

[0046] Figure 1 Schematic diagram of the main steps of the toll gate traffic anomaly identification method according to an embodiment of the present invention. Figure 1 As shown, the toll gate passage abnormality identification method of the embodiment of the present invention mainly includes the following steps S101 to S103:

[0047] Step S101, acquiring the environmental image around the vehicle and identifying the environmental image.

[0048] The image acquisition device is installed on the vehicle in advance to obtain the environmental image around the vehicle. The image acquisition device can be set on the left B-pillar of the vehicle, on the front bumper of the vehicle, on the roof, or other places where the environmental image around the vehicle can be acquired. The vehicle driving recorder can also be used as the image acquisition device. In this case, the vehicle driving image acquired by the driving recorder can be used as the environmental image around the vehicle.

[0049] It should be noted that the environmental image around the vehicle may include a 360-degree panoramic image around the vehicle. Preferably, the environmental image around the vehicle at least includes an environmental image in front of the vehicle, so as to identify the display content of the toll display device through the environmental image.

[0050] While acquiring the environmental image around the vehicle, screenshots of the environmental image can also be taken at a preset frequency so that the screenshots and environmental image can be used as evidence after a collision occurs.

[0051] Step S102 , in response to the recognition result of the environmental image indicating that the toll display device in a preset range in front of the vehicle indicates successful billing, key vehicle data is obtained and analyzed based on the key vehicle data.

[0052] After the environmental image is recognized, a recognition result is obtained, which at least includes the recognition result of the display text of the toll display device within the preset range in front of the vehicle in the environmental image. Here, the preset range in front of the vehicle can be set according to the maximum recognition distance from the ETC card reader to the vehicle to be recognized, and the value of the preset range can be the same as the above maximum recognition distance or slightly smaller than the above maximum recognition distance to ensure that the ETC card reader at the toll gate can recognize the vehicle. For example, if the maximum recognition distance from the ETC card reader to the vehicle to be recognized is 8 meters, the preset range can be 7 meters.

[0053] It is understandable that the recognition result may include not only whether the charging is successful as indicated by the toll display device, but also the license plate number indicated by the toll display device. According to the license plate number in the recognition result, it can be determined whether the ETC card reader currently recognizes the vehicle.

[0054] In the environmental image, the display text of the toll display device includes the license plate number of the vehicle, and after indicating that the charging is successful, the key data of the vehicle is obtained, and a real-time analysis of whether the vehicle has collided is performed based on the key data of the vehicle until the vehicle passes through the toll gate. Among them, the key data of the vehicle can be data reflecting the status of the vehicle during the driving process of the vehicle.

[0055] Step S103, when the analysis result of the key vehicle data indicates that a collision has occurred, or when the analysis result of the key vehicle data indicates that no collision has occurred and the recognition result of the environmental image indicates that the toll gate where the billing is successful does not meet the conditions for passing, a passage abnormality prompt message is generated.

[0056] The process of identifying the environmental image also includes identifying whether the toll gate indicating successful billing in the environmental image has the conditions for passage.

[0057] Specifically, when the analysis result of the key data of the vehicle indicates a collision, a traffic abnormality prompt message can be generated to indicate that the vehicle is abnormally passing through the toll gate. Here, the vehicle collision may specifically include: another vehicle behind the vehicle rear-ends the vehicle, the vehicle collides with another vehicle in front or to the side, the vehicle collides with the gate pole, etc.

[0058] When the analysis results of the key data of the vehicle indicate that no collision has occurred and the recognition results of the environmental image indicate that the toll gate where the billing was successful is ready for passage, the vehicle can be controlled to pass normally and pass through the toll gate.

[0059] When the analysis results of the vehicle's key data indicate that no collision has occurred and the recognition results of the environmental image indicate that the toll gate where the billing was successful does not meet the conditions for passage, an abnormal passage prompt message can be generated to indicate that the vehicle cannot pass through the toll gate normally.

[0060] In an optional embodiment, before the above step S101, the method further includes: when it is recognized that the vehicle is about to enter the toll station, starting to execute step S101. Specifically, it can be determined whether the vehicle is about to enter the toll station through the navigation information of the vehicle or the vehicle driving image collected by the driving recorder.

[0061] In case of judging whether the vehicle is about to enter a toll station by the navigation information of the vehicle, it is identified by the navigation information whether there is a toll station within a first preset distance ahead of the road where the vehicle is located. If so, it is determined that the vehicle is about to enter the toll station.

[0062] When judging whether the vehicle is about to enter a toll station through the vehicle driving image collected by the vehicle driving recorder, image recognition is performed on the vehicle driving image to identify whether there are words "toll station" or "ETC" waiting to be recognized or objects at toll stations or toll booths waiting to be recognized. If so, it is determined that the vehicle is about to enter a toll station.

[0063] In an optional embodiment, obtaining key vehicle data includes:

[0064] If the vehicle is a new energy vehicle, the real-time monitoring data and collision signal of the new energy vehicle are obtained and combined as the vehicle's key data; if the vehicle is a fuel vehicle, the radar data and collision signal of the fuel vehicle are obtained and combined as the vehicle's key data; among which, the collision signal is used to indicate whether the vehicle has collided.

[0065] According to national standards, new energy vehicles need to be equipped with a real-time monitoring (RTM) system to collect real-time monitoring data (RTM data) of new energy vehicles in real time and upload it to the enterprise backend database. When the vehicle is a new energy vehicle, the collision signal can be collected, and the collision signal and RTM data can be combined as key vehicle data and uploaded to the enterprise backend database. Here, RTM data can include basic vehicle data, battery system data, motor system data, vehicle fault information, vehicle location information, etc., among which the basic vehicle data can include vehicle speed, mileage, charging status, etc., the battery system data can include battery temperature, battery cell voltage, battery remaining power, etc., and the motor system data can include motor speed, motor temperature, etc.

[0066] For fuel vehicles, there is no requirement to configure the RTM system and upload RTM data, but in order to record the vehicle data and obtain the vehicle status, the radar data and collision signal of the fuel vehicle can be combined as the vehicle key data.

[0067] It is understandable that, whether for new energy vehicles or fuel vehicles, vehicle key data may also include other data, such as engine power.

[0068] The collision signal is a signal used to indicate whether the vehicle has collided. It can be obtained through analysis of sensors pre-configured in the vehicle, such as acceleration sensors, pressure sensors, deformation sensors, etc. It can also be judged by the body safety system based on comprehensive vehicle data.

[0069] In an optional embodiment, for a vehicle that is a new energy vehicle, after obtaining the key data of the vehicle, the method further includes:

[0070] Get the normal sending frequency of real-time monitoring data;

[0071] The normal sending frequency is adjusted to the target sending frequency, and the vehicle key data is sent to the enterprise backend database based on the target sending frequency, so that the emergency service center can identify traffic anomalies based on the vehicle key data received by the enterprise backend database; wherein the target sending frequency is higher than the normal sending frequency.

[0072] Specifically, for new energy vehicles, the RTM data is uploaded to the enterprise backend database based on the normal sending frequency. When the vehicle is in the toll station and starts to obtain the vehicle's key data, the normal sending frequency can be adjusted to the target sending frequency, and the vehicle's key data including the RTM data can be sent to the enterprise's backend database based on the target sending frequency, so that the enterprise's backend emergency service center can also identify traffic anomalies based on the vehicle's key data received in the enterprise's backend database, so that when the vehicle has traffic anomalies, the emergency service center can also quickly give feedback. The target sending frequency can be set according to actual conditions, and is not limited here. As an example, the normal sending frequency can be 30s / time, and the target sending frequency can be 1s / time.

[0073] When the executor of the toll gate traffic anomaly identification method of the embodiment of the present invention is the vehicle ECU, the vehicle ECU analyzes the vehicle key data to determine whether the vehicle has collided. At the same time, the vehicle ECU uploads the vehicle key data to the enterprise backend database, and the emergency service center can also identify traffic anomalies based on the vehicle key data in the enterprise backend database to determine whether the vehicle has traffic anomalies. After the vehicle has traffic anomalies, the emergency service center can provide emergency services in a timely and accurate manner, such as road rescue, car repairs, alarms, etc., and store the vehicle key data. The enterprise backend can also adjust the analysis method, processing flow, etc. of the emergency service center based on the vehicle key data of vehicles with traffic anomalies to further improve service quality.

[0074] Among them, the normal sending frequency is adjusted to a higher target sending frequency so that the enterprise backend database can obtain vehicle conditions in a timely manner. In the event of abnormal vehicle traffic, the emergency service center can provide feedback and emergency services more quickly.

[0075] In addition, for fuel vehicles that do not meet the requirements for uploading data, in order to reduce the interference of redundant data, when the recognition results of the environmental image indicate that there are other vehicles in front of the vehicle and the distance to other vehicles is less than a second preset distance, the vehicle key data of the fuel vehicle can be uploaded to the enterprise backend database at the target sending frequency.

[0076] In an optional embodiment, when the recognition result of the environmental image indicates that the barrier pole is raised and there are no other vehicles within a preset range in front of the vehicle, it is determined that the toll gate is passable; when the recognition result of the environmental image indicates that the barrier pole is not raised or the barrier pole is raised and there are other vehicles within a preset range in front of the vehicle, it indicates that the toll gate is not passable.

[0077] In the process of identifying the environmental image, it is necessary to identify the display text of the toll display device, the rise and fall of the barrier pole, and whether there is a vehicle in the preset range in front. When the recognition result of the environmental image indicates that the toll display device in the preset range in front of the vehicle indicates that the billing is successful, and the analysis result of the key data of the vehicle indicates that a collision has occurred, it indicates that the vehicle has collided at this time, and there is no need to obtain the rise and fall of the barrier pole and whether there is a vehicle in the preset range in front based on the recognition result of the environmental image. When the recognition result of the environmental image indicates that the toll display device in the preset range in front of the vehicle indicates that the billing is successful, and the analysis result of the key data of the vehicle indicates that no collision has occurred, it indicates that the current vehicle has not collided. In order to determine whether the toll gate has the conditions for passage and then determine whether the vehicle can pass the toll gate normally, the rise and fall of the barrier pole and whether there is a vehicle in the preset range in front can be obtained based on the recognition result of the environmental image.

[0078] If the barrier pole is not raised or there are other vehicles within the preset range in front of the vehicle, it means that there is an ETC abnormality or other vehicles are using the ETC, and the current toll gate does not meet the conditions for passage.

[0079] By recognizing the environmental image, the actual situation of the toll gate can be further determined to judge whether the vehicle can pass normally. It can quickly identify whether there are any conditions that affect the normal passage of the vehicle through the toll gate.

[0080] In an optional embodiment, generating the abnormal traffic prompt information includes:

[0081] When the key data of the vehicle indicates that no collision has occurred and the recognition result of the environmental image indicates that the barrier pole has not been lifted, a traffic abnormality prompt message is generated indicating that the toll collection device is abnormal or the vehicle is abnormal.

[0082] It can be understood that the recognition result of the environmental image indicates that the toll display device within the preset range in front of the vehicle indicates that the billing is successful, but the barrier pole is not raised, indicating that the ETC identifier has normally recognized the vehicle information, but the barrier pole is not raised due to problems such as toll equipment abnormalities or vehicle abnormalities. At this time, a traffic abnormality prompt message of "toll equipment abnormality or vehicle abnormality" can be directly generated, or the vehicle's key data can be further analyzed to determine whether it is a toll equipment abnormality or a vehicle abnormality, thereby generating a traffic abnormality prompt message of "toll equipment abnormality" or a traffic abnormality prompt message of "vehicle abnormality", giving the vehicle driver more accurate prompts.

[0083] Abnormal conditions of toll collection equipment include, but are not limited to, lane antenna failure, gate pole failure, or network communication failure.

[0084] Vehicle abnormalities include, but are not limited to, on-board unit (OBU) equipment failure, excessive speed, or discrepancy between the identified vehicle information and the actual vehicle information.

[0085] In the event of an abnormality in the toll collection device or vehicle, you can adjust the vehicle speed, check the OBU, verify the vehicle information or contact the toll station staff.

[0086] In an optional embodiment, generating the abnormal traffic prompt information includes:

[0087] When the key data of the vehicle indicates that no collision has occurred and the recognition result of the environmental image indicates that the barrier pole has been raised and there are other vehicles within a preset range in front of the vehicle, an abnormal traffic prompt message indicating that the ETC has been hit is generated.

[0088] When the recognition result of the environmental image indicates that the toll display device in the preset range in front of the vehicle indicates that the charging is successful and the barrier pole is raised, but there are other vehicles in the preset range in front of the vehicle, it means that other vehicles have inserted in front of the vehicle after the vehicle charging is successful, and there may be a situation of ETC being swiped, and a traffic abnormality prompt message indicating that the ETC has been swiped is generated. At this time, the acquired environmental image and screenshot can be saved as evidence of ETC being swiped.

[0089] In addition, when the analysis results of the vehicle's key data indicate that a collision has occurred, the acquired environmental images and screenshots can also be saved as evidence of the collision accident, so as to provide key evidence in the subsequent handling of the collision accident and improve the efficiency of accident handling.

[0090] When the analysis results of the vehicle's key data indicate that no collision has occurred and the recognition results of the environmental images indicate that the toll gate at which billing was successful is passable, the vehicle can pass through the toll gate normally, and the acquired environmental images and screenshots can be deleted to prevent them from occupying storage space.

[0091] In an optional embodiment, the method further includes: when the vehicle key data indicates that a collision has occurred, obtaining the vehicle's current position information; and generating and issuing an alarm signal including the vehicle's current position information.

[0092] At this time, an alarm signal including the vehicle's current location can be sent to the emergency service center, the driver's pre-set emergency contact, the insurance company, the traffic accident alarm center and / or the road rescue service center, so that rescue personnel or service personnel can provide timely rescue services for the vehicle and prevent secondary accidents from occurring. At the same time, rescue personnel or service personnel can quickly reach the accident site based on the vehicle's current location information, shorten the rescue time, and promptly direct traffic to avoid further deterioration of traffic congestion at the toll gate.

[0093] The method for identifying abnormal traffic at a toll gate is described in detail below through a specific embodiment.

[0094] The toll gate abnormality recognition method of the embodiment of the present invention can be executed by a vehicle controller, i.e., a vehicle ECU, or can be executed by a dedicated toll gate abnormality recognition system. It is understood that when the above method is executed by a dedicated toll gate abnormality recognition system, the system can be connected to the vehicle ECU for communication.

[0095] like Figure 2 and Figure 3 As shown, taking the vehicle ECU as an example of the toll gate passage abnormality identification method of the embodiment of the present invention, when the vehicle is a new energy vehicle, the method includes the following steps S201 to S208:

[0096] Step S201, based on navigation information or vehicle driving images collected by a driving recorder, the vehicle ECU can determine whether the vehicle 301 is about to enter a toll station;

[0097] Step S202, in response to the vehicle 301 about to enter the toll station, the vehicle ECU may obtain the environmental image around the vehicle 301 through the image acquisition device 3011 pre-set on the roof of the vehicle 301, and at the same time take screenshots of the environmental image at a preset frequency and recognize the environmental image;

[0098] Step S203, in response to the recognition result of the environmental image indicating that the toll display device 302 in the preset range in front of the vehicle 301 indicates successful charging, the vehicle ECU can obtain key vehicle data consisting of the RTM data and the collision signal of the vehicle 301;

[0099] At the same time, the normal sending frequency of the RTM data of vehicle 301 is obtained, and the vehicle ECU can adjust the normal sending frequency to a higher target sending frequency, and upload the vehicle key data to the enterprise backend database at the target sending frequency, so that the emergency service center can identify the passage abnormality of vehicle 301 based on the vehicle key data received by the enterprise backend database, so that emergency services can be provided in time when there is a passage abnormality of vehicle 301.

[0100] Step S204, the vehicle ECU can perform real-time analysis on the vehicle key data to determine whether the vehicle 301 has collided;

[0101] Step S205, when the analysis result of the key vehicle data indicates that a collision has occurred, the vehicle ECU may generate a traffic abnormality prompt message indicating that a collision has occurred to prompt the driver, and at the same time, the vehicle ECU may obtain the current position information of the vehicle, generate and send an alarm signal including the current position information of the vehicle;

[0102] At the same time, the acquired environmental images and screenshots are stored as evidence for subsequent handling of the collision accident;

[0103] Here, the collision of vehicle 301 may be with other vehicles in front of it, with barrier pole 303, or with other vehicles on its side or behind. For example, if other vehicle 304 turns left and enters the toll gate where vehicle 301 is located, vehicle 301 may collide with other vehicle 304.

[0104] Step S206, when the key data of the vehicle indicates that no collision has occurred and the recognition result of the environmental image indicates that the barrier rod 303 has not been lifted, the vehicle ECU may generate a traffic abnormality prompt message indicating that the toll collection device is abnormal or the vehicle is abnormal;

[0105] Step S207, when the key data of the vehicle indicates that no collision has occurred and the recognition result of the environmental image indicates that the barrier pole 303 is lifted and there are other vehicles within the preset range in front of the vehicle, generating a traffic abnormality prompt message indicating that the ETC has been hit;

[0106] As an example, another vehicle 304 turns left into the toll gate where the vehicle 301 is located, and inserts in front of the vehicle 301 in an attempt to use the ETC of the vehicle 301 .

[0107] At the same time, the acquired environmental images and screenshots are stored as evidence of ETC being used illegally.

[0108] Step S208, when the vehicle key data indicates that no collision has occurred and the recognition result of the environmental image indicates that the barrier pole 303 is lifted and there are no other vehicles within the preset range in front of the vehicle, the vehicle can pass through the toll gate normally without generating abnormal passage prompt information.

[0109] The toll gate traffic abnormality identification method of the embodiment of the present invention can identify the environmental images around the vehicle and analyze the vehicle's key data, integrate the environmental images and the vehicle's key data, and analyze the traffic conditions of the vehicle at the toll gate. It can accurately determine whether the current vehicle has a traffic abnormality problem, determine the details of the vehicle's traffic abnormality, and generate traffic abnormality prompt information in a timely manner.

[0110] At the same time, in the event of abnormal traffic, environmental images can be used as evidence of the abnormal traffic to assist in handling the accident.

[0111] Figure 4 Schematic diagram of the main modules of the toll gate abnormality identification device according to an embodiment of the present invention. Figure 4As shown, the toll gate traffic abnormality identification device 400 of the embodiment of the present invention includes: an identification module 401, which is used to obtain the environmental image around the vehicle and identify the environmental image; an analysis module 402, which is used to obtain the vehicle key data in response to the recognition result of the environmental image indicating that the toll display device within the preset range in front of the vehicle indicates successful billing, and analyze based on the vehicle key data; a generation module 403, which is used to generate a traffic abnormality prompt message when the analysis result of the vehicle key data indicates that a collision has occurred, or when the analysis result of the vehicle key data indicates that no collision has occurred and the recognition result of the environmental image indicates that the toll gate where the billing is successful does not have the conditions for passing.

[0112] In an optional embodiment of the present invention, the analysis module 402 is also used for: if the vehicle is a new energy vehicle, obtaining real-time monitoring data and collision signals of the new energy vehicle, and combining them as vehicle key data; if the vehicle is a fuel vehicle, obtaining radar data and collision signals of the fuel vehicle, and combining them as vehicle key data; wherein the collision signal is used to indicate whether the vehicle has collided.

[0113] In an optional embodiment of the present invention, for a vehicle that is a new energy vehicle, the toll gate traffic abnormality identification device also includes: an adjustment module, used to: obtain the normal sending frequency of real-time monitoring data; adjust the normal sending frequency to the target sending frequency, and send the vehicle key data to the enterprise backend database based on the target sending frequency, so that the emergency service center can perform traffic abnormality identification based on the vehicle key data received by the enterprise backend database; wherein, the target sending frequency is higher than the normal sending frequency.

[0114] In an optional embodiment of the present invention, when the recognition result of the environmental image indicates that the barrier pole is raised and there are no other vehicles within a preset range in front of the vehicle, it is determined that the toll gate is passable; when the recognition result of the environmental image indicates that the barrier pole is not raised or the barrier pole is raised and there are other vehicles within a preset range in front of the vehicle, it indicates that the toll gate is not passable.

[0115] In an optional embodiment of the present invention, the generation module 403 is also used to generate traffic abnormality prompt information indicating abnormality of the toll collection device or vehicle when the vehicle key data indicates that no collision has occurred and the recognition result of the environmental image indicates that the barrier pole has not been lifted.

[0116] In an optional embodiment of the present invention, the generation module 403 is also used to generate abnormal traffic prompt information indicating that the ETC has been hit when the vehicle's key data indicates that no collision has occurred and the recognition result of the environmental image indicates that the barrier pole has been lifted and there are other vehicles within a preset range in front of the vehicle.

[0117] In an optional embodiment of the present invention, the toll gate traffic abnormality identification device also includes: an alarm module, which is used to: obtain the vehicle's current position information when the vehicle's key data indicates a collision; and generate and send an alarm signal including the vehicle's current position information.

[0118] The toll gate traffic abnormality identification device of the embodiment of the present invention can identify the environmental images around the vehicle and analyze the vehicle's key data, merge the environmental images and the vehicle's key data, and analyze the traffic conditions of the vehicle at the toll gate. It can accurately determine whether the current vehicle has a traffic abnormality problem, determine the details of the vehicle's traffic abnormality, and generate traffic abnormality prompt information in a timely manner.

[0119] At the same time, in the event of abnormal traffic, environmental images can be used as evidence of the abnormal traffic to assist in handling the accident.

[0120] Figure 5 An exemplary system architecture 500 is shown to which the toll gate passage abnormality identification method or toll gate passage abnormality identification device according to the embodiment of the present invention can be applied.

[0121] like Figure 5 As shown, the system architecture 500 may include image acquisition devices or sensors 501, 502, 503, a network 504, and a vehicle ECU 505. The network 504 is used as a medium for providing a communication link between the image acquisition devices or sensors 501, 502, 503 and the vehicle ECU 505. The network 504 may be a vehicle bus in the vehicle that connects the image acquisition devices or sensors 501, 502, 503 and the vehicle ECU 505.

[0122] The image acquisition devices or sensors 501 , 502 , 503 interact with the vehicle ECU 505 via a network 504 to receive or send data, etc.

[0123] It should be noted that the toll gate passage abnormality identification method provided in the embodiment of the present invention is generally executed by the vehicle ECU 505 , and accordingly, the toll gate passage abnormality identification device is generally disposed in the vehicle ECU 505 .

[0124] It should be understood that Figure 5 The number of image acquisition devices or sensors, networks and vehicle ECUs in the embodiment is only for illustration. Any number of image acquisition devices or sensors, networks and vehicle ECUs may be provided according to the implementation requirements.

[0125] Reference below Figure 6 , which shows a schematic structural diagram of a computer system 600 suitable for implementing a vehicle ECU according to an embodiment of the present invention. Figure 6The vehicle ECU shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0126] like Figure 6 As shown, the computer system 600 includes a central processing unit (CPU) 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage part 608 into a random access memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the computer system 600 are also stored. The CPU 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0127] The following components are connected to the I / O interface 605: an input section 606 including a keyboard, a mouse, etc.; an output section 607 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 608 including a hard disk, etc.; and a communication section 609 including a network interface card such as a LAN card, a modem, etc. The communication section 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to the I / O interface 605 as needed. A removable medium 611, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 610 as needed, so that a computer program read therefrom is installed into the storage section 608 as needed.

[0128] In particular, according to the embodiments disclosed in the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present invention include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 609, and / or installed from the removable medium 611. When the computer program is executed by the central processing unit (CPU) 601, the above-mentioned functions defined in the system of the present invention are executed.

[0129] It should be noted that the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0130] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0131] The modules involved in the embodiments of the present invention may be implemented by software or hardware. The modules described may also be set in a processor. For example, they may be described as: a processor includes a recognition module, an analysis module, and a generation module. The names of these modules do not, in some cases, constitute limitations on the modules themselves. For example, the recognition module may also be described as a "module for acquiring an environmental image around a vehicle and recognizing the environmental image."

[0132] As another aspect, the present invention also provides a computer-readable medium, which may be included in the device described in the above embodiment; or it may exist independently and not be assembled into the device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by a device, the device includes: acquiring the environmental image around the vehicle and identifying the environmental image; in response to the recognition result of the environmental image indicating that the toll display device in the preset range in front of the vehicle indicates successful billing, acquiring the vehicle key data and analyzing based on the vehicle key data; in the case where the analysis result of the vehicle key data indicates that a collision has occurred, or in the case where the analysis result of the vehicle key data indicates that no collision has occurred and the recognition result of the environmental image indicates that the toll gate where the billing is successful does not meet the conditions for passing, generating a passage abnormality prompt information.

[0133] According to the technical solution of the embodiment of the present invention, by identifying the environmental image around the vehicle and analyzing the vehicle's key data, the environmental image and the vehicle's key data are integrated to analyze the vehicle's traffic conditions at the toll gate. It can accurately determine whether the current vehicle has any traffic abnormality problems, determine the details of the vehicle's traffic abnormality, and generate traffic abnormality prompt information in a timely manner.

[0134] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for identifying abnormal traffic at a toll gate, characterized in that: include: Acquire an environmental image around the vehicle and identify the environmental image; In response to the recognition result of the environmental image indicating that the toll display device in the preset range in front of the vehicle indicates successful charging, obtaining key vehicle data, and performing analysis based on the key vehicle data; When the analysis result of the key vehicle data indicates that a collision has occurred, or when the analysis result of the key vehicle data indicates that no collision has occurred and the recognition result of the environmental image indicates that the toll gate where the billing was successful does not meet the conditions for passage, a passage abnormality prompt message is generated.

2. The toll gate traffic abnormality identification method according to claim 1, characterized in that: The obtaining of key vehicle data includes: In view of the vehicle being a new energy vehicle, real-time monitoring data and a collision signal of the new energy vehicle are obtained, and the real-time monitoring data and the collision signal of the new energy vehicle are combined as key vehicle data; In view of the vehicle being a fuel vehicle, radar data and a collision signal of the fuel vehicle are obtained, and the radar data and the collision signal are combined as key vehicle data; The collision signal is used to indicate whether the vehicle has collided.

3. The toll gate traffic abnormality identification method according to claim 2, characterized in that: In view of the vehicle being a new energy vehicle, after acquiring the key vehicle data, the method further includes: Obtaining a normal sending frequency of the real-time monitoring data; The normal sending frequency is adjusted to the target sending frequency, and the vehicle key data is sent to the enterprise backend database based on the target sending frequency, so that the emergency service center can identify traffic anomalies based on the vehicle key data received by the enterprise backend database; wherein the target sending frequency is higher than the normal sending frequency.

4. The toll gate passage abnormality identification method according to claim 1, characterized in that: When the recognition result of the environmental image indicates that the barrier pole is raised and there are no other vehicles within a preset range in front of the vehicle, determining that the toll gate is passable; When the recognition result of the environmental image indicates that the barrier pole is not raised or the barrier pole is raised and there are other vehicles within a preset range in front of the vehicle, it means that the toll gate does not meet the conditions for passage.

5. The toll gate traffic abnormality identification method according to claim 4, characterized in that: The generating of the abnormal traffic prompt information includes: When the key data of the vehicle indicates that no collision has occurred and the recognition result of the environmental image indicates that the barrier pole has not been lifted, abnormal traffic prompt information indicating abnormality of the toll collection device or the vehicle is generated.

6. The toll gate traffic abnormality identification method according to claim 4, characterized in that: The generating of the abnormal traffic prompt information includes: When the key data of the vehicle indicates that no collision has occurred and the recognition result of the environmental image indicates that the barrier pole is lifted and there are other vehicles within a preset range in front of the vehicle, abnormal traffic prompt information indicating that the ETC has been hit is generated.

7. The toll gate traffic abnormality identification method according to claim 1, characterized in that: The method further comprises: When the key data of the vehicle indicates that a collision has occurred, obtaining the current position information of the vehicle; Generate and send out an alarm signal including the current position information of the vehicle.

8. A toll gate traffic abnormality recognition device, characterized in that: include: A recognition module, used to obtain an environmental image around the vehicle and recognize the environmental image; An analysis module, configured to obtain key vehicle data in response to the recognition result of the environmental image indicating that the charging display device within the preset range in front of the vehicle indicates successful charging, and perform analysis based on the key vehicle data; A generation module is used to generate abnormal passage prompt information when the analysis result of the vehicle key data indicates that a collision has occurred, or when the analysis result of the vehicle key data indicates that no collision has occurred and the recognition result of the environmental image indicates that the toll gate where the billing is successful does not meet the conditions for passage.

9. An electronic device for identifying abnormal traffic at a toll gate, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7.

10. A computer readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images