License plate information repair method and system based on historical data
By identifying the license plate images in vehicle photos and analyzing the associated photos in historical data, the problem of inaccurate identification of vehicle images license plate information is solved, automatic license plate information repair is realized, and the accuracy of license plate recognition and system reliability are improved.
Patent Information
- Application Number
- CN202010745705.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-07-29
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2040-07-29
AI Technical Summary
In the prior art, the license plate information identification of vehicle images is inaccurate, which causes the image to be unable to correspond one by one with the charging pass data, reducing the overall accuracy and reliability of the system.
By identifying the license plate images in the vehicle photos, analyzing the initial license plate information, using historical data to find related photos, judging the vehicle's driving trajectory and driving habits, and automatically repairing the wrong license plate information.
It realizes automated and accurate license plate information repair, improves the accuracy of license plate recognition when road monitoring equipment takes vehicle photos, reduces manual operations, and improves the convenience of traffic data summary and big data application.
Smart Images

Figure CN111860412B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of computer technology, in particular to the field of image recognition technology, and specifically refers to a method and system for repairing license plate information based on historical data. Background Art
[0002] As of December 28, 2018, the total mileage of China's expressways has reached 140,000 kilometers, ranking first in the world. There are more than 10,000 toll stations on this 140,000-kilometer artery. Toll stations continuously collect manual or ETC toll data to the provincial expressway system through data collection equipment. The provincial expressway system can synchronize the details of expressway data to the Ministry of Transport's expressway database through the public network or private network in real time. During the entire data generation process, the toll collector determines the type of vehicles that pay and are exempt from payment, and inputs the vehicle model into the computer through the toll keyboard. The toll computer also makes voice quotations, and the lane quotation machine will issue a quotation prompt sound. At the same time, the quotation machine digital tube displays the amount to be paid and the vehicle model. After the driver completes the payment, the toll collector uses the toll keyboard to operate the vehicle to pass. At this time, the ticket printer prints a ticket, and the gate barrier will automatically lift up. The lane will capture a vehicle image superimposed with relevant information about this toll, and the toll data will be uploaded to the server through the network. In addition, the systems and recognition equipment accuracy of each toll station are inconsistent, and the data will inevitably have various problems such as license plate number and axle number recognition errors, transmission errors, and human errors.
[0003] The main problem is the inaccurate recognition of the license plate information of the vehicle image, which makes it impossible to correspond the image one-to-one with the toll data. There is a lot of data in the system that needs further proofreading and repair, which reduces the overall accuracy and reliability of the system.
[0004] Therefore, how to provide an automatic, convenient and highly accurate license plate information repair has become an urgent problem to be solved in this field. Summary of the invention
[0005] The purpose of the present invention is to overcome the shortcomings of the above-mentioned prior art and provide a method and system for automatically and accurately repairing license plate information by analyzing vehicle driving trajectories and driving habits based on system historical data.
[0006] In order to achieve the above-mentioned purpose, the license plate information repair method based on historical data of the present invention comprises:
[0007] (1) Recognize the license plate image in the vehicle photo and obtain the initial license plate information;
[0008] (2) analyzing the initial license plate information based on the numbering rule to determine whether it is incorrect license plate information. If it is incorrect license plate information, proceed to step (3); if it is correct license plate information, exit this method;
[0009] (3) searching for related photos in historical data according to the initial license plate information and the photo information of the vehicle photo, and obtaining the license plate information of the related photos;
[0010] (4) Using the associated photo license plate information to repair the erroneous license plate information.
[0011] In the license plate information repair method based on historical data, the step (3) specifically includes:
[0012] (31) confirming the error position of the erroneous license plate information, and retrieving the matching information in the historical data in a default form of the error position as an associated photo;
[0013] (32) determining whether the vehicle image in the associated photo matches the vehicle image in the vehicle photo to be identified, if so, proceeding to step (33), if not, prompting that the license plate is wrong and exiting the method;
[0014] (33) Determine whether the photo information of the associated photo is inconsistent with the photo information of the vehicle photo to be identified. If not, proceed to step (4); if so, prompt that the license plate is wrong and exit this method.
[0015] In the license plate information repair method based on historical data, the step (32) of determining whether the vehicle image in the associated photo matches the vehicle image in the vehicle photo to be identified is specifically:
[0016] Determine whether the brand, model and color of the vehicle in the associated photo are consistent with those in the photo of the vehicle to be identified.
[0017] In the license plate information repair method based on historical data, the step (33) specifically includes the following steps:
[0018] (33-1) determining the time and location of photo shooting based on the photo information of the associated photo;
[0019] (33-2) Determine whether the time and location of taking the associated photo are inconsistent with the time and location of taking the photo of the vehicle to be identified. If not, proceed to step (4); if so, prompt that the license plate is wrong and exit this method.
[0020] In the method for repairing license plate information based on historical data, the following steps are further included after step (33-1):
[0021] (33-1a) drawing a vehicle's travel trajectory based on the time and location of shooting of the plurality of related photos;
[0022] (33-1b) Determine whether the driving trajectory is inconsistent with the shooting time and location of the vehicle photo to be identified. If not, enter step (33-2); if so, prompt that the license plate is wrong and exit this method.
[0023] In the license plate information repair method based on historical data, the driving trajectory includes a trajectory between a starting point and an end point determined according to the time and location of taking the associated photos, and also includes a habitual driving trajectory of the vehicle.
[0024] In the license plate information repair method based on historical data, the step (2) specifically includes the following steps:
[0025] (21) Determine the license plate type information and the license plate province information according to the initial license plate information, and determine the corresponding numbering rules;
[0026] (22) Determine whether the initial license plate information is correct according to the numbering rule. If not, proceed to step (3); if correct, exit this method.
[0027] In the license plate information repair method based on historical data, in the step (22), when it is determined that the initial license plate information is incorrect, the following steps are also included:
[0028] Determine whether the incorrect initial license plate information can be automatically repaired according to the encoding rules. If so, repair it and exit the method; if not, enter step (3).
[0029] The present invention also provides a license plate information repair system based on historical data, the system includes a processor and a memory, the memory stores an application program, and when the processor reads and runs the application program, the above-mentioned license plate information repair method based on historical data is implemented.
[0030] The license plate information repair method and system based on historical data of the invention can search the system historical data and obtain related photos when it is determined that the initial license plate information is wrong. The vehicle driving trajectory and driving habits are analyzed through the related photos, thereby realizing automatic and accurate license plate information repair. The license plate information repair method of the invention does not require manual operation and has a high degree of automation. At the same time, it can greatly improve the license plate recognition accuracy of vehicle photos taken by road monitoring equipment, thereby providing convenience for subsequent traffic data aggregation and big data applications. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] Figure 1 The present invention is a flowchart of the steps of the method for repairing license plate information based on historical data. DETAILED DESCRIPTION
[0032] In order to more clearly understand the technical content of the present invention, the following embodiments are given in detail.
[0033] See also Figure 1 Shown is a flowchart of the steps of the license plate information repair method based on historical data of the present invention.
[0034] In one embodiment, the license plate information repair method based on historical data includes:
[0035] (1) Recognize the license plate image in the vehicle photo and obtain the initial license plate information;
[0036] (2) analyzing the initial license plate information based on the numbering rule to determine whether it is incorrect license plate information. If it is incorrect license plate information, proceed to step (3); if it is correct license plate information, exit this method;
[0037] (3) searching for related photos in historical data according to the initial license plate information and the photo information of the vehicle photo, and obtaining the license plate information of the related photos;
[0038] (4) Using the associated photo license plate information to repair the erroneous license plate information.
[0039] In a more preferred embodiment, the step (3) specifically comprises:
[0040] (31) confirming the error position of the erroneous license plate information, and retrieving the matching information in the historical data in a default form of the error position as an associated photo;
[0041] (32) determining whether the vehicle image in the associated photo matches the vehicle image in the vehicle photo to be identified, if so, proceeding to step (33), if not, prompting that the license plate is wrong and exiting the method;
[0042] (33) Determine whether the photo information of the associated photo is inconsistent with the photo information of the vehicle photo to be identified. If not, proceed to step (4); if so, prompt that the license plate is wrong and exit this method.
[0043] In a further preferred embodiment, the step (32) of determining whether the vehicle image in the associated photo matches the vehicle image in the vehicle photo to be identified is specifically as follows:
[0044] Determine whether the brand, model and color of the vehicle in the associated photo are consistent with those in the photo of the vehicle to be identified.
[0045] In another preferred embodiment, the step (33) specifically comprises the following steps:
[0046] (33-1) determining the time and location of photo shooting based on the photo information of the associated photo;
[0047] (33-2) Determine whether the time and location of taking the associated photo are inconsistent with the time and location of taking the photo of the vehicle to be identified. If not, proceed to step (4); if so, prompt that the license plate is wrong and exit this method.
[0048] In a further preferred embodiment, after step (33-1), the following steps are also included:
[0049] (33-1a) drawing a vehicle's travel trajectory based on the time and location of shooting of the plurality of related photos;
[0050] (33-1b) Determine whether the driving trajectory is inconsistent with the shooting time and location of the photo of the vehicle to be identified. If not, enter step (33-2); if so, prompt that the license plate is wrong and exit this method.
[0051] In a further preferred embodiment, the driving trajectory includes a trajectory between a starting point and an end point determined according to the time and location of taking the associated photos, and also includes a habitual driving trajectory of the vehicle.
[0052] In another preferred embodiment, the step (2) specifically comprises the following steps:
[0053] (21) Determine the license plate type information and the license plate province information according to the initial license plate information, and determine the corresponding numbering rules;
[0054] (22) Determine whether the initial license plate information is correct according to the numbering rule. If not, proceed to step (3); if correct, exit this method.
[0055] In a more preferred embodiment, in the case where it is determined that the initial license plate information is incorrect in step (22), the following steps are further included:
[0056] Determine whether the incorrect initial license plate information can be automatically repaired according to the encoding rules. If so, repair it and exit the method; if not, enter step (3).
[0057] The present invention also provides a license plate information repair system based on historical data, the system includes a processor and a memory, the memory stores an application program, and when the processor reads and runs the application program, the above-mentioned license plate information repair method based on historical data is implemented.
[0058] In practical applications, the license plate information repair method and system based on historical data of the present invention can realize the repair and cleaning of original license plate data, and provide a basis for forming a big data system of vehicle driving data associated with license plates, as well as subsequent big data applications.
[0059] Firstly, the license plate information in the vehicle photo can be cleaned according to the basic logic rules of the license plate coding, and the logically invalid license plate information data can be marked, and then the method of the present invention can be used to repair the erroneous license plate information data.
[0060] Specifically, the repair method of the present invention may include the following aspects:
[0061] (1) Determine the driving path of the vehicle based on the found related photos to determine whether the shooting time and location of the vehicle photo including the license plate information to be repaired is on this driving path. If it is on this path, the license plate information can be repaired using the information in the related photos. For example, based on the license plate, search and obtain its passage record in the vehicle toll collection data, simulate and generate the driving route, and use the correct data of the entrance and exit to correct the wrong license plate number.
[0062] (2) Determine the behavior of the vehicle based on the associated photos found. Specifically, determine whether the time point, location, and driver information of the associated photos are consistent with the vehicle photo of the license plate information that needs to be repaired. If they are consistent, the information of the associated photos can be used to repair the license plate information. This behavior judgment not only includes the case where the driving path is consistent, but also includes the case where a single driving path cannot be determined, but the information to be repaired is consistent with the long-term behavior of the vehicle, thereby increasing the possibility of successful matching of the associated photos and improving the efficiency of license plate information repair.
[0063] (3) In addition to the above-mentioned driving route comparison and behavior pattern comparison, the license plate information can also be cleaned and repaired by referring to other business data related to the vehicle, including entry and exit station codes, entry and exit station times, total vehicle and cargo weight, payment method, vehicle type, weight limit, etc., thereby further improving the possibility of successful matching of associated photos.
[0064] (4) In addition, before using the above-mentioned driving path comparison and behavior pattern comparison, the license plate coding rules can also be used to perform rule repair on some erroneous license plates in advance. This type of rule repair includes coding rules based on vehicle types and regional coding rules. For example, when a new energy vehicle is identified based on the color of the license plate, the third or last digit is repaired to D / F; for example, the "I" in the license plate is automatically repaired to "1" based on the coding rules of some regions, and so on. The coding rule repair method can be used first to correct a certain number of erroneous license plates and reduce the number of remaining erroneous license plates, so that the repaired license plates do not need to query historical data for repair, reducing the system burden.
[0065] The license plate information repair method and system based on historical data of the invention can search the system historical data and obtain related photos when it is determined that the initial license plate information is wrong. The vehicle driving trajectory and driving habits are analyzed through the related photos, thereby realizing automatic and accurate license plate information repair. The license plate information repair method of the invention does not require manual operation and has a high degree of automation. At the same time, it can greatly improve the license plate recognition accuracy of vehicle photos taken by road monitoring equipment, thereby providing convenience for subsequent traffic data aggregation and big data applications.
[0066] In this specification, the present invention has been described with reference to specific embodiments thereof. However, it is apparent that various modifications and variations may be made without departing from the spirit and scope of the present invention. Therefore, the specification and drawings should be regarded as illustrative rather than restrictive.
Claims
1. A license plate information repair method based on historical data, characterized in that: The method includes: (1) Recognize the license plate image in the vehicle photo and obtain the initial license plate information; (2) analyzing the initial license plate information based on the numbering rule to determine whether it is incorrect license plate information. If it is incorrect license plate information, proceed to step (3); if it is correct license plate information, exit this method; (3) confirming the error position of the erroneous license plate information, retrieving the matching information in the historical data in the default form of the error position as the associated photo, and if the vehicle image in the associated photo matches the vehicle image in the photo of the vehicle to be identified, obtaining the license plate information of the associated photo; if the driving track formed by the time and location information of the associated photo is not inconsistent with the time and location information of the photo of the vehicle to be identified, proceeding to step (4); if there is a contradiction, determining the behavior of the vehicle based on the found associated photos, and judging whether the time point, location and driver information of the associated photo are consistent with those in the photo of the vehicle with the erroneous license plate information; if they are consistent, proceeding to step (4); (4) Using the associated photo license plate information to repair the erroneous license plate information.
2. The license plate information repair method based on historical data according to claim 1 is characterized in that: If the vehicle image in the associated photo matches the vehicle image in the vehicle photo to be identified, specifically: Determine whether the brand, model and color of the vehicle in the associated photo are consistent with those in the photo of the vehicle to be identified.
3. The license plate information repair method based on historical data according to claim 1 is characterized in that: The driving trajectory includes a trajectory between a starting point and an end point determined according to the time and location of taking the associated photos, and also includes a habitual driving trajectory of the vehicle.
4. The license plate information repair method based on historical data according to claim 1 is characterized in that: The step (2) specifically comprises the following steps: (21) Determine the license plate type information and the license plate province information according to the initial license plate information, and determine the corresponding numbering rules; (22) Determine whether the initial license plate information is correct according to the numbering rule. If not, proceed to step (3); if correct, exit this method.
5. The license plate information repair method based on historical data according to claim 4 is characterized in that: In the step (22), when it is determined that the initial license plate information is incorrect, the following steps are also included: Determine whether the incorrect initial license plate information can be automatically repaired according to the numbering rules. If so, repair it and exit the method; if not, enter step (3).
6. A license plate information repair system based on historical data, characterized in that: The invention comprises a processor and a memory, wherein the memory stores an application program, and when the processor reads and runs the application program, the license plate information repair method based on historical data as claimed in any one of claims 1 to 5 is implemented.
