A License Plate Camera Accuracy Self-Checking System and Method Based on a Multimodal Model

Abstract

The present invention provides a license plate camera accuracy self-checking system and method based on a multimodal model, belonging to the field of image recognition technology, and specifically comprising: a license plate sampling inspection module is responsible for extracting a preset number of license plate numbers and their corresponding identification pictures from the recognition results of the license plate recognition camera every day; a result verification module is responsible for submitting the identification pictures to multiple third-party large models for recognition to obtain recognition results, and using the comparison results between the recognition results and the license plate numbers to determine whether a reminder is needed; a verification result notification module is responsible for automatically notifying relevant personnel to inspect the license plate camera when a reminder is needed, thereby improving the efficiency of recognition processing of abnormal license plate camera accuracy.

Description

Technical Field

[0001] The present invention relates to the field of image recognition technology, and in particular to a license plate camera accuracy self-checking system and method based on a multimodal model, which is suitable for scenarios such as intelligent transportation systems and parking lot management systems that require real-time monitoring of license plate recognition accuracy. Background Art

[0002] With the popularization of intelligent transportation systems and parking management systems, license plate recognition cameras serve as core equipment to identify and process vehicle license plates.

[0003] However, for the vehicle license plate recognition system, its recognition accuracy directly affects the system reliability and user experience. Existing license plate recognition systems usually lack an effective self-checking mechanism and cannot monitor the recognition accuracy in real time, resulting in recognition errors being difficult to detect and correct in a timely manner.

[0004] In response to the above technical problems, this application specifically provides a license plate camera self-inspection and accuracy monitoring method based on a multimodal model. Summary of the Invention

[0005] To achieve the purpose of the present invention, the present invention adopts the following technical solutions:

[0006] In a first aspect, the present application provides a license plate camera accuracy self-test system based on a multimodal model, specifically comprising:

[0007] License plate sampling module, result verification module, verification result notification module;

[0008] The license plate sampling module is responsible for extracting a preset number of license plate numbers and their corresponding identification pictures from the recognition results of the license plate recognition camera every day;

[0009] The result verification module is responsible for submitting the recognition image to multiple third-party large models for recognition to obtain recognition results, and using the recognition results to compare with the license plate number to determine whether a reminder is needed;

[0010] The verification result notification module is responsible for automatically notifying relevant personnel to conduct license plate camera inspection when a reminder is required.

[0011] The beneficial effects of the present invention are:

[0012] By introducing multimodal model verification, cross-validation of license plate recognition results is achieved, and the reliability of recognition accuracy is improved.

[0013] The majority voting mechanism can automatically trigger manual intervention when the recognition results are inconsistent, ensuring that the problem is handled in a timely manner.

[0014] Through daily sampling testing, the recognition accuracy of the license plate recognition camera can be monitored in real time to ensure the long-term stable operation of the system.

[0015] A further technical solution is that the third-party model calls the third-party large model through an API interface to perform license plate recognition.

[0016] A further technical solution is to use the comparison result of the recognition result with the license plate number to determine whether a reminder is needed, specifically including:

[0017] When it is determined, based on the comparison between the license plate number and the recognition results of different third-party models, that there is no recognition result inconsistent with the license plate number, it is determined that no reminder is required;

[0018] When there is an identification result that is inconsistent with the license plate number, the third-party model is divided into multiple model groups according to whether the identification results are consistent. The number of third-party models consistent with the license plate number is added by 1 as the target number. When there is a model group in which the number of third-party models is greater than the target number, it is determined that a reminder is required.

[0019] A further technical solution is that the verification result notification module is triggered by email, text message or system notification.

[0020] In a second aspect, the present application provides a license plate camera accuracy self-test method based on a multimodal model, which is applied to the above-mentioned license plate camera accuracy self-test system based on a multimodal model, specifically comprising:

[0021] S1 obtains recognition deviation data of the license plate camera within a preset time period, and uses the recognition deviation data to determine whether the recognition processing accuracy of the license plate camera meets the requirements, and then proceeds to the next step;

[0022] S2 determines, based on the environmental data of the license plate camera in different time periods, recognition deviation data of the license plate camera under similar environmental data in the time periods, and determines the recognition deviation probability type of the time periods using the recognition deviation data under similar environmental data in the time periods;

[0023] S3 determines the number of license plates extracted by the license plate camera on the current date based on the recognition data of license plates in time periods of different recognition deviation probability types on the current date;

[0024] S4 uses the extraction quantity as a constraint condition, and uses the recognition deviation data under similar environmental data in the time period and the recognition data of the license plate to determine the extraction target time period and the number of license plates to be extracted in the time period, and determines whether it is necessary to dynamically adjust the extraction strategy of the current date based on the comparison result of the license plates in the extraction target time period.

[0025] A further technical solution is that the recognition deviation data of the license plate camera includes the number of recognition deviations of the license plate camera and environmental data corresponding to different recognition deviation numbers.

[0026] A further technical solution is that the environmental data includes light intensity.

[0027] A further technical solution is to determine whether the recognition accuracy of the license plate camera meets the requirements, specifically including:

[0028] Determine the number of recognition deviations of the license plate camera using the recognition deviation data of the license plate camera, and determine the number of recognition deviations within different illumination intervals using the illumination corresponding to different recognition deviations.

[0029] Based on the number of identification deviations in different light intensity intervals, the number of identification deviations in a preset light intensity interval is performed;

[0030] Whether the recognition processing accuracy of the license plate camera meets the requirements is determined by the number of recognition deviations within a preset light intensity range.

[0031] A further technical solution is that the preset light intensity interval is an interval in which the light intensity is less than a preset light intensity threshold.

[0032] A further technical solution is to determine whether the recognition processing accuracy of the license plate camera meets the requirements by the number of recognition deviations within a preset illumination range, which specifically includes:

[0033] When the number of recognition deviations within the preset illumination interval is greater than the preset number of deviations, it is determined that the recognition processing accuracy of the license plate camera does not meet the requirement.

[0034] A further technical solution is to determine whether it is necessary to dynamically adjust the extraction strategy of the current date, specifically including:

[0035] Determining the number of recognition deviations of the license plates in different extraction target periods based on the comparison results of the license plates in the extraction target period;

[0036] Determining recognition deviation ratios for different extraction target periods according to ratios of the number of recognition deviations of license plates in different extraction target periods to the number of extracted license plates;

[0037] The identification deviation ratio of different extraction target periods is used to determine whether dynamic adjustment of the extraction strategy for the current date is required.

[0038] A further technical solution is to determine whether it is necessary to dynamically adjust the extraction strategy for the current date based on the recognition deviation ratios of different extraction target periods, specifically including:

[0039] When the average value of the recognition deviation ratios of different extraction target periods is greater than a preset deviation ratio threshold, it is determined that a dynamic adjustment of the extraction strategy for the current date is required.

[0040] Other features and advantages will be described in the following description. The objectives and other advantages of the present invention are realized and obtained by the structures particularly pointed out in the description and drawings.

[0041] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] The above and other features and advantages of the present invention will become more apparent by describing in detail example embodiments thereof with reference to the accompanying drawings;

[0043] Figure 1 This is a framework diagram of a license plate camera accuracy self-checking system based on a multimodal model;

[0044] Figure 2 It is a flow chart of a self-checking method for the accuracy of a license plate camera based on a multimodal model;

[0045] Figure 3 It is a flow chart to determine whether the recognition processing accuracy of the license plate camera meets the requirements;

[0046] Figure 4 is a flow chart of a method for determining a type of identification deviation probability for a time period;

[0047] Figure 5 This is a flow chart of a method for determining the number of license plates extracted by a license plate camera on the current date. DETAILED DESCRIPTION

[0048] To help those skilled in the art better understand the technical solutions in this specification, the following will provide a clear and complete description of the technical solutions in the embodiments of this specification, in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of this specification, not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this specification without creative work should fall within the scope of protection of this specification.

[0049] This paper proposes a self-test and accuracy monitoring method for license plate recognition cameras based on multimodal model verification. Through daily sampling, multimodal model verification, result comparison, and manual intervention, it enables real-time monitoring and automatic correction of the license plate recognition camera's recognition accuracy.

[0050] The technical solutions of the present invention are as follows:

[0051] 1. Daily sampling test: Randomly sample the license plate number A1 and its corresponding recognition image B from the license plate recognition camera's recognition results once a day.

[0052] 2. Multimodal model verification: Submit image B to two third-party large models (such as DeepSeek-Version and Gpt-4V) for recognition, and obtain license plate numbers A2 and A3.

[0053] 3. Result comparison:

[0054] Consistency verification: If A1, A2, and A3 are completely consistent, the recognition result is considered accurate.

[0055] Majority voting mechanism: If the three are inconsistent, the majority vote principle is adopted, that is, the majority result is considered correct. If A1 is in the minority, manual intervention is automatically triggered to further investigate the problem.

[0056] 4. Human intervention: When A1 is in the minority, the system automatically notifies relevant personnel to conduct an inspection to ensure the accuracy of the recognition system.

[0057] Example 1 Figure 1 As shown, the present application provides a license plate camera accuracy self-test system based on a multimodal model, specifically including:

[0058] License plate sampling module, result verification module, verification result notification module;

[0059] The license plate sampling module is responsible for extracting a preset number of license plate numbers and their corresponding identification pictures from the recognition results of the license plate recognition camera every day;

[0060] The result verification module is responsible for submitting the recognition image to multiple third-party large models for recognition to obtain recognition results, and using the recognition results to compare with the license plate number to determine whether a reminder is needed;

[0061] The verification result notification module is responsible for automatically notifying relevant personnel to conduct license plate camera inspection when a reminder is required.

[0062] Furthermore, the third-party model calls the third-party large model through the API interface to perform license plate recognition.

[0063] Specifically, the comparison result between the recognition result and the license plate number is used to determine whether a reminder is needed, which specifically includes:

[0064] When it is determined, based on the comparison between the license plate number and the recognition results of different third-party models, that there is no recognition result inconsistent with the license plate number, it is determined that no reminder is required;

[0065] When there is an identification result that is inconsistent with the license plate number, the third-party model is divided into multiple model groups according to whether the identification results are consistent. The number of third-party models consistent with the license plate number is added by 1 as the target number. When there is a model group in which the number of third-party models is greater than the target number, it is determined that a reminder is required.

[0066] It should be noted that the verification result notification module is triggered by email, text message or system notification.

[0067] In one specific embodiment, the following is the core code related to this application:

[0068] import requests

[0069] def fetch_third_party_recognition(image_path, model_api_url):

[0070] # Call the API interface of the third-party model for license plate recognition

[0071] response = requests.post(model_api_url, files={'image': open(image_path, 'rb')})

[0072] if response.status_code == 200:

[0073] return response.json().get('license_plate')

[0074] else:

[0075] return None

[0076] def daily_self_check(license_plate_a1, image_b):

[0077] Third-party model validation

[0078] license_plate_a2 = fetch_third_party_recognition(image_b, 'https: / / api.deepseek.com / recognize')

[0079] license_plate_a3 = fetch_third_party_recognition(image_b, 'https: / / api.openai.com / recognize')

[0080] # Result comparison

[0081] if license_plate_a1 == license_plate_a2 == license_plate_a3:

[0082] print("The recognition results are consistent, the system is normal.")

[0083] else:

[0084] # Majority voting mechanism

[0085] majority_vote = max([license_plate_a1, license_plate_a2,license_plate_a3], key=[license_plate_a1, license_plate_a2, license_plate_a3].count)

[0086] if license_plate_a1 != majority_vote:

[0087] print("The recognition results are inconsistent, triggering manual intervention.")

[0088] # Notify relevant personnel

[0089] notify_operator(license_plate_a1, majority_vote)

[0090] def notify_operator(original_plate, majority_plate):

[0091] # Send notifications to relevant personnel

[0092] print(f"Notice: The original recognition result {original_plate} is inconsistent with the majority voting result {majority_plate}, please check the system.")

[0093] # You can add email or SMS notification code here

[0094] # Example call

[0095] daily_self_check('A12345', 'path_to_image_b.jpg')

[0096] In the second aspect of embodiment 2, Figure 2 As shown, the present application provides a license plate camera accuracy self-test method based on a multimodal model, which is applied to the above-mentioned license plate camera accuracy self-test system based on a multimodal model, specifically including:

[0097] S1 obtains recognition deviation data of the license plate camera within a preset time period, and uses the recognition deviation data to determine whether the recognition processing accuracy of the license plate camera meets the requirements, and then proceeds to the next step;

[0098] Furthermore, the recognition deviation data of the license plate camera includes the number of recognition deviations of the license plate camera and environmental data corresponding to different recognition deviation numbers.

[0099] Specifically, the environmental data includes light intensity.

[0100] Specifically, such as Figure 3 As shown, determining whether the recognition accuracy of the license plate camera meets the requirements specifically includes:

[0101] Determine the number of recognition deviations of the license plate camera using the recognition deviation data of the license plate camera, and determine the number of recognition deviations within different illumination intervals using the illumination corresponding to different recognition deviations.

[0102] Based on the number of identification deviations in different light intensity intervals, the number of identification deviations in a preset light intensity interval is performed;

[0103] Whether the recognition processing accuracy of the license plate camera meets the requirements is determined by the number of recognition deviations within a preset light intensity range.

[0104] Optionally, the preset light intensity interval is an interval in which the light intensity is less than a preset light intensity threshold.

[0105] It is understandable that determining whether the recognition processing accuracy of the license plate camera meets the requirements by the number of recognition deviations within the preset illumination range specifically includes:

[0106] When the number of recognition deviations within the preset illumination interval is greater than the preset number of deviations, it is determined that the recognition processing accuracy of the license plate camera does not meet the requirement.

[0107] Specifically, when the recognition processing accuracy of the license plate camera does not meet the requirement, the set number is used to determine the number of license plates extracted by the license plate camera on the current date.

[0108] In another possible embodiment, determining whether the recognition processing accuracy of the license plate camera meets the requirements specifically includes:

[0109] Determine the number of recognition deviations of the license plate camera using the recognition deviation data of the license plate camera;

[0110] Using the number of recognition deviations of the license plate camera on different dates, determining the recognition deviation date in the date;

[0111] Based on the number of the recognition deviation dates, it is determined whether the recognition processing accuracy of the license plate camera meets the requirements.

[0112] It should be noted that when the proportion of the number of recognition deviation dates within the preset time period is greater than the proportion of the number of preset dates, it is determined that the recognition processing accuracy of the license plate camera does not meet the requirements.

[0113] In another possible embodiment, determining whether the recognition processing accuracy of the license plate camera meets the requirements specifically includes:

[0114] Determining the number of recognition deviations of the license plate camera using the recognition deviation data of the license plate camera, and when the number of recognition deviations of the license plate camera does not meet the requirement, determining that the recognition processing accuracy of the license plate camera does not meet the requirement;

[0115] When the number of recognition deviations of the license plate camera meets the requirements:

[0116] Obtaining the number of recognition deviations of the license plate camera, using the illumination of the license plate camera on different dates and the illumination corresponding to different recognition deviations, determining the number of recognition deviations within different illumination intervals, and determining that the recognition processing accuracy of the license plate camera does not meet the requirements when the number of recognition deviations within the preset illumination interval does not meet the requirements;

[0117] When the number of identification deviations within the preset light intensity range meets the requirements:

[0118] Determining the number of recognition deviations of the license plate camera on different dates using recognition data of the license plate camera on different dates, and determining that the recognition processing accuracy of the license plate camera does not meet the requirements when determining that the license plate camera has a recognition deviation date using the number of recognition deviations of the license plate camera on different dates;

[0119] When the license plate camera does not have a recognition deviation date:

[0120] Obtaining the number of recognition deviations on different dates, and combining the light levels corresponding to the different recognition deviation numbers, determining that the recognition processing deviation rate of the license plate camera does not meet the requirements when the number of recognition deviations within a preset light level range does not meet the requirements on the date;

[0121] When there is no date on which the number of identified deviations within the preset light intensity range does not meet the requirements:

[0122] Determining recognition deviation coefficients for different dates based on the number of recognition deviations on different dates and the amounts of light corresponding to the different recognition deviations, and determining that the recognition processing deviation rate of the license plate camera does not meet the requirements when there is a date on which the recognition deviation coefficient does not meet the requirements;

[0123] When there is no date on which the identification coefficient of variation does not meet the requirements:

[0124] The recognition deviation amount of the license plate camera is determined based on the recognition deviation coefficients of different dates within a preset time period, and the recognition deviation amount is used to determine whether the recognition processing accuracy of the license plate camera meets the requirements.

[0125] Furthermore, the recognition deviation is used to determine whether the recognition processing accuracy of the license plate camera meets the requirements, specifically including:

[0126] When the recognition deviation of the license plate camera is within a preset deviation range, it is determined that the recognition processing accuracy of the license plate camera does not meet the requirement.

[0127] S2 determines, based on the environmental data of the license plate camera in different time periods, recognition deviation data of the license plate camera under similar environmental data in the time periods, and determines the recognition deviation probability type of the time periods using the recognition deviation data under similar environmental data in the time periods;

[0128] Specifically, the similar environmental data is environmental data whose deviation from the light intensity of the time period is within a preset light intensity deviation range.

[0129] It is understandable that if Figure 4 As shown, the method for determining the identification deviation probability type of the time period is:

[0130] Determine the number of recognition deviations under the similar environmental data based on the recognition deviation data under the similar environmental data in the time period;

[0131] determining a recognition deviation ratio based on a ratio of the number of recognition deviations under the similar environment data to the number of recognition processing under the similar environment data;

[0132] The recognition deviation number and the recognition deviation ratio are used to determine the recognition deviation probability of the time period, and the recognition deviation probability type of the time period is determined according to the recognition deviation probability.

[0133] Furthermore, the recognition deviation probability of the time period is determined based on the product of a preset weight coefficient corresponding to the number of recognition deviations and the recognition deviation ratio.

[0134] It should be noted that determining the identification deviation probability type of the time period according to the identification deviation probability specifically includes:

[0135] When the identification deviation probability of the time period is within the preset deviation probability range, determining the identification deviation probability type of the time period as a first-class deviation probability type;

[0136] When the recognition deviation probability of the time period is not within the preset deviation probability range, it is determined that the recognition deviation probability type of the time period is a second-class deviation probability type.

[0137] S3 determines the number of license plates extracted by the license plate camera on the current date based on the recognition data of license plates in time periods of different recognition deviation probability types on the current date;

[0138] It is understandable that if Figure 5 As shown, the method for determining the number of license plates extracted by the license plate camera on the current date is:

[0139] Based on the license plate recognition data of the license plate camera in different recognition deviation probability types during the current date, determining the recognition quantity ratio of the license plates corresponding to the different recognition deviation probability types on the current date;

[0140] Determining the bias weight coefficients of different recognition bias probability types using the preset bias weight coefficients corresponding to the different recognition bias probability types;

[0141] The extraction requirement coefficient of the license plate camera is determined based on the sum of the product of the proportion of the number of license plates corresponding to different recognition deviation probability types on the current date and the deviation weight coefficient, and the extraction requirement coefficient is used to determine the number of license plates extracted by the license plate camera on the current date.

[0142] Furthermore, the number of license plates to be extracted by the license plate camera on the current date is determined by utilizing the extraction demand coefficient, specifically including:

[0143] The product of the extraction demand coefficient and the number of license plates recognized by the license plate camera on the current date is used as the number of license plates extracted by the license plate camera on the current date.

[0144] In another embodiment, the method for determining the number of license plates extracted by the license plate camera on the current date is:

[0145] Determining the number of license plates recognized by the license plate camera on the current date based on recognition data of the license plate camera on the current date;

[0146] Based on the license plate recognition data of the license plate camera during time periods with different recognition deviation probability types, determining the proportion of the number of recognitions of license plates corresponding to different recognition deviation probability types on the current date, and determining the proportion of the number of recognitions of license plates corresponding to a type of deviation probability type on the current date;

[0147] The number of license plates extracted by the license plate camera on the current date is determined by multiplying the number of license plates recognized by the license plate camera on the current date by the proportion of the number of license plates recognized on the current date corresponding to a type of deviation probability type.

[0148] In another possible embodiment, the method for determining the number of license plates extracted by the license plate camera on the current date is:

[0149] Determining the number of license plates recognized by the license plate camera on the current date based on recognition data of the license plate camera on the current date, and when the number of license plates recognized by the license plate camera on the current date is greater than a preset number of license plates recognized, determining the number of license plates extracted by the license plate camera on the current date using the set number;

[0150] When the number of license plates recognized by the license plate camera on the current day is not greater than the preset number of license plates recognized:

[0151] When the number of license plates recognized by the license plate camera on the current date is less than a preset number threshold, the number of license plates recognized by the license plate camera on the current date is used to determine the number of license plates extracted by the license plate camera on the current date;

[0152] When the number of license plates recognized by the license plate camera on the current day is not less than a preset number threshold:

[0153] Determining the number of license plates recognized on the current date corresponding to a certain type of deviation probability based on the license plate recognition data of the license plate camera during different time periods of the recognition deviation probability type on the current date, and when the number of license plates recognized on the current date corresponding to a certain type of deviation probability does not meet the requirement, determining the number of license plates extracted by the license plate camera on the current date using a set number;

[0154] When the number of license plates corresponding to a type of deviation probability meets the requirements on the current date:

[0155] Determining the proportion of license plates corresponding to different recognition deviation probability types on the current date, and determining a recognition weight value corresponding to a type of deviation type based on the number of license plates recognized on the current date corresponding to a type of deviation probability type; when the recognition weight value is greater than a preset weight threshold, using the set number to determine the number of license plates extracted by the license plate camera on the current date;

[0156] When the recognition weight value is not greater than the preset weight threshold:

[0157] Determining the bias weight coefficients of different recognition bias probability types using the preset bias weight coefficients corresponding to the different recognition bias probability types;

[0158] The extraction requirement coefficient of the license plate camera is determined based on the sum of the product of the proportion of the number of license plates corresponding to different recognition deviation probability types on the current date and the deviation weight coefficient, and the extraction requirement coefficient is used to determine the number of license plates extracted by the license plate camera on the current date.

[0159] S4 uses the extraction quantity as a constraint condition, and uses the recognition deviation data under similar environmental data in the time period and the recognition data of the license plate to determine the extraction target time period and the number of license plates to be extracted in the time period, and determines whether it is necessary to dynamically adjust the extraction strategy of the current date based on the comparison result of the license plates in the extraction target time period.

[0160] Furthermore, the method for determining the target time period in the time period is:

[0161] Based on the recognition deviation data under the similar environment data in the time period, determining the number of recognition deviations under the similar environment data in the time period, and using it as the number of matching deviations;

[0162] Determining the number of license plates recognized during the time period using the license plate recognition data during the time period;

[0163] The number of matching deviations and the number of recognized license plates are used to determine whether the time period is an extraction target time period.

[0164] Specifically, the number of matching deviations and the number of license plate recognitions are used to determine whether the time period is a target time period for extraction, specifically including:

[0165] When any one of the number of matching deviations and the number of recognized license plates in the time period is not within a preset range, the time period is determined to be an extraction target time period.

[0166] It should be noted that the method for determining the number of license plates to be drawn during the target drawing period is as follows:

[0167] Determining the sum of weight coefficients for different extraction target time periods based on the sum of preset weight coefficients corresponding to the number of matching deviations in the extraction target time period and preset weight coefficients corresponding to the number of recognized license plates;

[0168] After normalizing the weight coefficients of different extraction target periods, the extraction proportional factors of different extraction target periods are obtained;

[0169] The number of license plates extracted during the target extraction period is determined by multiplying the extraction scale factor by the number of extractions.

[0170] Optionally, a method for determining the target time period in the time period is:

[0171] S41 uses the recognition data of the license plates in the time period to determine the number of license plates recognized in the time period, and determines the recognition processing busyness value of the time period in combination with the proportion of the number of license plates recognized in the time period to the number of the current date;

[0172] Optionally, the above step S41 includes the following contents:

[0173] S411 uses the recognition data of the license plates in the time period to determine the number of license plates recognized in the time period. When the number of license plates recognized in the time period is greater than a preset number of license plates, the time period is determined to be a target time period for extraction. When the number of license plates recognized in the time period is not greater than the preset number of license plates, the process proceeds to step S412.

[0174] S412 obtains the percentage of the number of license plates recognized in the time period on the current date. When the percentage of the number of license plates recognized in the time period on the current date is greater than the preset percentage, proceed to step S414. When the percentage of the number of license plates recognized in the time period on the current date is not greater than the preset percentage, proceed to step S413.

[0175] S413: When the number of license plate recognitions in the time period is within the preset recognition number range, it is determined that the time period does not belong to the extraction target time period; when the number of license plate recognitions in the time period is not within the preset recognition number range, the process proceeds to step S414;

[0176] S414 determines the recognition processing busy value of the time period based on the number of license plates recognized in the time period and the proportion of the number of license plates recognized in the time period to the number on the current date. When the recognition processing busy value of the time period is greater than the preset busy threshold, the time period is determined to be the extraction target time period. When the recognition processing busy value of the time period is not greater than the preset busy threshold, proceed to step S42.

[0177] S42 determines the number of recognition deviations under the similar environment data in the period based on the recognition deviation data under the similar environment data in the period, and uses it as the number of matching deviations. Based on the number of matching deviations in historical periods corresponding to different similar environment data and the number of recognized license plates, determines the recognition deviation value of the period;

[0178] Optionally, the above step S42 includes the following contents:

[0179] S421 determines the number of identification deviations under the similar environmental data of the time period based on the identification deviation data under the similar environmental data of the time period, and uses it as the number of matching deviations. When the number of matching deviations is greater than a preset deviation number threshold, it is determined that the time period belongs to the extraction target time period. When the number of matching deviations is not greater than the preset deviation number threshold, the process proceeds to step S422.

[0180] If it is determined in step S422 that there is a historical period in which the number of matching deviations does not meet the requirement based on the number of matching deviations in the historical periods corresponding to different similar environment data, the process proceeds to step S423; if there is no historical period in which the number of matching deviations does not meet the requirement, the process proceeds to step S424;

[0181] S423: When the number of historical periods in which the number of matching deviations does not meet the requirement is greater than the preset period number threshold, it is determined that the period belongs to the extraction target period. When the number of historical periods in which the number of matching deviations does not meet the requirement is not greater than the preset period number threshold, the process proceeds to step S424.

[0182] S424 determines the recognition deviation value of the time period based on the number of matching deviations and the number of license plates recognized in the historical time periods corresponding to different similar environmental data. When the recognition deviation value of the time period is greater than the preset deviation threshold, it is determined that the time period belongs to the extraction target time period. When the recognition deviation value of the time period is not greater than the preset deviation threshold, it proceeds to step S43.

[0183] S43 determines a target matching value for the time period by using an average value of the recognition processing busyness value and the recognition deviation value for the time period, and determines whether the time period is an extraction target time period according to the target matching value.

[0184] It should be noted that determining whether the current date extraction strategy needs to be dynamically adjusted specifically includes:

[0185] Determining the number of recognition deviations of the license plates in different extraction target periods based on the comparison results of the license plates in the extraction target period;

[0186] Determining recognition deviation ratios for different extraction target periods according to ratios of the number of recognition deviations of license plates in different extraction target periods to the number of extracted license plates;

[0187] The identification deviation ratio of different extraction target periods is used to determine whether dynamic adjustment of the extraction strategy for the current date is required.

[0188] Specifically, the identification deviation ratios of different extraction target periods are used to determine whether the extraction strategy for the current date needs to be dynamically adjusted, including:

[0189] When the average value of the recognition deviation ratios of different extraction target periods is greater than a preset deviation ratio threshold, it is determined that a dynamic adjustment of the extraction strategy for the current date is required.

[0190] The various embodiments in this specification are described in a progressive manner. Similar portions between the various embodiments can be referenced to each other, and each embodiment focuses on the differences from the other embodiments. In particular, the device, apparatus, and non-volatile computer storage medium embodiments are generally similar to the method embodiments, so their descriptions are relatively simplified. For relevant details, refer to the descriptions of the method embodiments.

[0191] The foregoing description of this specification describes specific embodiments. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that described in the embodiments and still achieve the desired results. Furthermore, the processes depicted in the accompanying drawings do not necessarily require the specific order shown or the sequential order to achieve the desired results. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0192] The foregoing description is merely one or more embodiments of this specification and is not intended to limit this specification. It will be apparent to those skilled in the art that various modifications and variations may be made to one or more embodiments of this specification. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of one or more embodiments of this specification are intended to be within the scope of the claims of this specification.

Claims

1. A license plate camera accuracy self-test system based on a multimodal model, characterized by: Specifically include: License plate sampling module, result verification module, verification result notification module; The license plate sampling module is responsible for extracting a preset number of license plate numbers and their corresponding identification pictures from the recognition results of the license plate recognition camera every day; The result verification module is responsible for submitting the recognition image to multiple third-party large models for recognition to obtain recognition results, and using the recognition results to compare with the license plate number to determine whether a reminder is needed; The verification result notification module is responsible for automatically notifying relevant personnel to conduct license plate camera inspection when a reminder is needed; One of the license plate camera accuracy self-checking systems based on a multimodal model includes: Acquiring recognition deviation data of the license plate camera within a preset time period, and using the recognition deviation data to determine whether the recognition processing accuracy of the license plate camera meets the requirements, proceeding to the next step; Based on the environmental data of the license plate camera in different time periods, determining recognition deviation data of the license plate camera under similar environmental data in the time periods, and using the recognition deviation data under similar environmental data in the time periods to determine the recognition deviation probability type of the time periods; Determining the number of license plates extracted by the license plate camera on the current date based on the recognition data of license plates in time periods of different recognition deviation probability types on the current date; Taking the extraction quantity as a constraint, determining the extraction target period and the number of license plates to be extracted in the period using the recognition deviation data under similar environmental data in the period and the recognition data of the license plates, and determining whether it is necessary to dynamically adjust the extraction strategy for the current date based on the comparison results of the license plates in the extraction target period; The method for determining the identification deviation probability type of the time period is: Determine the number of recognition deviations under the similar environmental data based on the recognition deviation data under the similar environmental data in the time period; determining a recognition deviation ratio based on a ratio of the number of recognition deviations under the similar environment data to the number of recognition processing under the similar environment data; The recognition deviation number and the recognition deviation ratio are used to determine the recognition deviation probability of the time period, and the recognition deviation probability type of the time period is determined according to the recognition deviation probability.

2. The license plate camera accuracy self-test system based on a multimodal model as claimed in claim 1, characterized in that: When the third-party large model performs license plate recognition, the third-party large model is called through an API interface.

3. The license plate camera accuracy self-test system based on a multimodal model as claimed in claim 1, characterized in that: The comparison result between the recognition result and the license plate number is used to determine whether a reminder is needed, specifically including: When it is determined that there is no recognition result inconsistent with the license plate number based on the comparison of the license plate number with the recognition results of different third-party large models, it is determined that no reminder is required; When there is a recognition result that is inconsistent with the license plate number, if the license plate number is inconsistent with the majority voting result, it is determined that a reminder is required.

4. The license plate camera accuracy self-test system based on a multimodal model as claimed in claim 1, characterized in that: The verification result notification module is triggered by email, text message or system notification.

5. The license plate camera accuracy self-test system based on a multimodal model as claimed in claim 1, characterized in that: The recognition deviation data of the license plate camera includes the recognition deviation times of the license plate camera and environmental data corresponding to different recognition deviation times.

6. The license plate camera accuracy self-test system based on a multimodal model as claimed in claim 1, characterized in that: The environmental data includes light intensity.

7. The license plate camera accuracy self-test system based on a multimodal model as claimed in claim 1, characterized in that: Determining that the recognition processing accuracy of the license plate camera meets the requirements specifically includes: Determine the number of recognition deviations of the license plate camera using the recognition deviation data of the license plate camera, and determine the number of recognition deviations within different illumination intervals using the illumination corresponding to different recognition deviations. Based on the number of identification deviations in different light intensity intervals, the number of identification deviations in a preset light intensity interval is performed; Whether the recognition processing accuracy of the license plate camera meets the requirements is determined by the number of recognition deviations within a preset light intensity range.

8. The license plate camera accuracy self-test system based on a multimodal model as claimed in claim 7, characterized in that: Determining whether the recognition processing accuracy of the license plate camera meets the requirements by the number of recognition deviations within a preset illumination range includes: When the number of recognition deviations within the preset illumination interval is greater than the preset number of deviations, it is determined that the recognition processing accuracy of the license plate camera does not meet the requirement.

9. The license plate camera accuracy self-test system based on a multimodal model as claimed in claim 1, characterized in that: Determine whether the current date extraction strategy needs to be dynamically adjusted, including: Determining the number of recognition deviations of the license plates in different extraction target periods based on the comparison results of the license plates in the extraction target period; Determining recognition deviation ratios for different extraction target periods according to ratios of the number of recognition deviations of license plates in different extraction target periods to the number of extracted license plates; The identification deviation ratio of different extraction target periods is used to determine whether dynamic adjustment of the extraction strategy for the current date is required.

Images