Vehicle monitoring device evaluation method, device, storage medium and test device

Abstract

The application provides a vehicle monitoring device evaluation method and device, a storage medium and a test device, and relates to the security field. The test device monitors a vehicle parking event through a to-be-tested device deployed in a production environment, and obtains a plurality of first parking records measured by the to-be-tested device. The to-be-tested device regards the production environment as a test environment. A plurality of second parking records measured by an existing monitoring system in the production environment are obtained. The actual performance of the to-be-tested device in the production environment is obtained according to the plurality of first parking records and the plurality of second parking records. In this way, the to-be-tested device is directly deployed in the production environment, and the to-be-tested device is compared with the production environment, so that the actual performance of the to-be-tested device in the production environment is obtained.

Description

Technical Field

[0001] This application relates to the field of security, and more specifically, to a method, apparatus, storage medium, and testing equipment for evaluating vehicle monitoring equipment. Background Technology

[0002] Currently, equipment manufacturers have evaluation indicators and third-party testing reports for the performance parameters of various types of equipment (e.g., unmanned equipment: license plate recognition rate ≥99%, geomagnetic equipment: sensing accuracy ≥99%). However, in practice, it has been found that the actual performance parameters of various equipment differ from the manufacturer's calibrated parameters, making it impossible to accurately estimate the required equipment quantity for a project. Summary of the Invention

[0003] To overcome at least one deficiency in the prior art, the purpose of this application is to provide a method, apparatus, storage medium, and testing equipment for evaluating vehicle monitoring equipment, specifically including:

[0004] In a first aspect, this application provides a method for evaluating vehicle monitoring equipment, the method comprising:

[0005] By monitoring vehicle parking events using a device under test deployed in a production environment, multiple first parking records are obtained from the device under test, wherein the production environment is used as the testing environment for the device under test.

[0006] Obtain multiple second parking records measured by the existing monitoring system in the production environment;

[0007] Based on the multiple first parking records and the multiple second parking records, the actual performance of the device under test in the production environment is obtained.

[0008] In conjunction with an optional implementation of the first aspect, obtaining the actual performance of the device under test in a production environment based on the plurality of first parking records and the plurality of second parking records includes:

[0009] The ratio of the number of the multiple first parking records to the number of the multiple second parking records is calculated as the coverage rate of the device under test.

[0010] In conjunction with an optional implementation of the first aspect, obtaining the actual performance of the device under test in a production environment based on the plurality of first parking records and the plurality of second parking records includes:

[0011] The multiple first parking records are compared with the multiple second parking records. Each entry / exit error record and a perfect match record are determined from the multiple first parking records. Among them, the entry / exit error record is compared with the second parking record of the same vehicle, and the time error of the vehicle's entry or exit is greater than the time threshold. The perfect match record is compared with the second parking record of the same vehicle, and the time error of the vehicle's entry or exit is less than or equal to the time threshold.

[0012] Calculate the sum of the number of all incorrect entry / exit records and the number of all perfectly matched records, and use this as the number of records to be entered;

[0013] The ratio between the number of entries and the number of the multiple second parking records is calculated as the vehicle entry rate of the device under test.

[0014] In conjunction with an optional implementation of the first aspect, obtaining the actual performance of the device under test in a production environment based on the plurality of first parking records and the plurality of second parking records includes:

[0015] The multiple first parking records are compared with the multiple second parking records to determine the record increment and to identify each incorrectly identified record, evidence chain error record, and missed detection record from the multiple first parking records. The record increment represents the difference between the total number of newly added records and the total number of missed records. Each newly added record represents a first parking record captured by the device under test but not by the existing monitoring system in the production environment. Each missed record represents a second parking record captured by the existing monitoring system in the production environment but not by the device under test. The license plate information in the incorrectly identified record does not match the license plate number in the vehicle image. The parking space number in the evidence chain error record does not match the recorded parking space number, or compared with the second parking record of the same vehicle, the time error of the vehicle's exit or entry is greater than a duration threshold.

[0016] The sum of the total number of erroneous records, the total number of erroneous records in the chain of evidence, and the total number of missed detections is used as the number of erroneous records.

[0017] Calculate the sum of the number of erroneous records and the record increment as the total number of errors;

[0018] The ratio between the total number of errors and the number of the multiple second parking records is calculated as the error rate of the device under test.

[0019] In conjunction with the optional implementation of the first aspect, the monitoring system includes a main monitoring system and an auxiliary monitoring system, and the acquisition of multiple second parking records measured by the existing monitoring system in the production environment includes:

[0020] For the same target vehicle, if the auxiliary monitoring system detects the entry or exit event of the target vehicle, the time of the entry or exit of the target vehicle is obtained.

[0021] The entry or exit time of the target vehicle, measured by the auxiliary monitoring system, is used to correct the entry or exit time of the target vehicle measured by the main monitoring system.

[0022] In conjunction with the optional implementation of the first aspect, the auxiliary monitoring system includes at least one of a geomagnetic sensor, manual intervention, and image acquisition equipment.

[0023] Secondly, this application also provides a vehicle monitoring equipment evaluation device, the device comprising:

[0024] The first recording module is used to monitor vehicle parking events through a device under test deployed in the production environment and obtain multiple first parking records measured by the device under test, wherein the production environment is used as the test environment by the device under test.

[0025] The second recording module is used to acquire multiple second parking records measured by the existing monitoring system in the production environment;

[0026] The performance evaluation module is used to obtain the actual performance of the device under test in a production environment based on the multiple first parking records and the multiple second parking records.

[0027] In conjunction with the optional implementation of the second aspect, the performance evaluation module is further specifically used for:

[0028] The ratio of the number of the multiple first parking records to the number of the multiple second parking records is calculated as the coverage rate of the device under test.

[0029] In conjunction with the optional implementation of the second aspect, the performance evaluation module is further specifically used for:

[0030] The multiple first parking records are compared with the multiple second parking records. Each entry / exit error record and a perfect match record are determined from the multiple first parking records. Among them, the entry / exit error record is compared with the second parking record of the same vehicle, and the time error of the vehicle's entry or exit is greater than the time threshold. The perfect match record is compared with the second parking record of the same vehicle, and the time error of the vehicle's entry or exit is less than or equal to the time threshold.

[0031] Calculate the sum of the number of all incorrect entry / exit records and the number of all perfectly matched records, and use this as the number of records to be entered;

[0032] The ratio between the number of entries and the number of the multiple second parking records is calculated as the vehicle entry rate of the device under test.

[0033] In conjunction with the optional implementation of the second aspect, the performance evaluation module is further specifically used for:

[0034] The multiple first parking records are compared with the multiple second parking records to determine the record increment and to identify each incorrectly identified record, evidence chain error record, and missed detection record from the multiple first parking records. The record increment represents the difference between the total number of newly added records and the total number of missed records. Each newly added record represents a first parking record captured by the device under test but not by the existing monitoring system in the production environment. Each missed record represents a second parking record captured by the existing monitoring system in the production environment but not by the device under test. The license plate information in the incorrectly identified record does not match the license plate number in the vehicle image. The parking space number in the evidence chain error record does not match the recorded parking space number, or compared with the second parking record of the same vehicle, the time error of the vehicle's exit or entry is greater than a duration threshold.

[0035] The sum of the total number of erroneous records, the total number of erroneous records in the chain of evidence, and the total number of missed detections is used as the number of erroneous records.

[0036] Calculate the sum of the number of erroneous records and the record increment as the total number of errors;

[0037] The ratio between the total number of errors and the number of the multiple second parking records is calculated as the error rate of the device under test.

[0038] In conjunction with the optional implementation of the second aspect, the monitoring system includes a main monitoring system and an auxiliary monitoring system, and the second recording module is further used for:

[0039] For the same target vehicle, if the auxiliary monitoring system detects the entry or exit event of the target vehicle, the time of the entry or exit of the target vehicle is obtained.

[0040] The entry or exit time of the target vehicle, measured by the auxiliary monitoring system, is used to correct the entry or exit time of the target vehicle measured by the main monitoring system.

[0041] In conjunction with the optional implementation of the second aspect, the auxiliary monitoring system includes at least one of a geomagnetic sensor, manual intervention, and image acquisition equipment.

[0042] Thirdly, this application also provides a storage medium storing a computer program, which, when executed by a processor, implements the vehicle monitoring equipment evaluation method.

[0043] Fourthly, this application provides a testing device, which includes a processor and a memory. The memory stores a computer program, and when the computer program is executed by the processor, it implements the vehicle monitoring device evaluation method.

[0044] Compared with the prior art, this application has the following beneficial effects:

[0045] This embodiment provides a method, apparatus, storage medium, and testing equipment for evaluating vehicle monitoring devices. The testing equipment monitors vehicle parking events using a device under test (DUT) deployed in a production environment, obtaining multiple first parking records measured by the DUT, where the production environment is used as the testing environment. It then acquires multiple second parking records measured by an existing monitoring system in the production environment. Based on the multiple first and second parking records, the actual performance of the DUT in the production environment is obtained. Thus, by directly deploying the DUT in the production environment and comparing it with the production environment, the actual performance of the DUT in the production environment can be obtained. Attached Figure Description

[0046] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0047] Figure 1 A flowchart illustrating the vehicle monitoring equipment evaluation method provided in this application embodiment;

[0048] Figure 2 This is a schematic diagram illustrating the principle of a single data acquisition in an embodiment of this application.

[0049] Figure 3 This is a schematic diagram illustrating the principle of multiple data acquisition provided in an embodiment of this application.

[0050] Figure 4 This is one of the schematic diagrams illustrating the relationship between the main control flow and auxiliary flow provided in the embodiments of this application;

[0051] Figure 5 This is the second schematic diagram illustrating the relationship between the main control flow and auxiliary flow in the embodiments of this application.

[0052] Figure 6A schematic diagram of time period relationships provided for embodiments of this application;

[0053] Figure 7 This is a schematic diagram of the structure of the vehicle monitoring equipment evaluation device provided in the embodiments of this application;

[0054] Figure 8 This is a schematic diagram of the structure of the test equipment provided in the embodiments of this application.

[0055] Icons: 100-First recording module; 101-Second recording module; 103-Performance evaluation module; 201-Memory; 202-Processor; 203-Communication unit; 204-System bus. Detailed Implementation

[0056] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. The components of the embodiments of this application described and shown in the accompanying drawings can generally be arranged and designed in various different configurations.

[0057] Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely to illustrate selected embodiments of the application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.

[0058] It should be noted that similar labels and letters in the following figures indicate similar items. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures.

[0059] In the description of this application, it should be noted that the terms "first," "second," "third," etc., are used only for distinguishing descriptions and should not be construed as indicating or implying relative importance. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0060] Based on the above statement, as introduced in the background technology, it has been found in practice that the actual performance parameters of various equipment differ from the calibration parameters specified by the manufacturer, which makes it impossible to accurately estimate the amount of equipment required for a project.

[0061] For example, in routine urban on-street parking management projects, if the indicators and parameters provided by equipment manufacturers (such as the license plate recognition rate and sensing accuracy of the equipment) cannot be directly linked to the operational indicators of parking orders (such as the cost of collecting parking data per transaction and the accuracy of parking orders), it will lead to an inability to make a direct and clear judgment on the actual effectiveness of the equipment during the equipment procurement process, which will indirectly affect the evaluation of the equipment investment value of parking management owners.

[0062] Based on the discovery of the aforementioned technical problems, the inventors, through creative labor, proposed the following technical solutions to solve or improve these problems. It should be noted that the deficiencies in the solutions of the prior art are all results derived by the inventors after practical experience and careful research. Therefore, the discovery process of the aforementioned problems and the solutions proposed in the embodiments of this application below should be considered contributions made by the inventors to this application during the inventive process, and should not be construed as technical content known to those skilled in the art.

[0063] In view of the above problems, in order to better manage and evaluate the existing parking data collection effect, an evaluation method for parking data collection effect was designed and developed. This embodiment provides a method for evaluating vehicle monitoring equipment. In this method, the test equipment monitors vehicle parking events through the device under test deployed in the production environment, obtaining multiple first parking records measured by the device under test, wherein the production environment is used as the test environment; multiple second parking records measured by the existing monitoring system in the production environment are obtained; based on the multiple first parking records and multiple second parking records, the actual performance of the device under test in the production environment is obtained. In this way, by directly deploying the device under test in the production environment and comparing it with the production environment, the actual performance of the device under test in the production environment can be obtained.

[0064] The aforementioned test equipment may be, but is not limited to, mobile terminals, tablet computers, laptop computers, desktop computers, and servers. When the test equipment is a server, the server may be a single server or a group of servers. The server group may be centralized or distributed (e.g., the servers may be a distributed system). In some embodiments, the server may be local or remote relative to the user terminal. In some embodiments, the server may be implemented on a cloud platform; by way of example only, the cloud platform may include private cloud, public cloud, hybrid cloud, community cloud, distributed cloud, inter-cloud, multi-cloud, etc., or any combination thereof. In some embodiments, the server may be implemented on a test equipment having one or more components.

[0065] To make the solution provided in this embodiment clearer, the following is combined with... Figure 1 Each step of the method is described in detail. However, it should be understood that the operations in the flowchart may not be implemented in sequence, and steps without logical contextual relationships may be reversed in order or implemented simultaneously. Furthermore, those skilled in the art, guided by the content of this application, may add one or more other operations to the flowchart, or remove one or more operations from the flowchart. Figure 1 As shown, the method includes:

[0066] S101 monitors vehicle parking events using the device under test deployed in the production environment and obtains multiple first parking records measured by the device under test.

[0067] In this embodiment, the production environment is used as the testing environment for the device under test (DUT). It should be understood that the production environment refers to an environment that has been debugged and is in working condition. In this embodiment, the measured parking records are used as a reference. For example, in daily urban on-street parking management, the environment of a monitoring system already in operation and charging is used as the production environment. The DUT is deployed in this production environment, allowing both systems to synchronously detect parking times in the production environment. Finally, the parking records obtained from both systems are compared to obtain the actual performance of the DUT in the production environment.

[0068] Furthermore, the device under test in this embodiment may be, but is not limited to, image acquisition devices, geomagnetic devices, high / low position video stakes, inspection vehicles, inductive ground locks, and other such devices.

[0069] See also Figure 1 The method also includes:

[0070] S102: Obtain multiple second parking records measured by existing monitoring systems in the production environment.

[0071] In this embodiment, the existing monitoring system in the production environment includes a main monitoring system and an auxiliary monitoring system. Thus, for the same target vehicle, if the auxiliary monitoring system detects the target vehicle's entry or exit event, the entry or exit time of the target vehicle is obtained; the entry or exit time of the target vehicle measured by the auxiliary monitoring system is used to correct the entry or exit time of the target vehicle measured by the main monitoring system. This improves the accuracy of monitoring vehicle entry and exit times.

[0072] For example, continuing with the management of daily urban on-street parking, based on whether or not cameras capture images of the scene, devices can be divided into visual and non-visual devices. Visual devices are further divided into single-capture and multiple-capture devices based on the number of images captured per parking instance. For example... Figure 2 as well as Figure 3 As shown, in a single-collection scenario, represented by a PDA handheld device, only one data collection is required from the vehicle. However, in a multi-collection scenario, video-based monitoring devices (including inspection vehicles) periodically collect data from the site multiple times, involving additional logic for matching information from multiple collections. Compared to single-collection scenarios, this places higher demands on the accuracy, robustness, and anomaly handling capabilities of the software and hardware systems.

[0073] like Figure 4 In the single-recognition scenario shown, the main control process of the primary monitoring system remains unchanged. Instead, it incorporates auxiliary processes provided by the auxiliary system, along with other parking data collection methods and user behavior elements, to improve the efficiency and accuracy of parking data collection. Vehicle parking events mainly include three states: entering, parked, and leaving. The primary and auxiliary monitoring systems work collaboratively as follows:

[0074] Entry: In a single parking scenario, the entry status is determined by the acquisition device of the main control process. For a single acquisition performed manually, if the geomagnetic sensor or other imaging device captures the entry behavior within a certain time range (configurable parameter), the entry time of the auxiliary process will be adopted to calibrate the delay of the manual operation.

[0075] While parked: In a single parking scenario, the main control process no longer makes business judgments while parked. At this time, if the auxiliary process's geomagnetic sensor detects that the vehicle has left the site for a period of time, it can alert the main control process whether the vehicle has left. Simultaneously, if the auxiliary process's visual imaging device observes the vehicle leaving and its confidence level is higher than a set threshold, it will immediately mark the vehicle as having left and send a departure notification to the main control process. This logical difference stems from the fact that the visual imaging device possesses on-site image evidence and can perform departure marking without authorization, while the sensor can only issue a notification and cannot perform unauthorized operations.

[0076] Departure: In a single parking scenario, the departure status is determined by the acquisition equipment in the main control process, supplemented by automatic departure detection by visual imaging devices in the auxiliary process. Within a certain timeframe of manual operation in the main control process (configurable parameter), if a geomagnetic sensor or other imaging device detects departure behavior, the departure time from the auxiliary process will be adopted to compensate for the delay in manual operation. Similarly, within a certain timeframe of manual operation in the main control process (configurable parameter), if user payment or other actions occur, after certain logical judgments, the departure time from the auxiliary process will also be adopted to compensate for the delay in manual operation.

[0077] like Figure 5 In the multiple identification scenarios shown, where the main control process remains unchanged despite multiple order identifications, a method combining other parking data collection methods and user behavior elements can be adopted to improve the efficiency and accuracy of parking data collection. For parking events such as entry, parking, and departure, the collaborative working method between the main monitoring system and the auxiliary monitoring system is as follows:

[0078] Entry: For parking scenarios with multiple data collections, the entry status is based on the data collection device of the main control process. However, in non-behavioral pattern-based entry photography scenarios (such as high-position cameras taking photos at regular intervals or inspection vehicles conducting periodic cyclical inspections), within a certain time range after the vehicle's first entry (configurable parameters), if the entry behavior is captured by a geomagnetic sensor, parking lock, or other sensing device, the entry time of the auxiliary process can be adopted to calibrate the entry operation delay.

[0079] While parked: For parking scenarios with multiple data collections, the main control process continuously checks the parked state while the vehicle is parked. Simultaneously, if the auxiliary process's geomagnetic sensor detects that the vehicle has left the site for a period of time, it can alert the main control process that a departure action may be imminent. However, similarly, due to the lack of image evidence from the sensor, it can only provide alerts and cannot overstep its authority.

[0080] Departure: In parking scenarios with multiple data collections, the departure status is based on the data collection device of the main control process. Within a certain time range (configurable parameter) of the automatic departure in the main control process, if a geomagnetic sensor or other imaging device captures departure behavior, the departure time of the auxiliary process can be adopted to calibrate system operation delays. Furthermore, if user payment or other actions occur within a certain time range (configurable parameter) of the automatic departure in the main control process, and after certain logical judgments, the departure time of the auxiliary process can also be adopted to calibrate system operation delays.

[0081] Furthermore, for auxiliary processes involving full manual monitoring, similar to single-time manual data collection, entry and exit in parking scenarios with multiple data collections can also be performed manually using a handheld PDA. Human intervention has the highest authority, and the system records human operation logs for future reference. An alarm will also be triggered when the system detects abnormal situations such as excessively frequent manual operations.

[0082] S103, based on multiple first parking records and multiple second parking records, obtain the actual performance of the device under test in the production environment.

[0083] The actual performance of the device under test in the production environment includes one or more of the following: coverage, vehicle entry rate, and error rate. Each of these performance metrics is described in detail below. For coverage, the specific implementation of S103 includes:

[0084] S103-1A calculates the ratio of the number of multiple first parking records to the number of multiple second parking records, which is used as the coverage rate of the device under test.

[0085] The expression for coverage is:

[0086] Coverage = Number of multiple first parking records / Number of multiple second parking records;

[0087] It is worth noting that the coverage rate can exceed 100%. The excess means that the data entry efficiency of the device under test is higher than that of the current data collection methods used in the production environment, which can create greater economic value.

[0088] Similarly, regarding the vehicle registration rate, the specific implementation method of S103 includes:

[0089] S103-1B compares multiple first parking records with multiple second parking records to identify each entry / exit error record and a fully matching record from the multiple first parking records.

[0090] Among them, the entry / exit error record, compared with the second parking record of the same vehicle, has a time error greater than the duration threshold for the vehicle's entry or exit; the perfect match record, compared with the second parking record of the same vehicle, has a time error less than or equal to the duration threshold for the vehicle's entry or exit.

[0091] It should be understood that, assuming each parking record includes elements such as "on-site image, license plate number, parking space number, entry time, and exit time," and the duration threshold is 15 minutes, for the same vehicle, if the "on-site image, license plate number, and parking space number" are completely identical, and the error between the entry / exit time measured by the device under test and the entry / exit time measured by the detection system is within 15 minutes, then it is considered a perfectly matched record. Figure 6As shown, assuming the reference time period measured by the monitoring system is between 9:00 AM and 3:00 PM, the time period measured by the device under test that satisfies any one of the four time periods in the figure is considered to be completely consistent with the time period measured by the detection system.

[0092] S103-2B: Calculate the sum of the number of all entry / exit error records and all fully matched records, and use this as the number of records to be entered.

[0093] S103-3B calculates the ratio between the number of entries and the number of multiple second parking records, which is used as the vehicle entry rate of the device under test.

[0094] The expression for the vehicle registration rate is as follows:

[0095] Vehicle entry rate = Number of entries / Number of multiple second parking records;

[0096] It is worth noting that the vehicle data entry rate can also exceed 100%. The excess means that the data entry efficiency of the device under test is higher than that of the data collection methods used in the current production environment, which can improve the vehicle data entry efficiency.

[0097] Regarding the error rate, the specific implementation of S103 includes:

[0098] S103-1C compares multiple first parking records with multiple second parking records to determine the record increment and to identify each incorrectly identified record, evidence chain error record, and missed detection record from the multiple first parking records.

[0099] Among them, the record increment represents the difference between the total number of newly added records and the total number of missing records. Each newly added record represents the first parking record that was captured by the device under test but not by the existing monitoring system in the production environment. Each missing record represents the second parking record that was captured by the existing monitoring system in the production environment but not by the device under test. The license plate information in the incorrectly identified record is inconsistent with the license plate number in the vehicle image. The berth number of the vehicle image in the evidence chain error record is inconsistent with the recorded berth number or, compared with the second parking record of the same vehicle, the time error of the vehicle's exit or entry is greater than the duration threshold.

[0100] S103-2C, calculate the sum of the numbers of all erroneous records, all erroneous records in the chain of evidence, and all missed records, as the number of erroneous records.

[0101] S103-3C, calculate the sum of the number of erroneous records and the record increment, as the total number of errors.

[0102] S103-4C, calculate the ratio between the total number of errors and the number of multiple second parking records, as the error rate of the device under test.

[0103] The expression for the error rate is:

[0104] Error rate = Total number of errors / Number of multiple second parking records;

[0105] It is worth noting that the error rate can be negative. When it is negative, it means that the error rate of the device under test exceeds the current data acquisition methods used in production.

[0106] As described in the above embodiments, the production environment used to test the device under test includes both single-collection and multiple-collection scenarios. Based on experience in practice, the following standards have been established for the device under test:

[0107]

[0108] Based on the same inventive concept as the vehicle monitoring equipment evaluation method provided in this embodiment, this embodiment also provides a vehicle monitoring equipment evaluation apparatus. The vehicle monitoring equipment evaluation apparatus includes at least one software functional module that can be stored in a memory or embedded in the operating system (OS) of an electronic device. The processor 202 in the electronic device is used to execute the executable module stored in the memory 201. For example, the software functional modules and computer programs included in the vehicle monitoring equipment evaluation apparatus. Please refer to... Figure 7 Functionally, vehicle monitoring equipment evaluation devices may include:

[0109] The first recording module 100 is used to monitor vehicle parking events through the device under test deployed in the production environment and obtain multiple first parking records measured by the device under test, wherein the production environment is used as the test environment for the device under test.

[0110] The second recording module 101 is used to acquire multiple second parking records measured by the existing monitoring system in the production environment;

[0111] The performance evaluation module 103 is used to obtain the actual performance of the device under test in the production environment based on multiple first parking records and multiple second parking records.

[0112] In this embodiment, the first recording module 100 is used to implement Figure 1 In step S101, the second recording module 101 is used to implement... Figure 1 In step S102, the performance evaluation module 103 is used to implement... Figure 1Step S103 in the above method. For a detailed description of each module, please refer to the specific implementation of the corresponding step. It should also be emphasized that, since it has the same inventive concept as the vehicle monitoring equipment evaluation method, the above modules can also be used to implement other steps or sub-steps of the method, and this embodiment does not specifically limit them.

[0113] In addition, the functional modules in the various embodiments of this application can be integrated together to form an independent part, or each module can exist independently, or two or more modules can be integrated to form an independent part.

[0114] It should also be understood that if the above embodiments are implemented as software functional modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application.

[0115] Therefore, this embodiment also provides a storage medium storing a computer program. When the computer program is executed by a processor, it implements the vehicle monitoring equipment evaluation method provided in this embodiment. The storage medium can be any medium capable of storing program code, such as a USB flash drive, portable hard drive, read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0116] This embodiment provides a testing device, such as... Figure 8 As shown, the testing device includes a processor 202 and a memory 201. The memory 201 stores a computer program, and the processor reads and executes the computer program corresponding to the above-described embodiments from the memory 201 to implement the vehicle monitoring device evaluation method provided in this embodiment.

[0117] See also Figure 8 The testing equipment also includes a communication unit 203. The memory 201, processor 202 and communication unit 203 are electrically connected to each other directly or indirectly through system bus 204 to realize data transmission or interaction.

[0118] The memory 201 can be an information recording device based on any electronic, magnetic, optical, or other physical principles, used to record execution instructions, data, etc. In some embodiments, the memory 201 can be, but is not limited to, volatile memory, non-volatile memory, memory drive, etc.

[0119] In some embodiments, the volatile memory may be random access memory (RAM); in some embodiments, the non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, etc.; in some embodiments, the storage drive may be a disk drive, solid-state drive, any type of storage disk (such as optical disc, DVD, etc.), or similar storage media, or a combination thereof.

[0120] The communication unit 203 is used to send and receive data over a network. In some embodiments, the network may include a wired network, a wireless network, a fiber optic network, a telecommunications network, an intranet, the Internet, a local area network (LAN), a wide area network (WAN), a wireless local area network (WLAN), a metropolitan area network (MAN), a public switched telephone network (PSTN), a Bluetooth network, a ZigBee network, or a near field communication (NFC) network, or any combination thereof. In some embodiments, the network may include one or more network access points. For example, the network may include wired or wireless network access points, such as base stations and / or network switching nodes, through which one or more components of the service request processing system can connect to the network to exchange data and / or information.

[0121] The processor 202 may be an integrated circuit chip with signal processing capabilities, and the processor may include one or more processing cores (e.g., a single-core processor or a multi-core processor). By way of example only, the processor described above may include a Central Processing Unit (CPU), an Application-Specific Integrated Circuit (ASIC), an Application-Specific Instruction-set Processor (ASIP), a Graphics Processing Unit (GPU), a Physics Processing Unit (PPU), a Digital Signal Processor (DSP), a Field Programmable Gate Array (FPGA), a Programmable Logic Device (PLD), a controller, a microcontroller unit, a Reduced Instruction Set Computing (RISC) computer, or a microprocessor, or any combination thereof.

[0122] Understandable. Figure 5 The structure shown is for illustrative purposes only. The testing equipment may also have more advanced features. Figure 5 Showing more or fewer components, or having with Figure 5 The different configurations shown. Figure 5 The components shown can be implemented using hardware, software, or a combination thereof.

[0123] It should be understood that the apparatus and methods disclosed in the above embodiments can also be implemented in other ways. The apparatus embodiments described above are merely illustrative. For example, the flowcharts and block diagrams in the accompanying drawings show the architecture, functionality, and operation of possible implementations of apparatus, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram and / or flowchart, and combinations of blocks in block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0124] The above descriptions are merely various embodiments of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for evaluating vehicle monitoring equipment, characterized in that, The method includes: By monitoring vehicle parking events using a device under test deployed in a production environment, multiple first parking records are obtained from the device under test, wherein the production environment is used as the testing environment for the device under test. Obtain multiple second parking records measured by the existing monitoring system in the production environment; The multiple first parking records are compared with the multiple second parking records to determine the record increment and to identify each incorrectly identified record, evidence chain error record, and missed detection record from the multiple first parking records. The record increment represents the difference between the total number of newly added records and the total number of missed records. Each newly added record represents a first parking record captured by the device under test but not by the existing monitoring system in the production environment. Each missed record represents a second parking record captured by the existing monitoring system in the production environment but not by the device under test. In the incorrectly identified record, the license plate information is inconsistent with the license plate number in the vehicle image. In the evidence chain error record, the parking space number of the vehicle image is inconsistent with the recorded parking space number, or compared with the second parking record of the same vehicle, the time error of the vehicle's exit or entry is greater than a duration threshold. The sum of the total number of erroneous records, the total number of erroneous records in the chain of evidence, and the total number of missed detections is used as the number of erroneous records. Calculate the sum of the number of erroneous records and the record increment as the total number of errors; The ratio between the total number of errors and the number of the multiple second parking records is calculated as the error rate of the device under test.

2. The vehicle monitoring equipment evaluation method according to claim 1, characterized in that, The monitoring system includes a main monitoring system and an auxiliary monitoring system. The acquisition of multiple second parking records already detected by the existing monitoring system in the production environment includes: For the same target vehicle, if the auxiliary monitoring system detects the entry or exit event of the target vehicle, the time of the entry or exit of the target vehicle is obtained. The entry or exit time of the target vehicle, measured by the auxiliary monitoring system, is used to correct the entry or exit time of the target vehicle measured by the main monitoring system.

3. The vehicle monitoring equipment evaluation method according to claim 2, characterized in that, The auxiliary monitoring system includes at least one of the following: a geomagnetic sensor, manual intervention, and image acquisition equipment.

4. A vehicle monitoring equipment evaluation device, characterized in that, The device includes: The first recording module is used to monitor vehicle parking events through a device under test deployed in the production environment and obtain multiple first parking records measured by the device under test, wherein the production environment is used as the test environment by the device under test. The second recording module is used to acquire multiple second parking records measured by the existing monitoring system in the production environment; The performance evaluation module is used to compare the multiple first parking records with the multiple second parking records to determine the record increment and to identify each incorrectly identified record, evidence chain error record, and missed detection record from the multiple first parking records. The record increment represents the difference between the total number of newly added records and the total number of missed records. Each newly added record represents a first parking record captured by the device under test but not by the existing monitoring system in the production environment. Each missed record represents a second parking record captured by the existing monitoring system in the production environment but not by the device under test. In the incorrectly identified records, the license plate information does not match the license plate number in the vehicle image; in the evidence chain error records, the parking space number of the vehicle image does not match the recorded parking space number, or compared with the second parking records of the same vehicle, the time error of the vehicle's exit or entry is greater than a duration threshold. The sum of the total number of erroneous records, the total number of erroneous records in the chain of evidence, and the total number of missed detections is used as the number of erroneous records. Calculate the sum of the number of erroneous records and the record increment as the total number of errors; The ratio between the total number of errors and the number of the multiple second parking records is calculated as the error rate of the device under test.

5. The vehicle monitoring equipment evaluation device according to claim 4, characterized in that, The monitoring system includes a main monitoring system and an auxiliary monitoring system, and the second recording module is further used for: For the same target vehicle, if the auxiliary monitoring system detects the entry or exit event of the target vehicle, the time of the entry or exit of the target vehicle is obtained. The entry or exit time of the target vehicle, measured by the auxiliary monitoring system, is used to correct the entry or exit time of the target vehicle measured by the main monitoring system.

6. A storage medium, characterized in that, The storage medium stores a computer program, which, when executed by a processor, implements the vehicle monitoring equipment evaluation method according to any one of claims 1-3.

7. A testing device, characterized in that, The testing device includes a processor and a memory. The memory stores a computer program. When the computer program is executed by the processor, it implements the vehicle monitoring device evaluation method according to any one of claims 1-3.

Images