Engineering machinery vehicle multi-device collaborative identification method and device and storage medium

Abstract

The invention discloses an engineering machinery vehicle multi-device cooperative identification method and device and a storage medium in the technical field of engineering machinery vehicles, and the method comprises the steps: responding to vehicle feature data of a vehicle head read in a message queue, putting the corresponding vehicle feature data into a delay queue, and waiting for preset cooperative time; in the cooperation time range, in response to the vehicle feature data of the vehicle tail read in the message queue, splicing and fusing the vehicle feature data of the vehicle head and the vehicle tail to obtain fused data; and analyzing the fusion data, obtaining a license plate number in the fusion data, matching the license plate number in the fusion data based on a preset white list and a license plate number in a vehicle release rule, and determining whether to open a gate or not according to a matching result. The technical problem that the license plate recognition accuracy is low and the traffic efficiency of a park is affected when the engineering machinery vehicle is captured and recognized in the prior art can be solved.

Description

Technical Field

[0001] This invention relates to the field of vehicle identification technology, and in particular to a method, device and storage medium for multi-device collaborative identification of engineering machinery vehicles. Background Technology

[0002] In the construction machinery industry, especially for large machinery vehicles (such as open-pit mining equipment and truck cranes), license plate recognition is required when entering and exiting construction sites. However, due to the poor construction environment, license plates are easily obscured by mud; in addition, the large size of machinery vehicles limits the recognition range of single-camera checkpoint devices, resulting in many blind spots and low accuracy in license plate recognition, which affects the efficiency of traffic flow in the park.

[0003] Therefore, there is an urgent need for a method, device, and storage medium for collaborative identification of multiple devices on engineering machinery vehicles to solve the above-mentioned technical problems. Summary of the Invention

[0004] The purpose of this invention is to overcome the shortcomings of the prior art and provide a method, device and storage medium for multi-device collaborative identification of construction machinery vehicles, which can solve the technical problem of low license plate recognition accuracy when capturing and identifying construction machinery vehicles, thus affecting the traffic efficiency of the park.

[0005] To achieve the above objectives, the present invention is implemented using the following technical solution: In a first aspect, the present invention provides a method for multi-device collaborative identification of engineering machinery vehicles, comprising: Receive vehicle feature data of the front or rear of the vehicle captured by the corresponding camera triggered by the induction coil. Upload the received vehicle feature data to the message queue; In response to reading vehicle feature data of the vehicle front from the message queue, the corresponding vehicle feature data is placed into the delay queue and waits for a preset coordination time. Within the coordination time range, in response to reading vehicle feature data of the rear of the vehicle from the message queue, vehicle feature data of the front of the vehicle is read from the delay queue, and the vehicle feature data of the front and rear of the vehicle are spliced ​​and fused to obtain fused data. The fused data is parsed to obtain the license plate numbers in the fused data. Based on the pre-set whitelist and vehicle release rules, the license plate numbers are matched with the license plate numbers in the fused data. Based on the matching results, a decision is made on whether to open the gate and release the vehicle.

[0006] Furthermore, placing the relevant vehicle feature data into a delay queue and waiting for a preset coordination time also includes: Within the coordination time range, if the vehicle feature data of the rear of the vehicle is not read in the message queue, the vehicle feature data of the front of the vehicle that has exited the delay queue after the coordination time is parsed to obtain the license plate number in the vehicle feature data of the front of the vehicle. Based on the pre-set whitelist and the license plate number in the vehicle release rules, the license plate number is matched with the license plate number in the vehicle feature data of the front of the vehicle. Based on the matching result, a decision is made on whether to open the gate and release the vehicle.

[0007] Furthermore, it also includes: After the received vehicle feature data is uploaded to the message queue, in response to the situation where the vehicle feature data of the front of the vehicle is not read in the message queue but the vehicle feature data of the rear of the vehicle is read first, the vehicle feature data of the rear of the vehicle is parsed to obtain the license plate number in the vehicle feature data of the rear of the vehicle. Based on the pre-set whitelist and the license plate number in the vehicle release rules, it is matched with the license plate number in the vehicle feature data of the rear of the vehicle. According to the matching result, a decision is made on whether to open the gate and release the vehicle.

[0008] Furthermore, it also includes: If no vehicle feature data from the front and rear of the vehicle is consumed within the specified coordination time range, manual intervention, adjustment of camera installation angle, and increase of auxiliary camera quantity will be added for coordination.

[0009] Furthermore, when the fused data is less than a preset threshold, the collaborative time range is increased or decreased.

[0010] Secondly, the present invention provides a multi-equipment collaborative identification device for engineering machinery vehicles, comprising: The receiving module is used to receive vehicle feature data of the front or rear of the vehicle captured by the corresponding camera triggered by the induction coil. The upload module is used to upload the received vehicle feature data to the message queue; The delay module is used to, in response to reading vehicle feature data of the vehicle front from the message queue, put the corresponding vehicle feature data into the delay queue and wait for a preset coordination time. The fusion module is used to, within the coordination time range, in response to reading vehicle feature data of the rear of the vehicle from the message queue, read vehicle feature data of the front of the vehicle from the delay queue, and splice and fuse the vehicle feature data of the front and rear of the vehicle to obtain fused data. The matching module is used to parse the fused data, obtain the license plate numbers in the fused data, match the license plate numbers in the fused data with the license plate numbers in the pre-set whitelist and vehicle release rules, and execute a decision on whether to open the gate and release the vehicle based on the matching result.

[0011] Thirdly, the present invention provides an electronic terminal, including a processor and a memory connected to the processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the steps of the method described in any of the preceding claims are performed.

[0012] Fourthly, the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of any of the methods described above.

[0013] Compared with the prior art, the beneficial effects achieved by the present invention are as follows: This application receives vehicle feature data of the front or rear of a vehicle captured by a camera triggered by an induction coil, and then uploads it to a message queue. When the front feature data is read first from the message queue, it is placed in a delay queue. If the rear feature data is received within a preset coordination time, the front and rear feature data are spliced ​​and fused to obtain fused data. After obtaining the fused data, it is parsed to obtain the license plate number. The obtained license plate number is compared and matched with the license plate numbers in the preset whitelist and release rules. If the match is successful, the gate is opened and the vehicle is released; otherwise, no action is taken. This improves the accuracy of license plate recognition when capturing and identifying construction machinery vehicles, and further improves the efficiency of traffic in the park. Attached Figure Description

[0014] Figure 1 This is a flowchart of a multi-device collaborative identification method for engineering machinery vehicles provided in Embodiment 1 of the present invention; Figure 2 This is a detailed flowchart of a multi-device collaborative identification method for engineering machinery vehicles provided in Embodiment 1 of the present invention. Detailed Implementation

[0015] The technical solution of the present invention will be described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the embodiments and specific features in the embodiments are detailed descriptions of the technical solution of the present application, rather than limitations thereof. In the absence of conflict, the embodiments and technical features in the embodiments can be combined with each other.

[0016] In this article, the term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.

[0017] For ease of understanding, the proper nouns mentioned in this application are explained below: NSGA-II: Second Generation of Non-Dominated Sorting Genetic Algorithm NSGA-II (Non-dominated-Sorting-Genetic-Algorithm-II) is a multi-objective optimization algorithm proposed by Indian scientists Deb et al. in 2002. It is a classic improvement on the Genetic Algorithm (GA) for multi-objective problems. It overcomes the shortcomings of the first-generation NSGA (proposed in 1995), such as high computational complexity, insufficient population diversity, and lack of elite preservation, and has become one of the most widely used and influential algorithms in the field of multi-objective optimization. Example 1

[0018] Figure 1 This is a flowchart of the multi-device collaborative identification method for engineering machinery vehicles according to Embodiment 1 of the present invention. This flowchart only illustrates the logical sequence of the method described in this embodiment. Provided there are no conflicts, different methods may be used in other possible embodiments of the present invention. Figure 1 Complete the steps shown or described in the order indicated.

[0019] The multi-device collaborative identification method for construction machinery vehicles provided in this embodiment can be applied to a terminal and can be executed by a mechanical equipment fault identification device. This device can be implemented by software and / or hardware and can be integrated into the terminal, such as any smartphone, tablet computer or computer device with communication function.

[0020] See Figure 1 As shown, the method in this embodiment specifically includes the following steps: Step 1: Receive vehicle feature data of the front or rear of the vehicle captured by the corresponding camera triggered by the induction coil. Specifically, the vehicle feature data of the front of the vehicle can be obtained by the main camera located at the front of the vehicle, and the vehicle feature data of the rear of the vehicle can be obtained by the secondary camera located at the rear of the vehicle. The main camera and the secondary camera can also be installed in different positions such as the left or right side of the entrance and exit. The specific location of the camera needs to be installed according to the actual situation on site.

[0021] Step 2: Upload the received vehicle feature data to the message queue. It should be noted that although Step 1 accepts either the front or rear vehicle feature data, the actual vehicle feature data that can be uploaded to the message queue can still include both types of vehicle feature data. The only difference is that the upload time to the message queue is different. It can be set so that the message queue does not simultaneously include the front and rear vehicle feature data.

[0022] Step 3: When the vehicle feature data of the front of the vehicle is read from the message queue, the corresponding vehicle feature data is placed in the delay queue and waits for the preset coordination time. Step 4: Within the coordination time range, in response to reading the vehicle feature data of the rear of the vehicle from the message queue, read the vehicle feature data of the front of the vehicle from the delay queue, and stitch and fuse the vehicle feature data of the front and rear of the vehicle to obtain fused data.

[0023] Step 5: Parse the fused data to obtain the license plate number in the fused data. Based on the pre-set whitelist and vehicle release rules, match the license plate number in the fused data with the license plate number in the fused data. Based on the matching result, decide whether to open the gate and release the vehicle.

[0024] However, if the vehicle feature data of the rear of the vehicle is not read in the message queue within the coordination time range, the vehicle feature data of the front of the vehicle that leaves the delay queue after the coordination time is parsed to obtain the license plate number in the vehicle feature data of the front of the vehicle. Based on the pre-set whitelist and the license plate number in the vehicle release rules, the license plate number is matched with the license plate number in the vehicle feature data of the front of the vehicle. Based on the matching result, a decision is made on whether to open the gate and release the vehicle. The aforementioned vehicle feature data of the front of the vehicle that exits the delay queue after the coordination time refers to the fact that when the feature data of the rear of the vehicle has not been read, the vehicle feature data of the front of the vehicle needs to wait in the delay queue for the coordination time before it exits the delay queue.

[0025] Furthermore, if, after uploading the received vehicle feature data to the message queue, in response to the situation where the vehicle feature data of the front of the vehicle is not read in the message queue but the vehicle feature data of the rear of the vehicle is read first, the vehicle feature data of the rear of the vehicle is parsed to obtain the license plate number in the vehicle feature data of the rear of the vehicle. Based on the pre-set whitelist and the license plate number in the vehicle release rules, the license plate number is matched with the license plate number in the vehicle feature data of the rear of the vehicle. Based on the matching result, a decision is made on whether to open the gate and release the vehicle.

[0026] Furthermore, if no vehicle feature data of the front and rear of the vehicle is consumed within the aforementioned collaborative time period, the probability of consuming vehicle feature data of the front and rear of the vehicle within the collaborative time period can be increased by adding manual intervention, adjusting the camera installation angle, and increasing the number of auxiliary cameras.

[0027] Similarly, when the fused data is less than a preset threshold, the probability of consuming vehicle feature data from the front and rear of the vehicle within the collaborative time range can be increased by increasing or decreasing the collaborative time range.

[0028] Regarding the release rules mentioned in this application, they are all formulated based on the nature of the venue and management requirements, and there are situations such as time-based control, free passage for monthly / annual rental vehicles and temporary vehicles.

[0029] The phrase "to make a decision on whether to open the gate based on the matching result" mentioned in this application refers to the decision to open the gate if the two match, and not to the decision to open the gate if they do not match.

[0030] More specifically, such as Figure 2 As shown, the multi-device collaborative identification method for construction machinery vehicles disclosed in this embodiment can be executed according to the following steps: Step S01: Install the main camera and the secondary camera at the construction site; Step S02: Enter the whitelist of construction machinery vehicles into VMS; Step S03: Record the camera collaboration time in VMS; Step S04: Enter vehicle release rules into VMS; Step S05: When the vehicle passes through the geomagnetic coils of the main camera and the secondary camera respectively, the main camera and the secondary camera are triggered to capture vehicle feature data; Step S06: Upload vehicle feature data to the VMS message queue; Step S07: When the vehicle feature data of the front of the vehicle is consumed in the message queue and the vehicle feature data of the rear of the vehicle is received within the coordination time range, the vehicle feature data is spliced ​​and fused to obtain fused data. Step S0701: Within the collaborative time range, the main and secondary cameras capture vehicle feature data respectively, and determine the captured license plate number. If the license plate number matches the whitelist set in the system and is within the release rules, a gate opening command is issued to release the vehicle; otherwise, the vehicle is not released. At the same time, the fused data is stored in the database and a log is recorded. Step S0702: When only the main camera captures vehicle feature data, if the license plate number matches the whitelist set in the system and is within the release rules, then the gate opening command is issued to release the vehicle; otherwise, the vehicle is not released. The vehicle feature data is not fused and is directly stored in the database and logged. Step S0703: When only the secondary camera captures vehicle feature data, if the license plate number matches the whitelist set in the system and is within the release rules, a gate opening command is issued to allow passage; otherwise, passage is not allowed. This data is not merged and is directly stored in the database and logged.

[0031] Step S0704: If neither the main nor auxiliary camera captures vehicle feature data within the collaborative time frame, manual intervention should be increased, the camera installation angle adjusted, or the number of auxiliary cameras increased for collaborative operation.

[0032] VMS (Vehicle-Management-System) is an intelligent management system based on modern IoT, computer vision, and automatic control technologies. It automates the identification, verification, release, payment, and recording of vehicles entering and exiting specific areas. Its core objective is to replace traditional manual management methods, improve vehicle traffic efficiency, ensure area security, optimize management costs, and achieve digital control of vehicle data. As this is existing technology, it will not be elaborated upon further. Example 2

[0033] Embodiment 2 of the present invention provides a multi-equipment collaborative identification device for engineering machinery vehicles, comprising: The receiving module is used to receive vehicle feature data of the front or rear of the vehicle captured by the corresponding camera triggered by the induction coil. The upload module is used to upload the received vehicle feature data to the message queue; The delay module is used to, in response to reading vehicle feature data of the vehicle front from the message queue, put the corresponding vehicle feature data into the delay queue and wait for a preset coordination time. The fusion module is used to, within the coordination time range, in response to reading vehicle feature data of the rear of the vehicle from the message queue, read vehicle feature data of the front of the vehicle from the delay queue, and splice and fuse the vehicle feature data of the front and rear of the vehicle to obtain fused data. The matching module is used to parse the fused data, obtain the license plate numbers in the fused data, match the license plate numbers in the fused data with the license plate numbers in the pre-set whitelist and vehicle release rules, and execute a decision on whether to open the gate and release the vehicle based on the matching result.

[0034] The multi-device collaborative identification method for construction machinery vehicles provided in Embodiment 2 of the present invention can execute the multi-device collaborative identification method for construction machinery vehicles provided in Embodiment 1 of the present invention, and has the corresponding functional modules and beneficial effects of the execution method. Example 3

[0035] Embodiment 3 of the present invention also provides an electronic terminal, including a processor and a memory connected to the processor, wherein a computer program is stored in the memory, and the processor is used to perform operations according to the instructions to execute the steps of the method described in Embodiment 1.

[0036] The electronic terminal provided in Embodiment 3 of the present invention can execute the multi-device collaborative identification method for engineering machinery vehicles provided in Embodiment 1 of the present invention, and has the corresponding functional modules and beneficial effects of the execution method. Example 4

[0037] Embodiment 4 of the present invention also provides a computer-readable storage medium storing a computer program thereon. When the computer program is executed by a processor, it implements the steps of the method described in Embodiment 1, and has the corresponding functional modules and beneficial effects of the method.

[0038] Those skilled in the art will understand that embodiments of this application can be provided as methods, apparatus, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0039] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (devices), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0040] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0041] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0042] The above description is only a preferred embodiment of the present invention. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the technical principles of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A method of coordinated recognition of multiple devices of a construction machine vehicle, characterized by, The method comprises the following steps: receiving vehicle feature data of a vehicle head or tail photographed by a corresponding camera triggered by an inductive coil; uploading the received vehicle feature data to a message queue; in response to reading vehicle feature data of a vehicle head in the message queue, putting the corresponding vehicle feature data into a delay queue and waiting for a preset coordination time; within the coordination time range, in response to reading vehicle feature data of a vehicle tail in the message queue, reading vehicle feature data of a vehicle head from the delay queue, splicing and fusing the vehicle feature data of the vehicle head and tail to obtain fused data; analyzing the fused data to obtain the license plate number in the fused data, matching the license plate number in the fused data with the license plate number in the preset whitelist list and vehicle release rule, and executing a decision on whether to open the gate according to the matching result.

2. The engineered machinery vehicle multi-device collaborative identification method of claim 1, wherein, Putting the corresponding vehicle feature data into the delay queue and waiting for the preset coordination time further comprises: within the coordination time range, if no vehicle feature data of a vehicle tail is read in the message queue, analyzing the vehicle feature data of the vehicle head out of the delay queue after the coordination time, obtaining the license plate number in the vehicle feature data of the vehicle head, matching the license plate number in the vehicle feature data of the vehicle head with the license plate number in the preset whitelist list and vehicle release rule, and executing a decision on whether to open the gate according to the matching result.

3. The engineered machinery vehicle multi-device collaborative identification method of claim 1, wherein, Further comprising: after uploading the received vehicle feature data to the message queue, in response to reading vehicle feature data of a vehicle tail first without reading vehicle feature data of a vehicle head in the message queue, analyzing the vehicle feature data of the vehicle tail to obtain the license plate number in the vehicle feature data of the vehicle tail, matching the license plate number in the vehicle feature data of the vehicle tail with the license plate number in the preset whitelist list and vehicle release rule, and executing a decision on whether to open the gate according to the matching result.

4. The method of claim 3, wherein, Further comprising: within the coordination time range, if neither the vehicle feature data of the vehicle head nor the vehicle feature data of the vehicle tail is consumed, increasing manual intervention, adjusting the installation angle of the camera, and increasing the number of auxiliary cameras.

5. The method according to claim 1, wherein when the fused data is less than a preset quantity threshold, the coordination time range is increased / decreased. The method comprises the following steps:

6. An apparatus for cooperative recognition of a plurality of devices of a construction machine vehicle, characterized by a receiving module for receiving vehicle feature data of a vehicle head or tail photographed by a corresponding camera triggered by an inductive coil; an uploading module for uploading the received vehicle feature data to a message queue; a delay module for, in response to reading vehicle feature data of a vehicle head in the message queue, putting the corresponding vehicle feature data into a delay queue and waiting for a preset coordination time; a fusion module for, within the coordination time range, in response to reading vehicle feature data of a vehicle tail in the message queue, reading vehicle feature data of a vehicle head from the delay queue, splicing and fusing the vehicle feature data of the vehicle head and tail to obtain fused data; ​ A matching module is configured to parse the fusion data, obtain the license plate number in the fusion data, match the license plate number in the fusion data with the license plate number in the pre-set white list and the license plate number in the vehicle release rule, and execute the decision on whether to open the gate for release according to the matching result.

7. An electronic terminal, characterized in that A computer program is stored in a memory connected to a processor, and when the computer program is executed by the processor, the steps of the method according to any one of claims 1 to 5 are executed.

8. A computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method according to any one of claims 1 to 5.

Images