License plate recognition system and method for intelligent parking system

Abstract

The invention is suitable for the field of intelligent parking, and provides a license plate recognition system and method for an intelligent parking system, and the system comprises an entrance camera, an exit camera, an entrance and exit control module, a data storage and processing module, a reservation module, a payment module, an auxiliary camera module, and a client. According to the invention, vehicle information is left in the system through an advanced reservation and payment mode, so that the license plate information can still be obtained through the reserved information when the vehicle enters and exits the parking lot and the license plate number is not identified, the vehicle can enter and exit, and the vehicle can enter and exit without the reserved information. The license plate number information of the vehicles in front of the entrance and exit is obtained by analyzing the model, color, brand and position relation data of the vehicles in the queue, so that even if the license plates of the vehicles in front of the gate cannot be collected, the vehicles can directly enter and exit the parking lot without backing up and self-confirmation of the system, and the passing efficiency is greatly improved.

Description

Technical Field

[0001] The present invention belongs to the field of intelligent parking, and in particular to a license plate recognition system and method for a smart parking system. Background Art

[0002] The Vehicle License Plate Recognition (VLPR) system is an important component of modern intelligent transportation systems and is widely used. Based on digital image processing, pattern recognition, computer vision and other technologies, it analyzes the vehicle images or video sequences taken by the camera to obtain the unique license plate number of each car, thereby completing the recognition process. Through some subsequent processing methods, it can achieve functions such as traffic flow control index measurement, vehicle positioning, car anti-theft, automatic supervision of speeding on highways, electronic police for running red lights, highway toll stations, etc. It has practical significance for maintaining traffic safety and urban security, preventing traffic jams, and realizing traffic automation management.

[0003] With the development of society, automatic license plate recognition technology has been increasingly applied to people's lives. Automatic recognition equipment has begun to be deployed at the entrance of the community, community parking lots and shopping mall parking lots, etc., automatically identifying the license plate number and automatically charging, which has brought a lot of convenience to people's lives. However, the recognition mechanism of the license plate recognition technology in the prior art is still insufficient. When vehicles queue up at the entrance and exit, some vehicles follow the vehicle too closely, resulting in the failure of the rear vehicle to recognize the vehicle after the front vehicle leaves. At this time, the user needs to back up the vehicle and then drive forward to the camera for re-recognition. However, since the distance between the vehicles does not meet the reversing conditions, the exit is blocked, which is very inconvenient and limits the further promotion of automatic license plate recognition. Summary of the invention

[0004] The purpose of the embodiments of the present invention is to provide the subject matter protected by the first independent claim, aiming to solve the technical problems existing in the prior art identified in the background technology.

[0005] The embodiment of the present invention is implemented as follows: on the one hand, a license plate recognition system for a smart parking system, the system comprising: an entrance camera, an exit camera, an entrance and exit control module, a data storage and processing module, a reservation module, a payment module, an auxiliary camera module and a client, wherein: The entrance and exit control module collects license plate images of vehicles entering and leaving through the entrance camera and the exit camera, and controls the gate switch; The data storage and processing module extracts the license plate information from the license plate image, and stores the extracted license plate number and entry time in the entry vehicle record table; If the information cannot be retrieved, the query mode is started, and the data storage and processing module extracts the vehicle information to be entered and exited during the period from the reservation module and the payment module, and stores it in the vehicle information table to be confirmed; The data storage and processing module identifies the model, color and brand of the vehicle through the auxiliary camera module, and compares it with the vehicle in the vehicle information table to be confirmed. If found, it is sent to the client for confirmation; If the confirmation fails, the retrieval mode is started, and the data storage and processing module extracts the vehicle information, license plate number information and vehicle queue information located on the road section before the entrance and exit from the auxiliary camera module, and stores them into the auxiliary information table; The data storage and processing module compares the extracted vehicle model, color, brand and information of the last vehicle that passed with the auxiliary information table, and allows the vehicle to pass if the four items are consistent.

[0006] As a further solution of the present invention, the specific steps of extracting the vehicle information to enter and exit during the time period from the reservation module include: The car owner reports the time in advance before entering the parking lot and enters the vehicle model, color, brand and license plate information in the client; The data storage and processing module extracts the vehicle information and entry time provided by the car owner from the client, stores the information of the vehicle to be confirmed in the table, and pushes the parking space information to the car owner in real time according to the internal conditions of the parking lot; After receiving the reservation vehicle entering the parking lot, the data storage and processing module deletes the corresponding record in the to-be-confirmed vehicle information table.

[0007] As a further solution of the present invention, the specific steps of extracting the vehicle information to be driven out during the time period from the payment module include: The car owner pays in advance through the client before leaving the parking lot; The data storage and processing module extracts the vehicle information of the paying user from the entry vehicle record table and stores it in the vehicle information table to be confirmed; After the paid vehicle leaves the parking lot, its corresponding information in the entry vehicle record table and the vehicle information table to be confirmed is deleted.

[0008] As a further solution of the present invention, the specific steps of the retrieval mode include: The auxiliary camera module scans the vehicle in front of the entrance and exit through the auxiliary camera 1 to extract the model, color and brand of the vehicle; The data storage and processing module receives the vehicle information sent from the auxiliary camera module and compares it with the vehicle information in the to-be-confirmed vehicle information table. If there is consistent information, it is sent to the client for confirmation. After the client confirms, the vehicle passes and its corresponding information in the to-be-confirmed vehicle information table is deleted; If the customer does not confirm, the auxiliary camera module monitors the vehicles on the road section before the entrance and exit in real time through the auxiliary camera 2, and extracts the model, color, brand, license plate information and position relationship of each vehicle in the queue; The data storage and processing module receives the information sent from the auxiliary camera module and stores it into the auxiliary information table; The data storage and processing module compares the extracted vehicle model, color, brand and information of the last passing vehicle with the auxiliary information table. If the four items are consistent, the vehicle is allowed to pass and its corresponding information in the auxiliary information table is deleted.

[0009] As a further solution of the present invention, the specific steps of comparing the extracted vehicle model, color, brand and the information of the last passing vehicle with the auxiliary information table include: The data storage and processing module generates candidate vehicles by comparing the vehicle information collected by the auxiliary camera 1 with the vehicle information collected by the auxiliary camera 2; The data storage and processing module extracts the vehicle information of the previous vehicle when the candidate vehicle is queuing to enter or exit the station; The data storage and processing module compares the vehicle information with the newly added vehicle information in the vehicle entry record table. If they are consistent, the license plate information of the candidate vehicle is used as the final recognized license plate number, the vehicle is allowed to pass, and stored in the vehicle entry record table.

[0010] As a further solution of the present invention, the specific steps of pushing parking space information to the car owner in real time according to the internal conditions of the parking lot include: The data storage and processing module extracts the occupancy status of the parking spaces through a camera arranged in the parking lot, and generates a parking space status table; The data storage and processing module will query the parking space status table, set the recommended priority of the parking space in the parking space occupancy status table, and push the highest priority and currently unoccupied parking space to the client according to the priority of the parking space.

[0011] As a further solution of the present invention, on the other hand, a license plate recognition method for a smart parking system is provided, characterized in that the license plate recognition system for a smart parking system described in any one of the above is adopted, and the method comprises the following steps: Extract the license plate information of the vehicle at the exit, and if possible, allow the vehicle to pass; If it cannot be retrieved, the query mode is started to extract the vehicle information that will enter and exit during the period from the reservation module and the charging module, and store it in the vehicle information table to be confirmed; The model, color and brand of the vehicle are identified through the auxiliary camera module and compared with the vehicles in the vehicle information table to be confirmed. If found, it is sent to the client for confirmation; If the confirmation fails, the search mode is started to extract the vehicle information, license plate number information and vehicle queue information located on the road section before the entrance and exit from the auxiliary camera module, and store them in the auxiliary information table; The model, color, brand and information of the last vehicle that passed through are compared with the auxiliary information table. If the four items are consistent, the vehicle is allowed to pass.

[0012] The beneficial effects of the embodiments of the present invention are: The present invention provides a license plate recognition system and method for a smart parking system, which extracts the license plate information of a vehicle at an exit, and allows the vehicle to pass if possible; if it cannot be extracted, starts the query mode, extracts the vehicle information to enter and exit during the period from the reservation module and the charging module, and stores it in a to-be-confirmed vehicle information table; identifies the model, color, and brand of the vehicle through an auxiliary camera module, and compares it with the vehicle in the to-be-confirmed vehicle information table, and if found, sends it to the client for confirmation; if it fails to pass the confirmation, starts the retrieval mode, extracts the vehicle information and license plate number information and vehicle queue information located on the road section before the entrance and exit from the auxiliary camera module, and stores it in the auxiliary information table; The extracted vehicle model, color, brand and information of the last vehicle that passed through are compared with the auxiliary information table. If the four items are consistent, the vehicle is allowed to pass. The vehicle information is left in the system by making an appointment in advance and paying a fee. When the vehicle enters and exits the parking lot, the license plate information can still be obtained through the reserved information when the license plate number is not recognized, so that the vehicle can enter and exit. In the case of no reserved information, the license plate number information of the vehicle in front of the entrance and exit can be obtained by analyzing the four data items of the model, color, brand and position relationship of the vehicle in the queue. Even if the license plate of the vehicle cannot be collected in front of the gate, there is no need to reverse. The vehicle can directly enter and exit the parking lot after the system confirms it, which greatly improves the traffic efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 This is the main structure diagram of the license plate recognition system used in the smart parking system; Figure 2 The main flow chart of the license plate recognition method for the smart parking system; Figure 3 A flowchart for extracting vehicle information from a reservation module in a license plate recognition system for a smart parking system; Figure 4 A flowchart for extracting vehicle information from a payment module in a license plate recognition system for a smart parking system; Figure 5Flow chart of the retrieval mode in the license plate recognition system for smart parking system. DETAILED DESCRIPTION

[0014] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0015] The specific implementation of the present invention is described in detail below in conjunction with specific embodiments.

[0016] Figure 1 The license plate recognition system for a smart parking system provided by an embodiment of the present invention includes an entrance camera, an exit camera, an entrance and exit control module, a data storage and processing module, a reservation module, a payment module, an auxiliary camera module and a client, wherein: The entrance and exit control module collects license plate images of vehicles entering and leaving through the entrance camera and the exit camera, and controls the gate switch; The data storage and processing module extracts the license plate information from the license plate image, and stores the extracted license plate number and entry time in the entry vehicle record table; If the information cannot be retrieved, the query mode is started, and the data storage and processing module extracts the vehicle information to be entered and exited during the period from the reservation module and the payment module, and stores it in the vehicle information table to be confirmed; The data storage and processing module identifies the model, color and brand of the vehicle through the auxiliary camera module, and compares it with the vehicle in the vehicle information table to be confirmed. If found, it is sent to the client for confirmation; If the confirmation fails, the retrieval mode is started, and the data storage and processing module extracts the vehicle information, license plate number information and vehicle queue information located on the road section before the entrance and exit from the auxiliary camera module, and stores them into the auxiliary information table; The data storage and processing module compares the extracted vehicle model, color, brand and information of the last vehicle that passed with the auxiliary information table, and allows the vehicle to pass if the four items are consistent.

[0017] When this embodiment is applied, when a vehicle enters or leaves the parking lot, the entrance camera or the exit camera can collect the license plate in front of the gate. Because the angles of the entrance camera and the exit camera are fixed, when the distance between the two vehicles is short, after the front vehicle passes, the license plate of the rear vehicle has entered the blind spot of the shooting, and the license plate information of the rear vehicle can no longer be collected. The data storage and processing module identifies the model, color, and brand of the vehicle through the auxiliary camera module, and queries the system whether there are similar vehicles that will enter and exit the parking lot during this time period. When there are alternative options, a confirmation message is sent to the corresponding client. If the result is yes, After confirmation, the vehicle passes. If not confirmed, the data storage and processing module extracts the vehicle information, license plate number information and vehicle queue information on the road section before the entrance and exit from the auxiliary camera module, and compares the vehicle information in front of the gate with the vehicle information on the road section before the entrance and exit extracted from the auxiliary camera module. If the vehicle information matches, the vehicle in front of the gate is confirmed according to the vehicle queue information, the license plate number information of the vehicle is extracted, and it is allowed to pass. Even if the license plate of the vehicle cannot be collected in front of the gate, there is no need to reverse. After the system confirms it by itself, it can directly enter and exit the parking lot, which greatly improves the traffic efficiency.

[0018] The data storage and processing module can be an independent physical server or terminal, or a server cluster composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud servers, cloud databases, cloud storage and CDN.

[0019] The client can be a smart phone, a tablet computer, a smart watch, etc., but is not limited thereto. The client and the data storage and processing module can be connected via a network, and the present invention does not limit this.

[0020] like Figure 3 As shown, as a preferred embodiment of the present invention, the specific steps of extracting the vehicle information to enter and exit during the time period from the reservation module include: The car owner reports the time in advance before entering the parking lot and enters the vehicle model, color, brand and license plate information in the client; The data storage and processing module extracts the vehicle information and entry time provided by the car owner from the client, stores the information of the vehicle to be confirmed in the table, and pushes the parking space information to the car owner in real time according to the internal conditions of the parking lot; After receiving the reservation vehicle entering the parking lot, the data storage and processing module deletes the corresponding record in the to-be-confirmed vehicle information table.

[0021] As a preferred embodiment of the present invention, the specific steps of pushing parking space information to the car owner in real time according to the internal conditions of the parking lot include: The data storage and processing module extracts the occupancy status of the parking spaces through a camera arranged in the parking lot, and generates a parking space status table; The data storage and processing module will query the parking space status table, set the recommended priority of the parking space in the parking space occupancy status table, and push the highest priority and currently unoccupied parking space to the client according to the priority of the parking space.

[0022] When this embodiment is applied, a plurality of internal cameras are arranged inside the parking lot. The data storage and processing module extracts the occupation status of each parking space inside the parking lot through the internal cameras and generates a parking space status table. The parking spaces in the existing parking lot are arranged in parallel. When the owner parks, if there are no vehicles parked on both sides of the parking space, the owner can easily complete the parking operation. Therefore, if there are no obstructions within the preset distance range on both sides of a parking space, the priority of the parking space is the highest. If there are no obstructions within the preset distance range on only one side of a parking space, the priority of the parking space is medium. If there are obstructions within the preset distance range on both sides of a parking space, the priority of the parking space is the lowest. When the owner completes the reservation operation, the data storage and processing module pushes the parking space with the highest priority and currently unoccupied to the client according to the priority of the parking space, so that the owner can quickly complete the parking operation after entering the parking lot, thereby avoiding the vehicle constantly wandering around in the parking lot to search for parking spaces, causing congestion in the parking lot, improving parking efficiency, and bringing great convenience to the owner.

[0023] As a preferred embodiment of the present invention, the parking space priority push step includes: the data storage and processing module will query the parking space status table, select the parking space with the highest priority and currently unoccupied in the parking lot, if it does not exist, select the parking space with a medium priority and currently unoccupied, if it does not exist, select the parking space with the lowest priority and currently unoccupied.

[0024] like Figure 4 As shown, as a preferred embodiment of the present invention, the specific steps of extracting the vehicle information to be driven out during the time period from the payment module include: The car owner pays in advance through the client before leaving the parking lot; The data storage and processing module extracts the vehicle information of the paying user from the entry vehicle record table and stores it in the vehicle information table to be confirmed; After the paid vehicle leaves the parking lot, its corresponding information in the entry vehicle record table and the vehicle information table to be confirmed is deleted.

[0025] When this embodiment is applied, the car owner can perform payment operations in advance in the client before leaving the parking lot. After the data storage and processing module receives the charging information sent by the client, it extracts the vehicle information of the paying user from the entry vehicle record table, and the vehicle information includes the vehicle model, color, brand, and license plate number information. The vehicle information obtained in advance is stored in the vehicle information table to be confirmed. When the vehicle leaves the parking lot normally, its information in the entry vehicle record table is deleted. When the vehicle cannot be captured by the exit camera at the exit, the data storage and processing module identifies the model, color, and brand of the vehicle through the auxiliary camera module, and queries whether there are similar vehicles in the vehicle information table to be confirmed that will enter and exit the parking lot during this time period. When there are alternative options, a confirmation message is sent to the corresponding client. If confirmed, the vehicle passes, so that the vehicle can directly exit the parking lot without queuing at the exit of the parking lot to pay, thereby reducing the occurrence of vehicles that cannot be identified due to queuing, and improving the entry and exit efficiency of the parking lot.

[0026] like Figure 5 As shown, as a preferred embodiment of the present invention, the specific steps of the retrieval mode include: The auxiliary camera module scans the vehicle in front of the entrance and exit through the auxiliary camera 1 to extract the model, color and brand of the vehicle; The data storage and processing module receives the vehicle information sent from the auxiliary camera module and compares it with the vehicle information in the to-be-confirmed vehicle information table. If there is consistent information, it is sent to the client for confirmation. After the client confirms, the vehicle passes and its corresponding information in the to-be-confirmed vehicle information table is deleted; If the customer does not confirm, the auxiliary camera module monitors the vehicles on the road section before the entrance and exit in real time through the auxiliary camera 2, and extracts the model, color, brand, license plate information and position relationship of each vehicle in the queue; The data storage and processing module receives the information sent from the auxiliary camera module and stores it into the auxiliary information table; The data storage and processing module compares the extracted vehicle model, color, brand and information of the last passing vehicle with the auxiliary information table. If the four items are consistent, the vehicle is allowed to pass and its corresponding information in the auxiliary information table is deleted.

[0027] When this embodiment is used, the auxiliary camera 1 set at the entrance and exit extracts the model, color and brand of the vehicle. The data storage and processing module receives the vehicle information extracted by the auxiliary camera 1 and compares it with the vehicle information in the vehicle information table to be confirmed. Because in the reservation module, the owner has entered the model, color and brand of the vehicle into the system before entering the parking lot, and stored them in the vehicle information table to be confirmed. By comparing the three sets of vehicle data, if the three sets of data are the same, alternative vehicle 1, alternative vehicle 2...alternative vehicle n are generated, and confirmation information is sent to the client of the corresponding owner based on the obtained alternative vehicles. If the owner confirms it, the license plate information of the alternative vehicle corresponding to the owner is used as the final recognized license plate number, and the vehicle is allowed to pass. The information of the vehicles in the queue is collected by the auxiliary camera 2, and the model, color, brand, license plate information and position relationship of each vehicle in the queue are extracted from the video information, and the information of the extracted vehicle model, color, brand and the last vehicle passing through the auxiliary information table are compared with the auxiliary information table. If the four items are consistent, the vehicle is allowed to pass and the corresponding information in the auxiliary information table is deleted, so that even if the license plate of the vehicle cannot be collected in front of the gate, there is no need to reverse. After the system confirms itself, it can directly enter and exit the parking lot, which greatly improves the traffic efficiency.

[0028] As a preferred embodiment of the present invention, the specific steps of comparing the extracted vehicle model, color, brand and the information of the last passing vehicle with the auxiliary information table include: The data storage and processing module generates candidate vehicles by comparing the vehicle information collected by the auxiliary camera 1 with the vehicle information collected by the auxiliary camera 2; The data storage and processing module extracts the vehicle information of the previous vehicle when the candidate vehicle is queuing to enter or exit the station; The data storage and processing module compares the vehicle information with the newly added vehicle information in the vehicle entry record table. If they are consistent, the license plate information of the candidate vehicle is used as the final recognized license plate number, the vehicle is allowed to pass, and stored in the vehicle entry record table.

[0029] When this embodiment is used, if the owner of the vehicle does not report in advance when entering or exiting the parking lot, and the license plate information cannot be extracted at the entrance or exit, the data storage and processing module collects the video information on the road section in front of the entrance or exit through the auxiliary camera 2, and extracts the model, color, brand, license plate information and position relationship of each vehicle in the queue from the video information. For example, vehicle A and vehicle B have the same model, color and brand, and both want to enter or exit the parking lot at the same time period. Vehicle C is in front of vehicle A, and vehicle D is in front of vehicle B. Vehicle A is now in front of the entrance or exit, and the data storage and processing module collects the video information on the road section in front of the entrance or exit through the auxiliary camera 2. After comparing the model, color and brand of vehicle A with the information collected by the auxiliary camera 1, it is concluded that vehicle A and vehicle B are candidate vehicles. The data storage and processing module inquires based on the video information that the vehicle in front of vehicle A is vehicle C, and the vehicle in front of vehicle B is vehicle D. The data storage and processing module inquires about the newly added vehicle in the entry vehicle record table and finds that it is vehicle C. The license plate of vehicle A in the auxiliary information table is extracted. The license plate information of vehicle A is used as the final identified license plate number, the vehicle is allowed to pass, and is stored in the entry vehicle record table. At the same time, the record corresponding to the license plate number is deleted from the auxiliary information table.

[0030] like Figure 2 As shown, in one embodiment, a license plate recognition method for a smart parking system is proposed. This embodiment mainly applies the method to the above Figure 1 Take the license plate recognition system for the smart parking system in the example. The specific steps may include: Step S10: extracting the license plate information of the vehicle at the exit, and if possible, allowing the vehicle to pass; Step S11: If the information cannot be retrieved, the query mode is started to retrieve the vehicle information that will enter and exit the time period from the reservation module and the charging module, and store the information in the vehicle information table to be confirmed; Step S12: Identify the model, color, and brand of the vehicle through the auxiliary camera module, and compare it with the vehicles in the vehicle information table to be confirmed. If found, send it to the client for confirmation; Step S13: If the confirmation fails, the search mode is started to extract the vehicle information, license plate number information and vehicle queue information located on the road section before the entrance and exit from the auxiliary camera module, and store them in the auxiliary information table; Step S14: The model, color, brand and information of the last vehicle passing through the vehicle are compared with the auxiliary information table. If the four items are consistent, the vehicle is allowed to pass.

[0031] The above-mentioned embodiment of the present invention provides a license plate recognition system for a smart parking system, and based on the license plate recognition system for a smart parking system, provides a license plate recognition method for a smart parking system, by extracting the license plate information of the vehicle at the exit, if possible, allowing the vehicle to pass; if it cannot be extracted, starting the query mode, extracting the vehicle information to enter and exit during the time period from the reservation module and the charging module, and storing it in the vehicle information table to be confirmed; identifying the model, color, and brand of the vehicle through the auxiliary camera module, and comparing it with the vehicle in the vehicle information table to be confirmed, if found, sending it to the client for confirmation; if it fails to pass the confirmation, starting the retrieval mode, extracting the vehicle information and license plate number located on the road section before the entrance and exit from the auxiliary camera module The information and vehicle queue information are stored in the auxiliary information table; the model, color, brand and information of the last vehicle that passed through the vehicle are compared with the auxiliary information table. If the four items are consistent, the vehicle is allowed to pass. The vehicle information is left in the system by making an appointment in advance and paying a fee. When the vehicle enters and exits the parking lot, the license plate information can be obtained through the reserved information when the license plate number is not recognized, so as to realize the entry and exit of the vehicle. In the case of no reserved information, the license plate number information of the vehicle in front of the entrance and exit can be obtained by analyzing the four data of the model, color, brand and position relationship of the vehicle in the queue. Even if the license plate of the vehicle cannot be collected in front of the gate, there is no need to reverse. After the system confirms it by itself, it can directly enter and exit the parking lot, which greatly improves the traffic efficiency.

[0032] In order to load the above-mentioned method and system and enable it to run smoothly, the system, in addition to the various modules mentioned above, may also include more or fewer components than described above, or a combination of certain components, or different components, for example, it may include input and output devices, network access devices, buses, processors and memories, etc.

[0033] The processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc. The processor is the control center of the system, and various interfaces and lines are used to connect various parts.

[0034] The above-mentioned memory can be used to store computer and system programs and / or modules. The above-mentioned processor realizes the above-mentioned various functions by running or executing the computer programs and / or modules stored in the memory, and calling the data stored in the memory. The memory can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as an information collection template display function, a product information release function, etc.). The data storage area can store data created according to the use of the berth status display system (such as product information collection templates corresponding to different product types, product information that needs to be released by different product providers, etc.). In addition, the memory can include a high-speed random access memory, and can also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (SmartMediaCard, SMC), a secure digital (SecureDigital, SD) card, a flash card (FlashCard), at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0035] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0036] The above-mentioned embodiments only express several implementation methods of the present invention, and the description thereof is relatively specific and detailed, but it cannot be understood as limiting the scope of the patent of the present invention. It should be pointed out that, for ordinary technicians in this field, several variations and improvements can be made without departing from the concept of the present invention, which all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the attached claims.

[0037] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A license plate recognition system for a smart parking system, characterized in that: The system includes: an entrance camera, an exit camera, an entrance and exit control module, a data storage and processing module, a reservation module, a payment module, an auxiliary camera module and a client, wherein: The entrance and exit control module collects license plate images of vehicles entering and leaving through the entrance camera and the exit camera, and controls the gate switch; The data storage and processing module extracts the license plate information from the license plate image, and stores the extracted license plate number and entry time in the entry vehicle record table; If the information cannot be retrieved, the query mode is started, and the data storage and processing module extracts the vehicle information to be entered and exited during the period from the reservation module and the payment module, and stores it in the vehicle information table to be confirmed; The data storage and processing module identifies the model, color and brand of the vehicle through the auxiliary camera module, and compares it with the vehicle in the vehicle information table to be confirmed. If found, it is sent to the client for confirmation; If the confirmation fails, the retrieval mode is started, and the data storage and processing module extracts the vehicle information, license plate number information and vehicle queue information located on the road section before the entrance and exit from the auxiliary camera module, and stores them into the auxiliary information table; The data storage and processing module compares the extracted vehicle model, color, brand and information of the last vehicle that passed with the auxiliary information table, and allows the vehicle to pass if the four items are consistent.

2. The license plate recognition system for a smart parking system according to claim 1, characterized in that: The specific steps of extracting the vehicle information to enter and exit during the period from the reservation module include: The car owner reports the time in advance before entering the parking lot and enters the model, color, brand and license plate information of the vehicle in the client; The data storage and processing module extracts the vehicle information and entry time provided by the car owner from the client, stores the information of the vehicle to be confirmed in the table, and pushes the parking space information to the car owner in real time according to the internal conditions of the parking lot; After receiving the reservation vehicle entering the parking lot, the data storage and processing module deletes the corresponding record in the to-be-confirmed vehicle information table.

3. The license plate recognition system for a smart parking system according to claim 1, characterized in that: The specific steps of extracting the vehicle information to be driven out during the period from the payment module include: The car owner pays in advance through the client before leaving the parking lot; The data storage and processing module extracts the vehicle information of the paying user from the entry vehicle record table and stores it in the vehicle information table to be confirmed; After the paid vehicle leaves the parking lot, its corresponding information in the entry vehicle record table and the vehicle information table to be confirmed is deleted.

4. The license plate recognition system for a smart parking system according to claim 1, characterized in that: The specific steps of the retrieval mode include: The auxiliary camera module scans the vehicle in front of the entrance and exit through the auxiliary camera 1 to extract the model, color and brand of the vehicle; The data storage and processing module receives the vehicle information sent from the auxiliary camera module and compares it with the vehicle information in the to-be-confirmed vehicle information table. If there is consistent information, it is sent to the client for confirmation. After the client confirms, the vehicle passes and its corresponding information in the to-be-confirmed vehicle information table is deleted; If the customer does not confirm, the auxiliary camera module monitors the vehicles on the road section before the entrance and exit in real time through the auxiliary camera 2, and extracts the model, color, brand, license plate information and position relationship of each vehicle in the queue; The data storage and processing module receives the information sent from the auxiliary camera module and stores it into the auxiliary information table; The data storage and processing module compares the extracted vehicle model, color, brand and information of the last passing vehicle with the auxiliary information table. If the four items are consistent, the vehicle is allowed to pass and its corresponding information in the auxiliary information table is deleted.

5. The license plate recognition system for a smart parking system according to claim 1, characterized in that: The specific steps of comparing the extracted vehicle model, color, brand and the last passing vehicle information with the auxiliary information table include: The data storage and processing module generates candidate vehicles by comparing the vehicle information collected by the auxiliary camera 1 with the vehicle information collected by the auxiliary camera 2; The data storage and processing module extracts the vehicle information of the previous vehicle when the candidate vehicle is queuing to enter or exit the station; The data storage and processing module compares the vehicle information with the newly added vehicle information in the vehicle entry record table. If they are consistent, the license plate information of the candidate vehicle is used as the final recognized license plate number, the vehicle is allowed to pass, and stored in the vehicle entry record table.

6. The license plate recognition system for a smart parking system according to claim 1, characterized in that: The specific steps of pushing parking space information to the car owner in real time according to the internal conditions of the parking lot include: The data storage and processing module extracts the occupancy status of the parking spaces through a camera arranged in the parking lot, and generates a parking space status table; The data storage and processing module will query the parking space status table, set the recommended priority of the parking space in the parking space occupancy status table, and push the highest priority and currently unoccupied parking space to the client according to the priority of the parking space.

7. The license plate recognition system for a smart parking system according to claim 1, characterized in that: The parking space priority push step includes: the data storage and processing module will query the parking space status table, select the parking space with the highest priority and currently unoccupied in the parking lot, if it does not exist, select the parking space with a medium priority and currently unoccupied, if it does not exist, select the parking space with the lowest priority and currently unoccupied.

8. A license plate recognition method for a smart parking system, characterized in that: The license plate recognition system for a smart parking system according to any one of claims 1 to 7 is adopted, and the method comprises the following steps: Extract the license plate information of the vehicle at the exit, and if possible, allow the vehicle to pass; If it cannot be retrieved, the query mode is started to extract the vehicle information that will enter and exit during the period from the reservation module and the charging module, and store it in the vehicle information table to be confirmed; The model, color and brand of the vehicle are identified through the auxiliary camera module and compared with the vehicles in the vehicle information table to be confirmed. If found, it is sent to the client for confirmation; If the confirmation fails, the search mode is started to extract the vehicle information, license plate number information and vehicle queue information located on the road section before the entrance and exit from the auxiliary camera module, and store them in the auxiliary information table; The model, color, brand and information of the last vehicle that passed through are compared with the auxiliary information table. If the four items are consistent, the vehicle is allowed to pass.

Images