Vehicle non-inductive charging method and system based on multi-source information fusion identification

Abstract

The invention provides a vehicle non-inductive charging method and system based on multi-source information fusion recognition, and the method comprises the steps: recognizing the vehicle information of a vehicle through a front camera when the vehicle runs to a charging area, and constructing a vehicle ID corresponding to the vehicle information, the vehicle information comprising a vehicle license plate, a vehicle color and a vehicle position; when the vehicle passes through the shooting range of the front camera, the vehicle license plate is recognized again through the position tracking camera, the recognized vehicle license plate is compared with the current vehicle license plate corresponding to the vehicle ID, and whether the vehicle information and the vehicle ID are updated or not is judged; when the vehicle runs to the toll island, identifying the vehicle license plate again through the lane camera equipment, comparing the identified vehicle license plate with the current vehicle license plate corresponding to the vehicle ID, and judging whether the vehicle information and the vehicle ID are updated or not; and performing a transaction based on the final vehicle information and the vehicle ID, and deleting the vehicle ID after the transaction.

Description

Technical Field

[0001] The present invention relates to the technical field of electronic toll collection on expressways, and in particular to a vehicle non-sensing toll collection method and system based on multi-source information fusion and recognition. Background Art

[0002] The Electronic Toll Collection System (ETC), also known as a non-stop toll collection system, is an automated toll collection method that utilizes advanced information and communication technologies. This system utilizes antennas and vehicle type recognition systems installed at the entrances and exits of toll booths on toll roads, highways, bridges, and tunnels, along with onboard devices (such as ETC onboard equipment or dedicated electronic cards) installed on vehicles. When vehicles pass through these toll booths, there's no need to stop and pay manually. The system automatically identifies the vehicle and deducts the corresponding toll from pre-deposited funds.

[0003] ETC uses Dedicated Short-Range Communication (DSRC) technology to enable non-stop toll collection through wireless signal exchange. However, in actual use, ETC transactions can easily fail due to interference from adjacent lanes, reflections from trucks, and reflections from information boards. Summary of the Invention

[0004] In view of this, an embodiment of the present invention provides a vehicle contactless charging method based on multi-source information fusion and identification to eliminate or improve one or more defects in the prior art.

[0005] One aspect of the present invention provides a vehicle contactless toll collection method based on multi-source information fusion and recognition. The method is based on a front-end recognition device and a lane camera device. The front-end recognition device is arranged in front of the lane camera device and includes a front camera and a position tracking camera. The method comprises the following steps:

[0006] When a vehicle drives towards a toll area, the front camera identifies the vehicle information of the vehicle and constructs a vehicle ID corresponding to the vehicle information, wherein the vehicle information includes the vehicle license plate, vehicle color and vehicle location;

[0007] When the vehicle passes through the shooting range of the front camera, the vehicle license plate is recognized again by the position tracking camera, and the recognized vehicle license plate is compared with the vehicle license plate currently corresponding to the vehicle ID to determine whether to update the vehicle information and vehicle ID;

[0008] When the vehicle arrives at the toll island, the lane camera device recognizes the vehicle license plate again, compares the recognized vehicle license plate with the vehicle license plate currently corresponding to the vehicle ID, and determines whether to update the vehicle information and vehicle ID;

[0009] The transaction is conducted based on the final vehicle information and vehicle ID, and the vehicle ID is deleted after the transaction.

[0010] Adopting the above scheme, this scheme deploys multi-source information fusion recognition equipment in the toll station area to perform multi-source fusion recognition of information such as the location, license plate, OBU and vehicle color of vehicles passing through the toll station area, and links it with the toll collection system in real time to accurately identify vehicles that have completed transactions, thereby increasing the passing rate of ETC vehicles and the accuracy of license plate payment and prepaid payment recognition in manual toll lanes, ultimately improving the toll collection accuracy and reliability of toll stations and providing a better traffic service experience.

[0011] In some embodiments of the present invention, the front recognition device also includes a roadside antenna. If the vehicle is an ETC vehicle equipped with an on-board terminal, in the step of identifying the vehicle information of the vehicle through the front camera, the OBU record is obtained from the vehicle on-board terminal through the roadside antenna, and the vehicle license plate in the OBU record is compared with the vehicle license plate identified by the front camera.

[0012] In some embodiments of the present invention, in the step of comparing the vehicle license plate in the OBU record with the vehicle license plate recognized by the front camera, if the difference between the vehicle license plate in the OBU record and the vehicle license plate recognized by the front camera is less than a preset number of characters, the vehicle license plate in the OBU record is used as the vehicle license plate in the vehicle information.

[0013] In some embodiments of the present invention, in the step of re-identifying the vehicle license plate by the position tracking camera, comparing the identified vehicle license plate with the vehicle license plate currently corresponding to the vehicle ID, and determining whether to update the vehicle information and vehicle ID, the vehicle license plate and vehicle position are re-identified by the position tracking camera, and the vehicle license plate identified by the position tracking camera is compared with the vehicle license plate in the current vehicle information, and the vehicle position identified by the position tracking camera is compared with the vehicle position in the current vehicle information, to determine whether to update the vehicle information and vehicle ID.

[0014] In some embodiments of the present invention, the position tracking camera corresponds to the front camera on a one-to-one basis, and the position tracking camera tracks a corresponding vehicle that has left the field of view of the front camera. In the step of comparing the vehicle license plate recognized by the position tracking camera with the vehicle license plate in the current vehicle information, and comparing the vehicle position recognized by the position tracking camera with the vehicle position in the current vehicle information, and determining whether to update the vehicle information and vehicle ID:

[0015] If the vehicle position identified by the position tracking camera is the same as the vehicle position in the current vehicle information, and the difference between the vehicle license plate in the current vehicle information and the vehicle license plate identified by the position tracking camera is less than the preset number of characters, the vehicle information and vehicle ID remain unchanged;

[0016] If the vehicle position identified by the position tracking camera is different from the vehicle position in the current vehicle information, the vehicle position in the vehicle information is updated;

[0017] If the vehicle position identified by the position tracking camera is different from the vehicle position in the current vehicle information, and the difference between the vehicle license plate in the current vehicle information and the vehicle license plate identified by the position tracking camera is not less than a preset number of characters, the vehicle position and vehicle license plate of the vehicle information are updated; and a new vehicle ID is generated to update the original vehicle ID.

[0018] In some embodiments of the present invention, when a vehicle reaches a toll island, the lane camera device recognizes the vehicle license plate again, compares the recognized vehicle license plate with the vehicle license plate currently corresponding to the vehicle ID, and determines whether to update the vehicle information and vehicle ID:

[0019] If the difference between the vehicle license plate of the vehicle identified by the lane camera device and the vehicle license plate in any vehicle information in the current database is less than a preset number of characters, and the vehicle position of the vehicle identified by the lane camera device is the same as the vehicle position in the vehicle information, then a correspondence between the vehicle information and the vehicle identified by the lane camera device is established, and the vehicle information and vehicle ID of the vehicle are kept unchanged;

[0020] If the difference between the vehicle license plate of the vehicle identified by the lane camera device and the vehicle license plate in any vehicle information in the current database is less than the preset number of characters, but the vehicle position of the vehicle identified by the lane camera device is different from the vehicle position in the vehicle information, then the vehicle position in the vehicle information of the vehicle is updated and the vehicle ID remains unchanged;

[0021] If the license plate of the vehicle recognized by the lane camera device differs from the license plate in any vehicle information in the current database by no less than a preset number of characters, the vehicle information of the vehicle recognized by the lane camera device creates a vehicle ID corresponding to the vehicle information.

[0022] In some embodiments of the present invention, in the step of conducting a transaction based on the final vehicle information and vehicle ID, and deleting the vehicle ID after the transaction, if the vehicle is an ETC vehicle equipped with an on-board terminal, the toll collection system conducts an ETC transaction on the vehicle, deletes the vehicle ID after the transaction, and issues a barrier lifting instruction. After the barrier lifting instruction is issued, the toll collection system continuously monitors whether the barrier is lifted. If the barrier is not lifted, a prompt instruction is sent to the toll collector's control terminal.

[0023] In some embodiments of the present invention, in the step of conducting a transaction based on the final vehicle information and vehicle ID and deleting the vehicle ID after the transaction, if the vehicle is not an ETC vehicle equipped with an on-board terminal, the toll collection system adopts a contactless deduction charging mode. The contactless deduction charging mode includes prepayment by license plate. The toll collection system background automatically generates a record of prepayment or license plate payment, and issues a barrier lifting instruction based on the current vehicle information. After the barrier lifting instruction is issued, it continuously monitors whether the barrier is lifted. If the barrier is not lifted, a prompt instruction is sent to the toll collector's control terminal.

[0024] The second aspect of the present invention also provides a vehicle contactless toll collection system based on multi-source information fusion and identification, which includes a computer device, wherein the computer device includes a processor and a memory, wherein the memory stores computer instructions, and the processor is used to execute the computer instructions stored in the memory. When the computer instructions are executed by the processor, the system implements the steps implemented by the method described above.

[0025] The third aspect of the present invention also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the aforementioned vehicle contactless charging method based on multi-source information fusion and recognition.

[0026] Additional advantages, objects, and features of the present invention will be described in part in the following description and will become apparent to those skilled in the art after studying the following or may be learned by practice of the present invention. The objects and other advantages of the present invention may be particularly pointed out and attained in the description and drawings.

[0027] Those skilled in the art will understand that the purposes and advantages that can be achieved by the present invention are not limited to the above specific descriptions, and the above and other purposes that can be achieved by the present invention will be more clearly understood based on the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The drawings described herein are used to provide a further understanding of the present invention, constitute a part of this application, and do not constitute a limitation of the present invention.

[0029] Figure 1 A schematic diagram of an implementation method of the vehicle contactless charging method based on multi-source information fusion and identification in this scheme;

[0030] Figure 2 This is a schematic diagram of the equipment layout of this solution;

[0031] Figure 3 This is a schematic diagram of the ETC vehicle charging process of this solution;

[0032] Figure 4 This is a schematic diagram of the non-ETC vehicle charging process for this scheme. DETAILED DESCRIPTION

[0033] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the embodiments and the accompanying drawings. Here, the exemplary embodiments of the present invention and their descriptions are used to explain the present invention, but are not intended to limit the present invention.

[0034] It should also be noted that, in order to avoid obscuring the present invention due to unnecessary details, the accompanying drawings only show structures and / or processing steps closely related to the solutions according to the present invention, while other details that are not closely related to the present invention are omitted.

[0035] Electronic Toll Collection (ETC) on highways has become widespread nationwide. However, in practice, ETC transactions often fail due to inconsistent sensitivity of onboard units (OBUs), regional differences in roadside antennas (RSUs), and wireless signal interference, such as interference from adjacent lanes, reflections from trucks, and reflections from information boards.

[0036] In addition, even if the ETC transaction is successful, when a vehicle passes through the ETC lane, due to problems such as following the vehicle and vehicle identification errors, the vehicle that has completed a normal ETC transaction may encounter a barrier in the toll lane that cannot be lifted in time. These low-probability events have a certain impact on the traffic efficiency of the ETC and manual toll lanes.

[0037] In manual toll lanes, some toll stations support pre-paid transactions and "license plate payment" transactions that automatically deduct fees through license plate recognition. The success rate of license plate recognition is greatly affected by light reflection and occlusion, and there are also certain recognition errors and omissions.

[0038] like Figure 1 and 2 As shown, the present invention proposes a vehicle non-sensing charging method based on multi-source information fusion and recognition. The method is based on a front recognition device and a lane camera device. The front recognition device is arranged in front of the lane camera device. The front recognition device includes a front camera and a position tracking camera. The steps of the method include:

[0039] Step S100, when a vehicle travels towards a toll area, the front camera identifies the vehicle information of the vehicle and constructs a vehicle ID corresponding to the vehicle information, wherein the vehicle information includes the vehicle license plate, vehicle color and vehicle location;

[0040] During the specific implementation process, if the vehicle is an ETC vehicle equipped with an on-board terminal, the vehicle information also includes the OBU serial number of the on-board ETC.

[0041] Step S200, when the vehicle passes through the shooting range of the front camera, the vehicle license plate is recognized again by the position tracking camera, and the recognized vehicle license plate is compared with the vehicle license plate currently corresponding to the vehicle ID to determine whether to update the vehicle information and vehicle ID;

[0042] Specifically, the front recognition device also includes a long-range camera. When the vehicle drives in front of the toll station, the long-range camera identifies the vehicle license plate, vehicle color, and vehicle location information, and performs continuous location recognition. If the location recognition result matches the result of the front camera recognition, a unique vehicle ID is assigned.

[0043] In some embodiments of the present invention, the vehicle position information in the vehicle information is the lane where the vehicle is located.

[0044] Step S300, when the vehicle drives to the toll island, the vehicle license plate is recognized again by the lane camera device, the recognized vehicle license plate is compared with the vehicle license plate currently corresponding to the vehicle ID, and it is determined whether the vehicle information and vehicle ID are updated;

[0045] After a vehicle enters the toll island, the RSU first identifies the OBU information installed on the ETC vehicle. The camera then identifies the vehicle's license plate, color, and location, and the identification results are returned to the toll collection system. After the vehicle enters the toll island, its trajectory is tracked and identified by the position-tracking camera until it enters the isolated lane of the toll island. In areas where the fields of view of different cameras overlap, vehicle position identification is achieved through position matching. When the center point error of the vehicle detected by different cameras at the same time is less than 1 meter, it can be determined to be the same vehicle. Each camera has a fixed position-tracking field of view, and the different locations in the images it captures can be calibrated in advance. Calibration methods can use latitude and longitude or relative position calibration.

[0046] Step S400: Conduct a transaction based on the final vehicle information and vehicle ID, and delete the vehicle ID after the transaction.

[0047] The equipment layout of the present invention is as follows Figure 2As shown, on the basis of the existing lane equipment, a front camera and a position tracking camera are added. The front camera is mainly a camera and an RSU, which are installed on the front gantry. According to the on-site installation conditions of the toll station, the front camera can also be installed on the roadside L-pole or column. The front identification equipment includes an RSU, which is used to identify the information of the on-board ETC terminal OBU; and a camera, which is used to identify the license plate and vehicle position information. In order to more accurately identify the vehicle position, position detection equipment such as laser radar and millimeter wave radar can be added, and photoelectric vehicle detectors or ground induction coil detectors can be laid in the camera's capture area. When the vehicle passes through the detection area, the camera at the corresponding position is triggered to capture and identify, so as to increase the accuracy of the camera's recognition of the vehicle and license plate. Whether or not to add position detection equipment does not affect the implementation effect of the present invention. The front camera can also use a three-eye camera. In Figure 2 In order to ensure the accuracy and consistency of position recognition, the front camera and the position tracking camera are arranged in a bidirectional manner, and the recognition area of the rear position tracking camera partially overlaps with the recognition area of the lane camera equipment.

[0048] When a vehicle enters the toll booth area, the front-end recognition device first identifies the vehicle's information and location. Then, as the vehicle passes through the sensing area of the front gantry / column, the vehicle's information and location are also recognized. Once the vehicle enters the toll booth's isolated lane, the lane camera recognizes the license plate and location. Each camera provides a confidence score for each license plate recognition result, allowing for secondary judgments when different cameras' recognition results differ.

[0049] Position-tracking cameras can be installed beneath the toll plaza canopy. The installation location and number of cameras are selected based on camera parameters to ensure coverage of vehicle license plates and location information throughout the entire toll plaza. When a vehicle enters the toll plaza, lane cameras identify the vehicle's license plate and location. The lane cameras measure the vehicle's longitudinal distance within the lane and verify that the license plate matches the position-tracking camera's recognition result.

[0050] This solution uses multiple sets of cameras to continuously identify the vehicle's driving path and position, and integrates the recognition results of other vehicle detection equipment such as RSU to track the passing vehicles in real time and identify their transaction status. This way, the transaction status of the vehicle is known when it reaches the toll lane exit, realizing automated or semi-automated operation and improving the traffic efficiency of the toll station.

[0051] Adopting the above scheme, this scheme deploys multi-source information fusion recognition equipment in the toll station area to perform multi-source fusion recognition of information such as the location, license plate, OBU and vehicle color of vehicles passing through the toll station area, and links it with the toll collection system in real time to accurately identify vehicles that have completed transactions, thereby increasing the passing rate of ETC vehicles and the accuracy of license plate payment and prepaid payment recognition in manual toll lanes, ultimately improving the toll collection accuracy and reliability of toll stations and providing a better traffic service experience.

[0052] In some embodiments of the present invention, the front recognition device also includes a roadside antenna. If the vehicle is an ETC vehicle equipped with an on-board terminal, in the step of identifying the vehicle information of the vehicle through the front camera, the OBU record is obtained from the vehicle on-board terminal through the roadside antenna, and the vehicle license plate in the OBU record is compared with the vehicle license plate identified by the front camera.

[0053] In some embodiments of the present invention, in the step of comparing the vehicle license plate in the OBU record with the vehicle license plate recognized by the front camera, if the difference between the vehicle license plate in the OBU record and the vehicle license plate recognized by the front camera is less than a preset number of characters, the vehicle license plate in the OBU record is used as the vehicle license plate in the vehicle information.

[0054] If the license plate identified by the camera differs from the license plate read by the RSU in the OBU by less than two characters, the vehicle color recognition result is consistent with the OBU record, and there is only one vehicle in the camera's field of view, the license plate in the OBU will prevail. Otherwise, it will be recorded as two different vehicles. The camera continuously monitors the vehicle's position information and updates its position at a set interval until the vehicle leaves the detection range of the front gantry camera.

[0055] In some embodiments of the present invention, in the step of re-identifying the vehicle license plate by the position tracking camera, comparing the identified vehicle license plate with the vehicle license plate currently corresponding to the vehicle ID, and determining whether to update the vehicle information and vehicle ID, the vehicle license plate and vehicle position are re-identified by the position tracking camera, and the vehicle license plate identified by the position tracking camera is compared with the vehicle license plate in the current vehicle information, and the vehicle position identified by the position tracking camera is compared with the vehicle position in the current vehicle information, to determine whether to update the vehicle information and vehicle ID.

[0056] In some embodiments of the present invention, the position tracking camera corresponds to the front camera on a one-to-one basis, and the position tracking camera tracks a corresponding vehicle that has left the field of view of the front camera. In the step of comparing the vehicle license plate recognized by the position tracking camera with the vehicle license plate in the current vehicle information, and comparing the vehicle position recognized by the position tracking camera with the vehicle position in the current vehicle information, and determining whether to update the vehicle information and vehicle ID:

[0057] If the vehicle position identified by the position tracking camera is the same as the vehicle position in the current vehicle information, and the difference between the vehicle license plate in the current vehicle information and the vehicle license plate identified by the position tracking camera is less than the preset number of characters, the vehicle information and vehicle ID remain unchanged;

[0058] If the vehicle position identified by the position tracking camera is different from the vehicle position in the current vehicle information, the vehicle position in the vehicle information is updated;

[0059] If the vehicle position identified by the position tracking camera is different from the vehicle position in the current vehicle information, and the difference between the vehicle license plate in the current vehicle information and the vehicle license plate identified by the position tracking camera is not less than a preset number of characters, the vehicle position and vehicle license plate of the vehicle information are updated; and a new vehicle ID is generated to update the original vehicle ID.

[0060] Specifically, the position tracking camera can perform a secondary recognition of the vehicle's license plate. If the position and license plate recognized by the position tracking camera are consistent with those recognized by the front camera, the position will be continuously detected and updated until the vehicle enters the toll lane with the barrier island. Otherwise, if the license plates recognized by the position tracking camera and the front camera are different, but the positions and colors are the same, and the difference in the license plate characters is within 2 characters, the license plate recognized by the front camera will be used as the basis, and the vehicle ID will remain unchanged. If the license plate and vehicle color recognized by the position tracking camera and the front camera are the same but the positions are different, the position recognized by the position tracking camera will be used as the basis, and the vehicle ID will remain unchanged. If the positions are different and the license plate characters differ by more than 2 characters, a new vehicle ID number will be set for the vehicle, corresponding to the new license plate number and position information.

[0061] In some embodiments of the present invention, when a vehicle reaches a toll island, the lane camera device recognizes the vehicle license plate again, compares the recognized vehicle license plate with the vehicle license plate currently corresponding to the vehicle ID, and determines whether to update the vehicle information and vehicle ID:

[0062] If the difference between the vehicle license plate of the vehicle identified by the lane camera device and the vehicle license plate in any vehicle information in the current database is less than a preset number of characters, and the vehicle position of the vehicle identified by the lane camera device is the same as the vehicle position in the vehicle information, then a correspondence between the vehicle information and the vehicle identified by the lane camera device is established, and the vehicle information and vehicle ID of the vehicle are kept unchanged;

[0063] If the difference between the vehicle license plate of the vehicle identified by the lane camera device and the vehicle license plate in any vehicle information in the current database is less than the preset number of characters, but the vehicle position of the vehicle identified by the lane camera device is different from the vehicle position in the vehicle information, then the vehicle position in the vehicle information of the vehicle is updated and the vehicle ID remains unchanged;

[0064] If the license plate of the vehicle recognized by the lane camera device differs from the license plate in any vehicle information in the current database by no less than a preset number of characters, the vehicle information of the vehicle recognized by the lane camera device creates a vehicle ID corresponding to the vehicle information.

[0065] The lane camera equipment identifies the vehicle's position and license plate information in the ETC toll island. If the recognized license plate is consistent with the license plate and position of an existing vehicle, the vehicle's ID remains unchanged; if the lane camera fails to recognize the license plate information or the recognized license plate information differs from the previous result by less than 2 characters, and the vehicle position matches, the license plate corresponding to the vehicle ID shall prevail; if the position is inconsistent but the license plate is the same, the vehicle's ID remains unchanged and the position information is updated; if the position is inconsistent and the license plate differs by more than 2 characters, a new ID number, license plate number and position information shall be set for the vehicle.

[0066] like Figure 3 As shown, in some embodiments of the present invention, in the step of conducting a transaction based on the final vehicle information and vehicle ID and deleting the vehicle ID after the transaction, if the vehicle is an ETC vehicle equipped with an on-board terminal, the toll collection system conducts an ETC transaction on the vehicle, deletes the vehicle ID after the transaction, and issues a barrier lifting instruction. After the barrier lifting instruction is issued, the toll collection system continuously monitors whether the barrier is lifted. If the barrier is not lifted, a prompt instruction is sent to the toll collector's control terminal.

[0067] In some embodiments of the present invention, if the vehicle is an ETC vehicle equipped with an on-board terminal and the ETC transaction fails, but there is OBU information, the barrier will be automatically lifted to allow passage, and the display device will show the amount payable.

[0068] When a vehicle's ETC transaction is successful, if the vehicle reaches the lane barrier and passes normally, the vehicle ID will be cancelled; if the vehicle reaches the lane barrier and the barrier is not raised, and the toll collection system has confirmed that the vehicle has completed the ETC transaction normally, the system can automatically lift the barrier and release it, or the toll collector can remotely lift the barrier with one click. The toll collector's one-click operation can save the toll collector's time in querying and confirming the vehicle transaction status on site; if the vehicle's ETC transaction fails, and the toll collection system has identified the vehicle's OBU information, the toll collector will use a handheld device to supplement the ETC transaction, or the system will record the transaction amount and lift the barrier to release it. The fee display will show the fee amount and prompt the backend to deduct the fee. The user can query the pass record and fee amount on the toll collection system application. If the ETC vehicle enters a manual toll lane, since the toll collection system has automatically recorded the amount to be collected, the toll collector can be directly prompted with the amount. The toll collector only needs to confirm the fee before releasing the vehicle.

[0069] For ETC vehicles, the present invention automatically identifies and issues a barrier-lifting command by the toll collection system when the ETC transaction is successful but the barrier is not lifted in time at the lane exit due to equipment failure or other reasons; when the ETC transaction fails but the system has already identified the license plate information and OBU information, the toll collection system performs background fee deduction operations and promptly lifts the barrier to release the vehicle, thereby realizing functions such as automatic identification of multi-source information, supplementary transactions, and self-processing of faults. When an ETC vehicle enters a manual toll lane, the toll collection system has automatically recorded the amount to be collected and can directly prompt the toll collector with the amount, who only needs to confirm it. The method of the present invention can effectively improve the traffic efficiency of ETC vehicles at toll stations and reduce the manual processing costs and time of toll collectors.

[0070] When a vehicle enters a manual toll lane, if it is an ETC vehicle, the toll collector will be prompted with the exact toll amount, and the toll collector only needs to confirm; if it is an MTC vehicle and the driver chooses to stop and pay, the toll amount will be displayed, and the vehicle will leave after the fee is collected.

[0071] like Figure 4 As shown, in some embodiments of the present invention, in the step of conducting a transaction based on the final vehicle information and vehicle ID and deleting the vehicle ID after the transaction, if the vehicle is not an ETC vehicle equipped with an on-board terminal, the toll collection system adopts a contactless deduction charging mode. The contactless deduction charging mode includes prepayment by license plate. The toll collection system background automatically generates a record of prepayment or license plate payment, and issues a barrier lifting instruction based on the current vehicle information. After the barrier lifting instruction is issued, it continuously monitors whether the barrier is lifted. If the barrier is not lifted, a prompt instruction is sent to the toll collector control terminal.

[0072] If a non-ETC vehicle drives into the ETC lane, the toll collector will handle it on the spot; if the toll is collected normally at the toll window, the barrier will be lifted to allow the vehicle to pass and the vehicle ID will be cancelled; if the vehicle needs to query route information or the amount of toll payable, the toll collection system will automatically display the recognized license plate result to the toll collector, who will release the vehicle after completing the collection and the vehicle ID will be cancelled.

[0073] If the toll station supports contactless charging modes such as license plate payment and prepaid payment, when a vehicle enters the toll lane, the toll system will automatically lift the barrier to let the vehicle pass if it has identified the vehicle's license plate information and color information before the vehicle enters. The system will automatically generate a record of prepaid payment or license plate payment.

[0074] If a toll station supports contactless toll collection modes such as license plate payment or prepaid, when a vehicle enters a toll lane and the system recognizes the vehicle's license plate information and color, it will automatically lift the barrier at the lane exit to allow passage, and the toll collection system backend will automatically generate a record of the prepaid or license plate payment. The use of multi-source information fusion and continuous license plate recognition effectively improves license plate recognition rates, resolving issues such as inaccurate or inability to recognize license plates in toll lanes due to lighting and occlusion, thereby improving both toll collection and traffic efficiency.

[0075] The present invention is applicable to scenarios where ETC vehicles and MTC vehicles are at exit toll stations, as well as scenarios where ETC vehicles are at entrance toll stations.

[0076] This invention improves the accuracy of license plate recognition by matching license plate recognition signals from multiple cameras. Each vehicle has three states: "Entering the toll plaza," "Entering the nth toll lane," and "Exiting." This system also enables automatic inspection image collection and road traffic volume and speed statistics. Continuous location recognition also provides a data source for the toll station's digital twin.

[0077] Front-end recognition RSUs and cameras, location tracking cameras, lane cameras, and toll lane control equipment such as toll amount displays, lane transaction RSUs, lane barriers, and self-service payment devices all maintain synchronization and communicate online with the toll management system. Once each vehicle entering the toll station is identified and confirmed, its license plate, onboard OBU, vehicle color, and location information are assigned a unique vehicle ID by the toll management system. This serves as a marker for multi-source information fusion and identification. The location information associated with this ID is updated at a set frequency, typically 100 milliseconds.

[0078] This solution deploys multi-source information fusion and recognition equipment in the toll station area to perform multi-source fusion recognition of information such as the location, license plate, OBU and vehicle color of vehicles passing through the toll station area, and interacts with the toll collection system in real time to accurately identify vehicles that have completed transactions, thereby increasing the passing rate of ETC vehicles and the accuracy of license plate payment and prepaid payment recognition in manual toll lanes, ultimately improving the toll collection accuracy and reliability of toll stations and providing a better traffic service experience.

[0079] This solution integrates multi-source information to identify vehicles entering the toll station area, and then uniquely identifies them in real time to achieve automatic matching of vehicle, license plate, OBU and user information. This allows the vehicle to pass through the toll station without stopping in typical abnormal scenarios, completing the automatic and contactless charging function when ETC transactions are abnormal.

[0080] An embodiment of the present invention also provides a vehicle contactless toll collection system with multi-source information fusion and identification, which includes a computer device, wherein the computer device includes a processor and a memory, wherein the memory stores computer instructions, and the processor is used to execute the computer instructions stored in the memory. When the computer instructions are executed by the processor, the system implements the steps implemented by the method described above.

[0081] An embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon. When executed by a processor, the computer program implements the steps of the aforementioned vehicle contactless toll collection method based on multi-source information fusion and recognition. The computer-readable storage medium can be a tangible storage medium, such as a random access memory (RAM), internal memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, register, floppy disk, hard disk, removable storage disk, CD-ROM, or any other form of storage medium known in the art.

[0082] It should be understood by those skilled in the art that the various exemplary components, systems and methods described in conjunction with the embodiments disclosed herein can be implemented in hardware, software or a combination of the two. Whether it is specifically performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention. When implemented in hardware, it can be, for example, an electronic circuit, an application specific integrated circuit (ASIC), appropriate firmware, a plug-in, a function card, etc. When implemented in software, the elements of the present invention are programs or code segments that are used to perform the required tasks. The program or code segment can be stored in a machine-readable medium, or transmitted on a transmission medium or a communication link via a data signal carried in a carrier.

[0083] It should be understood that the present invention is not limited to the specific configurations and processes described above and illustrated in the figures. For the sake of brevity, a detailed description of known methods is omitted. In the above embodiments, several specific steps are described and illustrated as examples. However, the method of the present invention is not limited to the specific steps described and illustrated. Those skilled in the art may make various changes, modifications, and additions, or change the order of the steps after understanding the spirit of the present invention.

[0084] In the present invention, features described and / or illustrated for one embodiment may be used in the same or similar manner in one or more other embodiments, and / or combined with or replace features of other embodiments.

[0085] The foregoing description is merely a preferred embodiment of the present invention and is not intended to limit the present invention. Those skilled in the art will readily appreciate that various modifications and variations to the present invention are possible. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of the present invention are intended to be within the scope of protection of the present invention.

Claims

1. A vehicle non-sensing charging method based on multi-source information fusion and recognition, characterized in that: The method is based on a front recognition device and a lane camera device, wherein the front recognition device is arranged in front of the lane camera device, and the front recognition device includes a front camera and a position tracking camera; The steps of the method include: When a vehicle drives towards a toll area, the front camera identifies the vehicle information of the vehicle and constructs a vehicle ID corresponding to the vehicle information, wherein the vehicle information includes the vehicle license plate, vehicle color and vehicle location; When the vehicle passes through the shooting range of the front camera, the vehicle license plate is recognized again by the position tracking camera, and the recognized vehicle license plate is compared with the vehicle license plate currently corresponding to the vehicle ID to determine whether to update the vehicle information and vehicle ID; When the vehicle arrives at the toll island, the lane camera device recognizes the vehicle license plate again, compares the recognized vehicle license plate with the vehicle license plate currently corresponding to the vehicle ID, and determines whether to update the vehicle information and vehicle ID; The transaction is conducted based on the final vehicle information and vehicle ID, and the vehicle ID is deleted after the transaction.

2. The vehicle non-sensing charging method based on multi-source information fusion and recognition according to claim 1 is characterized in that: The front recognition device also includes a roadside antenna. If the vehicle is an ETC vehicle equipped with an on-board terminal, in the step of identifying the vehicle information of the vehicle through the front camera, the OBU record is obtained from the vehicle on-board terminal through the roadside antenna, and the vehicle license plate in the OBU record is compared with the vehicle license plate identified by the front camera.

3. The vehicle non-sensing charging method based on multi-source information fusion and recognition according to claim 2 is characterized in that: In the step of comparing the vehicle license plate in the OBU record with the vehicle license plate identified by the front camera, if the difference between the vehicle license plate in the OBU record and the vehicle license plate identified by the front camera is less than a preset number of characters, the vehicle license plate in the OBU record is used as the vehicle license plate in the vehicle information.

4. The vehicle non-sensing charging method based on multi-source information fusion and recognition according to claim 1 is characterized in that: In the step of re-identifying the vehicle license plate by the position tracking camera, comparing the identified vehicle license plate with the vehicle license plate currently corresponding to the vehicle ID, and determining whether to update the vehicle information and vehicle ID, the vehicle license plate and vehicle position are re-identified by the position tracking camera, comparing the vehicle license plate identified by the position tracking camera with the vehicle license plate in the current vehicle information, and comparing the vehicle position identified by the position tracking camera with the vehicle position in the current vehicle information, to determine whether to update the vehicle information and vehicle ID.

5. The vehicle non-sensing charging method based on multi-source information fusion and recognition according to claim 4 is characterized in that: In the step of comparing the vehicle license plate recognized by the position tracking camera with the vehicle license plate in the current vehicle information, comparing the vehicle position recognized by the position tracking camera with the vehicle position in the current vehicle information, and determining whether to update the vehicle information and vehicle ID: If the vehicle position identified by the position tracking camera is the same as the vehicle position in the current vehicle information, and the difference between the vehicle license plate in the current vehicle information and the vehicle license plate identified by the position tracking camera is less than the preset number of characters, the vehicle information and vehicle ID remain unchanged; If the vehicle position identified by the position tracking camera is different from the vehicle position in the current vehicle information, the vehicle position in the vehicle information is updated; If the vehicle position identified by the position tracking camera is different from the vehicle position in the current vehicle information, and the difference between the vehicle license plate in the current vehicle information and the vehicle license plate identified by the position tracking camera is not less than a preset number of characters, the vehicle position and vehicle license plate of the vehicle information are updated; and a new vehicle ID is generated to update the original vehicle ID.

6. The vehicle non-sensing charging method based on multi-source information fusion and recognition according to claim 1 is characterized in that: When the vehicle arrives at the toll island, the lane camera device recognizes the vehicle license plate again, compares the recognized vehicle license plate with the vehicle license plate currently corresponding to the vehicle ID, and determines whether to update the vehicle information and vehicle ID: If the difference between the vehicle license plate of the vehicle identified by the lane camera device and the vehicle license plate in any vehicle information in the current database is less than a preset number of characters, and the vehicle position of the vehicle identified by the lane camera device is the same as the vehicle position in the vehicle information, then a correspondence between the vehicle information and the vehicle identified by the lane camera device is established, and the vehicle information and vehicle ID of the vehicle are kept unchanged; If the difference between the vehicle license plate of the vehicle identified by the lane camera device and the vehicle license plate in any vehicle information in the current database is less than the preset number of characters, but the vehicle position of the vehicle identified by the lane camera device is different from the vehicle position in the vehicle information, then the vehicle position in the vehicle information of the vehicle is updated and the vehicle ID remains unchanged; If the license plate of the vehicle recognized by the lane camera device differs from the license plate in any vehicle information in the current database by no less than a preset number of characters, the vehicle information of the vehicle recognized by the lane camera device creates a vehicle ID corresponding to the vehicle information.

7. The vehicle non-sensing charging method based on multi-source information fusion and recognition according to claim 1 is characterized in that: In the step of conducting a transaction based on the final vehicle information and vehicle ID, and deleting the vehicle ID after the transaction, if the vehicle is an ETC vehicle equipped with an on-board terminal, the ETC toll collection system conducts an ETC transaction on the vehicle, deletes the vehicle ID after the transaction, and issues a barrier lifting instruction. After the barrier lifting instruction is issued, the system continuously monitors whether the barrier is lifted. If the barrier is not lifted, a prompt instruction is sent to the toll collector's control terminal.

8. The vehicle non-sensing charging method based on multi-source information fusion and recognition according to claim 1 is characterized in that: In the step of conducting a transaction based on the final vehicle information and vehicle ID, and deleting the vehicle ID after the transaction, if the vehicle is an ETC vehicle equipped with an on-board terminal, the toll collection system conducts an ETC transaction on the vehicle, deletes the vehicle ID after the transaction, and issues a barrier lifting instruction. After the barrier lifting instruction is issued, the toll collection system continuously monitors whether the barrier is lifted. If the barrier is not lifted, a prompt instruction is sent to the toll collector's control terminal.

9. The vehicle non-sensing charging method based on multi-source information fusion and recognition according to claim 1 is characterized in that: In the step of conducting a transaction based on the final vehicle information and vehicle ID and deleting the vehicle ID after the transaction, if the vehicle is not an ETC vehicle equipped with an on-board terminal, the toll collection system adopts a contactless deduction charging mode. The contactless deduction charging mode includes prepayment by license plate. The toll collection system background automatically generates a record of prepayment or license plate payment, and issues a barrier lifting instruction based on the current vehicle information. After the barrier lifting instruction is issued, it continuously monitors whether the barrier is lifted. If the barrier is not lifted, a prompt instruction is sent to the toll collector's control terminal.

10. A vehicle non-sensing toll collection system based on multi-source information fusion and recognition, characterized in that: The system includes a computer device, which includes a processor and a memory. The memory stores computer instructions. The processor is used to execute the computer instructions stored in the memory. When the computer instructions are executed by the processor, the system implements the steps implemented by the method according to any one of claims 1 to 9.

Images