A vehicle collaborative management method and system based on image recognition

Abstract

The present invention provides a vehicle collaborative management method and system based on image recognition, which belongs to the field of image recognition and understanding technology. The vehicle collaborative management method includes: identifying the license plate information of vehicles in the waiting area; obtaining the image information of each vehicle in the toll station area; judging whether there is a vehicle that has not taken the card and whether there is a vehicle following the vehicle out of the station according to the image information; when there is a vehicle following the vehicle out of the station, judging whether the preceding vehicle and the following vehicle that have taken the card out of the station; if the preceding vehicle and the following vehicle both take the card, controlling the drop bar device to force the drop bar to drop; if the preceding vehicle or the following vehicle does not take the card, obtaining the license plate information of the vehicle to be picked up in the card picking area according to the image information, and writing the license plate information of the vehicle to be picked up into the toll card. The present invention can ensure the orderly passage of vehicles and normal toll collection when following the vehicle out of the station and missing the card, and avoid congestion.

Description

Technical Field

[0001] The present application relates to the technical field of image recognition and understanding, and in particular to a vehicle collaborative management method and system based on image recognition. Background Art

[0002] The highway toll collection system generally sets up an import toll station at the entrance of the highway and an exit toll station at the exit. The import toll station is generally equipped with a toll station management system, including identification equipment, card writing equipment and drop-bar equipment. The system first uses the identification equipment to identify the license plate of the vehicle entering the station, and then the card writing equipment writes the license plate number of the vehicle into the toll card. When the user pulls out the card from the card writing equipment, the drop-bar equipment lifts the bar, and when the vehicle drives away from the drop-bar equipment, the drop-bar equipment senses the behavior and then drops the bar.

[0003] The existing toll station management system is implemented in the above strict order of one license plate one card, one bar one car. When a user forgets to take the card, or two cars pass through when one bar is raised (i.e., the situation of following the car out of the station), the system will be confused, the card and the license plate will not correspond, or the bar drop device will behave abnormally, requiring manual intervention, resulting in congestion at the toll station. Summary of the invention

[0004] One purpose of the first aspect of the present invention is to provide a vehicle collaborative management method based on image recognition, which can ensure the orderly passage of vehicles and normal charging when following vehicles out of the station and missing cards occur, and avoid congestion.

[0005] Another object of the present invention is to further ensure that vehicles with incorrect toll card information can exit the station normally.

[0006] An object of the second aspect of the present invention is to provide a vehicle collaborative management system for executing the above-mentioned vehicle collaborative management method.

[0007] An embodiment of the present invention provides a vehicle collaborative management method based on image recognition, comprising:

[0008] Identify the license plate information of vehicles in the waiting area;

[0009] Obtain image information of each vehicle in the toll station area;

[0010] According to the image information, it is determined whether there is a vehicle that has not picked up the card and whether there is a vehicle following the vehicle out of the station in the drop-off area;

[0011] When there is a situation of following a vehicle out of the station, determine whether the preceding vehicle and the following vehicle in the situation of following a vehicle out of the station have taken the card;

[0012] If both the preceding vehicle and the following vehicle take the card, the rod-dropping device is controlled to forcefully drop the rod;

[0013] If the preceding vehicle or the following vehicle has not picked up the card, the license plate information of the vehicle to be picked up that is currently in the card picking area is obtained according to the image information, and the license plate information of the vehicle to be picked up is written into the toll card.

[0014] Furthermore, after the step of obtaining the image information of each vehicle in the toll station area, the step further includes:

[0015] Acquire the license plate information of the vehicle currently in the card collection area according to the image information;

[0016] Determine whether the license plate information of the vehicle to be picked up is consistent with the license plate information of the identified vehicle in the waiting area;

[0017] If not, record the abnormal information so that the license plate information of the vehicle in the waiting area can be matched to the vehicle to be picked up when paying.

[0018] Further, the step of judging whether there is a vehicle following the vehicle out of the station in the drop-bar area according to the image information includes:

[0019] It is determined based on the image information whether two vehicles pass through the lifting of the bar at the lowering device at one time. If so, it is determined that there is a following vehicle exiting the station; otherwise, it is determined that there is no following vehicle exiting the station.

[0020] Furthermore, the step of judging whether there is a vehicle that has not taken the card according to the image information includes:

[0021] It is determined based on the image information whether the preceding vehicle and the following vehicle that are following the vehicle out of the station have stopped at the card writing device. If so, it is determined that the corresponding vehicle has taken the card; if not, it is determined that the corresponding vehicle has not taken the card.

[0022] In particular, an embodiment of the present invention further provides a vehicle collaborative management system based on image recognition, which is used to execute any of the above-mentioned vehicle collaborative management methods, and the vehicle collaborative management system includes a control system, an identification device, a card writing device, a visual system and a pole dropping device, wherein:

[0023] The recognition device is used to recognize the license plate information of the vehicle in the waiting area and send the license plate information to the control system and the card writing device;

[0024] The visual system is used to obtain image information of each vehicle in the toll station area, and judge whether there is a vehicle that has not taken the card, and whether there is a vehicle following the vehicle leaving the toll station in the drop-bar area according to the image information. The visual system is also used to send the image information and the judgment result to the control system;

[0025] The card writing device is arranged downstream of the identification device and is used to write the received license plate information into a toll card;

[0026] The rod-dropping device is arranged downstream of the card-writing device, and is used to lift the rod after the toll card at the card-writing device is pulled out, and drop the rod after sensing that the vehicle has left;

[0027] When there is a situation where a following vehicle exits the station, the control system determines whether the preceding vehicle and the following vehicle that are following the following vehicle exit have taken the card. If both the preceding vehicle and the following vehicle have taken the card, the control system controls the bar lowering device to force the bar to drop. If the preceding vehicle or the following vehicle has not taken the card, the control system obtains the license plate information of the vehicle to be picked up that is currently in the card picking area based on the image information, and writes the license plate information of the vehicle to be picked up into the toll card.

[0028] Furthermore, the visual system is also used to obtain the license plate information of the vehicle to be picked up that is currently in the card picking area according to the image information;

[0029] The control system is also used to determine whether the license plate information of the vehicle to be picked up is consistent with the license plate information of the vehicle in the waiting area. If not, record the abnormal information so that the license plate information of the vehicle in the waiting area can be matched to the vehicle to be picked up when paying.

[0030] Furthermore, the visual system is also used to determine whether two vehicles pass through the lifting of the bar at the lowering device at one time based on the image information. If so, it is determined that there is a following vehicle exiting the station; otherwise, it is determined that there is no following vehicle exiting the station.

[0031] Furthermore, the visual system is also used to determine whether the front vehicle and the rear vehicle that are following the vehicle out of the station have stopped at the card writing device based on the image information. If so, it is determined that the corresponding vehicle takes the card; if not, it is determined that the corresponding vehicle does not take the card.

[0032] According to the first aspect of the present invention, by acquiring the image information of each vehicle in the toll station area, it is possible to analyze whether there is a situation of following a vehicle out of the station, and whether the vehicle in front and the vehicle behind take the card when the situation of following a vehicle out of the station exists. When there is a situation of following a vehicle out of the station, if both the vehicle in front and the vehicle behind take the card, the control rod drop device is forced to drop the rod, so that the system will not have information confusion when the situation of following a vehicle out of the station occurs, and the normal and orderly passage of vehicles is guaranteed.

[0033] Furthermore, when there is a situation of following a vehicle out of the station, if the vehicle in front or behind has not picked up the card, the license plate information of the vehicle to be picked up in the card picking area is obtained based on the image information, and the license plate information of the vehicle to be picked up is written into the toll card. In other words, when there is a situation of following a vehicle out of the station and missing toll cards at the same time, the system can also give the correct card writing information to the card writing device, thereby ensuring the correctness of the card information of the subsequent vehicles and ensuring the normal toll collection.

[0034] According to the second aspect of the invention, the present application also sets up an information comparison in the card picking area, that is, analyzing whether the license plate information of the vehicle to be picked up in the card picking area currently in the card picking area is consistent with the license plate information identified in the waiting area based on the image information. If there is inconsistency, it indicates a misidentification. At this time, the correct license plate information of the vehicle to be picked up is obtained based on the image information, and the correct license plate information and the license plate information of the vehicle that entered by mistake are matched and recorded, so that the vehicle will not be unable to exit the exit toll station normally due to the inconsistency between the license plate information in the toll card and the actual vehicle license plate information, and the resulting vehicle congestion is avoided. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 is a flow chart of a vehicle collaborative management method according to an embodiment of the present invention;

[0036] Figure 2 is a flow chart of a vehicle collaborative management method according to another embodiment of the present invention;

[0037] Figure 3 is a connection block diagram of a vehicle collaborative management system according to an embodiment of the present invention;

[0038] Reference numerals:

[0039] 100-vehicle collaborative management system, 10-control system, 20-identification device, 30-card writing device, 40-visual system, 50-dropping device. DETAILED DESCRIPTION

[0040] In order to make the above-mentioned purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are described in detail below in conjunction with the accompanying drawings. In the following description, many specific details are set forth to facilitate a full understanding of the present application. However, the present application can be implemented in many other ways different from those described herein, and those skilled in the art can make similar improvements without violating the connotation of the present application, so the present application is not limited by the specific embodiments disclosed below.

[0041] It should be noted that when a component is referred to as being "fixed to" or "disposed on" another component, it may be directly on the other component or there may also be a central component. When a component is considered to be "connected to" another component, it may be directly connected to the other component or there may be a central component at the same time. The terms "vertical", "horizontal", "upper", "lower", "left", "right" and similar expressions used in the specification of this application are for illustrative purposes only and do not represent the only implementation method.

[0042] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0043] In the present application, unless otherwise clearly specified and limited, a first feature being “above” or “below” a second feature may mean that the first feature is directly in contact with the second feature, or the first feature and the second feature are in contact indirectly through an intermediate medium. Moreover, a first feature being “above”, “above”, or “above” a second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. A first feature being “below”, “below”, or “below” a second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is lower in level than the second feature.

[0044] Unless otherwise defined, all technical and scientific terms used in the specification of this application have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application. The term "and / or" used in the specification of this application includes any and all combinations of one or more related listed items.

[0045] Figure 1 FIG. 1 is a flow chart of a vehicle cooperative management method according to an embodiment of the present invention. Figure 1 As shown, in one embodiment, the vehicle collaborative management method based on image recognition includes:

[0046] Step S100, identifying the license plate information of the vehicle in the waiting area;

[0047] Step S200, obtaining image information of each vehicle in the toll station area;

[0048] Step S300, judging whether there is a vehicle that has not picked up the card and whether there is a vehicle following the vehicle out of the station in the drop-off area according to the image information;

[0049] Step S400, when there is a situation of following a vehicle out of the station, determining whether the preceding vehicle and the following vehicle in the situation of following a vehicle out of the station have taken the card;

[0050] Step S500, if both the front vehicle and the rear vehicle take the card, control the bar-dropping device to force the bar to drop;

[0051] Step S600: If the front vehicle or the rear vehicle has not picked up the card, the license plate information of the vehicle to be picked up in the card picking area is obtained according to the image information, and the license plate information of the vehicle to be picked up is written into the toll card.

[0052] The leading vehicle and the trailing vehicle mentioned in this embodiment refer to two vehicles passing through simultaneously during one lifting process of the pole, and the leading vehicle is located in front of the trailing vehicle.

[0053] Generally, the toll station is arranged in sequence with a waiting area, a transaction area and a pole-dropping area. The waiting area is provided with an identification device, such as a high-definition camera, for identifying the license plate of the vehicle entering the toll station. The transaction area is provided with a card writing device, for writing the license plate identified by the identification device into the toll card, waiting for the corresponding car owner to take it away. The pole-dropping area is provided with a pole-dropping device, which is used to lift the pole after the toll card at the card writing device is pulled out, and the geomagnetic induction component on the ground senses the vehicle leaving and drops the pole. It should be noted that the existing pole-dropping device lifts the pole after the toll card is taken away, and drops the pole after sensing the vehicle leaving. Once two vehicles that are very close to each other drive out of the toll station in one pole-lifting process and both vehicles take the card, at this time, the pole-dropping device cannot identify that the two vehicles are driving out at the same time, but only thinks that one vehicle that takes the card has driven out. After the pole-dropping device drops the pole, the card of the second vehicle is also taken out and it is lifted again without falling. At this time, the third vehicle takes out the card again, and the pole-dropping device will receive two card-taking feedback signals, causing system confusion.

[0054] This embodiment adds image data of vehicles in the toll station on the basis of the traditional toll station identification system. For example, the image data of vehicles in the toll station can be obtained through a visual system, and the behavior of each vehicle in the toll station can be analyzed and integrated into the original vehicle management method, so that vehicles in the toll station can still circulate normally without affecting normal charging in the event of following vehicles or missing cards.

[0055] This embodiment obtains image information of each vehicle in the toll station area, and can analyze whether there is a situation of following a vehicle out of the station, and whether the front vehicle and the rear vehicle take the card when the situation of following a vehicle out of the station exists. When there is a situation of following a vehicle out of the station, if both the front vehicle and the rear vehicle take the card, the control rod drop device is forced to drop the rod, so that the system will not have information confusion when the situation of following a vehicle out of the station occurs, and the normal and orderly passage of vehicles is guaranteed.

[0056] Furthermore, when there is a situation of following a vehicle out of the station, if the vehicle in front or behind has not picked up the card, the license plate information of the vehicle to be picked up in the card picking area is obtained based on the image information, and the license plate information of the vehicle to be picked up is written into the toll card. In other words, when there is a situation of following a vehicle out of the station and missing toll cards at the same time, the system can also give the correct card writing information to the card writing device, thereby ensuring the correctness of the card information of the subsequent vehicles and ensuring the normal toll collection.

[0057] Figure 2 FIG. 1 is a flow chart of a vehicle cooperative management method according to another embodiment of the present invention. Figure 2 As shown, in another embodiment, after step S200, the following steps are further included:

[0058] Step S250, obtaining the license plate information of the vehicle currently in the card collection area according to the image information;

[0059] Step S260, determining whether the license plate information of the vehicle to be picked up is consistent with the license plate information of the vehicle in the waiting area, if so, proceeding to step S302, if not, proceeding to step S270;

[0060] Step S270, recording the abnormal information so that the license plate information of the vehicle in the waiting area can be matched to the vehicle to be picked up when paying the fee;

[0061] Step S300 includes:

[0062] Step S302, judging whether two vehicles have passed through the lifting of the barrier at the lowering device according to the image information, if so, proceeding to step S304, otherwise, terminating the current judging process and re-performing the license plate recognition of the next vehicle entering the station;

[0063] Step S304, determining whether there is a situation of following a vehicle out of the station;

[0064] Step S400 includes:

[0065] Step S402, determine based on the image information whether the leading vehicle and the following vehicle in the following vehicle exiting situation have both stopped at the card writing device. If so, it is determined that the corresponding vehicle has picked up the card and proceeds to step S500; otherwise, it is determined that the leading vehicle or the following vehicle has not picked up the card (because there is a following vehicle exiting the station, it means that at least one vehicle has picked up the card, causing the lowering device to lift the bar), and proceed to step S600.

[0066] This embodiment also sets up an information comparison in the card picking area, that is, to analyze whether the license plate information of the vehicle to be picked up in the card picking area is consistent with the license plate information recognized in the waiting area based on the image information. If they are inconsistent, it means that there is a misrecognition. For example, a vehicle enters the waiting area and is recognized by the recognition device for its license plate and then drives out. At this time, the license plate of the vehicle that has entered by mistake has been recognized and sent to the card writing device for writing. At this time, the correct license plate information of the vehicle to be picked up is obtained based on the image information, and the correct license plate information and the license plate information of the vehicle that has entered by mistake are matched and recorded, so that the vehicle will not be unable to exit the exit toll station normally because the license plate information in the toll card does not match the license plate information of the actual vehicle, and the vehicle congestion caused by this is also avoided.

[0067] Figure 3 FIG. 1 is a connection block diagram of a vehicle cooperative management system 100 according to an embodiment of the present invention. Figure 3 As shown, an embodiment of the present application also provides a vehicle collaborative management system 100 based on image recognition, which is used to execute any of the above-mentioned vehicle collaborative management methods, and the vehicle collaborative management system 100 includes a control system 10, an identification device 20, a card writing device 30, a visual system 40 and a drop bar device 50. The control system 10 here is a master control center, the identification device 20 may include a high-definition camera (also including supporting supplementary equipment, an image processing unit and a corresponding license plate recognition algorithm), and the card writing device 30 includes an RFID reader or an IC card reader.

[0068] The recognition device 20 is used to recognize the license plate information of the vehicle in the waiting area and send the license plate information to the control system 10 and the card writing device 30 .

[0069] The visual system 40 is used to obtain image information of each vehicle in the toll station area, and to determine whether there are any vehicles that have not taken their cards and whether there are any vehicles following out of the toll station in the toll station area based on the image information. The visual system 40 is also used to send the image information and the determination results to the control system 10.

[0070] The card writing device 30 is arranged downstream of the identification device 20, and is used to write the received license plate information into the toll card. The bar lowering device 50 is arranged downstream of the card writing device 30, and is used to lift the bar after the toll card at the card writing device 30 is pulled out, and lower the bar after sensing that the vehicle has left.

[0071] When there is a situation of following a vehicle out of the station, the control system 10 determines whether the vehicle in front and the vehicle behind that are following the vehicle out of the station have taken the card. If both the vehicle in front and the vehicle behind have taken the card, the control system 10 controls the bar lowering device 50 to force the bar to lower. If the vehicle in front or the vehicle behind has not taken the card, the control system obtains the license plate information of the vehicle to be picked up in the card picking area based on the image information, and writes the license plate information of the vehicle to be picked up into the toll card.

[0072] In a further embodiment, the visual system 40 is also used to obtain the license plate information of the vehicle to be picked up that is currently in the card picking area based on the image information. The control system 10 is also used to determine whether the license plate information of the vehicle to be picked up is consistent with the license plate information of the identified vehicle in the waiting area. If not, record the abnormal information so that the license plate information of the vehicle in the waiting area can be matched to the vehicle to be picked up when paying.

[0073] In a further embodiment, the visual system 40 is also used to determine whether two vehicles pass through the lifting of the bar at the lowering device 50 at one time based on the image information. If so, it is determined that there is a following vehicle exiting the station; otherwise, it is determined that there is no following vehicle exiting the station.

[0074] In a further embodiment, the visual system 40 is also used to determine whether the front vehicle and the rear vehicle that are following the vehicle out of the station have stopped at the card writing device 30 based on the image information. If so, it is determined that the corresponding vehicle has picked up the card; if not, it is determined that the corresponding vehicle has not picked up the card.

[0075] In the above embodiment, the judgment of whether to take the card and whether to follow the vehicle out of the station based on the image is performed by the visual system 40. In other embodiments, these judgment steps can also be performed by the control system 10, and the visual system 40 is mainly responsible for collecting and processing image information.

[0076] The above-mentioned embodiments only express several implementation methods of the present invention, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for ordinary technicians in this field, several variations and improvements can be made without departing from the concept of the present invention, and these all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the attached claims.

Claims

1. A vehicle collaborative management method based on image recognition, characterized in that: include: Identify the license plate information of vehicles in the waiting area; Obtain image information of each vehicle in the toll station area; According to the image information, it is determined whether there is a vehicle that has not taken the card, and whether there is a vehicle following the vehicle out of the station in the drop-off area; When there is a situation of following a vehicle out of the station, it is determined according to the image information whether the preceding vehicle and the following vehicle in the situation of following a vehicle out of the station have both stopped at the card writing device, and if so, it is determined that both the preceding vehicle and the following vehicle have taken the card, otherwise it is determined that the preceding vehicle or the following vehicle has not taken the card; If both the preceding vehicle and the following vehicle take the card, the rod lowering device is controlled to force the rod to lower; If the preceding vehicle or the following vehicle has not picked up the card, the license plate information of the vehicle to be picked up that is currently in the card picking area is obtained according to the image information, and the license plate information of the vehicle to be picked up is written into the toll card.

2. The vehicle collaborative management method based on image recognition according to claim 1 is characterized in that: The step of obtaining image information of each vehicle in the toll station area further includes: Acquire the license plate information of the vehicle currently in the card collection area according to the image information; Determine whether the license plate information of the vehicle to be picked up is consistent with the license plate information of the identified vehicle in the waiting area; If not, record the abnormal information so that the license plate information of the vehicle in the waiting area can be matched to the vehicle to be picked up when paying.

3. The vehicle collaborative management method based on image recognition according to claim 1 or 2, characterized in that: The step of judging whether there is a vehicle following the vehicle leaving the station in the drop-bar area according to the image information includes: It is determined based on the image information whether two vehicles pass through the lifting of the bar at the lowering device at one time. If so, it is determined that there is a following vehicle exiting the station; otherwise, it is determined that there is no following vehicle exiting the station.

4. The vehicle collaborative management method based on image recognition according to claim 1 or 2, characterized in that: The step of judging whether there is a vehicle without card removal according to the image information comprises: It is determined based on the image information whether the preceding vehicle and the following vehicle that are following the vehicle out of the station have stopped at the card writing device. If so, it is determined that the corresponding vehicle has taken the card; if not, it is determined that the corresponding vehicle has not taken the card.

5. A vehicle collaborative management system based on image recognition, used to execute the vehicle collaborative management method according to any one of claims 1 to 4, characterized in that: The vehicle collaborative management system includes a control system, an identification device, a card writing device, a visual system and a pole dropping device, wherein: The recognition device is used to recognize the license plate information of the vehicle in the waiting area and send the license plate information to the control system and the card writing device; The visual system is used to obtain image information of each vehicle in the toll station area, and judge whether there is a vehicle that has not taken the card, and whether there is a vehicle following the vehicle leaving the toll station in the drop-bar area according to the image information. The visual system is also used to send the image information and the judgment result to the control system; The card writing device is arranged downstream of the identification device and is used to write the received license plate information into a toll card; The rod-dropping device is arranged downstream of the card-writing device, and is used to lift the rod after the toll card at the card-writing device is pulled out, and drop the rod after sensing that the vehicle has left; When there is a situation where a following vehicle exits the station, the control system determines whether the preceding vehicle and the following vehicle that are following the following vehicle exit have taken the card. If both the preceding vehicle and the following vehicle have taken the card, the control system controls the bar lowering device to force the bar to drop. If the preceding vehicle or the following vehicle has not taken the card, the control system obtains the license plate information of the vehicle to be picked up that is currently in the card picking area based on the image information, and writes the license plate information of the vehicle to be picked up into the toll card.

6. The vehicle collaborative management system based on image recognition according to claim 5 is characterized in that: The visual system is also used to obtain the license plate information of the vehicle to be picked up that is currently in the card picking area according to the image information; The control system is also used to determine whether the license plate information of the vehicle to be picked up is consistent with the license plate information of the vehicle in the waiting area. If not, record the abnormal information so that the license plate information of the vehicle in the waiting area can be matched to the vehicle to be picked up when paying.

7. The vehicle collaborative management system based on image recognition according to claim 5 or 6, characterized in that: The visual system is also used to determine whether two vehicles pass through the lifting of the bar at the lowering device at one time based on the image information. If so, it is determined that there is a following vehicle exiting the station; otherwise, it is determined that there is no following vehicle exiting the station.

8. The vehicle collaborative management system based on image recognition according to claim 5 or 6, characterized in that: The visual system is also used to determine whether the leading vehicle and the trailing vehicle that are following the vehicle out of the station have stopped at the card writing device based on the image information. If so, it is determined that the corresponding vehicle has picked up the card; if not, it is determined that the corresponding vehicle has not picked up the card.

Images