Etc interaction control method and apparatus

Abstract

An ETC interaction control method and apparatus. The ETC interaction control method comprises: when an interaction behavior between a target vehicle and an ETC roadside unit is in an execution state, acquiring lane forward data of a target lane in which the target vehicle is located (210); identifying a vehicle state of a preceding vehicle on the basis of the lane forward data, and determining a vehicle behavior corresponding to the preceding vehicle (220); and when the vehicle behavior of the preceding vehicle indicates that the preceding vehicle has a vehicle intrusion behavior, interrupting the interaction behavior (230).

Description

ETC Interactive Control Method and Device

[0001] This application claims priority to Chinese Patent Application No. 202411394172.1, filed on October 8, 2024, entitled "ETC Interactive Control Method and Device", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of vehicle technology, and in particular to an ETC interactive control method and device. Background Technology

[0003] Electronic Toll Collection (ETC) is an automated toll collection technology used in traffic environments such as highways, bridges, and tunnels. It allows vehicles to pass through toll booths without stopping, thereby improving traffic efficiency and reducing congestion.

[0004] When a vehicle passes through a toll station, the on-board unit (OBU) installed on the windshield inside the vehicle establishes short-range wireless communication with the roadside unit (RSU) at the toll station, enabling the toll station to record vehicle information in order to charge fees and control the raising and lowering of the barriers based on the vehicle information.

[0005] However, in order to ensure the communication effect between the on-board unit and the roadside unit during the transaction through ETC, the vehicle needs to pass through the ETC identification area at a low speed. Therefore, there may be cases of malicious lane occupation to steal other people's ETC payment information, resulting in economic losses for car owners. Summary of the Invention

[0006] This application provides an ETC interactive control method, device, equipment, medium, and product. The technical solution is as follows:

[0007] On the one hand, an ETC interactive control method is provided, the method comprising:

[0008] When the interaction between the target vehicle and the ETC roadside unit is in progress, the forward lane data of the target lane where the target vehicle is located is obtained. The forward lane data is used to indicate the road conditions in front of the target vehicle in the target lane.

[0009] Based on the lane forward data, the vehicle status of the vehicle in front is identified, and the corresponding vehicle behavior of the vehicle in front is determined.

[0010] If the vehicle behavior of the preceding vehicle indicates that the preceding vehicle has engaged in vehicle intrusion, a stop command is sent to the ETC roadside unit. The stop command is used to instruct the current interactive behavior to be stopped.

[0011] On the other hand, an ETC interactive control device is provided, the device comprising:

[0012] The acquisition module is used to acquire lane forward data of the target lane where the target vehicle is located when the interaction between the target vehicle and the ETC roadside unit is in progress. The lane forward data is used to indicate the road conditions in front of the target vehicle in the target lane.

[0013] The identification module is used to identify the vehicle status of the vehicle in front based on the lane forward data and determine the vehicle behavior corresponding to the vehicle in front.

[0014] The control module is used to send a stop command to the ETC roadside unit when the vehicle behavior of the preceding vehicle indicates that the preceding vehicle has engaged in vehicle intrusion behavior. The stop command is used to instruct the current interactive behavior to be stopped.

[0015] On the other hand, an in-vehicle device is provided, the in-vehicle device including a processor and a memory, the memory storing at least one instruction, at least one program, code set or instruction set, the at least one instruction, the at least one program, the code set or instruction set being loaded and executed by the processor to implement the ETC interactive control method as described in any of the embodiments of this application above.

[0016] On the other hand, a computer-readable storage medium is provided, wherein at least one instruction, at least one program, code set, or instruction set is stored in the storage medium, wherein the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by a processor to implement the ETC interactive control method as described in any of the embodiments of this application above.

[0017] On the other hand, a computer program product or computer program is provided, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform any of the ETC interactive control methods described in the above embodiments.

[0018] The technical solution provided in this application includes at least the following beneficial effects:

[0019] During the ETC interaction process of the target vehicle, the system continuously determines whether there is a vehicle in front of the target vehicle based on the forward data of the lane ahead. If there is a vehicle in front, the system identifies the vehicle's behavior. If the vehicle's behavior indicates that the vehicle is intruding into the lane to steal the target vehicle's ETC interaction result, the system interrupts the interaction between the target vehicle and the ETC roadside unit when the intruding vehicle tries to pass through the barrier using the target vehicle's ETC interaction result. This prevents the loss caused by the intruding vehicle stealing the ETC interaction result and improves the security of the ETC interaction process. Attached Figure Description

[0020] Figure 1 is a structural block diagram of a control system provided in an exemplary embodiment of this application;

[0021] Figure 2 is a flowchart of an exemplary embodiment of the ETC interactive control method provided in this application;

[0022] Figure 3 is a flowchart of an exemplary embodiment of the ETC interactive control method provided in this application;

[0023] Figure 4 is a schematic diagram of a toll station dataset provided in an exemplary embodiment of this application;

[0024] Figure 5 is a schematic diagram of an ETC lane dataset provided in an exemplary embodiment of this application;

[0025] Figure 6 is a structural block diagram of an ETC interactive control device provided in an exemplary embodiment of this application;

[0026] Figure 7 is a structural block diagram of an in-vehicle device provided in an exemplary embodiment of this application. Detailed Implementation

[0027] First, a brief introduction to the terms used in the embodiments of this application will be given.

[0028] ETC (Electronic Toll Collection) is an important component of intelligent transportation systems, particularly suitable for use on highways or in busy bridge and tunnel environments. The ETC system allows vehicles to pass through toll booths automatically, completing the toll collection process without stopping, significantly improving traffic efficiency and reducing traffic congestion and environmental pollution. The main steps of the ETC system are as follows: Step 1: When a vehicle passes through a toll booth, it wirelessly communicates with the roadside unit (RSU) at the toll booth via the onboard unit (OBU) installed on the vehicle; Step 2: The OBU stores the vehicle's identification information. When the vehicle approaches the toll booth, the RSU sends an inquiry signal, and the OBU responds, engaging in two-way communication and data exchange; Step 3: The toll booth's central management system stores registered vehicle and user information in a large database. After obtaining the vehicle identification information, it compares it with the information in the database; Step 4: Based on the comparison result, the central management system controls the toll collection process, deducting the corresponding toll from the prepayment account or issuing instructions to other auxiliary facilities, such as automatic barriers.

[0029] Figure 1 shows a structural block diagram of a control system provided in an exemplary embodiment of this application. The control system 100 includes: a vehicle 110, a toll station device 120, and a barrier control device 130.

[0030] Indicatively, when vehicle 110 approaches the ETC recognition area of ​​the toll station, the on-board unit on vehicle 110 establishes a wireless communication connection with the roadside unit in the toll station equipment 120, and performs interactive behavior through this wireless communication connection. During the interactive behavior, vehicle 110 continuously acquires and identifies lane-heading data of its lane to determine the behavior of the vehicle in front. If it is determined that the vehicle in front is engaging in intrusion behavior, vehicle 110 interrupts the interactive behavior between the on-board unit and the roadside unit. If it is determined that the vehicle in front is engaging in normal driving behavior, or if no vehicle in front is detected in the lane, vehicle 110 does not obstruct the interactive behavior between the on-board unit and the roadside unit via wireless communication. Upon completion of the interactive behavior, the toll station equipment 120, based on the interaction completion signal from the roadside unit, controls the barrier control device 130 to raise the barrier, allowing vehicle 110 to pass.

[0031] Based on the above-mentioned terminology and application scenarios, the ETC interactive control method provided in this application will be described. This method is executed by a computer device, which includes in-vehicle devices, mobile terminal devices, etc. In this embodiment of the application, the method is executed by an in-vehicle device as an example. As shown in Figure 2, the method includes the following steps 210 to 230.

[0032] Step 210: While the interaction between the target vehicle and the ETC roadside unit is in progress, obtain the lane forward data of the target lane where the target vehicle is located.

[0033] Optionally, the target vehicle can be an internal combustion engine vehicle (ICEV), an electric vehicle (EV), a hybrid electric vehicle, a plug-in hybrid electric vehicle (PHEV), a range-extended electric vehicle (REEV), a fuel cell electric vehicle (FCEV), a mild hybrid electric vehicle (MHV), etc., without limitation.

[0034] In this embodiment, the target vehicle is equipped with an on-board device, which includes a processor and a memory. The memory stores at least one program, which is loaded and executed by the processor to implement the ETC interactive control method provided in this embodiment. In one example, the on-board device stores a target application that can implement ETC lane identification functionality. Optionally, the on-board device can be implemented as an on-board terminal, an ETC on-board unit, or other devices or apparatus in the target vehicle.

[0035] In this embodiment of the application, the method is applied to the ETC interaction scenario. Schematic, the target vehicle is equipped with an on-board unit that provides ETC interaction function. When the target vehicle drives into the ETC recognition area of ​​the toll station, the on-board unit can establish a wireless communication connection with the roadside unit in the toll station.

[0036] Optionally, the aforementioned toll stations include highway toll stations, parking lot toll stations, bridge toll stations, tunnel toll stations, etc.

[0037] In some embodiments, after the vehicle-mounted unit and the roadside unit establish a wireless communication connection, the roadside unit sends an information acquisition request to the vehicle-mounted unit. The vehicle-mounted unit responds to the information acquisition request by sending the vehicle information of the target vehicle to the roadside unit. The roadside unit then feeds back relevant information to the vehicle-mounted unit and the guardrail based on the comparison results of the vehicle information in the database.

[0038] Optionally, vehicle information includes at least one of the following: license plate number, vehicle type, vehicle account information, vehicle identification number (VIN), vehicle owner information, vehicle historical traffic records, and on-board unit identifier.

[0039] Optionally, the interaction between the on-board unit of the target vehicle and the ETC roadside unit includes at least one of the following: target vehicle information registration behavior and transaction behavior. The target vehicle information registration behavior is the ETC roadside unit recording the information of the target vehicle for subsequent fee calculation, and the transaction behavior is used to instruct the roadside unit to deduct the fee based on the recorded target vehicle information.

[0040] In one example, taking a target vehicle entering the highway via ETC as an example, the on-board unit responds to the information acquisition request by sending the license plate number to the roadside unit. The roadside unit records the license plate number, vehicle account, and corresponding highway passage start time in the database. After the data recording is completed, the roadside unit sends a passage permission confirmation message to the on-board unit of the target vehicle. For example, the above data interaction process between the roadside unit and the on-board unit can be regarded as an interactive behavior.

[0041] In another example, taking a target vehicle exiting the highway via ETC as an example, the on-board unit responds to the information acquisition request by sending the license plate number to the roadside unit. The roadside unit queries the database based on the license plate number to obtain the start time of the target vehicle's highway passage, takes the current time as the end time of the highway passage, determines the highway toll for the target vehicle based on the time difference between the start and end times of the highway passage, generates a toll collection instruction based on the highway toll, and sends the toll collection instruction to the on-board unit. The on-board unit responds to the toll collection instruction by sending the vehicle account information to the roadside unit. The roadside unit deducts the highway toll from the vehicle account corresponding to the target vehicle based on the vehicle account information to achieve automated payment. For example, the above data interaction process between the roadside unit and the on-board unit can be regarded as an interactive behavior.

[0042] Optionally, when a wireless communication connection is established between the on-board unit and the roadside unit, it is determined that the interaction between the target vehicle and the ETC roadside unit is in progress; alternatively, when an interaction data between the on-board unit and the roadside unit indicates that a toll order corresponding to the target vehicle has been created, it is determined that the interaction between the target vehicle and the ETC roadside unit is in progress.

[0043] In this embodiment of the application, the lane forward data is used to indicate the road conditions in front of the target vehicle in the target lane. That is, the lane forward data is the data collected by the target vehicle on the road conditions in front.

[0044] Optionally, the forward lane data can be in the form of an image, numerical data, video, signal data, etc., and there is no limitation on this.

[0045] Optionally, the lane forward data can be data collected by devices such as Global Positioning System (GPS), cameras, and sensors.

[0046] In some embodiments, taking lane-forward data including lane-forward images as an example, the lane-forward image is obtained by calling a camera to capture images of the area in front of the target vehicle. In one example, the camera continuously captures images of the area in front of the target vehicle at a preset shooting frequency; in another example, the camera continuously captures video of the area in front of the target vehicle, and video frames are extracted from the video to obtain the lane-forward image.

[0047] Optionally, the aforementioned camera can be a forward-facing camera, a panoramic camera, a digital video recorder (DVR), or the like, located on the target vehicle.

[0048] Step 220: Identify the vehicle status of the vehicle in front based on the lane forward data, and determine the corresponding vehicle behavior of the vehicle in front.

[0049] In some embodiments, the on-board unit determines whether there is a vehicle ahead in the target lane where the target vehicle is located using lane forward data. If a vehicle ahead exists, the unit further identifies the vehicle's state to determine its behavior. Illustratively, based on lane forward data, it determines whether there is a vehicle ahead of the target vehicle in the target lane. If a vehicle ahead is detected, the unit identifies its state and determines its behavior. That is, by first determining whether there is a vehicle ahead in the target vehicle's lane, and only after confirming its existence, further determination is made. This eliminates the need for vehicle state identification when no vehicle is present in the lane, reducing the computational data volume of the overall ETC interactive control process.

[0050] In some embodiments, when the lane forward data is implemented as a lane forward image, the presence of a preceding vehicle can be determined by identifying whether a vehicle exists in the lane forward image. In some embodiments, vehicle identification is achieved through a pre-trained vehicle recognition model. Schematic, the lane forward image is input into the pre-trained vehicle recognition model, the vehicle recognition model identifies whether a preceding vehicle exists in the lane forward image, obtains the image recognition result, and determines whether a preceding vehicle exists in the target lane based on the image recognition result.

[0051] Optionally, the above vehicle recognition model can be implemented using neural network models such as Convolutional Neural Networks (CNN), Feedforward Neural Network (FNN), Residual Network (ResNet), and Transformer, without specific limitations.

[0052] In some embodiments, before inputting the lane forward image into the vehicle recognition model, the lane forward image is further preprocessed, and the preprocessed lane forward image is input into the vehicle recognition model for recognition of the vehicle in front. Optionally, the above image preprocessing includes at least one of grayscale processing, noise reduction processing, contrast enhancement processing, histogram equalization processing, size correction processing, deblurring processing, scaling processing, etc.

[0053] In some embodiments, lane forward data can also be signal data detected by a radar sensor. Optionally, the radar sensor can be a lidar sensor, a millimeter-wave radar sensor, a corner radar sensor, etc., and is not limited thereto.

[0054] Indicatively, the signal data detected by the radar sensor is analyzed to determine the relative direction and relative distance between the obstacle ahead and the target vehicle. Based on the relative direction and relative distance, it is determined whether the detected obstacle is in the target lane. If so, it is determined that there is a vehicle ahead.

[0055] In some embodiments, when a vehicle is detected in the target lane, its behavior is identified. Illustratively, when a vehicle is detected in front of the target vehicle in the target lane, the vehicle's position is detected to obtain vehicle position information, the lane lines corresponding to the target lane are detected to obtain lane line position information, and the vehicle's behavior is determined based on the matching relationship between the vehicle position information and the lane line position information. That is, by matching the vehicle position of the preceding vehicle with the lane line, the vehicle's behavior is determined, improving the accuracy of vehicle behavior recognition and thus improving the control accuracy of ETC interactive control.

[0056] For illustrative purposes, the aforementioned vehicle position information includes at least one of the following: distance information between the preceding vehicle and the target vehicle, the proportion of the preceding vehicle's body within the target lane, and the direction in which the preceding vehicle is pointing.

[0057] In some embodiments, taking vehicle location information including distance information as an example, illustratively, when the distance information indicates that the distance between the target vehicle and the vehicle in front is less than a preset distance threshold, the vehicle behavior of the vehicle in front is determined as vehicle intrusion behavior; when the distance information indicates that the distance between the target vehicle and the vehicle in front is greater than or equal to the preset distance threshold, the vehicle behavior of the vehicle in front is determined as normal driving behavior.

[0058] In other embodiments, taking vehicle location information including vehicle body proportion information as an example, illustratively, when the proportion of the current vehicle body in the target lane is greater than a preset proportion threshold, the vehicle behavior of the preceding vehicle is determined as vehicle intrusion behavior; when the proportion of the current vehicle body in the target lane is less than or equal to the preset proportion threshold, the vehicle behavior of the preceding vehicle is determined as normal driving behavior.

[0059] In other embodiments, taking the vehicle location information including the direction information of the vehicle in front as an example, illustratively, when the direction of the vehicle in front is detected to indicate that the vehicle in front will use the target lane as its driving lane, the vehicle behavior of the vehicle in front is determined to be vehicle intrusion behavior; when the direction of the vehicle in front is detected to indicate that the vehicle in front will use a lane other than the target lane as its driving lane, the vehicle behavior of the vehicle in front is determined to be normal driving behavior.

[0060] In some embodiments, to improve the accuracy of vehicle behavior judgment, vehicle behavior is judged based on the area range of the ETC recognition zone. Illustratively, the ETC recognition zone corresponding to the target lane is obtained, where the ETC recognition zone is the area on the target lane used for vehicle entry and exit control via ETC. Based on the ETC recognition zone and lane line position information, the target recognition zone in front of the target vehicle is determined. When the vehicle position information indicates that the vehicle in front is within the target recognition zone, the vehicle behavior of the vehicle in front is determined to be vehicle intrusion behavior. When the vehicle position information indicates that the vehicle in front is outside the target recognition zone, the vehicle behavior of the vehicle in front is determined to be normal driving behavior, where normal driving behavior indicates that normal interaction is allowed. That is, intrusion behavior of the vehicle in front is only judged after the vehicle is identified as entering the area range of the ETC recognition zone, avoiding misjudgment problems in normal driving scenarios. After determining that the vehicle has entered the area range of the ETC recognition zone, the target recognition zone that needs to be judged for intrusion is divided, improving the accuracy of vehicle behavior judgment. Furthermore, the target recognition zone divided each time can adapt to different ETC scenarios in reality, further improving the accuracy of vehicle behavior judgment.

[0061] As an illustration, when determining the target recognition area based on the ETC recognition area and lane line position information, the ETC recognition area can be cropped according to the forward lane line position that the target vehicle can capture at its current position to obtain the target recognition area.

[0062] In some embodiments, the ETC identification area is the area within which the on-board unit and the roadside unit can establish a wireless communication connection to perform interactive behavior. Optionally, the ETC identification area can be identified in real time or preset by the system.

[0063] In some embodiments, when the ETC recognition area is identified in real time, the ETC recognition area is determined by identifying key elements in the environment surrounding the toll station. Optionally, the key elements may include column delineators, barriers, lane lines, toll station roof, etc.

[0064] In one example, the first position of the post delineator around the target vehicle, the second position of the guardrail, and the third position of the lane line of the target lane are identified, and the ETC recognition area is determined based on the first, second, and third positions. Determining the ETC recognition area by identifying the first position of the post delineator around the vehicle, the second position of the guardrail, and the third position of the lane line of the target lane improves the accuracy of ETC recognition.

[0065] Step 230: If the vehicle behavior of the preceding vehicle indicates that the preceding vehicle has engaged in vehicle intrusion behavior, send a stop command to the ETC roadside unit.

[0066] Schematic illustration: Upon detecting vehicle intrusion behavior by the vehicle ahead, the on-board device interrupts the interaction between the on-board unit and the roadside unit. In some embodiments, the on-board device controls the on-board unit to send a stop command to the roadside unit, which instructs the cessation of the interaction between the on-board unit and the roadside unit.

[0067] In some embodiments, when the behavior of the preceding vehicle indicates that the preceding vehicle has engaged in vehicle intrusion, the license plate information of the preceding vehicle is identified, and the aforementioned license plate information is carried in the stop command sent by the on-board unit to the roadside unit, so that the roadside unit records the vehicle with vehicle intrusion behavior.

[0068] In some embodiments, the roadside unit uploads the license plate information of vehicles engaging in intrusion behavior to a cloud server. The cloud server records the vehicles engaging in intrusion behavior. When the number of times the cloud server records intrusion behavior of a target license plate reaches a preset threshold, the cloud server can mark the target license plate and send the marked target license plate to the roadside unit. If the roadside unit detects an ETC interaction request sent by a vehicle with the target license plate, the roadside unit rejects the ETC interaction request. In one example, taking ETC application at a parking lot toll station as an example, after the target license plate is marked, the cloud server sends the marked target license plate to the toll collection equipment at the parking lot toll station. When it detects that a vehicle with the target license plate needs to enter the parking lot, it refuses the vehicle entry.

[0069] In other words, by uploading the license plate information of the intruding vehicle to the roadside unit and recording the license plate information of the intruding vehicle through the cloud server, the ETC interaction of the intruding vehicle is restricted when the intruding vehicle is repeatedly identified as having intrusion behavior, thereby improving the security of ETC interaction.

[0070] In some embodiments, when the behavior of the preceding vehicle indicates that the preceding vehicle's behavior is normal driving behavior, no intervention is made in the interaction between the on-board unit and the roadside unit.

[0071] In some embodiments, the ETC lane recognition function is turned off when a target vehicle is detected passing through the barrier.

[0072] In summary, during the ETC interaction process of the target vehicle, the presence of a preceding vehicle is continuously determined based on the forward lane data in front of the target vehicle. If a preceding vehicle is present, its behavior is identified. If the preceding vehicle's behavior indicates that it is attempting to steal the target vehicle's ETC interaction result by intruding into the lane, the interaction between the target vehicle and the ETC roadside unit is interrupted when the intruding vehicle attempts to pass through the barrier using the target vehicle's ETC interaction result. This prevents losses caused by the intruding vehicle's theft of the ETC interaction result and improves the security of the ETC interaction process.

[0073] Please refer to Figure 3, which shows a flowchart of an exemplary embodiment of the ETC interactive control method provided in this application. In this embodiment, the ETC lane identification function is implemented based on multiple sensors. The method includes the following steps 301 to 307.

[0074] Step 301: Obtain the location data of the target vehicle via GPS.

[0075] In this embodiment of the application, the target vehicle obtains its location data during driving by calling GPS, wherein the location data is used to indicate the target vehicle's position on the map during driving.

[0076] Step 302: If the positioning data indicates that there is a toll station within the first area of ​​the target vehicle, the front view image of the target vehicle is captured by the camera.

[0077] In some embodiments, after the target vehicle obtains its current location data via GPS, it determines its current position on the map and queries the map to see if a toll station exists within a first area centered on that location. If so, a toll station identification algorithm is activated. In one example, the aforementioned first area can be defined as a circular area with a radius of 1 km and the target vehicle's current position as its center.

[0078] In other embodiments, the target vehicle acquires positioning data via GPS and current navigation information via a navigation system, whereby the navigation information includes the current travel route of the target vehicle. Illustratively, the navigation information of the target vehicle is acquired, including the current travel route. If the navigation information determines that the target vehicle passes through a toll station on the travel route, the positional relationship between the target vehicle's location and the toll station is determined based on the positioning data. When the positional relationship indicates that the vehicle's location is within a second area of ​​the toll station, a front-view image of the target vehicle is captured. That is, the presence of a toll station on the travel route is determined based on the travel route indicated by the navigation information. If a toll station exists, and the target vehicle's positioning data indicates that the target vehicle is within the second area of ​​the toll station on the travel route, the toll station identification algorithm is activated. This reduces the computational resource consumption of the toll station identification algorithm and improves the utilization rate of the device's computational resources.

[0079] Optionally, the above navigation system can be implemented as an in-vehicle navigation system, or as a navigation application on a mobile device (e.g., a smartphone) that establishes a communication connection with an in-vehicle device.

[0080] To illustrate, when the toll station recognition algorithm is activated, the camera captures a front view image of the target vehicle, which is an image taken from the perspective of the target vehicle's direction of travel.

[0081] Optionally, the aforementioned camera can be a forward-facing camera, a panoramic camera, a digital video recorder (DVR), or the like, located on the target vehicle.

[0082] In some embodiments, after acquiring a vehicle front view image, the vehicle is identified using a pre-trained toll station recognition model. Schematic, the vehicle front view image is input into the pre-trained toll station recognition model, which identifies whether a toll station exists in the vehicle front view image and obtains a toll station recognition result. This toll station recognition result is used to indicate whether a toll station exists ahead of the road.

[0083] Optionally, the above-mentioned toll station recognition model can be implemented using neural network models such as Convolutional Neural Networks (CNN), Feedforward Neural Network (FNN), Residual Network (ResNet), and Transformer, without specific limitations.

[0084] In some embodiments, the training dataset of the toll display recognition model described above can be implemented as a dataset of toll stations within a specified area obtained through big data, as shown in FIG4, which illustrates a schematic diagram of a toll station dataset 400 provided in an exemplary embodiment of this application. The toll station dataset 400 includes toll station images within a specified area.

[0085] Optionally, the specified area may be an area determined based on the target vehicle's permanent residence; or, the specified area may be a system-preset area; or, the specified area may be a user-defined area.

[0086] Step 303: If the toll station is detected from the vehicle's forward view image, activate the ETC lane recognition function.

[0087] Among them, the ETC lane recognition function is used to determine whether the interactive behavior implemented through ETC needs to be interrupted based on the vehicle behavior of the vehicle in front.

[0088] In some embodiments, the method can be applied to ETC interaction in multiple scenarios. When identifying toll stations through the vehicle's forward-view image, the type of toll station is identified simultaneously. That is, the toll station identification result output by the toll station identification model includes the toll station type of the identified toll station, and different ETC lane identification functions are enabled based on the identified toll station type.

[0089] Optionally, the above-mentioned toll station types may include tunnel type, highway type, parking lot type, etc.

[0090] Optionally, the ETC lane recognition function for different toll station types can correspond to different recognition accuracy, recognition area size, and function activation conditions.

[0091] In one example, when the toll station type is identified as a parking lot, the ETC lane recognition function is not activated when the target vehicle's current journey is entering the parking lot, and the ETC lane recognition function is activated when the target vehicle's current journey is leaving the parking lot.

[0092] In this embodiment, executing the toll station identification algorithm first has the following effects: First, since the image information of toll stations is unique and the feature parameters are obvious, the identification accuracy is high. However, the features of toll entrances between different toll stations are not unique, and the interference of some negative samples is obvious, such as tunnel entrances and bridge entrances. Therefore, using the toll station identification algorithm to identify toll stations can avoid the false triggering of the ETC lane identification function. Second, it ensures that the ETC lane identification algorithm corresponding to the ETC lane identification function can be started in advance, avoiding the long algorithm start time and missed detection.

[0093] In some embodiments, when a toll station is identified from the vehicle's front view image, the pixel ratio of the image pixels corresponding to the toll station to all pixels in the vehicle's front view image is determined. When the pixel ratio reaches a preset ratio threshold, the ETC lane recognition function is activated. That is, the ETC lane recognition function is not activated prematurely, thus improving the utilization rate of computing resources.

[0094] Step 304: Obtain lane forward data of the target lane where the target vehicle is located using radar sensors.

[0095] Optionally, the aforementioned radar sensor can be implemented as a lidar sensor, millimeter-wave radar sensor, corner radar sensor, etc., and is not limited here.

[0096] In some embodiments, the target vehicle obtains lane forward data through the 3D point cloud imaging technology of the radar module where the radar sensor is located. The lane forward data includes a three-dimensional graphic of the object and distance information. The three-dimensional graphic of the object is a graphic formed by a 3D point cloud generated by the signal detected by the radar sensor, and the distance information is the distance between each point cloud and the target vehicle.

[0097] In some embodiments, when the ETC lane identification function is enabled, the ETC identification area is obtained. The ETC identification area is the area within which the on-board unit and the roadside unit can establish a wireless communication connection to perform interactive behavior. Optionally, the ETC identification area can be obtained in real time or it can be preset by the system.

[0098] In some embodiments, when the ETC recognition area is identified in real time, the ETC recognition area is determined by identifying key elements in the environment surrounding the toll station. Optionally, the key elements may include column delineators, barriers, lane lines, toll station roof, etc.

[0099] In one example, the first position of the post delineator around the target vehicle, the second position of the guardrail, and the third position of the lane line of the target lane are identified, and the ETC recognition area is determined based on the first, second, and third positions.

[0100] In some embodiments, vehicle identification is achieved through a pre-trained ETC lane identification model. Schematic, a vehicle front view image is input into the pre-trained ETC lane identification model, which identifies the ETC identification area in the vehicle front view image to obtain an area identification result. This area identification result is used to indicate the ETC identification area in the target lane where the target vehicle is located.

[0101] Optionally, the above-mentioned ETC lane recognition model can be implemented using neural network models such as Convolutional Neural Networks (CNN), Feedforward Neural Network (FNN), Residual Network (ResNet), and Transformer, without specific limitations.

[0102] In some embodiments, the training dataset of the above-mentioned ETC lane identification model can be implemented as a dataset of ETC lanes in toll stations obtained through big data, as shown in FIG5, which illustrates a schematic diagram of an ETC lane dataset 500 provided in an exemplary embodiment of this application. The ETC lane dataset 500 includes scene images of ETC lanes in toll stations.

[0103] Step 305: Determine whether there is a vehicle in front of the target vehicle in the target lane based on the lane forward data.

[0104] In a schematic way, the 3D object graphic formed by 3D point cloud is compared with the preset vehicle image. When the 3D object graphic and the preset vehicle image match, it is determined that there is a vehicle in front of the target vehicle.

[0105] Step 306: If it is detected that there is a vehicle in front of the target vehicle in the target lane, identify the vehicle status of the vehicle in front and determine the corresponding vehicle behavior.

[0106] In some embodiments, the first position of the preceding vehicle in the first coordinate system corresponding to the object's three-dimensional graphics is determined by the point cloud position corresponding to the 3D point cloud of the preceding vehicle in the object's three-dimensional graphics. The lane line corresponding to the target lane in the vehicle's front view image is identified, and the second position of the lane line in the second coordinate system corresponding to the vehicle's front view image is obtained. The first coordinate system and the second coordinate system are fitted so that the preceding vehicle position and the lane line position are in the same coordinate system. Based on the lane line position and the pre-acquired ETC recognition area, the target recognition area is determined. When the preceding vehicle position is within the target recognition area, the preceding vehicle's behavior is determined to be a vehicle intrusion behavior.

[0107] Step 307: If the vehicle behavior of the preceding vehicle indicates that the preceding vehicle has engaged in vehicle intrusion behavior, the interaction behavior is interrupted.

[0108] Schematic illustration: Upon detecting vehicle intrusion behavior by the vehicle ahead, the on-board device interrupts the interaction between the on-board unit and the roadside unit. In some embodiments, the on-board device controls the on-board unit to send a stop command to the roadside unit, which instructs the cessation of the interaction between the on-board unit and the roadside unit.

[0109] In some embodiments, the ETC interactive control method provided in this application is executed by the on-board terminal in the target vehicle. When the on-board terminal generates a stop command, it sends the stop command to the on-board unit through the Controller Area Network (CAN) to stop the interaction between the on-board unit and the road sign unit.

[0110] In some embodiments, after receiving a stop instruction, if the vehicle unit does not send a payment command to the roadside unit, the vehicle unit sends a payment stop message to the roadside unit. The payment stop message indicates that a vehicle has entered the current lane to steal ETC payment, and the current payment is stopped.

[0111] In some embodiments, after receiving a stop instruction, if the vehicle unit has already sent a payment command to the roadside unit, the vehicle unit sends a payment withdrawal message to the roadside unit. The payment withdrawal message indicates that a vehicle has entered the current lane to steal ETC payment and that the payment command needs to be withdrawn. When the roadside unit receives the payment withdrawal message, it will no longer control the barrier to rise based on the previous payment command.

[0112] In some embodiments, when the behavior of the preceding vehicle indicates that the preceding vehicle has engaged in vehicle intrusion, the license plate information of the preceding vehicle is identified, and the aforementioned license plate information is carried in the stop command sent by the on-board unit to the roadside unit, so that the roadside unit records the vehicle with vehicle intrusion behavior.

[0113] In some embodiments, the roadside unit uploads the license plate information of vehicles engaging in intrusion behavior to a cloud server. The cloud server records the vehicles engaging in intrusion behavior. When the number of times the cloud server records intrusion behavior of a target license plate reaches a preset threshold, the cloud server can mark the target license plate. In one example, taking ETC application at a parking lot toll station as an example, after the target license plate is marked, the cloud server sends the marked target license plate to the toll collection equipment at the parking lot toll station. When the system detects that a vehicle with the target license plate needs to enter the parking lot, it refuses the vehicle entry.

[0114] In some embodiments, when the behavior of the preceding vehicle indicates that the preceding vehicle's behavior is normal driving behavior, no intervention is made in the interaction between the on-board unit and the roadside unit.

[0115] In some embodiments, when a target vehicle is detected to have passed through the barrier, the ETC lane recognition function is turned off, that is, the vehicle behavior of the vehicle in front is continuously detected in a loop until the vehicle passes through the barrier.

[0116] In summary, during the ETC interaction process of the target vehicle, the presence of a preceding vehicle is continuously determined based on the forward lane data in front of the target vehicle. If a preceding vehicle is present, its behavior is identified. If the preceding vehicle's behavior indicates that it is attempting to steal the target vehicle's ETC interaction result by intruding into the lane, the interaction between the target vehicle and the ETC roadside unit is interrupted when the intruding vehicle attempts to pass through the barrier using the target vehicle's ETC interaction result. This prevents losses caused by the intruding vehicle's theft of the ETC interaction result and improves the security of the ETC interaction process.

[0117] In this embodiment, the location data of the target vehicle determines whether there is a toll station around the target vehicle. If a toll station exists, the forward image of the target vehicle is collected and identified. When the target vehicle is detected to be approaching the toll station, the ETC lane identification function is activated, thereby realizing fully automated ETC interactive control during vehicle travel. The user does not need to manually activate the function after approaching the ETC to achieve intrusion vehicle identification, thus realizing the automation effect of ETC interactive control and improving the control efficiency of ETC interactive control.

[0118] It should be noted that this application may display prompt interfaces, pop-ups, or output voice prompts before and during the collection of user data. These prompt interfaces, pop-ups, or voice prompts are used to inform the user that their data is being collected. This ensures that the application only begins the steps for collecting user data after receiving confirmation from the user regarding the prompt interface or pop-up; otherwise (i.e., without user confirmation), the steps for collecting user data end, meaning no user data is collected. In other words, all user data collected in this application is collected with the user's consent and authorization, and the collection, use, and processing of related user data must comply with the relevant laws, regulations, and standards of the relevant countries and regions.

[0119] Please refer to Figure 6, which shows a structural block diagram of an ETC interactive control device provided in an exemplary embodiment of this application. The device includes the following modules:

[0120] The acquisition module 610 is used to acquire lane forward data of the target lane where the target vehicle is located when the interaction between the target vehicle and the ETC roadside unit is in progress. The lane forward data is used to indicate the road conditions in front of the target vehicle in the target lane.

[0121] The identification module 620 is used to identify the vehicle status of the vehicle in front based on the lane forward data and determine the vehicle behavior corresponding to the vehicle in front.

[0122] The control module 630 is used to send a stop command to the ETC roadside unit when the vehicle behavior of the preceding vehicle indicates that the preceding vehicle has engaged in vehicle intrusion behavior. The stop command is used to indicate the cessation of the currently executed interactive behavior.

[0123] In some optional embodiments, the identification module 620 is further configured to determine, based on the lane forward data, whether there is a vehicle in front of the target vehicle in the target lane;

[0124] The identification module 620 is further configured to identify the vehicle status of the vehicle in front and determine the vehicle behavior corresponding to the vehicle in front when it is detected that there is a vehicle in front of the target vehicle in the target lane.

[0125] In some optional embodiments, the identification module 620 is further configured to detect the vehicle position corresponding to the vehicle in front and obtain vehicle position information when it is detected that there is a vehicle in front of the target vehicle in the target lane.

[0126] The identification module 620 is also used to detect the lane line corresponding to the target lane and obtain lane line position information;

[0127] The identification module 620 is further configured to determine the vehicle behavior corresponding to the preceding vehicle based on the matching relationship between the vehicle location information and the lane line location information.

[0128] In some optional embodiments, the acquisition module 610 is further configured to acquire the ETC identification area corresponding to the target lane, wherein the ETC identification area is the area on the target lane used for vehicle entry and exit control via ETC;

[0129] The identification module 620 is further configured to determine the target identification area in front of the target vehicle based on the ETC identification area and the lane line position information;

[0130] The identification module 620 is further configured to determine the vehicle behavior of the vehicle in front as the vehicle intrusion behavior when the vehicle location information indicates that the vehicle in front is located within the target identification area;

[0131] The identification module 620 is further configured to determine that the vehicle behavior of the preceding vehicle is normal driving behavior when the vehicle location information indicates that the preceding vehicle is outside the target identification area, and the normal driving behavior indicates that the interaction behavior is allowed to proceed normally.

[0132] In some optional embodiments, the identification module 620 is further configured to identify the first position of the post delineator around the target vehicle, the second position of the guardrail, and the third position of the lane line of the target lane;

[0133] The identification module 620 is further configured to determine the ETC identification area based on the first location, the second location, and the third location.

[0134] In some optional embodiments, the acquisition module 610 is further configured to acquire a front view image of the target vehicle, wherein the front view image is an image taken from the perspective of the direction of travel of the target vehicle.

[0135] The identification module 620 is also used to activate the ETC lane identification function when a toll station is identified from the vehicle's forward view image. The ETC lane identification function is used to determine whether the interactive behavior implemented through ETC needs to be interrupted based on the vehicle behavior of the vehicle in front.

[0136] In some optional embodiments, the acquisition module 610 is further configured to acquire the positioning data of the target vehicle, the positioning data being used to indicate the position of the target vehicle on a map during its driving process;

[0137] The acquisition module 610 is further configured to acquire a front view image of the target vehicle when the positioning data indicates that a toll station exists within the first area of ​​the target vehicle.

[0138] In some optional embodiments, the acquisition module 610 is further configured to acquire navigation information of the target vehicle, the navigation information including the current travel route of the target vehicle;

[0139] The identification module 620 is further configured to determine the positional relationship between the target vehicle and the toll station based on the positioning data when it is determined based on the navigation information that the target vehicle passes through the toll station on the travel route;

[0140] The acquisition module 610 is further configured to acquire a front view image of the target vehicle when the positional relationship indicates that the vehicle is located within the second area of ​​the toll station.

[0141] In some optional embodiments, the identification module 620 is further configured to identify the license plate information of the preceding vehicle when the vehicle behavior of the preceding vehicle indicates that the preceding vehicle has engaged in vehicle intrusion behavior;

[0142] The control module is also used to send the stop command to the ETC roadside unit, the stop command including the license plate information of the vehicle in front;

[0143] The ETC roadside unit uploads the license plate information of the vehicle in front to a cloud server, which records the license plate information. When the number of times the cloud server records vehicle intrusion behavior of the target license plate reaches a preset threshold, the cloud server marks the target license plate and sends the marked target license plate to the ETC roadside unit. If the ETC roadside unit detects an ETC interaction request sent by the vehicle with the target license plate, the ETC roadside unit rejects the ETC interaction request.

[0144] In summary, during the ETC interaction process of the target vehicle, the presence of a preceding vehicle is continuously determined based on the forward lane data in front of the target vehicle. If a preceding vehicle is present, its behavior is identified. If the preceding vehicle's behavior indicates that it is attempting to steal the target vehicle's ETC interaction result by intruding into the lane, the interaction between the target vehicle and the ETC roadside unit is interrupted when the intruding vehicle attempts to pass through the barrier using the target vehicle's ETC interaction result. This prevents losses caused by the intruding vehicle's theft of the ETC interaction result and improves the security of the ETC interaction process.

[0145] It is worth noting that the various embodiments provided in this application can be implemented in combination or independently, and no limitation is made here.

[0146] It should be noted that the ETC interactive control device provided in the above embodiments is only an example of the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the ETC interactive control device and the ETC interactive control method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.

[0147] Figure 7 shows a structural block diagram of an in-vehicle device 700 provided in an exemplary embodiment of this application.

[0148] Typically, the vehicle-mounted device 700 includes a processor 701 and a memory 702.

[0149] Processor 701 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. Processor 701 may also include a main processor and a coprocessor. The main processor, also known as a central processing unit (CPU), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 701 may integrate a graphics processing unit (GPU), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 701 may also include an artificial intelligence (AI) processor, which handles computational operations related to machine learning.

[0150] The memory 702 may include one or more computer-readable storage media, which may be non-transitory. In some embodiments, the non-transitory computer-readable storage media in the memory 702 are used to store at least one instruction, which is executed by the processor 701 to implement the ETC interactive control method provided in the method embodiments of this application.

[0151] Indicatively, the vehicle-mounted device 700 also includes other components 703. Those skilled in the art will understand that the structure shown in FIG7 does not constitute a limitation on the vehicle-mounted device 700, and may include more or fewer components than shown, or combine certain components, or use different component arrangements.

[0152] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing related hardware. This program can be stored in a computer-readable storage medium, which may be a computer-readable storage medium included in the memory described in the above embodiments; or it may be a standalone computer-readable storage medium not assembled into the terminal. The computer-readable storage medium stores at least one instruction, at least one program segment, a code set, or an instruction set. The at least one instruction, the at least one program segment, the code set, or the instruction set is loaded and executed by the processor to implement any of the ETC interactive control methods described in the above embodiments.

[0153] Optionally, the computer-readable storage medium may include: read-only memory (ROM), random access memory (RAM), solid-state drives (SSDs), or optical discs, etc. The random access memory may include resistive random access memory (ReRAM) and dynamic random access memory (DRAM). The sequence numbers of the embodiments in this application are merely descriptive and do not represent the superiority or inferiority of the embodiments.

[0154] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

Claims

1. An ETC interactive control method, the method being executed by a computer device, the method comprising: When the interaction between the target vehicle and the ETC roadside unit is in progress, the forward lane data of the target lane where the target vehicle is located is obtained. The forward lane data is used to indicate the road conditions in front of the target vehicle in the target lane. Based on the lane forward data, the vehicle status of the vehicle in front is identified, and the corresponding vehicle behavior of the vehicle in front is determined. If the vehicle behavior of the preceding vehicle indicates that the preceding vehicle has engaged in vehicle intrusion, a stop command is sent to the ETC roadside unit. The stop command is used to instruct the current interactive behavior to be stopped.

2. The method according to claim 1, wherein, The step of identifying the vehicle state of the vehicle in front based on the lane forward data and determining the corresponding vehicle behavior includes: Based on the lane forward data, determine whether there is a vehicle in front of the target vehicle in the target lane; If a vehicle is detected in front of the target vehicle in the target lane, the vehicle status of the vehicle in front is identified, and the corresponding vehicle behavior is determined.

3. The method according to claim 1 or 2, wherein, When it is detected that there is a vehicle in front of the target vehicle in the target lane, the step of identifying the vehicle state of the vehicle in front and determining the corresponding vehicle behavior includes: If it is detected that there is a vehicle in front of the target vehicle in the target lane, the position of the vehicle corresponding to the vehicle in front is detected to obtain the vehicle position information; Detect the lane lines corresponding to the target lane to obtain lane line position information; Based on the matching relationship between the vehicle location information and the lane line location information, the vehicle behavior corresponding to the preceding vehicle is determined.

4. The method according to any one of claims 1 to 3, wherein, The step of determining the vehicle behavior corresponding to the preceding vehicle based on the matching relationship between the vehicle location information and the lane line location information includes: Obtain the ETC identification area corresponding to the target lane, wherein the ETC identification area is the area on the target lane used for vehicle entry and exit control via ETC; Based on the ETC recognition area and the lane line position information, the target recognition area in front of the target vehicle is determined; When the vehicle location information indicates that the vehicle in front is located within the target identification area, the vehicle behavior of the vehicle in front is determined to be the vehicle intrusion behavior; When the vehicle location information indicates that the preceding vehicle is outside the target recognition area, the vehicle behavior of the preceding vehicle is determined to be normal driving behavior, and the normal driving behavior indicates that the interaction behavior is allowed to proceed normally.

5. The method according to any one of claims 1 to 4, wherein, The step of obtaining the ETC recognition area corresponding to the target lane includes: Identify the first position of the post delineator around the target vehicle, the second position of the guardrail, and the third position of the lane line of the target lane; The ETC identification area is determined based on the first location, the second location, and the third location.

6. The method according to any one of claims 1 to 5, wherein, The method further includes: Acquire a front view image of the target vehicle, wherein the front view image is an image taken from the perspective of the direction in which the target vehicle is moving; When a toll station is detected from the vehicle's forward view image, the ETC lane recognition function is activated. The ETC lane recognition function is used to determine whether the interactive behavior implemented through ETC needs to be interrupted based on the vehicle behavior of the vehicle in front.

7. The method according to any one of claims 1 to 6, wherein, The acquisition of the front view image of the target vehicle includes: The location data of the target vehicle is obtained, and the location data is used to indicate the position of the target vehicle on the map during the driving process; If the location data indicates the presence of a toll station within a first area of ​​the target vehicle, a front view image of the target vehicle is acquired.

8. The method according to any one of claims 1 to 7, wherein, When the positioning data indicates the presence of a toll station within a first area of ​​the target vehicle, the process of acquiring a front-view image of the target vehicle includes: Obtain the navigation information of the target vehicle, the navigation information including the current travel route of the target vehicle; If the navigation information determines that the target vehicle passes through the toll station on the travel route, the location relationship between the target vehicle and the toll station is determined based on the positioning data. When the location relationship indicates that the vehicle is located within the second area of ​​the toll station, a front view image of the target vehicle is acquired.

9. The method according to any one of claims 1 to 8, wherein, When the vehicle behavior of the preceding vehicle indicates that the preceding vehicle has engaged in vehicle intrusion, sending a stop command to the ETC roadside unit includes: When the vehicle behavior of the preceding vehicle indicates that the preceding vehicle has engaged in vehicle intrusion, the license plate information of the preceding vehicle is identified; Send the stop command to the ETC roadside unit, the stop command including the license plate information of the vehicle in front; The ETC roadside unit uploads the license plate information of the vehicle in front to a cloud server, which records the license plate information. When the number of times the cloud server records vehicle intrusion behavior of the target license plate reaches a preset threshold, the cloud server marks the target license plate and sends the marked target license plate to the ETC roadside unit. If the ETC roadside unit detects an ETC interaction request sent by the vehicle with the target license plate, the ETC roadside unit rejects the ETC interaction request.

10. An ETC interactive control device, the device comprising: The acquisition module is used to acquire lane forward data of the target lane where the target vehicle is located when the interaction between the target vehicle and the ETC roadside unit is in progress. The lane forward data is used to indicate the road conditions in front of the target vehicle in the target lane. The identification module is used to identify the vehicle status of the vehicle in front based on the lane forward data and determine the vehicle behavior corresponding to the vehicle in front. The control module is used to send a stop command to the ETC roadside unit when the vehicle behavior of the preceding vehicle indicates that the preceding vehicle has engaged in vehicle intrusion behavior. The stop command is used to instruct the current interactive behavior to be stopped.

Images