Electric vehicle violation behavior identification method, device and equipment and storage medium

By capturing images and trajectories of electric vehicles through cameras and combining them with license plate information to identify traffic violations, the problem of timely warnings for traffic violations by electric vehicles has been solved, achieving accurate violation identification and reducing safety hazards.

CN119028144AActive Publication Date: 2024-11-26SHIJIAZHUANG UNIVERSITY
View PDF 10 Cites 0 Cited by

Patent Information

Application Number
CN202411023201.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-29
Publication Date
2024-11-26
Estimated Expiration
2044-07-29

AI Technical Summary

Technical Problem

Traffic violations by electric vehicles are frequent and difficult to be promptly addressed, leading to increased safety hazards.

Method used

Images of target electric vehicles are captured by cameras at both ends of the road. License plate information and movement trajectory are extracted. Combined with the non-motorized vehicle lane area, it is predicted whether the electric vehicle has left the non-motorized vehicle lane, whether a violation has occurred, and the violation is recorded to notify the driver.

Benefits of technology

Accurately identify traffic violations by electric vehicles to reduce traffic violations and lower safety hazards.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119028144A_ABST
    Figure CN119028144A_ABST
Patent Text Reader

Abstract

The invention is suitable for the technical field of data processing, and provides an electric vehicle violation behavior recognition method, device and equipment and a storage medium, and the method comprises the steps: obtaining an image set of a target electric vehicle collected by cameras at two ends of a road, the two ends of the road comprise a first road end and a second road end, the target electric vehicle runs from the road first end to the road second end; based on the image set, extracting license plate information of the target electric vehicle, and extracting a motion trail of the target electric vehicle collected by a camera at a first end of a road and a motion trail of the target electric vehicle collected by a camera at a second end of the road, and respectively recording the motion trails as a first motion trail and a second motion trail; and based on the first movement track, the second movement track, the non-motorized vehicle lane area and the license plate information, determining whether the target electric vehicle has a violation behavior. According to the invention, traffic violation persons can be warned accurately and timely, and occurrence of traffic violation behaviors of the electric vehicle is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the field of data processing technology, and in particular, relates to a method, device, equipment and storage medium for identifying illegal behaviors of electric vehicles. Background Art

[0002] With the advancement of science and technology and the improvement of people's living standards, the number of private cars has increased significantly. The popularization of cars has greatly facilitated people's daily travel. At the same time, it has also added great pressure to the load capacity of the road traffic system, especially during rush hours such as commuting. Traffic jams are very likely to occur, resulting in most people currently choosing to travel by electric bikes. Because electric bikes are easy to operate and do not require traffic jams, they have been rapidly popularized as a means of travel.

[0003] However, with the widespread popularity of electric vehicles, a large number of traffic violations have also increased. In particular, it is difficult for the people involved to get corresponding warnings after committing traffic violations, which prompts some people to frequently commit traffic violations, especially when driving on motor vehicle lanes, posing great safety hazards to themselves and traffic management. Summary of the invention

[0004] The embodiments of the present application provide a method, device, equipment and storage medium for identifying traffic violations of electric vehicles, so as to accurately and timely warn traffic violators and reduce the occurrence of traffic violations of electric vehicles.

[0005] This application is implemented through the following technical solutions:

[0006] In a first aspect, an embodiment of the present application provides a method for identifying illegal behavior of an electric vehicle, comprising:

[0007] A set of images of the target electric vehicle captured by cameras at two ends of a road is obtained, wherein the two ends of the road include a first end of the road and a second end of the road, and the target electric vehicle travels from the first end of the road to the second end of the road.

[0008] Based on the image set, the license plate information of the target electric vehicle is extracted, and the motion trajectory of the target electric vehicle captured by the camera at the first end of the road and the motion trajectory of the target electric vehicle captured by the camera at the second end of the road are extracted, which are recorded as the first motion trajectory and the second motion trajectory respectively.

[0009] Based on the first motion trajectory, the second motion trajectory, the non-motor vehicle lane area and the license plate information, it is determined whether the target electric vehicle has committed any illegal behavior.

[0010] In combination with the first aspect, in some possible implementations, determining whether the target electric vehicle has violated traffic regulations based on the first motion trajectory, the second motion trajectory, the non-motor vehicle lane area, and the license plate information includes:

[0011] According to the first motion trajectory, a motion trajectory of the target electric vehicle after it leaves the acquisition range of the camera at the first end of the road is predicted, which is recorded as the first predicted motion trajectory.

[0012] According to the second motion trajectory, the motion trajectory of the target electric vehicle before it enters the acquisition range of the camera at the second end of the road is predicted, which is recorded as the second predicted motion trajectory.

[0013] If the first predicted motion trajectory intersects with the second predicted motion trajectory, the first predicted motion trajectory before the intersection, the second predicted motion trajectory after the intersection, the first motion trajectory and the second motion trajectory are taken to obtain a complete motion trajectory of the target electric vehicle.

[0014] If the entire movement trajectory is entirely within the non-motorized vehicle lane area, it is determined that the target electric vehicle has not committed any illegal behavior.

[0015] If there is a portion of the complete motion trajectory outside the non-motorized vehicle lane area, the target electric vehicle is deemed to have violated traffic regulations.

[0016] If the first predicted motion trajectory does not intersect with the second predicted motion trajectory, the number of times the target electric vehicle has violated traffic regulations within a preset time period is determined based on the license plate information.

[0017] If the number of traffic violation behaviors occurring within a preset time period exceeds a first threshold, it is determined that the target electric vehicle has committed a traffic violation.

[0018] If the number of traffic violation behaviors within the preset time period does not exceed the first threshold, it is determined that the target electric vehicle has not committed any traffic violation.

[0019] In combination with the first aspect, in some possible implementations, the method further includes:

[0020] If the first predicted motion trajectory does not intersect with the second predicted motion trajectory, it is determined whether the first predicted motion trajectory and the second predicted motion trajectory are both within the non-motor vehicle lane area.

[0021] If the first predicted motion trajectory is within the non-motor vehicle lane area, and the second predicted motion trajectory is within the non-motor vehicle lane area, it is determined that the target electric vehicle has not committed any illegal behavior.

[0022] If either the first predicted motion trajectory or the second predicted motion trajectory has a portion outside the non-motorized vehicle lane area, and the number of violations within a preset time period does not exceed a first threshold, it is determined that the target electric vehicle has not committed any violations.

[0023] If either the first predicted motion trajectory or the second predicted motion trajectory has a portion outside the non-motor vehicle lane area, and the number of violations within a preset time period exceeds a first threshold, it is determined that the target electric vehicle has committed a violation.

[0024] If the first predicted motion trajectory has a portion outside the non-motor vehicle lane area, and the second predicted motion trajectory has a portion outside the non-motor vehicle lane area, it is determined that the target electric vehicle has violated traffic regulations.

[0025] In combination with the first aspect, in some possible implementations, predicting a movement trajectory of the target electric vehicle after it leaves the acquisition range of the camera at the first end of the road according to the first movement trajectory, recorded as the first predicted movement trajectory, includes:

[0026] Based on the first motion trajectory, a motion direction and a motion speed of the target electric vehicle in the first motion trajectory are obtained, and based on the motion direction and the motion speed of the target electric vehicle in the first motion trajectory, a first predicted motion trajectory is obtained.

[0027] According to the second motion trajectory, the motion trajectory of the target electric vehicle before entering the acquisition range of the camera at the second end of the road is predicted, which is recorded as the second predicted motion trajectory, including:

[0028] Based on the second motion trajectory, a motion direction and a motion speed of the target electric vehicle in the second motion trajectory are obtained, and based on the motion direction and the motion speed of the target electric vehicle in the second motion trajectory, a second predicted motion trajectory is obtained.

[0029] In combination with the first aspect, in some possible implementations, extracting a motion trajectory of the target electric vehicle captured by a camera at a first end of the road and a motion trajectory of the target electric vehicle captured by a camera at a second end of the road, respectively recorded as a first motion trajectory and a second motion trajectory, includes:

[0030] The image set is divided into an image set at a first end of the road and an image set at a second end of the road.

[0031] Based on the image set at the first end of the road, the target electric vehicle is determined, the transparency of the images in the image set at the first end of the road is adjusted and overlapped, and the center points of multiple target electric vehicles in the overlapped images are connected to obtain a first motion trajectory.

[0032] Based on the image set at the second end of the road, the target electric vehicle is determined, the transparency of the images in the image set at the second end of the road is adjusted and overlapped, and the center points of multiple target electric vehicles in the overlapped images are connected to obtain a second motion trajectory.

[0033] In combination with the first aspect, in some possible implementations, extracting the license plate information of the target electric vehicle based on the image set includes:

[0034] The license plate image of the target electric vehicle in each image in the image set is obtained respectively to obtain multiple license plate images.

[0035] Information extraction is performed on multiple license plate images in sequence to obtain multiple information extraction results.

[0036] For each word in the license plate information of the target electric vehicle, the corresponding word in the multiple information extraction results is processed based on the fuzzy algorithm to obtain the output result of the word;

[0037] Summarize the output results of each word to get the license plate information of the target electric vehicle.

[0038] In combination with the first aspect, in some possible implementations, the method further includes:

[0039] Record the traffic violations of the target electric vehicle.

[0040] Based on the license plate information, obtain the contact information of the license plate registration.

[0041] Based on the contact information, the driver of the target electric vehicle is notified of his or her illegal behavior.

[0042] In a second aspect, an embodiment of the present application provides a device for identifying traffic violations of electric vehicles, including:

[0043] The image acquisition module is used to acquire a set of images of the target electric vehicle captured by cameras at both ends of the road, wherein the two ends of the road include a first end of the road and a second end of the road, and the target electric vehicle drives from the first end of the road to the second end of the road.

[0044] The trajectory confirmation module is used to extract the license plate information of the target electric vehicle based on the image set, and extract the motion trajectory of the target electric vehicle captured by the camera at the first end of the road and the motion trajectory of the target electric vehicle captured by the camera at the second end of the road, which are recorded as the first motion trajectory and the second motion trajectory respectively.

[0045] The result output module is used to determine whether the target electric vehicle has violated the traffic rules based on the first motion trajectory, the second motion trajectory, the non-motor vehicle lane area and the license plate information.

[0046] In a third aspect, an embodiment of the present application provides a terminal device, including: a processor and a memory, the memory is used to store a computer program, and when the processor executes the computer program, it implements the electric vehicle violation behavior identification method as described in any one of the first aspects.

[0047] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method for identifying electric vehicle violation behaviors as described in any one of the first aspects is implemented.

[0048] It can be understood that the beneficial effects of the second to fourth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here.

[0049] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0050] This application extracts the first motion trajectory, the second motion trajectory and the license plate information of the target electric vehicle based on the image set of the target electric vehicle collected by cameras at both ends of the road, and then determines whether the target electric vehicle has driven out of the non-motor vehicle lane area by combining the first motion trajectory, the second motion trajectory and the license plate information. It can predict whether there are violations in areas without cameras, and can promptly warn traffic violators after the driver commits a violation, thereby reducing the occurrence of traffic violations by electric vehicles and reducing safety hazards.

[0051] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present specification. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0053] Figure 1 It is a flowchart of a method for identifying traffic violation behavior of an electric vehicle provided in one embodiment of the present application;

[0054] Figure 2 It is a structural schematic diagram of an electric vehicle violation behavior identification device provided by an embodiment of the present application;

[0055] Figure 3 It is a structural diagram of a terminal device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0056] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0057] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0058] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0059] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0060] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0061] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0062] The present application provides a method for identifying traffic violations of electric vehicles. Figure 1is a schematic diagram of the process of an electric vehicle violation behavior identification method provided by an embodiment of the present application, referring to Figure 1 , the detailed description of the electric vehicle violation behavior identification method is as follows:

[0063] Step 101, obtaining a set of images of a target electric vehicle captured by cameras at both ends of a road, wherein the two ends of the road include a first end of the road and a second end of the road, and the target electric vehicle travels from the first end of the road to the second end of the road.

[0064] In some specific embodiments, the two ends of a road refer to two intersections of the road (intersections where electronic probes are installed).

[0065] Step 102, based on the image set, extract the license plate information of the target electric vehicle, and extract the motion trajectory of the target electric vehicle captured by the camera at the first end of the road and the motion trajectory of the target electric vehicle captured by the camera at the second end of the road, which are recorded as the first motion trajectory and the second motion trajectory respectively.

[0066] Exemplarily, based on the image set, extracting the license plate information of the target electric vehicle may include:

[0067] The license plate image of the target electric vehicle in each image in the image set is obtained respectively to obtain multiple license plate images.

[0068] Information extraction is performed on multiple license plate images in sequence to obtain multiple information extraction results.

[0069] For each word in the license plate information of the target electric vehicle, the corresponding word in the multiple information extraction results is processed based on the fuzzy algorithm to obtain the output result of the word;

[0070] Summarize the output results of each word to get the license plate information of the target electric vehicle.

[0071] In some specific embodiments, in order to ensure the accuracy of the extracted license plate information, the license plate image in each image is obtained, and the license plate information in each image is extracted, and then processed by a fuzzy algorithm to obtain the final license plate information. The fuzzy algorithm can select the most likely one from multiple extracted results as the final output. Corresponding to this solution, such processing is performed on each character, so the final license plate information is more accurate.

[0072] Exemplarily, extracting the motion trajectory of the target electric vehicle captured by a camera at a first end of the road and the motion trajectory of the target electric vehicle captured by a camera at a second end of the road, respectively recorded as a first motion trajectory and a second motion trajectory, may include:

[0073] The image set is divided into an image set at a first end of the road and an image set at a second end of the road.

[0074] Based on the image set at the first end of the road, the target electric vehicle is determined, the transparency of the images in the image set at the first end of the road is adjusted and overlapped, and the center points of multiple target electric vehicles in the overlapped images are connected to obtain a first motion trajectory.

[0075] Based on the image set at the second end of the road, the target electric vehicle is determined, the transparency of the images in the image set at the second end of the road is adjusted and overlapped, and the center points of multiple target electric vehicles in the overlapped images are connected to obtain a second motion trajectory.

[0076] Step 103, based on the first motion trajectory, the second motion trajectory, the non-motor vehicle lane area and the license plate information, determine whether the target electric vehicle has violated traffic regulations.

[0077] Exemplarily, step 103 may include:

[0078] According to the first motion trajectory, a motion trajectory of the target electric vehicle after it leaves the acquisition range of the camera at the first end of the road is predicted, which is recorded as the first predicted motion trajectory.

[0079] According to the second motion trajectory, the motion trajectory of the target electric vehicle before it enters the acquisition range of the camera at the second end of the road is predicted, which is recorded as the second predicted motion trajectory.

[0080] If the first predicted motion trajectory intersects with the second predicted motion trajectory, the first predicted motion trajectory before the intersection, the second predicted motion trajectory after the intersection, the first motion trajectory and the second motion trajectory are taken to obtain a complete motion trajectory of the target electric vehicle.

[0081] If the entire movement trajectory is entirely within the non-motorized vehicle lane area, it is determined that the target electric vehicle has not committed any illegal behavior.

[0082] If there is a portion of the complete motion trajectory outside the non-motorized vehicle lane area, the target electric vehicle is deemed to have violated traffic regulations.

[0083] If the first predicted motion trajectory does not intersect with the second predicted motion trajectory, the number of times the target electric vehicle has violated traffic regulations within a preset time period is determined based on the license plate information.

[0084] If the number of traffic violation behaviors occurring within a preset time period exceeds a first threshold, it is determined that the target electric vehicle has committed a traffic violation.

[0085] If the number of traffic violation behaviors within the preset time period does not exceed the first threshold, it is determined that the target electric vehicle has not committed any traffic violation.

[0086] In some specific embodiments, in order to obtain a higher accuracy of the motion trajectory of the target electric vehicle when it is not captured by the camera, the first predicted motion trajectory and the second predicted motion trajectory are combined to obtain a target electric vehicle. When the two predicted motion trajectories intersect, it is proved that the motion of the target electric vehicle is likely to overlap with a part of the two predicted motion trajectories, and enter the second predicted motion trajectory at the intersection point. At this time, the first predicted motion trajectory before the intersection point, the second predicted motion trajectory after the intersection point, the first motion trajectory and the second motion trajectory are connected to obtain the complete motion trajectory of the target electric vehicle. At this time, it can be determined whether the target electric vehicle has traveled out of the non-motor vehicle lane based on the complete motion trajectory.

[0087] Exemplarily, the method may further include:

[0088] If the first predicted motion trajectory does not intersect with the second predicted motion trajectory, it is determined whether the first predicted motion trajectory and the second predicted motion trajectory are both within the non-motor vehicle lane area.

[0089] If the first predicted motion trajectory is within the non-motor vehicle lane area, and the second predicted motion trajectory is within the non-motor vehicle lane area, it is determined that the target electric vehicle has not committed any illegal behavior.

[0090] If either the first predicted motion trajectory or the second predicted motion trajectory has a portion outside the non-motor vehicle lane area, and the number of violations within the preset time period does not exceed the first threshold, it is determined that the target electric vehicle has not committed any violations.

[0091] If either the first predicted motion trajectory or the second predicted motion trajectory has a portion outside the non-motor vehicle lane area, and the number of violations within a preset time period exceeds a first threshold, it is determined that the target electric vehicle has committed a violation.

[0092] If the first predicted motion trajectory has a portion outside the non-motor vehicle lane area, and the second predicted motion trajectory has a portion outside the non-motor vehicle lane area, it is determined that the target electric vehicle has violated traffic regulations.

[0093] In some specific embodiments, the number of violations within a preset time period reflects the driver's historical violations, based on which the possibility of this violation can be inferred, and whether a violation has occurred can be determined more accurately.

[0094] Exemplarily, according to the first motion trajectory, predicting the motion trajectory of the target electric vehicle after it leaves the acquisition range of the camera at the first end of the road, recorded as the first predicted motion trajectory, may include:

[0095] Based on the first motion trajectory, a motion direction and a motion speed of the target electric vehicle in the first motion trajectory are obtained, and based on the motion direction and the motion speed of the target electric vehicle in the first motion trajectory, a first predicted motion trajectory is obtained.

[0096] Predicting the motion trajectory of the target electric vehicle before it enters the acquisition range of the camera at the second end of the road according to the second motion trajectory, recorded as the second predicted motion trajectory, may include:

[0097] Based on the second motion trajectory, a motion direction and a motion speed of the target electric vehicle in the second motion trajectory are obtained, and based on the motion direction and the motion speed of the target electric vehicle in the second motion trajectory, a second predicted motion trajectory is obtained.

[0098] Exemplarily, the electric vehicle violation behavior identification method may also include:

[0099] Record the traffic violations of the target electric vehicle.

[0100] Based on the license plate information, obtain the contact information of the license plate registration.

[0101] Based on the contact information, the driver of the target electric vehicle is notified of his or her illegal behavior.

[0102] The above-mentioned electric vehicle violation identification method extracts the first motion trajectory, the second motion trajectory and the license plate information of the target electric vehicle based on the image set of the target electric vehicle collected by the cameras at both ends of the road, and then determines whether the target electric vehicle has driven out of the non-motor vehicle lane area by combining the first motion trajectory, the second motion trajectory and the license plate information. It can predict whether violations occur in areas without cameras, and can promptly warn traffic violators after the driver commits a violation, thereby reducing the occurrence of electric vehicle traffic violations and reducing safety hazards.

[0103] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0104] Corresponding to the electric vehicle violation behavior identification method described in the above embodiment, Figure 2 A structural block diagram of an electric vehicle violation behavior identification device provided in an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown.

[0105] See also Figure 2 The electric vehicle violation behavior recognition device in the embodiment of the present application may include:

[0106] The image acquisition module 201 is used to acquire a set of images of the target electric vehicle captured by cameras at both ends of the road, wherein the two ends of the road include a first end of the road and a second end of the road, and the target electric vehicle travels from the first end of the road to the second end of the road.

[0107] The trajectory confirmation module 202 is used to extract the license plate information of the target electric vehicle based on the image set, and extract the motion trajectory of the target electric vehicle captured by the camera at the first end of the road and the motion trajectory of the target electric vehicle captured by the camera at the second end of the road, which are recorded as the first motion trajectory and the second motion trajectory respectively.

[0108] The result output module 203 is used to determine whether the target electric vehicle has violated traffic regulations based on the first motion trajectory, the second motion trajectory, the non-motor vehicle lane area and the license plate information.

[0109] Exemplarily, the result output module 203 may also be used for:

[0110] According to the first motion trajectory, a motion trajectory of the target electric vehicle after it leaves the acquisition range of the camera at the first end of the road is predicted, which is recorded as the first predicted motion trajectory.

[0111] According to the second motion trajectory, the motion trajectory of the target electric vehicle before it enters the acquisition range of the camera at the second end of the road is predicted, which is recorded as the second predicted motion trajectory.

[0112] If the first predicted motion trajectory intersects with the second predicted motion trajectory, the first predicted motion trajectory before the intersection, the second predicted motion trajectory after the intersection, the first motion trajectory and the second motion trajectory are taken to obtain a complete motion trajectory of the target electric vehicle.

[0113] If the entire movement trajectory is entirely within the non-motorized vehicle lane area, it is determined that the target electric vehicle has not committed any illegal behavior.

[0114] If there is a portion of the complete motion trajectory outside the non-motorized vehicle lane area, the target electric vehicle is deemed to have violated traffic regulations.

[0115] If the first predicted motion trajectory does not intersect with the second predicted motion trajectory, the number of times the target electric vehicle has violated traffic regulations within a preset time period is determined based on the license plate information.

[0116] If the number of traffic violation behaviors occurring within a preset time period exceeds a first threshold, it is determined that the target electric vehicle has committed a traffic violation.

[0117] If the number of traffic violation behaviors within the preset time period does not exceed the first threshold, it is determined that the target electric vehicle has not committed any traffic violation.

[0118] Exemplarily, the result output module 203 may also be used for:

[0119] If the first predicted motion trajectory does not intersect with the second predicted motion trajectory, it is determined whether the first predicted motion trajectory and the second predicted motion trajectory are both within the non-motor vehicle lane area.

[0120] If the first predicted motion trajectory is within the non-motor vehicle lane area, and the second predicted motion trajectory is within the non-motor vehicle lane area, it is determined that the target electric vehicle has not committed any illegal behavior.

[0121] If either the first predicted motion trajectory or the second predicted motion trajectory has a portion outside the non-motor vehicle lane area, and the number of violations within the preset time period does not exceed the first threshold, it is determined that the target electric vehicle has not committed any violations.

[0122] If either the first predicted motion trajectory or the second predicted motion trajectory has a portion outside the non-motor vehicle lane area, and the number of violations within a preset time period exceeds a first threshold, it is determined that the target electric vehicle has committed a violation.

[0123] If the first predicted motion trajectory has a portion outside the non-motor vehicle lane area, and the second predicted motion trajectory has a portion outside the non-motor vehicle lane area, it is determined that the target electric vehicle has violated traffic regulations.

[0124] Exemplarily, the result output module 203 may also be used for:

[0125] Based on the first motion trajectory, a motion direction and a motion speed of the target electric vehicle in the first motion trajectory are obtained, and based on the motion direction and the motion speed of the target electric vehicle in the first motion trajectory, a first predicted motion trajectory is obtained.

[0126] Exemplarily, the result output module 203 may also be used for:

[0127] Based on the second motion trajectory, a motion direction and a motion speed of the target electric vehicle in the second motion trajectory are obtained, and based on the motion direction and the motion speed of the target electric vehicle in the second motion trajectory, a second predicted motion trajectory is obtained.

[0128] Exemplarily, the trajectory confirmation module 202 may also be used for:

[0129] The image set is divided into an image set at a first end of the road and an image set at a second end of the road.

[0130] Based on the image set at the first end of the road, the target electric vehicle is determined, the transparency of the images in the image set at the first end of the road is adjusted and overlapped, and the center points of multiple target electric vehicles in the overlapped images are connected to obtain a first motion trajectory.

[0131] Based on the image set at the second end of the road, the target electric vehicle is determined, the transparency of the images in the image set at the second end of the road is adjusted and overlapped, and the center points of multiple target electric vehicles in the overlapped images are connected to obtain a second motion trajectory.

[0132] Exemplarily, the trajectory confirmation module 202 may also be used for:

[0133] The license plate image of the target electric vehicle in each image in the image set is obtained respectively to obtain multiple license plate images.

[0134] Information extraction is performed on multiple license plate images in sequence to obtain multiple information extraction results.

[0135] For each word in the license plate information of the target electric vehicle, the corresponding word in the multiple information extraction results is processed based on the fuzzy algorithm to obtain the output result of the word;

[0136] Summarize the output results of each word to get the license plate information of the target electric vehicle.

[0137] Exemplarily, the result output module 203 may also be used for:

[0138] Record the traffic violations of the target electric vehicle.

[0139] Based on the license plate information, obtain the contact information of the license plate registration.

[0140] Based on the contact information, the driver of the target electric vehicle is notified of his or her illegal behavior.

[0141] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0142] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0143] The present application also provides a terminal device, see Figure 3 The terminal device 300 may include: at least one processor 310 and a memory 320, wherein the memory 320 is used to store a computer program 321, and the processor 310 is used to call and run the computer program 321 stored in the memory 320 to implement the steps in any of the above-mentioned method embodiments, for example Figure 1 Steps 101 to 104 in the illustrated embodiment. Alternatively, when the processor 310 executes the computer program, the functions of each module / unit in the above-mentioned device embodiments are implemented, for example Figure 2 The functions of each module are shown.

[0144] Exemplarily, the computer program 321 may be divided into one or more modules / units, one or more modules / units are stored in the memory 320, and are executed by the processor 310 to complete the present application. The one or more modules / units may be a series of computer program segments that can complete specific functions, and the program segments are used to describe the execution process of the computer program in the terminal device 300.

[0145] Those skilled in the art will understand that Figure 3 It is only an example of a terminal device and does not constitute a limitation on the terminal device. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components, such as input and output devices, network access devices, buses, etc.

[0146] The processor 310 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.

[0147] The memory 320 may be an internal storage unit of the terminal device, or an external storage device of the terminal device, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. The memory 320 is used to store the computer program and other programs and data required by the terminal device. The memory 320 may also be used to temporarily store data that has been output or is to be output.

[0148] The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the bus in the drawings of the present application is not limited to only one bus or one type of bus.

[0149] The electric vehicle violation behavior identification method provided in the embodiment of the present application can be applied to terminal devices such as computers, wearable devices, vehicle-mounted devices, tablet computers, laptops, netbooks, etc. The embodiment of the present application does not impose any restrictions on the specific type of terminal devices.

[0150] An embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps in each embodiment of the above-mentioned electric vehicle violation behavior identification method can be implemented.

[0151] An embodiment of the present application provides a computer program product. When the computer program product is run on a mobile terminal, the mobile terminal can implement the steps in each embodiment of the above-mentioned electric vehicle violation behavior identification method when executing the computer program product.

[0152] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device that can carry the computer program code to the camera device / terminal device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electrical carrier signal, telecommunication signal and software distribution medium. For example, a USB flash drive, a mobile hard disk, a disk or an optical disk.

[0153] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0154] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0155] In the embodiments provided in the present application, it should be understood that the disclosed devices / network equipment and methods can be implemented in other ways. For example, the device / network equipment embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0156] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0157] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A method for identifying illegal behavior of electric vehicles, characterized in that: include: Acquire a set of images of the target electric vehicle captured by cameras at two ends of a road, wherein the two ends of the road include a first end of the road and a second end of the road, and the target electric vehicle drives from the first end of the road to the second end of the road; Based on the image set, extract the license plate information of the target electric vehicle, and extract the motion trajectory of the target electric vehicle captured by the camera at the first end of the road and the motion trajectory of the target electric vehicle captured by the camera at the second end of the road, which are recorded as the first motion trajectory and the second motion trajectory respectively; Based on the first motion trajectory, the second motion trajectory, the non-motor vehicle lane area and the license plate information, it is determined whether the target electric vehicle has committed a traffic violation.

2. The electric vehicle violation behavior identification method according to claim 1, characterized in that: Determining whether the target electric vehicle has violated traffic regulations based on the first motion trajectory, the second motion trajectory, the non-motor vehicle lane area, and the license plate information includes: According to the first motion trajectory, predicting the motion trajectory of the target electric vehicle after it leaves the acquisition range of the camera at the first end of the road, recorded as a first predicted motion trajectory; Predicting, based on the second motion trajectory, the motion trajectory of the target electric vehicle before it enters the acquisition range of the camera at the second end of the road, recorded as a second predicted motion trajectory; If the first predicted motion trajectory intersects with the second predicted motion trajectory, the first predicted motion trajectory before the intersection, the second predicted motion trajectory after the intersection, the first motion trajectory and the second motion trajectory are taken to obtain a complete motion trajectory of the target electric vehicle; If the entire motion trajectory is entirely within the non-motor vehicle lane area, it is determined that the target electric vehicle has not committed any illegal behavior; If the complete motion trajectory has a portion outside the non-motor vehicle lane area, it is determined that the target electric vehicle has violated traffic regulations; If the first predicted motion trajectory does not intersect with the second predicted motion trajectory, determining the number of traffic violations that the target electric vehicle has committed within a preset time period based on the license plate information; If the number of traffic violation behaviors occurring within the preset time period exceeds a first threshold, it is determined that the target electric vehicle has committed a traffic violation; If the number of traffic violation behaviors occurring within the preset time period does not exceed the first threshold, it is determined that the target electric vehicle has not committed any traffic violation behaviors.

3. The electric vehicle violation behavior identification method according to claim 2, characterized in that: The method further comprises: If the first predicted motion trajectory does not intersect with the second predicted motion trajectory, determining whether the first predicted motion trajectory and the second predicted motion trajectory are both within the non-motor vehicle lane area; If the first predicted motion trajectory is within the non-motor vehicle lane area, and the second predicted motion trajectory is within the non-motor vehicle lane area, it is determined that the target electric vehicle has not committed any illegal behavior; If any one of the first predicted motion trajectory or the second predicted motion trajectory has a portion outside the non-motor vehicle lane area, and the number of violations within the preset time period does not exceed a first threshold, it is determined that the target electric vehicle has not committed any violation; If any one of the first predicted motion trajectory or the second predicted motion trajectory has a portion outside the non-motor vehicle lane area, and the number of violations within the preset time period exceeds a first threshold, it is determined that the target electric vehicle has violated the traffic rules; If the first predicted motion trajectory has a portion outside the non-motor vehicle lane area, and the second predicted motion trajectory has a portion outside the non-motor vehicle lane area, it is determined that the target electric vehicle has violated traffic regulations.

4. The electric vehicle violation behavior identification method according to claim 2, characterized in that: Predicting, based on the first motion trajectory, a motion trajectory of the target electric vehicle after it leaves the acquisition range of the camera at the first end of the road, recorded as a first predicted motion trajectory, includes: Based on the first motion trajectory, obtaining a motion direction and a motion speed of the target electric vehicle in the first motion trajectory, and based on the motion direction and the motion speed of the target electric vehicle in the first motion trajectory, obtaining the first predicted motion trajectory; The step of predicting the motion trajectory of the target electric vehicle before it enters the acquisition range of the camera at the second end of the road according to the second motion trajectory, recorded as the second predicted motion trajectory, includes: Based on the second motion trajectory, a motion direction and a motion speed of the target electric vehicle in the second motion trajectory are obtained, and based on the motion direction and the motion speed of the target electric vehicle in the second motion trajectory, the second predicted motion trajectory is obtained.

5. The electric vehicle violation behavior identification method according to claim 1, characterized in that: The extracting the motion trajectory of the target electric vehicle captured by the camera at the first end of the road and the motion trajectory of the target electric vehicle captured by the camera at the second end of the road, respectively recorded as the first motion trajectory and the second motion trajectory, includes: Dividing the image set into an image set at a first end of the road and an image set at a second end of the road; Based on the image set at the first end of the road, the target electric vehicle is determined, and the transparency of the images in the image set at the first end of the road is adjusted and overlapped, and the center points of multiple target electric vehicles in the overlapped images are connected to obtain the first motion trajectory; Based on the image set at the second end of the road, the target electric vehicle is determined, and the transparency of the images in the image set at the second end of the road is adjusted and overlapped, and the center points of multiple target electric vehicles in the overlapped images are connected to obtain the second motion trajectory.

6. The electric vehicle violation behavior identification method according to claim 1, characterized in that: Extracting the license plate information of the target electric vehicle based on the image set includes: Respectively obtain the license plate image of the target electric vehicle in each image in the image set to obtain multiple license plate images; Extracting information from the plurality of license plate images in sequence to obtain a plurality of information extraction results; For each word in the license plate information of the target electric vehicle, processing the corresponding word in the plurality of information extraction results based on a fuzzy algorithm to obtain an output result of the word; The output results of each word are summarized to obtain the license plate information of the target electric vehicle.

7. The electric vehicle violation behavior identification method according to claim 1, characterized in that: The method further comprises: Recording the traffic violation of the target electric vehicle; Based on the license plate information, obtaining contact information for registration of the license plate information; The driver of the target electric vehicle is notified of the traffic violation according to the contact information.

8. An electric vehicle violation behavior recognition device, characterized in that: include: An image acquisition module, used to acquire a set of images of a target electric vehicle captured by cameras at two ends of a road, wherein the two ends of the road include a first end of the road and a second end of the road, and the target electric vehicle travels from the first end of the road to the second end of the road; A trajectory confirmation module is used to extract the license plate information of the target electric vehicle based on the image set, and extract the motion trajectory of the target electric vehicle collected by the camera at the first end of the road and the motion trajectory of the target electric vehicle collected by the camera at the second end of the road, which are recorded as the first motion trajectory and the second motion trajectory respectively; A result output module is used to determine whether the target electric vehicle has violated traffic regulations based on the first motion trajectory, the second motion trajectory, the non-motor vehicle lane area and the license plate information.

9. A terminal device, comprising: A processor and a memory, wherein the memory stores a computer program that can be run on the processor, and wherein the processor implements the electric vehicle violation behavior identification method as described in any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method for identifying electric vehicle traffic violation behavior as described in any one of claims 1 to 7 is implemented.

Citation Information

Patent Citations

  • Vehicle violation event detection method and device and electronic device

    CN109784254A

  • Monitoring system and method of non-automatic vehicle illegal driving

    CN110085031A

  • Pedestrian and non-motor vehicle violation detection and tracking method based on video stream

    CN110826508A

  • Intelligent traffic management method and system based on driving vehicle violation recognition

    CN113269042A

  • Non-motor vehicle violation snapshot evidence obtaining device, method and system

    CN114333343A