A vehicle violation identification processing method and device

Abstract

The application discloses a vehicle violation identification processing method, a vehicle violation example library acquisition method, a cloud violation identification processing method, a vehicle violation identification processing device and a vehicle violation identification processing system. The method comprises the following steps: acquiring image information of a vehicle-mounted camera; the vehicle-mounted camera records images of surrounding vehicle driving states; a violation example library is acquired; the violation example library comprises image examples of vehicle violations and violation identification features; the image examples in the violation example library are compared with the vehicle driving state images to determine whether the surrounding vehicles are in violation; if the vehicle driving state image comprises the violation identification features and the similarity between the violation identification features and the image examples exceeds a preset threshold, the current position coordinate information of the vehicle is acquired; and the images acquired by the current vehicle-mounted camera are marked and stored according to the current position coordinate of the vehicle and the information that the corresponding surrounding vehicle driving state is in violation. Through the above scheme, the vehicle moving is utilized to expand the vehicle violation monitoring range.

Description

Technical Field

[0001] This application relates to the field of vehicle violations, and in particular to methods for identifying and processing vehicle violations, methods for obtaining a database of vehicle violation examples, cloud-based methods for identifying and processing violations, vehicle violation identification and processing devices, and vehicle violation identification and processing systems. Background Technology

[0002] Currently, the main method for monitoring traffic violations is to install cameras on roads to monitor and supervise road users through public facilities and equipment. While these cameras are widely distributed, they can only capture violations at fixed locations. Therefore, they cannot monitor road sections without cameras. For example, relatively remote sections of road, and gaps between two fixed cameras, cannot be monitored for violating vehicles.

[0003] Currently, a supplementary method for investigating and handling traffic violations on roads without surveillance is to use handheld camera equipment to select shooting locations, but this is usually not suitable for relatively remote road sections.

[0004] Some vehicles are equipped with cameras that can move around and record the surrounding vehicles. Although the shooting angle may not be the same as the usual shooting angle, it can still record the state of the surrounding vehicles driving on the road.

[0005] Therefore, there is a need for a method that can use vehicle-mounted cameras to identify traffic violations by surrounding vehicles, thereby increasing the monitoring range of vehicles that violate traffic rules. Summary of the Invention

[0006] The purpose of this invention is to provide a method for identifying and processing vehicle traffic violations, a method for obtaining a database of vehicle traffic violation examples, a cloud-based method for identifying and processing traffic violations, a device for identifying and processing vehicle traffic violations, and a system for identifying and processing vehicle traffic violations, thereby solving at least one of the aforementioned technical problems.

[0007] This invention provides the following solution:

[0008] According to one aspect of the present invention, a method for identifying and recording vehicle traffic violations is provided, the method comprising:

[0009] Acquire image information from the vehicle's camera;

[0010] The vehicle-mounted camera records images of the surrounding vehicles' driving status.

[0011] Access the database of traffic violation examples;

[0012] The violation example library includes image examples of vehicle violations and violation recognition features;

[0013] Based on the comparison of the vehicle driving status image with the image examples in the violation example database, it is determined whether the surrounding vehicles are in violation;

[0014] If the vehicle driving status image includes violation recognition features and the similarity to the violation recognition features in the image example exceeds a preset threshold, then the current position coordinate information of the vehicle is obtained.

[0015] Based on the vehicle's current location coordinates and information that surrounding vehicles are in a violation state, the image captured by the vehicle's onboard camera is marked and stored.

[0016] Furthermore, examples of images of vehicle violations include:

[0017] Collect images of vehicles violating traffic rules based on the viewpoint of the vehicle's onboard camera;

[0018] Mark the violation identification features and violation types of images of vehicles committing traffic violations;

[0019] Based on the violation recognition features and violation type of the images of vehicles violating traffic rules, generate examples of vehicle violation images from the perspective of the onboard camera.

[0020] Furthermore, the step of determining whether surrounding vehicles have committed traffic violations by comparing the vehicle driving status image with image examples in the violation example database includes:

[0021] Select from the library of traffic violation examples that share the same viewpoint as your vehicle's onboard camera;

[0022] Based on the violation recognition features of the violation image examples, filter the real-time images obtained by the vehicle camera;

[0023] If a real-time image is identified that is similar to any violation image in the violation example library in terms of violation recognition features, then the image frame of the real-time image is captured and stored in the preset storage address;

[0024] The image frame is marked with the time it was captured and the violation type information corresponding to the violation identification features.

[0025] Furthermore, the step of comparing the vehicle driving status image with image examples in the violation example database to determine whether surrounding vehicles have committed violations also includes:

[0026] Based on the fact that multiple consecutive images in the real-time image have violation recognition features, image frames of the real-time image are continuously extracted;

[0027] Based on continuously captured image frames, a video file recording the violation process is generated;

[0028] Based on the violation identification features corresponding to the video file of the violation process, mark the time when the video file was generated and the violation type information corresponding to the violation identification features.

[0029] According to a second aspect of the present invention, a method for obtaining a traffic violation example database for vehicles is provided, the method comprising:

[0030] Send the vehicle's onboard camera view information to the cloud server;

[0031] The vehicle receives violation example data from the cloud server and updates the local violation example database;

[0032] The violation example database corresponds to the viewpoint of the vehicle-mounted camera.

[0033] Furthermore, it also includes:

[0034] Based on the image information of traffic violations of surrounding vehicles collected and stored by this vehicle, the vehicle sends the image information of the traffic violations and the corresponding image marking information;

[0035] Receive feedback information on whether the judgment result of the vehicle violation in the image is confirmed;

[0036] If the feedback information confirms the judgment result of the vehicle violation in the image, then update the violation example library of this vehicle based on the confirmed vehicle violation image;

[0037] If the feedback information denies the judgment result of the vehicle violation in the image, then the violation examples and violation recognition features in the violation example library of this vehicle are corrected and used to update the violation example library of this vehicle.

[0038] According to three aspects of the present invention, a cloud-based method for identifying and processing traffic violations is provided, wherein the cloud-based method for managing a database of traffic violation examples includes:

[0039] The cloud server receives data from the vehicle and obtains the field of view data from the vehicle camera;

[0040] The cloud server sends the corresponding database of traffic violation examples based on the perspective of the vehicle's camera.

[0041] The violation example library includes image examples of vehicle violations and violation recognition features.

[0042] Furthermore, including:

[0043] The cloud server receives image information and corresponding image tagging information from the vehicle to identify traffic violations by surrounding vehicles.

[0044] The cloud-based system filters the received image information based on violation identification features according to a cloud-based database of violation examples.

[0045] If the violation identification features in the image information are confirmed, the system will provide feedback that the image has been confirmed as a vehicle violation image and report the marking information of the violating vehicle in the image information to the official website of the Transportation Bureau.

[0046] If the violation identification features in the image information are denied, the system will send a message indicating that the image has been denied and send data to the vehicle to correct the violation image example and the corresponding violation identification features.

[0047] According to four aspects of the present invention, a vehicle violation identification and recording device is provided, the vehicle violation identification and recording device comprising:

[0048] The image acquisition module is used to acquire image information from the vehicle-mounted camera, including images of the driving status of surrounding vehicles recorded by the vehicle-mounted camera.

[0049] The violation example library module is used to obtain a violation example library, including image examples of vehicle violations and violation recognition features;

[0050] The violation judgment module is used to compare the vehicle driving status image with the image examples in the violation example library to determine whether the surrounding vehicles are in violation.

[0051] The violation marking module is used to obtain the current location coordinates of the vehicle if the vehicle driving status image includes violation recognition features and the similarity to the violation recognition features in the image example exceeds a preset threshold.

[0052] The violation recording module is used to mark and store the image captured by the on-board camera based on the vehicle's current location coordinates and information on the driving status of surrounding vehicles that are in violation.

[0053] According to five aspects of the present invention, a vehicle violation identification and recording system is provided, the vehicle violation identification and recording system comprising: an on-board module, a cloud module, and a traffic management module;

[0054] The vehicle-mounted module is used to acquire traffic violation image information;

[0055] The cloud module is used to generate examples of violation images;

[0056] The traffic management module is used to deploy violation processing strategies based on the violation situation;

[0057] The cloud module generates a sample image of a traffic violation and sends it to the vehicle-mounted module.

[0058] The vehicle-mounted module receives data from the cloud module and filters images acquired in real time by the vehicle-mounted camera according to examples of traffic violation images;

[0059] If the vehicle module filters out a vehicle camera image that is similar to the identification features of a violation image example, then the image is captured and the vehicle in the image is marked with violation record information.

[0060] The on-board module uploads images that mark vehicle traffic violations to the cloud module;

[0061] The cloud module receives data sent by the vehicle module and sends vehicle information marked with traffic violation records to the traffic management module;

[0062] The traffic management module generates instructions for deploying police forces and equipment to handle violations based on the vehicle information marked with violation records.

[0063] The above solution achieves the following beneficial technical effects:

[0064] This application records images of surrounding vehicles from the perspective of an in-vehicle camera, identifies traffic violations from these images, and expands the scope of monitoring vehicle violations by taking advantage of the large range of vehicle movement.

[0065] This application establishes a database of traffic violation image examples from the perspective of vehicle-mounted cameras, making the criteria for identifying vehicle violations more consistent with the working state of vehicle cameras.

[0066] This application uses an in-vehicle camera to capture information about vehicles violating traffic rules, and then uses a cloud database to further filter and confirm the information, making the determination of violation results more reliable.

[0067] In addition to collecting images to determine traffic violations by surrounding vehicles, this application also records video of the violation process, thus broadening the range of violation types that can be identified.

[0068] This application links vehicle violation information collected from the vehicle with traffic management, making traffic violation processing more timely.

[0069] This application, by labeling the obtained vehicle violation images with information such as the location of collection, the type of violation, the time of collection, and the identity of the violating vehicle, can preserve as complete vehicle violation evidence as possible, making the judgment result more authoritative. Attached Figure Description

[0070] Figure 1 This is a flowchart of a vehicle violation identification and recording method provided by one or more embodiments of the present invention.

[0071] Figure 2 This is a structural diagram of a vehicle violation identification and recording device provided in one or more embodiments of the present invention.

[0072] Figure 3 This is a flowchart of a method for obtaining a database of traffic violation examples for vehicles, provided by one or more embodiments of the present invention.

[0073] Figure 4 This is a flowchart of a cloud-based violation identification and processing method provided by one or more embodiments of the present invention.

[0074] Figure 5This is a structural diagram of a vehicle violation identification and recording system provided by one or more embodiments of the present invention.

[0075] Figure 6 This is a schematic diagram of the structure of a vehicle violation recognition and recording system according to a specific embodiment of the present invention.

[0076] Figure 7 This is a schematic diagram of a vehicle violation recognition and recording system according to a specific embodiment of the present invention.

[0077] Figure 8 This is a block diagram of an electronic device for a vehicle violation identification and recording method provided in one or more embodiments of the present invention. Detailed Implementation

[0078] The technical solution of the present invention will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0079] Figure 1 This is a flowchart of a vehicle violation identification and recording method provided by one or more embodiments of the present invention.

[0080] like Figure 1 As shown, the methods for identifying and recording vehicle traffic violations include:

[0081] Step S1: Acquire image information from the vehicle-mounted camera; the vehicle-mounted camera records images of the surrounding vehicles' driving status.

[0082] Step S2: Obtain the violation example library, which includes image examples of vehicle violations and violation recognition features;

[0083] Step S3: Based on the vehicle driving status image, compare it with the image examples in the violation example database to determine whether the surrounding vehicles are in violation.

[0084] Step S4: If the vehicle driving status image includes violation recognition features and the similarity to the violation recognition features in the image example exceeds a preset threshold, then obtain the current location coordinate information of the vehicle.

[0085] Step S5: Based on the vehicle's current location coordinates and the information that the surrounding vehicles are in a violation status, mark and store the image acquired by the vehicle camera.

[0086] The above solution achieves the following beneficial technical effects:

[0087] This application records images of surrounding vehicles from the perspective of an in-vehicle camera, identifies traffic violations from these images, and expands the scope of monitoring vehicle violations by taking advantage of the large range of vehicle movement.

[0088] This application establishes a database of traffic violation image examples from the perspective of vehicle-mounted cameras, making the criteria for identifying vehicle violations more consistent with the working state of vehicle cameras.

[0089] This application uses an in-vehicle camera to capture information about vehicles violating traffic rules, and then uses a cloud database to further filter and confirm the information, making the determination of violation results more reliable.

[0090] In addition to collecting images to determine traffic violations by surrounding vehicles, this application also records video of the violation process, thus broadening the range of violation types that can be identified.

[0091] This application links vehicle violation information collected from the vehicle with traffic management, making traffic violation processing more timely.

[0092] This application, by labeling the obtained vehicle violation images with information such as the location of collection, the type of violation, the time of collection, and the identity of the violating vehicle, can preserve as complete vehicle violation evidence as possible, making the judgment result more authoritative.

[0093] Specifically, traffic violations typically occur on roads where vehicles can travel, but existing cameras used to record these violations are relatively fixed. Even temporary cameras only capture images of specific road sections or intersections, which, while serving a purpose of segmented traffic management, still has limitations. Many traffic violations and the dangers they cause occur in interactions with other vehicles; therefore, preventing traffic violations when two vehicles are in close proximity is essential. Vehicle-mounted cameras that follow the vehicle's movement can capture images of surrounding vehicles, effectively compensating for the need to prevent other vehicles' violations from posing a threat to the vehicle in question.

[0094] A database of image recognition examples and an image recognition mechanism can be pre-set for vehicles. Using images obtained from in-vehicle cameras, images of surrounding vehicles violating traffic rules can be filtered out, and evidence of their violations can be secured.

[0095] During the image filtering process, once a vehicle is found to have committed a traffic violation, such as crossing a solid line, changing lanes continuously, or not using turn signals, the vehicle's current location information is marked on the image file identified as a "violation," and a dedicated storage space is set up for backup storage of such images.

[0096] In addition to identifying the violation status of surrounding vehicles, it also includes identifying the vehicle's identity (license plate) and annotating the identified license plate information on the "violation" image file, thus effectively securing evidence of other vehicles' violations.

[0097] In this embodiment, examples of vehicle traffic violations include:

[0098] Collect images of vehicles violating traffic rules based on the viewpoint of the vehicle's onboard camera;

[0099] Mark the violation identification features and violation types of images of vehicles committing traffic violations;

[0100] Based on the violation recognition features and violation type of the images of vehicles violating traffic rules, generate examples of vehicle violation images from the perspective of the onboard camera.

[0101] Specifically, existing vehicle-mounted cameras may not have been originally intended solely for determining traffic violations by other vehicles, and their uses vary widely. For example, there are cameras positioned at the rear of the vehicle to film backwards, cameras positioned in the rearview mirror to view the front and rear wheels, and cameras inside the vehicle to identify occupants; some are on trucks, some on cars. Compared to existing fixed cameras that capture traffic violations, the visual perspective of a vehicle's onboard cameras—capturing a violation from a third-party viewpoint, or a violation between two vehicles—is significantly different.

[0102] Furthermore, since this vehicle and other vehicles are constantly in motion, their relative positions are dynamically changing. Therefore, a database of traffic violation examples needs to be established based on the perspective of the vehicle-mounted camera. Image recognition technology includes techniques for identifying the same object from different angles. Image examples matching the shooting angle of the vehicle-mounted camera can be selected from the database, and their recognition features extracted to create a traffic violation example library. The violation image examples in the library correspond to the location and shooting angle of the vehicle-mounted camera. This design can improve the recognition efficiency and accuracy of the vehicle-mounted camera.

[0103] Violation types can be distinguished based on their identification features. For example, a rear camera can capture the distance between the front wheels of a vehicle behind and a solid line to determine if the vehicle behind has crossed the solid line. Similarly, a front camera can capture the distance between the rear wheels of a vehicle in front and a solid line to determine if the vehicle in front has crossed the solid line.

[0104] Besides directly collecting images from the corresponding shooting angles of vehicle-mounted cameras to build an image example database, "distortion" processing can also be applied to images in some existing image databases. For example, some cameras use "fisheye" type cameras to widen the field of view, resulting in "distortion" differences compared to ordinary images. Images in ordinary image databases can be "distorted" into image types similar to those from "fisheye" cameras, and then compared using violation recognition features. Alternatively, images captured by "fisheye" cameras can be "distorted" towards normal images, and then compared with image examples in the database for violation recognition features.

[0105] In this embodiment, determining whether surrounding vehicles have committed traffic violations by comparing vehicle driving status images with image examples in the violation example database includes:

[0106] Select from the library of traffic violation examples that share the same viewpoint as your vehicle's onboard camera;

[0107] Based on the violation recognition features of the violation image examples, filter the real-time images obtained by the vehicle camera;

[0108] If a real-time image is identified that is similar to any violation image in the violation example library in terms of violation recognition features, then the image frame of the real-time image is captured and stored in the preset storage address;

[0109] The image frame is marked with the time it was captured and the violation type information corresponding to the violation identification features.

[0110] Specifically, because vehicles are dynamically moving, multiple image examples are needed to determine the same type of violation, to account for changes in image quality due to changes in vehicle position. This reduces situations where violation recognition features are "unclear" due to changes in vehicle position. For example, a left-side camera can identify a vehicle's right wheel crossing a solid line, while a right-side camera can identify it's the left wheel. However, directly using an image example prepared for the left-side camera in the right-side camera's judgment of a vehicle crossing a solid line could lead to "unclear" violation recognition features. Therefore, multiple image examples are needed for each type of violation. As long as one image example is successfully recognized and compared, the vehicle's violation status can be determined.

[0111] In this embodiment, determining whether surrounding vehicles have committed traffic violations by comparing vehicle driving status images with image examples in the violation example database further includes:

[0112] Based on the fact that multiple consecutive images in a real-time image have violation recognition features, image frames of the real-time image are continuously extracted;

[0113] Based on continuously captured image frames, a video file recording the violation process is generated;

[0114] Based on the violation identification features corresponding to the video file of the violation process, mark the time when the video file was generated and the violation type information corresponding to the violation identification features.

[0115] Specifically, some types of violations can be identified using a single image, such as a vehicle crossing a solid line. Image frames showing a vehicle crossing a solid line can be extracted from real-time images, processed, and tagged with the time of extraction and the type of violation (including the GPS coordinates of the vehicle at the time of acquisition, the license plate of the other vehicle, etc.). These violations can then be categorized and stored according to the type of violation involving a vehicle crossing a solid line.

[0116] Some types of traffic violations require identification using video footage composed of multiple images, such as continuous lane changing violations. This requires the vehicle to cross multiple lanes from one lane as evidence of a violation. The violation image examples used when judging continuous lane changes are also a series of consecutive images; the extracted violation recognition features are not concentrated on a single image but distributed across multiple images. For example, the violation recognition features for crossing the first lane and crossing the second and third lanes can be restricted to occurring within a single data collection period. If the violation recognition features for crossing the first lane and crossing the second and third lanes are continuously identified within a preset time period, then the violation features can be classified as continuous lane changing violations.

[0117] Figure 3 This is a flowchart of a method for obtaining a database of traffic violation examples for vehicles, provided by one or more embodiments of the present invention.

[0118] like Figure 3 As shown, the methods for obtaining the traffic violation example database for vehicles include:

[0119] Step S11: Send the vehicle's onboard camera view information to the cloud server;

[0120] Step S12: The vehicle receives violation example database data from the cloud server and updates the local violation example database.

[0121] Step S13, wherein the violation example database data corresponds to the viewpoint of the vehicle camera.

[0122] Specifically, this vehicle acts as a data acquisition terminal, comparing the acquired images with image examples in the local violation example database to identify vehicle violation information in the real-time acquired images.

[0123] The system can first send the vehicle's onboard camera view information to the cloud server to obtain a database of traffic violation examples corresponding to that view, and then perform violation recognition. The local violation example database is updated using the data from the cloud server's database. The cloud server's database of violation examples is specifically designed for the vehicle's onboard camera view.

[0124] Due to differences in vehicle shape, the installation height and position of onboard cameras vary, resulting in variations in the characteristics of traffic violations detected during image recognition. Continuously updating the local violation example database can improve the vehicle's ability to identify violations.

[0125] In this embodiment, it also includes:

[0126] Based on the image information of traffic violations of surrounding vehicles collected and stored by this vehicle, the vehicle sends the image information of the traffic violations and the corresponding image marking information;

[0127] Receive feedback information on whether the judgment result of the vehicle violation in the image is confirmed;

[0128] If the feedback information confirms the judgment result of the vehicle violation in the image, then update the violation example library of this vehicle based on the confirmed vehicle violation image;

[0129] If the feedback information denies the judgment result of the vehicle violation in the image, then the violation examples and violation recognition features in the violation example library of this vehicle are corrected and used to update the violation example library of this vehicle.

[0130] Specifically, the vehicle stores images with violation marks (indicating a violation) and sends them to a cloud server. The cloud server then further evaluates the images, providing either a positive or negative response. If the vehicle's accuracy in identifying violations is high, the recorded violation images can be used to enrich its violation example database. If the accuracy is low, the violation example database in the cloud can be used to update and correct the vehicle's violation example database.

[0131] The images used to identify traffic violations by this vehicle with a high accuracy rate are adapted to the camera shooting conditions of this vehicle. Therefore, using these images to update the traffic violation example database is a feasible method.

[0132] It cannot be ruled out that, with the development of vehicle models and the enrichment of data, the original violation examples may become insufficient in terms of violation recognition capabilities. This could be addressed by continuously updating the violation examples or the violation characteristics of the examples to maintain a high level of violation recognition capability for the vehicle.

[0133] Figure 4 This is a flowchart of a cloud-based violation identification and processing method provided by one or more embodiments of the present invention.

[0134] like Figure 4 As shown, the cloud-based methods for identifying and processing traffic violations include:

[0135] Step S21: The cloud server receives data from the vehicle and obtains the field of view data information of the vehicle camera;

[0136] In step S22, the cloud server sends the corresponding violation example library based on the perspective of the vehicle camera. The violation example library includes image examples of vehicle violations and violation recognition features.

[0137] Specifically, the cloud server has a rich database with numerous pre-set violation example libraries for different vehicle models or types of in-vehicle cameras. By collecting vehicle in-vehicle camera angle data and matching it with the corresponding violation example library, the vehicle can accurately identify whether surrounding vehicles are violating traffic rules.

[0138] The field of view of a vehicle camera depends on two factors. First, the camera's placement. For example, on a tall truck, the camera can be mounted high to overlook nearby vehicles. Second, it depends on the camera's intended purpose. For instance, a camera mounted on a rearview mirror is originally intended to observe the side of the front wheels, but its narrow field of view only allows it to capture and identify whether the rear wheels of vehicles in front of it are crossing the line.

[0139] For different vehicle cameras, corresponding image examples and violation recognition features are set.

[0140] In this embodiment, it includes:

[0141] The cloud server receives image information and corresponding image tagging information from the vehicle to identify traffic violations by surrounding vehicles.

[0142] The cloud-based system filters the received image information based on violation identification features according to a cloud-based database of violation examples.

[0143] If the violation identification features in the image information are confirmed, the system will provide feedback that the image has been confirmed as a vehicle violation image and report the marking information of the violating vehicle in the image information to the official website of the Transportation Bureau.

[0144] If the violation identification features in the image information are denied, the system will send a message indicating that the image has been denied and send data to the vehicle to correct the violation image example and the corresponding violation identification features.

[0145] Specifically, cloud servers can collect a large number of traffic violation examples from the same perspective as a particular type of vehicle, which is much richer than a database of data for a single vehicle. Based on this large collection of violation examples from the same perspective, the violation recognition features can be continuously iterated. By judging images of suspected violations uploaded by vehicles through the cloud server, it is possible to understand whether there are other vehicles violating traffic rules around the vehicle that uploaded the data, and also to determine if the vehicle's violation recognition capabilities are insufficient.

[0146] The system can provide feedback to vehicles regarding the accuracy of submitted traffic violation identification results. If flaws are found in the submitted violation judgment results, updated data from the cloud-based violation example database can be sent to improve the vehicle's judgment capabilities.

[0147] The traffic bureau's official website can directly implement control measures based on information about vehicles that have violated traffic rules. These measures include broadcasting, public announcements, and location tracking to monitor and process the violations.

[0148] Figure 2 This is a structural diagram of a vehicle violation identification and recording device provided in one or more embodiments of the present invention.

[0149] like Figure 2As shown, the vehicle violation recognition and recording device includes: an image acquisition module, a violation example library module, a violation judgment module, a violation marking module, and a violation recording module;

[0150] The image acquisition module is used to acquire image information from the vehicle-mounted camera, including images of the surrounding vehicles' driving status recorded by the vehicle-mounted camera.

[0151] The violation example library module is used to obtain a violation example library, including image examples of vehicle violations and violation recognition features;

[0152] The violation judgment module is used to compare the vehicle driving status image with the image examples in the violation example library to determine whether the surrounding vehicles are in violation.

[0153] The violation marking module is used to obtain the current location coordinates of the vehicle if the vehicle driving status image includes violation recognition features and the similarity with the violation recognition features in the image example exceeds a preset threshold.

[0154] The traffic violation recording module is used to mark and store the images captured by the on-board camera based on the vehicle's current location coordinates and information on the driving status of surrounding vehicles that are in violation.

[0155] It is worth noting that although this system only discloses the image acquisition module, the violation demonstration library module, the violation judgment module, the violation marking module, and the violation recording module, it does not mean that this device is limited to the above-mentioned basic functional modules. On the contrary, what this invention intends to express is that, based on the above-mentioned basic functional modules, those skilled in the art can arbitrarily add one or more functional modules in combination with existing technology to form an infinite number of embodiments or technical solutions. That is to say, this system is open rather than closed. It should not be assumed that the scope of protection of the claims of this invention is limited to the above-disclosed basic functional modules just because this embodiment only discloses a few basic functional modules.

[0156] Figure 5 This is a structural diagram of a vehicle violation identification and recording system provided by one or more embodiments of the present invention.

[0157] like Figure 5 As shown, the vehicle violation recognition and recording system includes: an on-board module, a cloud module, and a traffic management module;

[0158] The vehicle-mounted module is used to acquire images of traffic violations.

[0159] A cloud-based module for generating example images of traffic violations;

[0160] The traffic management module is used to deploy violation processing strategies based on the nature of the violation.

[0161] The cloud module generates sample images of traffic violations and sends them to the vehicle-mounted module.

[0162] The vehicle-mounted module receives data from the cloud module and filters the images acquired in real time by the vehicle-mounted camera based on examples of traffic violation images;

[0163] If the vehicle module filters out an image from a vehicle camera that is similar to the characteristics of a violation image example, it will capture the image and mark the vehicle in the image with violation record information.

[0164] The onboard module uploads images marked with vehicle traffic violation records to the cloud module;

[0165] The cloud module receives data sent by the vehicle module and sends vehicle information marked with traffic violations to the traffic management module;

[0166] The traffic management module generates instructions for deploying police forces and equipment to handle violations based on the vehicle information marked with violation records.

[0167] Specifically, the cloud module can summarize violation image examples and violation recognition features based on violation image data from multiple vehicle-mounted modules (vehicle-mounted cameras), forming an example database. The vehicle-mounted modules, through practice, use these violation image examples to compare with continuously collected real-time images to determine if other vehicles in the image are also violating regulations. The traffic management module is linked to the vehicle violation determination; if a vehicle violation is detected, control measures are taken according to the vehicle's marking record. The marking record information includes the vehicle's license plate, the type of violation, the road segment where the violation occurred, and the time of the violation.

[0168] The traffic management module is typically closer to the human operator, allowing for further verification of uploaded violations to determine their suitability. This can be achieved through manual review of violation determination documents or by responding to driver feedback, enabling manual correction of existing cloud-based example databases and fine-tuning of identification features. It's also possible that changes to traffic regulations or modifications to existing violation criteria could require the traffic management module to send targeted updates to the cloud-based database, modifying the examples and violation identification features. Furthermore, the cloud-based module can update the onboard module to maintain the accuracy of the vehicle's collection of violations from surrounding vehicles.

[0169] Figure 6 This is a schematic diagram of the structure of a vehicle violation recognition and recording system according to a specific embodiment of the present invention.

[0170] Figure 7 This is a schematic diagram of a vehicle violation recognition and recording system according to a specific embodiment of the present invention.

[0171] like Figure 6 , 7As shown, the vehicle-mounted camera records images of the area around the vehicle. The image recognition module identifies the vehicles within these images. If the vehicle violation recognition module detects violations, indicating a traffic violation, the image containing the violation is cropped. The location of the traffic violation is marked by the vehicle navigation module and sent to the cloud module. The cloud module stores the traffic violation images from the vehicle, filters those confirmed in the cloud database, and uploads them, along with the offending vehicle's location data and vehicle identification data, to the traffic management bureau's official website.

[0172] Once the vehicle starts moving, it begins recording its driving footage. During the journey, the video recognition module continuously identifies other vehicles in the video feed, recognizing their positions and trajectories. Combining this with current location information and environmental data, the traffic violation decision-making module determines whether a vehicle in the video has violated traffic rules, such as running a red light, crossing a line, or driving in a non-motorized vehicle lane or emergency lane. If a traffic violation is determined, the video processing module extracts the corresponding video segment and uploads it, along with the road location information, to a cloud server. The cloud server then uploads the video and related information to the traffic management bureau for traffic violation reporting.

[0173] Figure 8 This is a block diagram of an electronic device for a vehicle violation identification and recording method provided in one or more embodiments of the present invention.

[0174] like Figure 8 As shown, this application provides an electronic device, including: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus;

[0175] The memory stores a computer program that, when executed by a processor, causes the processor to perform steps of a method for identifying and recording vehicle violations.

[0176] This application also provides a computer-readable storage medium storing a computer program executable by an electronic device, which, when run on the electronic device, causes the electronic device to perform the steps of a vehicle violation identification and recording method.

[0177] This application also provides a vehicle, including:

[0178] Electronic equipment, used to implement methods for identifying and recording vehicle violations;

[0179] The processor runs a program that, when running, executes the steps of a vehicle violation identification and recording method based on data output from electronic devices.

[0180] Storage medium for storing programs that, when running, execute steps of a vehicle violation identification and recording method based on data output from an electronic device.

[0181] The communication bus mentioned in the above electronic devices can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. This communication bus can be divided into address bus, data bus, control bus, etc. For ease of illustration, only one thick line is used to represent it in the diagram, but this does not mean that there is only one bus or one type of bus.

[0182] The electronic device comprises a hardware layer, an operating system layer running on top of the hardware layer, and an application layer running on the operating system. The hardware layer includes hardware such as a central processing unit (CPU), a memory management unit (MMU), and memory. The operating system can be any one or more computer operating systems that control the electronic device through processes, such as Linux, Unix, Android, iOS, or Windows. Furthermore, in this embodiment of the invention, the electronic device can be a smartphone, tablet computer, or other handheld device, or a desktop computer, portable computer, or other electronic device; there is no particular limitation in this embodiment.

[0183] In this embodiment of the invention, the executing entity for electronic device control can be an electronic device itself, or a functional module within an electronic device capable of calling and executing a program. The electronic device can obtain the firmware corresponding to the storage medium. This firmware is provided by the supplier, and different storage media may have the same or different firmware; no limitation is made here. After obtaining the firmware corresponding to the storage medium, the electronic device can write this firmware into the storage medium; specifically, it burns the firmware corresponding to the storage medium into the storage medium. The process of burning the firmware into the storage medium can be implemented using existing technology, and will not be elaborated upon in this embodiment of the invention.

[0184] Electronic devices can also obtain reset commands corresponding to storage media. These reset commands are provided by the supplier, and the reset commands for different storage media can be the same or different, which is not limited here.

[0185] At this time, the storage medium of the electronic device is a storage medium on which the corresponding firmware has been written. The electronic device can respond to the reset command corresponding to the storage medium on which the corresponding firmware has been written, thereby resetting the storage medium on which the corresponding firmware has been written according to the reset command. The process of resetting the storage medium according to the reset command can be implemented by existing technology and will not be described in detail in this embodiment of the invention.

[0186] For ease of description, the above devices are described separately by function as various units and modules. Of course, in implementing this application, the functions of each unit and module can be implemented in one or more software and / or hardware.

[0187] It will be understood by those skilled in the art that, unless otherwise defined, all terms used herein (including technical and scientific terms) have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. It should also be understood that terms such as those defined in general dictionaries should be understood to have the meaning consistent with their meaning in the context of the prior art, and should not be interpreted in an idealized or overly formal sense unless specifically defined.

[0188] For the sake of simplicity, the method embodiments are described as a series of actions. However, those skilled in the art should understand that the embodiments of the present invention are not limited to the described order of actions, because according to the embodiments of the present invention, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions involved are not necessarily essential to the embodiments of the present invention.

[0189] As can be seen from the above description of the embodiments, those skilled in the art can clearly understand that this application can be implemented by means of software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of this application.

[0190] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for identifying and recording vehicle traffic violations, characterized in that, The method for identifying and recording vehicle violations includes: Acquire image information from the vehicle's camera; The vehicle-mounted camera records images of the driving status of surrounding vehicles. Access the database of traffic violation examples; The violation example library includes image examples of vehicle violations and violation recognition features; Examples of images of vehicle violations include: Collect images of vehicles violating traffic rules based on the viewpoint of the vehicle's onboard camera; Mark the violation identification features and violation types of images of vehicles committing traffic violations; Based on the violation recognition features and violation type of the images of vehicles violating traffic rules, vehicle violation image examples corresponding to the perspective of the vehicle camera are generated. The violation example library is a library of vehicle violation image examples corresponding to the perspective of the vehicle camera. It also includes distortion processing of the real-time images acquired by the vehicle-mounted camera; the distortion processing is as follows: if the vehicle-mounted camera is a "fisheye" type camera, the acquired image is distorted to a normal image; if it is a regular camera, the acquired image is distorted to an image type similar to that of a "fisheye" type camera. Select the violation example library from the same viewpoint of the vehicle's onboard camera, and compare the image of the vehicle's driving status with the image examples in the violation example library to determine whether the surrounding vehicles are in violation. If the vehicle driving status image includes violation recognition features and the similarity to the violation recognition features in the image example exceeds a preset threshold, then the current position coordinate information of the vehicle is obtained. If multiple consecutive images in the real-time image have violation identification features, then image frames of the real-time image are continuously captured; based on the continuously captured image frames, a video file recording the violation process is generated; based on the violation identification features corresponding to the video file of the violation process, the time of video file generation and the violation type information of the corresponding violation identification features are marked. Based on the vehicle's current location coordinates and the information that the surrounding vehicles are in a violation state, the images captured by the vehicle camera are marked and stored, along with the captured image frames or generated video files. The marking information includes the time of capturing the image frame, the time of generating the video file, and the violation type information corresponding to the violation identification features.

2. The vehicle violation identification and recording method according to claim 1, characterized in that, The step of comparing the vehicle driving status image with image examples in the violation example database to determine whether surrounding vehicles are in violation includes: Select from the library of traffic violation examples that share the same viewpoint as your vehicle's onboard camera; Based on the violation recognition features of the violation image examples, filter the real-time images obtained by the vehicle camera; If a real-time image is identified that is similar to any violation image in the violation example library in terms of violation recognition features, then the image frame of the real-time image is captured and stored in the preset storage address; The image frame is marked with the time it was captured and the violation type information corresponding to the violation identification features.

3. A method for obtaining a database of traffic violation examples for vehicles, characterized in that, Based on the vehicle violation identification and recording method according to any one of claims 1 or 2, the method for obtaining a vehicle violation example database includes: Send the vehicle's onboard camera perspective information to the cloud server. The perspective information includes the camera's installation position and shooting angle. The vehicle receives violation example data from the cloud server and updates the local violation example database; The violation example database corresponds to the viewpoint of the vehicle-mounted camera.

4. The method for obtaining a vehicle violation example database according to claim 3, characterized in that, Also includes: Based on the image information of traffic violations of surrounding vehicles collected and stored by this vehicle, the vehicle sends the image information of the traffic violations and the corresponding image marking information; Receive feedback information on whether the judgment result of the vehicle violation in the image is confirmed; If the feedback information confirms the judgment result of the vehicle violation in the image, then update the violation example library of this vehicle based on the confirmed vehicle violation image; If the feedback information denies the judgment result of the vehicle violation in the image, then the violation examples and violation recognition features in the violation example library of this vehicle are corrected and used to update the violation example library of this vehicle.

5. A method for managing a cloud-based database of violation examples, characterized in that, Based on the method for obtaining a traffic violation example database for vehicles as described in claim 3 or 4, the cloud-based method for managing the traffic violation example database includes: The cloud server receives data from the vehicle and obtains the field of view data information of the vehicle camera, including the camera installation position and shooting angle. The cloud server sends the corresponding database of traffic violation examples based on the perspective of the vehicle's camera. The violation example library includes image examples of vehicle violations and violation recognition features.

6. The cloud-based method for managing a database of traffic violation examples according to claim 5, characterized in that, include: The cloud server receives image information and corresponding image tagging information from the vehicle to identify traffic violations by surrounding vehicles. The cloud-based system filters the received image information based on violation identification features according to a cloud-based database of violation examples. If the violation identification features in the image information are confirmed, the system will provide feedback that the image has been confirmed as a vehicle violation image and report the marking information of the violating vehicle in the image information to the official website of the Transportation Bureau. If the violation identification features in the image information are denied, the system will send a message indicating that the image has been denied and send data to the vehicle to correct the violation image example and the corresponding violation identification features.

7. A vehicle violation identification and recording device, characterized in that, The vehicle violation identification and recording device includes: The image acquisition module is used to acquire image information from the vehicle-mounted camera, including images of the driving status of surrounding vehicles recorded by the vehicle-mounted camera. The violation example library module is used to obtain a violation example library, including image examples of vehicle violations and violation recognition features; Examples of images of vehicle violations include: Collect images of vehicles violating traffic rules based on the viewpoint of the vehicle's onboard camera; Mark the violation identification features and violation types of images of vehicles committing traffic violations; Based on the violation recognition features and violation type of the images of vehicles violating traffic rules, vehicle violation image examples corresponding to the perspective of the vehicle camera are generated. The violation example library is a library of vehicle violation image examples corresponding to the perspective of the vehicle camera. It also includes distortion processing of the real-time images acquired by the vehicle-mounted camera; the distortion processing is as follows: if the vehicle-mounted camera is a "fisheye" type camera, the acquired image is distorted to a normal image; if it is a regular camera, the acquired image is distorted to an image type similar to that of a "fisheye" type camera. The violation judgment module is used to compare the vehicle driving status image with the image examples in the violation example library to determine whether the surrounding vehicles are violating the rules; wherein, the violation example library is selected from the same viewpoint of the vehicle's onboard camera. The violation marking module is used to obtain the current position coordinates of the vehicle if the vehicle driving status image includes violation recognition features and the similarity to the violation recognition features in the image example exceeds a preset threshold; it also includes continuously capturing image frames from the real-time image if multiple consecutive images in the real-time image have violation recognition features; generating a video file recording the violation process based on the continuously captured image frames; and marking the time of video file generation and the violation type information of the corresponding violation recognition features based on the violation recognition features corresponding to the video file of the violation process. The violation recording module is used to mark and store the image acquired by the vehicle camera based on the vehicle's current location coordinates and information on the driving status of surrounding vehicles that are in violation, along with the captured image frames or generated video files. The marking information includes the time of capturing the image frame, the time of generating the video file, and the violation type information corresponding to the violation identification features.

8. A vehicle violation identification and recording system, characterized in that, Based on the method for obtaining a traffic violation example library for vehicles according to claim 3 or 4, the vehicle traffic violation identification and recording system includes: an on-board module, a cloud module, and a traffic management module; The vehicle-mounted module is used to acquire violation image information and perform distortion processing on the real-time image. The distortion processing is as follows: if the vehicle-mounted camera is a "fisheye" type camera, the acquired image is distorted to a normal image; if it is a regular camera, the acquired image is distorted to an image type similar to that of a "fisheye" type camera. The cloud module is used to generate examples of traffic violation images from the perspective of the vehicle-mounted camera. The traffic management module is used to deploy violation processing strategies based on the violation situation; The cloud module generates a sample image of a traffic violation and sends it to the vehicle-mounted module. The vehicle-mounted module receives data from the cloud module and filters images acquired in real time by the vehicle-mounted camera according to examples of traffic violation images; If the vehicle module filters out a vehicle camera image that is similar to the identification features of a violation image example, then the image is captured. If multiple consecutive images have violation identification features, then a video file recording the violation process is generated, and violation record information is marked on the vehicles in the images. The vehicle-mounted module uploads image or video files that mark vehicle traffic violations to the cloud module; The cloud module receives data sent by the vehicle module and sends vehicle information marked with traffic violation records to the traffic management module; The traffic management module generates instructions for deploying police forces and equipment to handle violations based on the vehicle information marked with violation records.

Images