Video processing method and device, vehicle and storage medium
The video data is detected through sensors inside and outside the vehicle, and suspected violations are determined and saved, which solves the problem that the vehicle cannot appeal due to misjudgment during driving, and achieves effective support for violation complaints.
Patent Information
- Application Number
- CN202510161512.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-13
- Publication Date
- 2025-05-13
AI Technical Summary
Traffic violations may occur during the vehicle, especially those of non-drivers' subjective intentions, which leads to the inability of electronic police to take accurate photos, resulting in misjudgment of violation judgments and the inability to appeal.
The video data detected by sensors inside and outside the vehicle are determined separately whether there is a suspected violation. If it exists, the relevant video data will be saved so that the appeal will be made in the future.
It effectively avoids the problem of inability to appeal caused by misjudgment, provides evidence-supported complaint process, and improves vehicle use efficiency.
Smart Images
Figure CN119992835A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of vehicle technology, and in particular to a video processing method, device, vehicle and storage medium. Background Art
[0002] When vehicles are driving, they are bound to commit traffic violations. Some of these violations are not the driver's subjective intention. For example, if there is a faulty vehicle at the traffic light ahead and the vehicle needs to cross the solid line to change lanes, the electronic police may not be able to capture the entire process, resulting in an incorrect judgment of the violation.
[0003] Therefore, in the above situation, there is a technical problem of misjudgment of the violation and inability to appeal. Summary of the invention
[0004] The embodiments of the present application provide a video processing method, device, vehicle and storage medium to solve the technical problem that a complaint cannot be filed when a vehicle is misjudged to have violated a traffic rule.
[0005] In a first aspect, an embodiment of the present application provides a video processing method, including:
[0006] Acquire first video data detected by a vehicle sensor, wherein the first video data includes: in-vehicle video data and / or out-vehicle video data;
[0007] Based on the user behavior data in the in-vehicle video data, determining whether there is a first suspected violation of traffic rules inside the vehicle; and / or,
[0008] Determining whether there is a second suspected violation of traffic rules during driving of the vehicle based on driving data and traffic data in the off-vehicle video data;
[0009] If the first suspected traffic violation and / or the second suspected traffic violation exists, second video data related to the suspected traffic violation is saved from the first video data.
[0010] In a possible implementation manner, the saving of second video data related to the suspected traffic violation from the first video data includes:
[0011] Determine a first timestamp of a suspected traffic violation occurring in the first video data;
[0012] The first video data within a preset time period before and after the first timestamp is used as the second video data and saved.
[0013] In a possible implementation, the user behavior data includes: at least one of a clothing image and a hair image of the driver, and a seat belt image;
[0014] Accordingly, determining whether there is a first suspected traffic violation inside the vehicle based on the user behavior data in the in-vehicle video data includes:
[0015] If at least one of the clothing image and the hair image blocks the seat belt image, determining that the first suspected violation exists inside the vehicle;
[0016] If at least one of the clothing image and the hair image is similar in color and / or material to the seat belt image, it is determined that the first suspected violation exists inside the vehicle.
[0017] In a possible implementation, the user behavior data includes: a hand image and a head image of the driver;
[0018] Accordingly, determining whether there is a first suspected traffic violation inside the vehicle based on the user behavior data in the in-vehicle video data includes:
[0019] If the hand image and the head image overlap, it is determined that the first suspected violation exists inside the vehicle.
[0020] In a possible implementation, the driving data includes: the vehicle changing lanes in a solid line;
[0021] Accordingly, determining whether there is a second suspected violation of traffic rules while the vehicle is traveling based on the driving data and traffic data in the off-vehicle video data includes:
[0022] If the vehicle changes lanes in a solid line and the traffic data indicates that there is a faulty vehicle and / or a special operation vehicle in front of the vehicle, it is determined that the second suspected violation occurs during the driving of the vehicle.
[0023] In a possible implementation manner, the driving data includes: the vehicle driving through a red light intersection;
[0024] Accordingly, determining whether there is a second suspected violation of traffic rules while the vehicle is traveling based on the driving data and traffic data in the off-vehicle video data includes:
[0025] If the vehicle passes a red light intersection and the traffic data indicates that there is a traffic police officer in front of the vehicle, it is determined that the second suspected violation occurs during the driving of the vehicle;
[0026] If the vehicle passes a red light intersection and the traffic data indicates a traffic light failure, it is determined that the second suspected violation occurs during the driving of the vehicle.
[0027] In a possible implementation manner, the acquiring first video data detected by a vehicle sensor includes:
[0028] In response to a user turning on a violation recording function, acquiring first video data detected by the vehicle sensor;
[0029] Accordingly, the method further includes:
[0030] In response to the user turning off the violation recording function, the acquisition of the first video data detected by the vehicle sensor is stopped.
[0031] In a second aspect, an embodiment of the present application provides a video processing device, including:
[0032] An acquisition module, configured to acquire first video data detected by a vehicle sensor, wherein the first video data includes: in-vehicle video data and / or out-vehicle video data;
[0033] A first determination module is configured to determine whether there is a first suspected violation of traffic rules inside the vehicle based on user behavior data in the in-vehicle video data; and / or,
[0034] A second determination module is used to determine whether there is a second suspected violation of traffic rules during the driving of the vehicle based on the driving data and traffic data in the off-vehicle video data;
[0035] A processing module is used for saving second video data related to the suspected traffic violation from the first video data if the first suspected traffic violation and / or the second suspected traffic violation exists.
[0036] In a possible implementation manner, the processing module saves second video data related to the suspected traffic violation from the first video data, specifically for:
[0037] Determine a first timestamp of a suspected traffic violation occurring in the first video data;
[0038] The first video data within a preset time period before and after the first timestamp is used as the second video data and saved.
[0039] In a possible implementation, the user behavior data includes: at least one of a clothing image and a hair image of the driver, and a seat belt image;
[0040] Accordingly, the first determining module is specifically configured to:
[0041] If at least one of the clothing image and the hair image blocks the seat belt image, determining that the first suspected violation exists inside the vehicle;
[0042] If at least one of the clothing image and the hair image is similar in color and / or material to the seat belt image, it is determined that the first suspected violation exists inside the vehicle.
[0043] In a possible implementation, the user behavior data includes: a hand image and a head image of the driver;
[0044] Accordingly, the first determining module is specifically configured to:
[0045] If the hand image and the head image overlap, it is determined that the first suspected violation exists inside the vehicle.
[0046] In a possible implementation, the driving data includes: the vehicle changing lanes in a solid line;
[0047] Accordingly, the second determination module is specifically used for:
[0048] If the vehicle changes lanes in a solid line and the traffic data indicates that there is a faulty vehicle and / or a special operation vehicle in front of the vehicle, it is determined that the second suspected violation occurs during the driving of the vehicle.
[0049] In a possible implementation manner, the driving data includes: the vehicle driving through a red light intersection;
[0050] Accordingly, the second determination module is specifically used for:
[0051] If the vehicle passes a red light intersection and the traffic data indicates that there is a traffic police officer in front of the vehicle, it is determined that the second suspected violation occurs during the driving of the vehicle;
[0052] If the vehicle passes a red light intersection and the traffic data indicates a traffic light failure, it is determined that the second suspected violation occurs during the driving of the vehicle.
[0053] In a possible implementation manner, the acquisition module is specifically configured to:
[0054] In response to a user turning on a violation recording function, acquiring first video data detected by the vehicle sensor;
[0055] Accordingly, the acquisition module is also used for:
[0056] In response to the user turning off the violation recording function, the acquisition of the first video data detected by the vehicle sensor is stopped.
[0057] In a third aspect, an embodiment of the present application provides a vehicle, including: a memory, a processor;
[0058] The memory stores computer-executable instructions;
[0059] The processor executes the computer-executable instructions stored in the memory, so that the processor executes the above first aspect and / or various possible implementations of the first aspect.
[0060] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, they are used to implement the first aspect above and / or various possible implementations of the first aspect.
[0061] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the above first aspect and / or various possible implementation methods of the first aspect.
[0062] The video processing method, device, vehicle and storage medium provided by the embodiment of the present application, the method obtains the first video data detected by the vehicle sensor, the first video data includes: in-vehicle video data, and / or out-vehicle video data; based on the user behavior data in the in-vehicle video data, determines whether there is a first suspected violation inside the vehicle; and / or, based on the driving data and traffic data in the out-vehicle video data, determines whether there is a second suspected violation while the vehicle is driving; if there is a first suspected violation, and / or a second suspected violation, saves the second video data related to the suspected violation from the first video data. In this technical solution, the video data detected by the internal and external sensors of the vehicle are used to determine whether there is a suspected violation, and if there is, the video data of the suspected violation is recorded to facilitate subsequent appeals, so as to avoid the problem of being unable to appeal due to misjudgment. BRIEF DESCRIPTION OF THE DRAWINGS
[0063] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.
[0064] Figure 1 A schematic diagram of the structure of a video processing system provided in an embodiment of the present application;
[0065] Figure 2 Schematic diagram of the video processing method provided in the embodiment of the present application Figure 1 ;
[0066] Figure 3 Schematic diagram of the video processing method provided in the embodiment of the present application Figure 2 ;
[0067] Figure 4 Schematic diagram of the video processing method provided in the embodiment of the present application Figure 3 ;
[0068] Figure 5 A schematic diagram of the structure of a video processing device provided in an embodiment of the present application;
[0069] Figure 6 A schematic diagram of the structure of a vehicle provided in an embodiment of the present application.
[0070] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION
[0071] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.
[0072] When vehicles are driving, they are bound to commit traffic violations. Some of these violations are not the driver's subjective intention. For example, if there is a faulty vehicle at the traffic light ahead and the vehicle needs to cross the solid line to change lanes, the electronic police may not be able to capture the entire process.
[0073] This results in the vehicle being recorded for violations and corresponding penalties being taken. However, in the above situation, when the user needs to appeal, there is no direct evidence, which leads to an unsuccessful appeal.
[0074] In response to the technical problems existing in the prior art, the inventor of the present application has conceived that video detection can be performed with the help of internal and external sensors arranged on the vehicle. When a suspected violation is detected, the video clip corresponding to the violation can be saved, so that the video clip can be used for subsequent appeals. Moreover, the method of saving the clips will not cause excessive occupancy of the hardware storage in the vehicle, thereby improving the efficiency of vehicle use.
[0075] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.
[0076] Figure 1 A schematic diagram of the structure of a video processing system provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, the schematic diagram includes: a controller (an example of an execution subject of an embodiment of the present application), a video saving system (such as a hardware storage unit, etc.), and sensors (such as front / rear cameras, driver monitoring cameras).
[0077] The sensor and the video storage system are connected to the controller for communication. The execution subject of the embodiment of the present application is a vehicle, which can be a controller in the vehicle.
[0078] exist Figure 1 On the basis of Figure 2 Schematic diagram of the video processing method provided in the embodiment of the present application Figure 1 ,like Figure 2 As shown, the method includes:
[0079] Among them, step 22 and step 23 are executed based on actual conditions, without limiting the execution order, and can also be executed concurrently.
[0080] Step 21, obtaining first video data detected by a vehicle sensor, the first video data including: in-vehicle video data and / or out-vehicle video data;
[0081] In this step, sensors are arranged in the vehicle to collect video data from the outside of the vehicle, i.e., outside-vehicle video data, for subsequent detection of suspected violations of traffic rules by the vehicle itself when the vehicle is driving on the road; and / or to collect video data from the inside of the vehicle, i.e., inside-vehicle video data, for subsequent detection of suspected violations of traffic rules by users inside the vehicle when the vehicle is driving on the road.
[0082] Optionally, a possible implementation of step 21 may be: in response to a user turning on a violation recording function, acquiring first video data detected by a vehicle sensor.
[0083] In this implementation, a switch component for the violation recording function may be provided in the vehicle, such as a physical button, an icon in a visual interface, and the like.
[0084] For example, taking the icon in the visualization interface as an example, when the user clicks the icon, the vehicle obtains the first video data detected by the sensor and performs subsequent implementations.
[0085] Correspondingly, in response to the user turning off the violation recording function, the acquisition of the first video data detected by the vehicle sensor stops.
[0086] For example, taking the icon in the visualization interface as an example, when the user clicks the icon again, the vehicle stops acquiring the first video data detected by the sensor and no longer executes subsequent implementations.
[0087] Step 22: determining whether there is a first suspected violation of traffic rules inside the vehicle based on the user behavior data in the in-vehicle video data;
[0088] In this step, the in-vehicle video data can be the monitoring data of the driver's real-time behavior, that is, the user behavior data. Based on the analysis and processing of the user behavior data and the judgment criteria for illegal behavior, it is determined whether there is any suspected illegal behavior inside the vehicle, which is recorded as the first suspected illegal behavior.
[0089] Optionally, the user behavior data includes: at least one of the driver's clothing image and hair image, and a seat belt image, then the following possibilities exist:
[0090] First, if at least one of the clothing image and the hair image blocks the seat belt image, it is determined that a first suspected violation exists inside the vehicle;
[0091] In this implementation, taking the clothing image as an example, if there is an occlusion with the seat belt image, that is, the driver's clothes cover the seat belt, which may be misjudged as not fastening the seat belt, then it is considered that there is a first suspected violation inside the vehicle; taking the hair image as an example, if there is an occlusion with the seat belt image, that is, the driver's hair covers the seat belt, which may be misjudged as not fastening the seat belt, then it is considered that there is a first suspected violation inside the vehicle.
[0092] Second, if at least one of the clothing image and the hair image is similar in color and / or material to the seat belt image, it is determined that a first suspected violation exists inside the vehicle.
[0093] In this implementation, taking the clothing image as an example, if there is an image of clothing that has the same color and / or a similar material as the seat belt image, that is, the driver's clothes are similar to the seat belt and may be mistakenly judged as not wearing a seat belt, then it is considered that there is a first suspected violation inside the vehicle; taking the hair image as an example, if there is an image of clothing that has the same color and / or a similar material as the seat belt image, that is, the driver's hair color, material and shape are similar to the seat belt, that is, it may be mistakenly judged as not wearing a seat belt, then it is considered that there is a first suspected violation inside the vehicle.
[0094] Optionally, the user behavior data includes: a hand image and a head image of the driver, then the following possibilities exist:
[0095] If the hand image and the head image overlap, it is determined that a first suspected violation exists inside the vehicle.
[0096] In this implementation, when there is an overlap between the hand image and the head image, that is, the driver uses his hands to hold his glasses or touches his face, he will also be misjudged as not wearing a seat belt, and it is considered that there is a first suspected violation inside the vehicle.
[0097] Step 23: determining whether there is a second suspected violation of traffic rules while the vehicle is traveling based on the driving data and traffic data in the off-vehicle video data;
[0098] In this step, the off-vehicle video data may be the vehicle's own driving conditions, such as the analyzed speed information, line-crossing behavior and other driving data; it may also be the conditions of other vehicles around the vehicle, traffic signal indications, pedestrian information and other traffic data;
[0099] Afterwards, based on the analysis and processing of the driving data and traffic data, combined with the judgment criteria for traffic violations, it is determined whether there is any suspected traffic violation inside the vehicle, which is recorded as the second suspected traffic violation.
[0100] Optionally, the driving data includes: if the vehicle changes lanes on a solid line, the following possibilities exist:
[0101] If the vehicle changes lanes on a solid line and traffic data indicates that there is a faulty vehicle and / or a special operation vehicle in front of the vehicle, it is determined that a second suspected violation occurs during the driving of the vehicle.
[0102] In this implementation, when it is analyzed based on the driving data that the vehicle changes lanes on a solid line, it is a violation. However, in order to avoid misjudgment, for example, the traffic data indicates that there is a broken down vehicle ahead of the vehicle that needs to be detoured, or there is a characteristic operating vehicle ahead that also needs to be avoided, then it is considered that the vehicle must cross the solid line to change lanes, and a second suspected violation is recorded in the vehicle's driving.
[0103] Optionally, the driving data includes: when a vehicle passes a red light intersection, the following possibilities exist:
[0104] First, if the vehicle passes a red light intersection and the traffic data indicates that there is a traffic police officer in front of the vehicle, it is determined that the vehicle has a second suspected violation of traffic rules;
[0105] In this implementation, when it is analyzed based on the driving data that the vehicle passes through a red light intersection, it is a violation, but in order to avoid misjudgment, for example, the traffic data indicates that there is a traffic police officer in front of the vehicle, it is believed that the instruction may be due to the command of the traffic police officer, and there is traffic congestion. If the vehicle passes the red light, it will be recorded that there is a second suspected violation in the vehicle's driving.
[0106] Second: if the vehicle passes a red light intersection and traffic data indicates a traffic light failure, it is determined that a second suspected violation exists during the driving of the vehicle.
[0107] In this implementation, when it is analyzed based on the driving data that the vehicle passes through a red light intersection, it is a violation, but in order to avoid misjudgment, for example, the traffic data indicates a traffic light malfunction, such as the red light countdown remains unchanged for a long time, or the red and green lights are on at the same time, and the vehicle passes the red light, the violation in this case is uncertain, then a second suspected violation is recorded in the vehicle's driving.
[0108] Step 24: If there is a first suspected traffic violation and / or a second suspected traffic violation, save the second video data related to the suspected traffic violation from the first video data.
[0109] In this step, under the above steps, if it is determined that there is a first suspected traffic violation and / or a second suspected traffic violation, it is considered necessary to record the video data corresponding to the suspected traffic violation, that is, the video data corresponding to the first suspected traffic violation and / or the second suspected traffic violation is saved from the first video data and recorded as the second video data.
[0110] Furthermore, the second video data is saved to a preset storage space of the vehicle, and the saving period can be set, such as 14 days, that is, after 14 days, the second video data can be cleared or overwritten by new second video data to save storage space.
[0111] One possible implementation is that the second video data is stored by a video storage system, where the system includes: a preset storage space.
[0112] The video processing method provided in the embodiment of the present application obtains the first video data detected by the vehicle sensor, and the first video data includes: in-vehicle video data and / or out-vehicle video data; based on the user behavior data in the in-vehicle video data, determines whether there is a first suspected violation inside the vehicle; and / or, based on the driving data and traffic data in the out-vehicle video data, determines whether there is a second suspected violation while the vehicle is driving; if there is a first suspected violation and / or a second suspected violation, saves the second video data related to the suspected violation from the first video data. In this technical solution, the video data detected by the internal and external sensors of the vehicle are used to determine whether there is a suspected violation. If there is, the video data of the suspected violation is recorded to facilitate subsequent appeals and avoid the problem of being unable to appeal due to misjudgment.
[0113] Based on the above embodiments, Figure 3 Schematic diagram of the video processing method provided in the embodiment of the present application Figure 2 ,like Figure 3 As shown, the above step 24 may include the following implementations:
[0114] Step 31, determining a first timestamp of a suspected traffic violation in the first video data;
[0115] In this step, the time point of the video data corresponding to the suspected traffic violation (ie, the first suspected traffic violation and / or the second suspected traffic violation) in the first video data is recorded as the first timestamp.
[0116] For example, taking the in-car video data in the first video data as an example, when it is determined that the time corresponding to the suspected violation of not wearing a seat belt is 13:25, 13:25 is recorded as the first timestamp.
[0117] Step 32: The first video data within a preset time period before and after the first timestamp is used as the second video data and saved.
[0118] In this step, in order to ensure the integrity of the video record of the suspected violation and occupy as little storage space as possible, a preset duration can be set, and the first video data within the preset duration before and after the first timestamp can be saved as the second video data.
[0119] For example, if the preset duration is 2 minutes, the second video data is the video data between 13:23 and 13:27 in the first video data.
[0120] The video processing method provided in the embodiment of the present application determines the first timestamp at which the suspected traffic violation occurs in the first video data, and saves the first video data within a preset time period before and after the first timestamp as the second video data. In this technical solution, by determining the time point at which the suspected traffic violation occurs and saving the video within a period of time before and after the time point, subsequent traffic violation complaints are facilitated and excessive storage space is avoided.
[0121] Based on the above embodiments, Figure 4 Schematic diagram of the video processing method provided in the embodiment of the present application Figure 3 ,like Figure 4 As shown, the method includes the following implementation:
[0122] Step 1. Start;
[0123] Step 2: Check whether the violation record function is enabled; if yes, proceed to step 3; if no, proceed to step 5;
[0124] Step 3: Determine whether a traffic violation has occurred; if so, proceed to step 4; if not, proceed to step 6;
[0125] Step 4: Remind the driver that the video has been saved and end;
[0126] Step 5: Enable the prohibition function and end;
[0127] Step 6: No action, and end.
[0128] The video processing method provided in the embodiment of the present application has similar implementation principles and technical effects, which will not be described in detail in this embodiment.
[0129] Figure 5A schematic diagram of the structure of a video processing device provided in an embodiment of the present application is shown in FIG. Figure 5 As shown, the video processing device provided in this embodiment includes:
[0130] An acquisition module 51 is used to acquire first video data detected by a vehicle sensor, where the first video data includes: in-vehicle video data and / or out-vehicle video data;
[0131] A first determination module 52 is used to determine whether there is a first suspected violation of traffic rules inside the vehicle based on the user behavior data in the in-vehicle video data; and / or,
[0132] A second determination module 53 is used to determine whether there is a second suspected violation of traffic rules during the driving of the vehicle based on the driving data and traffic data in the off-vehicle video data;
[0133] The processing module 54 is configured to save the second video data related to the suspected traffic violation from the first video data if the first suspected traffic violation and / or the second suspected traffic violation exists.
[0134] In a possible implementation, the processing module 54 saves the second video data related to the suspected traffic violation from the first video data, specifically for:
[0135] Determine a first timestamp of a suspected traffic violation occurring in the first video data;
[0136] The first video data within a preset time period before and after the first timestamp is used as the second video data and saved.
[0137] In a possible implementation, the user behavior data includes: at least one of a clothing image and a hair image of the driver, and a seat belt image;
[0138] Accordingly, the first determining module 52 is specifically configured to:
[0139] If at least one of the clothing image and the hair image blocks the seat belt image, it is determined that a first suspected violation exists inside the vehicle;
[0140] If at least one of the clothing image and the hair image is similar in color and / or material to the seat belt image, it is determined that a first suspected violation exists inside the vehicle.
[0141] In a possible implementation, the user behavior data includes: a driver's hand image and a head image;
[0142] Accordingly, the first determining module 52 is specifically configured to:
[0143] If the hand image and the head image overlap, it is determined that a first suspected violation exists inside the vehicle.
[0144] In a possible implementation, the driving data includes: a vehicle changing lanes in a solid line;
[0145] Accordingly, the second determining module 53 is specifically configured to:
[0146] If the vehicle changes lanes on a solid line and traffic data indicates that there is a faulty vehicle and / or a special operation vehicle in front of the vehicle, it is determined that a second suspected violation occurs during the driving of the vehicle.
[0147] In a possible implementation, the driving data includes: the vehicle driving through a red light intersection;
[0148] Accordingly, the second determining module 53 is specifically configured to:
[0149] If the vehicle passes a red light intersection and the traffic data indicates that there is a traffic police officer in front of the vehicle, it is determined that the vehicle has a second suspected violation of traffic rules;
[0150] If the vehicle passes a red light intersection and traffic data indicates a traffic light failure, it is determined that a second suspected violation occurs during the driving of the vehicle.
[0151] In a possible implementation, the acquisition module 51 is specifically configured to:
[0152] In response to a user turning on a traffic violation recording function, acquiring first video data detected by a vehicle sensor;
[0153] Correspondingly, the acquisition module 51 is also used for:
[0154] In response to the user turning off the violation recording function, the acquisition of the first video data detected by the vehicle sensor is stopped.
[0155] The video processing device provided in this embodiment can execute the method provided in the above method embodiment. Its implementation principle and technical effect are similar, and this embodiment will not be described in detail here.
[0156] Figure 6 This is a schematic diagram of the structure of a vehicle provided in an embodiment of the present application. Figure 6 As shown, the vehicle provided in this embodiment includes: at least one processor 61 and a memory 62.
[0157] Optionally, the vehicle further includes a communication component 63 , wherein the processor 61 , the memory 62 and the communication component 63 are connected via a bus 64 .
[0158] In a specific implementation process, at least one processor 61 executes the computer-executable instructions stored in the memory 62, so that at least one processor 61 executes the above method.
[0159] The specific implementation process of the processor 61 can be found in the above method embodiment, and its implementation principle and technical effect are similar, so this embodiment will not be repeated here.
[0160] In the above embodiments, it should be understood that the processor can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. A general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in the invention can be directly implemented as a hardware processor, or can be implemented by a combination of hardware and software modules in the processor.
[0161] The memory may include a high-speed memory (Random Access Memory, RAM), and may also include a non-volatile memory (NVM), such as at least one disk storage.
[0162] The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the bus in the drawings of this application is not limited to only one bus or one type of bus.
[0163] The present application also provides a computer program product, including a computer program, which implements the above method when executed by a processor.
[0164] The present application also provides a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the above method is implemented.
[0165] The above-mentioned readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The readable storage medium can be any available medium that can be accessed by a general or special-purpose computer.
[0166] An exemplary readable storage medium is coupled to a processor so that the processor can read information from the readable storage medium and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can be located in an application specific integrated circuit (Application Specific Integrated Circuits, referred to as: ASIC). Of course, the processor and the readable storage medium can also exist in the device as discrete components.
[0167] The division of units is only a logical function division, and there may be other divisions in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interface, device or unit, which can be electrical, mechanical or other forms.
[0168] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0169] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0170] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods of each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.
[0171] Those skilled in the art can understand that all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, disk or optical disk and other media that can store program codes.
[0172] Finally, it should be noted that those skilled in the art will readily conceive of other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. The present invention is intended to cover any variations, uses or adaptations of the present invention, which follow the general principles of the present invention and include common knowledge or customary technical means in the art not disclosed by the present invention, are not limited to the precise structure described above and shown in the drawings, and may be modified and changed in various ways without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.
Claims
1. A video processing method, characterized in that: include: Acquire first video data detected by a vehicle sensor, wherein the first video data includes: in-vehicle video data and / or out-vehicle video data; Based on the user behavior data in the in-vehicle video data, determining whether there is a first suspected violation of traffic rules inside the vehicle; and / or, Determining whether there is a second suspected violation of traffic rules during driving of the vehicle based on driving data and traffic data in the off-vehicle video data; If the first suspected traffic violation and / or the second suspected traffic violation exists, second video data related to the suspected traffic violation is saved from the first video data.
2. The method according to claim 1, characterized in that The step of saving the second video data related to the suspected traffic violation from the first video data includes: Determine a first timestamp of a suspected traffic violation occurring in the first video data; The first video data within a preset time period before and after the first timestamp is used as the second video data and saved.
3. The method according to claim 1 or 2, characterized in that: The user behavior data includes: at least one of the driver's clothing image and hair image, and a seat belt image; Accordingly, determining whether there is a first suspected traffic violation inside the vehicle based on the user behavior data in the in-vehicle video data includes: If at least one of the clothing image and the hair image blocks the seat belt image, determining that the first suspected violation exists inside the vehicle; If at least one of the clothing image and the hair image is similar in color and / or material to the seat belt image, it is determined that the first suspected violation exists inside the vehicle.
4. The method according to claim 1 or 2, characterized in that: The user behavior data includes: a hand image and a head image of the driver; Accordingly, determining whether there is a first suspected traffic violation inside the vehicle based on the user behavior data in the in-vehicle video data includes: If the hand image and the head image overlap, it is determined that the first suspected violation exists inside the vehicle.
5. The method according to claim 1 or 2, characterized in that: The driving data includes: the vehicle changing lanes in a solid line; Accordingly, determining whether there is a second suspected violation of traffic rules while the vehicle is traveling based on the driving data and traffic data in the off-vehicle video data includes: If the vehicle changes lanes in a solid line and the traffic data indicates that there is a faulty vehicle and / or a special operation vehicle in front of the vehicle, it is determined that the second suspected violation occurs during the driving of the vehicle.
6. The method according to claim 1 or 2, characterized in that: The driving data includes: the vehicle driving through a red light intersection; Accordingly, determining whether there is a second suspected violation of traffic rules while the vehicle is traveling based on the driving data and traffic data in the off-vehicle video data includes: If the vehicle passes a red light intersection and the traffic data indicates that there is a traffic police officer in front of the vehicle, it is determined that the second suspected violation occurs during the driving of the vehicle; If the vehicle passes a red light intersection and the traffic data indicates a traffic light failure, it is determined that the second suspected violation occurs during the driving of the vehicle.
7. The method according to claim 1 or 2, characterized in that: The step of acquiring first video data detected by a vehicle sensor includes: In response to a user turning on a violation recording function, acquiring first video data detected by the vehicle sensor; Accordingly, the method further includes: In response to the user turning off the violation recording function, the acquisition of the first video data detected by the vehicle sensor is stopped.
8. A video processing device, characterized in that: include: An acquisition module, configured to acquire first video data detected by a vehicle sensor, wherein the first video data includes: in-vehicle video data and / or out-vehicle video data; A first determination module is configured to determine whether there is a first suspected violation of traffic rules inside the vehicle based on user behavior data in the in-vehicle video data; and / or, A second determination module is used to determine whether there is a second suspected violation of traffic rules during the driving of the vehicle based on the driving data and traffic data in the off-vehicle video data; A processing module is used for saving second video data related to the suspected traffic violation from the first video data if the first suspected traffic violation and / or the second suspected traffic violation exists.
9. A vehicle, characterized in that: include: Memory, processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor performs the method according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 7 when executed by a processor.