Event detection method, device, equipment and medium
By integrating the electronic signals and inertial sensor data of the vehicle, and automatically detecting vehicle events, and using the central control host or a moving camera for video editing, the problems of low identification efficiency and equipment installation in the prior art are solved, and efficient and accurate event recognition and Video processing.
Patent Information
- Application Number
- CN202411133125.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-19
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2044-08-19
AI Technical Summary
In the prior art, the identification of whether a wonderful event occurs in a vehicle depends on manual analysis, which is inefficient and can easily lead to misidentification or missed identification. The motion camera is not installed firmly on the car, and the power supply and storage capacity are insufficient.
By obtaining the broadcast signals of the vehicle's electronic suspension system, electronic stability system and vehicle controller, as well as data from inertial sensors, we automatically detect whether the target event occurs in the vehicle, and use the central control host or a moving camera to transmit video data in real time and Edit and generate exciting video clips.
It improves the efficiency and accuracy of exciting events, solves the problem of unreliable installation of motion cameras on cars, insufficient power supply and storage capacity, and realizes automated video editing and data processing.
Smart Images

Figure CN118651236B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of data processing technology, and in particular to an event detection method, device, equipment and medium. Background Art
[0002] When a vehicle is driving, exciting events may occur (such as rollover, drift, and tail-spinning). How to identify whether an exciting event has occurred in the vehicle is of great significance in improving user experience and interactivity, data collection and analysis, improving driving safety, and promoting technological progress and innovation.
[0003] In the related art, whether an exciting event occurs in the vehicle is analyzed by manually viewing the vehicle's driving data or the video data captured by the vehicle's onboard camera.
[0004] However, manual analysis methods not only have the problem of low analysis efficiency, but may also lead to misidentification or missed identification of exciting events. Summary of the invention
[0005] The present disclosure aims to solve one of the technical problems in the related art at least to some extent.
[0006] One aspect of the present disclosure provides an event detection method, apparatus, device, and medium to achieve both recognition efficiency and recognition accuracy of exciting events.
[0007] The first embodiment of the present disclosure provides an event detection method, including:
[0008] Acquire a first broadcast signal broadcast by an electronic suspension system of a vehicle and a second broadcast signal broadcast by an electronic stability system;
[0009] Acquire a third broadcast signal broadcast by a vehicle controller of the vehicle and vehicle posture data monitored by an inertial sensor;
[0010] Whether a target event occurs in the vehicle is detected according to the first broadcast signal, the second broadcast signal, the third broadcast signal and the vehicle posture data.
[0011] As a possible implementation method, detecting whether a target event occurs in the vehicle based on the first broadcast signal, the second broadcast signal, the third broadcast signal and the vehicle posture data includes: determining whether the first broadcast signal, the second broadcast signal, the third broadcast signal and the vehicle posture data satisfy an event trigger condition associated with the target event; if the event trigger condition is satisfied, determining that the target event occurs in the vehicle; if the event trigger condition is not satisfied, determining that the target event does not occur in the vehicle.
[0012] As a possible implementation method, the first broadcast signal includes at least one of a vehicle lift-off signal and a vehicle landing signal; the second broadcast signal includes at least one of a steering wheel angular velocity signal and a steering wheel angle signal; the third broadcast signal includes at least one of an accelerator pedal opening signal, a brake pedal opening signal and an instantaneous power signal; the vehicle posture data includes at least one of a vehicle pitch angle and a vehicle tilt angle.
[0013] As a possible implementation, the event triggering condition includes at least one of the following: the vehicle state indicated by the vehicle lift-off signal switches from the grounded state to the lift-off state; the vehicle state indicated by the vehicle landing signal switches from the lift-off state to the landed state;
[0014] The steering wheel angle speed indicated by the steering wheel angle speed signal is greater than the set angle speed; the steering wheel angle indicated by the steering wheel angle signal is greater than the set angle; the accelerator pedal opening indicated by the accelerator pedal opening signal is greater than the first set opening; the brake pedal opening indicated by the brake pedal opening signal is greater than the second set opening; the vehicle instantaneous power indicated by the instantaneous power signal is greater than the set power; the vehicle pitch angle in the vehicle posture data is greater than the set pitch angle; the vehicle tilt angle in the vehicle posture data is greater than the set tilt angle.
[0015] As a possible implementation method, the set steering wheel angular velocity is 60° / s, the set angle of the steering wheel angle is 600°, the first set opening of the accelerator pedal is 98%, the second set opening of the brake pedal is 98%, the set power of the vehicle instantaneous power is 2000W, the set pitch angle of the vehicle pitch angle is 30°, and the set tilt angle of the vehicle tilt angle is 30°.
[0016] As a possible implementation manner, the method further includes: in response to monitoring a triggering operation on a setting control of the vehicle, determining that the target event occurs in the vehicle.
[0017] As a possible implementation manner, the method also includes: determining the time parameters of the target event based on the monitored trigger time of the trigger operation of the set control of the vehicle or the driving status data of the vehicle; based on the time parameters, acquiring and storing a first video clip matching the target event; wherein the time parameters include the starting time and / or the ending time of the target event occurring in the vehicle; the driving status data includes the first broadcast signal, the second broadcast signal, the third broadcast signal and the vehicle posture data; wherein the first video clip is obtained by editing the video data taken by the motion camera installed in the vehicle based on the time parameters.
[0018] As a possible implementation manner, the method is executed by the central control host of the vehicle, and the obtaining and storing of the first video clip matching the target event based on the time parameter includes: marking the video data sent by the motion camera based on the time parameter and the driving status data; querying the first editing duration and the second editing duration associated with the target event; wherein the first editing duration is used to edit the video clip before the target event occurs, and the second editing duration is used to edit the video clip after the target event occurs; according to the time parameter, the first editing duration and the second editing duration, the marked video data is edited to obtain the first video clip; and the first video clip is stored.
[0019] As a possible implementation method, the motion camera transmits the captured video data to the central control host in real time for storage; or, the motion camera segments the captured video data according to a set duration, stores the segmented video data locally, and sends the segmented video data to the central control host for storage.
[0020] As a possible implementation manner, the method is executed by the central control host of the vehicle, and the obtaining and storing of the first video clip matching the target event based on the time parameter includes: sending a video editing instruction carrying the time parameter to the motion camera; receiving the first video clip sent by the motion camera; wherein the first video clip is obtained by the motion camera responding to the video editing instruction, querying the first editing duration and the second editing duration associated with the target event, and editing the video data shot and stored by the motion camera according to the time parameter, the first editing duration and the second editing duration; and storing the first video clip.
[0021] As a possible implementation manner, the method is executed by the motion camera, and the obtaining and storing of the first video clip matching the target event based on the time parameter includes: marking the video data shot and stored by the motion camera based on the time parameter and the driving status data; querying the first clip duration and the second clip duration associated with the target event; clipping the marked video data according to the time parameter, the first clip duration and the second clip duration to obtain the first video clip; and storing the first video clip.
[0022] As a possible implementation manner, the method further includes: sending the first video clip to a central control host of the vehicle for storage.
[0023] As a possible implementation manner, the method is executed by the central control host of the vehicle, and the method also includes: determining a target motion effect model that is adapted to the event type of the target event from a plurality of candidate motion effect models; extracting key features from the first video clip; performing motion effect processing on the first video clip based on the target motion effect model and the key features to obtain a second video clip; sending the second video clip to a mobile terminal bound to the vehicle; wherein the second video clip is used by the mobile terminal to perform at least one of the following operations: displaying the second video clip; editing the second video clip; sharing the second video clip to a social platform.
[0024] As a possible implementation, the sports camera is installed in a first card slot, which is arranged in the area where a metal pillar of the vehicle is located, and the metal pillar is used to connect the front windshield and the front door of the vehicle; and / or, the auxiliary shooting component connected to the sports camera is installed in a second card slot, which is arranged on the roof of the vehicle.
[0025] As a possible implementation method, a first data cable is provided at the first card slot, and the first data cable is used to power or charge the sports camera, and / or, the first data cable is used for the sports camera to transmit the captured video data to the central control host of the vehicle for storage; and / or, a second data cable is provided at the second card slot, and the second data cable is used to power or charge the sports camera, and / or, the second data cable is used for the sports camera to transmit the captured video data to the central control host of the vehicle for storage.
[0026] The second aspect of the present disclosure provides an event detection device, including:
[0027] A first acquisition module, configured to acquire a first broadcast signal broadcast by an electronic suspension system of a vehicle and a second broadcast signal broadcast by an electronic stability system;
[0028] A second acquisition module, used to acquire a third broadcast signal broadcast by a vehicle controller of the vehicle and vehicle posture data monitored by an inertial sensor;
[0029] A detection module is used to detect whether a target event occurs in the vehicle based on the first broadcast signal, the second broadcast signal, the third broadcast signal and the vehicle posture data.
[0030] The third aspect embodiment of the present disclosure proposes an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the event detection method proposed in the first aspect embodiment of the present disclosure is implemented.
[0031] The fourth aspect embodiment of the present disclosure proposes a non-temporary computer-readable storage medium, on which a computer program is stored. When the program is executed by a processor, it implements the event detection method proposed in the first aspect embodiment of the present disclosure.
[0032] The fifth aspect embodiment of the present disclosure proposes a computer program product. When the instructions in the computer program product are executed by a processor, the event detection method proposed in the first aspect embodiment of the present disclosure is executed.
[0033] The technical solutions provided by the above embodiments of the present disclosure bring at least the following beneficial effects:
[0034] The vehicle's electronic suspension system, electronic stability system, vehicle controller's broadcast signals, and inertial sensor's monitoring data are integrated to automatically detect whether a target event (such as a wonderful event) has occurred in the vehicle, taking into account both the recognition efficiency and recognition accuracy of the target event.
[0035] Additional aspects and advantages of the present disclosure will be given in part in the following description and in part will be obvious from the following description or learned through practice of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0036] The above and / or additional aspects and advantages of the present disclosure will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:
[0037] Figure 1 A flowchart of an event detection method provided by an embodiment of the present disclosure;
[0038] Figure 2 A flowchart of another event detection method provided by an embodiment of the present disclosure;
[0039] Figure 3 A flowchart of another event detection method provided by an embodiment of the present disclosure;
[0040] Figure 4 A flowchart of another event detection method provided by an embodiment of the present disclosure;
[0041] Figure 5 Schematic diagram of event detection and video editing principles provided by the embodiment of the present disclosure Figure 1 ;
[0042] Figure 6 Schematic diagram of event detection and video editing principles provided by the embodiment of the present disclosure Figure 2 ;
[0043] Figure 7 A flowchart of another event detection method provided by an embodiment of the present disclosure;
[0044] Figure 8 Schematic diagram of event detection and video editing principles provided by the embodiment of the present disclosure Figure 3 ;
[0045] Fig. 9 A flowchart of another event detection method provided by an embodiment of the present disclosure;
[0046] Fig.10 Schematic diagram of event detection and video editing principles provided by the embodiment of the present disclosure Figure 4 ;
[0047] Fig.11 A schematic diagram of the structure of a system for generating short videos by editing a vehicle provided in an embodiment of the present disclosure;
[0048] Fig.12 A schematic diagram of the structure of an event detection device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION
[0049] Embodiments of the present disclosure are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present disclosure, and should not be construed as limiting the present disclosure.
[0050] At present, the intelligent networking of the vehicle industry, including passenger cars and all-terrain vehicles, does not involve the pre-installation of action cameras, nor the data interaction between the video and the vehicle-mounted central control host. At present, action cameras are only sold directly to ordinary users as consumer electronic products, and then installed by users on bicycles, electric vehicles, and motorcycles, but never pre-installed on cars.
[0051] Since the action camera is an aftermarket product, users need to find a fixed installation location for the action camera on the car after purchasing it, which may result in an unstable installation. Ordinary users can only use the built-in battery of the action camera for power supply, and cannot use the car's power supply for continuous power supply. Ordinary users can only use the memory card that comes with the action camera to store the video data taken by the action camera, and cannot use the large-capacity erasable storage space of the on-board central control host. Ordinary users can only use the mobile phone APP that comes with the action camera to download long video files, and then spend a lot of time playing the long video files to edit wonderful video clips. Ordinary users cannot obtain CAN (Controller Area Network) data of the vehicle operation in the video clips recorded by them.
[0052] In addition, the identification of wonderful events is currently mainly done by manually viewing the vehicle's driving data or the video data captured by the vehicle's onboard camera to analyze whether a wonderful event has occurred. However, the manual analysis method not only has the problem of low analysis efficiency, but may also lead to misidentification or omission of wonderful events.
[0053] In response to at least one of the above problems, the present disclosure provides an event detection method, device, equipment and medium.
[0054] The event detection method, apparatus, device, and medium of the embodiments of the present disclosure are described below with reference to the accompanying drawings.
[0055] Figure 1 A flowchart of an event detection method provided by an embodiment of the present disclosure.
[0056] The execution subject of the embodiment of the present disclosure may be a central control host of the vehicle, or a sports camera installed in the vehicle.
[0057] like Figure 1 As shown, the event detection method includes the following steps S101 to S103:
[0058] Step S101 , obtaining a first broadcast signal broadcast by an electronic suspension system of a vehicle and a second broadcast signal broadcast by an electronic stability system.
[0059] The signals broadcast by the electronic suspension system (referred to as the first broadcast signal in the present disclosure) include, but are not limited to, a “vehicle lift-off” signal, a “vehicle landing” signal, and the like.
[0060] The second broadcast signal broadcast by the electronic stability system (such as ESP (Electronic Stability Program)) includes but is not limited to: a "steering wheel angular speed" signal, a "steering wheel angle" signal, and the like.
[0061] In the disclosed embodiment, the execution subject may communicate with the CAN bus of the entire vehicle to obtain a first broadcast signal broadcast by the electronic suspension system of the vehicle and a second broadcast signal broadcast by the vehicle body electronic stability system.
[0062] Step S102, obtaining a third broadcast signal broadcast by a vehicle controller of the vehicle and vehicle posture data monitored by an inertial sensor.
[0063] Among them, the third broadcast signal broadcast by the vehicle controller (such as VCU (Vehicle Control Unit)) includes but is not limited to: "accelerator pedal opening" signal, "brake pedal opening" signal, "instantaneous power" signal, etc.
[0064] The inertial sensor is used to monitor or collect vehicle attitude data, wherein the vehicle attitude data includes but is not limited to: vehicle pitch angle, vehicle tilt angle, etc. Exemplarily, the inertial sensor may be a 6-axis gyroscope built into the central control host of the vehicle.
[0065] In the disclosed embodiment, the execution subject can communicate with the vehicle CAN bus to obtain the third broadcast signal broadcast by the vehicle controller of the vehicle and the vehicle posture data monitored by the inertial sensor.
[0066] Step S103, detecting whether a target event occurs in the vehicle according to the first broadcast signal, the second broadcast signal, the third broadcast signal and the vehicle posture data.
[0067] Among them, target events include but are not limited to: flying events (or airborne events), drifting events, tail swing events, flipping events and other exciting events.
[0068] In the embodiment of the present disclosure, the execution entity can integrate the first broadcast signal, the second broadcast signal, the third broadcast signal and the vehicle posture data to automatically detect whether a target event occurs in the vehicle.
[0069] The event detection method of the disclosed embodiment can integrate the broadcast signals of the vehicle's electronic suspension system, electronic stability system and vehicle controller and the monitoring data of the inertial sensor to automatically detect whether a target event (such as a wonderful event) occurs in the vehicle, and can take into account both the recognition efficiency and recognition accuracy of the target event.
[0070] The present disclosure also proposes an event detection method. Figure 2 This is a flow chart of another event detection method provided by an embodiment of the present disclosure. The event detection method can be executed by a central control host of a vehicle or a motion camera installed in the vehicle.
[0071] It should be noted that the event detection method can be executed alone, or it can be executed in combination with any embodiment of the present disclosure or a possible implementation method in an embodiment, or it can be executed in combination with any technical solution in the relevant technology, and the embodiments of the present disclosure are not limited to this.
[0072] like Figure 2 As shown, the event detection method includes the following steps S201 to S205:
[0073] Step S201 , obtaining a first broadcast signal broadcast by an electronic suspension system of a vehicle and a second broadcast signal broadcast by an electronic stability system.
[0074] Step S202, obtaining a third broadcast signal broadcast by a vehicle controller of the vehicle and vehicle posture data monitored by an inertial sensor.
[0075] For explanations of steps S201 to S202, reference may be made to the relevant descriptions in any embodiment of the present disclosure and will not be repeated here.
[0076] Step S203, determine whether the first broadcast signal, the second broadcast signal, the third broadcast signal and the vehicle posture data meet the event triggering condition associated with the target event, if so, execute step S204, if not, execute step S205.
[0077] The event trigger condition is a trigger condition pre-configured for the target event.
[0078] As a possible implementation manner, the event triggering condition may include at least one of the following:
[0079] Item 1: The vehicle state indicated by the vehicle lift-off signal in the first broadcast signal switches or changes from the grounded state to the lift-off state.
[0080] Item 2: The vehicle state indicated by the vehicle landing signal in the first broadcast signal switches or changes from a lift-off state to a landed state.
[0081] Item 3: The steering wheel angular velocity indicated by the steering wheel angular velocity signal in the second broadcast signal is greater than the set angular velocity.
[0082] The set angular velocity refers to a preset (or configured) angular velocity threshold. For example, the set angular velocity may be 60° / s (60° per second).
[0083] Item 4: The steering wheel angle indicated by the steering wheel angle signal in the second broadcast signal is greater than the set angle.
[0084] The set angle refers to a preset turning angle threshold, and illustratively, the set angle may be 600°.
[0085] Item 5: The accelerator pedal opening indicated by the accelerator pedal opening signal in the third broadcast signal is greater than the first set opening.
[0086] The first set opening refers to a preset opening threshold, and illustratively, the first set opening may be 98%.
[0087] Item 6: The brake pedal opening indicated by the brake pedal opening signal in the third broadcast signal is greater than the second set opening.
[0088] The second set opening is also a preset opening threshold. It should be noted that the disclosure does not limit the magnitude relationship between the first set opening and the second set opening, that is, the first set opening may be equal to the second set opening, or the first set opening may be different from the second set opening. For example, the second set opening may also be 98%.
[0089] Item 7: The instantaneous power of the vehicle indicated by the instantaneous power signal in the third broadcast signal is greater than the set power.
[0090] The set power refers to a preset instantaneous power threshold, and illustratively, the set power may be 2000W (Watt, abbreviated as W).
[0091] Item 8: The vehicle pitch angle in the vehicle posture data is greater than the set pitch angle.
[0092] The set pitch angle refers to a preset pitch angle threshold, and illustratively, the set pitch angle may be 30°.
[0093] Item 9: The vehicle tilt angle in the vehicle posture data is greater than the set tilt angle.
[0094] The set tilt angle refers to a preset tilt angle threshold, and illustratively, the set tilt angle may be 30°.
[0095] Step S204, determining whether a target event occurs in the vehicle.
[0096] In the embodiment of the present disclosure, when the first broadcast signal, the second broadcast signal, the third broadcast signal and the vehicle posture data meet the event triggering conditions associated with the target event, it can be determined that the target event has occurred in the vehicle.
[0097] Step S205, determining that the vehicle has not experienced a target event.
[0098] In the embodiment of the present disclosure, when the first broadcast signal, the second broadcast signal, the third broadcast signal and the vehicle posture data do not satisfy the event triggering conditions associated with the target event, it can be determined that the target event has not occurred in the vehicle.
[0099] It should be noted that in any embodiment of the present disclosure, not only can the central control host or the sports camera automatically detect whether an exciting target event has occurred in the vehicle based on the CAN data of the vehicle, but the user can also manually trigger the setting controls (such as physical buttons) of the vehicle to inform the central control host or the sports camera that an exciting target event has occurred in the vehicle.
[0100] As an example, when an exciting target event has occurred or is about to occur in the vehicle, the user can manually trigger the vehicle's setting control. Accordingly, when it is monitored that the user has triggered the trigger operation of the vehicle's setting control, it can be determined that the target event has occurred in the vehicle.
[0101] Therefore, not only can the vehicle's CAN data be used to automatically detect whether a target event has occurred, but the user can also manually trigger the set controls (such as physical buttons) in the vehicle to indicate that the vehicle has experienced a target event, which can improve the flexibility and applicability of the method.
[0102] The event detection method of the embodiment of the present disclosure determines whether a target event occurs in a vehicle based on an event triggering condition associated with the target event, thereby improving the effectiveness, accuracy and reliability of target event recognition.
[0103] The present disclosure also proposes an event detection method. Figure 3 This is a flow chart of another event detection method provided by an embodiment of the present disclosure. The event detection method can be executed by a central control host of a vehicle or a motion camera installed in the vehicle.
[0104] It should be noted that the event detection method can be executed alone, or it can be executed in combination with any embodiment of the present disclosure or a possible implementation method in an embodiment, or it can be executed in combination with any technical solution in the relevant technology, and the embodiments of the present disclosure are not limited to this.
[0105] like Figure 3 As shown, the event detection method includes the following steps S301 to S303:
[0106] Step S301, based on the setting controls of the vehicle or the driving status data of the vehicle, determine whether the target event occurs in the vehicle. If so, execute step S302. If not, it indicates that the target event does not occur in the vehicle. At this time, no processing is required.
[0107] The driving status data includes a first broadcast signal broadcast by the vehicle's electronic suspension system, a second broadcast signal broadcast by the electronic stability system, a third broadcast signal broadcast by the vehicle's vehicle controller, and vehicle posture data monitored by an inertial sensor.
[0108] Among them, the implementation principle of judging whether a target event occurs in the vehicle according to the driving status data of the vehicle can be referred to the relevant description in the above embodiment, which will not be repeated here.
[0109] In the disclosed embodiment, it is also possible to determine whether a target event has occurred in the vehicle based on the trigger status of the vehicle's setting controls, that is, if a trigger operation on the vehicle's setting controls (such as physical buttons) is monitored, it is determined that the target event has occurred in the vehicle; if no trigger operation on the vehicle's setting controls is monitored, it is determined that the target event has not occurred in the vehicle.
[0110] Step S302, determining the time parameter of the target event based on the monitored trigger time of the trigger operation of the set control or the driving state data of the vehicle.
[0111] The time parameter includes the start time and / or the end time of the target event occurring on the vehicle.
[0112] In any one of the embodiments of the present disclosure, the time parameters of the target event can be determined based on the vehicle's driving status data (the driving status data carries timestamp information); wherein the time parameters include the start time and / or end time of the target event occurring in the vehicle.
[0113] For example, taking the target event as a take-off event, the start time refers to the time when the vehicle leaves the ground, and the end time refers to the time when the vehicle lands.
[0114] In any one of the embodiments of the present disclosure, the time parameters of the target event can also be determined based on the monitored trigger time of the trigger operation of the set control; wherein the time parameters include the start time and / or end time of the target event occurring in the vehicle.
[0115] As an example, when the target event begins to occur in the vehicle, the user can click the setting control to indicate the start time of the target event. When the target event ends, the user can click the setting control again to indicate the end time of the target event.
[0116] Step S303, based on the time parameter, obtain and store a first video clip that matches the target event; wherein the first video clip is obtained by editing the video data shot by the motion camera installed in the vehicle based on the time parameter.
[0117] In an embodiment of the present disclosure, a video clip (referred to as a first video clip in the present disclosure) matching the target event can be obtained based on the time parameters of the target event, and the first video clip can be stored locally; wherein the first video clip is obtained by editing video data captured by a motion camera installed in a vehicle based on the time parameters of the target event.
[0118] As an example, taking the example that the time parameter only includes the start time of the target event, the first video segment includes video data captured by the motion camera within a period of time before and after the start time.
[0119] As another example, taking the example that the time parameter only includes the termination time of the target event, the first video clip includes video data captured by the motion camera within a period of time before and after the termination time.
[0120] As another example, taking the time parameter including both the start time and the end time of the target event, the first video segment includes the video data shot by the motion camera during a period of time between the start time and the end time. Alternatively, the first video segment includes the video data shot by the motion camera during a period of time between the start time and the end time, the video data shot by the motion camera during a period of time before the start time, and the video data shot by the motion camera during a period of time after the end time.
[0121] It should be noted that in the prior art, action cameras are only sold directly to ordinary users as consumer electronic products, and then installed by the users on bicycles, electric vehicles, and motorcycles, but never pre-installed on cars. In addition, since action cameras are post-installed products, users need to find a fixed installation position for the action cameras on the car after purchasing them, which may result in the action cameras being unsecured.
[0122] In view of the above problems, in any embodiment of the present disclosure, the action camera can be installed in the first card slot, wherein the first card slot is arranged in the area where the metal pillar (such as the A-pillar) of the vehicle is located, and the metal pillar is used to connect the front windshield and the front door of the vehicle; and / or, the auxiliary shooting component (such as a selfie stick) connected to the action camera is installed in the second card slot, and the second card slot is arranged on the roof of the vehicle. In this way, the problem that there is no completely matching fixing structure when ordinary users purchase action cameras and install them in vehicles can be solved, and the action camera can be prevented from falling due to the unreliable fixing, thereby damaging the action camera.
[0123] It should also be noted that in the prior art, ordinary users can only use the built-in battery of the action camera for power supply, and cannot use the vehicle's power supply for continuous power supply; and ordinary users can only use the memory card of the action camera to store the captured video data, and cannot use the large-capacity erasable storage space of the vehicle's central control host.
[0124] In response to the above problems, in any one of the embodiments of the present disclosure, a first data line may be provided at the first card slot, wherein the first data line is used to power or charge the sports camera, and / or the first data line is used for the sports camera to transmit the captured video data to the vehicle's central control host for storage; and / or a second data line may be provided at the second card slot, wherein the second data line is used to power or charge the sports camera, and / or the second data line is used for the sports camera to transmit the captured video data to the vehicle's central control host for storage. In this way, the problem that sports cameras purchased by ordinary users cannot be continuously powered and can only use the built-in battery of the sports camera can be solved, and continuous power supply for the sports camera can be achieved. In addition, the problem that the memory card capacity of the sports camera purchased by ordinary users is small can be solved, and the situation where the sports camera stops recording video after the storage capacity is full can be avoided.
[0125] The event detection method of the disclosed embodiment can realize that the central control host of the vehicle or the motion camera installed in the vehicle can automatically identify whether an exciting target event occurs in the vehicle based on the vehicle's driving status data or the trigger status of the vehicle's setting controls, and when the target event occurs in the vehicle, determine the time parameter associated with the target event, and automatically edit the video data shot by the motion camera based on the time parameter to obtain a wonderful video clip matching the target event, without the need for the user to watch the video data to identify the exciting target event and manually edit the wonderful video clips related to the target event. This can improve the editing efficiency of the exciting video clips, save the user's time cost, reduce the user's operation steps, and improve the user's usage experience.
[0126] The present disclosure also proposes an event detection method. Figure 4 A flow chart of another event detection method provided by an embodiment of the present disclosure is provided. The event detection method can be executed by a central control host of a vehicle.
[0127] It should be noted that the event detection method can be executed alone, or it can be executed in combination with any embodiment of the present disclosure or a possible implementation method in an embodiment, or it can be executed in combination with any technical solution in the relevant technology, and the embodiments of the present disclosure are not limited to this.
[0128] like Figure 4 As shown, in Figure 3 Based on the illustrated embodiment, step S303 may include the following steps S401 to S404:
[0129] Step S401: marking the video data sent by the motion camera based on the time parameter and the driving status data.
[0130] Among them, the motion camera can transmit the captured video data in real time to the central control host for storage; or, the motion camera can also segment the captured video data according to the set duration, store the segmented video data locally, and send the segmented video data to the central control host for storage.
[0131] The set duration is a pre-configured duration threshold, for example, the set duration may be 3 minutes.
[0132] In the disclosed embodiment, the central control host may determine key data associated with the target event from the driving status data based on the time parameters of the target event, and mark the video data sent by the motion camera based on the key data.
[0133] For example, taking the target event as a take-off event, the vehicle's height above the ground can be determined from the driving status data based on the time parameters of the target event, and the video data sent by the motion camera can be marked based on the height above the ground, so that the user can intuitively know how many meters the vehicle is above the ground based on the height above the ground marked in the video data.
[0134] In the embodiment of the present disclosure, the central control host can also mark the time point of the video data sent by the motion camera based on the start time and / or end time in the time parameters of the target event, so that the user can intuitively know the start time, end time and duration of the target event based on the marked time points in the video data.
[0135] Step S402, querying a first clipping duration and a second clipping duration associated with the target event; wherein the first clipping duration is used to clip the video segment before the target event occurs, and the second clipping duration is used to clip the video segment after the target event occurs.
[0136] The first clip duration and the second clip duration are both preset clip durations, and the disclosure does not limit the size relationship between the first clip duration and the second clip duration, that is, the first clip duration may be greater than the second clip duration, or the first clip duration may be less than the second clip duration, or the first clip duration may be equal to the second clip duration. For example, the first clip duration may be 3 seconds, and the second clip duration may be 7 seconds.
[0137] Step S403 , clipping the marked video data according to the time parameter, the first clipping duration, and the second clipping duration to obtain a first video segment.
[0138] In the disclosed embodiment, the central control host may edit the marked video data according to the time parameter of the target event, the first editing duration, and the second editing duration to obtain a first video clip associated with the target event.
[0139] As an example, taking the example that the time parameters of the target event only include the starting time, the first video clip may include: video data shot by the motion camera in a first time period before the starting time, and video data shot by the motion camera in a second time period after the starting time; wherein the duration of the first time period is consistent with the duration of the first clip, and the duration of the second time period is consistent with the duration of the second clip.
[0140] As another example, taking the example that the time parameters of the target event only include the termination moment, the first video clip may include: video data shot by the motion camera in a third time period before the termination moment, and video data shot by the motion camera in a fourth time period after the termination moment; wherein the duration of the third time period is consistent with the duration of the first clip, and the duration of the fourth time period is consistent with the duration of the second clip.
[0141] As another example, taking the example that the time parameters of the target event include both the start occurrence time and the end occurrence time, the first video clip may include: video data shot by the motion camera in a first time period before the start occurrence time, video data shot by the motion camera in a time period between the start occurrence time and the end occurrence time, and video data shot by the motion camera in a fourth time period after the end occurrence time.
[0142] Step S404: store the first video clip.
[0143] In the embodiment of the present disclosure, the first video clip may be stored in an internal storage space of the central control host (eg, a large-capacity erasable storage space).
[0144] In any embodiment of the present disclosure, after obtaining the first video clip, the central control host may further process the first video clip and transmit the processed video clip to the mobile terminal, so that the user on the mobile terminal side can display, edit, share or upload the video clip. As an example, after obtaining the first video clip, the central control host may further perform the following steps:
[0145] 1) From multiple candidate animation models, determine the target animation model that is compatible with the event type of the target event.
[0146] The event types of the target event include, but are not limited to, flying, flipping, drifting, and the like.
[0147] Among them, the candidate motion effect model is a pre-configured motion effect model used to add motion effects to the video.
[0148] Each candidate motion effect model is associated with or adapted to an event type.
[0149] 2) Based on video feature extraction technology, key features are extracted from the first video clip.
[0150] Among them, key features include but are not limited to scene change features, character action features, specific objects or signs and other features.
[0151] 3) Based on the target motion effect model and key features, the first video clip is processed with motion effects to obtain a second video clip.
[0152] As an example, the target motion effect model can be fused with the first video clip to ensure that the motion effect is closely integrated with the video content without causing any abruptness. Afterwards, the start time, end time and position of the motion effect in the first video clip can be adjusted to match the key features of the first video clip.
[0153] 4) Sending the second video clip to a mobile terminal bound to the vehicle; wherein the second video clip is used by the mobile terminal to perform at least one of the following operations: displaying the second video clip; editing the second video clip; sharing the second video clip or the edited second video clip to a social platform.
[0154] In summary, based on the target motion effect model adapted to the event type of the target event and the key features of the first video clip, the edited first video clip is animated to enhance the visual effect of the video processing. Moreover, the processed video clip is shared to a mobile terminal bound to the vehicle, so that users can browse, edit or share the video clip in time, thereby improving the user experience.
[0155] The event detection method of the disclosed embodiment can enable the central control host to integrate key data associated with the target event in the vehicle's driving status data into the video data captured by the motion camera, thereby improving the content richness of the edited video clips.
[0156] Below in conjunction with embodiment A and embodiment B, Figure 4 The event detection and video editing principles of the central control host shown are explained in detail.
[0157] Embodiment A: When a sports camera installed in front of a vehicle is shooting a video, the original video data is directly transmitted to the vehicle central control host in real time through a data cable (such as a data transmission cable using a USB (Universal Serial Bus) Type-C interface) for storage. The central control host is responsible for editing and storing wonderful video clips to ensure that the wonderful video clips are not overwritten. Figure 5 As shown, embodiment A mainly includes the following steps:
[0158] Step 1: Power on the vehicle.
[0159] Step 2: The action camera installed in the vehicle starts and records the video.
[0160] Step 3: The sports camera transmits the recorded original video data to the central control host in real time.
[0161] Step 4: The central control host receives and stores the original video data.
[0162] Step 5: The central control host monitors the vehicle CAN bus and status signal to obtain the vehicle's driving status data. If the driving status data triggers the event triggering condition of the target event, it is determined that the vehicle has a wonderful target event. At this time, step 7 and subsequent steps can be executed. Alternatively, step 6: If the user triggers the vehicle's physical button, it is determined that the vehicle has a wonderful target event. At this time, step 7 and subsequent steps can be executed.
[0163] Step 7: The central control host marks the original video data. For example, the original video data is marked with time points based on the start time and / or end time of the target event, or the original video data is marked based on key data associated with the target event in the driving status data. For example, assuming that the target event is a take-off event, the vehicle's height from the ground, the length of time off the ground, etc. can be marked.
[0164] Step 8: The central control host edits the marked original video data to obtain wonderful video clips and stores them.
[0165] Step 9: The central control host performs motion effect processing on the video clip according to the motion effect model to obtain a wonderful video clip (hereinafter referred to as a short video).
[0166] Step 10: The central control host transmits the wonderful short video to the mobile terminal.
[0167] Step 11: The user on the mobile terminal side edits the wonderful short video again.
[0168] Step 12: The user on the mobile terminal side shares the wonderful short video to the social platform.
[0169] Embodiment B: The sports camera installed in front of the vehicle first stores the original video data in segments according to a fixed short period (such as 3 minutes) in the local sports camera. After the storage is completed, while the video is continuously shot, the segmented original video clips are transmitted to the central control host through a data cable (such as a data transmission cable using a USB Type-C interface) for storage. The central control host is then responsible for editing and storing the wonderful video clips to ensure that the wonderful video clips are not overwritten. Figure 6 As shown, embodiment B mainly includes the following steps:
[0170] Step 1': Power on the vehicle.
[0171] Step 2': The action camera installed in the vehicle starts and records the video.
[0172] Step 3': The motion camera stores the recorded original video data in segments.
[0173] Step 4': The action camera records the video while transmitting the segmented original video clips to the central control host.
[0174] Step 5': The central control host receives and stores the original video clip.
[0175] Step 6': The central control host monitors the vehicle CAN bus and status signal to obtain the vehicle's driving status data. If the driving status data triggers the event triggering condition of the target event, it is determined that the vehicle has a wonderful target event. At this time, step 8' and subsequent steps can be executed. Alternatively, step 7': If the user triggers the vehicle's physical button, it is determined that the vehicle has a wonderful target event. At this time, step 8' and subsequent steps can be executed.
[0176] Step 8': The central control host marks the stored original video data (or original video clip).
[0177] Step 9': The central control host edits the marked original video data to obtain wonderful video clips and stores them.
[0178] Step 10': the central control host performs motion effect processing on the above video clips according to the motion effect model to obtain wonderful video clips (hereinafter referred to as short videos).
[0179] Step 11': The central control host transmits the wonderful short video to the mobile terminal.
[0180] Step 12': The user on the mobile terminal side edits the wonderful short video again.
[0181] Step 13': The user on the mobile terminal side shares the wonderful short video to the social platform.
[0182] The present disclosure also proposes an event detection method. Figure 7 A flow chart of another event detection method provided by an embodiment of the present disclosure is provided. The event detection method can be executed by a central control host of a vehicle.
[0183] It should be noted that the event detection method can be executed alone, or it can be executed in combination with any embodiment of the present disclosure or a possible implementation method in an embodiment, or it can be executed in combination with any technical solution in the relevant technology, and the embodiments of the present disclosure are not limited to this.
[0184] like Figure 7 As shown, in Figure 3Based on the illustrated embodiment, step S303 may include the following steps S701 to S703:
[0185] Step S701: Send a video editing instruction carrying a time parameter to a motion camera.
[0186] Among them, the original video data captured by the sports camera is only stored locally in the sports camera instead of being transmitted to the central control host for storage.
[0187] In the disclosed embodiment, the central control host may send a video editing instruction carrying the time parameter of the target event to the motion camera.
[0188] Step S702, receiving a first video clip sent by a motion camera; wherein the first video clip is obtained by the motion camera responding to a video clipping instruction, querying a first clipping duration and a second clipping duration associated with a target event, and clipping the video data shot and stored by the motion camera according to the time parameter, the first clipping duration, and the second clipping duration.
[0189] The first editing duration is used to edit the video clip before the target event occurs, and the second editing duration is used to edit the video clip after the target event occurs.
[0190] In the embodiment of the present disclosure, after receiving the video clipping instruction, the motion camera can respond to the video clipping instruction, query the first clipping duration and the second clipping duration associated with the target event, and clip the video data shot and stored by the motion camera according to the time parameter of the target event, the first clipping duration and the second clipping duration to obtain the first video segment. The implementation principle is similar to steps S402 to S403, and will not be described in detail here.
[0191] After editing the first video clip, the motion camera may send the first video clip to the central control host. Correspondingly, the central control host may receive the first video clip sent by the motion camera.
[0192] Step S703: store the first video clip.
[0193] In the embodiment of the present disclosure, the first video clip may be stored in an internal storage space of the central control host (eg, a large-capacity erasable storage space).
[0194] The event detection method of the disclosed embodiment can realize video editing not only by the central control host, but also by the motion camera, which can improve the flexibility and applicability of the method.
[0195] Below in conjunction with Example C, Figure 7 The event detection and video editing principles of the central control host shown are explained in detail.
[0196] Embodiment C: The original video data shot by the sports camera installed in front of the vehicle is stored locally in the sports camera. When the central control host sends a video editing instruction to the sports camera, the sports camera responds to the video editing instruction, edits wonderful video clips from the original video data, and stores them locally in the sports camera to ensure that the wonderful video clips are not overwritten. While continuously shooting the video, the sports camera transmits the edited and stored wonderful video clips to the central control host via a data cable (such as a data transmission cable using a USB Type-C interface) for storage. Figure 8 As shown, Example C mainly includes the following steps:
[0197] Step a: Power on the vehicle.
[0198] Step b: The action camera installed in the vehicle starts and records the video.
[0199] Step c: The sports camera stores the recorded original video data locally.
[0200] Step d: The central control host monitors the vehicle CAN bus and status signal to obtain the vehicle's driving status data. If the driving status data triggers the event triggering condition of the target event, it is determined that the vehicle has a wonderful target event. At this time, step f and subsequent steps can be executed. Alternatively, step e: If the user triggers the vehicle's physical button, it is determined that the vehicle has a wonderful target event. At this time, step f and subsequent steps can be executed.
[0201] Step f: The central control host sends a video editing instruction to the sports camera.
[0202] Step g: The motion camera marks the original video data captured.
[0203] Step h: The motion camera edits the marked original video data to obtain wonderful video clips.
[0204] Step i: The action camera records the video and transmits the edited video clips to the central control host.
[0205] Step j: The central control host receives and stores the edited video clips.
[0206] Step k: The central control host performs motion effect processing on the video clip according to the motion effect model to obtain a wonderful video clip (hereinafter referred to as a short video).
[0207] Step 1: The central control host transmits the wonderful short video to the mobile terminal.
[0208] Step m: The user on the mobile terminal side edits the wonderful short video again.
[0209] Step n: The user on the mobile terminal side shares the wonderful short video to the social platform.
[0210] The present disclosure also provides an event detection method, Fig. 9 A flow chart of another event detection method provided by an embodiment of the present disclosure is provided. The event detection method can be executed by a motion camera installed in a vehicle, wherein the motion camera stores the captured video data locally.
[0211] It should be noted that the event detection method can be executed alone, or it can be executed in combination with any embodiment of the present disclosure or a possible implementation method in an embodiment, or it can be executed in combination with any technical solution in the relevant technology, and the embodiments of the present disclosure are not limited to this.
[0212] like Fig. 9 As shown, in Figure 3 Based on the illustrated embodiment, step S303 may include the following steps S901 to S904:
[0213] Step S901: marking the video data captured and stored by the motion camera based on the time parameter and the driving status data.
[0214] Among them, the original video data captured by the sports camera is only stored locally in the sports camera instead of being transmitted to the central control host for storage.
[0215] In the embodiment of the present disclosure, the motion camera can mark the captured and stored video data based on the time parameter of the target event and the driving state data. The implementation principle is similar to step S401 and will not be described in detail here.
[0216] Step S902: query the first clip duration and the second clip duration associated with the target event.
[0217] The first editing duration is used to edit the video clip before the target event occurs, and the second editing duration is used to edit the video clip after the target event occurs.
[0218] It should be noted that the implementation principle of step S902 is similar to that of step S402 and will not be elaborated here.
[0219] Step S903 , clipping the marked video data according to the time parameter, the first clipping duration, and the second clipping duration to obtain a first video segment.
[0220] It should be noted that the implementation principle of step S903 is similar to that of step S403 and will not be elaborated here.
[0221] Step S904: store the first video clip.
[0222] In the embodiment of the present disclosure, the sports camera may store the first video clip locally in the camera.
[0223] Furthermore, the motion camera can also send the first video clip to the central control host of the vehicle for storage, so that the central control host can perform the following operations: determine the target motion effect model that is adapted to the event type of the target event from a plurality of candidate motion effect models; extract key features from the first video clip; perform motion effect processing on the first video clip based on the target motion effect model and the key features to obtain a second video clip; send the second video clip to a mobile terminal bound to the vehicle; wherein the second video clip is used for the mobile terminal to perform at least one of the following operations: display the second video clip; edit the second video clip; share the second video clip or the edited second video clip to a social platform. The implementation principle can be found in the relevant description in the above embodiment, which will not be elaborated here.
[0224] The event detection method of the disclosed embodiment can realize communication between the motion camera and the CAN bus of the whole vehicle to obtain the driving status data of the vehicle, and automatically edit the first video clip associated with the target event based on the driving status data or the trigger status of the setting control of the vehicle, without the need for the motion camera to interact with the central control host (such as sending a video editing instruction) to edit the first video clip, which can improve the timeliness of video editing.
[0225] In conjunction with Example D, Fig. 9 The event detection and video editing principles of the motion camera shown are explained in detail.
[0226] Embodiment D: The original video data shot by the sports camera installed in front of the vehicle is stored locally. The sports camera automatically marks and edits the wonderful video clips and stores them locally to ensure that the wonderful video clips are not overwritten. While continuously shooting videos, the sports camera transmits the edited and stored wonderful video clips to the central control host via a data cable (such as a data transmission cable using a USB Type-C interface) for storage. Fig.10 As shown, embodiment D mainly includes the following steps:
[0227] Step a': Power on the vehicle.
[0228] Step b': The motion camera installed in the vehicle starts and records the video.
[0229] Step c': The motion camera stores the recorded original video data locally.
[0230] Step d': The central control host monitors the vehicle CAN bus and status signal to obtain the vehicle's driving status data. If the driving status data triggers the event triggering condition of the target event, it is determined that the vehicle has a wonderful target event. At this time, step f' and subsequent steps can be executed. Alternatively, step e': If the user triggers the vehicle's physical button, it is determined that the vehicle has a wonderful target event. At this time, step f' and subsequent steps can be executed.
[0231] Step f': The motion camera marks the original video data.
[0232] Step g': the motion camera edits the marked original video data to obtain wonderful video clips.
[0233] Step h': the sports camera records the video and transmits the edited video clips to the central control host.
[0234] Step i': The central control host receives and stores the edited video clips.
[0235] Step j': the central control host performs motion effect processing on the video clip according to the motion effect model to obtain a wonderful video clip (hereinafter referred to as a short video).
[0236] Step k': The central control host transmits the wonderful short video to the mobile terminal.
[0237] Step 1': The user on the mobile terminal side edits the wonderful short video again.
[0238] Step m': The user on the mobile terminal side shares the wonderful short video to the social platform.
[0239] In any embodiment of the present disclosure, the present disclosure proposes a vehicle editing and generating short video system (the structure can be as follows Fig.11 As shown in the figure, the short video system includes a sports camera installed in front of the vehicle, a central control host of the vehicle, a mobile terminal APP and other modules. Fig.11 In the process, the central control host supplies 5V (volts) to the action camera, and the central control host and the action camera transmit data. The central control host communicates with the mobile terminal through vehicle-to-vehicle interconnection technologies such as USB, WIFI (Wireless Fidelity), BLE (Bluetooth Low Energy) and other technologies. This disclosure mainly proposes strategies for the physical connection, continuous power supply, video editing, transmission, and data synthesis of the action camera as a front-mounted part of the vehicle. Among them,
[0240] 1. A dedicated slot structure is designed at the A-pillar of the vehicle, and the action camera can be directly installed in the slot (referred to as the first slot in this disclosure), and the user can install and remove the action camera at will; a dedicated slot structure is designed at the roof, and the selfie stick dedicated to the action camera can be directly installed in the slot (referred to as the second slot in this disclosure), and the user can install and remove the selfie stick at will. In this way, the problem that the action camera purchased by ordinary users does not have a completely matching fixing structure when installed in the vehicle can be solved, and the action camera can be prevented from being easily dropped due to insecure fixing, thereby damaging the action camera.
[0241] 2. The dedicated card slot of the vehicle is designed with a data cable to continuously power and charge the action camera. This can solve the problem that the action camera purchased by ordinary users cannot be continuously powered and can only use the built-in battery of the action camera, and can realize continuous power supply for the action camera.
[0242] 3. The vehicle's dedicated card slot is designed with a data cable. The original video data shot by the vehicle's front-mounted sports camera is transmitted to the vehicle's central control host for storage in real time through the data cable. The sports camera does not need to have a memory. When the internal storage space of the central control host is full, the original video data with the old timestamp can be automatically overwritten to ensure that the sports camera can continue to record and store new video data. This can solve the problem of small capacity of the sports camera memory card purchased by ordinary users, and avoid the situation where the video recording stops after the storage capacity is full.
[0243] 4. The vehicle's central control host or sports camera can automatically edit video clips of wonderful moments, which can solve the problem of ordinary users spending a lot of time viewing and editing videos.
[0244] 5. The vehicle's central control host integrates the vehicle's key CAN data into the video clips, which can solve the problem that the video clips recorded and edited by ordinary users are relatively single.
[0245] 6. The vehicle's central control host automatically synthesizes wonderful video clips, which can solve the problem that ordinary users need to manually synthesize video clips.
[0246] As an example, the video data stream is designed as follows:
[0247] 1. The sports camera installed on the front of the vehicle shoots and generates original video data.
[0248] 2. The sports camera installed in the front of the vehicle or the central control host of the vehicle can edit wonderful video clips.
[0249] 3. After obtaining the wonderful video clips, the vehicle's central control host processes the data and special effects of the video clips according to the motion effect model to synthesize a wonderful short video.
[0250] 4. The vehicle's central control host transmits the short video to the mobile terminal APP side through terminal interconnection.
[0251] 5. The mobile terminal APP shares the short video to the social platform.
[0252] As an example, the event detection and video clipping logic is as follows:
[0253] 1. Based on the vehicle's driving status data, automatically determine whether the vehicle has an exciting target event, and automatically edit the video when it is determined that an exciting target event has occurred:
[0254] The central control host or sports camera communicates with the vehicle CAN bus, and can monitor data buried point signals through the CAN bus, including the "vehicle lift-off / landing" signal broadcast by the vehicle's electronic suspension system, the "steering wheel angular speed" signal and "steering wheel angle" signal broadcast by the body electronic stability system, the "accelerator pedal opening" signal, "brake pedal opening" signal, "instantaneous power" signal broadcast by the vehicle controller, and the vehicle pitch angle, vehicle tilt angle status, etc. monitored by the built-in 6-axis gyroscope of the central control host. When the central control host or the motion camera determines, based on the above signals, that the vehicle has lifted off the ground / landed, or the steering wheel angular speed is greater than 60° / s, or the steering wheel angle is greater than 600°, or the accelerator pedal opening is greater than 98%, or the brake pedal opening is greater than 98%, or the instantaneous power is greater than 2000W, or the vehicle pitch angle is greater than 30°, or the vehicle tilt angle is greater than 30°, at least one of the following occurs, it can be determined that a wonderful target event has occurred in the vehicle. At this time, the central control host or the motion camera will mark the original video data to obtain a marking point (for example, the marking point is used to indicate the start and end time of the target event), and based on the marking point, a video clip from 3 seconds before the marking point to 7 seconds after the marking point is edited, and the edited video clip is stored to ensure that this wonderful video clip is not overwritten.
[0255] 2. Based on the trigger status of the physical button, determine whether an exciting target event occurs in the vehicle, and edit the video when the trigger status indicates that the physical button is manually triggered:
[0256] The user manually operates the physical buttons, or the central control host sends a video editing command to the sports camera to perform video editing, or the central control host performs video editing to edit a video clip from 3 seconds before the marked point to 7 seconds after the marked point, and stores the edited video clip to ensure that this wonderful video clip is not overwritten.
[0257] In order to implement the above embodiments, the present disclosure also provides an event detection device.
[0258] Fig.12 A schematic diagram of the structure of an event detection device provided in an embodiment of the present disclosure.
[0259] like Fig.12 As shown, the event detection device 1200 includes: a first acquisition module 1210 , a second acquisition module 1220 and a detection module 1230 .
[0260] The first acquisition module 1210 is used to acquire a first broadcast signal broadcast by an electronic suspension system of the vehicle and a second broadcast signal broadcast by an electronic stability system;
[0261] The second acquisition module 1220 is used to acquire the third broadcast signal broadcast by the vehicle controller of the vehicle and the vehicle posture data monitored by the inertial sensor;
[0262] The detection module 1230 is used to detect whether a target event occurs in the vehicle according to the first broadcast signal, the second broadcast signal, the third broadcast signal and the vehicle posture data.
[0263] In a possible implementation of the embodiment of the present disclosure, the detection module 1230 is specifically used to: determine whether the first broadcast signal, the second broadcast signal, the third broadcast signal and the vehicle posture data meet the event trigger condition associated with the target event; if the event trigger condition is met, it is determined that the target event has occurred in the vehicle; if the event trigger condition is not met, it is determined that the target event has not occurred in the vehicle.
[0264] In a possible implementation of the embodiment of the present disclosure, the first broadcast signal includes at least one of a vehicle lift-off signal and a vehicle landing signal; the second broadcast signal includes at least one of a steering wheel angular velocity signal and a steering wheel angle signal; the third broadcast signal includes at least one of an accelerator pedal opening signal, a brake pedal opening signal and an instantaneous power signal; the vehicle posture data includes at least one of a vehicle pitch angle and a vehicle tilt angle.
[0265] In a possible implementation of the embodiment of the present disclosure, the event trigger condition includes at least one of the following: the vehicle state indicated by the vehicle lift-off signal switches from the landing state to the lift-off state; the vehicle landed signal indicates that the vehicle state switches from the lift-off state to the landing state; the steering wheel angular velocity indicated by the steering wheel angular velocity signal is greater than the set angular velocity; the steering wheel angle indicated by the steering wheel angle signal is greater than the set angle; the accelerator pedal opening indicated by the accelerator pedal opening signal is greater than the first set opening; the brake pedal opening indicated by the brake pedal opening signal is greater than the second set opening; the vehicle instantaneous power indicated by the instantaneous power signal is greater than the set power; the vehicle pitch angle in the vehicle posture data is greater than the set pitch angle; the vehicle tilt angle in the vehicle posture data is greater than the set tilt angle.
[0266] In a possible implementation of the embodiment of the present disclosure, the set steering wheel angular velocity is 60° / s, the set steering wheel angle is 600°, the first set accelerator pedal opening is 98%, the second set brake pedal opening is 98%, the set vehicle instantaneous power is 2000W, the set pitch angle of the vehicle is 30°, and the set tilt angle of the vehicle is 30°.
[0267] In a possible implementation of the embodiment of the present disclosure, the event detection device 1200 further includes:
[0268] The first determination module is used to determine that a target event occurs in the vehicle in response to monitoring a trigger operation on a setting control of the vehicle.
[0269] In a possible implementation of the embodiment of the present disclosure, the event detection device 1200 further includes:
[0270] A second determination module is used to determine the time parameters of the target event based on the monitored trigger time of the trigger operation of the setting control of the vehicle or the driving state data of the vehicle; wherein the time parameters include the starting time and / or the ending time of the target event occurring in the vehicle; the driving state data includes the first broadcast signal, the second broadcast signal, the third broadcast signal and the vehicle posture data;
[0271] The first processing module is used to obtain and store a first video clip matching the target event based on a time parameter; wherein the first video clip is obtained by editing video data shot by a motion camera installed in the vehicle based on the time parameter.
[0272] In a possible implementation of the embodiment of the present disclosure, a central control host applied to a vehicle, a first processing module, is specifically used to: mark the video data sent by a motion camera based on time parameters and driving status data; query a first editing duration and a second editing duration associated with a target event; wherein the first editing duration is used to edit the video clip before the target event occurs, and the second editing duration is used to edit the video clip after the target event occurs; according to the time parameter, the first editing duration and the second editing duration, the marked video data is edited to obtain a first video clip; and the first video clip is stored.
[0273] In a possible implementation of the embodiment of the present disclosure, the motion camera transmits the captured video data to the central control host in real time for storage; or, the motion camera segments the captured video data according to a set duration, stores the segmented video data locally, and sends the segmented video data to the central control host for storage.
[0274] In a possible implementation of the embodiment of the present disclosure, a central control host applied to a vehicle, a first processing module, is specifically used to: send a video editing instruction carrying a time parameter to a motion camera; receive a first video clip sent by the motion camera; wherein the first video clip is obtained by the motion camera responding to the video editing instruction, querying a first editing duration and a second editing duration associated with a target event, and editing the video data shot and stored by the motion camera according to the time parameter, the first editing duration, and the second editing duration; and storing the first video clip.
[0275] In a possible implementation of the embodiment of the present disclosure, applied to a sports camera, the first processing module is specifically used to: mark the video data shot and stored by the sports camera based on the time parameter and the driving status data; query the first clipping duration and the second clipping duration associated with the target event; according to the time parameter, the first clipping duration and the second clipping duration, the marked video data is clipped to obtain a first video clip; and the first video clip is stored.
[0276] In a possible implementation of the embodiment of the present disclosure, the event detection device 1200 further includes:
[0277] The first sending module is used to send the first video clip to the central control host of the vehicle for storage.
[0278] In a possible implementation of the embodiment of the present disclosure, the event detection device 1200 is applied to a central control host of a vehicle, and further includes:
[0279] A second determination module is used to determine a target motion effect model that is adapted to the event type of the target event from a plurality of candidate motion effect models;
[0280] An extraction module, configured to extract key features from the first video clip;
[0281] A second processing module, configured to perform motion effect processing on the first video segment based on the target motion effect model and the key features to obtain a second video segment;
[0282] The second sending module is used to send the second video clip to the mobile terminal bound to the vehicle; wherein the second video clip is used by the mobile terminal to perform at least one of the following operations: display the second video clip; edit the second video clip; share the second video clip to a social platform.
[0283] In a possible implementation of the embodiment of the present disclosure, the sports camera is installed in a first card slot, which is arranged in the area where a metal pillar of the vehicle is located, and the metal pillar is used to connect the front windshield and the front door of the vehicle; and / or, the auxiliary shooting component connected to the sports camera is installed in a second card slot, which is arranged on the roof of the vehicle.
[0284] In a possible implementation of the embodiment of the present disclosure, a first data line is provided at the first card slot, and the first data line is used to power or charge the sports camera, and / or, the first data line is used for the sports camera to transmit the captured video data to the central control host of the vehicle for storage; and / or, a second data line is provided at the second card slot, and the second data line is used to power or charge the sports camera, and / or, the second data line is used for the sports camera to transmit the captured video data to the central control host of the vehicle for storage.
[0285] It should be noted that the event detection device provided in the embodiment of the present disclosure can achieve the above Figures 1 to 10 All the method steps implemented in the method embodiment can achieve the same technical effect, and the parts and beneficial effects of this embodiment that are the same as those in the method embodiment will not be described in detail here.
[0286] In order to implement the above embodiments, the present disclosure also proposes an electronic device, wherein the electronic device can be any device with computing capabilities, and the electronic device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the program, it implements the event detection method proposed in any of the aforementioned embodiments of the present disclosure.
[0287] In order to implement the above embodiments, the present disclosure further proposes a non-temporary computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the event detection method proposed in any of the above embodiments of the present disclosure is implemented.
[0288] In order to implement the above embodiments, the present disclosure further proposes a computer program product. When instructions in the computer program product are executed by a processor, the event detection method proposed in any of the above embodiments of the present disclosure is executed.
[0289] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present disclosure. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.
[0290] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of the present disclosure, "plurality" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.
[0291] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present disclosure includes additional implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present disclosure belong.
[0292] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purposes of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples (non-exhaustive list) of computer-readable media include the following: an electrical connection with one or more wires (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.
[0293] It should be understood that the various parts of the present disclosure can be implemented in hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.
[0294] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.
[0295] In addition, each functional unit in each embodiment of the present disclosure may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.
[0296] The storage medium mentioned above may be a read-only memory, a disk or an optical disk, etc. Although the embodiments of the present disclosure have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations of the present disclosure. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present disclosure.
Claims
1. An event detection method, characterized in that: include: Acquire a first broadcast signal broadcast by an electronic suspension system of a vehicle and a second broadcast signal broadcast by an electronic stability system; Acquire a third broadcast signal broadcast by a vehicle controller of the vehicle and vehicle posture data monitored by an inertial sensor; Detecting whether a target event occurs to the vehicle according to the first broadcast signal, the second broadcast signal, the third broadcast signal and the vehicle posture data, wherein the target event is a wonderful event, and the wonderful event includes a flying event, a drifting event, a tail swing event or a flipping event; Determining a time parameter of the target event based on the monitored trigger time of the trigger operation of the setting control of the vehicle or the driving state data of the vehicle; Based on the time parameter, acquiring and storing a first video clip matching the target event; The first video clip is obtained by editing the video data shot by the motion camera installed in the vehicle based on the time parameter; The sports camera is detachably mounted in a first card slot, and the first card slot is arranged in an area where a metal pillar of the vehicle is located, and the metal pillar is used to connect the front windshield and the front door of the vehicle; and / or, The auxiliary shooting component connected to the sports camera is detachably installed in a second card slot, and the second card slot is arranged on the roof of the vehicle; The detecting whether a target event occurs in the vehicle according to the first broadcast signal, the second broadcast signal, the third broadcast signal and the vehicle posture data comprises: Determine whether the first broadcast signal, the second broadcast signal, the third broadcast signal and the vehicle posture data meet an event trigger condition associated with the target event, the event trigger condition comprising: a vehicle state indicated by a vehicle landing signal switches from a lift-off state to a landing state; If the event triggering condition is met, determining that the target event occurs on the vehicle; If the event triggering condition is not met, it is determined that the target event has not occurred in the vehicle.
2. The method according to claim 1, characterized in that: The first broadcast signal includes at least one of a vehicle lift-off signal and a vehicle landing signal; The second broadcast signal includes at least one of a steering wheel angular velocity signal and a steering wheel angle signal; The third broadcast signal includes at least one of an accelerator pedal opening signal, a brake pedal opening signal and an instantaneous power signal; The vehicle posture data includes at least one of a vehicle pitch angle and a vehicle tilt angle.
3. The method according to claim 2, characterized in that The event triggering condition also includes at least one of the following: The vehicle state indicated by the vehicle lift-off signal switches from the grounded state to the lift-off state; The steering wheel angular speed indicated by the steering wheel angular speed signal is greater than the set angular speed; The steering wheel angle indicated by the steering wheel angle signal is greater than the set angle; The accelerator pedal opening indicated by the accelerator pedal opening signal is greater than a first set opening; The brake pedal opening indicated by the brake pedal opening signal is greater than a second set opening; The instantaneous power of the vehicle indicated by the instantaneous power signal is greater than the set power; The vehicle pitch angle in the vehicle posture data is greater than the set pitch angle; The vehicle tilt angle in the vehicle posture data is greater than the set tilt angle.
4. The method according to claim 3, characterized in that The set steering wheel angular velocity is 60° / s, the set angle of the steering wheel angle is 600°, the first set opening of the accelerator pedal is 98%, the second set opening of the brake pedal is 98%, the set power of the vehicle instantaneous power is 2000W, the set pitch angle of the vehicle pitch angle is 30°, and the set tilt angle of the vehicle tilt angle is 30°.
5. The method according to claim 1, characterized in that The method further comprises: In response to monitoring a triggering operation on a set control of the vehicle, it is determined that the target event occurs in the vehicle.
6. The method according to any one of claims 1 to 5, characterized in that The time parameter includes the starting time and / or ending time of the target event occurring at the vehicle; the driving status data includes the first broadcast signal, the second broadcast signal, the third broadcast signal and the vehicle posture data.
7. The method according to claim 6, characterized in that The method is executed by a central control host of the vehicle, and acquiring and storing a first video clip matching the target event based on the time parameter includes: Based on the time parameter and the driving status data, marking the video data sent by the motion camera; Querying a first clipping duration and a second clipping duration associated with the target event; wherein the first clipping duration is used to clip the video segment before the target event occurs, and the second clipping duration is used to clip the video segment after the target event occurs; According to the time parameter, the first editing duration, and the second editing duration, the marked video data is edited to obtain the first video segment; The first video segment is stored.
8. The method according to claim 7, characterized in that The motion camera transmits the captured video data to the central control host in real time for storage; or The motion camera segments the captured video data according to the set duration, stores the segmented video data locally, and sends the segmented video data to the central control host for storage.
9. The method according to claim 6, characterized in that The method is executed by a central control host of the vehicle, and acquiring and storing a first video clip matching the target event based on the time parameter includes: Sending a video editing instruction carrying the time parameter to the motion camera; Receive a first video clip sent by the motion camera; wherein the first video clip is obtained by the motion camera responding to the video clipping instruction, querying a first clipping duration and a second clipping duration associated with the target event, and clipping the video data shot and stored by the motion camera according to the time parameter, the first clipping duration, and the second clipping duration; The first video segment is stored.
10. The method according to claim 6, characterized in that The method is performed by the motion camera, and based on the time parameter, acquiring and storing a first video segment matching the target event includes: Based on the time parameter and the driving status data, marking the video data captured and stored by the motion camera; Querying a first clip duration and a second clip duration associated with the target event; According to the time parameter, the first clipping duration, and the second clipping duration, the marked video data is clipped to obtain the first video segment; The first video segment is stored.
11. The method according to claim 10, characterized in that The method further comprises: The first video clip is sent to a central control host of the vehicle for storage.
12. The method according to claim 6, characterized in that The method is executed by a central control host of the vehicle, and the method further includes: Determine a target motion effect model adapted to the event type of the target event from a plurality of candidate motion effect models; Extracting key features from the first video clip; Based on the target motion effect model and the key features, performing motion effect processing on the first video segment to obtain a second video segment; sending the second video clip to a mobile terminal bound to the vehicle; The second video clip is used by the mobile terminal to perform at least one of the following operations: displaying the second video clip; editing the second video clip; sharing the second video clip to a social platform.
13. The method according to claim 1, characterized in that A first data line is provided at the first card slot, and the first data line is used to power or charge the sports camera, and / or the first data line is used for the sports camera to transmit the captured video data to the central control host of the vehicle for storage; and / or, A second data cable is provided at the second card slot, and the second data cable is used to power or charge the sports camera, and / or, the second data cable is used for the sports camera to transmit the captured video data to the central control host of the vehicle for storage.
14. An event detection device, characterized in that: include: A first acquisition module, configured to acquire a first broadcast signal broadcast by an electronic suspension system of a vehicle and a second broadcast signal broadcast by an electronic stability system; A second acquisition module, used to acquire a third broadcast signal broadcast by a vehicle controller of the vehicle and vehicle posture data monitored by an inertial sensor; a detection module, configured to detect whether a target event occurs to the vehicle according to the first broadcast signal, the second broadcast signal, the third broadcast signal and the vehicle posture data, wherein the target event is a wonderful event, and the wonderful event includes a flying event, a drifting event, a tail swing event or a flipping event; The device is also used for: Determining a time parameter of the target event based on the monitored trigger time of the trigger operation of the setting control of the vehicle or the driving state data of the vehicle; Based on the time parameter, acquiring and storing a first video clip matching the target event; The first video clip is obtained by editing the video data shot by the motion camera installed in the vehicle based on the time parameter; The sports camera is detachably mounted in a first card slot, and the first card slot is arranged in an area where a metal pillar of the vehicle is located, and the metal pillar is used to connect the front windshield and the front door of the vehicle; and / or, The auxiliary shooting component connected to the sports camera is detachably installed in a second card slot, and the second card slot is arranged on the roof of the vehicle; The detecting whether a target event occurs in the vehicle according to the first broadcast signal, the second broadcast signal, the third broadcast signal and the vehicle posture data comprises: Determine whether the first broadcast signal, the second broadcast signal, the third broadcast signal and the vehicle posture data meet an event trigger condition associated with the target event, the event trigger condition comprising: a vehicle state indicated by a vehicle landing signal switches from a lift-off state to a landing state; If the event triggering condition is met, determining that the target event occurs on the vehicle; If the event triggering condition is not met, it is determined that the target event has not occurred in the vehicle.
15. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the event detection method according to any one of claims 1 to 13. 16 . A computer-readable storage medium, when instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the event detection method according to any one of claims 1 to 13.
17. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the event detection method according to any one of claims 1 to 13 is implemented.
