Video shooting method and device and storage medium

Abstract

The invention relates to a video shooting method and device and a storage medium, and the method comprises the steps: responding to a shooting instruction, and enabling a terminal to collect a video frame image at a first frame rate; in the acquisition process of the video frame image, detecting motion information of a target object; if the motion information of the target object meets a preset condition, controlling the terminal to adjust a collection frame rate to a second frame rate; wherein the first frame rate is smaller than the second frame rate; and continuing to collect the video frame image based on the second frame rate.

Description

Technical Field

[0001] The present disclosure relates to the field of shooting technology, and in particular to a video shooting method, device and storage medium. Background Art

[0002] With the development of terminal technology, more and more shooting functions are available for terminals such as mobile phones or tablet computers. For example, a terminal may have multiple video shooting functions such as time-lapse photography and slow motion.

[0003] In order to capture fleeting wonderful shots in sports scenes or other scenes where the subject moves quickly, the terminal's slow-motion shooting function is usually used. However, the duration of such wonderful shots is very short. If the user manually determines the shooting time of slow-motion shooting, it is easy to miss the best shooting time; if the slow-motion shooting function is used to shoot the entire video directly, the video file will be too large, wasting the terminal's memory resources. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the present disclosure provides a video shooting method, device and storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, there is provided a video shooting method, including:

[0006] In response to the shooting instruction, the terminal captures video frame images at a first frame rate;

[0007] During the acquisition of the video frame images, detecting motion information of the target object;

[0008] If the motion information of the target object meets a preset condition, controlling the terminal to adjust the acquisition frame rate to a second frame rate; wherein the first frame rate is less than the second frame rate;

[0009] Based on the second frame rate, continue to capture video frame images.

[0010] Optionally, the method further comprises:

[0011] If the motion information of the target object does not meet the preset condition, and the acquisition frame rate is the second frame rate, the control terminal restores the acquisition frame rate to the first frame rate;

[0012] The video frame images are acquired based on the first frame rate.

[0013] Optionally, the method further comprises:

[0014] In response to a shooting stop instruction, acquiring the captured multiple video frame images and timing information of the multiple video frame images;

[0015] Determine the target playback frame rate;

[0016] Based on the timing information, a plurality of the video frame images are converted into a video file according to the target playback frame rate.

[0017] Optionally, generating a video file from the plurality of video frame images according to the target playback frame rate based on the timing information includes:

[0018] Based on the timing information, determining a playback order of the plurality of video frame images;

[0019] Based on the target playback frame rate, determining the playback duration of each of the video frame images;

[0020] A video file is generated based on the playback order of the multiple video frame images and the playback duration of each of the video frame images.

[0021] Optionally, the motion information includes at least: motion speed;

[0022] If the motion information of the target object meets a preset condition, controlling the terminal to adjust the acquisition frame rate to a second frame rate includes:

[0023] If the moving speed of the target object is greater than or equal to a preset speed threshold, the control terminal adjusts the acquisition frame rate to the second frame rate.

[0024] Optionally, the target object may include: a first target object and a second target object;

[0025] If the motion information of the target object meets a preset condition, controlling the terminal to adjust the acquisition frame rate to a second frame rate includes:

[0026] If the first target object and the second target object are simultaneously detected within the image acquisition range of the terminal, and the movement speed of the first target object is greater than or equal to a preset speed threshold, the control terminal adjusts the acquisition frame rate to the second frame rate.

[0027] Optionally, the method further comprises:

[0028] In response to a selection operation of a shooting mode, determining a target shooting mode from a plurality of shooting modes;

[0029] The speed threshold corresponding to the target shooting mode is determined as the preset speed threshold; different shooting modes correspond to different speed thresholds.

[0030] Optionally, detecting motion information of the target object includes:

[0031] A dynamic vision sensor (DVS) is used to detect the motion of the target object to obtain the motion information.

[0032] According to a second aspect of an embodiment of the present disclosure, there is provided a video shooting device, including:

[0033] A capture module, configured to respond to a shooting instruction, and the terminal captures video frame images at a first frame rate;

[0034] A detection module, which detects motion information of a target object during the acquisition of the video frame image;

[0035] An adjustment module, configured to control the terminal to adjust the acquisition frame rate to a second frame rate if the motion information of the target object meets a preset condition; wherein the first frame rate is less than the second frame rate;

[0036] The acquisition module is further used to continue acquiring video frame images based on the second frame rate.

[0037] Optionally, the adjustment module is further used to:

[0038] If the motion information of the target object does not meet the preset condition, and the acquisition frame rate is the second frame rate, the control terminal restores the acquisition frame rate to the first frame rate;

[0039] The video frame images are acquired based on the first frame rate.

[0040] Optionally, the device further includes: a playing module, configured to:

[0041] In response to a shooting stop instruction, acquiring the captured multiple video frame images and timing information of the multiple video frame images;

[0042] Determine the target playback frame rate;

[0043] Based on the timing information, a plurality of the video frame images are converted into a video file according to the target playback frame rate.

[0044] Optionally, the playback module is further used to:

[0045] Based on the timing information, determining a playback order of the plurality of video frame images;

[0046] Based on the target playback frame rate, determining the playback duration of each of the video frame images;

[0047] A video file is generated based on the playback order of the multiple video frame images and the playback duration of each of the video frame images.

[0048] Optionally, the motion information includes at least: motion speed;

[0049] The adjustment module is used for:

[0050] If the moving speed of the target object is greater than or equal to a preset speed threshold, the control terminal adjusts the acquisition frame rate to the second frame rate.

[0051] Optionally, the target object may include: a first target object and a second target object;

[0052] The adjustment module is used for:

[0053] If the first target object and the second target object are simultaneously detected within the image acquisition range of the terminal, and the movement speed of the first target object is greater than or equal to a preset speed threshold, the control terminal adjusts the acquisition frame rate to the second frame rate.

[0054] Optionally, the adjustment module is further used to:

[0055] In response to a selection operation of a shooting mode, determining a target shooting mode from a plurality of shooting modes;

[0056] The speed threshold corresponding to the target shooting mode is determined as the preset speed threshold; different shooting modes correspond to different speed thresholds.

[0057] Optionally, the detection module is further used to:

[0058] The motion of the target object is detected using a dynamic vision sensor DVS to obtain the motion information.

[0059] According to a third aspect of an embodiment of the present disclosure, there is provided a video shooting device, including:

[0060] processor;

[0061] a memory for storing executable instructions;

[0062] Wherein, the processor is configured to: when executing the executable instructions stored in the memory, implement the steps in the video shooting method described in the first aspect of the embodiment of the present disclosure.

[0063] According to the fourth aspect of the embodiments of the present disclosure, a non-temporary computer-readable storage medium is provided. When the instructions in the storage medium are executed by the processor of the video capture device, the video capture device can perform the steps in the video capture method described in the first aspect of the embodiments of the present disclosure.

[0064] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0065] In the process of using the terminal to collect video frame images at a first frame rate, the disclosed embodiment can detect the motion information of the target object, and when the motion information of the target object meets the preset condition for triggering the terminal to adjust the acquisition frame rate, the acquisition frame rate is adjusted from the first frame rate to the second frame rate, that is, the acquisition frame rate of the terminal is increased; and the second frame rate is used to continue to collect video frame images. In this way, during the video shooting process, the shooting of slow-motion video can be automatically triggered according to the motion information of the target object, so that when the motion state of the target object changes, the acquisition frame rate can be adjusted in time. On the one hand, there is no need for manual triggering by the user, which reduces the situation where the timing of starting the shooting of slow-motion video is inappropriate; on the other hand, compared with the method of directly shooting all videos at a high frame rate, the disclosed embodiment can dynamically adjust the acquisition frame rate according to the motion information of the target object, so that the collected video frame image can not only display the motion information of the target object more clearly, but also reduce the memory usage of the collected video frame image, so as to save the memory resources of the terminal.

[0066] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0067] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0068] Figure 1 is a schematic diagram of a video shooting method according to an exemplary embodiment Figure 1 ;

[0069] Figure 2 is a schematic diagram of a video shooting method according to an exemplary embodiment Figure 2 ;

[0070] Figure 3 is a schematic structural diagram of a video shooting device according to an exemplary embodiment;

[0071] Figure 4 It is a block diagram of a terminal according to an exemplary embodiment. DETAILED DESCRIPTION

[0072] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices consistent with some aspects of the present disclosure as detailed in the appended claims.

[0073] The present disclosure provides a video shooting method. Figure 1 As shown, Figure 1 is a schematic diagram of a video shooting method according to an exemplary embodiment Figure 1 The method comprises:

[0074] Step S101, in response to a shooting instruction, the terminal captures video frame images at a first frame rate;

[0075] Step S102, detecting motion information of a target object during the acquisition process of the video frame image;

[0076] Step S103, if the motion information of the target object meets a preset condition, controlling the terminal to adjust the acquisition frame rate to a second frame rate; wherein the first frame rate is less than the second frame rate;

[0077] Step S104: continue to capture video frame images based on the second frame rate.

[0078] The video shooting method shown in the embodiment of the present disclosure can be applied to a terminal equipped with an image acquisition device, and the terminal may include: a smart phone, a tablet computer or a wearable electronic device, etc.

[0079] The image acquisition device generally refers to a device in a terminal that can perform a shooting function, including a camera, and necessary processing modules and storage modules to complete image acquisition and transmission.

[0080] In step S101, in response to a shooting instruction input by a user, the terminal may start a camera and control the camera to capture video frame images at a first frame rate.

[0081] Here, the shooting command input by the user can be a command generated based on the user's start operation of the shooting button of the video shooting application in the terminal device, or it can be a command generated based on the call operation of other applications to the video shooting application, etc., and the present disclosure does not limit this.

[0082] The first frame rate may be a capture frame rate set by default by the terminal; or, the first frame rate may be a capture frame rate set by a user.

[0083] The acquisition frame rate is used to indicate the number of frames of images captured by the camera per second. It should be noted that the acquisition frame rate, also known as the acquisition frame rate, is measured in frames per second (fps). A camera can support multiple acquisition frame rates, for example, 30fps, 90fps, 120fps, and 480fps.

[0084] During the video shooting process of the terminal, the acquisition frame rate can refer to the number of static images acquired by the terminal per second. When the terminal plays the acquired static images at the same frame rate, the same number of static images are played per second. To the user, these static images will have a dynamic effect.

[0085] In the embodiment of the present disclosure, the terminal captures video frame images at a first frame rate, which can be understood as the terminal being in a normal video shooting mode.

[0086] In step S102, during the acquisition of the video frame image, the terminal may detect the target object within the image acquisition range to obtain the motion information of the target object.

[0087] The target object may be a dynamic object, that is, the video frame image targeted by the video shooting method of the embodiment of the present disclosure is an image obtained by capturing a moving target object.

[0088] The target object may be: a person, an animal, or a vehicle, etc.

[0089] In some embodiments, when there are multiple objects within the image acquisition range, the depth of each object may be acquired, and the object with the smallest depth may be determined as the target object.

[0090] In other embodiments, when there are multiple objects within the image acquisition range, one of the objects may be determined as the target object according to a selection operation by the user.

[0091] The motion sensor can be used to detect the motion of the target object within the image acquisition range to obtain the motion information of the target object.

[0092] In some embodiments, a motion detection algorithm may be used to detect a target object within the image acquisition range of the terminal to obtain motion information of the target object.

[0093] When acquiring the motion information of the target object, the motion information may be acquired at a certain frequency, that is, the motion information from the initial moment of the motion or the moment when the motion information was last acquired to the current moment is acquired at every preset time interval.

[0094] Here, the motion information may include, but is not limited to: motion direction, motion position, motion trajectory, motion distance, motion speed and / or motion acceleration.

[0095] In step S103, after the motion information of the target object is obtained, it may be determined whether the motion information of the target object meets a preset condition based on the motion information of the target object.

[0096] Here, the preset condition may be a trigger condition for triggering the terminal to adjust the acquisition frame rate. The preset condition may be set according to actual needs, and the embodiment of the present disclosure does not limit this.

[0097] In some embodiments, the motion information of the target object satisfies a preset condition, which may indicate that the motion state of the target object changes rapidly. For example, the preset condition may be that the motion acceleration of the target object is greater than a preset acceleration threshold.

[0098] In the embodiment of the present disclosure, if the motion information of the target object meets the preset condition, the terminal can adjust the acquisition frame rate to the second frame rate. Here, the first frame rate is less than the second frame rate.

[0099] In some embodiments, the second frame rate may be a capture frame rate when the terminal shoots a slow-motion video.

[0100] It should be noted that when the motion state of the target object changes rapidly, in order to more clearly analyze the motion state of the target object, when the motion state of the target object is detected to change, the acquisition frame rate can be adjusted from the first frame rate to the second frame rate. This allows the number of video frame images captured by the terminal per second to increase during the video capture process, thereby capturing video frame images of the target object at a higher frame rate.

[0101] In the embodiment of the present disclosure, controlling the terminal to adjust the acquisition frame rate to the second frame rate can be understood as the terminal switching from a normal video shooting mode to a slow-motion video shooting mode.

[0102] In some embodiments, if the motion information of the target object does not meet the preset condition, the terminal may continue to capture video frame images at the first frame rate.

[0103] In step S104, after the terminal adjusts the acquisition frame rate to the second frame rate, the camera may be controlled to continue acquiring video frame images at the second frame rate.

[0104] It can be understood that the camera continues to capture video frame images at the second frame rate, which can be understood as the terminal in the slow-motion video shooting mode starting to capture video frame images.

[0105] In the process of using the terminal to collect video frame images at a first frame rate, the disclosed embodiment can detect the motion information of the target object, and when the motion information of the target object meets the preset condition for triggering the terminal to adjust the acquisition frame rate, the acquisition frame rate is adjusted from the first frame rate to the second frame rate, that is, the acquisition frame rate of the terminal is increased; and the second frame rate is used to continue to collect video frame images. In this way, during the video shooting process, the shooting of slow-motion video can be automatically triggered according to the motion information of the target object, so that when the motion state of the target object changes, the acquisition frame rate can be adjusted in time. On the one hand, there is no need for manual triggering by the user, which reduces the situation where the timing of starting the shooting of slow-motion video is inappropriate; on the other hand, compared with the method of directly shooting all videos at a high frame rate, the disclosed embodiment can dynamically adjust the acquisition frame rate according to the motion information of the target object, so that the collected video frame image can not only display the motion information of the target object more clearly, but also reduce the memory usage of the collected video frame image, so as to save the memory resources of the terminal.

[0106] Optionally, the method further comprises:

[0107] If the motion information of the target object does not meet the preset condition, and the acquisition frame rate is the second frame rate, the control terminal restores the acquisition frame rate to the first frame rate;

[0108] The video frame images are acquired based on the first frame rate.

[0109] In the embodiment of the present disclosure, during the process of the terminal collecting video frame images at the second frame rate, the terminal may keep monitoring the motion of the target object to continuously obtain the motion information of the target object.

[0110] If the motion information of the target object does not meet the preset conditions and the acquisition frame rate of the terminal is the second frame rate, the terminal may adjust the acquisition frame rate from the second frame rate to the first frame rate, and control the camera to acquire video frame images at the first frame rate.

[0111] It should be noted that controlling the terminal to restore the acquisition frame rate to the first frame rate can be understood as the terminal switching from the slow-motion video shooting mode back to the normal video shooting mode.

[0112] In an embodiment of the present disclosure, when the terminal is collecting video frame images at a second frame rate, if the motion information of the target object does not meet a preset condition, that is, the motion state of the target object no longer changes rapidly, the camera's collection frame rate can be reduced, and the video frame images can be collected at a lower collection frame rate.

[0113] It is worth noting that, compared with capturing video frame images at the first frame rate, when the shooting duration is the same, the terminal captures video frame images at the second frame rate, obtains more video frame images, and occupies more memory. Therefore, when there is no need to perform slow motion shooting of the target object, the embodiment of the present disclosure controls the terminal to exit the slow motion video shooting mode in time to save the terminal's memory resources.

[0114] Optionally, the method further comprises:

[0115] In response to a shooting stop instruction, acquiring the captured multiple video frame images and timing information of the multiple video frame images;

[0116] Determine the target playback frame rate;

[0117] Based on the timing information, a plurality of the video frame images are converted into a video file according to the target playback frame rate.

[0118] In an embodiment of the present disclosure, during the acquisition of video frame images, if a shooting stop command input by the user is detected, the camera can be controlled to stop the acquisition of video frame images, and multiple video frame images captured by the camera during this acquisition process and the timing information corresponding to the multiple video frame images can be obtained.

[0119] Here, the shooting stop instruction can be an instruction generated based on the user's closing operation on the shooting button of the video shooting application in the terminal device, or an instruction generated based on the stop call operation of other applications on the video shooting application, etc., and the present disclosure does not limit this.

[0120] In the embodiment of the present disclosure, the multiple video frame images may include: multiple video frame images collected by the terminal at a first frame rate, and / or multiple video frame images collected by the terminal at a second frame rate.

[0121] The timing information may be information for indicating a time sequence between a plurality of video frame images.

[0122] The playback frame rate may refer to the number of static images played by the terminal per second. It is understandable that the collected multiple video frame images (static) are played at a certain playback frame rate to present a dynamic video display effect composed of multiple video frame images to the user.

[0123] The target playback frame rate may be the playback frame rate corresponding to the multiple video frames. It should be noted that in the relative technology, the playback frame rate of the video frames is usually determined according to the acquisition frame rate of the video frames, so that the multiple video frames present a dynamic display effect.

[0124] However, since the acquisition frame rates of multiple video frame images in the embodiments of the present disclosure may be different, if the playback frame rate of the video frame image is determined directly according to the acquisition frame rate of each video frame image; mixing multiple video frame images with different playback frame rates together will cause visual jumps or errors, affecting the user experience.

[0125] Based on this, it can be determined that the playback frame rates of the multiple video frame images are uniformly processed, and the playback frame rates of the multiple video frame images are set to the same frame rate value.

[0126] In some embodiments, the target playback frame rate of the plurality of video frame images may be set to a first frame rate.

[0127] According to the timing information of the multiple video frame images, the multiple video frame images can be organized into a plurality of temporally continuous video frame images, and after determining the target playback frame rates corresponding to the multiple video frame images, a video file displaying the video frame images at the target playback frame rate is generated based on the multiple temporally continuous video frame images.

[0128] After the video shooting is completed, the disclosed embodiment can sort the multiple video frame images according to the timing information of the multiple video frame images collected, and combine the sorted multiple video frame images into a video file according to the target playback frame rate, so as to unify the playback frame rates of the multiple video frame images with different acquisition frame rates, thereby reducing visual jumps or errors in the process of video file playback and improving the user experience.

[0129] Optionally, generating a video file from the plurality of video frame images according to the target playback frame rate based on the timing information includes:

[0130] Based on the timing information, determining a playback order of the plurality of video frame images;

[0131] Based on the target playback frame rate, determining the playback duration of each of the video frame images;

[0132] A video file is generated based on the playback order of the multiple video frame images and the playback duration of each of the video frame images.

[0133] In the embodiment of the present disclosure, the timing information of the video frame image may be the acquisition time of the video frame image.

[0134] The multiple video frame images may be sorted according to the acquisition time corresponding to each video frame image to determine the acquisition order of the multiple video frame images, that is, to determine the playback order of the multiple video frame images.

[0135] The number of video frames displayed per second by the terminal can be determined according to the target playback frame rate, and then the playback duration of each video frame can be determined. It can be understood that since the target playback frame rates of multiple video frames are the same, the playback duration of each video frame in the multiple video frames is the same.

[0136] After determining the playback duration of each video frame image, the playback time of each video frame image in the multiple video frame images can be determined according to the playback order of the multiple video frame images and the playback duration of each video frame image; and a video file can be generated according to the multiple video frame images and the corresponding playback times of the multiple video frame images.

[0137] Optionally, the motion information includes at least: motion speed;

[0138] If the motion information of the target object meets a preset condition, controlling the terminal to adjust the acquisition frame rate to a second frame rate includes:

[0139] If the moving speed of the target object is greater than or equal to a preset speed threshold, the control terminal adjusts the acquisition frame rate to the second frame rate.

[0140] In the embodiment of the present disclosure, the motion information may at least include: motion speed.

[0141] During the acquisition of the video frame image, the motion speed of the target object can be detected. If the motion speed of the target object is greater than a preset speed threshold, it can be determined that the motion information of the target object meets the preset condition, that is, the motion state of the target object changes rapidly. At this time, the terminal can adjust the acquisition frame rate from the first frame rate to the second frame rate.

[0142] Here, the speed threshold may be a default setting of the terminal or a user-defined setting, which is not limited in the embodiments of the present disclosure.

[0143] It can be understood that if the movement speed of the target object is greater than or equal to the speed threshold, it can be understood that the target object is in a fast movement state; at this time, in order to more clearly analyze the movement state of the target object, the terminal's acquisition frame rate can be increased.

[0144] It is worth noting that the embodiments of the present disclosure can accurately determine the change timing of the motion state of the target object based on the motion speed of the target object, thereby dynamically adjusting the acquisition frame rate of the terminal according to the change of the motion speed of the target object; so as to timely adjust the acquisition frame rate when the motion state of the target object changes, without the need for manual triggering by the user, thereby reducing the situation of inappropriate start timing of slow-motion video shooting.

[0145] Optionally, the target object may include: a first target object and a second target object;

[0146] If the motion information of the target object meets a preset condition, controlling the terminal to adjust the acquisition frame rate to a second frame rate includes:

[0147] If the first target object and the second target object are simultaneously detected within the image acquisition range of the terminal, and the movement speed of the first target object is greater than or equal to a preset speed threshold, the control terminal adjusts the acquisition frame rate to the second frame rate.

[0148] In the embodiment of the present disclosure, the target object may include: a first target object and a second target object.

[0149] During the video frame image acquisition process, the target object within the image acquisition range can be detected. If the first target object and the second target object are detected within the image acquisition range at the same time, and the movement speed of the first target object is greater than the preset speed threshold, it can be determined that the preset condition is met. At this time, the terminal can adjust the acquisition frame rate from the first frame rate to the second frame rate.

[0150] Taking into account some special sports scenes, such as football and basketball, it is necessary to analyze the fast movements of athletes on the ball. In the actual sports process, the athlete may be in a fast-moving state, but the athlete and the ball do not appear in the image acquisition range at the same time. For example, the athlete runs to a certain position in advance and waits for the teammate to pass the ball. At this time, although the athlete moves faster, there will be no fast movements of the athlete on the ball, and there is no need to use the second frame rate to capture video frame images.

[0151] It can be understood that if the movement speed of the first target object is greater than or equal to the speed threshold, and the first target object and the second target object appear in the image acquisition range of the terminal at the same time, it means that a fast action of the first target object acting on the second target object may occur at present; at this time, in order to more clearly analyze the fast action, the acquisition frame rate of the terminal can be increased.

[0152] It is worth noting that the embodiments of the present disclosure can accurately determine the timing of the rapid action of the first target object on the second target object based directly on the movement speed of the first target object and whether the first target object and the second target object are detected simultaneously within the image acquisition range, thereby dynamically adjusting the acquisition frame rate of the terminal; so as to timely adjust the acquisition frame rate when the rapid action of the first target object on the second target object occurs, without the need for manual triggering by the user, thereby reducing the situation where the shooting of the slow-motion video is inappropriately started.

[0153] Optionally, the method further comprises:

[0154] In response to a selection operation of a shooting mode, determining a target shooting mode from a plurality of shooting modes;

[0155] The speed threshold corresponding to the target shooting mode is determined as the preset speed threshold; different shooting modes correspond to different speed thresholds.

[0156] In an embodiment of the present disclosure, the terminal may include multiple shooting modes; different shooting modes may be applicable to different sports scenes.

[0157] For different sports scenes, the speed threshold for triggering slow-motion video shooting may be different; for example, the speed threshold corresponding to a badminton sports scene may be different from the speed threshold corresponding to a running sports scene.

[0158] For different motion scenes, in order to more accurately determine the timing of the change in the motion state of the target object based on the motion speed of the target object, the speed threshold may be dynamically adjusted according to the motion scene.

[0159] During the video shooting process, in response to the user's selection operation on the shooting mode, a target shooting mode selected by the user is determined from a plurality of shooting modes of the terminal.

[0160] It is understandable that the user may determine the target shooting mode according to the sports scene to be shot, so as to select the target shooting mode corresponding to the sports scene.

[0161] A speed threshold corresponding to the target shooting mode is obtained, a moving speed of the target object is compared with the speed threshold corresponding to the target shooting mode, and according to the comparison result, it is determined whether the target object meets a preset condition.

[0162] The disclosed embodiment can set different speed thresholds for shooting modes corresponding to different sports occasions; so that during the video shooting process, the target shooting mode selected by the selection operation and the speed threshold corresponding to the target shooting mode can be determined according to the user's selection operation; thereby directly based on the comparison result between the movement speed of the target object and the speed threshold corresponding to the target shooting mode, the change timing of the movement state of the target object can be accurately determined.

[0163] Optionally, detecting motion information of the target object includes:

[0164] The motion of the target object is detected using a dynamic vision sensor DVS to obtain the motion information.

[0165] In an embodiment of the present disclosure, the terminal may include a dynamic vision sensor (DVS) and an image sensor.

[0166] In some other embodiments, the terminal may include an image sensor with DVS. It is understandable that the image sensor with DVS may be understood as a hybrid sensor having both the function of DVS and the function of a common image sensor, for example, a hybrid-DVS sensor.

[0167] The DVS in the terminal can be directly used to detect the motion of the target object within the image acquisition range to obtain the motion information of the target object.

[0168] It should be noted that the dynamic vision sensor is a sensor based on motion perception and a complementary metal oxide semiconductor asynchronous image sensor based on address event representation. The dynamic vision sensor is a biomimetic vision sensor that simulates the human retina based on pulse-triggered neurons. The dynamic vision sensor has a pixel unit array composed of multiple pixel units, in which each pixel unit will respond and record the area with rapid changes in light intensity only when it senses changes in light intensity.

[0169] Compared with traditional image sensors that output pixel information in the form of frames, DVS simulates the working mechanism of biological retinal nerves and uses asynchronous address event representation to only output the pixel address and information of the pixel where the light intensity changes, rather than reading out the information of each pixel in the frame one by one. That is, DVS only outputs the information of moving objects within the image acquisition range, and does not output any information for the pixel part corresponding to the non-moving objects within the image acquisition range.

[0170] It is understandable that when the photographed object does not move relative to the terminal, the light intensity detected by the pixel unit in the dynamic vision sensor will not change; when the photographed object moves relative to the terminal, the light will change, thereby triggering the pixel unit to output a pixel event. The event data of the pixel event may include: the coordinate position of the pixel unit that detects the change in brightness and the timestamp information of the time when it is triggered.

[0171] It is worth noting that DVS has the characteristics of real-time dynamic response to scene changes, ultra-sparse image representation, and asynchronous output of time domain change events. It can solve the defects of high redundancy, high latency, high noise, low dynamic range, and transmission bottleneck brought by the traditional image sensor frame sampling method. It is suitable for high-speed and real-time visual applications.

[0172] The present disclosure also provides the following embodiments:

[0173] Figure 2 is a schematic diagram of a video shooting method according to an exemplary embodiment Figure 2 , the method comprising:

[0174] Step S201, start the camera, set the motion detection threshold and the frame rate value of high frame rate shooting;

[0175] Here, the motion detection threshold corresponds to the speed threshold of the embodiment of the present disclosure, and the frame rate value of the high frame rate shooting corresponds to the second frame rate of the embodiment of the present disclosure.

[0176] Step S202, start video recording, when the DVS detects that the moving speed of the moving object reaches the motion detection threshold, the camera starts high frame rate shooting;

[0177] Step S203, when it is detected that the moving speed of the moving object is lower than the motion detection threshold, stop high frame rate shooting;

[0178] Step S204, after the video recording is finished, the recorded video is processed into a video with a uniform frame rate.

[0179] For example, take the shooting of a badminton player's hitting action as an example. Before the badminton arrives, the player's movement speed remains below the motion detection threshold, and at this time, the terminal will not trigger high frame rate shooting; when the badminton falls into the player's hitting range, the player starts to swing the racket, and at this time the player's movement speed is greater than the motion detection threshold, and the terminal triggers high frame rate shooting; after the player's swinging action ends, the badminton also flies out of the image acquisition range, and the player's movement speed remains below the motion detection threshold again, and the terminal stops high frame rate shooting.

[0180] The embodiment of the present disclosure also provides a video shooting device. Figure 3 is a schematic structural diagram of a video shooting device according to an exemplary embodiment. Figure 3 As shown, the device is applied to a terminal, and the device 100 includes:

[0181] The acquisition module 101 is used for, in response to a shooting instruction, the terminal acquires video frame images at a first frame rate;

[0182] The detection module 102 detects the motion information of the target object during the acquisition process of the video frame image;

[0183] An adjustment module 103, configured to control the terminal to adjust the acquisition frame rate to a second frame rate if the motion information of the target object meets a preset condition; wherein the first frame rate is less than the second frame rate;

[0184] The acquisition module 101 is further configured to continue acquiring video frame images based on the second frame rate.

[0185] Optionally, the adjustment module 103 is further configured to:

[0186] If the motion information of the target object does not meet the preset condition, and the acquisition frame rate is the second frame rate, the control terminal restores the acquisition frame rate to the first frame rate;

[0187] The video frame images are acquired based on the first frame rate.

[0188] Optionally, the device further includes: a playing module 104, configured to:

[0189] In response to a shooting stop instruction, acquiring the captured multiple video frame images and timing information of the multiple video frame images;

[0190] Determine the target playback frame rate;

[0191] Based on the timing information, a plurality of the video frame images are converted into a video file according to the target playback frame rate.

[0192] Optionally, the playing module 104 is further configured to:

[0193] Based on the timing information, determining a playback order of the plurality of video frame images;

[0194] Based on the target playback frame rate, determining the playback duration of each of the video frame images;

[0195] A video file is generated based on the playback order of the multiple video frame images and the playback duration of each of the video frame images.

[0196] Optionally, the motion information includes at least: motion speed;

[0197] The adjustment module 103 is used to:

[0198] If the moving speed of the target object is greater than or equal to a preset speed threshold, the control terminal adjusts the acquisition frame rate to the second frame rate.

[0199] Optionally, the target object may include: a first target object and a second target object;

[0200] The adjustment module 103 is used to:

[0201] If the first target object and the second target object are simultaneously detected within the image acquisition range of the terminal, and the movement speed of the first target object is greater than or equal to a preset speed threshold, the control terminal adjusts the acquisition frame rate to the second frame rate.

[0202] Optionally, the adjustment module 103 is further configured to:

[0203] In response to a selection operation of a shooting mode, determining a target shooting mode from a plurality of shooting modes;

[0204] The speed threshold corresponding to the target shooting mode is determined as the preset speed threshold; different shooting modes correspond to different speed thresholds.

[0205] Optionally, the detection module 102 is further configured to:

[0206] The motion of the target object is detected using a dynamic vision sensor DVS to obtain the motion information.

[0207] Figure 4 800 is a block diagram of a terminal according to an exemplary embodiment. For example, the terminal 800 may be a mobile phone, a mobile computer, etc.

[0208] Reference Figure 4 The terminal 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0209] The processing component 802 generally controls the overall operation of the terminal 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0210] The memory 804 is configured to store various types of data to support operations at the terminal 800. Examples of such data include instructions for any application or method operating on the terminal 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as a static random access memory (SRAM), an electrically erasable programmable read-only memory (EEPROM), an erasable programmable read-only memory (EPROM), a programmable read-only memory (PROM), a read-only memory (ROM), a magnetic memory, a flash memory, a magnetic disk, or an optical disk.

[0211] Power component 806 provides power to various components of terminal 800. Power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to terminal 800.

[0212] The multimedia component 808 includes a screen that provides an output interface between the terminal 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the terminal 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and the rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0213] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the terminal 800 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0214] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0215] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the terminal 800. For example, the sensor assembly 814 can detect the open / closed state of the terminal 800, the relative positioning of the components, such as the display and keypad of the terminal 800, and the sensor assembly 814 can also detect the position change of the terminal 800 or a component of the terminal 800, the presence or absence of contact between the user and the terminal 800, the orientation or acceleration / deceleration of the terminal 800 and the temperature change of the terminal 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

[0216] The communication component 816 is configured to facilitate wired or wireless communication between the terminal 800 and other devices. The terminal 800 can access a wireless network based on a communication standard, such as Wi-Fi, 4G or 5G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0217] In an exemplary embodiment, terminal 800 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above methods.

[0218] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, and the instructions can be executed by a processor 820 of the terminal 800 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0219] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0220] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A video shooting method, characterized in that: The method comprises: In response to the shooting instruction, the terminal captures video frame images at a first frame rate; During the acquisition of the video frame images, detecting motion information of the target object; If the motion information of the target object meets a preset condition, controlling the terminal to adjust the acquisition frame rate to a second frame rate; wherein the first frame rate is less than the second frame rate; Based on the second frame rate, continue to capture video frame images.

2. The method according to claim 1, characterized in that The method further comprises: If the motion information of the target object does not meet the preset condition, and the acquisition frame rate is the second frame rate, the control terminal restores the acquisition frame rate to the first frame rate; The video frame images are acquired based on the first frame rate.

3. The method according to claim 1 or 2, characterized in that: The method further comprises: In response to a shooting stop instruction, acquiring the captured multiple video frame images and timing information of the multiple video frame images; Determine the target playback frame rate; Based on the timing information, a plurality of the video frame images are converted into a video file according to the target playback frame rate.

4. The method according to claim 3, characterized in that The step of generating a video file from the plurality of video frame images according to the target playback frame rate based on the timing information includes: Based on the timing information, determining a playback order of the plurality of video frame images; Based on the target playback frame rate, determining the playback duration of each of the video frame images; A video file is generated based on the playback order of the multiple video frame images and the playback duration of each of the video frame images.

5. The method according to claim 1, characterized in that The motion information at least includes: motion speed; If the motion information of the target object meets a preset condition, controlling the terminal to adjust the acquisition frame rate to a second frame rate includes: If the moving speed of the target object is greater than or equal to a preset speed threshold, the control terminal adjusts the acquisition frame rate to the second frame rate.

6. The method according to claim 1, characterized in that The target object may include: a first target object and a second target object; If the motion information of the target object meets a preset condition, controlling the terminal to adjust the acquisition frame rate to a second frame rate includes: If the first target object and the second target object are simultaneously detected within the image acquisition range of the terminal, and the movement speed of the first target object is greater than or equal to a preset speed threshold, the control terminal adjusts the acquisition frame rate to the second frame rate.

7. The method according to claim 5 or 6, characterized in that: The method further comprises: In response to a selection operation of a shooting mode, determining a target shooting mode from a plurality of shooting modes; The speed threshold corresponding to the target shooting mode is determined as the preset speed threshold; different shooting modes correspond to different speed thresholds.

8. The method according to claim 1, characterized in that The detecting the motion information of the target object includes: The motion of the target object is detected using a dynamic vision sensor DVS to obtain the motion information.

9. A video shooting device, characterized in that: The device comprises: A capture module, configured to respond to a shooting instruction, and the terminal captures video frame images at a first frame rate; A detection module, which detects motion information of a target object during the acquisition of the video frame image; An adjustment module, configured to control the terminal to adjust the acquisition frame rate to a second frame rate if the motion information of the target object meets a preset condition; wherein the first frame rate is less than the second frame rate; The acquisition module is further used to continue acquiring video frame images based on the second frame rate.

10. A video shooting device, characterized in that: include: processor; a memory for storing executable instructions; The processor is configured to implement the video shooting method according to any one of claims 1 to 8 when executing the executable instructions stored in the memory. 11 . A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of a video capture device, the response control device is enabled to execute the video capture method according to any one of claims 1 to 8.

Images