Video recording method, recording device and system

Abstract

The present disclosure provides a video recording method, a recording device and a system, which can be applied to the technical field of video. The video recording method comprises: in a video recording process, in response to a speed trigger condition, generating at least one target video segment, the speed of the target video segment being a target speed, and the picture of the target video segment being collected in the video recording process; in response to a recording end operation, saving a recorded video, wherein the recorded video comprises the target video segment.

Description

Technical Field

[0001] This disclosure relates to the field of video technology, and more specifically to a video recording method, recording device, and system. Background Technology

[0002] Currently, users can use mobile phones, cameras, and other electronic devices to record videos, and after recording, they can perform post-editing operations such as speeding up the playback to watch the various exciting scenes in the video.

[0003] However, this method of recording first and then editing increases the user's workload and reduces the user experience. Summary of the Invention

[0004] In view of the above problems, this disclosure provides a video recording method, recording equipment and recording system.

[0005] According to a first aspect of this disclosure, a recording method is provided, comprising: during video recording, in response to a speed-up trigger condition, generating at least one target video segment, wherein the speed of the target video segment is a target speed, and the frame of the target video segment is captured during the video recording; and in response to a recording end operation, saving the recorded video, wherein the recorded video includes the target video segment.

[0006] According to embodiments of this disclosure, the speed-up triggering conditions include: determining a target speed in response to a triggering operation that determines a target speed; and / or, acquiring attitude information of the shooting device to determine the target speed; and / or, determining the target speed based on image information acquired by the shooting device.

[0007] According to embodiments of this disclosure, during video recording, in response to a speed-up trigger condition, generating at least one target video segment includes: determining the number of target frames based on a frame rate corresponding to the target speed; and extracting target frames from multiple video frames within the video recording period according to the number of target frames to generate at least one target video segment.

[0008] According to embodiments of this disclosure, extracting a target frame from multiple video frames within a video recording period includes: performing a frame dropping operation on non-target frames among the multiple video frames; and in response to detecting a frame dropping operation on the i-th video frame, requesting an internal encoding frame for video encoding, where i is an integer greater than 1.

[0009] According to embodiments of this disclosure, the method further includes: in response to detecting that the j-th video frame is a keyframe, determining that the j-th video frame is a target frame, where j is an integer greater than 1.

[0010] According to embodiments of this disclosure, the method further includes: determining the j-th video frame as a keyframe in response to detecting that the motion sensor parameters corresponding to the j-th video frame meet a first predetermined threshold.

[0011] According to embodiments of this disclosure, the method further includes: in response to detecting that the image quality parameter corresponding to the j-th video frame meets a second predetermined threshold, determining the j-th video frame as a keyframe.

[0012] According to embodiments of this disclosure, during video recording, in response to a speed-up trigger condition, at least one target video segment is generated, including: determining a frame dropping interval based on a frame rate corresponding to the target speed; and performing frame dropping processing on multiple video frames according to the frame dropping interval based on the timestamps of multiple video frames, so as to generate at least one target video segment.

[0013] According to embodiments of this disclosure, the method further includes: in response to detecting a termination operation of video recording, storing multiple video frames within the video recording period.

[0014] According to embodiments of this disclosure, the method further includes sending a plurality of video frames within a predetermined recording period to a target terminal device.

[0015] According to embodiments of this disclosure, during video recording, in response to a speed-up trigger condition, at least one target video segment is generated, including: adjusting the frame interval parameter of the image sensor based on the frame rate corresponding to the target speed-up to achieve video recording and generate at least one target video segment.

[0016] According to embodiments of this disclosure, the method further includes: adjusting the frame interval parameter of the image sensor based on the ambient brightness and the frame rate corresponding to the target speed.

[0017] According to embodiments of this disclosure, during video recording, in response to a speed-up trigger condition, generating at least one target video segment includes: in response to detecting that the ambient light parameter of the recording area is greater than a third predetermined threshold, performing frame dropping processing on multiple video frames within a predetermined recording period based on the frame rate corresponding to the target speed-up, so as to achieve video recording and generate at least one target video segment.

[0018] According to embodiments of this disclosure, during video recording, in response to a speed-up trigger condition, generating at least one target video segment includes: in response to detecting that the ambient light parameter of the recording area is less than or equal to a third predetermined threshold, adjusting the frame interval parameter of the image sensor based on the frame rate corresponding to the target speed-up to achieve video recording and generate at least one target video segment.

[0019] According to embodiments of this disclosure, the method further includes: compressing multiple audio clips within a video recording period to a target time period corresponding to a target speed.

[0020] A second aspect of this disclosure provides a recording device, including: a housing, and a lens, an image sensor, and one or more processors mounted on the housing, for performing the video recording method described above.

[0021] A third aspect of this disclosure provides a recording system, including: the recording device described above and a target terminal device that interacts with the recording device. Attached Figure Description

[0022] The foregoing contents, as well as other objects, features, and advantages of this disclosure, will become clearer from the following description of embodiments with reference to the accompanying drawings, in which:

[0023] Figure 1 This diagram illustrates an application scenario of the video recording method according to an embodiment of the present disclosure.

[0024] Figure 2 A flowchart illustrating a video recording method according to an embodiment of the present disclosure is shown schematically.

[0025] Figure 3 This schematically illustrates a logic block diagram for determining the recording speed mode based on ambient light parameters according to an embodiment of the present disclosure;

[0026] Figure 4 This illustration schematically shows a video frame-dropping method used to achieve accelerated recording according to an embodiment of the present disclosure.

[0027] Figure 5 This illustration schematically shows a video frame-dropping method for speed recording according to another embodiment of the present disclosure;

[0028] Figure 6 The illustration schematically shows a method for achieving accelerated recording by adjusting the frame interval parameter of an image sensor according to an embodiment of the present disclosure;

[0029] Figure 7 This illustration schematically shows a diagram of achieving accelerated recording by adjusting the outgoing frame interval parameter of an image sensor according to another embodiment of the present disclosure;

[0030] Figure 8 A schematic diagram illustrating audio-video synchronization according to an embodiment of the present disclosure is shown.

[0031] Figure 9 A schematic block diagram of a recording device according to an embodiment of the present disclosure is shown; and

[0032] Figure 10A block diagram of a recording system suitable for implementing a video recording method according to an embodiment of the present disclosure is shown schematically. Detailed Implementation

[0033] The embodiments of the present disclosure will now be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the disclosure. In the following detailed description, numerous specific details are set forth to provide a thorough understanding of the embodiments of the present disclosure for ease of explanation. However, it will be apparent that one or more embodiments may be practiced without these specific details. Furthermore, descriptions of well-known structures and techniques are omitted in the following description to avoid unnecessarily obscuring the concepts of the present disclosure.

[0034] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit this disclosure. The terms “comprising,” “including,” etc., as used herein indicate the presence of the stated features, steps, operations, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, or components.

[0035] All terms used herein (including technical and scientific terms) have the meanings commonly understood by those skilled in the art, unless otherwise defined. It should be noted that the terms used herein are to be interpreted in a manner consistent with the context of this specification, and not in an idealized or overly rigid way.

[0036] When using expressions such as "at least one of A, B and C", they should generally be interpreted in accordance with the meaning that is commonly understood by those skilled in the art (e.g., "a system having at least one of A, B and C" should include, but is not limited to, a system having A alone, a system having B alone, a system having C alone, a system having A and B, a system having A and C, a system having B and C, and / or a system having A, B and C, etc.).

[0037] When recording videos of athletes' exciting competition moments, some key movements are completed in a short period of time. Therefore, to allow viewers to focus on these key movements, the video footage of those key movements needs to be played in slow motion. For example, the aerial rotations and somersaults of a diver before entering the water require re-editing of the recorded video to achieve slow-motion playback. This not only increases the user's workload but also increases the video production time and degrades the user experience.

[0038] In view of the above, embodiments of this disclosure provide a video recording method, including: during video recording, in response to a speed-up trigger condition, generating at least one target video segment, wherein the speed of the target video segment is the target speed, and the frame of the target video segment is captured during the video recording process; and in response to a recording end operation, saving the recorded video, wherein the recorded video includes the target video segment.

[0039] Figure 1 The diagram illustrates an application scenario of the video recording method according to an embodiment of the present disclosure.

[0040] like Figure 1 As shown, application scenario 100 according to this embodiment may include recording device 101 and recording scenario 102. In recording scenario 102, an athlete is running on a playground. During the recording process of the athlete's running, the user can select the speed on the speed selection interface of recording device 101. The recording method of this embodiment can be executed by recording device 101 to record multiple speed combinations according to user preferences.

[0041] For example, during the athlete's preparation phase, when there are fewer exciting moments, users can choose to record at 0.5x speed. During the run, to capture the athlete's running motion, users can choose 1.0x speed for normal recording. During the athlete's sprint, especially the brief moment before crossing the finish line, users can choose 2.0x speed to capture the exciting moment of the athlete crossing the finish line.

[0042] The following will be based on Figure 1 The described scene, through Figures 2-8 The video recording method of the present disclosure will be described in detail.

[0043] Figure 2 A flowchart illustrating a video recording method according to an embodiment of the present disclosure is shown schematically.

[0044] like Figure 2 As shown, the video recording method of this embodiment includes operations S210 to S220.

[0045] During operation S210, in response to the speed-up trigger condition, at least one target video segment is generated during video recording.

[0046] When operating S220, in response to the recording end operation, the recorded video is saved.

[0047] According to embodiments of this disclosure, the speed of the target video segment can be a target speed, and the footage of the target video segment is captured during the video recording process.

[0048] According to embodiments of this disclosure, the speed-up triggering condition may include any one or more combinations of the following.

[0049] In some embodiments, the target speed can be determined by acquiring the attitude information of the shooting device. The attitude information includes, but is not limited to, sensor parameters of the shooting device that characterize the camera pose. A mapping relationship between each sensor parameter and each speed can be pre-configured; when a sensor parameter representing the camera pose is detected, the target speed is determined based on the aforementioned mapping relationship.

[0050] For example, when the shooting distance between the camera and the subject is close, video recording can be performed at 0.5x speed. When the shooting distance is far, video recording can be performed at 2.5x speed. In some embodiments, the target speed can be determined based on image information acquired by the camera. Image information includes, but is not limited to, image content and shooting scene. A mapping relationship between each shooting scene or subject and each speed can be pre-configured. When a shooting scene or subject is detected, the target speed is determined based on the above mapping relationship. For example, when the shooting scene is a thrilling moment of an athlete sprinting, video recording can be performed at 0.5x speed to capture more exciting moments. When the shooting scene is a static scene, video recording can be performed at 2.0x speed.

[0051] In some embodiments, the target speed can be determined in response to a trigger operation that determines the target speed; for example, during video recording, a user can determine the target speed by selecting candidate speeds on the speed selection interface of an electronic device with recording capabilities.

[0052] For example, electronic devices with video recording capabilities may include any of the following: mobile phones, smart cameras, tablets, desktops, laptops, notebook computers, handheld computers, netbooks, personal digital assistants (PDAs), wearable electronic devices, smartwatches, etc.

[0053] For example, the candidate speed multiplier can be any combination of speed multipliers such as 0.25x, 0.5x, 1.0x, 1.25x, 1.5x, and 2.0x.

[0054] According to embodiments of this disclosure, the target speed can represent either the recording speed or the playback speed. The recorded video is captured during the video recording process and can include video at normal speed or video at various target speeds.

[0055] According to an embodiment of this disclosure, when the user selects 0.5x speed, the target scene is recorded at 0.5x speed so that the recorded video has a speed of 0.5x.

[0056] According to embodiments of this disclosure, frame rate (FPS) refers to the number of frames transmitted per second. The more frames transmitted per second, the smoother the motion displayed on the screen.

[0057] Typically, when shooting video with a mobile phone, the image sensor captures images at 30 FPS, meaning it captures 30 frames per second evenly. After video frame encoding, the final video data is encoded at 30 FPS. When playing this video, the video player also decodes and displays the video at 30 FPS. Therefore, the video content seen by the user is exactly the same as the video content captured in the real world.

[0058] When users need to record exciting moments of athletes' competitions, such as fleeting actions like snowboarders performing aerial spins or grabbing the board, they can choose to record at a slower speed. The recording speed can be adapted to the image sensor's frame rate based on the user's selected target speed. For example, it can capture images at 240 FPS (240 images per second, averaging one image every 4 milliseconds), and then encode each of the 240 frames to form video data. When playing this video data, the player can still play it at 30 FPS. In this case, since the recording captured 240 images per second, the playback time would be 8 seconds. The video playback speed is slowed down to 1 / 8 of the original, and all movements and changes are slowed down, thus allowing for more precise capture of the details of the movements.

[0059] According to embodiments of this disclosure, when a user selects speed recording, speed recording can also be achieved by actively dropping frames.

[0060] For example, when recording video at 2.0x speed, you can first capture images at 30FPS, then discard one frame at a time and encode them to obtain video data at 2.0x speed.

[0061] In the process of implementing accelerated video recording, audio captured synchronously with the video can be compressed using audio speed-up algorithms to a speed-up time corresponding to the 2.0x speed video data, thus achieving audio-video synchronization. Audio speed-up algorithms can include, but are not limited to: Time-scale Modulation (TSM), Overlap-and-Add (OLA), and Waveform Similarity Overlap-Add (WSOLA).

[0062] Then, a muxer can be used to merge the synchronized video and audio data into a single container format, such as MKV (Matroska Video File) or MPEG-4 (Moving Picture Experts Group). The recorded video is then saved at the target speed. It should be noted that the muxer, MKV, and MPEG-4 formats are merely illustrative and do not necessarily imply that this disclosure will use these examples.

[0063] According to embodiments of this disclosure, by generating at least one target video segment based on a speed-up trigger condition during video recording and saving the recorded video, it is possible to directly record a video at double speed without requiring the user to perform secondary editing of the video after recording, thus simplifying user operations and improving user experience.

[0064] According to embodiments of this disclosure, ambient light parameters can be used to characterize the brightness of the surrounding environment in a video recording scene. Ambient light parameters are a major factor affecting the exposure time of the recording device. Exposure time refers to the duration for which light falls on the image sensor. The longer the exposure, the brighter the image generated on the film. There is a positive correlation between the exposure time and frame rate in video recording; therefore, the frame rate also limits the exposure time. For example, for a video at 30 frames per second, the exposure time is generally less than or equal to 1 / 30 of a second.

[0065] However, in low-light conditions, a longer exposure time is generally required. In bright-light conditions, a shorter exposure time is generally required. Therefore, embodiments of this disclosure can determine the specific implementation method of speed-up recording based on ambient light parameters.

[0066] Figure 3 The diagram illustrates a logic block diagram of determining the recording speed mode based on ambient light parameters according to an embodiment of the present disclosure.

[0067] like Figure 3 As shown, the method for determining the recording speed can include operations S321 to S324.

[0068] During operation S321, the ambient light parameters of the recording area are obtained;

[0069] In operation S322, determine whether the ambient light parameter is greater than the ambient light parameter threshold. If yes, proceed to operation S323; otherwise, proceed to operation S324.

[0070] According to embodiments of this disclosure, the ambient light parameter can be the light intensity of the recording area collected by the built-in light sensor of the recording device. The ambient light parameter threshold can be set according to the actual application scenario requirements, for example, it can be 300 lux.

[0071] In operation S323, based on the frame rate corresponding to the target speed, multiple video frames within a predetermined recording period are dropped to generate at least one target video segment.

[0072] In operation S324, the frame interval parameter of the image sensor is adjusted based on the frame rate corresponding to the target speed to achieve video recording and generate at least one target video segment.

[0073] According to embodiments of this disclosure, the predetermined recording period can be a recording period at the same speed. The start time of this period can be the time when the user selects the target speed and starts recording, and the end time of this period can be the time when the user stops recording, or the time when the user selects another speed or resumes normal speed and starts recording.

[0074] For example: A user selects 1.0x speed at time t1 and starts recording video, then selects 2.0x speed at time t2 and starts recording again, continuing until recording ends at time t3. The recording period corresponding to 1.0x speed can be the time interval t1 to t2. The recording period corresponding to 2.0x speed can be the time interval t2 to t3.

[0075] For example, the ambient light parameter in the recording area can be 500 lux. Since 500 lux > 300 lux, when the user selects a target speed of 2.0x, multiple video frames in the time period t2 to t3 can be dropped based on the frame rate corresponding to the target speed, such as 15 frames / second, so as to record at 2.0x speed.

[0076] For example, the ambient light parameter in the recording area can be 100 lux. Since 100 lux < 300 lux, when the user selects a target speed of 2.0x, the frame rate corresponding to the target speed, such as 15 frames per second, can be adjusted to record at 2.0x speed.

[0077] According to embodiments of this disclosure, different strategies are adaptively matched based on ambient light to achieve speed-up recording, thereby improving the intelligence of video speed-up recording.

[0078] The following is combined with Figures 4-5 This paper provides a detailed explanation of the method for achieving accelerated recording speed by actively dropping frames.

[0079] According to embodiments of this disclosure, during video recording, generating at least one target video segment in response to a speed-up trigger condition may include the following operations: determining the number of target frames based on the frame rate corresponding to the target speed; and extracting target frames from multiple video frames within the video recording period according to the number of target frames, so as to achieve video recording.

[0080] For example, the frame rate of the image sensor of the recording device can be 30 FPS, meaning that 30 video frames are captured per second at 1.0x speed. The target speed can be 2.0x speed, which corresponds to a frame rate of 15 FPS. Without changing the frame rate of the image sensor, 15 frames can be actively discarded from the 30 frames of video in 1 second, so the target number of frames can be 15.

[0081] According to embodiments of this disclosure, speed recording is achieved by actively dropping frames, eliminating the need for complex operations during video encoding and improving the efficiency of speed recording.

[0082] According to embodiments of this disclosure, the target frame may be a keyframe, for example: in response to detecting that the j-th video frame is a keyframe, the j-th video frame is determined to be the target frame, where j is an integer greater than 1.

[0083] According to embodiments of this disclosure, keyframes can be identified by comparing the content similarity between adjacent video frames in a video frame sequence, and those with low similarity to adjacent video frames can be identified. Keyframes can be frames containing key actions of a moving or changing target object, frames where animation effects are applied, or frames corresponding to moments when the shooting scene changes.

[0084] According to embodiments of this disclosure, keyframes can also be determined based on parameters of a motion sensor built into the recording device.

[0085] For example: in response to detecting that the motion sensor parameters corresponding to the j-th video frame meet a first predetermined threshold, the j-th video frame is determined to be a keyframe.

[0086] According to embodiments of this disclosure, motion sensor parameters can be used to characterize the pose state, motion state, etc., of the recording device. A first predetermined threshold can characterize the pose parameters of the recording device when it is in a stable state.

[0087] According to embodiments of this disclosure, using video frames acquired by the motion sensor in a stable state as keyframes can effectively reduce jitter in videos recorded at double speed.

[0088] According to embodiments of this disclosure, keyframes can also be determined based on image quality parameters based on video frames.

[0089] For example, by evaluating the picture quality of each video frame, in response to detecting that the picture quality parameter corresponding to the j-th video frame meets a second predetermined threshold, the j-th video frame can be determined as a key frame.

[0090] According to embodiments of this disclosure, image quality parameters include, but are not limited to, any parameter or combination of parameters such as signal-to-noise ratio, contrast ratio, and resolution.

[0091] According to embodiments of this disclosure, the signal-to-noise ratio can be the peak signal-to-noise ratio (PSNR), which can be calculated according to formula (1):

[0092] (1)

[0093] Where L represents the maximum dynamic range of the image data type; MSE represents the mean square error of pixels between the reference image and the video frame.

[0094] For example, for float type image data, the value range is [0, 1], therefore L = 1. For unit 8 type image data, the value range is [0, 255], therefore L = 255.

[0095] According to embodiments of this disclosure, when the image quality parameter is a single parameter, the second predetermined threshold can be the threshold value of that parameter. When the image quality parameter is a combination of parameters, the second predetermined threshold can be the threshold value resulting from the weighted sum of multiple parameters. The weights of each parameter can be configured according to actual application requirements, and this disclosure does not specifically limit this.

[0096] According to embodiments of this disclosure, identifying video frames with higher image quality parameters as keyframes can improve the image quality of videos recorded at double speed.

[0097] According to embodiments of this disclosure, keyframes can also be determined based on motion sensor parameters and image quality parameters.

[0098] For example, weights can be assigned to motion sensor parameters and image quality parameters, and then keyframes can be determined based on the weighted summation.

[0099] For example, one could first determine whether the motion sensor parameters corresponding to a video frame meet a first predetermined threshold. Then, for video frames that meet the first predetermined threshold, it could be determined whether the corresponding image quality parameters meet a second predetermined threshold. Finally, video frames whose motion sensor parameters meet the first predetermined threshold and whose image quality parameters meet the second predetermined threshold could be identified as keyframes.

[0100] Figure 4This illustration schematically shows a video frame-dropping method used to achieve accelerated recording according to an embodiment of the present disclosure.

[0101] like Figure 4 As shown in Example 400, for the time period t1~t2, recording is performed at a normal speed of 1.0x, resulting in video frames 411, 412, 413, and 414. From time t2 until time t3, recording is performed at a speed of 2.0x. For example, the duration of normal recording and speed recording can be the same. For the acquired video frames 521~528, the number of target frames for the time period t2~t3 can be determined to be 4 based on the frame rate corresponding to the target speed.

[0102] Then, video frames 521, 523, 524, and 527 can be determined as target frames using the keyframe determination method described above. Finally, frame dropping operations are performed on video frames 522, 525, 526, and 528.

[0103] In addition to identifying keyframes as target frames, embodiments of this disclosure can also determine the frame dropping interval based on the frame rate corresponding to the target speed; and perform frame dropping processing on multiple video frames according to the frame dropping interval based on the timestamps of multiple video frames, so as to achieve video recording.

[0104] Figure 5 The illustration shows a schematic diagram of video frames being processed by dropping frames to achieve speed-up recording according to another embodiment of the present disclosure.

[0105] like Figure 5 As shown in Example 500, for the time period t1~t2, recording is performed at a normal speed of 1.0x, resulting in video frames 411, 412, 413, and 414. From time t2 until time t3, recording is performed at a speed of 2.0x. For example, the duration of normal recording and speed recording can be the same. For the acquired video frames 521~528, the number of target frames for the time period t2~t3 can be determined to be 4 based on the frame rate corresponding to the target speed.

[0106] Then, the recording speed can be 24ms. After frame dropping, the target number of frames within 24ms is 4, so the inter-frame interval can be determined to be 6ms. However, the current 24ms includes 8 video frames, with an inter-frame interval of 3ms. Therefore, the frame dropping interval can be determined to be 3ms, meaning one frame is dropped every 3ms. Frame dropping operations can be performed on video frames 522, 524, 526, and 528 to complete the speed-up recording.

[0107] According to embodiments of this disclosure, by dropping frames at average intervals, the timing and number of dropped frames can be accurately determined, enabling accelerated recording and simplifying user operations.

[0108] During video encoding, each frame is typically encoded as an I-frame, P-frame, or B-frame. An I-frame is an intra-coded frame, an independent frame containing complete picture information. A P-frame is an intra-predictive coded frame, recording the differences between the current frame and the previous frame. A B-frame is a bidirectional predictive coded frame, recording the differences between the current frame and the frames before and after it.

[0109] During decoding, I-frames can be decoded independently without referencing other frames. However, P-frames require predictive coding by overlaying the buffered previous frame onto the current frame. Because P-frames are dependent on preceding P-frames or I-frames, if the forward reference frame is incorrect, the data being supplemented during decoding is not the actual data showing the motion changes. Therefore, dropping frames for P-frames can cause a mosaic effect during decoding.

[0110] Similarly, when decoding B-frames, it is necessary to obtain not only the buffered image of the previous frame, but also the decoded image of the next frame. The final image of the current frame is obtained by superimposing the images from the previous and next frames with the image data of the current frame. Therefore, dropping frames for B-frames can also cause a mosaic effect during decoding.

[0111] To ensure video quality after frame dropping, frame dropping operations can be performed on non-target frames among multiple video frames. In response to the detection of frame dropping operation of the i-th video frame, an internal encoding frame is requested for video encoding, where i is an integer greater than 1.

[0112] like Figure 5 As shown, video frame 521 can be encoded as an I-frame. When a frame dropping operation is performed on video frames 522, 524, 526 and 528, I-frames can be actively requested for video encoding at the corresponding positions of video frames 522, 524, 526 and 528.

[0113] According to embodiments of this disclosure, by requesting I-frames for video encoding of lost video frames, the probability of pixelation during the decoding process of videos recorded at double speed is reduced.

[0114] The following is combined with Figures 6-7 A detailed explanation is provided of a method for achieving accelerated recording by adjusting the frame interval parameter of the image sensor.

[0115] According to embodiments of this disclosure, the frame interval parameter of the image sensor can be adjusted based on the frame rate corresponding to the target speed to achieve video recording.

[0116] Figure 6 The illustration schematically shows a method for achieving accelerated recording by adjusting the frame interval parameter of an image sensor according to an embodiment of the present disclosure.

[0117] like Figure 6 As shown, in embodiment 600, when the user selects a target speed 602 of 2.0x in the speed selection interface of the recording device 601, the frame rate 603 can be determined to be 15 frames / second based on the target speed 602, and then the frame interval parameter 604 of the image sensor can be adjusted to 15 frames / second.

[0118] According to embodiments of this disclosure, since the exposure duration of video recording is positively correlated with the frame rate (e.g., for a video at 30 frames per second, the exposure duration cannot exceed 1 / 30 of a second), when the user selects a target speed of 2.0x, by adjusting the frame interval parameter of the image sensor to 15 frames per second, the final video exposure duration is 1 / 15 of a second, thus overcoming the limitation of video capture frame rate on exposure duration.

[0119] According to embodiments of this disclosure, the frame interval parameter of the image sensor corresponding to the target speed can be pre-configured and stored in the recording device, so that the frame interval parameter of the corresponding image sensor can be matched according to the target speed selected by the user, thereby realizing the automatic adjustment of the frame interval of the image sensor.

[0120] According to embodiments of this disclosure, the frame interval parameter of the image sensor can also be adjusted based on the ambient brightness and the frame rate corresponding to the target speed.

[0121] Figure 7 The illustration schematically shows a diagram of achieving accelerated recording by adjusting the outgoing frame interval parameter of an image sensor according to another embodiment of the present disclosure.

[0122] like Figure 7 As shown, in embodiment 700, when the user selects a target speed 702 of 0.5x in the speed selection interface of the recording device 701, the frame rate 703 can be determined to be 60 frames / second based on the target speed 702. Then, the frame interval parameter 705 of the image sensor can be adjusted based on the frame rate 703 and the ambient light brightness 704.

[0123] According to embodiments of this disclosure, the frame interval parameter of the image sensor corresponding to the frame rate can be a numerical range. Ambient brightness can be an ambient light parameter, and specific parameters within the aforementioned numerical range corresponding to the ambient brightness can be pre-configured.

[0124] For example, based on the frame rate corresponding to the target speed selected by the user, the frame interval parameter range of the image sensor can be matched to [60~65] frames / second; when the ambient light parameter is (100,200) lux, the corresponding frame interval parameter is 65 frames / second; when the ambient light parameter is (300,400) lux, the corresponding frame interval parameter is 60 frames / second. The frame interval parameters corresponding to other ambient light parameter ranges will not be elaborated here.

[0125] When the ambient brightness is 150 lux, the corresponding frame interval parameter can be determined to be 65 frames per second. The frame interval parameter of the image sensor can be adjusted by calling the controller built into the recording device.

[0126] According to embodiments of this disclosure, speed recording is achieved by adjusting the frame interval parameter of the image sensor based on both ambient light brightness and frame rate. This not only breaks through the limitation of frame rate on exposure time, but also increases the brightness of video frames, reduces noise, reduces device power consumption, and improves video quality in low ambient light conditions.

[0127] For recording scenarios that include audio, since the essence of sound is sound waves generated when objects vibrate, the speed of audio is to lengthen or shorten the speech signal in the time domain. Considering the user experience, while ensuring the speed of the sound, the sampling rate, fundamental frequency, and formant of the speech must not change, so as to achieve the purpose of changing the speed without changing the pitch.

[0128] The above method may also include the following operation: compressing multiple audio clips within the video recording period to the target time period corresponding to the target speed.

[0129] Figure 8 A schematic diagram illustrating audio and video synchronization according to an embodiment of the present disclosure is shown.

[0130] like Figure 8 As shown in Example 800, during the time period t1~t2, the user selects 1.0x recording speed, i.e., normal recording speed. Therefore, the audio captured during this time period does not need to be compressed. During the time period t2~t3, the user selects 2.0x recording speed. After dropping frames for non-key frames during t2~t3, the audio captured during t2~t3 can be compressed to the target time period corresponding to the dropped frames using an audio speed-up algorithm.

[0131] For example, if a 2-second video is recorded at 2.0x speed, the audio within those 2 seconds needs to be compressed to 1 second to achieve synchronization between the audio and video data.

[0132] For example, the Waveform Similarity Overlay (WSOLA) algorithm can be used to find the next most similar signal frame in the current frame and overlay the current frame with the most similar signal frame. The resulting audio is clear, natural, and of high quality.

[0133] According to embodiments of this disclosure, by employing an audio speed-up algorithm to compress the audio to a target time segment corresponding to the target speed, the audio data and video data are synchronized while the audio loss rate during speed-up recording is reduced, thereby improving the video quality of speed-up recording.

[0134] To further enhance the user experience, the video recording method of this disclosure embodiment further includes: in response to detecting a termination operation of video recording, storing multiple video frames within the video recording period.

[0135] According to embodiments of this disclosure, all unprocessed video frames from the speed-up recording stage are stored so that users can recall the video frames at any time to perform secondary creations on the speed-up recorded video as needed.

[0136] According to embodiments of this disclosure, multiple video frames within a predetermined recording period can also be sent to the target terminal device.

[0137] According to embodiments of this disclosure, the target terminal device can be an electronic device that interacts with the recording device, such as a mobile phone, tablet computer, or laptop computer. This allows users to utilize unprocessed video frames from the video recording stage to create secondary content from the sped-up video, improving the user experience.

[0138] Figure 9 A block diagram schematically illustrates an electronic device suitable for implementing a video recording method according to an embodiment of the present disclosure.

[0139] like Figure 9 As shown, an electronic device 900 according to an embodiment of the present disclosure includes a housing and a processor 901 housed within the housing, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage portion 908 into a random access memory (RAM) 903. The processor 901 may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or an associated chipset and / or a special-purpose microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 901 may also include onboard memory for caching purposes. The processor 901 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0140] RAM 903 stores various programs and data required for the operation of electronic device 900. Processor 901, ROM 902, and RAM 903 are interconnected via bus 904. Processor 901 performs various operations of the method flow according to embodiments of the present disclosure by executing programs in ROM 902 and / or RAM 903. It should be noted that the programs may also be stored in one or more memories other than ROM 902 and RAM 903. Processor 901 may also perform various operations of the method flow according to embodiments of the present disclosure by executing programs stored in said one or more memories.

[0141] According to embodiments of this disclosure, the electronic device 900 may further include an input / output (I / O) interface 905, which is also connected to a bus 904. The electronic device 900 may also include one or more of the following components connected to the I / O interface 905: a camera 906; an image sensor 907; a storage section 908 including a hard disk, etc.; and a communication section 909 including a network interface card such as a LAN card or a modem. The communication section 909 performs communication processing via a network such as the Internet. A drive 910 is also connected to the I / O interface 905 as needed. A removable medium 911, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed on the drive 910 as needed so that computer programs read from it can be installed into the storage section 908 as needed.

[0142] This disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or it may exist independently and not assembled into the device / apparatus / system. The computer-readable storage medium carries one or more programs that, when executed, implement the method according to the embodiments of this disclosure.

[0143] According to embodiments of this disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, such as including, but not limited to: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. For example, according to embodiments of this disclosure, the computer-readable storage medium may include ROM 902 and / or RAM 903 and / or one or more memories other than ROM 902 and RAM 903 described above.

[0144] Embodiments of this disclosure also include a computer program product comprising a computer program containing program code for performing the methods shown in the flowchart. When the computer program product is run on a computer system, the program code enables the computer system to implement the video recording method provided in the embodiments of this disclosure.

[0145] When the computer program is executed by the processor 901, it performs the functions defined in the system / apparatus of this disclosure embodiments. According to embodiments of this disclosure, the systems, apparatuses, modules, units, etc., described above can be implemented by computer program modules.

[0146] In one embodiment, the computer program may rely on a tangible storage medium such as an optical storage device or a magnetic storage device. In another embodiment, the computer program may also be transmitted and distributed in the form of signals over a network medium, and downloaded and installed via the communication section 909, and / or installed from a removable medium 911. The program code contained in the computer program can be transmitted using any suitable network medium, including but not limited to: wireless, wired, etc., or any suitable combination thereof.

[0147] In such an embodiment, the computer program can be downloaded and installed from a network via the communication section 909, and / or installed from the removable medium 911. When the computer program is executed by the processor 901, it performs the functions defined in the system of this disclosure embodiment. According to embodiments of this disclosure, the systems, devices, apparatuses, modules, units, etc., described above can be implemented by computer program modules.

[0148] According to embodiments of this disclosure, program code for executing the computer programs provided in embodiments of this disclosure can be written in any combination of one or more programming languages. Specifically, these computational programs can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, languages ​​such as Java, C++, Python, "C", or similar programming languages. The program code can execute entirely on a user's computing device, partially on a user's device, partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0149] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0150] This disclosure also provides a recording system, including the above-described recording device and a target terminal device that interacts with the recording device.

[0151] According to embodiments of this disclosure, the target terminal device may be a server or server cluster capable of data interaction with the recording device, or it may be an electronic device capable of data interaction with the recording device, such as a mobile phone or tablet computer.

[0152] Figure 10 A block diagram of a recording system suitable for implementing a video recording method according to an embodiment of the present disclosure is shown schematically.

[0153] like Figure 10 As shown, the recording system 1000 may include a recording device 1010, a network 1020, and a server 1030.

[0154] Network 1020 is a medium used to provide a communication link between recording device 1010 and server 1030. Network 1002 may include various connection types, such as wired and / or wireless communication links, etc.

[0155] Users can use the recording device 1010 to interact with the server 1030 via the network 1020 to receive or send messages, etc. Various communication client applications, such as software with image capture and video recording functions, can be installed on the recording device 1010.

[0156] The recording device 1010 can be any electronic device with a display screen and web browsing support, including but not limited to smartphones, smart cameras, tablets, etc. The display screen can have a speed selection interface, allowing users to choose the target speed according to their recording needs or preferences during video recording.

[0157] Server 1030 can be a server that provides various services, such as a backend management server that supports the content captured or recorded by the user using recording device 1010. The backend management server can perform image quality analysis and other processing on the received user-captured videos, and feed the processing results back to recording device 1010 so that the recording device can determine keyframes based on the analysis results, and then encode the video for the keyframes to achieve speed-up recording.

[0158] It should be noted that the video recording method provided in this embodiment can generally be executed by the recording device 1010.

[0159] Those skilled in the art will understand that the features described in the various embodiments and / or claims of this disclosure can be combined or combined in various ways, even if such combinations or combinations are not explicitly described in this disclosure. In particular, the features described in the various embodiments and / or claims of this disclosure can be combined or combined in various ways without departing from the spirit and teachings of this disclosure. All such combinations and / or combinations fall within the scope of this disclosure.

[0160] The embodiments of this disclosure have been described above. However, these embodiments are for illustrative purposes only and are not intended to limit the scope of this disclosure. Although various embodiments have been described above, this does not mean that the measures in the various embodiments cannot be used advantageously in combination. The scope of this disclosure is defined by the appended claims and their equivalents. Various substitutions and modifications can be made by those skilled in the art without departing from the scope of this disclosure, and all such substitutions and modifications should fall within the scope of this disclosure.

Claims

1. A video recording method, characterized in that, The method includes: During video recording, in response to a speed-up trigger condition, at least one target video segment is generated, wherein the speed of the target video segment is the target speed, and the footage of the target video segment is captured during the video recording process; and In response to the recording end operation, the recorded video is saved, wherein the recorded video includes the target video segment.

2. The video recording method as described in claim 1, characterized in that, The speed-up trigger conditions include: In response to a trigger operation that determines a target speed, the target speed is determined; and / or, Acquire the attitude information of the shooting equipment to determine the target speed; and / or, The target speed is determined based on the image information captured by the shooting equipment.

3. The method according to claim 1, characterized in that, During video recording, in response to a speed-up trigger condition, at least one target video segment is generated, including: The number of target frames is determined based on the frame rate corresponding to the target speed; and Based on the number of target frames, extract the target frames from multiple video frames within the video recording period to generate at least one target video segment.

4. The method according to claim 3, characterized in that, Extracting the target frame from multiple video frames within the video recording period includes: Perform frame dropping operations on non-target frames among the plurality of video frames; and In response to the detection of a dropped frame in the i-th video frame, an internal encoding frame is requested for video encoding, where i is an integer greater than 1.

5. The method according to claim 3 or 4, characterized in that, The method further includes: In response to detecting that the j-th video frame is a keyframe, the j-th video frame is determined to be the target frame, where j is an integer greater than 1.

6. The method according to claim 5, characterized in that, The method further includes: In response to detecting that the motion sensor parameters corresponding to the j-th video frame meet a first predetermined threshold, the j-th video frame is determined to be the key frame.

7. The method according to claim 5, characterized in that, The method further includes: In response to detecting that the image quality parameter corresponding to the j-th video frame meets the second predetermined threshold, the j-th video frame is determined to be the key frame.

8. The method according to claim 3, characterized in that, During video recording, in response to a speed-up trigger condition, at least one target video segment is generated, including: Based on the frame rate corresponding to the target speed, determine the frame dropping interval duration; and Based on the timestamps of the multiple video frames, the multiple video frames are processed by dropping frames according to the frame dropping interval duration to generate at least one target video segment.

9. The method according to any one of claims 1-8, characterized in that, The method further includes: In response to the detection of the termination operation of the video recording, multiple video frames within the video recording period are stored.

10. The method according to claim 9, characterized in that, The method further includes: Send multiple video frames within the predetermined recording period to the target terminal device.

11. The method according to claim 1, characterized in that, During video recording, in response to a speed-up trigger condition, at least one target video segment is generated, including: Based on the frame rate corresponding to the target speed, the frame interval parameter of the image sensor is adjusted to achieve video recording and generate at least one target video segment.

12. The method according to claim 11, characterized in that, The method further includes: The frame interval parameter of the image sensor is adjusted according to the ambient brightness and the frame rate corresponding to the target speed.

13. The method according to claim 12, characterized in that, During video recording, in response to a speed-up trigger condition, at least one target video segment is generated, including: In response to detecting that the ambient light parameter of the recording area is greater than a third predetermined threshold, multiple video frames within a predetermined recording period are dropped based on the frame rate corresponding to the target speed, so as to generate at least one target video segment.

14. The method according to claim 12, characterized in that, During video recording, in response to a speed-up trigger condition, at least one target video segment is generated, including: In response to detecting that the ambient light parameter of the recording area is less than or equal to a third predetermined threshold, the frame interval parameter of the image sensor is adjusted based on the frame rate corresponding to the target speed to achieve video recording and generate at least one target video segment.

15. The method according to any one of claims 1-14, characterized in that, The method further includes: Multiple audio clips within the video recording period are compressed to a target time period corresponding to the target speed.

16. A recording device, characterized in that, The device includes: The housing, and the camera and image sensor housed within the housing. One or more processors are configured to perform the video recording method according to any one of claims 1-15.

17. A recording system, characterized in that, The system includes: the recording device as described in claim 16 and a target terminal device that interacts with the recording device.

Images