Video data processing method and apparatus, and electronic device

Abstract

Provided in the embodiments of the present disclosure are a video data processing method and apparatus, and an electronic device. The method comprises: extracting, from a reference video, camera movements corresponding to a plurality of video image frames, and forming a camera movement sequence by using the plurality of camera movements; and on the basis of the camera movement sequence, generating a camera movement template used for adding camera movements to a video. In the solution, a camera movement template is extracted from a reference video with camera movements being used, and a user can add camera movements to a captured video by using the camera movement template, so that the difficulty for the user to use a camera movement effect is reduced, and a relatively good application effect can be achieved when users having different picture editing and processing capabilities apply camera movements to videos, thereby improving the user experience.

Description

Video data processing method, device and electronic equipment

[0001] This application claims priority to the Chinese invention patent application entitled “Video Data Processing Method, Device and Electronic Device” filed on June 27, 2023, with application number 2023107744702, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present disclosure relate to the field of image processing technology, and in particular to a video data processing method, device, and electronic device. Background Art

[0003] Camera movement typically refers to motion shots. In video production, camera movement serves as a crucial narrative medium, embodying creative agility and artistic value. Appropriate use of camera movement in a video can help portray characters, establish their characteristics, and set the scene's atmosphere, while also driving the narrative. Different motion shots can create different rhythms within the narrative, providing diverse visual experiences and psychological implications.

[0004] Summary of the Invention

[0005] The embodiments of the present disclosure provide a video data processing method, apparatus, and electronic device to provide a camera movement template to a user, thereby solving the problem that it is difficult for the user to apply camera movement effects in a video.

[0006] In a first aspect, an embodiment of the present disclosure provides a method for processing video data, the method comprising: extracting camera movements corresponding to multiple frames of video images from a reference video, and forming a camera movement sequence from the multiple camera movements; and generating a camera movement template for adding camera movements to the video based on the camera movement sequence.

[0007] In a second aspect, an embodiment of the present disclosure provides a video data processing method, which includes: in response to receiving a trigger operation of applying camera movement to a target video performed by a user, calling a camera movement template; wherein the camera movement sequence in the camera movement template is obtained based on the camera movement sequence extracted from a reference video; and applying multiple camera movements in the camera movement sequence in the camera movement template to multiple frames of video images of the target video.

[0008] In a third aspect, an embodiment of the present disclosure provides a video data processing device, which includes: an acquisition unit for extracting camera movements corresponding to multiple frames of video images from a reference video, and forming a camera movement sequence from multiple camera movements; a generation unit for generating a camera movement template for adding camera movements to the video based on the camera movement sequence.

[0009] In a fourth aspect, an embodiment of the present disclosure provides a video data processing device, which includes a calling unit for calling a camera movement template in response to receiving a trigger operation of applying camera movement performed by a user on a target video; wherein the camera movement sequence in the camera movement template is obtained based on the camera movement sequence extracted from a reference video; and an application unit for applying multiple camera movements in the camera movement sequence in the camera movement template to multiple frames of video images of the target video.

[0010] In a fifth aspect, an embodiment of the present disclosure provides an electronic device comprising: a processor and a memory; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the above-mentioned first aspect, second aspect, and various possible video data processing methods of the first and second aspects.

[0011] In a sixth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer execution instructions are stored. When a processor executes the computer execution instructions, various possible video data processing methods as described in the first aspect, the second aspect, and the first and second aspects are implemented.

[0012] In a seventh aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the first aspect, the second aspect, and various possible video data processing methods of the first and second aspects above. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0014] FIG1 is a flow chart of a video data processing method according to an embodiment of the present disclosure;

[0015] FIG2 is a principle flow chart of the video data processing method provided by the embodiment shown in FIG1 ;

[0016] FIG3 is a second flow chart of a video data processing method according to an embodiment of the present disclosure;

[0017] FIG4 is a schematic diagram showing a principle of adding enhancement information to a camera movement sequence;

[0018] FIG5 is a third flow chart of a video data processing method provided by an embodiment of the present disclosure;

[0019] FIG6 is a flow chart of a video data processing method provided by an embodiment of the present disclosure;

[0020] FIG7 is a structural block diagram of a video data processing device provided by an embodiment of the present disclosure;

[0021] FIG8 is a structural block diagram of a video data processing device provided by an embodiment of the present disclosure;

[0022] FIG9 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0023] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present disclosure without making any creative efforts shall fall within the scope of protection of the present disclosure.

[0024] Camera movement usually refers to a moving lens. For images in a fixed scene, the image captured by the moving lens can also be simulated by geometrically transforming the image captured by the fixed lens. For example, the "push" movement in the camera movement is to gradually approach the subject being photographed. This can be simulated by zooming in on the image captured by the fixed lens. The "pull" movement in the camera movement is to gradually move away from the subject being photographed. This can be simulated by zooming out on the image captured by the fixed lens. The "shift" movement in the camera movement is to move the lens. Similarly, the "shift" movement can be simulated by cropping the image captured by the fixed lens and appropriately expanding the scene.

[0025] To address the difficulty many users face in applying camera movements to videos, this disclosure provides a video data processing method that extracts camera movement sequences from existing videos and generates camera movement templates based on these sequences. Users can use these templates to simulate camera movements in their captured videos, simplifying the process.

[0026] Please refer to FIG1 , which shows a flow chart 1 of the video data processing method provided by the present disclosure.

[0027] S101: extracting camera movements corresponding to multiple frames of video images from a reference video, and composing a camera movement sequence from the multiple camera movements.

[0028] The video processing method in the present disclosure may be executed by a user terminal device or a server.

[0029] In this embodiment, the reference video here refers to a reference video that uses camera movement, which includes: actually using a moving lens in the process of shooting the reference video, or applying a simulated moving lens such as zooming or rotating to a video shot with a fixed lens.

[0030] In some application scenarios, the reference video can be, for example, a dance video. As one implementation method, to achieve a dynamic dance image and enhance the narrative effect of the dance, the dance video can be shot using a moving camera. Alternatively, a user proficient in simulated camera movement applications can add simulated camera movement to a dance video shot with a fixed camera to generate the reference video.

[0031] For a reference video that uses camera movement, the camera movement corresponding to each of the multiple video frames can be determined by using each video frame in the reference video. The camera movement corresponding to each of the multiple video frames can be a simulated camera movement.

[0032] The camera movement sequence includes multiple camera movements arranged in time sequence. That is, the camera movement information in the camera movement sequence may include multiple camera movements and time information corresponding to each camera movement.

[0033] The above-mentioned camera movements include but are not limited to: translation, zooming in, zooming out, and rotation.

[0034] The execution subject can analyze and process the reference video to obtain the camera movements corresponding to multiple frames of video images in the reference video.

[0035] The simulated camera movement here can be regarded as a geometric transformation operation.

[0036] In order to determine the geometric transformation operation corresponding to the video frame image, you can first determine P non-collinear pixel points on the video frame image, and then find the matching P pixel points on the previous video frame image. Then, based on the geometric relationship between the above P pixel points corresponding to the two frames of video images, determine the geometric transformation operation corresponding to the video frame image. Assume that the position of the P pixel points in the previous video frame image is X1 (the position of the center point of the figure composed of P pixel points is X1), and the position of the P pixel points in the video frame image is x1+Δx. Due to the continuity between the video frame images, it can be determined that the camera movement corresponding to the video frame image is translation on the x-axis. The translation size can be approximately equal to Δx.

[0037] In practice, for each two adjacent video frames in the reference video, the geometric relationship between the matching pixel points in the previous video frame image and the next video frame image in the two adjacent video frames can be determined in the above manner to determine the simulated camera movement corresponding to the next video frame image.

[0038] In this way, the camera movement corresponding to each video frame image in the reference video can be obtained through the above method. The camera movements corresponding to each video frame image are arranged in sequence according to the time information corresponding to each video frame image to obtain a camera movement sequence. Each camera movement in the above camera movement sequence can carry the time information of the video frame image corresponding to the camera movement.

[0039] S102: Based on the camera movement sequence, generate a camera movement template for adding camera movement to the video.

[0040] In some application scenarios, the camera movement sequences extracted from the reference video can be packaged in their respective orders to generate a camera movement template for adding camera movement to the video.

[0041] The camera movement here refers to a simulated camera movement that performs geometric transformations such as translation, rotation, and scaling on the video frame images in the video that has been shot.

[0042] In some application scenarios, after the camera movement sequence is obtained in step S101, a camera movement template including enhancement information for enhancing the camera movement may be generated according to preset enhancement rules.

[0043] In some application scenarios, the camera movement in the camera movement sequence obtained in step S101 may be smoothed to obtain a smoothed camera movement template.

[0044] In this embodiment, camera movements corresponding to multiple frames of video images are extracted from a reference video, and a camera movement sequence is formed from the multiple camera movements. Based on the camera movement sequence, a camera movement template is generated for adding camera movements to the video. This allows users to use the camera movement template to add camera movements to captured videos, reducing the difficulty of using camera movement effects. This allows users with different image editing capabilities to achieve good results when applying camera movements to videos, improving the user experience.

[0045] In some embodiments, the above step S101 includes the following steps:

[0046] First, for a video frame image in a reference video, the camera movement corresponding to the video frame image is determined based on the same image information in the previous video frame image and the video frame image.

[0047] Secondly, the camera movements corresponding to the video frame images are arranged in sequence to obtain a camera movement sequence.

[0048] In these embodiments, the reference video includes multiple frames of video images arranged in chronological order. For any video frame starting from the second video frame, the camera movement of the video frame can be determined based on the geometric correspondence between the previous video frame and the same image information in the video frame. The camera movement corresponding to the first video frame can be a preset value. The preset value can indicate that no camera movement is used.

[0049] In these embodiments, the camera movement corresponding to the latter of the two adjacent video frame images is determined by using each adjacent two video frame images, so that the obtained camera movement template has a smaller granularity. When the camera movement template is used to apply the camera movement to the shot video, a camera movement application effect with better continuity can be obtained.

[0050] In some embodiments, for a video frame image in a reference video, determining the camera movement corresponding to the video frame image based on the same image information in the video frame image and the previous video frame image includes the following steps:

[0051] First, by matching feature information, background images corresponding to the same background are determined in the video frame image and the previous video frame image of the video frame image.

[0052] Secondly, the camera movement is determined according to the geometric transformation relationship between the previous video frame image of the video frame image and the above-mentioned background images respectively corresponding to the video frame image.

[0053] The background here can be a stationary physical object. The image information corresponding to the background can be the imaging result of the stationary physical object in the video frame image. Preferably, the above-mentioned background can be a wall in the captured space.

[0054] In practice, an edge operator can be used to determine a background image with a regular edge shape (such as a rectangle) in the video frame image, and then an image matching method is used to search for a background image identical to the background image in the previous video frame image.

[0055] In these embodiments, a background image (deemed as a first background image) can be determined from the video frame image, and then image features of the first background image in the video frame image can be determined. This image feature is then matched with the video frame image preceding the video frame image, thereby matching a background image (deemed as a second background image) that matches the first background image in the preceding video frame image. The camera movement of the video frame image can be determined based on the geometric correspondence between the first background image and the second background image.

[0056] Specifically, the camera movement of the video frame may be determined based on a geometric transformation relationship between feature points in the first background image and corresponding feature points in the second background image.

[0057] As an illustrative example, for a reference video containing a moving object, the moving object can first be identified in multiple frames of the reference video using an object detection method. The image of the moving object is then removed from the video frame image data by masking or deleting the image data of the moving object. After this processing, each video frame image only includes the entire background image.

[0058] The N-1th video frame is the video frame preceding the Nth video frame. A background image (first background image) with a regular outline can be searched for in the Nth video frame. Image features of the first background image are then extracted. These image features are used to perform a match in the N-1th video frame, thereby matching the second background image in the N-1th video frame. The N-1th video frame and the Nth video frame can be background images of an image without a moving object.

[0059] The regular shape may be, for example, a rectangle or triangle. Vertices in the outline of the first background image may be used as feature points. Corresponding vertices in the second background image may be used as corresponding feature points. The camera movement may be determined by a geometric transformation relationship between at least one feature point in the first background image and its corresponding feature point in the second background image.

[0060] The above-mentioned geometric transformation relationship may include, for example, rotation, translation, scaling, etc.

[0061] In these embodiments, by selecting a background image whose outline is a regular pattern to determine the simulated camera movement, the complexity of determining the simulated camera movement can be reduced.

[0062] In some embodiments, determining the camera movement based on a geometric transformation relationship between a previous video frame image of the video frame image and a background image corresponding to the video frame image includes:

[0063] The camera movement is determined based on an affine matrix between feature points of a background image corresponding to the video frame image and corresponding feature points of a background image corresponding to a video frame image preceding the video frame image.

[0064] In practice, an affine matrix including four degrees of freedom, namely, x-axis translation, y-axis translation, rotation, and scaling, can be set. The affine matrix here can be, for example, an affine matrix. The values ​​of the parameters corresponding to each of the degrees of freedom can be approximately determined based on the affine transformation relationship between the coordinates of multiple corresponding feature points in the background image of the previous video frame and the feature points in the background image of the current video frame. Based on the values ​​of the parameters for each degree of freedom, the quantized camera movement corresponding to the video frame is determined.

[0065] Still taking the background image in the N-1th frame of video image as the second background image and the Nth frame of video image as the first background image as an example, the geometric transformation relationship between the corresponding feature point X'(x', y') in the first background image and the feature point X(x, y) in the second background image can be represented by the following formula (1):

[0066] X'=AX+B(1); where

[0067] A is a matrix including rotation and scaling degrees of freedom; B is a matrix including translation.

[0068] The above formula (1) can be expressed as the following formula (2):

[0069] in, It can be an affine matrix. a, b, c, d, e, and f are the parameters to be determined.

[0070] The above-mentioned multiple feature points and the coordinates of the above-mentioned multiple corresponding feature points can be used to solve the above-mentioned formula (2), thereby obtaining a quantitative representation of the camera movement of the N-th frame of video image.

[0071] Furthermore, for different camera movements, the above parameters a, b, c, d, e, and f have different constraints. When solving formula (2), for each camera movement, the corresponding constraints, the feature points, and their coordinates can be used to solve for the above parameters. This results in a quantitative representation of the camera movement.

[0072] In some embodiments, the above formula (2) can be solved based on a gradient descent algorithm. Schematically, initial values ​​a0, b0, c0, d0, e0, and f0 can be set for each parameter. The result of multiplying the affine matrix composed of the initial values ​​of each parameter by the column vector [x, y, 1]' is then subtracted from the column vector [x', y', 1]', and the resulting difference is used as the initial difference (Loss value). That is, the above difference is calculated by the following formula (3):

[0073] Then, set the corresponding change amount for each parameter, use the sum of the initial value of each parameter and the above change amount as the updated initial value, and recalculate the above loss using the above formula (3). If the loss increases, adjust the change direction of the above transformation amount, re-determine the updated initial value, and recalculate the above formula (3).

[0074] If the loss decreases, the direction of change corresponding to the change is the opposite direction of the gradient. Continue to determine the change along this direction, and then determine the updated initial values ​​corresponding to each parameter. Then, use the above formula (3) to calculate the loss based on the updated initial values. Iterate step by step until the loss tends to be stable. This can obtain the values ​​of a, b, c, d, e, and f. This results in the affine matrix, which is the quantized camera movement.

[0075] The simulated camera movement of each video frame image may be determined according to the above method.

[0076] Please refer to Figure 2, which shows a principle flow chart of the video data processing method provided by this embodiment. The reference video includes a video frame image sequence arranged in chronological order: video frame image 1, video frame image 2, ..., video frame image k, ... and video frame image n.

[0077] For the n video frames described above, the camera movement of video frame 1 can be set to a parameter indicating that no camera movement is used. Starting with video frame 2, the moving target object can be removed from this video frame to determine the background image in this video frame. An edge detection operator is used to determine a first background image having a rectangular edge outline in the background image.

[0078] The first background image is registered with the previous video frame image using a preset registration method to obtain a second background image in the previous video frame image that matches the first background image.

[0079] If the reference video is a dance video, taking video frame image 2 as an example, a human body recognition algorithm can be used to identify the human body from video frame image 2. Then, the image data of the human body is removed from the image data of video frame image 2 to obtain background image data. An image detection method or an edge detection operator is used to identify a first background image having a rectangular outline. The image features of the first background image are extracted. Then, a match is performed in video frame image 1 based on the image features, and a second background image is matched from video frame image 1. The outline of the second background image is determined using an edge detection algorithm. Several first feature points (such as the four vertices of the rectangular outline) are found from the first background image, and several second feature points (such as the four vertices of the rectangular outline) corresponding to the first feature points are found from the second background image. Based on the first feature points and the second feature points, the various parameters of the affine matrix corresponding to video frame image 2 are calculated.

[0080] Specifically, when calculating the various parameters of the preset affine matrix, the values ​​of the various parameters can be gradually solved using the gradient descent method and the preset loss function, and finally the values ​​of the various parameters of the affine matrix are obtained.

[0081] An affine matrix composed of the values ​​of the various parameters can be used as simulated camera movement 2 for video frame image 2. This results in simulated camera movement 2 for video frame image 2. This process is repeated until simulated camera movement n for video frame image n is determined. Time information is added to the simulated camera movement 1, simulated camera movement 2, ..., simulated camera movement k, ..., and simulated camera movement n, respectively, and each simulated camera movement is arranged according to its corresponding time information to obtain a camera movement sequence. Simulated camera movement 1 for video frame image 1 can correspond to a preset initial value.

[0082] In these implementations, the affine matrix corresponding to the latter video frame image in two adjacent video frames is estimated by using the feature points of the same background image in the two adjacent video frames, and the camera movement corresponding to the latter video frame image is represented by the affine matrix. The specific representation of the camera movement can be determined by using the existing affine matrix solution method, and an accurate camera movement representation can be obtained.

[0083] Please continue to refer to Figure 3, which shows a second flow chart of the video data processing method provided by the present disclosure. As shown in Figure 3, the video data processing method includes the following steps:

[0084] S301: extracting camera movements corresponding to multiple frames of video images from a reference video, and composing a camera movement sequence from the multiple camera movements.

[0085] The specific implementation of the above step S301 can refer to the description of the embodiment shown in FIG1 , which will not be described in detail here.

[0086] S302: Determine first enhancement information corresponding to at least one camera movement based on action information and / or aesthetic deconstruction features of a target object in video frames respectively involved in a plurality of camera movements.

[0087] S303: Generate a camera movement template including first enhancement information based on the camera movement sequence.

[0088] The execution subject of this embodiment may be a terminal device, or a server that provides a camera movement template.

[0089] After obtaining the above-mentioned camera movement sequence in step S301, each camera movement in the camera movement sequence may correspond to an affine matrix quantizing the camera movement. In order to increase the appeal of the video using the camera movement template, first camera movement enhancement information may also be set in the camera movement template.

[0090] In some application scenarios, corresponding enhancement information can be set for a preset action of an object. For example, the preset action may include a preset action performed by a person's limbs. For example, the preset action may include one or more specified dance movements. In other words, when, in multiple frames of a reference video, the target object's action in a video frame is one of the preset actions, enhancement information can be set for the camera movement corresponding to that video frame.

[0091] The first enhancement information here includes a coefficient for magnifying or reducing the camera movement.

[0092] The above-mentioned magnification coefficient and reduction coefficient can be set according to the specific application scenario and are not limited here. In addition, the above-mentioned magnification coefficient and reduction coefficient can also be set based on experience.

[0093] In some application scenarios, for each camera movement, first enhancement information can be set that is positively correlated with the target object's motion amplitude. In this way, the camera movement template can include first enhancement information corresponding to each camera movement. Each first enhancement information is positively correlated with the target object's motion amplitude in the corresponding video frame.

[0094] In some application scenarios, the aesthetic deconstruction features of the video frames corresponding to multiple camera movements can be analyzed, and then one or more camera movements can be selected from the multiple camera movements based on the aesthetic deconstruction features, and the first enhancement information can be set for the selected one or more camera movements.

[0095] Aesthetic deconstruction characteristics can be characteristics that emphasize contingency and particularity.

[0096] In these application scenarios, selecting one or more camera movements for enhancement through aesthetic deconstruction features can increase the interest of the video using the above-mentioned camera movement template.

[0097] Compared with the embodiment of Figure 1, this embodiment adds the first enhancement information corresponding to the camera movement determined based on the action information and / or aesthetic structural characteristics of the target object in the reference video. The generated camera movement template includes the first enhancement information, so that the video obtained using the camera movement template can have better dynamics and appeal, which can improve the user's visual experience.

[0098] Please refer to Figure 4, which shows a schematic diagram of the principle of adding enhancement information to a camera movement sequence. As shown in Figure 4, a reference video is input to the execution body of the video data processing method. The above-mentioned execution body can use the steps of the embodiment shown in Figure 1 or Figure 3 to analyze the camera movement of the reference video, thereby obtaining a camera movement sequence. For each video frame image in the reference video, the aesthetic deconstruction features in the video frame image can be analyzed. For each video frame image, the first enhancement information of the camera movement corresponding to the video frame image can be determined based on the above-mentioned aesthetic deconstruction features and / or the user action information in the video frame image. The first enhancement information corresponding to each video frame is associated with the camera movement corresponding to the video frame and stored to obtain a camera movement template including the first enhancement information.

[0099] Please continue to refer to Figure 5, which shows a flow chart of the third method for processing video data provided by the present disclosure. As shown in Figure 5, the method for processing video data includes the following steps:

[0100] S501: extracting camera movements corresponding to multiple frames of video images from a reference video, and composing a camera movement sequence from the multiple camera movements.

[0101] The specific implementation of the above step S501 can refer to the description of the embodiment shown in FIG1 , which will not be described in detail here.

[0102] S502: Determine second enhancement information corresponding to at least one camera movement according to audio information corresponding to video frame images respectively involved in a plurality of camera movements.

[0103] S503: Generate a camera movement template including second enhancement information based on the camera movement sequence.

[0104] The execution subject of this embodiment may be a terminal device, or a server that provides a camera movement template.

[0105] After the camera movement sequence is obtained in step S501 , each camera movement in the camera movement sequence may correspond to an affine matrix that quantizes the camera movement.

[0106] In this embodiment, the at least one camera movement may be one or more of the multiple camera movements. In some application scenarios, the at least one camera movement may be all the camera movements in the camera movement sequence.

[0107] The above audio information includes but is not limited to one or more of the following: music type, emotions conveyed by the music, music structure, beat, human voice in the music, and instrument type.

[0108] The second enhancement information here includes a coefficient for magnifying or reducing the camera movement.

[0109] In some embodiments, corresponding second enhancement information may be set for specific audio information, such as drum beats, and second enhancement information corresponding to the drum beats may be set.

[0110] In some embodiments, different second enhancement information can be set for different music types. For example, for audio information with a soft melody, second enhancement information with a reduction factor can be set, while for music with a strong sense of rhythm and card points, second enhancement information with a magnification factor can be set.

[0111] The second enhancement information corresponding to the at least one camera movement in the camera movement sequence is respectively associated with the at least one camera movement, and then packaged to generate a camera movement template including the second enhancement information.

[0112] That is to say, one or more camera movements in the camera movement sequence in the camera movement template are respectively associated with the corresponding second enhancement information. When applying the camera movement template, the multiple audio frames in the audio information used, the camera movement sequence and the video frame sequence of the video to which the camera movement template is applied can be aligned on the time axis. For each video frame image, the camera movement and audio frame corresponding to the video frame image can be searched on the time axis. The audio information of the audio frame is detected, and the second enhancement information matching the audio information is searched from the camera movement template, and the second enhancement information is applied to the camera movement, thereby applying music-aware camera movement to the video.

[0113] Compared with the embodiment shown in Figure 1, the camera movement template in this embodiment adds transformation information related to audio information for camera movement, which is beneficial for users to apply music-perceived camera movement to the shot video, thereby enhancing the appeal and expressiveness of the video and further enhancing the user experience.

[0114] Please continue to refer to Figure 6, which shows a flow chart of the video data processing method provided by the present disclosure. As shown in Figure 6, the video data processing method includes the following steps:

[0115] S601: In response to receiving a trigger operation of applying camera movement to a target video performed by a user, calling a camera movement template; wherein the camera movement sequence in the camera movement template is obtained according to a camera movement sequence extracted from a reference video.

[0116] The execution subject of this embodiment may be a terminal device used by a user.

[0117] The target video here can be any video shot with a fixed lens. In some application scenarios, the target video can be a dance video.

[0118] A user may apply camera movement to the target video, for example, by displaying a camera movement control indicating the application of the camera movement in an interface displaying the target video. The user may trigger the camera movement control. Upon receiving the trigger operation on the camera movement control, the execution entity may call a pre-stored camera movement template. The camera movement template may include a camera movement sequence. The camera movement template may be generated based on a camera movement sequence extracted from a reference video.

[0119] S602: Apply multiple camera movements in the camera movement sequence to multiple frames of video images of the target video.

[0120] The camera movement sequence includes multiple camera movements arranged in chronological order.

[0121] Each camera movement in the camera movement sequence can be sequentially applied to multiple frames of the target video according to its respective time information. As an implementation method, the camera movement sequence can be aligned with the video frame sequence of the target video on the time axis. For each frame of the target video, the camera movement aligned on the time axis is applied.

[0122] In this embodiment, when applying camera movement to a target video, a camera movement template is called, and multiple camera movements in the camera movement template are applied to multiple frames of video images of the target video. This reduces the difficulty of adding simulated camera movement to the shot video, and enables users with different picture editing and processing capabilities to achieve better application effects when applying camera movement to videos, thereby improving the user experience.

[0123] In some embodiments, the above method further comprises the following steps:

[0124] First, the action of the target object in the current video frame image is detected, and first enhancement information matching the action is determined.

[0125] Secondly, the camera movement corresponding to the current video frame image is enhanced using the first enhancement information.

[0126] The target object's action is a body movement of the target object. In some embodiments, when the target object's action matches a preset action, first enhancement information matching the preset action can be determined from the camera movement template.

[0127] In other words, the camera movement template is also associated with first enhancement information. The first enhancement information can be associated with a specific action (preset action) of a target object in a target video frame. For example, if the target video is a dance video, when a user performs a preset dance action in the target video, the camera movement of the video frame of the dance action can be enhanced.

[0128] In some embodiments, if the amplitude of the target object's motion is greater than a preset amplitude threshold, first enhancement information matching the motion may be determined from the camera movement template.

[0129] For each camera movement, a corresponding first enhancement information may be associated. The enhancement amplitude of the camera movement indicated by the first enhancement information may be positively correlated with the motion amplitude of the target object. The motion amplitude of the target object here may include, for example, the motion amplitude of a person's limbs.

[0130] For example, if the target video scene is a dance scene, the camera movement enhancement coefficient for a video frame is set based on the magnitude of the target object's dance movement detected in the video frame. The larger the dance movement, the larger the enhancement coefficient.

[0131] In these embodiments, by determining the first enhancement information according to the action of the target object and enhancing the camera movement of the video frame image according to the first enhancement information, the dynamics of the target video can be enhanced and the appeal of the target video can be enhanced.

[0132] In some embodiments, the above method further comprises the following steps:

[0133] First, current audio information is detected, and second enhancement information matching the current audio information is determined.

[0134] Secondly, the second enhancement information is applied to enhance the camera movement corresponding to the current video frame image.

[0135] The audio information here includes but is not limited to one or more of music style, structure, mood, beat, instrument type, and vocals.

[0136] The above-mentioned camera movement template may include second enhancement information corresponding to different audio information.

[0137] In these embodiments, current audio content can be acquired in real time, and audio information corresponding to the acquired audio content can be detected. A camera movement corresponding to the audio information is determined from a camera movement template. Second enhancement information corresponding to the audio information is simultaneously determined from the camera movement template, and the second enhancement information is applied to the camera movement. The camera movement with the second enhancement information applied is then applied to the current video frame image.

[0138] In these embodiments, the intensity of camera movements is triggered by analyzing audio information, making the overall camera effects of the video richer and more varied. Music camera movements analyze the type, structure, mood, and tempo of the music in the video and generate corresponding trigger signals based on the audio information. This automatically adapts camera movements and other special effects to the original video, enhancing the video's appeal and expressiveness.

[0139] Corresponding to the video data processing method of the embodiment shown in FIG1 above, FIG7 is a structural block diagram of a video data processing device provided by an embodiment of the present disclosure. For ease of explanation, only the parts related to the embodiment of the present disclosure are shown. Referring to FIG7, the video data processing device 70 includes: an acquisition unit 701 and a generation unit 702.

[0140] An acquisition unit 701 is configured to extract camera movements corresponding to multiple frames of video images from a reference video, and to form a camera movement sequence from the multiple camera movements;

[0141] 702 A generating unit is used to generate a camera movement template for adding camera movement to the video based on the camera movement sequence.

[0142] In one embodiment of the present disclosure, the acquiring unit 701 is further configured to:

[0143] For a video frame image in a reference video, determining a camera movement corresponding to the video frame image based on the same image information in the video frame image and a previous video frame image of the video frame image;

[0144] Arrange the camera movements corresponding to the video frame images in sequence to obtain a camera movement sequence.

[0145] In one embodiment of the present disclosure, the acquiring unit 701 is further configured to:

[0146] By matching feature information, background images corresponding to the same background are determined in the previous video frame image of the video frame image and the video frame image;

[0147] The camera movement is determined according to a geometric transformation relationship between a previous video frame image of the video frame image and background images respectively corresponding to the video frame image.

[0148] In one embodiment of the present disclosure, the acquiring unit 701 is further configured to:

[0149] The camera movement is determined based on an affine matrix between feature points of a background image corresponding to the video frame image and corresponding feature points of a background image corresponding to a video frame image preceding the video frame image.

[0150] In one embodiment of the present disclosure, the generating unit 702 is further configured to:

[0151] determining first enhancement information corresponding to at least one camera movement based on motion information and / or aesthetic deconstruction features of a target object in video frame images respectively involved in the plurality of camera movements;

[0152] A camera movement template including the first enhancement information is generated.

[0153] In one embodiment of the present disclosure, the generating unit 702 is further configured to:

[0154] determining, based on audio information corresponding to video frame images respectively involved in the plurality of camera movements, second enhancement information corresponding to at least one camera movement;

[0155] Generate a camera movement template including the second enhancement information.

[0156] In one embodiment of the present disclosure, the audio information includes at least one of the following:

[0157] The type of music, the mood the music conveys, the structure of the music, the beat, the vocals in the music, the types of instruments.

[0158] Corresponding to the video data processing method of the embodiment shown in FIG5 above, FIG8 is a structural block diagram of a video data processing device provided by an embodiment of the present disclosure. For ease of explanation, only the parts related to the embodiment of the present disclosure are shown. Referring to FIG8, the video data processing device 80 includes: a calling unit 801 and an application unit 802.

[0159] The calling unit 801 is configured to call a camera movement template in response to receiving a trigger operation of applying camera movement to a target video by a user; wherein the camera movement sequence in the camera movement template is obtained based on the camera movement sequence extracted from the reference video;

[0160] The application unit 802 is configured to apply multiple camera movements in a camera movement sequence in a camera movement template to multiple frames of video images of a target video.

[0161] In some embodiments, the application unit 802 is further configured to:

[0162] Detecting an action of a target object in a current video frame image, and determining first enhancement information matching the action;

[0163] The first enhancement information is applied to enhance the camera movement corresponding to the current video frame image.

[0164] In some embodiments, the application unit 802 is further configured to:

[0165] detecting current audio information and determining second enhancement information matching the current audio information;

[0166] The second enhancement information is applied to enhance the camera movement corresponding to the current video frame image.

[0167] In order to implement the above embodiment, the embodiment of the present disclosure further provides an electronic device.

[0168] Referring to FIG9 , a schematic diagram of the structure of an electronic device 900 suitable for implementing an embodiment of the present disclosure is shown. The electronic device 900 may be a terminal device or a server. The terminal device may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), vehicle-mounted terminals (e.g., vehicle-mounted navigation terminals), and fixed terminals such as digital TVs and desktop computers. The electronic device shown in FIG9 is merely an example and should not limit the functionality and scope of use of the embodiments of the present disclosure.

[0169] As shown in Figure 9, the electronic device 900 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 into a random access memory (RAM) 903. Various programs and data required for the operation of the electronic device 900 are also stored in the RAM 903. The processing device 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0170] Typically, the following devices may be connected to the I / O interface 905: an input device 906 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 907 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 908 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 909. The communication device 909 may allow the electronic device 900 to communicate with other devices wirelessly or by wire to exchange data. Although FIG9 shows an electronic device 900 with various devices, it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or have alternatively.

[0171] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via the communication device 909, or installed from the storage device 908, or installed from the ROM 902. When the computer program is executed by the processing device 901, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0172] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0173] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0174] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0175] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0176] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0177] The units described in the embodiments of the present disclosure may be implemented in software or hardware. In some cases, the name of a unit does not limit the unit itself. For example, the acquisition unit may be described as "a unit that extracts camera movements corresponding to multiple frames of video images from a reference video and composes a camera movement sequence from the multiple camera movements."

[0178] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0179] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0180] In a first aspect, according to one or more embodiments of the present disclosure, a method for processing video data is provided, the method comprising:

[0181] Extracting camera movements corresponding to multiple frames of video images from a reference video, and composing a camera movement sequence from the multiple camera movements;

[0182] Based on the camera movement sequence, a camera movement template is generated for adding camera movement to the video.

[0183] According to one or more embodiments of the present disclosure, camera movements corresponding to multiple frames of video images are extracted from a reference video, and a camera movement sequence is formed from the multiple camera movements, including:

[0184] For a video frame image in a reference video, determining a camera movement corresponding to the video frame image based on the same image information in the video frame image and a previous video frame image of the video frame image;

[0185] Arrange the camera movements corresponding to the video frame images in sequence to obtain a camera movement sequence.

[0186] According to one or more embodiments of the present disclosure, for a video frame image in a reference video, determining a camera movement corresponding to the video frame image based on identical image information between a previous video frame image and the video frame image includes:

[0187] By matching feature information, background images corresponding to the same background are determined in the previous video frame image of the video frame image and the video frame image;

[0188] The camera movement is determined according to a geometric transformation relationship between a previous video frame image of the video frame image and background images respectively corresponding to the video frame image.

[0189] According to one or more embodiments of the present disclosure, determining a camera movement based on a geometric transformation relationship between a previous video frame image of the video frame image and a background image corresponding to the video frame image includes:

[0190] The camera movement is determined based on an affine matrix between feature points of a background image corresponding to the video frame image and corresponding feature points of a background image corresponding to a video frame image preceding the video frame image.

[0191] According to one or more embodiments of the present disclosure, generating a camera template for adding camera movements to a video based on a camera movement sequence includes:

[0192] determining first enhancement information corresponding to at least one camera movement based on motion information and / or aesthetic deconstruction features of a target object in video frame images respectively involved in the plurality of camera movements;

[0193] A camera movement template including the first enhancement information is generated.

[0194] According to one or more embodiments of the present disclosure, generating a camera template for adding camera movements to a video based on a camera movement sequence includes:

[0195] determining, based on audio information corresponding to video frame images respectively involved in the plurality of camera movements, second enhancement information corresponding to at least one camera movement;

[0196] Generate a camera movement template including the second enhancement information.

[0197] According to one or more embodiments of the present disclosure, the audio information includes at least one of the following:

[0198] The type of music, the mood the music conveys, the structure of the music, the beat, the vocals in the music, the types of instruments.

[0199] In a second aspect, according to one or more embodiments of the present disclosure, a method for processing video data is provided, the method comprising:

[0200] In response to receiving a trigger operation of applying camera movement to a target video performed by a user, calling a camera movement template; wherein a camera movement sequence in the camera movement template is obtained according to a camera movement sequence extracted from a reference video;

[0201] Apply multiple camera moves in a camera move sequence to multiple frames of a target video.

[0202] According to one or more embodiments of the present disclosure, the method further includes:

[0203] Detecting an action of a target object in a current video frame image, and determining first enhancement information matching the action;

[0204] The camera movement corresponding to the current video frame image is enhanced using the first enhancement information.

[0205] According to one or more embodiments of the present disclosure, the method further includes:

[0206] detecting current audio information and determining second enhancement information matching the current audio information;

[0207] The second enhancement information is applied to enhance the camera movement corresponding to the current video frame image.

[0208] In a third aspect, according to one or more embodiments of the present disclosure, a video data processing device is provided, the device comprising: an acquisition unit and a generation unit.

[0209] An acquisition unit, configured to extract camera movements corresponding to multiple frames of video images from a reference video, and compose a camera movement sequence from the multiple camera movements;

[0210] The generating unit is used to generate a camera movement template for adding camera movement to the video based on the camera movement sequence.

[0211] In one embodiment of the present disclosure, the acquiring unit is further configured to:

[0212] For a video frame image in a reference video, determining a camera movement corresponding to the video frame image based on the same image information in the video frame image and a previous video frame image of the video frame image;

[0213] Arrange the camera movements corresponding to the video frame images in sequence to obtain a camera movement sequence.

[0214] In one embodiment of the present disclosure, the acquiring unit is further configured to:

[0215] By matching feature information, background images corresponding to the same background are determined in the previous video frame image of the video frame image and the video frame image;

[0216] The camera movement is determined according to a geometric transformation relationship between a previous video frame image of the video frame image and background images respectively corresponding to the video frame image.

[0217] In one embodiment of the present disclosure, the acquiring unit is further configured to:

[0218] The camera movement is determined based on an affine matrix between feature points of a background image corresponding to the video frame image and corresponding feature points of a background image corresponding to a video frame image preceding the video frame image.

[0219] In one embodiment of the present disclosure, the generating unit is further configured to:

[0220] determining first enhancement information corresponding to at least one camera movement based on motion information and / or aesthetic deconstruction features of a target object in video frame images respectively involved in the plurality of camera movements;

[0221] A camera movement template including the first enhancement information is generated.

[0222] In one embodiment of the present disclosure, the generating unit is further configured to:

[0223] determining, based on audio information corresponding to video frame images respectively involved in the plurality of camera movements, second enhancement information corresponding to at least one camera movement;

[0224] Generate a camera movement template including the second enhancement information.

[0225] In one embodiment of the present disclosure, the audio information includes at least one of the following:

[0226] The type of music, the mood the music conveys, the structure of the music, the beat, the vocals in the music, the types of instruments.

[0227] In a fourth aspect, according to one or more embodiments of the present disclosure, a video data processing device is provided, the device comprising: a calling unit and an application unit; wherein,

[0228] a calling unit, configured to call a camera movement template in response to receiving a trigger operation of applying camera movement to a target video performed by a user; wherein the camera movement sequence in the camera movement template is obtained according to the camera movement sequence extracted from the reference video;

[0229] The application unit is used to apply multiple camera movements in the camera movement sequence to multiple frames of video images of the target video.

[0230] In some embodiments, the application unit is further configured to:

[0231] Detecting an action of a target object in a current video frame image, and determining first enhancement information matching the action;

[0232] The camera movement corresponding to the current video frame image is enhanced using the first enhancement information.

[0233] In some embodiments, the application unit is further configured to:

[0234] detecting current audio information and determining second enhancement information matching the current audio information;

[0235] The second enhancement information is applied to enhance the camera movement corresponding to the current video frame image.

[0236] In a fifth aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, comprising: at least one processor and a memory;

[0237] Memory stores computer-executable instructions;

[0238] At least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the first aspect, the second aspect, and various video data processing methods that may be involved in the first and second aspects.

[0239] In the sixth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, in which computer execution instructions are stored. When the processor executes the computer execution instructions, the video data processing methods as described in the first aspect, the second aspect, and various possible aspects of the first and second aspects are implemented.

[0240] In the seventh aspect, according to one or more embodiments of the present disclosure, a computer program product is provided, including a computer program, which, when executed by a processor, implements the first aspect, the second aspect, and various video data processing methods that may be involved in the first and second aspects.

[0241] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0242] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0243] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A video data processing method, comprising: Extract camera movements corresponding to multiple frames of video images from a reference video, and form a camera movement sequence from the multiple camera movements; Based on the camera movement sequence, a camera movement template for adding camera movement to the video is generated.

2. The method according to claim 1, wherein extracting camera movements corresponding to multiple frames of video images from a reference video and forming a camera movement sequence from the multiple camera movements comprises: For a video frame image in the reference video, determining a lens movement corresponding to the video frame image according to a previous video frame image of the video frame image and the same image information in the video frame image; The camera movements corresponding to the video frame images are arranged in sequence to obtain the camera movement sequence.

3. The method according to claim 2, wherein for a video frame image in the reference video, determining the camera movement corresponding to the video frame image according to the same image information in the video frame image and a previous video frame image of the video frame image comprises: By matching the feature information, background images corresponding to the same background are determined in the previous video frame image of the video frame image and the video frame image; The camera movement is determined according to a geometric transformation relationship between a previous video frame image of the video frame image and the background images respectively corresponding to the video frame image.

4. The method according to claim 3, wherein determining the camera movement according to the geometric transformation relationship between the previous video frame image of the video frame image and the background image respectively corresponding to the video frame image comprises: The camera movement is determined based on an affine matrix between feature points of the background image corresponding to the video frame image and corresponding feature points of the background image corresponding to a previous video frame image of the video frame image.

5. The method according to claim 1, wherein generating a camera movement template for adding camera movement to a video based on the camera movement sequence comprises: Determine first enhancement information corresponding to at least one camera movement according to action information and / or aesthetic deconstruction features of a target object in the video frame images respectively involved in the multiple camera movements; Generate a camera movement template including the first enhanced information.

6. The method according to claim 1, wherein generating a camera movement template for adding camera movement to a video based on the camera movement sequence comprises: Determining second enhancement information corresponding to at least one camera movement according to audio information corresponding to the video frame images respectively involved in the multiple camera movements; Generate a camera movement template including the second enhanced information.

7. The method according to claim 6, wherein the audio information comprises at least one of the following: The type of music, the emotions it conveys, the structure of the music, the beat, the vocals in the music, the types of instruments.

8. A video data processing method, comprising: In response to receiving a trigger operation of applying camera movement performed by a user on a target video, calling a camera movement template; wherein a camera movement sequence in the camera movement template is obtained according to a camera movement sequence extracted from a reference video; Apply multiple camera movements in the camera movement sequence to multiple frames of video images of a target video.

9. The method according to claim 8, wherein the method further comprises: Detecting an action of a target object in a current video frame image, and determining first enhancement information matching the action; The camera movement corresponding to the current video frame image is enhanced using the first enhancement information.

10. The method according to claim 8, wherein the method further comprises: Detecting current audio information and determining second enhanced information matching the current audio information; The second enhancement information is applied to enhance the camera movement corresponding to the current video frame image.

11. A video data processing device, comprising: An acquisition unit, used for extracting camera movements corresponding to multiple frames of video images from a reference video, and forming a camera movement sequence from the multiple camera movements; A generating unit is used to generate a camera movement template for adding camera movement to a video based on the camera movement sequence.

12. A video data processing device, comprising: A calling unit, configured to call a camera movement template in response to receiving a trigger operation of applying camera movement performed by a user on a target video; wherein the camera movement sequence in the camera movement template is obtained according to the camera movement sequence extracted from the reference video; The application unit is used to apply multiple camera movements in the camera movement sequence in the camera movement template to multiple frames of video images of the target video.

13. An electronic device comprising: Processor and memory; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor performs the video data processing method according to any one of claims 1 to 10.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions. When a processor executes the computer-executable instructions, the video data processing method according to any one of claims 1 to 10 is implemented.

15. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the video data processing method according to any one of claims 1 to 10 is implemented.

Images