A video content generation method, device, electronic equipment and storage medium

Abstract

The application relates to the computer technical field, and in particular to a video content generation method and device, electronic equipment and storage medium, which are used for fast secondary creation of video content and improve the human-computer interaction efficiency. The method comprises the following steps: in response to a first editing operation, an editing interface comprising an editing control is displayed, and a to-be-edited video picture of a to-be-processed video is displayed in the editing interface; in response to a second editing operation, a corresponding first target effect material is added to a target region in the to-be-edited video picture, the first target effect material is obtained by performing editing processing on a picture in the target region in the to-be-edited video picture according to an editing function corresponding to a target editing control; and in response to an editing completion operation, an edited to-be-processed video is generated based on the first target effect material, and the edited to-be-processed video is continuously played in a video display interface. The application extracts original video content as a material for fast secondary creation, thereby improving the human-computer interaction efficiency.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a video content generation method, apparatus, electronic device, and storage medium. Background Technology

[0002] With the rapid development of computer technology and mobile communication technology, various video platforms based on electronic devices have been widely used, and more and more people are watching videos through these platforms, greatly enriching their daily lives.

[0003] In related technologies, in order to increase the number and stickiness of objects in video applications, system-preset materials or external text formats, stickers, music, GIFs and other materials can be overlaid on the video content to achieve secondary creation of the video content.

[0004] In this method, after overlaying video content with system-preset or external materials, the differences between these materials and the original video content can easily lead to choppy and jerky adjusted video content, affecting the viewing experience and resulting in low human-computer interaction efficiency. Furthermore, this method typically uses a separate application (APP) for modification, resulting in low overall modification efficiency. Therefore, how to quickly perform secondary creation of video content and improve human-computer interaction efficiency is an urgent problem to be solved. Summary of the Invention

[0005] This application provides a video content generation method, apparatus, electronic device, and storage medium for rapid secondary creation of video content, thereby improving human-computer interaction efficiency.

[0006] The first video content generation method provided in this application includes: In response to a first editing operation triggered by a video to be processed playing in a video display interface, an editing interface including at least one editing control is displayed, and the video to be edited is displayed in the editing interface, with each editing control corresponding to an editing function; In response to a second editing operation triggered by a target editing control, a corresponding first target effect material is added to the target area of ​​the video frame to be edited. The first target effect material is obtained by editing the image within the target area of ​​the video frame to be edited according to the editing function corresponding to the target editing control. In response to the editing completion operation triggered for the video to be processed, an edited video to be processed is generated based on the first target effect material, and the edited video to be processed continues to play in the video display interface.

[0007] The second video content generation method provided in this application includes: The system receives a first editing instruction from the client for the video to be processed. The first editing instruction is generated by the client in response to a second editing operation triggered by a target editing control in the editing interface. The editing interface is displayed by the client after responding to the first editing operation triggered by the video to be processed. It includes at least one editing control and displays the video to be processed, with each editing control corresponding to an editing function. Based on the first editing instruction, the editing function corresponding to the target editing control is determined, and the image in the target area of ​​the video to be edited is processed to achieve the corresponding effect of the editing function, generating the first target effect material, and feeding it back to the client so that the client can add the first target effect material to the target area of ​​the video to be edited; The first target effect material is associated with and stored with the video to be processed.

[0008] The first video content generation apparatus provided in this application includes: An editing trigger unit is used to respond to a first editing operation triggered by a video to be processed played in a video display interface, display an editing interface including at least one editing control, and display the video to be edited in the editing interface, wherein each editing control corresponds to an editing function; The video editing unit is used to respond to a second editing operation triggered by a target editing control, and to add a corresponding first target effect material to the target area of ​​the video frame to be edited. The first target effect material is obtained by editing the image in the target area of ​​the video frame to be edited according to the editing function corresponding to the target editing control. The video generation unit is configured to, in response to an editing completion operation triggered for the video to be processed, generate an edited video to be processed based on the first target effect material, and continue playing the edited video to be processed in the video display interface.

[0009] Optionally, the editing interface further includes a time period setting control; then the video editing unit is also used for: In response to a setting operation triggered by the time period setting control, the effect application period for the target editing control is determined, and a corresponding second target effect material is added to the area corresponding to the target area in other video frames within the effect application period. The second target effect material is obtained by editing the images in the area corresponding to the target area in other video frames according to the editing function corresponding to the target editing control. The video generation unit is specifically used for: Based on the first target effect material and each of the second target effect materials, an edited video to be processed is generated.

[0010] Optionally, the video editing unit is further configured to: Before adding the corresponding first target effect material to the target area in the video frame to be edited in response to the second editing operation triggered by the target editing control, a material selection box is displayed in the specified area of ​​the video frame to be edited in response to the selection operation triggered by the target editing control; The video editing unit is specifically used for: In response to a second editing operation on the selected material frame, the target area marked by the adjusted selected material frame in the video frame to be edited is determined, and a corresponding first target effect material is added to the target area.

[0011] Optionally, the video editing unit is further configured to: Add corresponding initial effect material to the specified area. The initial effect material is obtained by processing the image in the specified area of ​​the video frame to be edited based on the target editing control using the corresponding video editing function. The video editing unit is specifically used for: The material selection box is displayed in the target area of ​​the video frame to be edited, and the initial effect material in the material selection box is replaced with the first target effect material.

[0012] Optionally, the editing interface further includes a segment selection area, which is used to display thumbnails of at least one video frame within the associated editing period of the video to be processed, wherein the associated editing period is a time period of a certain duration including the trigger time of the first editing operation. The video frame to be edited is determined in the following way: The video frame corresponding to the trigger time of the first editing operation is used as the video frame to be edited; or In response to a triggering operation that selects a thumbnail of a first target video frame from the segment selection area, the first target video frame is used as the video frame to be edited.

[0013] Optionally, the video editing unit is further configured to: In response to a triggering operation that selects at least one thumbnail of a second target video frame from the segment selection area, a corresponding third target effect material is added to the area corresponding to the target area in the at least one second target video frame. The third target effect material is obtained by editing the image in the area corresponding to the target area in the corresponding second target video frame according to the editing function corresponding to the target editing control. The video generation unit is specifically used for: Based on the first target effect material and each of the third target effect materials, an edited video to be processed is generated.

[0014] Optionally, the editing interface may also include: an effect undo control; The video editing unit is further configured to, in response to a triggering operation of the effect undo control, cancel at least one second editing operation prior to the triggering operation before the video generation unit responds to an editing completion operation triggered for the video to be processed.

[0015] Optionally, the editing interface further includes an effect preview control; then the video editing unit is also used for: In response to a trigger operation on the effect preview control, starting from the video frame to be edited, the video editing effect corresponding to at least one video frame is previewed in the editing interface.

[0016] Optionally, the video display interface further includes an effect masking control; then the device further includes: The browsing control unit is used to, in response to the triggering operation of the effect masking control, remove the video editing effects on the video to be processed in the video display interface and continue playing the original video to be processed while the edited video to be processed continues to play in the video display interface.

[0017] The second video content generation apparatus provided in this application embodiment includes: The first receiving unit is configured to receive a first editing instruction sent by the client for the video to be processed. The first editing instruction is generated by the client in response to a second editing operation triggered by a target editing control in the editing interface. The editing interface is displayed by the client in response to the first editing operation triggered by the client for the video to be processed, including at least one editing control and displaying the video to be processed, and each editing control corresponds to an editing function. The first feedback unit is used to determine the editing function corresponding to the target editing control based on the first editing instruction, and to perform editing processing on the screen in the target area of ​​the video screen to be edited, to generate the first target effect material, and to feed it back to the client, so that the client can add the first target effect material to the target area of ​​the video screen to be edited; A storage unit is used to associate and store the first target effect material with the video to be processed.

[0018] Optionally, the editing interface may also include a time period setting control; The first feedback unit is also used for: For the frames in other video frames within the same area as the target area during the effect application period, the corresponding effects of the editing function are edited to generate corresponding second target effect materials, which are then fed back to the client so that the client can add corresponding second target effect materials to the areas in other video frames corresponding to the target area. The effect application period is defined as the period during which the client determines the effect application for the target editing control after responding to a setting operation triggered by the setting control for the specified period.

[0019] Optionally, the storage unit is further used for: Each second target effect material and the time period for which the effect is applied are associated and stored with the first target effect material.

[0020] Optionally, the editing interface may also include a segment selection area; The device further includes: The second receiving unit is configured to receive a second editing instruction for the video to be processed sent by the client before the first receiving unit receives the first editing instruction for the video to be processed sent by the client, wherein the second editing instruction is generated by the client in response to the first editing operation; The second feedback unit is used to determine, based on the second editing instruction, a thumbnail of at least one video frame within the associated editing period of the video to be processed, and to feed it back to the client so that the client can display it in the segment selection area; the associated editing period is a time period of a certain duration including the trigger time of the first editing operation.

[0021] Optionally, the device further includes: The first synchronization unit is used to upload the first target effect material for the video to be processed to the content platform server for synchronous storage.

[0022] Optionally, the device further includes: The second synchronization unit is used to upload the various second target effect materials for the video to be processed and the application time period of the effect to the content platform server for synchronous storage.

[0023] An electronic device provided in this application includes a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the steps of any of the above-described video content generation methods.

[0024] This application provides a computer-readable storage medium including a computer program. When the computer program is run on an electronic device, the computer program is used to cause the electronic device to perform the steps of any of the above-described video content generation methods.

[0025] This application provides a computer program product, which includes a computer program stored in a computer-readable storage medium. When the processor of an electronic device reads the computer program from the computer-readable storage medium, the processor executes the computer program, causing the electronic device to perform the steps of any of the above-described video content generation methods.

[0026] The beneficial effects of this application are as follows: This application provides a video content generation method, apparatus, electronic device, and storage medium. In this embodiment, while watching video content, the user processes the content in the target area of ​​the video frame according to the editing function of the target editing control, obtaining a first target effect material corresponding to that target area. This first target effect material is then added to the target area, enabling secondary creation of the video content. This method does not require separate modification of the application; the original video content can be extracted as material for rapid secondary creation while the user is watching the video. This ensures the overall consistency of the video content's tone, enhances the interactivity and atmosphere of the video content, and helps improve user activity and retention rates, thereby increasing human-computer interaction efficiency.

[0027] Other features and advantages of this application will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the application. The objectives and other advantages of this application may be realized and obtained by means of the structures particularly pointed out in the written description, claims, and drawings. Attached Figure Description

[0028] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments of this application and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings: Figure 1 This is an optional schematic diagram of an application scenario in an embodiment of this application; Figure 2 This is a flowchart illustrating a method for generating video content based on the original video stream as material, as described in an embodiment of this application. Figure 3 This is a schematic diagram of a video display interface in an embodiment of this application; Figure 4 This is a schematic diagram illustrating the switching process between a video display interface and an editing interface in an embodiment of this application. Figure 5A This is a schematic diagram of the first type of effect patch in the embodiments of this application; Figure 5B This is a schematic diagram of the second type of effect patch in the embodiments of this application; Figure 5C This is a schematic diagram of the third effect patch in the embodiments of this application; Figure 5D This is a schematic diagram of the fourth effect patch in the embodiments of this application; Figure 6 This is a schematic diagram of yet another video display interface in an embodiment of this application; Figure 7 This is a schematic diagram of an effect masking control in an embodiment of this application; Figure 8A This is a schematic diagram illustrating the first type of video editing process jump in the embodiments of this application; Figure 8B This is a schematic diagram illustrating the second type of video editing process jump in the embodiments of this application; Figure 8C This is a schematic diagram illustrating the third video editing process jump in the embodiments of this application; Figure 8D This is a schematic diagram illustrating the fourth video editing process jump in the embodiments of this application; Figure 8E This is a schematic diagram illustrating the fifth type of video editing process jump in the embodiments of this application; Figure 9A This is a schematic diagram of a time period setting control in an embodiment of this application; Figure 9B This is a schematic diagram of a method for setting an effect application screen in an embodiment of this application; Figure 10 This is a schematic diagram of a corresponding region in an embodiment of this application; Figure 11A This is a schematic diagram of an effect cancellation process in an embodiment of this application; Figure 11B This is a schematic diagram of an effect preview process in an embodiment of this application; Figure 12 This is a flowchart illustrating another video content generation method in an embodiment of this application; Figure 13 This illustrates a hierarchical relationship between the original video and the generated effect in one embodiment of this application. Figure 14 This is a schematic diagram of the interactive implementation process of a rapid secondary creation method for extracting original video stream content as material in an embodiment of this application; Figure 15 This is a schematic diagram of the composition structure of the first video content generation device in the embodiments of this application; Figure 16 This is a schematic diagram of the composition structure of the second type of video content generation device in the embodiments of this application; Figure 17 This is a schematic diagram of the hardware structure of an electronic device using an embodiment of this application; Figure 18 This is a schematic diagram of the hardware structure of another electronic device using an embodiment of this application. Detailed Implementation

[0029] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of this application will be clearly and completely described below with reference to the accompanying drawings of the embodiments of this application. Obviously, the described embodiments are only some embodiments of the technical solutions of this application, and not all embodiments. Based on the embodiments recorded in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the technical solutions of this application.

[0030] The following describes some of the concepts involved in the embodiments of this application.

[0031] Video display interface: This is an interactive interface for users to play and browse video content. In this embodiment, users can browse short video streams through the video display interface and interact with the video to be processed during the browsing process, which will redirect to the editing interface, allowing users to edit the currently viewed video.

[0032] Editing Interface: This is a user-facing, interactive interface for secondary creation of video content. In this embodiment, the editing interface displays at least one editing control and a corresponding video frame to be edited. Users can select different editing controls to perform different editing effects on the video frame.

[0033] Effect materials: These are materials obtained by editing the original content of the video to be processed using the editing functions corresponding to the editing controls, applying appropriate effects. This application embodiment involves target effect materials and initial effect materials. Target effect materials refer to those obtained by adjusting the video frame of a target area selected by the user, while initial effect materials refer to those obtained by adjusting the video frame of a system-default specified area. Further, the target effect materials in this application embodiment can be further divided into: first target effect materials, second target effect materials, and third target effect materials.

[0034] A client, also known as a user terminal, refers to a program that provides local services to a client, corresponding to a server. Except for some applications that run only locally, they are generally installed on ordinary client machines and need to work in conjunction with the server. With the development of the Internet, commonly used clients include web browsers used for the World Wide Web, email clients for sending and receiving emails, and instant messaging client software. For these types of applications, corresponding servers and service programs on the network are required to provide the corresponding services, such as database services, email services, etc. Therefore, a specific communication connection needs to be established between the client and the server to ensure the normal operation of the application.

[0035] The design concept of the embodiments of this application is briefly introduced below: With the rapid development of computer technology and mobile communication technology, various video platforms based on electronic devices have been widely used, and more and more people are watching videos through these platforms, greatly enriching their daily lives.

[0036] In related technologies, there are two common methods for video creation: Method 1: During video shooting, recommended materials are generated based on the target video information previewed by the user, and video creation materials are recommended to the user who is shooting, so as to make secondary creations on the current video.

[0037] Method 2: Capture and display video images on the terminal based on image processing instructions, and then perform secondary creation on the captured video images.

[0038] Both of these methods involve overlaying the original video content with system-preset materials or external materials. Since these materials differ from the original video content, the adjusted video content may not be smooth.

[0039] In view of this, this application proposes a video content generation method, apparatus, electronic device, and storage medium. The video content generation method in this application can be applied during a user's viewing process. Specifically, while watching video content, the user, for the video content to be processed, performs processing on the content in the target area of ​​the video screen corresponding to the editing function of the target editing control to obtain the first target effect material corresponding to the target area, and adds the first target effect material to the target area, realizing the secondary creation of the video content. This method extracts the original video content as material for rapid secondary creation, ensuring the overall tone consistency of the video content, enhancing the interactivity and atmosphere of the video content, and helping to improve user activity and retention rate, thereby improving human-computer interaction efficiency.

[0040] Furthermore, the embodiments of this application can be applied to short video streaming scenarios. This method helps improve the interactive experience of users while watching short videos, especially in highly interactive short videos. It can effectively meet users' needs for superimposed interaction and enhanced viewing experience, thereby improving the efficiency of human-computer interaction.

[0041] The preferred embodiments of this application are described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are for illustration and explanation only and are not intended to limit this application. Furthermore, the embodiments and features in the embodiments of this application can be combined with each other without conflict.

[0042] like Figure 1 The diagram shown is an application scenario illustration of an embodiment of this application. The application scenario diagram includes two terminal devices 110 and one server 120.

[0043] In this embodiment, the terminal device 110 includes, but is not limited to, mobile phones, tablets, laptops, desktop computers, e-book readers, smart voice interaction devices, smart home appliances, and in-vehicle terminals. The terminal device may have a video editing-related client installed. This client can be software (such as a browser, short video software, etc.), or a webpage, mini-program, etc. The server 120 is the backend server corresponding to the software, webpage, mini-program, etc., or a server specifically used for video editing; this application does not impose specific limitations. The server 120 can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms.

[0044] It should be noted that the video content generation method in this embodiment can be executed by an electronic device, which can be a server 120 or a terminal device 110. That is, the method can be executed by the server 120 or the terminal device 110 alone, or by both the server 120 and the terminal device 110. The terminal device 110 is mainly used to execute video content generation methods related to user-triggered front-end operations, while the server 120 is mainly used to execute video content generation methods related to background operations corresponding to the front-end operations.

[0045] Taking terminal device 110 as an example, on the terminal device side, a user logs into a short video software through terminal device 110, browses short videos on the video display interface of the short video software, and during the browsing process, wishes to perform secondary creation on the currently viewed video. In this case, the video can be treated as a video to be processed, and a first editing operation is triggered on the video. Then, in response to the first editing operation, terminal device 110 (short video software) jumps to an editing interface containing multiple editing controls and displays the video screen to be edited in the editing interface. Further, the user can edit the target area in the video screen to be edited based on the target editing control. In response to the second editing operation triggered by the user based on the target editing control, terminal device 110 adds corresponding target effect materials to the target area in the video screen to be edited. After the user finishes editing, terminal device 110, in response to the editing completion operation triggered by the user, generates the edited video to be processed and continues to play the edited video to be processed on the video display interface.

[0046] In one alternative implementation, the terminal device 110 and the server 120 can communicate via a communication network.

[0047] In one alternative implementation, the communication network is a wired network or a wireless network.

[0048] It should be noted that, Figure 1 The examples shown are merely illustrative; in reality, the number of terminal devices and servers is unlimited and is not specifically limited in the embodiments of this application.

[0049] In this embodiment of the application, when there are multiple servers, the multiple servers can form a blockchain, and the servers are nodes on the blockchain; as disclosed in the video content generation method of this application, the effect material data (including the first target effect material and the second target effect material), effect application time period data, etc., involved can all be stored on the blockchain.

[0050] Furthermore, the embodiments of this application can be applied to various scenarios, including but not limited to cloud technology, artificial intelligence, smart transportation, and assisted driving.

[0051] The video content generation method provided by the exemplary embodiments of this application will be described below with reference to the accompanying drawings and the application scenarios described above. It should be noted that the application scenarios described above are only shown to facilitate understanding of the spirit and principles of this application, and the embodiments of this application are not limited in any way in this respect.

[0052] See Figure 2 The diagram shown is an implementation flowchart of a video content generation method provided in this application. Taking the client as the executing entity as an example, the specific implementation flow of this method is as follows: S21: In response to the first editing operation triggered by the video to be processed playing in the video display interface, the client displays an editing interface including at least one editing control, and displays the video to be edited in the editing interface, with each editing control corresponding to an editing function; The video display interface can be a short video app or other video software interface that can play video streams, allowing users to stream and play the video to be processed. Alternatively, the video display interface can also be other web pages, pop-ups, etc., that can play the video to be processed; this article does not specify any particular limitation.

[0053] In this embodiment of the application, users can create secondary content based on the currently viewed video while streaming. For example... Figure 3 As shown, it is a schematic diagram of a video display interface in an embodiment of this application. In the current video display interface, users can switch short videos by swiping up and down, or by specifying gestures.

[0054] Additionally, users can click the "Add Adhesive" control to trigger the first editing operation on the currently playing short video. The client responds to this first editing operation by displaying the editing interface. For example... Figure 4 As shown, after the user clicks the "Add Patch" control in interface 4a, they will be redirected to interface 4b, which is an editing interface listed in one of the embodiments of this application.

[0055] In the editing interface shown in interface 4b, section S41 displays the video footage to be edited, and section S42 displays four editing controls (also called patches). The editing functions corresponding to these four controls are: zoom in, zoom out, mosaic, and funhouse mirror. The funhouse mirror can be used to create irregular changes; for example, when adding a funhouse mirror effect to the same area of ​​the image, it can zoom in on part of the image and zoom out on another part.

[0056] Optionally, the editing interface may also include a segment selection area, which displays thumbnails of at least one video frame within the associated editing period of the video to be processed. The associated editing period is a time segment of a certain duration that includes the trigger time of the first editing operation.

[0057] In this embodiment, a duration of 20 seconds is used as an example for illustration. When the user clicks "Add Patch," the system automatically captures 20 seconds of video content before and after the current keyframe and enters editing mode, generating preset effect materials from the currently captured video content. Here, the current keyframe refers to the video frame corresponding to the trigger moment of the first editing operation.

[0058] It should be noted that this "certain duration" can be set according to the actual situation, and is generally a maximum of 20 seconds.

[0059] As shown in section S43 of interface 4b, the white line is used to mark the thumbnail of the video frame to be edited. Specifically, the thumbnail of the video frame to be edited is the frame marked by the shaded part in S43. The thumbnail of the video frame marked by the white line can be switched by swiping left and right, etc., and the video frame to be edited can be switched accordingly.

[0060] Based on the above embodiments, the video frame to be edited in this application embodiment is determined in the following two ways: Method 1: Use the video frame corresponding to the trigger moment of the first editing operation as the video frame to be edited; Method 2: In response to the triggering operation of selecting the thumbnail of the first target video frame from the segment selection area, the first target video frame is used as the video frame to be edited.

[0061] For example, by swiping right, a user can move the thumbnail of the video frame corresponding to 00:12 to the position of the white line in the image, and then select the thumbnail of the first target video frame corresponding to 00:12 to switch the video frame to be edited to the first target video frame.

[0062] In the above embodiments, the video frame corresponding to the trigger moment of the first editing operation can be directly used as the video frame to be edited. Alternatively, the user can flexibly set the video frame to be edited to reduce the situation where the video frame corresponding to the trigger moment of the first editing operation is not the frame that the user wants to edit due to slow hand, lag, or other reasons, and the user needs to go back to the previous step and re-trigger it. This allows the user to quickly determine the video frame to be edited and improves video editing efficiency.

[0063] S22: The client responds to the second editing operation triggered by the target editing control and adds the corresponding first target effect material to the target area in the video frame to be edited; The first target effect material is obtained by editing the image within the target area of ​​the video frame to be edited according to the editing function corresponding to the target editing control. In this embodiment, the user can add corresponding first target effect material, also known as effect patch, to the target area in the video frame to be edited based on the target editing control. Figure 4 The various editing controls listed allow users to change multiple original video effect patches in edit mode, which means editing the target area in the original video frame to obtain the corresponding effect patch.

[0064] Optional, user selects Figure 4 When a certain editing control is used as shown in section S42, a material selection box will first be displayed in the specified area of ​​the video frame to be edited in section S41, and corresponding initial effect material will be added to the material selection box. Specifically, the initial effect material is obtained by editing the video frame in the specified area based on the target editing control to perform corresponding video editing effects.

[0065] In this embodiment, the designated area can be: a central area of ​​a certain size in the video frame to be edited, or other areas in the video frame to be edited; this is not specifically limited here. The following... Figure 4 Examples of effect tiles corresponding to several different editing controls in the software are provided.

[0066] like Figures 5A to 5D As shown, these are several different types of effect patches listed in the embodiments of this application. Among them, Figure 5A This is an illustration showing the effect of adding a magnifying tile to the material selection box when the user selects the target editing control as "zoom in". The magnifying tile refers to the zoom level... Figure 5A Image showing the enlarged view of the hand of the person on the left side of the middle section; Figure 5B This is an illustration showing the effect of adding a zoom-out patch to the material selection box when the user selects the target editing control as "zoom out". The zoom-out patch refers to the zoom-out... Figure 5B Image showing the effect of a smaller-sized head for the character on the left side of the middle section; Figure 5C This image shows an illustration of adding a mosaic tile to the material selection box when the user selects "Mosaic" as the target editing control. The mosaic tile refers to... Figure 5C The image showing the effect of pixelating the head of the character on the left side of the middle section; Figure 5D This image shows the effect of adding a funhouse mirror patch to the material selection box when the user selects the target editing control as "funhouse mirror". The enlarged patch refers to... Figure 5D The image shows the effect of a funhouse mirror effect on the head of the person on the left side of the image.

[0067] It should be noted that the above Figures 5A to 5DThis application merely illustrates the editing effects of several different editing controls listed in the embodiments. Specifically, users can also adjust the position and size of the material selection box to edit other areas of the video frame. Furthermore, the editing controls listed above are only examples. In fact, editing controls for other editing functions are also applicable to the embodiments of this application, and are not specifically limited here.

[0068] S23: In response to the editing completion operation triggered for the video to be processed, the client generates the edited video to be processed based on the first target effect material, and continues to play the edited video to be processed in the video display interface.

[0069] In this embodiment of the application, after the user finishes editing, the editing completion operation for the video to be processed is triggered, and the user is redirected to the video display interface, where the edited video to be processed continues to play.

[0070] like Figure 6 As shown, this is a schematic diagram of another video display interface in an embodiment of this application. Wherein, Figure 6 The video currently being played is the edited version of the video awaiting processing. Once the user confirms the edit, they can directly return to the streaming scene and play the short video they created online. Compared to the video before editing, the head of the person on the left side of the current video screen has been enlarged with a patch.

[0071] In the above implementation, while watching video content, the user can process the content in the target area of ​​the video screen to be edited using the editing function of the target editing control to obtain the first target effect material corresponding to the target area. This first target effect material is then added to the target area to achieve secondary creation of the video content. This method extracts the original video content as material for rapid secondary creation, ensuring the overall tone of the video content is consistent, enhancing the interactivity and atmosphere of the video content, which is conducive to improving user activity and retention rate, and improving human-computer interaction efficiency.

[0072] In this embodiment, considering that the method can be directly applied to streaming scenarios, allowing for secondary creation of the currently viewed video content, users can return to the streaming page to continue watching after editing. If the user or other users do not wish to see the edited video but prefer to see the original video, they can also use a blocking function to block the editing effect.

[0073] An optional implementation is that the video display interface in this embodiment further includes an effect masking control, such as... Figure 7 The "Shielding Patch" control shown. Figure 7The video display interface shown is where the user is... Figure 6 The interface shown is displayed after clicking on the current video frame. Users can trigger editing controls such as "Speed ​​Up," "Add Adhesive," and "Disable Adhesive" by clicking (or using gestures, voice commands, etc.). The edited video continues to play in this video display interface. If the user clicks the "Disable Adhesive" control during playback, the client responds to the trigger action of the disabling control, removing the video editing effects from the video and resuming playback of the original video.

[0074] In the above implementation, users can choose whether to block the patch and watch the original video content before editing or the edited video content, which improves the flexibility of human-computer interaction and provides users with more choices.

[0075] The following is combined Figures 8A to 8E This provides a brief overview of the video editing process during the streaming process.

[0076] like Figure 8A As shown, by clicking "Add Sticker", the user can trigger the first editing operation on the currently playing video (the video to be processed). In response to this operation, the client jumps from the video display interface to the editing interface, and displays the video frame (the video frame to be edited) corresponding to the trigger time of the first editing operation. The editing interface also displays four editing controls, and the user can add effect stickers to the original video by selecting the editing controls.

[0077] Specifically, before step S22, the user first needs to select the target editing control. In response to the selection operation triggered by the target editing control, the client displays a material selection box in the specified area of ​​the video screen to be edited. In addition, corresponding initial effect materials can be added to the specified area. The initial effect materials are obtained by processing the screen in the specified area of ​​the video screen to be edited based on the target editing control and performing corresponding video editing functions.

[0078] like Figure 8B As shown, when the user clicks the "Zoom In" control, a selection operation is triggered on the target editing control ("Zoom In" control), and the client displays... Figure 8B The interface shown on the right shows the "Zoom In" control in bold, indicating that it is selected. The selection box for the material is displayed in the center area of ​​the current video frame to be edited (i.e., the specified area), and the initial effect material, namely the zoomed-in patch of the person's hand, is displayed in the selection box.

[0079] In this embodiment, after selecting the corresponding editing effect, the user can also adjust the effect area. Optionally, the user can adjust the effect area based on the material selection box. Then, in response to the second editing operation on the material selection box, the client determines the target area marked by the adjusted material selection box in the video frame to be edited, and adds the corresponding first target effect material to the target area.

[0080] The second editing operations for the material selection box include, but are not limited to, the following: Editing operations for selection box position, selection box size, and selection box shape.

[0081] Specifically, the selection box position can be adjusted by dragging or other means; the size of the selection box can be changed by dragging or other means; and the shape of the selection box can be changed by dragging or other means.

[0082] like Figure 8C As shown, when the user adjusts the position of the material selection box from the person's hand to the person's head and increases the size of the material selection box, the client can determine the adjusted effect area as the target area. The material selection box is displayed in the target area of ​​the video to be edited, and the initial effect material in the original material selection box is also replaced with the first target effect material as the user operates. As shown in 8C, as the position and size of the material selection box are updated, the hand patch is also updated to the head patch.

[0083] In this embodiment, after selecting the target editing control, the user can further adjust the size and position of the material selection box to determine the target area and display the corresponding first target effect material in the target area. Furthermore, the user can click the "×" in the upper left corner of the material selection box to delete it. Further, the user can select a new target editing control for editing; no specific limitations are made here.

[0084] In addition, users can preview the effect of adding the patch to the current video frame by clicking on the blank area outside the video frame to be edited, such as... Figure 8D As shown, after the user clicks on a blank area at the bottom of the video screen to be edited, the editing interface appears as follows. Figure 8D The image on the right shows a preview of the effect after removing the material selection box.

[0085] like Figure 8E As shown, when the user clicks "√", the editing operation is completed, and the edited video continues to play in the video display interface.

[0086] In the above implementation, using extracted original video content as material for rapid secondary creation ensures the overall consistency of the short video's tone, enhances its interactivity and atmosphere, and provides the possibility of improving user activity and retention. The original video content, once extracted, can be directly used as material to accelerate the efficiency of secondary creation, further reduce the threshold required for user interaction, and quickly drive the actual conversion and consumption of secondary creations, which is in line with the product's ultimate goal.

[0087] Optionally, users can further expand the application of effects during video editing, specifically in the following two ways: Method 1: Set the application duration of the effect based on the time period setting control.

[0088] Optionally, the editing interface in this embodiment also includes a time period setting control.

[0089] like Figure 9A As shown, it is a schematic diagram of a time period setting control in an embodiment of this application. In this editing interface, S91 is the time period setting control, and the effect application time period corresponding to the target editing control selected by the user can be adjusted based on this control.

[0090] In this embodiment of the application, taking the initial duration of the default time period setting control as 3 seconds as an example, the middle moment of these 3 seconds is aligned with the white line, that is, the duration from the left to the right of the white line is 1.5 seconds, which constitutes the effect application period corresponding to the target operation control.

[0091] For example, when a user clicks the "zoom in" tile, the tile's default length is 3 seconds, and its center point is positioned at the current frame. The user can then adjust the duration of the control by dragging or other methods. Figure 9A The user adjusted the duration of the effect applied to the target editing control from 3 seconds to 3.9 seconds, and also adjusted the start and end times of the effect application. Based on this, the application period of the effect corresponding to the target editing control can be determined.

[0092] In this method, the client responds to the setting operation triggered by the user for the time period setting control, determines the time period for the effect to be applied to the target editing control, and adds the corresponding second target effect material to the area corresponding to the target area in other video frames except the video frame to be edited during the effect application time period. The second target effect material is obtained by editing the frame in the area corresponding to the target area in the corresponding other video frames according to the editing function corresponding to the target editing control. Based on this, the edited video to be processed can be generated from the first target effect material and each of the second target effect materials.

[0093] It should be noted that if the user does not trigger the setting operation for the time period setting control, the default duration of the effect application period corresponding to the target editing control is 3 seconds, starting 1.5 seconds before the video frame to be edited and ending 1.5 seconds after the video frame to be edited.

[0094] Method 2: Set the effect application screen.

[0095] Specifically, users can also select multiple video frames by selecting a segment area, set the screen where the current effect is applied, and add the corresponding third target effect material to the area in the video frame selected by the user that corresponds to the target area.

[0096] like Figure 9B As shown, the video frames selected by the user are represented by shadows. The other video frames, excluding the first target video frame, are designated as the second target video frames. In response to a trigger operation that selects at least one thumbnail of a second target video frame from the segment selection area, the client adds corresponding third target effect material to the area corresponding to the target area within each second target video frame. This third target effect material is obtained by editing the image within the corresponding area of ​​the second target video frame according to the editing functions of the target editing control.

[0097] Based on this, the edited video to be processed can be generated from the first target effect material and each third target effect material.

[0098] The following is combined Figure 10 The corresponding regions listed in the embodiments of this application will be described.

[0099] like Figure 10 As shown, the target area in video frame 1 and the corresponding area in video frame 2 are the same in size and position relative to the video frame.

[0100] In this embodiment, after selecting the corresponding effect, the user can not only adjust the effect area, but also modify the effect's application duration or the application screen. Considering that in some scenarios, the position of an object in several consecutive frames may not change or may change very little, based on the setting of the effect's application duration or application screen, it can be ensured that the same effect patch is added to the same part of the same object in several consecutive frames (non-consecutive frames are also possible, set by the user), thus ensuring video smoothness and overall tone.

[0101] It should be noted that the two extension methods listed above are merely illustrative examples. Any extension method that applies to the embodiments of this application is applicable and is not specifically limited here.

[0102] In addition, in this embodiment of the application, the user can also preview the video being modified in real time and perform undo / rewind operations.

[0103] An alternative implementation includes an effect undo control in the editing interface. For example... Figure 11A As shown, this is a schematic diagram of an effect cancellation control listed in an embodiment of this application, where S111 is the effect cancellation control. Before step S23, the user can also click the effect cancellation control, and the client responds to the trigger operation on the effect cancellation control, canceling at least one second editing operation before the trigger operation.

[0104] like Figure 11A As shown, after the user clicks the effect cancellation control, the previous second editing operation is canceled, and the user returns from interface 11a to interface 11b.

[0105] Another alternative implementation includes an effect preview control in the editing interface. For example... Figure 11B As shown, this is a schematic diagram of an effect preview control listed in an embodiment of this application, where S112 is the effect preview control. Before step S23, the user can also click the effect preview control. In response to the trigger operation on the effect preview control, the client previews the video editing effect corresponding to at least one video frame in the editing interface, starting from the video frame to be edited. For example... Figure 11B After the user clicks S112, the interface will be updated from interface 11c to interface 11d. In the editing interface, the video to be edited will start playing. When effect patches are added to the video to be edited and several subsequent frames, the effect can be previewed.

[0106] In the above implementation, users can undo and rewind operations using the effect undo control, and can also preview the video being modified in real time using the effect preview control, so as to view the editing effect in a timely manner and make timely modifications if they are not satisfied with the editing effect, thus ensuring the video editing effect and editing efficiency.

[0107] The above mainly describes the video content generation method in this application embodiment from the client's perspective. Below, we will briefly introduce another video content generation method in this application embodiment from the perspective of the server corresponding to the client: See Figure 12 The diagram shown is an implementation flowchart of a video content generation method provided in this application embodiment. The execution subject of this method is a server, and the specific implementation process is as follows: S121: The server receives the first editing instruction for the video to be processed from the client; Here, "server" refers to the server corresponding to the clients listed above. For example, if the client is a short video app, then the server is the server of that short video app; if the client is a browser, then the server is the server of that browser. The first editing instruction is generated by the client in response to a second editing operation triggered on a target editing control in the editing interface. The editing interface is displayed by the client after responding to the first editing operation triggered on the video to be processed, including at least one editing control and displaying the video to be processed. Each editing control corresponds to one editing function.

[0108] S122: The server determines the editing function corresponding to the target editing control based on the first editing instruction, and performs editing processing on the image in the target area of ​​the video frame to be edited, generating the first target effect material, and feeding it back to the client so that the client can add the first target effect material to the target area of ​​the video frame to be edited; S123: The server associates and stores the first target effect material with the video to be processed.

[0109] Specifically, such as Figures 8A to 8E As shown in the attached diagrams, these figures provide a simple illustration of the video editing process during the streaming process. Among them, Figure 8B , Figure 8C The process refers to the user selecting the "zoom in" control and setting the effect area. During this process, the client can send the first editing instruction to the server. The server can determine the target editing control selected by the user, the corresponding editing function, and the target area based on the instruction, and then perform the corresponding editing effect processing.

[0110] Optionally, the editing interface also includes a time period setting control, similar to... Figure 9A In the examples provided, users can also set the application period of the effect. Furthermore, the server can also perform corresponding editing functions on the images in other video frames within the application period that correspond to the target area, generate corresponding second target effect materials, and feed them back to the client so that the client can add corresponding second target effect materials to the areas in other video frames that correspond to the target area.

[0111] The effect application period is the period during which the effect is applied to the target editing control, as determined by the client after responding to the setting operation triggered by the time period setting control. For details, please refer to the above embodiments. Repeated parts will not be repeated.

[0112] Optionally, the server can also associate and store each secondary target effect material and the effect application period with the primary target effect material in a cache, recording the user's edits to the video to be processed.

[0113] Optionally, the editing interface also includes a segment selection area; before step S121, a second editing instruction for the video to be processed is received from the client. The second editing instruction is generated by the client in response to the first editing operation, for example... Figure 8A As shown, the process involves a user triggering the client to perform a first editing operation. The client can then send a second editing instruction to the server. Based on the second editing instruction, the server determines thumbnails of at least one video frame within the associated editing time period of the video to be processed and sends them back to the client so that the client can display them in the segment selection area. The associated editing time period is a certain duration encompassing the trigger time of the first editing operation. The client-side display effect is as follows: Figure 4 As shown in section S43, the repeated parts will not be repeated.

[0114] Specifically, the server can directly send a thumbnail of at least one video frame to the client, or it can only send the identifiers of these video frames to the client, allowing the client to identify the corresponding video frame in the previously acquired video stream based on the identifiers and display the corresponding thumbnail.

[0115] Optionally, the server can also upload the first target effect material for the video to be processed, the various second target effect materials for the video to be processed, and the time periods for effect application to the content platform server for synchronous storage.

[0116] In addition, for the third target effect materials, the server can also generate feedback to the client and upload them to the content platform server for synchronous storage, which will not be repeated here.

[0117] like Figure 13 As shown, this illustrates the hierarchical relationship between the original video and the generated effect in one embodiment of this application.

[0118] In this embodiment, the original video layer is located above the generated effect layer. After the user selects the corresponding position, the corresponding position selected by the user needs to be cut off in the original video layer to make the selected area in the original video layer transparent, so that the generated effect layer below the corresponding position can be revealed. This allows the system to reveal the effect material of the selected area based on the original video content effect.

[0119] The following is combined Figure 14 This document provides a brief overview of the front-end and back-end interaction logic in the embodiments of this application. (See also...) Figure 14 The diagram shown illustrates the interactive implementation process of a rapid secondary creation method for extracting original video stream content as material, as described in an embodiment of this application. The specific implementation process of this method is as follows: Specifically, this process involves three levels: the user side, the short video app's front-end display, and the back-end. To improve user experience, the user side only perceives the WYSIWYG (What You See Is What You Get) modification effect, remaining unaware of the original video effect processing and other back-end processes.

[0120] User side: 1. Click "Add Adhesive" to enter editing mode; 2. Select the corresponding original video effect adhesive and adjust the range; slide to the time period to be added and adjust the duration; 3. Click the "Complete" command to return to the streaming page and watch the short video you created.

[0121] Short video app front-end: 1. Streaming page; 2. Editing page appears; preview and display of overlay effects; 3. Return to streaming page.

[0122] Backend (Short Video Backend Server): 1. Collects the specified duration before and after the current frame of the execution command and loads it for editing; 2. Processes the original video effect overlay on the video within this time period in real time and records it into the cache; 3. The processed effect video is located below the original video; 4. The selected original video position is completely transparent, displaying the effect video below; 5. The effects of the corresponding time and area are uploaded to the content platform server and superimposed on the segment position.

[0123] The above method satisfies users' desire for rapid interaction and enables real-time extraction and re-creation of original segments based on video viewing. This capability allows users to quickly create secondary works based on images from the original video area. Users can add effect patches based on the original video content anytime, anywhere, starting from the video scene. This application provides effect supplementation for the rapid secondary creation of short video content, greatly enhancing the interactive experience.

[0124] The following is a brief introduction to the video content generation device, electronic device, storage medium, and program product in the embodiments of this application: Based on the same inventive concept, embodiments of this application also provide a video content generation apparatus. For example... Figure 15 As shown, this is a structural schematic diagram of the first type of video content generation device 1500, which may include: The editing trigger unit 1501 is used to respond to a first editing operation triggered by a video to be processed played in the video display interface, display an editing interface including at least one editing control, and display the video to be edited in the editing interface, with each editing control corresponding to an editing function; The video editing unit 1502 is used to respond to a second editing operation triggered based on a target editing control, and add a corresponding first target effect material to the target area of ​​the video frame to be edited. The first target effect material is obtained by editing the image in the target area of ​​the video frame to be edited according to the editing function corresponding to the target editing control. The video generation unit 1503 is used to generate an edited video based on the first target effect material in response to an editing completion operation triggered for the video to be processed, and to continue playing the edited video to be processed in the video display interface.

[0125] Optionally, the editing interface also includes time period setting controls; then the video editing unit 1502 is also used for: In response to the setting operation triggered by the time period setting control, the time period for applying the effect to the target editing control is determined, and corresponding second target effect material is added to the area corresponding to the target area in other video frames within the effect application time period. The second target effect material is obtained by editing the image in the area corresponding to the target area in other video frames according to the editing function corresponding to the target editing control. The video generation unit 1503 is specifically used for: Based on the first target effect material and each of the second target effect materials, generate the edited video to be processed.

[0126] Optionally, the video editing unit 1502 is also used for: Before adding the corresponding first target effect material to the target area in the video frame to be edited in response to the second editing operation triggered by the target editing control, a material selection box is displayed in the specified area of ​​the video frame to be edited in response to the selection operation triggered by the target editing control; Video editing unit 1502 is specifically used for: In response to the second editing operation on the material selection box, the target area marked in the video frame to be edited is determined by the adjusted material selection box, and the corresponding first target effect material is added to the target area.

[0127] Optionally, the video editing unit 1502 is also used for: Add the corresponding initial effect material to the specified area. The initial effect material is obtained by processing the specified area of ​​the video screen to be edited by the target editing control using the corresponding video editing functions. Video editing unit 1502 is specifically used for: Display a selection box for materials in the target area of ​​the video to be edited, and replace the initial effect material in the selection box with the first target effect material.

[0128] Optionally, the editing interface also includes: a segment selection area, which is used to display: a thumbnail of at least one video frame within the associated editing period of the video to be processed, wherein the associated editing period is: a time period of a certain duration including the trigger time of the first editing operation; The video frame to be edited is determined in the following way: Use the video frame corresponding to the trigger moment of the first editing operation as the video frame to be edited; or In response to a triggering operation that selects a thumbnail of the first target video frame from the segment selection area, the first target video frame is used as the video frame to be edited.

[0129] Optionally, the video editing unit 1502 is also used for: In response to a triggering operation that selects at least one thumbnail of a second target video frame from the segment selection area, a corresponding third target effect material is added to the area corresponding to the target area in the at least one second target video frame. The third target effect material is obtained by editing the image in the area corresponding to the target area in the corresponding second target video frame according to the editing function corresponding to the target editing control. The video generation unit 1503 is specifically used for: Based on the first target effect material and each third target effect material, generate the edited video to be processed.

[0130] Optionally, the editing interface may also include: an effect undo control; The video editing unit 1502 is further configured to, in response to a triggering operation of the effect undo control, cancel at least one second editing operation prior to the triggering operation of the video generation unit 1503 in response to an editing completion operation triggered for the video to be processed.

[0131] Optionally, the editing interface also includes an effect preview control; then the video editing unit 1502 is also used for: In response to a trigger operation on the effect preview control, starting from the video frame to be edited, preview the video editing effect corresponding to at least one video frame in the editing interface.

[0132] Optionally, the video display interface may also include an effect masking control; then the device may also include: The browsing control unit 1504 is used to remove the video editing effects on the video to be processed in the video display interface in response to the triggering operation of the effect masking control, and continue playing the original video to be processed.

[0133] Based on the same inventive concept, embodiments of this application also provide a video content generation apparatus. For example... Figure 16 As shown, this is a structural schematic diagram of the first type of video content generation device 1600, which may include: The first receiving unit 1601 is used to receive a first editing instruction for the video to be processed sent by the client. The first editing instruction is generated by the client in response to a second editing operation triggered by a target editing control in the editing interface. The editing interface is displayed by the client after responding to the first editing operation triggered by the client in response to the video to be processed. It includes at least one editing control and displays the video to be processed with the video to be processed. Each editing control corresponds to an editing function. The first feedback unit 1602 is used to determine the editing function corresponding to the target editing control based on the first editing instruction, and to perform editing processing on the screen in the target area of ​​the video screen to be edited, thereby generating the first target effect material and feeding it back to the client so that the client can add the first target effect material to the target area of ​​the video screen to be edited. Storage unit 1603 is used to associate and store the first target effect material with the video to be processed.

[0134] Optionally, the editing interface also includes a time period setting control; The first feedback unit 1602 is also used for: For other video frames within the same target area during the effect application period, the corresponding editing functions are used to edit the corresponding effects, generate corresponding second target effect materials, and feed them back to the client so that the client can add corresponding second target effect materials to the areas in other video frames that correspond to the target area; The effect application period is defined as the period during which the effect is applied to the target editing control, determined after the client responds to the setting operation triggered by the time period setting control.

[0135] Optionally, storage unit 1603 is also used for: Each secondary target effect material and its application period is associated with and stored with the primary target effect material.

[0136] Optionally, the editing interface also includes a segment selection area; The device also includes: The second receiving unit 1604 is configured to receive a second editing instruction sent by the client for the video to be processed before the first receiving unit 1601 receives the first editing instruction sent by the client for the video to be processed. The second editing instruction is generated by the client in response to the first editing operation. The second feedback unit 1605 is used to determine, based on the second editing instruction, a thumbnail of at least one video frame within the associated editing period of the video to be processed, and to feed it back to the client so that the client can display it in the segment selection area; the associated editing period is a time period of a certain duration including the trigger time of the first editing operation.

[0137] Optionally, the device also includes: The first synchronization unit 1606 is used to upload the first target effect material for the video to be processed to the content platform server for synchronous storage.

[0138] Optionally, the device also includes: The second synchronization unit 1607 is used to upload the various second target effect materials and effect application time periods for the video to be processed to the content platform server for synchronous storage.

[0139] In this embodiment, when a user is watching video content, they can process the content in the target area of ​​the video screen to be edited using the editing function of the target editing control to obtain the first target effect material corresponding to the target area. This first target effect material is then added to the target area to achieve secondary creation of the video content. This method extracts the original video content as material for rapid secondary creation, ensuring the overall tone of the video content is consistent, enhancing the interactivity and atmosphere of the video content, which is conducive to improving user activity and retention rate, and improving human-computer interaction efficiency.

[0140] For ease of description, the above sections are divided into modules (or units) according to their functions and described separately. Of course, in implementing this application, the functions of each module (or unit) can be implemented in one or more software or hardware components.

[0141] Having introduced the video content generation method and apparatus according to exemplary embodiments of this application, we will now introduce another exemplary embodiment of the video content generation apparatus according to this application.

[0142] Those skilled in the art will understand that various aspects of this application can be implemented as a system, method, or program product. Therefore, various aspects of this application can be specifically implemented in the following forms: a completely hardware implementation, a completely software implementation (including firmware, microcode, etc.), or a combination of hardware and software implementations, collectively referred to herein as a "circuit," "module," or "system."

[0143] Based on the same inventive concept as the above-described method embodiments, this application also provides an electronic device. In one embodiment, the electronic device may be a server, such as... Figure 1 The server 120 is shown. In this embodiment, the structure of the electronic device can be as follows: Figure 17 As shown, it includes a memory 1701, a communication module 1703, and one or more processors 1702.

[0144] The memory 1701 is used to store computer programs executed by the processor 1702. The memory 1701 may mainly include a program storage area and a data storage area. The program storage area may store the operating system and programs required to run instant messaging functions, etc.; the data storage area may store various instant messaging information and operation instruction sets, etc.

[0145] Memory 1701 may be volatile memory, such as random-access memory (RAM); memory 1701 may also be non-volatile memory, such as read-only memory, flash memory, hard disk drive (HDD), or solid-state drive (SSD); or memory 1701 may be any other medium capable of carrying or storing a desired computer program having the form of instructions or data structures and accessible by a computer, but is not limited thereto. Memory 1701 may be a combination of the above-described memories.

[0146] Processor 1702 may include one or more central processing units (CPUs) or digital processing units, etc. Processor 1702 is used to implement the above-described video content generation method when it calls the computer program stored in memory 1701.

[0147] The communication module 1703 is used to communicate with terminal devices and other servers.

[0148] This application embodiment does not limit the specific connection medium between the memory 1701, communication module 1703, and processor 1702. This application embodiment... Figure 17 The memory 1701 and the processor 1702 are connected via a bus 1704, and the bus 1704 is in Figure 17 The diagram uses thick lines to describe the connections between other components; these are for illustrative purposes only and should not be considered limiting. The 1704 bus can be divided into address bus, data bus, control bus, etc. For ease of description, Figure 17 It is described using only a thick line, but does not indicate that there is only one bus or one type of bus.

[0149] The memory 1701 stores a computer storage medium, which stores computer-executable instructions for implementing the video content generation method of this application embodiment. The processor 1702 is used to execute the above-described video content generation method, such as... Figure 2 As shown.

[0150] In another embodiment, the electronic device may also be other electronic devices, such as... Figure 1 The terminal device 110 is shown. In this embodiment, the electronic device can be structured as follows: Figure 18 As shown, it includes components such as: communication component 1810, memory 1820, display unit 1830, camera 1840, sensor 1850, audio circuit 1860, Bluetooth module 1870, processor 1880, etc.

[0151] The communication component 1810 is used to communicate with the server. In some embodiments, it may include a Wireless Fidelity (WiFi) module, which is a short-range wireless transmission technology, and the electronic device can help the user send and receive information through the WiFi module.

[0152] The memory 1820 can be used to store software programs and data. The processor 1880 executes various functions of the terminal device 110 and performs data processing by running the software programs or data stored in the memory 1820. The memory 1820 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. The memory 1820 stores an operating system that enables the terminal device 110 to run. In this application, the memory 1820 may store the operating system and various applications, and may also store code that executes the video content generation method of the embodiments of this application.

[0153] The display unit 1830 can also be used to display information input by the user or information provided to the user, as well as various menus of the terminal device 110, forming a graphical user interface (GUI). Specifically, the display unit 1830 may include a display screen 1832 disposed on the front of the terminal device 110. The display screen 1832 may be configured as a liquid crystal display, a light-emitting diode, or the like. The display unit 1830 can be used to display video display interfaces, editing interfaces, etc., as described in this application embodiment.

[0154] The display unit 1830 can also be used to receive input digital or character information and generate signal inputs related to user settings and function control of the terminal device 110. Specifically, the display unit 1830 may include a touch screen 1831 disposed on the front of the terminal device 110, which can collect touch operations of the user on or near it, such as clicking buttons, dragging scroll boxes, etc.

[0155] The touchscreen 1831 can be placed on top of the display screen 1832, or the touchscreen 1831 and the display screen 1832 can be integrated to realize the input and output functions of the terminal device 110. After integration, it can be referred to as a touch display screen. In this application, the display unit 1830 can display the application and the corresponding operation steps.

[0156] Camera 1840 can be used to capture still images, which users can then post comments on via the application. There can be one or multiple cameras 1840. An object is projected onto a photosensitive element through a lens, generating an optical image. This photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then transmitted to the processor 1880 to be converted into a digital image signal.

[0157] The terminal device may also include at least one sensor 1850, such as an accelerometer 1851, a proximity sensor 1852, a fingerprint sensor 1853, and a temperature sensor 1854. The terminal device may also be equipped with other sensors such as a gyroscope, barometer, hygrometer, thermometer, infrared sensor, light sensor, and motion sensor.

[0158] Audio circuitry 1860, speaker 1861, and microphone 1862 provide an audio interface between the user and terminal device 110. Audio circuitry 1860 converts received audio data into electrical signals, which are then transmitted to speaker 1861, where they are converted into sound signals for output. Terminal device 110 may also be equipped with volume buttons for adjusting the volume of the sound signal. Conversely, microphone 1862 converts collected sound signals into electrical signals, which are then received by audio circuitry 1860, converted back into audio data, and output to communication component 1810 for transmission to, for example, another terminal device 110, or to memory 1820 for further processing.

[0159] The Bluetooth module 1870 is used to interact with other Bluetooth devices that also have a Bluetooth module via the Bluetooth protocol. For example, a terminal device can establish a Bluetooth connection with a wearable electronic device (such as a smartwatch) that also has a Bluetooth module through the Bluetooth module 1870, thereby exchanging data.

[0160] The processor 1880 is the control center of the terminal device, connecting various parts of the terminal through various interfaces and lines. It executes software programs stored in the memory 1820 and calls data stored in the memory 1820 to perform various functions and process data. In some embodiments, the processor 1880 may include one or more processing units; the processor 1880 may also integrate an application processor and a baseband processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the baseband processor mainly handles wireless communication. It is understood that the baseband processor may not be integrated into the processor 1880. In this application, the processor 1880 can run an operating system, applications, user interface display and touch response, and the video content generation method of this embodiment. Furthermore, the processor 1880 is coupled to the display unit 1830.

[0161] In some possible implementations, various aspects of the video content generation method provided in this application can also be implemented as a program product, which includes a computer program. When the program product is run on an electronic device, the computer program causes the electronic device to perform the steps of the video content generation method according to the various exemplary embodiments of this application described above. For example, the electronic device can perform actions such as... Figure 2 or Figure 12 The steps are shown in the figure.

[0162] The program product may employ any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0163] The program product of the embodiments of this application may employ a portable compact disc read-only memory (CD-ROM) and include a computer program, and may run on a computing device. However, the program product of this application is not limited thereto. In this document, the readable storage medium may be any tangible medium that contains or stores a program that may be used by or in conjunction with a command execution system, apparatus, or device.

[0164] A readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying a readable computer program. This propagated data signal may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A readable signal medium may also be any readable medium other than a readable storage medium, capable of sending, propagating, or transmitting a program for use by or in conjunction with a command execution system, apparatus, or device.

[0165] Computer programs contained on readable media may be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination thereof.

[0166] Computer programs for performing the operations of this application can be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java and C++, and conventional procedural programming languages ​​such as C or similar languages. The computer program can execute entirely on the user's computing device, partially on the user's device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0167] It should be noted that although several units or sub-units of the device have been mentioned in the detailed description above, this division is merely exemplary and not mandatory. In fact, according to embodiments of this application, the features and functions of two or more units described above can be embodied in one unit. Conversely, the features and functions of one unit described above can be further divided and embodied by multiple units.

[0168] Furthermore, although the operations of the method of this application are described in a specific order in the accompanying drawings, this does not require or imply that these operations must be performed in that specific order, or that all the operations shown must be performed to achieve the desired result. Additionally or alternatively, certain steps may be omitted, multiple steps may be combined into one step, and / or one step may be broken down into multiple steps.

[0169] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing a computer-usable computer program.

[0170] Although preferred embodiments of this application have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments as well as all changes and modifications falling within the scope of this application.

[0171] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

1. A method for generating video content, characterized in that, The method includes: In response to a first editing operation triggered by a video to be processed playing in a video display interface, an editing interface including at least one editing control is displayed, and the video to be edited is displayed in the editing interface, with each editing control corresponding to an editing function; In response to a second editing operation triggered by a target editing control, a corresponding first target effect material is added to the target area in the video frame to be edited, and other target effect materials are added to the areas corresponding to the target area in other video frames of the video to be processed; the other video frames are determined by modifying the application duration or application screen of the effect corresponding to the target editing control; the first target effect material is obtained by editing the screen in the target area of ​​the video frame to be edited according to the editing function corresponding to the target editing control; the other target effect materials are obtained by editing the screen in the area corresponding to the target area in the other video frames according to the editing function corresponding to the target editing control. In response to an edit completion operation triggered for the video to be processed, an edited video to be processed is generated based on the first target effect material and the other target effect materials, and the edited video to be processed continues to play in the video display interface.

2. The method as described in claim 1, characterized in that, The other target effect materials are the second target effect materials; the editing interface also includes a time period setting control; then, other target effect materials are added to the area corresponding to the target area in other video frames of the video to be processed, including: In response to a setting operation triggered by the time period setting control, the effect application period for the target editing control is determined; for the video to be processed, in the area corresponding to the target area in other video frames within the effect application period, a corresponding second target effect material is added; the second target effect material is obtained by editing the images in the area corresponding to the target area in other video frames according to the editing function corresponding to the target editing control, and performing corresponding effect editing processing. The process of generating the edited video to be processed based on the first target effect material and the other target effect materials includes: Based on the first target effect material and each of the second target effect materials, an edited video to be processed is generated.

3. The method as described in claim 1, characterized in that, Before adding the corresponding first target effect material to the target area in the video frame to be edited in response to the second editing operation triggered by the target editing control, the method further includes: In response to a selection operation triggered by the target editing control, a material selection box is displayed in a specified area of ​​the video frame to be edited; The response to the second editing operation triggered by the target editing control, adding corresponding first target effect material to the target area of ​​the video frame to be edited, includes: In response to a second editing operation on the selected material frame, the target area marked by the adjusted selected material frame in the video frame to be edited is determined, and a corresponding first target effect material is added to the target area.

4. The method as described in claim 3, characterized in that, The response to the selection operation triggered for the target editing control further includes: Add corresponding initial effect material to the specified area. The initial effect material is obtained by processing the image in the specified area of ​​the video frame to be edited based on the target editing control using the corresponding video editing function. The process of determining the adjusted material selection frame within the target area marked on the video frame to be edited, and adding corresponding first target effect material to the target area, includes: The material selection box is displayed in the target area of ​​the video frame to be edited, and the initial effect material in the material selection box is replaced with the first target effect material.

5. The method as described in claim 1, characterized in that, The editing interface further includes: a segment selection area; the segment selection area is used to display: a thumbnail of at least one video frame within the associated editing period of the video to be processed; the associated editing period is: a time period of a certain duration including the trigger time of the first editing operation; The video frame to be edited is determined in the following way: The video frame corresponding to the trigger time of the first editing operation is used as the video frame to be edited; or In response to a triggering operation that selects a thumbnail of a first target video frame from the segment selection area, the first target video frame is used as the video frame to be edited.

6. The method as described in claim 5, characterized in that, The other target effect materials are third target effect materials, and the other video frames are second target video frames; Add other target effect materials to the areas corresponding to the target area in other video frames of the video to be processed, including: In response to a triggering operation that selects at least one thumbnail of a second target video frame from the segment selection area, a corresponding third target effect material is added to the area corresponding to the target area in the at least one second target video frame; the third target effect material is obtained by editing the image in the area corresponding to the target area in the corresponding second target video frame according to the editing function corresponding to the target editing control, and performing corresponding effect editing processing. The process of generating the edited video to be processed based on the first target effect material and the other target effect materials includes: Based on the first target effect material and each of the third target effect materials, an edited video to be processed is generated.

7. The method as described in claim 1, characterized in that, The editing interface also includes: an effect undo control; Prior to the edit completion operation triggered in response to the video to be processed, the method further includes: In response to a triggering operation of the effect cancellation control, at least one second editing operation prior to the triggering operation is cancelled.

8. The method as described in claim 1, characterized in that, The editing interface also includes an effect preview control; therefore, the method further includes: In response to a trigger operation on the effect preview control, starting from the video frame to be edited, the video editing effect corresponding to at least one video frame is previewed in the editing interface.

9. The method according to any one of claims 1 to 8, characterized in that, The video display interface also includes an effect masking control; therefore, the method further includes: While the edited video to be processed continues to play in the video display interface, in response to the triggering operation of the effect masking control, the video editing effect on the video to be processed is removed in the video display interface, and the original video to be processed continues to play.

10. A method for generating video content, characterized in that, The method includes: The system receives a first editing instruction from the client for the video to be processed. The first editing instruction is generated by the client in response to a second editing operation triggered by a target editing control in the editing interface. The editing interface is displayed by the client after responding to the first editing operation triggered by the video to be processed. It includes at least one editing control and displays the video to be processed, with each editing control corresponding to an editing function. Based on the first editing instruction, the editing function corresponding to the target editing control is determined, and the images within the target area of ​​the video frame to be edited are processed with the corresponding effects of the editing function to generate a first target effect material; and the images within the areas corresponding to the target area in other video frames of the video to be processed are processed with the corresponding effects of the editing function to generate other target effect materials; the other video frames are determined by modifying the application duration or application screen of the effect corresponding to the target editing control; The first target effect material and the other target effect materials are fed back to the client, so that the client adds the first target effect material to the target area in the video frame to be edited, and adds the other target effect materials to the areas corresponding to the target area in other video frames; The first target effect material and the other target effect materials are associated and stored with the video to be processed.

11. The method as described in claim 10, characterized in that, The other target effect materials are the second target effect materials; the editing interface also includes a time period setting control; Then, the editing process of the images within the area corresponding to the target area in other video frames of the video to be processed, generating other target effect materials, includes: For the video to be processed, the corresponding editing functions are applied to the frames in other video frames within the same area as the target area during the effect application period to generate corresponding second target effect materials, so that the client can add corresponding second target effect materials to the areas in other video frames corresponding to the target area; The effect application period is defined as the period during which the client determines the effect application for the target editing control after responding to a setting operation triggered by the setting control for the specified period.

12. The method as described in claim 11, characterized in that, The step of associating and storing the first target effect material and the other target effect materials with the video to be processed further includes: Each second target effect material and the time period for which the effect is applied are associated and stored with the first target effect material.

13. The method as described in claim 10, characterized in that, The editing interface also includes a segment selection area; Before receiving the first editing instruction for the video to be processed sent by the client, the following is also included: The system receives a second editing instruction for the video to be processed sent by the client, wherein the second editing instruction is generated by the client in response to the first editing operation; Based on the second editing instruction, a thumbnail of at least one video frame within the associated editing period of the video to be processed is determined and fed back to the client so that the client can display it in the segment selection area; the associated editing period is a time period of a certain duration including the trigger time of the first editing operation.

14. The method as described in any one of claims 10, 11, and 13, characterized in that, The method further includes: The first target effect material for the video to be processed will be uploaded to the content platform server for synchronous storage.

15. The method as described in claim 12, characterized in that, The method further includes: The various second target effect materials for the video to be processed, as well as the time periods for which the effects are applied, will be uploaded to the content platform server for synchronous storage.

16. A video content generation apparatus, characterized in that, include: An editing trigger unit is used to respond to a first editing operation triggered by a video to be processed played in a video display interface, display an editing interface including at least one editing control, and display the video to be edited in the editing interface, wherein each editing control corresponds to an editing function; The video editing unit is configured to respond to a second editing operation triggered by a target editing control by adding a corresponding first target effect material to a target area in the video frame to be edited, and adding other target effect materials to areas corresponding to the target area in other video frames of the video to be processed; the other video frames are determined by modifying the application duration or application screen of the effect corresponding to the target editing control; the first target effect material is obtained by editing the screen in the target area of ​​the video frame to be edited according to the editing function corresponding to the target editing control; the other target effect materials are obtained by editing the screen in the area corresponding to the target area in the other video frames according to the editing function corresponding to the target editing control. The video generation unit is configured to, in response to an editing completion operation triggered for the video to be processed, generate an edited video to be processed based on the first target effect material and the other target effect materials, and continue playing the edited video to be processed in the video display interface.

17. A video content generation apparatus, characterized in that, include: The first receiving unit is configured to receive a first editing instruction sent by the client for the video to be processed. The first editing instruction is generated by the client in response to a second editing operation triggered by a target editing control in the editing interface. The editing interface is displayed by the client in response to the first editing operation triggered by the client for the video to be processed, including at least one editing control and displaying the video to be processed, and each editing control corresponds to an editing function. The first feedback unit is configured to determine the editing function corresponding to the target editing control based on the first editing instruction, and to perform editing processing on the screen within the target area of ​​the video frame to be edited, thereby generating a first target effect material; and to perform editing processing on the screen within the area corresponding to the target area in other video frames of the video to be processed, thereby generating other target effect materials; the other video frames are determined by modifying the application duration or application screen of the effect corresponding to the target editing control; and to feed back the first target effect material and the other target effect materials to the client, so that the client adds the first target effect material to the target area of ​​the video frame to be edited, and adds the other target effect materials to the area corresponding to the target area in other video frames; The storage unit is used to associate and store the first target effect material and the other target effect materials with the video to be processed.

18. An electronic device, characterized in that, It includes a processor and a memory, wherein the memory stores a computer program that, when executed by the processor, causes the processor to perform the steps of any of the methods described in claims 1 to 15.

19. A computer-readable storage medium, characterized in that, It includes a computer program that, when run on an electronic device, causes the electronic device to perform the steps of any of the methods described in claims 1 to 15.

20. A computer program product, characterized in that, The method includes a computer program stored in a computer-readable storage medium; when a processor of an electronic device reads the computer program from the computer-readable storage medium, the processor executes the computer program, causing the electronic device to perform the steps of any one of claims 1 to 15.

Images