Video editing method and device, equipment and medium

By obtaining and presenting clips of text and virtual objects in the video editing interface and performing video editing, the problem of high professional threshold and poor flexibility of digital human animation creation in the prior art is solved, and a more flexible and user-friendly video editing experience is achieved.

CN119729090APending Publication Date: 2025-03-28BEIJING ZITIAO NETWORK TECH CO LTD

Patent Information

Application Number
CN202311278289.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-09-28
Publication Date
2025-03-28

AI Technical Summary

Technical Problem

In the prior art, creating digital human animations and exporting them as videos requires independent digital human construction tools, with high professional thresholds and poor flexibility.

Method used

Provides a video editing method, by displaying the target video editing interface, obtaining the target text and virtual objects, and presenting text clips and video clips in the editing area, performing video editing, and presenting the editing effect through the video preview area.

Benefits of technology

It lowers the threshold for creating with virtual objects, improves the flexibility and user experience of video editing, and allows users to intuitively understand the editing effect and make adjustments before finally generating the video.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119729090A_ABST
    Figure CN119729090A_ABST
Patent Text Reader

Abstract

The embodiment of the invention relates to a video editing method and device, equipment and a medium. The method comprises the following steps: displaying a target video editing interface; obtaining a target text and a target virtual object, and presenting a text segment formed based on the target text and a video segment formed based on the target virtual object in the editing area; performing video editing based on the text segment and the video segment, and presenting a video editing effect through the video preview area; wherein the video editing effect is at least used for presenting a picture and sound of reading the target text by the target virtual object, and the picture displays subtitles determined based on the text segment. According to the embodiment of the invention, the threshold that the user uses the virtual object to create is reduced, more users can flexibly and conveniently use the virtual object to create the video, and the video creation form is enriched.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of multimedia technology, and in particular to a video editing method, device, equipment and medium. Background Art

[0002] With the development of computer technology, virtual objects such as digital humans have become increasingly popular and have a certain appeal to users. However, related technologies usually require independent digital human construction tools to create digital human animations and directly export them as videos, which requires a high professional threshold and poor flexibility. Summary of the invention

[0003] In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides a video editing method, device, equipment and medium.

[0004] An embodiment of the present disclosure provides a video editing method, the method comprising: displaying a target video editing interface; wherein the target video editing interface includes an editing area and a video preview area; obtaining a target text and a target virtual object, and presenting a text segment formed based on the target text and a video segment formed based on the target virtual object in the editing area; wherein the text segment and the video segment have aligned timeline positions; performing video editing based on the text segment and the video segment, and presenting a video editing effect through the video preview area; wherein the video editing effect is at least used to present a picture and sound of the target virtual object reading the target text, and the picture displays subtitles determined based on the text segment.

[0005] Optionally, the editing area includes multiple editing tracks, and the multiple editing tracks include at least a first editing track corresponding to the text material and a second editing track corresponding to the virtual object material; wherein the text segment is presented through the first editing track, and the video segment is presented through the second editing track.

[0006] Optionally, the multiple editing tracks also include a third editing track corresponding to at least one target type material; the target type material is different from the text material and the virtual object material; the track segment formed based on the target type material is presented through the third editing track; the video editing based on the text segment and the video segment includes: video editing based on the text segment, the video segment and the track segment corresponding to the target type material.

[0007] Optionally, the performing video editing based on the text segment and the video segment includes: in a case where editing operation information corresponding to the editing area is acquired, performing video editing based on the editing operation information, the object segment and the video segment.

[0008] Optionally, obtaining the target text includes: in response to receiving user uploaded text, using the user uploaded text as the target text; or, in response to receiving user uploaded information, generating recommended text based on the user uploaded information, and using the recommended text as the target text.

[0009] Optionally, obtaining the target virtual object includes: in response to a virtual object triggering operation, displaying multiple candidate virtual objects; different candidate virtual objects have different images and / or actions; in response to a selection operation on the multiple candidate virtual objects, using the virtual object corresponding to the selection operation as the target virtual object.

[0010] Optionally, the candidate virtual objects are generated based on a preset object generation algorithm, and the object generation algorithms corresponding to different candidate virtual objects are the same or different.

[0011] Optionally, presenting the video editing effect through the video preview area includes: displaying a static picture corresponding to the target virtual object in the video preview area before the target virtual object is rendered, and displaying a dynamic picture corresponding to the target virtual object in the video preview area until the rendering of the target virtual object is completed; converting the target text into target audio, and playing the target audio during the display of the target virtual object picture, so as to present the picture and sound of the target virtual object reading the target text through the video preview area.

[0012] Optionally, the static picture of the target virtual object is a pre-set picture, or the static picture of the target virtual object is the first frame rendering picture of the target virtual object; the dynamic picture of the target virtual object is the rendering picture of a preset action sequence corresponding to the target virtual object.

[0013] Optionally, displaying the target video editing interface includes: in response to a selection operation on a target subtask in a preset video editing task, displaying the target video editing interface; wherein, the video editing task includes multiple subtasks, and different subtasks correspond to different video editing interfaces.

[0014] Optionally, the method further includes: acquiring an editing template used by the video editing task; and determining and displaying a plurality of subtasks included in the video editing task based on the editing template.

[0015] The disclosed embodiment also provides a video editing device, comprising: an editing interface display module, used to display a target video editing interface; wherein the target video editing interface includes an editing area and a video preview area; a segment presentation module, used to obtain a target text and a target virtual object, and present a text segment formed based on the target text and a video segment formed based on the target virtual object in the editing area; wherein the text segment and the video segment have aligned timeline positions; a video editing module, used to perform video editing based on the text segment and the video segment, and present a video editing effect through the video preview area; wherein the video editing effect is at least used to present a picture and sound of the target virtual object reading the target text, and the picture displays subtitles determined based on the text segment.

[0016] An embodiment of the present disclosure also provides an electronic device, which includes: a processor; a memory for storing executable instructions of the processor; the processor is used to read the executable instructions from the memory and execute the instructions to implement the video editing method provided by the embodiment of the present disclosure.

[0017] The embodiment of the present disclosure further provides a computer-readable storage medium, wherein the storage medium stores a computer program, and the computer program is used to execute the video editing method provided by the embodiment of the present disclosure.

[0018] The embodiment of the present disclosure also provides a computer program product, including a computer program, which implements the video editing method when executed by a processor.

[0019] The above-mentioned technical scheme provided by the embodiment of the present disclosure provides users with an easy-to-operate video editing interface (including a target video editing interface with an editing area and a video preview area, and the editing area can present text segments formed based on the target text and video segments formed based on the target virtual object). Users can flexibly and conveniently edit the required virtual objects and texts, introduce virtual objects used for reading text as materials into video editing, and can intuitively present the effect of the virtual object reading text through the video preview area. It also helps users to clearly know the editing effect and make flexible adjustments before the final video is generated, which greatly reduces the threshold for users to use virtual objects for creation, and also helps more users to flexibly and conveniently use virtual objects for video creation, enriching the form of video creation.

[0020] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0022] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0023] Figure 1 A flowchart of a video editing method provided by an embodiment of the present disclosure;

[0024] Figure 2 A schematic diagram of a target video editing interface provided by an embodiment of the present disclosure;

[0025] Figure 3 A schematic diagram of a video preview area provided in an embodiment of the present disclosure;

[0026] Figure 4 A schematic diagram of the structure of a video editing device provided by an embodiment of the present disclosure;

[0027] Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0028] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0029] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0030] Figure 1 The flowchart of a video editing method provided by an embodiment of the present disclosure is shown in FIG. 1 , which can be executed by a video editing device, wherein the device can be implemented by software and / or hardware and can generally be integrated in an electronic device. Figure 1 As shown, the method mainly includes the following steps S102 to S106:

[0031] Step S102, displaying a target video editing interface; wherein the target video editing interface includes an editing area and a video preview area.

[0032] In actual applications, the target video editing interface can be the initial editing interface directly presented by the video editing software, or it can be a proprietary interface that the video editing software displays only when certain conditions are met. For example, when a creation request for a voice-over video creation task is detected, the target video editing interface for implementing the voice-over video creation task is displayed.

[0033] In some embodiments, the editing area provided in the target video editing interface includes multiple editing tracks, and the multiple editing tracks include at least a first editing track corresponding to the text material and a second editing track corresponding to the virtual object material; wherein the text segment is presented through the first editing track, and the video segment is presented through the second editing track. The above method facilitates users to introduce virtual objects as materials into the video editing process, which not only facilitates creation for virtual objects, but also enriches the video editing form. In some specific application examples, the virtual object can be a 2D object or a 3D object, which is not limited by the embodiments of the present disclosure. Exemplarily, the virtual object can be a digital person. The virtual object introduced in the video editing software of the embodiments of the present disclosure can be used to read aloud text, that is, a virtual object is used to replace a real person to read aloud the specified text, so as to quickly and conveniently complete the oral task.

[0034] The area to which multiple editing tracks belong in the editing area can be called the editing track area. In addition to the editing track area, the target video editing interface can also include an editing tool area and a material selection area. The editing tool area can be used to present editing controls, and the material selection area can be used to display the selected materials and / or the selected materials. Editing controls include but are not limited to operation controls of editing tools such as track editing controls and tool editing controls, which are used to trigger video editing processing in response to user operations. The embodiments of the present disclosure do not limit the arrangement of the above areas of the target video editing interface. For example, the video preview area can be set above the editing track area, and the operation controls of the specified editing tools can be set below the editing track area.

[0035] Step S104, obtaining the target text and the target virtual object, and presenting a text segment formed based on the target text and a video segment formed based on the target virtual object in the editing area; wherein the text segment and the video segment have aligned timeline positions, in other words, the text segment and the video segment formed based on the target virtual object are aligned in position on the editing timeline.

[0036] The target text can be text input by the user or text automatically generated according to user needs, which is not limited here. In practical applications, a variety of optional virtual objects can be provided to the user for the user to select the desired target virtual object. After the user determines the target text, a text segment formed based on the target text can be presented on the first editing track; and after the user determines the target virtual object, a video segment formed based on the target virtual object can be presented on the second editing track. Since the embodiment of the present disclosure expects to achieve the effect of the target virtual object reading the target text aloud, the text segment and the video segment formed based on the target virtual object have aligned timeline positions, and the timeline positions of the text segment and the video segment formed based on the target virtual object can all overlap.

[0037] Step S106, video editing is performed based on the text segment and the video segment, and the video editing effect is presented in the video preview area; wherein the video editing effect is at least used to present the image and sound of the target virtual object reading the target text, and the image displays subtitles determined based on the text segment. The above method can effectively ensure the user's audio-visual experience.

[0038] In actual applications, the user may only select the target text and the target virtual object, and do not take further editing operations. Therefore, if the editing operation information corresponding to the editing area is not obtained, the video editing can be performed directly based on the text segment and the video segment. Some users may take further editing operations on materials such as text, virtual objects or corresponding segments according to their needs. Therefore, if the editing operation information corresponding to the editing area is obtained, the video editing is performed based on the editing operation information, the object segment and the video segment. The editing operation information includes but is not limited to text modification information and / or object modification information. The text modification information may include one or more of text content modification information, text style modification information, text font modification information, text size modification information, and text position modification information. The object modification information may include one or more of object size modification information, object position modification information, and object image modification information. The above is only an exemplary description. Any method that can edit text or virtual objects is acceptable and is not limited here. In a specific implementation example, video editing can be performed based on editing operation information, object segments and video segments. The obtained video editing result can be a target video draft. The user can directly save the target video draft or export the target video based on the target video draft. The disclosed embodiment does not limit the video editing results.

[0039] In actual applications, video editing can be performed based on editing operation information, text clips and video clips, and the video editing effect can be directly presented to the user intuitively through the video preview area. The user can clearly know the current editing effect without having to wait for the video to be exported before viewing the effect, which can greatly improve the user's video editing experience.

[0040] The user can only read the text of the virtual object for editing, or add other materials besides text and virtual objects to merge other materials with the virtual objects to form a rich video editing effect. Therefore, in some implementation examples, multiple editing tracks also include a third editing track corresponding to at least one target type of material; the target type material is different from the text material and the virtual object material, and can include any material required for video editing, such as video material, image material, special effect material, sticker material, music material, etc., which is not limited here. The track segment formed based on the target type material is presented through the third editing track. On this basis, video editing is performed based on text segments and video segments, including: video editing based on text segments, video segments and track segments corresponding to the target type material. For example, the user provides background video material, and through multi-track editing, the virtual object is superimposed on the background video to read the text content related to the background video, thereby giving the user a good audio-visual experience. For ease of understanding, please refer to Figure 2 Schematic diagram of a target video editing interface shown in FIG. 1 , illustrating an editing tool area, a material selection area, a video preview area, and an editing track area, and further illustrating a first editing track, a second editing track, and a third editing track in the editing track area. For example, taking the target type material as a background video material uploaded by a user, a video clip formed based on the video material is presented on the third editing track. For easy distinction, Figure 2 In the video clip, the video clip is referred to as the background video clip, and the video clip formed based on the target virtual object is referred to as the object video clip. On this basis, the second editing track can be used as a picture-in-picture track. Through the above interface, the text clip, the object video clip, and the background video clip can be edited to give people the effect of the virtual object reading the text in the scene corresponding to the background video. It should be noted that Figure 2 This is only an example. In actual applications, the video editing interface may include Figure 2In the video editing interface, more or fewer areas can be added, and the regional layout can also be different, which is not limited here. In actual applications, the second editing track corresponding to the target virtual object can be used as a picture-in-picture track, and various editing operations can be performed on the target virtual object based on the picture-in-picture function, including but not limited to splitting, speed change, volume, mixing mode, animation, deletion, replacement, editing, basic properties, hierarchy, keyframes, cutting the main track, copying, filters, adjustment, beauty and body, mask, audio separation, opacity, reverse playback, freeze frame, voice change and other operations, which greatly enriches the user's editing diversity for virtual objects.

[0041] In summary, the above-mentioned technical scheme provided by the embodiment of the present disclosure provides users with an easy-to-operate video editing interface (a target video editing interface including an editing track area and a video preview area, and the editing track area includes multiple editing tracks, including at least a first editing track corresponding to the text material and a second editing track corresponding to the virtual object material). Users can flexibly and conveniently use the tracks in the editing track area to edit the required virtual objects and texts, introduce virtual objects used for reading text as materials into video editing, and intuitively present the effect of virtual objects reading text through the video preview area, which also helps users to clearly know the editing effects and make flexible adjustments before the final video is generated, greatly reducing the threshold for users to use virtual objects for creation, and also helping more users to flexibly and conveniently use virtual objects for video creation, enriching the form of video creation.

[0042] The present disclosure provides two implementation methods for obtaining the target text. The target text may be obtained by referring to the following method 1 or method 2:

[0043] Method 1: In response to receiving the user uploaded text, the user uploaded text is used as the target text.

[0044] For example, the text uploaded by the user can be obtained through the text input control, and the user uploaded text can be directly used as the target text read by the target virtual object required by the user. This method can effectively ensure that the text content read by the target virtual object fully meets the user's needs.

[0045] Method 2: In response to receiving the user uploaded information, generating a recommended text based on the user uploaded information, and using the recommended text as the target text.

[0046] Exemplarily, the information uploaded by the user can be obtained through the information upload control, and the user uploaded information includes but is not limited to text form, voice form, image form, video form, etc., wherein the user uploaded information in text form and voice form can be expressed only by keywords and sentences. Based on the user uploaded information, the disclosed embodiment can use artificial intelligence models such as language models to automatically generate recommended texts that match the user uploaded information. For example, if the user uploaded information is a picture of a water cup, the recommended text can be the advertising slogan corresponding to the water cup in the water cup picture; for example, if the user uploaded information is a keyword of a certain scenery, the recommended text can be a detailed description of the scenery; for example, if the user uploaded information is a certain knowledge point, the recommended text is a detailed introduction of the knowledge point. Through the above method, the user's time and energy can be better saved, and the user can be provided with text that meets the needs. In practical applications, a text modification control can also be provided to the user for the user to modify the recommended text.

[0047] Furthermore, the embodiment of the present disclosure provides an implementation method for obtaining a target virtual object, which can be performed by referring to the following steps (1) and (2):

[0048] Step (1), in response to a virtual object triggering operation, displaying a plurality of candidate virtual objects; different candidate virtual objects have different images and / or actions.

[0049] In actual applications, an object selection control can be set. If the object selection control is triggered, it is determined that a virtual object triggering operation is detected. At this time, a variety of candidate virtual objects can be displayed on the interface. The candidate virtual objects are generated based on a preset object generation algorithm. The object generation algorithms corresponding to different candidate virtual objects are the same or different. Even if the same object generation algorithm is used, the parameters corresponding to different candidate virtual objects may be different, so the resulting images or actions may also be different.

[0050] Step (2), in response to a selection operation on multiple candidate virtual objects, taking the candidate virtual object corresponding to the selection operation as the target virtual object.

[0051] The user can select one or more virtual objects from a variety of candidate virtual objects as target virtual objects according to needs, so as to apply the target virtual objects to video editing.

[0052] In order to effectively guarantee the user's video editing experience, the embodiment of the present disclosure further provides an implementation example of presenting the video editing effect through the video preview area, which can be performed with reference to the following steps A and B:

[0053] Step A: Display a static image corresponding to the target virtual object in the video preview area while the target virtual object is not rendered, and display a dynamic image corresponding to the target virtual object in the video preview area after the target virtual object is rendered.

[0054] Considering that the rendering time of virtual objects is usually long, in order to avoid users waiting, the static picture corresponding to the target virtual object can be presented to the user first, and the rendering can be completed quickly during the display of the static picture. When the target virtual object is rendered, the static picture is replaced with the dynamic picture corresponding to the target virtual object. Exemplarily, the static picture of the target virtual object is a pre-set picture, or the static picture of the target virtual object is the first frame rendering picture of the target virtual object; the dynamic picture of the target virtual object is the rendering picture of the preset action sequence corresponding to the target virtual object. The preset action sequence can be automatically generated based on the object generation algorithm corresponding to the target virtual object, or it can be manually set and input into the object generation algorithm, which is not limited here. In the above manner, the user does not need to wait or export the video, so that the user can watch the editing effect of the virtual object in time during video editing, which better guarantees the user experience.

[0055] Step B, converting the target text into target audio, and playing the target audio during the screen display of the target virtual object, so as to present the picture and sound of the target virtual object reading the target text through the video preview area, and the screen displays subtitles determined based on the text segment.

[0056] In practical applications, the target text can be quickly converted into the target audio by using TTS (Text To Speech) technology, and played synchronously with the image of the target virtual object, thereby presenting the effect of the target virtual object reading the target text. It should be noted that step A and step B do not limit the order in which the steps are executed. In practical applications, step A and step B can be executed simultaneously.

[0057] For easier understanding, see Figure 3 The schematic diagram of a video preview area shown in the figure takes the virtual object as a digital human and the target type material as a picture as an example, and at the same time illustrates the text read aloud by the digital human in real time in the interface. When the digital human is not rendered, the static picture corresponding to the digital human can be used, and the static picture corresponding to the digital human can be superimposed with the background picture to present the static digital human effect to the user, but the presentation time of the static digital human is usually short. Once the digital human is rendered, the dynamic picture corresponding to the digital human can be used, and the dynamic picture corresponding to the digital human can be superimposed with the background picture to present the dynamic digital human effect to the user. The above are all accompanied by the audio converted from the target text for playback, and the overall video playback effect of the digital human explaining the product in real time is presented to the user.

[0058] In order to facilitate users to edit quickly, the embodiment of the present disclosure can provide users with editing templates. The editing template can divide video editing into multiple submodules. Specifically, the video editing task can be divided into multiple subtasks. Different subtasks correspond to different video editing interfaces. Users can conveniently perform video editing for each subtask, thereby combining the video editing results corresponding to each subtask to obtain the final desired video. Based on this, the method provided by the embodiment of the present disclosure also includes: obtaining an editing template used for the video editing task; based on the editing template, determining and displaying multiple subtasks included in the video editing task.

[0059] The video editing task may be a video editing task initiated by a user, such as an advertising editing task. The disclosed embodiment may provide a variety of editing templates in advance, and different editing templates may be used to perform different video editing tasks. The editing template may indicate a specific way to subdivide the video editing task into subtasks, and provide corresponding editing components. Exemplarily, the subtasks may be off-screen audio and video editing subtasks, oral video editing subtasks, video display subtasks, and the like. Among them, the main commentary content in the off-screen audio and video editing subtask comes from the narration audio, and the video screen may be jumped according to the sound content. In the oral video editing subtask, a virtual object or a real person is required to read the text, and pictures or video materials may be further added to the background. The video display subtask may only display the video without narration or virtual object / real person commentary. The above are all examples, and the disclosed embodiment does not limit the type of subtask. In the above manner, the video editing task is disassembled according to the needs, and each subtask is quickly edited. The video editing interfaces corresponding to different subtasks are different, and the editing components provided may also be different. Based on this, in some implementations of displaying the target video editing interface, the target video editing interface can be displayed in response to the selection operation of the target subtask in the preset video editing task. Exemplarily, the target subtask can be the aforementioned oral video editing subtask. That is, when the oral video editing subtask is triggered, the target video editing interface containing the first editing track corresponding to the text material and the second editing track corresponding to the virtual object material is displayed to the user for the user to edit through the interface, thereby achieving the oral effect of the virtual object reading the text.

[0060] To sum up, the video editing method provided by the embodiments of the present disclosure provides users with an easy-to-operate video editing interface, and users can flexibly and conveniently edit the required virtual objects and texts, introduce virtual objects used to read text as materials into video editing, and can intuitively present the effect of the virtual object reading text through the video preview area, which also helps users to clearly understand the editing effect and make flexible adjustments before the final video is generated, greatly reducing the threshold for users to use virtual objects for creation, and also helping more users to flexibly and conveniently use virtual objects for video creation, enriching the form of video creation.

[0061] Corresponding to the aforementioned video editing method, the embodiment of the present disclosure further provides a video editing device, Figure 4 FIG. 1 is a schematic diagram of a video editing device provided by an embodiment of the present disclosure. The device can be implemented by software and / or hardware and can generally be integrated into an electronic device, such as Figure 4 As shown, the video editing device comprises:

[0062] The editing interface display module 402 is used to display the target video editing interface; wherein the target video editing interface includes an editing area and a video preview area;

[0063] The segment presentation module 404 is used to obtain the target text and the target virtual object, and present the text segment formed based on the target text and the video segment formed based on the target virtual object in the editing area; wherein the text segment and the video segment have aligned timeline positions;

[0064] The video editing module 406 performs video editing based on the text segment and the video segment, and presents the video editing effect through the video preview area; wherein the video editing effect is at least used to present the picture and sound of the target virtual object reading the target text, and the picture displays subtitles determined based on the text segment.

[0065] The above-mentioned device provided by the embodiment of the present disclosure provides users with an easy-to-operate video editing interface (including a target video editing interface with an editing area and a video preview area, and the editing area can present text segments formed based on the target text and video segments formed based on the target virtual object). Users can flexibly and conveniently edit the required virtual objects and texts, introduce virtual objects used to read text as materials into video editing, and can intuitively present the effect of the virtual object reading text through the video preview area. It also helps users to clearly know the editing effect and make flexible adjustments before the final video is generated, which greatly reduces the threshold for users to use virtual objects for creation, and also helps more users to flexibly and conveniently use virtual objects for video creation, enriching the form of video creation.

[0066] In some embodiments, the editing area includes multiple editing tracks, and the multiple editing tracks include at least a first editing track corresponding to the text material and a second editing track corresponding to the virtual object material; wherein the text segment is presented through the first editing track, and the video segment is presented through the second editing track.

[0067] In some embodiments, the multiple editing tracks also include a third editing track corresponding to at least one target type material; the target type material is different from the text material and the virtual object material; the track segment formed based on the target type material is presented through the third editing track; the video editing module 406 is specifically used to perform video editing based on the text segment, the video segment and the track segment corresponding to the target type material.

[0068] In some implementations, the video editing module 406 is specifically configured to: upon acquiring the editing operation information corresponding to the editing area, perform video editing based on the editing operation information, the object segment, and the video segment.

[0069] In some embodiments, the fragment presentation module 404 is specifically used to: in response to receiving user uploaded text, use the user uploaded text as the target text; or, in response to receiving user uploaded information, generate recommended text based on the user uploaded information, and use the recommended text as the target text.

[0070] In some embodiments, the fragment presentation module 404 is specifically used to: display a plurality of candidate virtual objects in response to a virtual object triggering operation; different candidate virtual objects have different images and / or actions; and in response to a selection operation on the plurality of candidate virtual objects, use the virtual object corresponding to the selection operation as the target virtual object.

[0071] In some implementations, the candidate virtual objects are generated based on a preset object generation algorithm, and different candidate virtual objects may correspond to the same or different object generation algorithms.

[0072] In some embodiments, the video editing module 406 is specifically used to: display a static image corresponding to the target virtual object in the video preview area before the target virtual object is rendered, and display a dynamic image corresponding to the target virtual object in the video preview area after the rendering of the target virtual object is completed; convert the target text into a target audio, and play the target audio during the display of the target virtual object, so as to present the image and sound of the target virtual object reading the target text through the video preview area.

[0073] In some embodiments, the static image of the target virtual object is a pre-set image, or the static image of the target virtual object is the first frame rendering image of the target virtual object; the dynamic image of the target virtual object is the rendering image of a preset action sequence corresponding to the target virtual object.

[0074] In some embodiments, the editing interface display module 402 is specifically used to: display a target video editing interface in response to a selection operation of a target subtask in a preset video editing task; wherein the video editing task includes multiple subtasks, and different subtasks correspond to different video editing interfaces.

[0075] In some implementations, the device further includes a subtask determination module, which is used to obtain an editing template used by the video editing task; based on the editing template, determine and display a plurality of subtasks included in the video editing task.

[0076] The video editing device provided in the embodiments of the present disclosure can execute the video editing method provided in any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

[0077] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described device embodiment can refer to the corresponding process in the method embodiment, and will not be repeated here.

[0078] An embodiment of the present disclosure provides an electronic device, which includes: a storage device on which a computer program is stored; and a processing device for executing the computer program in the storage device to implement the steps of any method in the present disclosure.

[0079] Reference below Figure 5 , which shows a schematic diagram of the structure of an electronic device 500 suitable for implementing the embodiment of the present disclosure. The terminal device in the embodiment of the present disclosure may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 5 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0080] like Figure 5As shown, the electronic device 500 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the electronic device 500 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0081] Typically, the following devices may be connected to the I / O interface 505: an input device 506 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509. The communication device 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 5 The electronic device 500 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0082] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 509, or installed from a storage device 508, or installed from a ROM 502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0083] In addition to the above-mentioned methods and devices, the embodiments of the present disclosure may also be a computer program product, which includes computer program instructions, which, when executed by a processor, cause the processor to perform the image processing method provided by the embodiments of the present disclosure. The computer program product may be written in any combination of one or more programming languages ​​to write program codes for performing the operations of the embodiments of the present disclosure, the programming languages ​​including object-oriented programming languages ​​such as Java, C++, etc., and also conventional procedural programming languages ​​such as "C" language or similar programming languages. The program code may be executed entirely on a user computing device, partially on a user device, as an independent software package, partially on a user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0084] In addition, the embodiment of the present disclosure may also be a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by a processor, the processor executes the video editing method provided by the embodiment of the present disclosure.

[0085] The computer readable storage medium can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0086] The embodiments of the present disclosure also provide a computer program product, including a computer program / instruction, which implements the video editing method in the embodiments of the present disclosure when executed by a processor.

[0087] It is understandable that before using the technical solutions disclosed in the various embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0088] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0089] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0090] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0091] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0092] The above description is only a specific embodiment of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A video editing method, characterized in that: include: Displaying a target video editing interface; wherein the target video editing interface includes an editing area and a video preview area; Acquire a target text and a target virtual object, and present a text segment formed based on the target text and a video segment formed based on the target virtual object in the editing area; wherein the text segment and the video segment have aligned timeline positions; Video editing is performed based on the text segment and the video segment, and the video editing effect is presented through the video preview area; wherein the video editing effect is at least used to present the picture and sound of the target virtual object reading the target text, and the picture displays subtitles determined based on the text segment.

2. The method according to claim 1, characterized in that The editing area includes multiple editing tracks, and the multiple editing tracks include at least a first editing track corresponding to the text material and a second editing track corresponding to the virtual object material; wherein the text segment is presented through the first editing track, and the video segment is presented through the second editing track.

3. The method according to claim 2, characterized in that The multiple editing tracks further include a third editing track corresponding to at least one target type material; the target type material is different from the text material and the virtual object material; The track fragment formed based on the target type material is presented through the third editing track; The performing video editing based on the text segment and the video segment includes: performing video editing based on the text segment, the video segment and the track segment corresponding to the target type material.

4. The method according to claim 1, characterized in that: The video editing based on the text segment and the video segment includes: When the editing operation information corresponding to the editing area is acquired, video editing is performed based on the editing operation information, the object segment, and the video segment.

5. The method according to claim 1, characterized in that The obtaining of the target text comprises: In response to receiving the user uploaded text, taking the user uploaded text as the target text; or, In response to receiving the user uploaded information, a recommended text is generated based on the user uploaded information, and the recommended text is used as the target text.

6. The method according to claim 1, characterized in that The step of acquiring the target virtual object comprises: In response to a virtual object triggering operation, a plurality of candidate virtual objects are displayed; different candidate virtual objects have different images and / or actions; In response to a selection operation on the multiple candidate virtual objects, the candidate virtual object corresponding to the selection operation is used as a target virtual object.

7. The method according to claim 6, characterized in that The candidate virtual objects are generated based on a preset object generation algorithm, and different candidate virtual objects correspond to the same or different object generation algorithms.

8. The method according to claim 1, characterized in that The presenting of the video editing effect through the video preview area includes: During the period when the target virtual object is not rendered, a static picture corresponding to the target virtual object is displayed in the video preview area, and until the rendering of the target virtual object is completed, a dynamic picture corresponding to the target virtual object is displayed in the video preview area; The target text is converted into a target audio, and the target audio is played during the screen display of the target virtual object, so as to present the screen and sound of the target virtual object reading the target text through the video preview area.

9. The method according to claim 8, characterized in that The static picture of the target virtual object is a preset picture, or the static picture of the target virtual object is a first frame rendering picture of the target virtual object; The dynamic picture of the target virtual object is a rendering picture of a preset action sequence corresponding to the target virtual object.

10. The method according to claim 1, characterized in that The target video editing interface includes: In response to a selection operation of a target subtask in a preset video editing task, a target video editing interface is displayed; wherein the video editing task includes a plurality of subtasks, and different subtasks correspond to different video editing interfaces.

11. The method according to claim 10, characterized in that The method further comprises: Obtaining an editing template used by the video editing task; Based on the editing template, multiple subtasks included in the video editing task are determined and displayed.

12. A video editing device, characterized in that: include: An editing interface display module, used to display a target video editing interface; wherein the target video editing interface includes an editing area and a video preview area; A segment presentation module, used to obtain a target text and a target virtual object, and present a text segment formed based on the target text and a video segment formed based on the target virtual object in the editing area; wherein the text segment and the video segment have aligned timeline positions; A video editing module is used to perform video editing based on the text segment and the video segment, and present the video editing effect through the video preview area; wherein the video editing effect is at least used to present the picture and sound of the target virtual object reading the target text, and the picture displays subtitles determined based on the text segment.

13. An electronic device, characterized in that: The electronic device comprises: a storage device having a computer program stored thereon; A processing device, used to execute the computer program in the storage device to implement the steps of the video editing method according to any one of claims 1-11.

14. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and the computer program is used to execute the video editing method described in any one of claims 1 to 11.

15. A computer program product, characterized in that The invention comprises a computer program, which implements the video editing method according to any one of claims 1 to 11 when being executed by a processor.

Citation Information

Patent Citations

  • Virtual image processing method and device, terminal and storage medium

    CN113325983A

  • Method and system for generating virtual character broadcast video and readable storage medium

    CN115022674A

  • Virtual image animation generation method and device, electronic equipment and storage medium

    CN115393484A

  • Demonstration video generation method and device, electronic equipment and readable storage medium

    CN115766971A

  • Virtual image animation generation method and device, electronic equipment and storage medium

    CN116168122A

Cited By

  • Browser video title editing method and device, storage medium and program product

    CN120128748A

  • Video processing method and device, electronic equipment and storage medium

    CN120547419A

  • Interaction method and device, electronic equipment and storage medium

    CN120711240A

  • Video processing method and device, equipment, storage medium and product

    CN121665027A