Video editing method and apparatus, device, and medium

Abstract

Embodiments of the present disclosure relate to a video editing method and apparatus, a device, and a medium. The method comprises: displaying a target video editing interface; acquiring a target text and acquiring a target virtual object, and presenting, in an editing area, a text fragment formed on the basis of the target text and a video clip formed on the basis of the target virtual object; and performing video editing on the basis of the text fragment and the video clip, and presenting a video editing effect by means of a video preview area, wherein the video editing effect is at least used for presenting a picture and sound of the target virtual object reading the target text, and the picture displays a subtitle determined on the basis of the text fragment. The embodiments of the present disclosure lower the threshold that a user uses a virtual object for creation, and facilitate more users to flexibly and conveniently use the virtual object to perform video creation, thereby enriching video creation forms.

Description

Video editing method, device, equipment and medium

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to the Chinese invention patent application with application number 202311278289.9, entitled “Video editing method, device, equipment and medium” and filing date September 28, 2023, and the entire application is incorporated herein by reference. Technical Field

[0003] The present disclosure relates to the field of multimedia technology, and in particular to a video editing method, apparatus, device, and medium. Background Art

[0004] With the development of computer technology, virtual objects such as digital humans have become increasingly popular and attractive to users. However, related technologies typically require independent digital human construction tools to create digital human animations and directly export them as videos, which requires a high level of professional expertise and lacks flexibility.

[0005] Summary of the Invention

[0006] In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides a video editing method, apparatus, device and medium.

[0007] An embodiment of the present disclosure provides a video editing method, the method comprising: displaying a target video editing interface; wherein the target video editing interface includes an editing area and a video preview area; obtaining a target text and a target virtual object, and presenting a text segment formed based on the target text and a video segment formed based on the target virtual object in the editing area; wherein the text segment and the video segment have aligned timeline positions; performing video editing based on the text segment and the video segment, and presenting a video editing effect through the video preview area; wherein the video editing effect is used to at least present a picture and sound of the target virtual object reading the target text, and the picture displays subtitles determined based on the text segment.

[0008] Optionally, the editing area includes multiple editing tracks, and the multiple editing tracks include at least a first editing track corresponding to the text material and a second editing track corresponding to the virtual object material; wherein the text segment is presented through the first editing track and the video segment is presented through the second editing track.

[0009] Optionally, the multiple editing tracks also include a third editing track corresponding to at least one target type material; the target type material is different from the text material and the virtual object material; the track segment formed based on the target type material is presented through the third editing track; the video editing based on the text segment and the video segment includes: video editing based on the text segment, the video segment and the track segment corresponding to the target type material.

[0010] Optionally, the performing video editing based on the text segment and the video segment includes: upon obtaining editing operation information corresponding to the editing area, performing video editing based on the editing operation information, the object segment and the video segment.

[0011] Optionally, obtaining the target text includes: in response to receiving user-uploaded text, using the user-uploaded text as the target text; or, in response to receiving user-uploaded information, generating a recommended text based on the user-uploaded information, and using the recommended text as the target text.

[0012] Optionally, obtaining the target virtual object includes: displaying multiple candidate virtual objects in response to a virtual object triggering operation; different candidate virtual objects have different images and / or actions; and in response to a selection operation on the multiple candidate virtual objects, using the virtual object corresponding to the selection operation as the target virtual object.

[0013] Optionally, the candidate virtual objects are generated based on a preset object generation algorithm, and different candidate virtual objects correspond to the same or different object generation algorithms.

[0014] Optionally, presenting the video editing effect through the video preview area includes: displaying a static picture corresponding to the target virtual object in the video preview area before the target virtual object is rendered, and displaying a dynamic picture corresponding to the target virtual object in the video preview area until the rendering of the target virtual object is completed; converting the target text into target audio, and playing the target audio during the display of the target virtual object picture, so as to present the picture and sound of the target virtual object reading the target text through the video preview area.

[0015] Optionally, the static image of the target virtual object is a pre-set image, or the static image of the target virtual object is the first frame rendering image of the target virtual object; the dynamic image of the target virtual object is the rendering image of the preset action sequence corresponding to the target virtual object.

[0016] Optionally, displaying the target video editing interface includes: displaying the target video editing interface in response to a selection operation of a target subtask in a preset video editing task; wherein, the video editing task includes multiple subtasks, and different subtasks correspond to different video editing interfaces.

[0017] Optionally, the method further includes: obtaining an editing template used for the video editing task; and determining and displaying a plurality of subtasks included in the video editing task based on the editing template.

[0018] An embodiment of the present disclosure also provides a video editing device, comprising: an editing interface display module, for displaying a target video editing interface; wherein the target video editing interface includes an editing area and a video preview area; a segment presentation module, for obtaining a target text and a target virtual object, and presenting a text segment formed based on the target text and a video segment formed based on the target virtual object in the editing area; wherein the text segment and the video segment have aligned timeline positions; a video editing module, for performing video editing based on the text segment and the video segment, and presenting a video editing effect through the video preview area; wherein the video editing effect is at least used to present the picture and sound of the target virtual object reading the target text, and the picture displays subtitles determined based on the text segment.

[0019] An embodiment of the present disclosure also provides an electronic device, which includes: a processor; a memory for storing instructions executable by the processor; the processor is used to read the executable instructions from the memory and execute the instructions to implement the video editing method provided by the embodiment of the present disclosure.

[0020] An embodiment of the present disclosure further provides a computer-readable storage medium, wherein the storage medium stores a computer program, and the computer program is used to execute the video editing method provided by the embodiment of the present disclosure.

[0021] The embodiment of the present disclosure further provides a computer program product, including a computer program, which implements the video editing method when executed by a processor.

[0022] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0024] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0025] FIG1 is a flow chart of a video editing method provided by an embodiment of the present disclosure;

[0026] FIG2 is a schematic diagram of a target video editing interface provided by an embodiment of the present disclosure;

[0027] FIG3 is a schematic diagram of a video preview area provided by an embodiment of the present disclosure;

[0028] FIG4 is a schematic structural diagram of a video editing device provided by an embodiment of the present disclosure;

[0029] FIG5 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0030] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features therein can be combined with each other in the absence of conflict.

[0031] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0032] FIG1 is a flow chart of a video editing method provided by an embodiment of the present disclosure. The method can be executed by a video editing device, wherein the device can be implemented using software and / or hardware and can generally be integrated into an electronic device. As shown in FIG1 , the method mainly includes the following steps S102 to S106:

[0033] Step S102: displaying a target video editing interface; wherein the target video editing interface includes an editing area and a video preview area.

[0034] In actual applications, the target video editing interface can be the initial editing interface directly presented by the video editing software, or it can be a proprietary interface that the video editing software displays only when certain conditions are met. For example, when a creation request for a voice-over video creation task is detected, the target video editing interface for implementing the voice-over video creation task is displayed.

[0035] In some embodiments, the editing area provided in the target video editing interface includes multiple editing tracks, and the multiple editing tracks include at least a first editing track corresponding to the text material and a second editing track corresponding to the virtual object material; wherein, the text segment is presented through the first editing track, and the video segment is presented through the second editing track. The above method facilitates users to introduce virtual objects as materials into the video editing process, which not only facilitates creation for virtual objects, but also enriches the video editing form. In some specific application examples, the virtual object can be a 2D object or a 3D object, which is not limited by the embodiment of the present disclosure. For example, the virtual object can be a digital person. The virtual object introduced in the video editing software of the embodiment of the present disclosure can be used to read text aloud, that is, a virtual object is used to replace a real person to read the specified text aloud, thereby completing the oral task quickly and conveniently.

[0036] The area to which multiple editing tracks belong in the editing area can be called the editing track area. In addition to the editing track area, the target video editing interface can also include an editing tool area and a material selection area. The editing tool area can be used to present editing controls, and the material selection area can be used to display the selected materials and / or selected materials. Editing controls include but are not limited to operation controls of editing tools such as track editing controls and tool editing controls, which are used to trigger video editing processing in response to user operations. The embodiments of the present disclosure do not limit the arrangement of the above areas of the target video editing interface. For example, the video preview area can be set above the editing track area, and the operation controls of the specified editing tools can be set below the editing track area.

[0037] Step S104, obtain the target text and the target virtual object, and present a text segment formed based on the target text and a video segment formed based on the target virtual object in the editing area; wherein the text segment and the video segment have aligned timeline positions, in other words, the text segment and the video segment formed based on the target virtual object are aligned in the position of the editing timeline.

[0038] The target text can be text input by the user or text automatically generated according to user needs, which is not limited here. In actual applications, a variety of optional virtual objects can be provided to the user for the user to select the desired target virtual object. After the user determines the target text, a text segment formed based on the target text can be presented on the first editing track; and after the user determines the target virtual object, a video segment formed based on the target virtual object can be presented on the second editing track. Since the embodiment of the present disclosure expects to achieve the effect of the target virtual object reading the target text, the text segment and the video segment formed based on the target virtual object have aligned timeline positions, and the timeline positions of the text segment and the video segment formed based on the target virtual object can all overlap.

[0039] In step S106, video editing is performed based on the text segment and the video segment, and the video editing effect is presented in the video preview area. The video editing effect at least presents the image and sound of the target virtual object reading the target text, and the screen displays subtitles determined based on the text segment. This method effectively ensures the user's audiovisual experience.

[0040] In actual applications, the user may only select the target text and the target virtual object, and not take further editing operations. Therefore, if the editing operation information corresponding to the editing area is not obtained, the video editing can be performed directly based on the text segment and the video segment. Some users may take further editing operations on materials such as text, virtual objects, or corresponding segments according to their needs. Therefore, if the editing operation information corresponding to the editing area is obtained, the video editing is performed based on the editing operation information, the object segment, and the video segment. The editing operation information includes but is not limited to text modification information and / or object modification information. The text modification information may include one or more of text content modification information, text style modification information, text font modification information, text size modification information, and text position modification information. The object modification information may include one or more of object size modification information, object position modification information, and object image modification information. The above is only an exemplary description. Any method that can edit text or virtual objects is acceptable and is not limited here. In a specific implementation example, video editing can be performed based on editing operation information, object segments and video segments. The obtained video editing result can be a target video draft. The user can directly save the target video draft or export the target video based on the target video draft. The embodiment of the present disclosure does not limit the video editing results.

[0041] In actual applications, video editing can be performed based on editing operation information, text fragments, and video fragments, and the video editing effect can be directly presented to the user intuitively through the video preview area. The user can clearly know the current editing effect without having to wait for the video to be exported before viewing the effect, which can greatly improve the user's video editing experience.

[0042] The user can only read the text of the virtual object for editing, or add other materials besides text and virtual objects to merge other materials with the virtual object to form a rich video editing effect. Therefore, in some implementation examples, multiple editing tracks also include a third editing track corresponding to at least one target type material; the target type material is different from the text material and the virtual object material, and can include any material required for video editing such as video material, image material, special effect material, sticker material, music material, etc., which is not limited here. The track segment formed based on the target type material is presented through the third editing track. On this basis, video editing is performed based on text segments and video segments, including: video editing based on text segments, video segments and track segments corresponding to the target type material. For example, the user provides background video material, and through multi-track editing, the virtual object is superimposed on the background video and reads the text content related to the background video, thereby giving the user a good audio-visual experience. For ease of understanding, reference may be made to the schematic diagram of a target video editing interface shown in FIG2 , which illustrates the editing tool area, material selection area, video preview area, and editing track area, and further illustrates the first editing track, the second editing track, and the third editing track in the editing track area. For example, if the target type material is a background video material uploaded by the user, the third editing track presents a video clip formed based on the video material. For ease of distinction, the video clip is referred to as the background video clip in FIG2 , and the video clip formed based on the target virtual object is referred to as the object video clip. On this basis, the second editing track can be used as a picture-in-picture track. Through the above interface, editing the text clip, the object video clip, and the background video clip can give the impression that the virtual object is reading the text in the scene corresponding to the background video. It should be noted that FIG2 is only an exemplary illustration. In actual applications, the video editing interface may contain more or fewer areas than the video editing interface in FIG2 , and the area layout may also be different, which is not limited here. In actual applications, the second editing track corresponding to the target virtual object can be used as a picture-in-picture track, and various editing operations can be performed on the target virtual object based on the picture-in-picture function, including but not limited to splitting, speed change, volume, mixing mode, animation, deletion, replacement, editing, basic properties, hierarchy, keyframes, cutting to the main track, copying, filters, adjustment, beauty and body, mask, audio separation, opacity, reverse playback, freeze frame, voice change and other operations, which greatly enriches the user's editing diversity for virtual objects.

[0043] In summary, the above-mentioned technical solution provided by the embodiment of the present disclosure provides users with an easy-to-operate video editing interface (a target video editing interface including an editing track area and a video preview area, and the editing track area includes multiple editing tracks, including at least a first editing track corresponding to the text material and a second editing track corresponding to the virtual object material). Users can flexibly and conveniently use the tracks in the editing track area to edit the required virtual objects and texts, introduce the virtual objects used for reading text as materials into the video editing, and can intuitively present the effect of the virtual objects reading text through the video preview area. It also helps users to clearly understand the editing effects and make flexible adjustments before the final video is generated, which greatly reduces the threshold for users to use virtual objects for creation, and helps more users to flexibly and conveniently use virtual objects for video creation, enriching the form of video creation.

[0044] The present disclosure provides two implementation methods for obtaining the target text. The target text can be obtained by referring to the following method 1 or method 2:

[0045] Method 1: In response to receiving the user-uploaded text, the user-uploaded text is used as the target text.

[0046] For example, the text uploaded by the user can be obtained through the text input control, and the user-uploaded text can be directly used as the target text read aloud by the target virtual object required by the user. This method can effectively ensure that the text content read aloud by the target virtual object fully meets the user's needs.

[0047] Method 2: In response to receiving user uploaded information, generating a recommended text based on the user uploaded information, and using the recommended text as the target text.

[0048] For example, the information uploaded by the user can be obtained through the information upload control. The user uploaded information includes but is not limited to text, voice, image, video, etc., wherein the user uploaded information in text and voice form can be expressed only in key words and sentences. Based on the user uploaded information, the embodiment of the present disclosure can use artificial intelligence models such as language models to automatically generate recommended text that matches the user uploaded information. For example, if the user uploaded information is a picture of a water cup, the recommended text can be the advertising slogan corresponding to the water cup in the water cup picture; for example, if the user uploaded information is a keyword of a certain scenery, the recommended text can be a detailed description of the scenery; for example, if the user uploaded information is a certain knowledge point, the recommended text can be a detailed introduction to the knowledge point. Through the above method, the user's time and energy can be better saved, and the user can be provided with text that meets the needs. In actual applications, a text modification control can also be provided for the user to modify the recommended text.

[0049] Furthermore, the embodiment of the present disclosure provides an implementation method for obtaining a target virtual object, which can be performed with reference to the following steps (1) and (2):

[0050] Step (1): in response to a virtual object triggering operation, display a plurality of candidate virtual objects; different candidate virtual objects have different images and / or actions.

[0051] In actual applications, an object selection control can be set. If the object selection control is triggered, it is determined that a virtual object triggering operation is detected. At this time, a variety of candidate virtual objects can be displayed on the interface. The candidate virtual objects are generated based on a preset object generation algorithm. Different candidate virtual objects correspond to the same or different object generation algorithms. Even if the same object generation algorithm is used, the parameters corresponding to different candidate virtual objects may be different, so the resulting images or actions will also be different.

[0052] Step (2): In response to a selection operation on multiple candidate virtual objects, the candidate virtual object corresponding to the selection operation is used as a target virtual object.

[0053] The user can select one or more virtual objects from a variety of candidate virtual objects as target virtual objects according to needs, thereby applying the target virtual objects to video editing.

[0054] In order to effectively ensure the user's video editing experience, the embodiment of the present disclosure further provides an implementation example of presenting the video editing effect through the video preview area, which can be performed with reference to the following steps A and B:

[0055] Step A: Display a static image corresponding to the target virtual object in the video preview area while the target virtual object is not rendered. Display a dynamic image corresponding to the target virtual object in the video preview area after the target virtual object is rendered.

[0056] Taking into account that the rendering time of virtual objects is usually long, in order to avoid users waiting, the static picture corresponding to the target virtual object can be presented to the user first, and the rendering can be completed quickly during the display of the static picture. When the target virtual object is rendered, the static picture is replaced with the dynamic picture corresponding to the target virtual object. Exemplarily, the static picture of the target virtual object is a pre-set picture, or the static picture of the target virtual object is the first frame rendering picture of the target virtual object; the dynamic picture of the target virtual object is the rendering picture of the preset action sequence corresponding to the target virtual object. The preset action sequence can be automatically generated based on the object generation algorithm corresponding to the target virtual object, or it can be manually set and input into the object generation algorithm, which is not limited here. In the above manner, users do not need to wait or export videos, and can watch the editing effects of virtual objects in time during video editing, which better guarantees the user experience.

[0057] Step B, converting the target text into target audio, and playing the target audio during the screen display of the target virtual object, so as to present the picture and sound of the target virtual object reading the target text through the video preview area, and the screen displays subtitles determined based on the text segment.

[0058] In actual applications, TTS (Text To Speech) technology can be used to quickly convert the target text into the target audio, and play it synchronously with the image of the target virtual object, thereby creating the effect of the target virtual object reading the target text. It should be noted that steps A and B do not limit the order in which they are performed. In actual applications, steps A and B can be performed simultaneously.

[0059] For easier understanding, see Figure 3, a schematic diagram of a video preview area. This example illustrates a digital human as the virtual object and an image as the target material. The interface also shows the text being read aloud by the digital human in real time. Before the digital human is rendered, a static image corresponding to the digital human can be used. This static image is superimposed on the background image, presenting the user with a static digital human effect. However, the presentation duration of a static digital human is typically short. Once the digital human is rendered, a dynamic image corresponding to the digital human is used. This dynamic image is superimposed on the background image, presenting the user with a dynamic digital human effect. All of this is accompanied by audio converted from the target text, creating a video playback effect of the digital human explaining the product in real time.

[0060] To facilitate quick editing, the disclosed embodiments can provide users with editing templates. The editing templates can divide video editing into multiple submodules. Specifically, the video editing task can be divided into multiple subtasks. Different subtasks correspond to different video editing interfaces. Users can conveniently edit videos for each subtask, thereby combining the video editing results corresponding to each subtask to obtain the final desired video. Based on this, the method provided by the disclosed embodiments also includes: obtaining an editing template for the video editing task; and based on the editing template, determining and displaying the multiple subtasks included in the video editing task.

[0061] A video editing task may be a video editing task initiated by a user, such as an advertising editing task. The disclosed embodiment may provide a variety of editing templates in advance, and different editing templates may be used to perform different video editing tasks. The editing template may indicate the specific method of subdividing the video editing task into subtasks, and provide corresponding editing components. For example, the subtasks may be off-screen audio and video editing subtasks, spoken video editing subtasks, video display subtasks, and the like. Among them, the main commentary content in the off-screen audio and video editing subtask comes from the narration audio, and the video screen may jump according to the sound content. The spoken video editing subtask requires a virtual object or a real person to read the text aloud, and may further add pictures or video materials to the background. The video display subtask may only display the video without narration or virtual object / real person commentary. The above are all examples, and the disclosed embodiment does not limit the type of subtask. In the above manner, the video editing task is disassembled according to needs, and each subtask is quickly edited. The video editing interfaces corresponding to different subtasks are different, and the editing components provided may also be different. Based on this, in some embodiments of displaying the target video editing interface, the target video editing interface can be displayed in response to the selection operation of the target subtask in the preset video editing task. Exemplarily, the target subtask can be the aforementioned spoken video editing subtask. That is, when the spoken video editing subtask is triggered, the target video editing interface containing the first editing track corresponding to the text material and the second editing track corresponding to the virtual object material is displayed to the user for the user to edit through the interface, thereby achieving the spoken effect of the virtual object reading the text.

[0062] To sum up, the video editing method provided by the embodiment of the present disclosure provides users with an easy-to-operate video editing interface. Users can flexibly and conveniently edit the required virtual objects and texts, introduce virtual objects used to read text as materials into video editing, and can intuitively present the effect of virtual objects reading text through the video preview area. It also helps users to clearly understand the editing effects and make flexible adjustments before the final video is generated, which greatly reduces the threshold for users to use virtual objects for creation, and also helps more users to flexibly and conveniently use virtual objects for video creation, enriching the form of video creation.

[0063] Corresponding to the aforementioned video editing method, an embodiment of the present disclosure further provides a video editing device. FIG4 is a schematic structural diagram of a video editing device provided by an embodiment of the present disclosure. The device can be implemented by software and / or hardware and can generally be integrated into an electronic device. As shown in FIG4 , the video editing device includes:

[0064] The editing interface display module 402 is used to display the target video editing interface; wherein the target video editing interface includes an editing area and a video preview area;

[0065] A segment presentation module 404 is configured to obtain a target text and a target virtual object, and present a text segment formed based on the target text and a video segment formed based on the target virtual object in an editing area; wherein the text segment and the video segment have aligned timeline positions;

[0066] The video editing module 406 performs video editing based on the text segment and the video segment, and presents the video editing effect through the video preview area; wherein, the video editing effect is at least used to present the picture and sound of the target virtual object reading the target text, and the picture displays subtitles determined based on the text segment.

[0067] The above-mentioned device provided by the embodiment of the present disclosure provides users with an easy-to-operate video editing interface (including a target video editing interface with an editing area and a video preview area, and the editing area can present text segments formed based on the target text and video segments formed based on the target virtual object). Users can flexibly and conveniently edit the required virtual objects and texts, introduce virtual objects used for reading text as materials into video editing, and can intuitively present the effect of the virtual object reading text through the video preview area. It also helps users to clearly understand the editing effect and make flexible adjustments before the final video is generated, which greatly reduces the threshold for users to use virtual objects for creation, and helps more users to flexibly and conveniently use virtual objects for video creation, enriching the form of video creation.

[0068] In some embodiments, the editing area includes multiple editing tracks, and the multiple editing tracks include at least a first editing track corresponding to the text material and a second editing track corresponding to the virtual object material; wherein the text segment is presented through the first editing track and the video segment is presented through the second editing track.

[0069] In some embodiments, the multiple editing tracks also include a third editing track corresponding to at least one target type material; the target type material is different from the text material and the virtual object material; the track segment formed based on the target type material is presented through the third editing track; the video editing module 406 is specifically used to: perform video editing based on the text segment, the video segment and the track segment corresponding to the target type material.

[0070] In some implementations, the video editing module 406 is specifically configured to: upon acquiring editing operation information corresponding to the editing area, perform video editing based on the editing operation information, the object segment, and the video segment.

[0071] In some embodiments, the fragment presentation module 404 is specifically used to: in response to receiving user uploaded text, use the user uploaded text as the target text; or, in response to receiving user uploaded information, generate recommended text based on the user uploaded information, and use the recommended text as the target text.

[0072] In some embodiments, the fragment presentation module 404 is specifically used to: display multiple candidate virtual objects in response to a virtual object triggering operation; different candidate virtual objects have different images and / or actions; and in response to a selection operation for the multiple candidate virtual objects, use the virtual object corresponding to the selection operation as the target virtual object.

[0073] In some embodiments, the candidate virtual objects are generated based on a preset object generation algorithm, and different candidate virtual objects may correspond to the same or different object generation algorithms.

[0074] In some embodiments, the video editing module 406 is specifically used to: display a static image corresponding to the target virtual object in the video preview area while the target virtual object is not rendered, and display a dynamic image corresponding to the target virtual object in the video preview area after the rendering of the target virtual object is completed; convert the target text into target audio, and play the target audio during the display of the target virtual object image, so as to present the image and sound of the target virtual object reading the target text through the video preview area.

[0075] In some embodiments, the static image of the target virtual object is a pre-set image, or the static image of the target virtual object is the first frame rendering image of the target virtual object; the dynamic image of the target virtual object is the rendering image of the preset action sequence corresponding to the target virtual object.

[0076] In some embodiments, the editing interface display module 402 is specifically used to: display the target video editing interface in response to the selection operation of the target subtask in the preset video editing task; wherein, the video editing task includes multiple subtasks, and different subtasks correspond to different video editing interfaces.

[0077] In some embodiments, the apparatus further includes a subtask determining module configured to obtain an editing template used by the video editing task; and based on the editing template, determine and display a plurality of subtasks included in the video editing task.

[0078] The video editing device provided by the embodiments of the present disclosure can execute the video editing method provided by any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

[0079] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described device embodiment can refer to the corresponding process in the method embodiment, and will not be repeated here.

[0080] An embodiment of the present disclosure provides an electronic device, which includes: a storage device storing a computer program; and a processing device configured to execute the computer program in the storage device to implement the steps of any one of the methods in the present disclosure.

[0081] Reference is now made to FIG5 , which illustrates a schematic diagram of the structure of an electronic device 500 suitable for implementing embodiments of the present disclosure. Terminal devices in embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. The electronic device illustrated in FIG5 is merely an example and should not limit the functionality or scope of use of embodiments of the present disclosure.

[0082] As shown in Figure 5, the electronic device 500 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. Various programs and data required for the operation of the electronic device 500 are also stored in the RAM 503. The processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0083] Typically, the following devices may be connected to the I / O interface 505: an input device 506 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509. The communication device 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. Although FIG5 shows the electronic device 500 with various devices, it should be understood that not all of the devices shown are required to be implemented or present. More or fewer devices may alternatively be implemented or present.

[0084] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 509, or installed from the storage device 508, or installed from the ROM 502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0085] In addition to the above-mentioned methods and devices, the embodiments of the present disclosure may also be a computer program product, which includes computer program instructions, which, when executed by a processor, cause the processor to perform the image processing method provided by the embodiments of the present disclosure. The computer program product may be written in any combination of one or more programming languages ​​to write program codes for performing the operations of the embodiments of the present disclosure, the programming languages ​​including object-oriented programming languages ​​such as Java, C++, etc., and also conventional procedural programming languages ​​such as "C" language or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0086] In addition, the embodiment of the present disclosure may also be a computer-readable storage medium having computer program instructions stored thereon. When the computer program instructions are executed by a processor, the processor executes the video editing method provided by the embodiment of the present disclosure.

[0087] The computer-readable storage medium can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can, for example, include but is not limited to a system, device or component of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination thereof. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0088] The embodiments of the present disclosure further provide a computer program product, including a computer program / instruction, which implements the video editing method in the embodiments of the present disclosure when executed by a processor.

[0089] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0090] For example, in response to a user's active request, a prompt message is sent to the user to clearly inform the user that the operation requested will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the electronic device, application, server, storage medium, or other software or hardware that performs the operations of the disclosed technical solution based on the prompt message.

[0091] As an optional but non-limiting implementation, in response to receiving a user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. Furthermore, the pop-up window may also contain a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0092] It is understandable that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0093] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

[0094] The foregoing description is intended only to provide specific embodiments of the present disclosure, intended to enable those skilled in the art to understand and implement the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the embodiments described herein, but rather to be construed in the broadest manner consistent with the principles and novel features disclosed herein.

Claims

1. A video editing method, comprising: Displaying a target video editing interface; wherein the target video editing interface includes an editing area and a video preview area; Acquire a target text and a target virtual object, and present a text segment formed based on the target text and a video segment formed based on the target virtual object in the editing area; wherein the text segment and the video segment have aligned timeline positions; Video editing is performed based on the text segment and the video segment, and the video editing effect is presented through the video preview area; wherein the video editing effect is at least used to present the picture and sound of the target virtual object reading the target text, and the picture displays subtitles determined based on the text segment.

2. The method according to claim 1, wherein: The editing area includes multiple editing tracks, and the multiple editing tracks include at least a first editing track corresponding to the text material and a second editing track corresponding to the virtual object material; wherein the text segment is presented through the first editing track, and the video segment is presented through the second editing track.

3. The method according to claim 2, wherein: The multiple editing tracks further include a third editing track corresponding to at least one target type material; the target type material is different from the text material and the virtual object material; The track fragment formed based on the target type material is presented through the third editing track; The performing video editing based on the text segment and the video segment includes: performing video editing based on the text segment, the video segment and the track segment corresponding to the target type material.

4. The method according to claim 1, wherein: The video editing based on the text segment and the video segment includes: When the editing operation information corresponding to the editing area is acquired, video editing is performed based on the editing operation information, the object segment, and the video segment.

5. The method according to claim 1, wherein: The obtaining of the target text comprises: In response to receiving the user uploaded text, taking the user uploaded text as the target text; or, In response to receiving the user uploaded information, a recommended text is generated based on the user uploaded information, and the recommended text is used as the target text.

6. The method according to claim 1, wherein: The step of acquiring the target virtual object comprises: In response to a virtual object triggering operation, a plurality of candidate virtual objects are displayed; different candidate virtual objects have different images and / or actions; In response to a selection operation on the multiple candidate virtual objects, the candidate virtual object corresponding to the selection operation is used as a target virtual object.

7. The method according to claim 6, wherein: The candidate virtual objects are generated based on a preset object generation algorithm, and different candidate virtual objects correspond to the same or different object generation algorithms.

8. The method according to claim 1, wherein: The presenting the video editing effect through the video preview area includes: During the period when the target virtual object is not rendered, a static picture corresponding to the target virtual object is displayed in the video preview area, and until the rendering of the target virtual object is completed, a dynamic picture corresponding to the target virtual object is displayed in the video preview area; The target text is converted into a target audio, and the target audio is played during the screen display of the target virtual object, so as to present the screen and sound of the target virtual object reading the target text through the video preview area.

9. The method according to claim 8, wherein: The static picture of the target virtual object is a preset picture, or the static picture of the target virtual object is a first frame rendering picture of the target virtual object; The dynamic picture of the target virtual object is a rendering picture of a preset action sequence corresponding to the target virtual object.

10. The method according to claim 1, wherein: The target video editing interface includes: In response to a selection operation of a target subtask in a preset video editing task, a target video editing interface is displayed; wherein the video editing task includes a plurality of subtasks, and different subtasks correspond to different video editing interfaces.

11. The method according to claim 10, wherein: The method further comprises: Obtaining an editing template used by the video editing task; Based on the editing template, multiple subtasks included in the video editing task are determined and displayed.

12. A video editing device, comprising: An editing interface display module, used to display a target video editing interface; wherein the target video editing interface includes an editing area and a video preview area; A segment presentation module, used to obtain a target text and a target virtual object, and present a text segment formed based on the target text and a video segment formed based on the target virtual object in the editing area; wherein the text segment and the video segment have aligned timeline positions; A video editing module is used to perform video editing based on the text segment and the video segment, and present the video editing effect through the video preview area; wherein the video editing effect is at least used to present The target virtual object reads aloud the image and sound of the target text, and the image is displayed with subtitles determined based on the text segment.

13. An electronic device comprising: a storage device having a computer program stored thereon; A processing device, used to execute the computer program in the storage device to implement the steps of the video editing method according to any one of claims 1-11.

14. A computer-readable storage medium storing a computer program, wherein the computer program is used to execute the video editing method according to any one of claims 1 to 11.

15. A computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the computer program implements the video editing method according to any one of claims 1 to 11.

Images