Video editing method and apparatus, electronic device, and storage medium

By generating and editing text materials related to video materials, the problem of low text editing in video editing is solved, and fast and efficient text editing is achieved.

WO2025045117A1PCT designated stage expired Publication Date: 2025-03-06BEIJING ZITIAO NETWORK TECH CO LTD

Patent Information

Application Number
PCT/CN2024/115301
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-08-28
Filing Date
2024-08-28
Publication Date
2025-03-06

AI Technical Summary

Technical Problem

During the video editing process, the lack of good text editing ability will lead to the text material not meeting the requirements and need to be re-edited, resulting in low text editing efficiency of the video.

Method used

By determining the target video material, generating the target text material based on relevant information, and editing and processing under the video generation instructions, the fast text editing input of the video is realized.

Benefits of technology

It improves text editing efficiency and text adsorption, so that even if you do not have rich text writing capabilities, you can quickly edit suitable text materials.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024115301_06032025_PF_FP_ABST
    Figure CN2024115301_06032025_PF_FP_ABST
Patent Text Reader

Abstract

Embodiments of the present disclosure provide a video editing method and apparatus, an electronic device, and a storage medium. The method comprises: determining a target video material specified in a target editing task; on the basis of related information of the target video material, generating a target text material corresponding to the target video material in the target editing task, wherein an editing operation indicated by the target editing task is at least used for presenting the target text material on an image of the target video material; and in response to a video generation instruction, on the basis of the editing operation indicated by the target editing task, editing materials in the target editing task to obtain a target video. According to the present solution, editing and inputting of a text material of a target video can be rapidly carried out by means of text rewriting assistance, and the video editing efficiency is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Video editing method, device, electronic device and storage medium

[0001] This application claims priority to the Chinese invention patent application with application number 202311094468.7 filed on August 28, 2023 and titled “Video Editing Method, Device, Electronic Device and Storage Medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present disclosure relate to the field of video processing technology, and in particular to a video editing method, device, electronic device, and storage medium. Background Art

[0003] With the development of video technology, video has become an important medium for communication in daily life. Video editing involves text editing, which requires adding text to the video to create a copy that matches the video. However, when actually editing text for a video, only those with strong text editing skills can produce good text and create a good copy. Without strong text editing skills, the edited text will not meet the requirements and will need to be re-edited, resulting in low efficiency in video text editing.

[0004] Summary of the Invention

[0005] The present disclosure provides a video editing method, device, electronic device and storage medium to enable quick editing of a target video by inputting appropriate text materials, thereby improving text editing efficiency and text adsorption.

[0006] In a first aspect, an embodiment of the present disclosure provides a video editing method, the method comprising: determining a target video material specified in a target editing task; generating a target text material corresponding to the target video material in the target editing task based on relevant information of the target video material; wherein the editing operation indicated by the target editing task is at least used to present the target text material on an image of the target video material; in response to a video generation instruction, editing the material in the target editing task based on the editing operation indicated by the target editing task to obtain a target video.

[0007] In the second aspect, the embodiments of the present disclosure also provide a video editing device, which includes: a determination module for determining the target video material specified in the target editing task; a text generation module for generating a target text material corresponding to the target video material in the target editing task based on relevant information of the target video material; wherein the editing operation indicated by the target editing task is at least used to present the target text material on the image of the target video material; a video generation module for responding to a video generation instruction and editing the material in the target editing task based on the editing operation indicated by the target editing task to obtain a target video.

[0008] In a third aspect, an embodiment of the present disclosure further provides an electronic device, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the video editing method as described in any of the above embodiments.

[0009] In a fourth aspect, an embodiment of the present disclosure further provides a storage medium comprising computer-executable instructions, which, when executed by a computer processor, are used to execute the video editing method as described in any of the above embodiments.

[0010] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The above and other features, advantages, and aspects of the various embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that the originals and elements are not necessarily drawn to scale.

[0012] FIG1 is a flow chart of a video editing method provided by an embodiment of the present disclosure;

[0013] FIG2 is a flow chart of another video editing method provided by an embodiment of the present disclosure;

[0014] FIG3 is a schematic diagram of an implementation flow of generating candidate text materials corresponding to a target video material in a target editing task based on relevant information of the target video material, provided by an embodiment of the present disclosure;

[0015] FIG4a is a schematic diagram of an interface flow triggered by text rewriting applicable to an embodiment of the present disclosure;

[0016] FIG4 b is a schematic diagram of an interface flow for triggering text editing applicable to an embodiment of the present disclosure;

[0017] FIG4c is a schematic diagram of another interface flow for triggering text editing applicable to an embodiment of the present disclosure;

[0018] FIG5 is a schematic diagram of an interface flow for displaying text material after a text rewrite is triggered, applicable to an embodiment of the present disclosure;

[0019] FIG6 is a schematic diagram of an interface flow after selecting a text material triggered by a text rewriting according to an embodiment of the present disclosure;

[0020] FIG7 is a schematic diagram of an interface for secondary editing of text material in a text preview area applicable to an embodiment of the present disclosure;

[0021] FIG8 is a schematic diagram of an interface flow for restoring text material in a text preview area applicable to an embodiment of the present disclosure;

[0022] FIG9 is a schematic diagram of an interface flow for rewriting text to generate text material after switching text styles, applicable to an embodiment of the present disclosure;

[0023] FIG10 is a schematic diagram of an interface flow for loading more text materials applicable to an embodiment of the present disclosure;

[0024] FIG11 is a schematic structural diagram of a video editing device provided by an embodiment of the present disclosure;

[0025] FIG12 is a schematic structural diagram of an electronic device for implementing a video editing method provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0026] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0027] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0028] As used herein, the term "including" and its variations are open-ended, i.e., "including but not limited to." The term "based on" means "based, at least in part, on." The term "one embodiment" means "at least one embodiment," the term "another embodiment" means "at least one additional embodiment," and the term "some embodiments" means "at least some embodiments." Other terms are defined in the following description.

[0029] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0030] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, they should be understood as "one or more".

[0031] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0032] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0033] For example, in response to a user's active request, a prompt message is sent to the user to clearly inform the user that the operation requested will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the electronic device, application, server, storage medium, or other software or hardware that performs the operations of the disclosed technical solution based on the prompt message.

[0034] As an optional but non-limiting implementation, in response to receiving a user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. Furthermore, the pop-up window may also contain a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0035] It is understandable that the above notification and user authorization process are merely illustrative and do not limit the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0036] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) must comply with the requirements of relevant laws, regulations and relevant provisions.

[0037] Figure 1 is a flow chart illustrating a video editing method provided by an embodiment of the present disclosure. This embodiment of the present disclosure is applicable to video editing by adding text to a target video. This method can be performed by a video editing device, which can be implemented in software and / or hardware and generally integrated into any electronic device with network communication capabilities. This electronic device can be a mobile terminal, a PC, or a server.

[0038] As shown in FIG. 1 , the video editing method according to the embodiment of the present disclosure may include the following processes S101 , S102 , and S103 .

[0039] S101. Determine the target video material specified in the target editing task.

[0040] S102. Generate a target text material corresponding to the target video material in a target editing task based on relevant information of the target video material; wherein the editing operation indicated by the target editing task is at least used to present the target text material on the image of the target video material.

[0041] The target editing task specifies the text material to be edited into the target video material. This generates a target video with text effects using the target video material and the provided text material. After obtaining the target video material, the target material can be used to assist in text rewriting. This automated text rewriting generates the target text material that matches the target video material in the target editing task.

[0042] Optionally, the editing operation indicated by the target editing task may include a triggering operation for confirming the use of the target text material in the target editing task and presenting the target text material on the image of the target video material. For example, after generating the target text material corresponding to the target video material in the target editing task, in response to the triggering operation of selecting the generated target text material, the target text material is placed on the image of the target video material for presentation.

[0043] S103 . In response to the video generation instruction, the material in the target editing task is edited based on the editing operation indicated by the target editing task to obtain a target video.

[0044] The target video material in the target editing task is added to the video track segment used to implement the target editing task, and the target text material to be presented on the image of the target video material is added to the text track segment used to implement the target editing task. The track segments of the text track segment containing the target text material and the video track segment containing the target video material are time-aligned, and the target video is generated based on the materials recorded in the time-aligned text track segment and video track segment.

[0045] The technical solution of the disclosed embodiment, when executing the target editing task of the target video material, intelligently generates the target text material corresponding to the target video material in the target editing task based on the relevant information of the target video material, and the editing operation indicated by the target editing task is at least used to present the target text material on the image of the video material. When the video generation instruction is triggered, the material in the target editing task can be edited based on the editing operation indicated by the target editing task to obtain the target video. This solution can ensure that text materials can be quickly edited for video materials even if rich text writing capabilities are not available. At the same time, it can adapt to different editing requirements and provide different text materials respectively, thereby improving the editing efficiency of the target editing task of the target video material.

[0046] Figure 2 is a flow chart of another video editing method provided by an embodiment of the present disclosure. The technical solution of this embodiment further optimizes the process of generating target text materials corresponding to the target video materials in the target editing task based on the relevant information of the target video materials in the above embodiment. This embodiment can be combined with various optional solutions in one or more of the above embodiments.

[0047] As shown in FIG. 2 , the video editing method according to the embodiment of the present disclosure may include the following processes S201 , S202 , S203 , and S204 .

[0048] S201: Determine the target video material specified in the target editing task.

[0049] S202: Generate candidate text materials corresponding to the target video material in the target editing task based on the relevant information of the target video material. The candidate text materials are text materials generated by text rewriting with the assistance of the relevant information of the target video material.

[0050] Optionally, the relevant information of the target video material can be a video frame image in the target video material or an audio material corresponding to the target video material, or it can be an initial text material imported after selecting a text template based on the target video material, or a text material adjusted and modified based on the imported initial text material, or it can also be a text material, image material or audio material edited, input or adjusted and modified in the input area corresponding to the target editing task based on the target video material.

[0051] As an optional but non-limiting implementation method, generating candidate text materials corresponding to the target video material in the target editing task based on relevant information of the target video material includes the following steps A1-A2.

[0052] Step A1: Identify reference text material corresponding to the target video material from relevant information of the target video material. The relevant information of the target video material is a video frame image in the target video material or an audio material corresponding to the target video material.

[0053] When the relevant information of the target video material only includes the video frame image in the target video material or the audio material corresponding to the target video material, the reference text material corresponding to the target video material in the target editing task is obtained by identifying and analyzing the picture content included in the still frame picture of the target video material or the audio content of the audio material corresponding to the target video material.

[0054] Optionally, a text recognition model can be used to identify the image content included in one or more still frames of the target video material or the audio content of the audio material corresponding to the target video material, and the obtained text material can be used as the reference text material corresponding to the target video material in the target editing task to participate in text rewriting. In some embodiments, the text recognition model is used to extract the core content of the image from the image and generate text material that matches the image content; or to extract the core content of the image from the audio content of the audio material corresponding to the target video material and generate text material that matches the image content.

[0055] Step A2: rewrite the reference text material corresponding to the target video material to generate candidate text materials corresponding to the target video material in the target editing task.

[0056] As another optional but non-limiting implementation, generating candidate text materials corresponding to the target video material in the target editing task based on relevant information of the target video material includes the following steps B1-B2.

[0057] Step B1: Identify a reference text material corresponding to the target video material from the relevant information of the target video material. The relevant information of the target video material may be an initial text material imported after selecting a text template based on the target video material, or a text material adjusted and modified based on the imported initial text material. Alternatively, the relevant information of the target video material may be a text material, image material, or audio material edited, input, or adjusted and modified in an input area corresponding to a target editing task based on the target video material.

[0058] Step B2: rewrite the reference text material corresponding to the target video material to generate candidate text materials corresponding to the target video material in the target editing task.

[0059] In the case where the relevant information of the target video material also includes the initial text material imported after selecting a text template based on the target video material, or the text material adjusted and modified based on the imported initial text material, or the relevant information of the target video material is the text material, image material, or audio material edited, input, or adjusted and modified based on the input area corresponding to the target editing task based on the target video material, the recorded text material can be directly read from the relevant information of the target video material. The read text material is used as the reference text material corresponding to the target editing task, without the need to identify the video frame image in the target video material or the audio material corresponding to the target video material to obtain the text material.

[0060] As an optional but non-limiting implementation method, rewriting the reference text material corresponding to the target video material to generate a candidate text material corresponding to the target video material in the target editing task includes the following steps:

[0061] The text generator rewrites the reference text material corresponding to the target editing task to generate candidate text materials corresponding to the target video material in the target editing task. The text generator is pre-configured based on a natural language processing model or a machine learning model.

[0062] Optionally, the reference text material corresponding to the target editing task is rewritten by the text generator, including: sending a text rewriting request to the text generator to rewrite the reference text material corresponding to the target video material in the target editing task, so that the text generator returns a plurality of candidate text materials obtained by rewriting the reference text material based on the text rewriting request. In some embodiments, the text generator is used to rewrite the reference text material to obtain a plurality of candidate text materials by changing the sentence order of the reference text material or replacing it with other synonymous words, etc., while ensuring semantic consistency, so that the text material is more fluent and has more diverse expressions.

[0063] S203. Generate a target text material corresponding to the target video material in the target editing task based on the candidate text material; wherein the editing operation indicated by the target editing task is at least used to present the target text material on the image of the target video material.

[0064] After the text rewriting process in the target editing task is completed, the generated multiple candidate text materials can be displayed and presented, and each of the presented candidate text materials can be triggered to be selected. In response to the triggering operation of selecting multiple candidate text materials, the selected candidate text material will be used as the target text material corresponding to the target video material in the target editing task. Then, according to the editing operation indicated by the target editing task, the target text material can be presented on the image of the target video material, so as to achieve the display effect presentation of the text material and the target video material.

[0065] S204 . In response to the video generation instruction, edit the material in the target editing task based on the editing operation indicated by the target editing task to obtain a target video.

[0066] The technical solution of the embodiment of the present disclosure is that when executing the target editing task of the target video material, the text auxiliary editing function will be started to rewrite the text, and the operation of intelligently generating candidate text materials corresponding to the target video material in the target editing task based on the relevant information of the target video material and displaying the generated candidate text materials will be performed. In this way, according to the selection operation of the target text material in the presented candidate text materials, the selected target text material can be presented on the image of the target video material to complete the target editing task. The text rewriting can assist in the rapid editing and input of the text material of the target video, and at the same time, multiple candidate text materials are displayed to facilitate the selection of appropriate text materials to perform the target editing task. Even if you do not have rich text writing skills, you can ensure that the text material can be edited quickly while adapting to different editing requirements and providing different text materials, thereby improving the editing efficiency of the target editing task.

[0067] FIG3 is a schematic diagram of an implementation process of generating candidate text materials corresponding to a target video material in a target editing task based on relevant information of the target video material, provided by an embodiment of the present disclosure. This embodiment can be combined with various optional solutions in one or more of the above embodiments.

[0068] As shown in FIG3 , the implementation process of generating candidate text materials corresponding to the target video material in the target editing task based on the relevant information of the target video material in this embodiment may further include the following processes S301 and S302 .

[0069] S301: Display a first editing interface corresponding to a target editing task, where the first editing interface includes a text auxiliary editing control and a first text preview area.

[0070] 4a , a first editing interface corresponding to a target editing task displays a text auxiliary editing control 210, a first text preview area 220, and an input area 230. In some embodiments, when the text auxiliary editing control 210 is triggered, it is used to initiate text rewriting. The first text preview area 220 is used to display text materials generated by the text rewriting. The input area 230 has the function of editing and inputting text materials, image materials, or audio materials, allowing the reception of text materials, image materials, or audio materials input through the input keyboard to form the text materials displayed in the first text preview area 220.

[0071] S302: In response to triggering the text-assisted editing function on the first editing interface, a second editing interface corresponding to the target editing task is displayed. The second editing interface includes a second text preview area and a text generation result selection area. The text generation result selection area presents candidate text materials corresponding to the target video material in the target editing task. When the text-assisted editing function is triggered, the following operations are performed: candidate text materials corresponding to the target video material in the target editing task are generated based on relevant information about the target video material.

[0072] Referring to FIG. 4a , when executing a target editing task, a text material matching the target video material in the target editing task can be input through the input area on the first editing interface. However, when actually editing text materials, if one lacks good text editing skills, the edited text material is likely to fail to meet the requirements and require re-editing, resulting in low text editing efficiency for the video material.

[0073] To this end, referring to FIG4a , a text auxiliary editing control can be added to the first editing interface corresponding to the target editing task in advance, and the text auxiliary editing function can be activated by triggering the text auxiliary editing control to rewrite the text. In the process of triggering the text auxiliary editing function to rewrite the text, the second editing interface is displayed from the first editing interface, and the second editing interface is displayed with a second text preview area 240 and a text generation result selection area 250. By utilizing the text auxiliary editing function activated on the first editing interface, it is possible to rewrite the text based on the relevant information of the target video material to generate multiple candidate text materials corresponding to the target video material in the target editing task. Furthermore, the multiple candidate text materials generated by the text rewriting are sequentially displayed in the text generation result selection area 250 of the second editing interface.

[0074] In some embodiments, when the text-assisted editing function is activated for text rewriting, an icon named "AI Help Writing" will be displayed on the second editing interface to prompt that the text-assisted editing function has been activated for text rewriting. Of course, other names can also be used.

[0075] Optionally, referring to Figure 4a, when the relevant information of the target video material only includes the video frame image in the target video material or the audio material corresponding to the target video material, for example, when the input area on the first editing interface is empty and does not include text material, the reference text material corresponding to the target video material in the target editing task is obtained by identifying and analyzing the picture content included in the still frame of the target video material or the audio content of the audio material corresponding to the target video material.

[0076] Optionally, referring to Figure 4a, the relevant information of the target video material also includes the initial text material imported after the text template is selected based on the target video material, or the text material adjusted and modified based on the imported initial text material, or the relevant information of the target video material is the text material, image material or audio material edited, input or adjusted and modified based on the target video material in the input area corresponding to the target editing task, for example, when the input area on the first editing interface is not empty and includes text material, image material or audio material, the recorded text material is read directly from the relevant information of the target video material, and the read text material is used as the reference text material corresponding to the target editing task.

[0077] Using the above method, when executing the target video boundary task, a text auxiliary editing control that can assist in the input of text materials is provided by displaying the first editing interface. When the text auxiliary editing control on the first editing interface is triggered, the text auxiliary editing function is activated to perform text rewriting, and the target video material based on the target editing task is rewritten to generate candidate text materials, and then the second editing interface is displayed and the candidate text materials generated by the text rewriting are displayed in the text generation result selection area of ​​the second editing interface. In this way, according to the selection operation of the target text material among the candidate text materials presented in the text generation result selection area, the selected target text material is placed in the second text preview area on the second editing interface for display to complete the target editing task. Through text rewriting, the text material of the target video can be quickly edited and input, and multiple candidate text materials are displayed in the text generation result selection area, making it easy to select the appropriate text material to perform the target editing task. Even if you do not have rich text writing skills, you can ensure that the text material is quickly edited while adapting to different editing requirements and providing different text materials, thereby improving the editing efficiency of the target editing task.

[0078] As an optional but non-limiting implementation, displaying the first editing interface corresponding to the target editing task includes the following steps: in response to a triggering operation of a text addition control on a third editing interface corresponding to the target editing task, displaying the first editing interface corresponding to the target editing task. The first video preview area of ​​the first editing interface presents a video frame of the target video material, and the first text preview area of ​​the first editing interface presents preset prompt text. The preset prompt text prompts the input area of ​​the first editing interface to edit the target video material based on the input text material, image material, or audio material, or the preset prompt text includes the adjusted and modified text material, image material, or audio material.

[0079] Referring to Figure 4b, a third editing interface is created and displayed for the target editing task, and a text adding control is presented on the third editing interface. When the text adding control is triggered, the first editing interface corresponding to the target editing task will be displayed from the third editing interface. When the first editing interface is displayed, a preset prompt text will be synchronously displayed in the first text preview area of ​​the first editing interface. Optionally, the preset prompt text can be used to prompt that there is no text material in the first text preview area and that text material that matches the target video material needs to be input according to the screen content in the target video material corresponding to the target editing task; or, the preset prompt text is the adjusted and modified text material, image material or audio material. Referring to Figure 4b, the text adding control of the third editing interface corresponding to the target editing task is provided with an icon for prompting whether the text auxiliary editing function can be started for text rewriting. When rewriting text in a preset language type, the icon to be presented at the text adding control of the third editing interface corresponding to the target editing task, which is used to prompt whether the text assisted editing function is enabled for text rewriting, is in a visible state; when rewriting text in a preset language type is not performed, the icon to be presented at the text adding control of the third editing interface corresponding to the target editing task, which is used to prompt whether the text assisted editing function is enabled for text rewriting, is in a hidden and invisible state.

[0080] Referring to Figure 4b, optionally, when the text adding control on the third editing interface corresponding to the target editing task is clicked for the first time, a text rewriting introduction pop-up window for prompting the text auxiliary editing function to rewrite the text is presented on the third editing interface corresponding to the target editing task. The text rewriting introduction pop-up window may include a video animation for introducing the text auxiliary editing function to rewrite the text, the function name, the highlight introduction, and a button for confirming the trial. After clicking the button for confirming the trial in the text rewriting introduction pop-up window, a text rewriting authorization pop-up window is displayed on the third editing interface corresponding to the target editing task, requiring authorization for text rewriting to obtain video materials and text materials. Click Confirm to proceed to the next step, and click Reject to close the pop-up window.

[0081] As an optional but non-limiting implementation, displaying the first editing interface corresponding to the target editing task includes the following steps: in response to a triggering operation on a text editing control on a third editing interface corresponding to the target editing task, displaying the first editing interface corresponding to the target editing task. The third text preview area of ​​the third editing interface is displayed above the third video preview area of ​​the third editing interface. The first text preview area of ​​the first editing interface presents the initial text material imported after selecting a text template based on the target video material, or the text material adjusted and modified based on the imported initial text material, or the text material, image material, or audio material edited, entered, adjusted, or modified in the input area based on the target video material.

[0082] Referring to Figure 4c, a third text preview area is displayed on the third editing interface corresponding to the target editing task. The third text preview area is configured with a text deletion control, a text editing control, and a text rotation control. The text deletion control is used to delete the text material presented in the third text preview area when triggered. The text rotation control is used to rotate the third text preview area on the third editing interface when triggered. The text editing control is used to launch the first editing interface corresponding to the target editing task when triggered, so that text rewriting can be initiated in the first editing interface.

[0083] Referring to Figure 4c, the third text preview area of ​​the third editing interface is placed above the third video preview area of ​​the third editing interface for display. In one example, on the third editing interface, after selecting a suitable text template according to the target video material corresponding to the target editing task, the text material recorded in the selected text template is imported into the third text preview area; or, the third video preview area of ​​the third editing interface displays the text material that has been edited, inputted, or modified in the third text preview area according to the target video material corresponding to the target editing task. When the text editing operation is triggered to jump from the third editing interface to display the first editing interface, the text material in the third text preview area can be placed in the first text preview area 220 of the first editing interface for display, so that when the text auxiliary editing control 210 is triggered, the text auxiliary editing function is activated to rewrite the text material recorded in the first text preview area 220.

[0084] As an optional but non-limiting implementation, displaying the second editing interface corresponding to the target editing task includes the following steps C1-C2.

[0085] Step C1: Identify reference text materials corresponding to the target editing task from the materials recorded in the first editing interface, and rewrite the reference text materials corresponding to the target video material to generate candidate text materials corresponding to the target editing task. The materials recorded in the first editing interface are relevant information about the target video material corresponding to the target editing task.

[0086] Step C2: Display the second editing interface corresponding to the target editing task, and place the candidate text material corresponding to the target editing task in the text generation result selection area of ​​the second editing interface for display. The second editing interface includes a second text preview area and a text generation result selection area. The text generation result selection area is used to present the candidate text material.

[0087] Referring to Figure 4a, when the first text preview area 220 displays text material for editing, inputting, or modifying the target video material corresponding to the target editing task, the text material for editing, inputting, or modifying the target video material corresponding to the target editing task will be recorded in the text input area 230 on the first editing interface. The first video preview area 270 of the first editing interface allows for preview playback of the video material, and after the preview playback is completed, a static video frame will be displayed in the first video preview area 270. The static video frame will contain the core content of the target video material in the first editing interface, facilitating the creation of text material that matches the video material.

[0088] Referring to FIG. 4a , when a text material for editing or modifying a target video material corresponding to a target editing task exists in the input area of ​​the first editing interface, the recorded text material, image material, or audio material can be directly read from the input area of ​​the first editing interface. The read text material, image material, or audio material is used as a reference text material corresponding to the target editing task, without having to recognize the image content included in the static video frame of the target video material to obtain the text material.

[0089] Referring to Figure 5, after rewriting the reference text material corresponding to the target editing task to obtain multiple candidate text materials, the multiple candidate text materials are transferred to the text generation result selection area 250, and the candidate text materials of different entries are displayed in sequence in the text generation result selection area 250.

[0090] 5 , the text generation result selection area 250 may optionally be configured with multiple text style controls, each of which displays candidate text materials corresponding to that text style. The candidate text materials to be presented in the text generation result selection area 250 are configured to be grouped and displayed in the text generation result selection area 250 according to the text style to which the candidate text materials belong.

[0091] 5 , optionally, when a target text style control is selected in the text generation result selection area 250, the candidate text material corresponding to the target text style control is displayed in the text generation result selection area 250, while the candidate text materials corresponding to other unselected text style controls are not displayed in the text generation result selection area 250. Optionally, at least some of the text style controls to be presented in the text generation result selection area 250 are in a visible state or at least some of the text style controls are in an invisible state.

[0092] On the basis of the above embodiment, optionally, generating a target text material corresponding to a target video material in a target editing task based on the candidate text material includes the following steps: in response to a selection operation of the target text material in the candidate text material presented in the text generation result selection area, placing the target text material in a second text preview area for display.

[0093] Referring to Figure 5, when the text rewriting process in the target editing task is completed, multiple candidate text materials can be displayed in the text generation result selection area 250 of the second editing interface, and each candidate text material presented in the text generation result selection area 250 can be triggered for selection. When the target text material among the multiple candidate text materials is selected, the selected target text material will be filled into the second text preview area 240 of the second editing interface for display, so as to realize the presentation of the text material effect.

[0094] Based on the above embodiment, optionally, after displaying the second editing interface corresponding to the target editing task, the following steps are also included: in response to a trigger operation on the second editing interface for confirming that the target editing task adopts the target text material, jumping from the second editing interface to the third editing interface for presentation, and displaying the target text material in the third text preview area of ​​the third editing interface.

[0095] As shown in Figure 6, the first editing interface also includes a confirmation control for confirming that the selected target text material has completed the target editing task. By triggering the confirmation control, the user can jump from the second editing interface to the third editing interface for display. When the third editing interface is displayed, the target text material is also displayed in the third text preview area 260 of the third editing interface. Furthermore, a target video with text effects can be generated based on the target text material and the target video material placed in the third text preview area of ​​the third editing interface corresponding to the target editing task.

[0096] As an optional but non-limiting implementation method, when displaying the second editing interface corresponding to the target editing task, the following steps are also included: automatically selecting the first candidate text material displayed sequentially in the text generation result selection area of ​​the second editing interface to automatically trigger the selection of the target text material among the candidate text materials presented in the text generation result selection area.

[0097] Referring to FIG5 , when multiple candidate text materials generated by text rewriting are sequentially presented in the text generation result selection area 250, the candidate text material that is first in the sequence is automatically selected. Since the first candidate text material is selected as the target text material, the selected target text material is placed in the second text preview area of ​​the second editing interface for display. When a new candidate text material is selected as the target text material, the target text material placed in the second text preview area of ​​the second editing interface is replaced.

[0098] As an optional but non-limiting implementation, the process of generating candidate text materials corresponding to the target video material in the target editing task based on the relevant information of the target video material further includes the following steps: obtaining text rewriting progress data for rewriting the text based on the relevant information of the target video material, and presenting a text rewriting progress icon in the text generation result selection area of ​​the second editing interface according to the text rewriting progress data. The text rewriting progress icon is an animated icon and is used to dynamically indicate the progress of the text rewriting based on the relevant information of the target video material.

[0099] Referring to FIG. 5 , during the process of triggering the text generator to rewrite the reference text material corresponding to the target editing task, while waiting for the generation of candidate text materials, a second editing interface including a text generation result selection area may be displayed. Simultaneously, since the candidate text materials have not yet been generated, the text rewriting progress data for the reference text material may be read, and then a text rewriting progress icon that dynamically indicates the text rewriting progress may be displayed in the text generation result selection area.

[0100] Referring to FIG5 , when a text rewriting progress icon is displayed in the text generation result selection area of ​​the second editing interface, the method further includes the following steps: cyclically displaying text rewriting prompt content in the text generation result selection area of ​​the second editing interface. The text rewriting prompt content is used to indicate that a text rewriting operation is being performed, and the text rewriting prompt content is displayed below the text rewriting progress icon.

[0101] As an optional but non-limiting implementation, after the target text material is placed in the second text preview area for display, the following steps D1-D2 are further included.

[0102] Step D1: In response to a triggering operation on a text editing function corresponding to a second text preview area on a second editing interface, an input area corresponding to the second text preview area is displayed on the second editing interface.

[0103] Step D2: In response to an editing input operation in the input area corresponding to the second text preview area, adjusting the target text material placed in the second text preview area of ​​the second editing interface.

[0104] Referring to FIG7 , a text editing control is displayed on the second editing interface. The text editing control corresponding to the second text preview area can be an edit button 280 configured for the second text preview area or an input button 290 displayed on the second editing interface. When edit button 280 or input button 290 is triggered, an input area corresponding to the second text preview area is displayed on the second editing interface. By performing editing input operations in the input area corresponding to the second text preview area, secondary editing adjustments can be made to the target text material in the second text preview area.

[0105] As an optional but non-limiting implementation, after the target text material is placed in the second text preview area for display, the following steps E1-E2 are further included.

[0106] Step E1: In response to a selection operation on a candidate text material presented in a text generation result selection area, a text restoration control corresponding to a second text preview area is displayed on a second editing interface.

[0107] Step E2: In response to a triggering operation on a text restoration control corresponding to the second text preview area, the text material displayed in the second text preview area of ​​the second editing interface is restored.

[0108] Referring to Figure 8, in the scenario of text rewriting, after clicking on the candidate text material presented in the text generation result selection area, the text recovery control corresponding to the second text preview area is immediately displayed on the second editing interface, such as the revert button in Figure 8. By triggering the text recovery control, the text material displayed in the second text preview area of ​​the second editing interface can be restored. For example, when the input area is opened, the text material displayed in the second text preview area is A. After selecting text material B or C, the second text preview area displays text material B or C. When the text recovery control is triggered to restore, the text material displayed in the second text preview area is restored to A. Of course, if the adjustment of the text material generates a large number of text materials, it may affect the layout of the second text preview area. No special layout processing will be performed for the time being, and it is necessary to manually zoom and drag the second text preview area for adjustment.

[0109] As an optional but non-limiting implementation, after displaying the second editing interface corresponding to the target editing task, the following steps are further included: in response to a triggering operation on the second editing interface for a text style switching function, the text-assisted editing function is again triggered to switch and display candidate text materials in the text generation result selection area of ​​the second editing interface, where the text generation result selection area presents the candidate text materials corresponding to the target video material in the target editing task that are switched and displayed. When the text-assisted editing function is again triggered, the following operation is again performed: candidate text materials corresponding to the target video material in the target editing task are generated based on the relevant information of the target video material.

[0110] 9 , a plurality of text style controls are configured in the text generation result selection area 250. Each text style control corresponds to a candidate text material of that text style, allowing the generation of candidate text materials of different text styles when rewriting text. When the text style controls are displayed in the text generation result selection area, the text style control selected at the last completion is selected again by default.

[0111] Referring to Figure 9, when switching between various text style controls in the text generation result selection area, the reference text material of the target editing task is triggered again to rewrite the text to generate candidate text materials that match the text style corresponding to the switched text style control, and then the candidate text materials can be switched and displayed in the text generation result selection area of ​​the second editing interface. Of course, if the reference text material corresponding to the target editing task has been rewritten to generate text materials before the switching selection operation, then when switching to select the text style control, it is only necessary to display the candidate text materials that have been obtained in the text generation result selection area without the need to rewrite the text.

[0112] Optionally, when displaying candidate text materials in the text generation result selection area, a candidate text material prompt text is synchronously displayed below the text generation result selection area to prompt that the content generated by rewriting the reference text material is for reference only, please check before sharing.

[0113] As an optional but non-limiting implementation method, after displaying the second editing interface corresponding to the target editing task, the following steps are also included: in response to the triggering operation of the text loading function in the text generation result selection area, the text auxiliary editing function is triggered again to newly display the candidate text material corresponding to the target video material in the target editing task in the text generation result selection area of ​​the second editing interface. When the text auxiliary editing function is triggered again, the following operation is performed again: based on the relevant information of the target video material, the candidate text material corresponding to the target video material in the target editing task is generated, and the newly displayed candidate text material is placed in the text generation result selection area and presented after the position of the originally displayed candidate text material.

[0114] Referring to Figure 10, a text loading control is configured in the text generation result selection area 250 of the second editing interface. When the text loading control is triggered, the reference text material corresponding to the target editing task can be triggered again to rewrite the text based on the candidate text material originally displayed in the text generation result selection area to generate new text material, and then the newly obtained candidate text material can be presented sequentially in the text generation result selection area after the position of the candidate text material originally displayed.

[0115] Refer to Figure 10. Under the same text style control, you can click the text loading control to load more (for example, the corresponding load button of the text loading control follows the candidate text material. When a batch is changed, it will request to rewrite the text again. After loading the preset times, you cannot continue to load more. If the loading fails, it will still return to the load button and prompt: "Loading failed, please try again".

[0116] By employing the above-described technical solutions of the disclosed embodiments, text rewriting can assist in quickly editing and inputting text materials for a target video. Multiple candidate text materials are displayed in the text generation result selection area, facilitating the selection of appropriate text materials for the target editing task. Even those without extensive text writing skills can still quickly edit text materials while providing different text materials to suit different editing requirements, thereby improving editing efficiency for the target editing task.

[0117] Figure 11 is a structural schematic diagram of a video editing device provided by an embodiment of the present disclosure. The embodiment of the present disclosure is applicable to the situation where text material is added to the target video material for video editing. The video editing device can be implemented in the form of software and / or hardware, and is generally integrated on any electronic device with network communication function, which can be a mobile terminal, PC or server, etc.

[0118] As shown in FIG11 , the video editing apparatus of the embodiment of the present disclosure may include: a determination module 1101, a text generation module 1102, and a video generation module 1103. The determination module 1101 is used to determine the target video material specified in the target editing task; the text generation module 1102 is used to generate the target text material corresponding to the target video material in the target editing task based on the relevant information of the target video material; wherein the editing operation indicated by the target editing task is at least used to present the target text material on the image of the target video material; and the video generation module 1103 is used to edit the material in the target editing task based on the editing operation indicated by the target editing task in response to the video generation instruction to obtain the target video.

[0119] On the basis of the above embodiment, optionally, the target text material corresponding to the target video material in the target editing task is generated based on the relevant information of the target video material, including: generating candidate text material corresponding to the target video material in the target editing task based on the relevant information of the target video material, the candidate text material being a text material generated by assisting text rewriting based on the relevant information of the target video material; generating the target text material corresponding to the target video material in the target editing task based on the candidate text material.

[0120] On the basis of the above embodiment, optionally, candidate text material corresponding to the target video material in the target editing task is generated based on the relevant information of the target video material, including: identifying the reference text material corresponding to the target video material from the relevant information of the target video material, the relevant information of the target video material being the video frame image in the target video material or the audio material corresponding to the target video material; performing text rewriting on the reference text material corresponding to the target video material to generate candidate text material corresponding to the target video material in the target editing task.

[0121] On the basis of the above embodiment, optionally, candidate text materials corresponding to the target video material in the target editing task are generated based on the relevant information of the target video material, including: identifying reference text materials corresponding to the target video material from the relevant information of the target video material, the relevant information of the target video material being the initial text material imported after selecting a text template based on the target video material or the text material adjusted and modified based on the imported initial text material, or the relevant information of the target video material being the text material, image material or audio material edited, input or adjusted and modified in the input area corresponding to the target editing task based on the target video material; performing text rewriting on the reference text material corresponding to the target video material to generate candidate text materials corresponding to the target video material in the target editing task.

[0122] On the basis of the above embodiment, optionally, the reference text material corresponding to the target video material is rewritten to generate candidate text material corresponding to the target video material in the target editing task, including: rewriting the reference text material corresponding to the target editing task through a text generator to generate candidate text material corresponding to the target video material in the target editing task, and the text generator is pre-configured and generated based on a natural language processing model.

[0123] Based on the above embodiment, optionally, the editing operation indicated by the target editing task specifically includes: a triggering operation for confirming the use of the target text material to present the target text material on the image of the target video material in the target editing task.

[0124] On the basis of the above embodiment, optionally, candidate text materials corresponding to the target video material in the target editing task are generated based on the relevant information of the target video material, including: displaying a first editing interface corresponding to the target editing task, the first editing interface including a text auxiliary editing control and a first text preview area; in response to a triggering operation of the text auxiliary editing function on the first editing interface, displaying a second editing interface corresponding to the target editing task, the second editing interface including a second text preview area and a text generation result selection area, the text generation result selection area presenting the candidate text materials corresponding to the target video material in the target editing task, and performing the following operation when the text auxiliary editing function is triggered: generating candidate text materials corresponding to the target video material in the target editing task based on the relevant information of the target video material.

[0125] Based on the above embodiment, optionally, a target text material corresponding to the target video material in the target editing task is generated based on the candidate text material, including: in response to a selection operation of the target text material in the candidate text material presented in the text generation result selection area, the target text material is placed in the second text preview area for display.

[0126] Based on the above embodiment, optionally, displaying the first editing interface corresponding to the target editing task includes: in response to a triggering operation of a text adding control on a third editing interface corresponding to the target editing task, displaying the first editing interface corresponding to the target editing task, wherein a first video preview area of ​​the first editing interface presents a video frame of the target video material, and a first text preview area of ​​the first editing interface presents preset prompt text, wherein the preset prompt text is used to prompt the user to edit and input text material, image material, or audio material in an input area of ​​the first editing interface based on the target video material, or the preset prompt text includes adjusted and modified text material, image material, or audio material; or, in response to a triggering operation of a text editing control on a third editing interface corresponding to the target editing task, displaying the first editing interface corresponding to the target editing task, wherein a third text preview area of ​​the third editing interface is displayed above a third video preview area of ​​the third editing interface, and wherein the first text preview area of ​​the first editing interface presents initial text material imported after selecting a text template based on the target video material, or text material adjusted and modified based on the imported initial text material, or text material, image material, or audio material edited, input, or adjusted and modified in the input area based on the target video material.

[0127] Based on the above embodiment, optionally, when displaying the second editing interface corresponding to the target editing task, it also includes: automatically selecting the first candidate text material sequentially displayed in the text generation result selection area of ​​the second editing interface to automatically trigger the selection of the target text material among the candidate text materials presented in the text generation result selection area.

[0128] On the basis of the above embodiment, optionally, after displaying the second editing interface corresponding to the target editing task, it also includes: in response to the triggering operation of the text style switching function on the second editing interface, triggering the text auxiliary editing function again to switch and display the candidate text materials in the text generation result selection area of ​​the second editing interface, the text generation result selection area presents the switched display of the candidate text materials corresponding to the target video material in the target editing task, and when the text auxiliary editing function is triggered again, the following operation is performed again: generating the candidate text materials corresponding to the target video material in the target editing task based on the relevant information of the target video material.

[0129] On the basis of the above embodiment, optionally, after displaying the second editing interface corresponding to the target editing task, it also includes: in response to the triggering operation of the text loading function on the text generation result selection area, triggering the text auxiliary editing function again to newly display the candidate text material corresponding to the target video material in the target editing task in the text generation result selection area of ​​the second editing interface, and the text auxiliary editing function is triggered again when it is triggered again. The following operation is performed again: based on the relevant information of the target video material, the candidate text material corresponding to the target video material in the target editing task is generated, and the newly displayed candidate text material is placed in the text generation result selection area and presented after the position of the originally displayed candidate text material.

[0130] On the basis of the above embodiment, optionally, the candidate text materials to be presented in the text generation result selection area are configured to be displayed in groups in the text generation result selection area according to the text styles to which the candidate text materials belong.

[0131] Based on the above embodiment, optionally, after the target text material is placed in the second text preview area for display, it also includes: in response to a triggering operation of a text editing function corresponding to the second text preview area on the second editing interface, displaying an input area corresponding to the second text preview area on the second editing interface; in response to an editing input operation in the input area corresponding to the second text preview area, adjusting the target text material placed in the second text preview area of ​​the second editing interface.

[0132] Based on the above embodiment, optionally, after the target text material is placed in the second text preview area for display, it also includes: in response to a selection operation on the candidate text material presented in the text generation result selection area, displaying a text recovery control corresponding to the second text preview area on the second editing interface; in response to a triggering operation on the text recovery control corresponding to the second text preview area, restoring the text material displayed in the second text preview area of ​​the second editing interface.

[0133] On the basis of the above embodiment, optionally, in the process of generating candidate text materials corresponding to the target video material in the target editing task based on the relevant information of the target video material, it also includes: obtaining text rewriting progress data for text rewriting based on the relevant information of the target video material, and presenting a text rewriting progress icon in the text generation result selection area of ​​the second editing interface according to the text rewriting progress data, wherein the text rewriting progress icon is an animated icon and is used to dynamically prompt the progress of text rewriting based on the relevant information of the target video material.

[0134] Based on the above embodiment, optionally, when the text rewriting progress icon is presented in the text generation result selection area of ​​the second editing interface, it also includes: cyclically presenting text rewriting prompt content in the text generation result selection area of ​​the second editing interface, the text rewriting prompt content is used to prompt that a text rewriting operation is being performed, and the text rewriting prompt content is presented below the text rewriting progress icon.

[0135] The technical solution provided by the embodiment of the present disclosure can assist in the rapid editing and input of text materials for the target video through text rewriting, and at the same time display multiple candidate text materials in the text generation result selection area, so as to facilitate the selection of suitable text materials to perform the target editing task. Even if one does not have rich text writing skills, one can ensure the rapid editing of text materials while adapting to different editing requirements and providing different text materials, thereby improving the editing efficiency of the target editing task.

[0136] The video editing device provided by the embodiments of the present disclosure can execute the video editing method provided by any embodiment of the present disclosure, and has corresponding functional modules and beneficial effects for executing the video editing method.

[0137] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present disclosure.

[0138] Figure 12 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. Referring to Figure 12 below, it shows a schematic diagram of the structure of an electronic device (such as the terminal device or server in Figure 12) 500 suitable for implementing an embodiment of the present disclosure. The terminal device in the embodiment of the present disclosure may include but is not limited to mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. The electronic device shown in Figure 12 is only an example and should not bring any limitations to the functions and scope of use of the embodiments of the present disclosure.

[0139] As shown in FIG11 , the electronic device 500 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. Various programs and data required for the operation of the electronic device 500 are also stored in the RAM 503. The processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An edit / output (I / O) interface 505 is also connected to the bus 504.

[0140] Typically, the following devices may be connected to the I / O interface 505: an input device 506 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509. The communication device 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. Although FIG12 shows the electronic device 500 with various devices, it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or have alternatively.

[0141] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 509, or installed from the storage device 508, or installed from the ROM 502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0142] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0143] The electronic device provided by the embodiment of the present disclosure and the video editing method provided by the above embodiment belong to the same inventive concept. For technical details not fully described in this embodiment, please refer to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.

[0144] An embodiment of the present disclosure provides a computer storage medium having a computer program stored thereon. When the program is executed by a processor, the video editing method provided by the above embodiment is implemented.

[0145] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0146] In some embodiments, the client and server can communicate using any currently known or later developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or later developed network.

[0147] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0148] The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the electronic device, the electronic device: determines the target video material specified in the target editing task; generates the target text material corresponding to the target video material in the target editing task based on the relevant information of the target video material; wherein the editing operation indicated by the target editing task is at least used to present the target text material on the image of the target video material; in response to the video generation instruction, the material in the target editing task is edited based on the editing operation indicated by the target editing task to obtain the target video.

[0149] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0150] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0151] The units described in the embodiments of the present disclosure may be implemented in software or hardware. In some embodiments, the name of a unit does not necessarily limit the unit itself. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses."

[0152] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0153] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0154] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0155] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0156] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A video editing method, the method comprising: Determine the target video material specified in the target editing task; Generate a target text material corresponding to the target video material in the target editing task based on the relevant information of the target video material; wherein the editing operation indicated by the target editing task is at least used to present the target text material on the image of the target video material; In response to the video generation instruction, the material in the target editing task is edited based on the editing operation indicated by the target editing task to obtain the target video.

2. The method according to claim 1, wherein: Generating a target text material corresponding to the target video material in the target editing task based on the relevant information of the target video material includes: Generating candidate text materials corresponding to the target video material in the target editing task based on the relevant information of the target video material, wherein the candidate text materials are text materials generated by text rewriting with the assistance of the relevant information of the target video material; A target text material corresponding to the target video material in the target editing task is generated based on the candidate text material.

3. The method according to claim 2, wherein: Generating candidate text materials corresponding to the target video material in the target editing task based on the relevant information of the target video material includes: Identify a reference text material corresponding to the target video material from relevant information of the target video material, where the relevant information of the target video material is a video frame image in the target video material or an audio material corresponding to the target video material; The reference text material corresponding to the target video material is rewritten to generate a candidate text material corresponding to the target video material in the target editing task.

4. The method according to claim 2, wherein: Generating candidate text materials corresponding to the target video material in the target editing task based on the relevant information of the target video material includes: Identify a reference text material corresponding to the target video material from the relevant information of the target video material, the relevant information of the target video material being an initial text material imported after selecting a text template based on the target video material or a text material adjusted and modified based on the imported initial text material, or the relevant information of the target video material being a text material, an image material or an audio material edited, inputted or adjusted and modified in an input area corresponding to the target editing task based on the target video material; The reference text material corresponding to the target video material is rewritten to generate a candidate text material corresponding to the target video material in the target editing task.

5. The method according to claim 3 or 4, wherein: Rewriting the reference text material corresponding to the target video material to generate a candidate text material corresponding to the target video material in the target editing task, including: The reference text material corresponding to the target editing task is rewritten by a text generator to generate candidate text material corresponding to the target video material in the target editing task, and the text generator is pre-configured and generated based on a natural language processing model.

6. The method according to claim 1, wherein: The editing operations indicated by the target editing task specifically include: A triggering operation for confirming the use of a target text material to present the target text material on an image of the target video material in the target editing task.

7. The method according to any one of claims 2 to 6, wherein: Generating candidate text materials corresponding to the target video material in the target editing task based on the relevant information of the target video material includes: Displaying a first editing interface corresponding to the target editing task, wherein the first editing interface includes a text auxiliary editing control and a first text preview area; In response to a triggering operation on a text auxiliary editing function on a first editing interface, a second editing interface corresponding to a target editing task is displayed, wherein the second editing interface includes a second text preview area and a text generation result selection area, wherein the text generation result selection area presents candidate text materials corresponding to target video materials in the target editing task, and the text auxiliary editing function performs the following operation when triggered: generating candidate text materials corresponding to target video materials in the target editing task based on relevant information of the target video material.

8. The method according to claim 7, wherein: Generating a target text material corresponding to a target video material in the target editing task based on the candidate text material includes: In response to a selection operation of a target text material from the candidate text materials presented in the text generation result selection area, the target text material is placed in the second text preview area for display.

9. The method according to claim 7, wherein: The first editing interface corresponding to the target editing task is displayed, including: In response to a triggering operation of adding a text control on a third editing interface corresponding to a target editing task, a first editing interface corresponding to the target editing task is displayed, a first video preview area of ​​the first editing interface presents a video frame of a target video material, and a first text preview area of ​​the first editing interface presents a preset prompt text, wherein the preset prompt text is used to prompt the user to edit and input text material, image material or audio material in an input area of ​​the first editing interface based on the target video material, or the preset prompt text includes the adjusted and modified text material, image material or audio material; or, In response to a triggering operation on a text editing control on a third editing interface corresponding to a target editing task, a first editing interface corresponding to the target editing task is displayed, and a third text preview area of ​​the third editing interface is The domain is displayed above the third video preview area of ​​the third editing interface, and the first text preview area of ​​the first editing interface presents the initial text material imported after selecting a text template based on the target video material, or the text material adjusted and modified based on the imported initial text material, or the text material, image material or audio material edited, input or adjusted and modified in the input area based on the target video material.

10. The method according to claim 7, wherein: When displaying the second editing interface corresponding to the target editing task, it also includes: The first candidate text material sequentially displayed in the text generation result selection area of ​​the second editing interface is automatically selected to automatically trigger the selection of the target text material from the candidate text materials presented in the text generation result selection area.

11. The method according to claim 7, wherein: After displaying the second editing interface corresponding to the target editing task, the method further includes: In response to the triggering operation of the text style switching function on the second editing interface, the text auxiliary editing function is triggered again to switch and display the candidate text materials in the text generation result selection area of ​​the second editing interface, and the text generation result selection area presents the switched display of the candidate text materials corresponding to the target video material in the target editing task. When the text auxiliary editing function is triggered again, the following operation is performed again: based on the relevant information of the target video material, the candidate text materials corresponding to the target video material in the target editing task are generated.

12. The method according to claim 7, wherein: After displaying the second editing interface corresponding to the target editing task, the method further includes: In response to the triggering operation of the text loading function in the text generation result selection area, the text auxiliary editing function is triggered again to display the candidate text material corresponding to the target video material in the target editing task in the text generation result selection area of ​​the second editing interface. When it can be triggered again, the following operation will be performed again: based on the relevant information of the target video material, candidate text materials corresponding to the target video material in the target editing task are generated, and the newly displayed candidate text materials are placed in the text generation result selection area and presented after the position of the originally displayed candidate text materials.

13. The method according to claim 7, wherein: The candidate text materials to be presented in the text generation result selection area are configured to be displayed in groups in the text generation result selection area according to the text styles to which the candidate text materials belong.

14. The method according to claim 8, wherein: After placing the target text material in the second text preview area for display, the method further includes: In response to a triggering operation on a text editing function corresponding to the second text preview area on the second editing interface, displaying an input area corresponding to the second text preview area on the second editing interface; In response to an editing input operation in an input area corresponding to the second text preview area, the target text material placed in the second text preview area of ​​the second editing interface is adjusted.

15. The method according to claim 8, wherein: After placing the target text material in the second text preview area for display, the method further includes: In response to a selection operation on the candidate text material presented in the text generation result selection area, displaying a text restoration control corresponding to the second text preview area on the second editing interface; In response to a triggering operation on a text restoration control corresponding to the second text preview area, the text material displayed in the second text preview area of ​​the second editing interface is restored.

16. The method according to claim 7, wherein: In the process of generating candidate text materials corresponding to the target video material in the target editing task based on the relevant information of the target video material, the method further includes: Acquire text rewriting progress data for text rewriting based on the relevant information of the target video material, and present a text rewriting progress icon in the text generation result selection area of ​​the second editing interface according to the text rewriting progress data. The text rewriting progress icon is an animated icon and is used to dynamically prompt the progress of text rewriting based on the relevant information of the target video material.

17. The method according to claim 16, wherein: When a text rewriting progress icon is displayed in the text generation result selection area of ​​the second editing interface, the method further includes: The text rewriting prompt content is cyclically presented in the text generation result selection area of ​​the second editing interface, and the text rewriting prompt content is used to prompt that the text rewriting operation is being performed. The text rewriting prompt content is presented below the text rewriting progress icon.

18. A video editing device, comprising: A determination module, used to determine the target video material specified in the target editing task; A text generation module, configured to generate a target text material corresponding to the target video material in the target editing task based on the relevant information of the target video material; wherein the editing operation indicated by the target editing task is at least used to present the target text material on the image of the target video material; The video generation module is used to respond to the video generation instruction and edit the material in the target editing task based on the editing operation indicated by the target editing task to obtain the target video.

19. An electronic device, comprising: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the video editing method as described in any one of claims 1-17.

20. A storage medium comprising computer executable instructions, wherein the computer executable instructions are used to perform the video editing method according to any one of claims 1 to 17 when executed by a computer processor.

Citation Information

Patent Citations

  • Subtitle editing method and device and electronic equipment

    CN111970577A

  • Video generation method and device, electronic equipment and storage medium

    CN113364999A

  • Oral broadcasting video generation method and device, electronic equipment and storage medium

    CN113411655A

  • Text input method and device, electronic equipment and storage medium

    CN113589991A

  • Video editing method and device

    CN115883935A

Cited By

  • Media editing method and apparatus, device and storage medium

    WO2026194247A1