Method, device and equipment for multimedia editing and storage medium

Abstract

The embodiment of the invention provides a multimedia editing method and device, equipment and a storage medium. The method comprises the following steps: receiving a first message from terminal equipment, wherein the first message indicates a request for editing target multimedia; generating guidance information to the target model based on the first message and a set of editing functions for multimedia editing; and sending a second message to the terminal device based on the output information of the target model, the second message being used for indicating the terminal device to execute a corresponding editing operation on the target multimedia. By means of the mode, the user only needs to give the requirement for editing the multimedia, the remote device can understand the intention of the user by calling the target model, and then the editing requirement of the user is met.

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computer technology, and particularly to methods, apparatuses, devices, and storage media for multimedia editing. Background Art

[0002] With the rapid development of information technology, various terminal devices can provide people with various services in aspects such as work and life. Terminal devices can provide users with editing functions to assist users in performing corresponding editing operations on multimedia data. There is an expectation of how to achieve the user's need for multimedia editing according to an understanding of the user's intention. Summary of the Invention

[0003] In a first aspect of the present disclosure, there is provided a method for multimedia editing. The method includes: receiving a first message from a terminal device, the first message indicating a request to edit target multimedia; generating guiding information to a target model based on the first message and a set of editing functions used by the terminal device for multimedia editing; and sending a second message to the terminal device based on output information of the target model, the second message being used to instruct the terminal device to perform a corresponding editing operation on the target multimedia.

[0004] In a second aspect of the present disclosure, there is provided a method for multimedia editing. The method includes: obtaining input information via an editing interface for editing target multimedia, the input information indicating an editing request for the target multimedia; sending a first message to a remote device based on the input information for generating guiding information input to the target model; and presenting an editing result of the target multimedia in the editing interface based on a second message received from the remote device, where the second message is generated based on output information generated by the target model according to the guiding information.

[0005] In a third aspect of the present disclosure, there is provided an apparatus for multimedia editing. The apparatus includes: a receiving module configured to receive a first message from a terminal device, the first message indicating a request to edit target multimedia; a guiding information generating module configured to generate guiding information to a target model based on the first message and a set of editing functions used by the terminal device for multimedia editing; and a second message sending module configured to send a second message to the terminal device based on output information of the target model, the second message being used to instruct the terminal device to perform a corresponding editing operation on the target multimedia.

[0006] In a fourth aspect of the present disclosure, there is provided an apparatus for multimedia editing. The apparatus includes: an information acquisition module configured to acquire input information via an editing interface for editing a target multimedia, where the input information indicates an editing request for the target multimedia; a first message sending module configured to send a first message to a remote device based on the input information for generating guiding information input to a target model; and a presenting editing result module configured to present an editing result of the target multimedia in the editing interface based on a second message received from the remote device, where the second message is generated based on output information generated by the target model according to the guiding information.

[0007] In a fifth aspect of the present disclosure, there is provided a remote device. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. The instructions, when executed by the at least one processing unit, cause the remote device to execute the method of the first aspect.

[0008] In a sixth aspect of the present disclosure, there is provided a terminal device. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. The instructions, when executed by the at least one processing unit, cause the terminal device to execute the method of the second aspect.

[0009] In a seventh aspect of the present disclosure, there is provided a computer-readable storage medium. A computer program is stored on the medium, and when the computer program is executed by a processor, the method of the first aspect or the second aspect is implemented.

[0010] It should be understood that the content described in this part is not intended to define the key features or important features of the embodiments of the present disclosure, nor is it used to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] In conjunction with the accompanying drawings and with reference to the following detailed description, the above and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent. In the drawings, the same or similar reference numerals denote the same or similar elements, where:

[0012] Figure 1 A schematic diagram showing an example environment in which the embodiments of the present disclosure can be implemented;

[0013] Figures 2A to 2C A schematic diagram showing multimedia editing according to some embodiments;

[0014] Figures 3A to 3C A schematic diagram showing multimedia editing according to other embodiments;

[0015] Figures 4A to 4B Shows a schematic diagram for multimedia editing according to still other embodiments;

[0016] Figure 5 Shows a flowchart of a process for multimedia editing according to some embodiments of the present disclosure;

[0017] Figure 6 Shows a flowchart of a process for multimedia editing according to some embodiments of the present disclosure;

[0018] Figure 7 Shows a schematic structural block diagram of a device for multimedia editing according to some embodiments of the present disclosure;

[0019] Figure 8 Shows a schematic structural block diagram of a device for multimedia editing according to some embodiments of the present disclosure; and

[0020] Figure 9 Shows a block diagram of an electronic device suitable for implementing one or more embodiments of the present disclosure. Detailed implementation manners

[0021] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. On the contrary, these embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not used to limit the protection scope of the present disclosure.

[0022] In the description of the embodiments of the present disclosure, the term "including" and its similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". There may also be other explicit and implicit definitions hereinafter.

[0023] In this article, unless otherwise specified, performing a step "in response to A" does not mean that the step is immediately executed after "A", but may include one or more intermediate steps.

[0024] It can be understood that the data involved in the technical solution (including but not limited to the data itself, the acquisition, use, storage, or deletion of the data) should comply with the requirements of the corresponding laws, regulations, and related provisions.

[0025] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the type, scope of use, usage scenarios, etc. of the information involved in the present disclosure should be informed to relevant users and the authorization of relevant users should be obtained through appropriate means in accordance with relevant laws and regulations. Among them, relevant users may include any type of rights subject, such as individuals, enterprises, and groups.

[0026] For example, when responding to an active request from a user, a prompt message is sent to the relevant user to clearly prompt the relevant user that the operation requested by the user will require obtaining and using the information of the relevant user, so that the relevant user can autonomously choose whether to provide information to software or hardware such as an electronic device, application program, server, or storage medium that executes the operation of the technical solution of the present disclosure according to the prompt message.

[0027] As an optional but non-limiting implementation manner, the manner of sending a prompt message to the relevant user in response to receiving an active request from the relevant user may be, for example, in the form of a pop-up window. The prompt message may be presented in text in the pop-up window. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide information to the electronic device.

[0028] It is understandable that the above process of notifying and obtaining user authorization is only illustrative and does not constitute a limitation on the implementation manner of the present disclosure. Other manners that meet relevant laws and regulations can also be applied to the implementation manner of the present disclosure.

[0029] As used herein, the term "model" can learn the corresponding association relationship between input and output from training data, so that after training, for a given input, a corresponding output can be generated. The generation of the model can be based on machine learning techniques. Deep learning is a machine learning algorithm that processes inputs and provides corresponding outputs by using multiple processing units. A neural network model is an example of a model based on deep learning. In this article, "model" can also be referred to as "machine learning model", "learning model", "machine learning network" or "learning network", and these terms can be used interchangeably in this article.

[0030] Currently, a terminal device can provide an editing function to assist a user in performing corresponding editing operations on multimedia. For example, performing editing operations such as video clipping, animation making, and transition. However, the traditional method is based on the user manually performing editing operations such as clipping, animation making, and transition selection. By this method, it takes a long time, it is difficult to control the time, and the editing operations are also relatively complex.

[0031] In an embodiment of the present disclosure, a solution for multimedia editing is proposed. In this solution, a requirement of a user to edit a target multimedia can be received from a terminal device, and guidance information for a target model can be generated according to the requirement of the user and a set of editing functions used by the terminal device for multimedia editing. Further, according to the information output by the target model, a corresponding editing operation on the target multimedia can be sent to the terminal device.

[0032] In this way, the embodiment of the present disclosure can understand the intention of the user by calling the target model, and then complete the corresponding editing operation. Thus, the embodiment of the present disclosure can complete the multimedia editing process more efficiently.

[0033] Some exemplary embodiments of the present disclosure will be described in detail below with reference to examples of the accompanying drawings.

[0034] Exemplary Environment

[0035] Figure 1 FIG. shows a schematic diagram of an exemplary environment 100 in which embodiments of the present disclosure can be implemented. In this exemplary environment 100, an application 120 is installed in a terminal device 110. A user 140 can interact with the application 120 via the terminal device 110 and / or an attached device of the terminal device 110. In some embodiments, the application 120 may include a multimedia editing application or any suitable application integrated with multimedia editing capabilities.

[0036] The application 120 can provide an integration of multiple applications or components to the user 140. These applications can be used as application modules in the application 120. In some embodiments, the application 120 can be downloaded and installed as an application in the terminal device 110. In some embodiments, the application 120 can also be accessed by other means, such as via a web page.

[0037] In Figure 1 the environment 100, if the application 120 is launched, the terminal device 110 can present an interface 150 of the application 120 to the user 140. The interface 150 is sometimes also referred to as a client interface. The interface 150 can include various interfaces that the application 120 can provide, such as a session interface for presenting chat content, an editing interface, an editing result interface, and so on.

[0038] In some embodiments, the terminal device 110 communicates with the remote device 130 to supply the services of the application 120. The target model 160 is deployed in the environment 100. The target model 160 may be deployed on a suitable electronic device. As an example, the target model 160 may also be deployed on other electronic devices different from the remote device 130. For example, the remote device 130 may call the target model 160 to perform corresponding tasks through service invocation. In another example, the target model 160 may also be deployed locally on the remote device 130.

[0039] As will be described in detail below, the terminal device 110 may utilize the target model 160 to understand the user's editing intention and then automatically complete the corresponding multimedia editing operation. As an example, the terminal device 110 may call the target model through the remote device 130. As another example, the terminal device 110 may also directly call the target model to understand the user's editing intention.

[0040] The terminal device 110 may be any type of mobile terminal, fixed terminal or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, multimedia computers, multimedia tablets, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, television receivers, radio broadcast receivers, e-book devices, game devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the terminal device 110 can also support any type of interface for the user (such as "wearable" circuits, etc.). The remote device 130 may be various types of computing systems / servers capable of providing computing capabilities, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, and the like.

[0041] It should be understood that the structures and functions of the various elements in the environment 100 are described only for exemplary purposes and do not imply any limitation on the scope of the present disclosure. For example, the embodiments of the present disclosure may be applied to any suitable one or more applications, not limited to multimedia editing.

[0042] Example process

[0043] It should be understood that the examples described in the present disclosure may be performed by, for example Figure 1It is implemented by the terminal device 110, the remote device 120, or a combination of the terminal device 110 and the remote device 120 as shown. In view of this, although in some embodiments, the corresponding functions are described as being implemented by the terminal device 110, it should be understood that in other embodiments, the corresponding functions can also be implemented by the remote device 130. Similarly, although in some embodiments, the corresponding functions are described as being implemented by the remote device 130, it should be understood that in other embodiments, the corresponding functions can also be implemented by the terminal device 110. The execution subject of the disclosed embodiments is not limited in this regard.

[0044] For a better understanding of the various embodiments of the present disclosure only, in the following exemplary embodiments, reference is made to Figures 2A to 4B the exemplary user interfaces 201 to 402 shown. It should be understood that Figures 2A to 4B the user interfaces shown are merely examples, and various designs can actually exist. For example, the various graphical elements and / or controls in the user interface can have different arrangements and different visual representations, one or more of the elements and / or controls can be omitted or replaced, and there can also be one or more other elements and / or controls. In addition, the user interface can contain any appropriate content. The scope of the present disclosure is not limited in this regard.

[0045] First, reference will be made to Figures 2A to 2C to illustrate the solution of the present disclosure for multimedia editing. Figures 2A to 2C A schematic diagram for multimedia editing according to some embodiments is shown. For ease of description, reference will be made to Figure 1 to describe Figures 2A to 2C .

[0046] The terminal device 110 obtains the input information 220 of the user 140 through the interface 150. The interface 150 is an editing interface for editing the target multimedia 210. The input information 220 of the user 140 is the editing requirement of the user 140 for the target multimedia 210, that is, an editing request for the target multimedia. In some examples, the terminal device 110 can obtain the input information 220 through the text content, voice content, etc. input by the user 140. The terminal device 110 can also receive the triggering operation of the user 140 on the control of at least one editing item by the user 140 clicking on the control of at least one editing item in the interface 150.

[0047] In some embodiments, the terminal device 110 sends a first message to the remote device 130 according to the input information 220 of the user 140. The remote device 130 generates guiding information input into the target model 160 according to the first message. The generation of the guiding information of the target model 160 by the remote device 130 will be described in detail below.

[0048] The terminal device 110 presents the editing result of the target multimedia 210 in the editing interface 150 according to the second message received from the remote device 130. As Figure 3C shown, the terminal device 110 displays the editing result 310 on the editing page and replies with "The matte extraction is completed and can be adjusted." Figure 3C This will be described in detail below. In some examples, the second message is generated based on the output information generated by the terminal device 110 according to the target model 160 through the guidance information.

[0049] In some examples, the editing interface 150 includes an interaction area, and the terminal device 110 can provide a feedback message in the interaction area that at least one editing operation has been applied to the target multimedia. In some examples, the terminal device 110 can be associated with the feedback message and provide adjustment controls. As Figure 3C shown, the terminal device 110 provides an adjustment control 311, and the user 140 can click on the adjustment control 311 to adjust the editing result 310.

[0050] In some embodiments, based on the user 140 clicking on the adjustment control 311, the terminal device 110 modifies a parameter. The parameter is a parameter associated with at least one editing operation of the target multimedia.

[0051] As Figures 2A to 2C , the terminal device 110 obtains the input information of the user 140 in the input box 214 through the editing interface 150, such as "Help me add a piece of text here." The terminal device 110 will send a first message to the remote device 130 according to the "Help me add a piece of text here" input by the user 140. The remote device 130 generates guidance information input to the target model 160 according to the first message.

[0052] During the period from when the terminal device 110 receives the input information of the user 140 to when it receives the second message, the terminal device 110 will display a processing progress 320 in the editing interface 150, such as "Recommending text, please wait." Based on the displayed progress, the user 140 can also click on the cancel control to pause the editing operation. The terminal device 110 presents the editing result 310 of the target multimedia 210 in the editing interface 150 according to the second message received from the remote device 130.

[0053] The following will use examples and in combination with Figures 3A to 3C 、 Figures 4A to 4B describe the multimedia editing solution. Figures 3A to 3C shows a schematic diagram for multimedia editing according to some other embodiments.

[0054] As Figures 3A to 3C, the terminal device 110 obtains the input information of the user 140 in the input box 214 through the editing interface 150, such as "Help me cut out the picture". The terminal device 110 will send a first message to the remote device 130 according to "Help me cut out the picture" input by the user 140. The remote device 130 generates guiding information input into the target model 160 according to the first message.

[0055] During the period when the terminal device 110 receives the input information of the user 140 until it receives the second message, the terminal device 110 will display the processing progress 320 in the editing interface 150, such as "Cutting out the picture for you, please wait 64%". Based on the displayed progress, the user 140 can also click the cancel control to pause the editing operation. The terminal device 110 presents the editing result 310 of the target multimedia 210 in the editing interface 150 according to the second message received from the remote device 130.

[0056] Figures 4A to 4B Shows a schematic diagram for multimedia editing according to some other embodiments. As Figures 4A to 4B , the terminal device 110 obtains the input information of the user 140 in the input box 214 through the editing interface 150, such as "Adjust the beauty effect". The terminal device 110 will send a first message to the remote device 130 according to "Adjust the beauty effect" input by the user 140. The remote device 130 generates guiding information input into the target model 160 according to the first message.

[0057] The terminal device 110 presents the editing result 410 of the target multimedia 210 in the editing interface 150 according to the second message received from the remote device 130. The user 140 adjusts the editing result 410 based on the adjustment control provided by the terminal device 110 in the interaction area in the form of a frame 420.

[0058] The above describes the multimedia editing solution from the perspective of the terminal device 110. The terminal device 110 receives the input information of the user and sends a first message to the remote device 130. Furthermore, it receives the second message from the remote device 130 and presents the editing result. The following will describe generating the guiding information of the target model 160 from the perspective of the remote device 130 based on the first message and a set of APIs for multimedia editing.

[0059] In some embodiments, the remote device 130 receives the first message from the terminal device 110. The first message is used to indicate a request for editing the target multimedia. The first message can be the content input by the user 140 to the terminal device 110 on the interface 150. The input content can be text-type input, voice-type input, etc. As Figure 2BAs shown, user 140 enters in the input box 214 in interface 150: "Help me add a piece of copy here." In some examples, the multimedia includes: videos, pictures, and composite multimedia including multiple multimedia types.

[0060] In some examples, if the input content is of the text type, the guiding information of the target model 160 includes a piece of text related to the input text to characterize the content input by user 140. If the input content is of the voice type, the target model 160 transcribes the input voice into text.

[0061] The first message can also be a triggering operation by user 140 on at least one editing item provided by the terminal device 110 on interface 150. As Figure 2A shown, the editing items provided by the terminal device 110 are: change music 211, add packaging 212, add copy 213, etc. User 140 can click on any one of the editing items provided by the terminal device 110. In some examples, if user 140 selects to click on any one of the editing items, the guiding information of the target model 160 needs to include a piece of text corresponding to any one of the editing items. The piece of text corresponding to any one of the editing items included in the guiding information of the target model 160 is used to characterize that user 140 has clicked on any one of the editing items.

[0062] In some embodiments, the remote device 130 generates the guiding information (also referred to as guiding words or prompt words) of the target model 160 according to the first message and a set of editing functions for multimedia editing used by the terminal device.

[0063] In some embodiments, the guiding information can include one or more of the following information items: ability setting information, material information, a set of editing functions, at least one example, the status of the material, and the user's input.

[0064] In some embodiments, a set of editing functions can be a set of application programming interfaces (APIs) for multimedia editing. In some examples, a set of APIs can be a set of APIs for replacing all fancy words in the text of the multimedia, can be a set of APIs for adding a certain music to the multimedia, etc. The present disclosure does not limit this.

[0065] Additionally, in some embodiments, a set of editing functions may include a description part, an explanation part, an editing function declaration part, a processing example part, a user status description part, and a user interaction option description part for the editing functions. The description part of the editing function may include "background" parameter, "type", "identifier" parameter, "material" parameter, and so on. The explanation part of the editing function may include video: video, audio: audio, music: music, text_to_audio: voice-over, text: text, lyrics: lyrics, subtitle: subtitle, and so on. The editing function declaration part of the editing function, for example, the parameters associated with "speed change". For example, slowing down to 0.8 times the speed can be represented by [0.8], speeding up by 50% can be represented by [1.5x], and so on. If the user's status is to select the ['video_7'] material, use the python function to answer the question described in the user interaction option: replace all subtitles, output the code and wrap it in the "python" format. If the question is not related to editing or difficult to complete, return the "unsupported()" function and do not force an answer.

[0066] For example, the functions included in a set of editing functions may be: when using the xxAdd function to add relevant functions, a new draft_id needs to be created as the input of the function, and in other cases, the existing draft_ids should be used as the input. When using the xxEdit function for editing, if the operation on which material in the material is not specified in the question, the operation should be performed on the first material. The voice-over is done with synthesized sound and there is no need to record by oneself. Regarding copyright verification and replacement, and issues related to commercial use of materials, the materialEdit function should be used, such as changing to a copyrighted music, font, and so on.

[0067] In some embodiments, the remote device 130 generates the guiding information of the target model 160 according to the first message received from the terminal device 110 and a set of editing functions. The guiding information may be a set of materials associated with the target multimedia to be edited. For example, if the target multimedia to be edited is a video, a set of materials related to it may be: audio, text, stickers, filters, special effects, and so on.

[0068] For example, a set of editing functions for video editing operations may include, but are not limited to: replacement, layout modification, subtitle recognition, beat marking, speed change, camera tracking, cropping, scaling, background replacement, background editing, packaging and polishing, etc. The output information of the target model 160 may be parameters associated with "replacement". The output information of the target model 160 may also be parameters associated with "layout modification", such as parameters associated with rotation, movement, video resizing, etc. The output information of the target model 160 may also be parameters associated with "speed change". For example, slowing down to 0.8 times the speed can be represented by [0.8], and speeding up by 50% can be represented by [1.5x], and so on.

[0069] In some embodiments, the guidance information further includes a capability setting section. For example, "You are a professional video editing program for [specific person / thing], and your job is to use Python functions to modify the API according to the user's question to achieve the user's desired effect to the minimum extent, and you will only output code."

[0070] The guidance information also indicates the processing status of at least one piece of material. For example, the guidance information needs to reflect the user's selection status of the material and inform the user that a certain material in the video is currently selected. After the guidance information reflects the material currently selected by the user, if the user has other editing requests, the guidance information also needs to reflect and answer based on the user's editing requests. For example, inform the target model 160: "If the user's current selection status is to select the ['video_7'] material, use the Python function to answer the user's question: Replace all captions."

[0071] The guidance information also indicates at least one processing example. The at least one processing example includes an editing request and the corresponding model output. For example, inform the target model 160 that when the user's multimedia editing requirement is to bold the subtitles, the output can be textEdit('Replace', ['all_subtitles'], '{ori_str}','re.sub(".+", \' '+str+' \', str)'); when the user's multimedia editing requirement is to translate the subtitle text into French, the output can be textEdit("Translate", ['all_subtitles'], 'fr'); when the user's multimedia editing requirement is to delete the bottom subtitles, the output can be materialDelete(['all_subtitles']), and so on.

[0072] In some embodiments, the remote device 130 sends a second message to the terminal device 110 according to the output information of the target model 160. The second message instructs the terminal device 110 to perform a corresponding editing operation on the target multimedia. In some examples, the output information of the target model 160 may be parameters associated with at least one editing function in a set of editing functions.

[0073] In some embodiments, the remote device 130 may generate a second message according to the output information of the target model 160. The second message is code that can be executed by the terminal device 110. For example, the code is in the typescript format. The remote device 130 sends the second message to the terminal device 110, and the terminal device 110 presents the editing result of the target multimedia in the editing interface 150. In some examples, the output information of the target model 160 includes a first code representation corresponding to a first programming language. The second message includes a second code representation corresponding to a second programming language.

[0074] In the embodiments of the present disclosure, by receiving the user's requirement for editing the target multimedia from the terminal device and generating the guiding information of the target model according to the user's requirement and a set of editing functions for multimedia editing. The remote device sends a corresponding editing operation on the target multimedia according to the information output by the target model. In this way, the user only needs to issue the requirement for editing the multimedia, and the remote device can understand the user's intention by calling the target model, thereby realizing the user's editing requirement.

[0075] Example method

[0076] Figure 5 FIG. shows a flowchart of a process 500 for multimedia editing according to some embodiments of the present disclosure. The process 500 may be implemented by Figure 1 the remote device 130, the terminal device 110, or a combination of the terminal device 110 and the remote device 130 therein. For ease of description, the process 500 is described by taking the example that the process 500 is implemented at the remote device 130.

[0077] In block 510, the remote device 130 receives a first message from the terminal device, and the first message indicates a request to edit the target multimedia.

[0078] In block 520, the remote device 130 generates guiding information to the target model based on the first message and a set of editing functions used by the terminal device for multimedia editing.

[0079] In block 530, the remote device 130 sends a second message to the terminal device based on the output information of the target model, and the second message is used to instruct the terminal device to perform a corresponding editing operation on the target multimedia.

[0080] In some embodiments, the first message is determined based on at least one of the following: content input by a user to a terminal device; or a triggering operation of the user on at least one editing item provided by the terminal device.

[0081] In some embodiments, the guiding information indicates: a set of materials associated with a target multimedia to be edited; a processing state of at least one material; or at least one processing example, where the at least one processing example includes an editing request and a corresponding model output.

[0082] In some embodiments, the output information indicates: at least one target editing function in a set of editing functions; and parameters associated with the at least one target editing function.

[0083] In some embodiments, process 500 further includes: generating a second message based on the output information, where the second message includes a code representation to be executed by the terminal device.

[0084] In some embodiments, the output information includes a first code representation corresponding to a first programming language, and the second message includes a second code representation corresponding to a second programming language.

[0085] Figure 6 A flowchart of a process 600 for multimedia editing according to some embodiments of the present disclosure is shown. Process 600 can be implemented at Figure 1 terminal device 110, or can be implemented in or included in other devices for multimedia editing, such as other terminal devices or service devices. For ease of description, it is assumed that process 600 can be implemented at terminal device 110, and process 600 will be described below with reference to Figure 1 to describe process 600.

[0086] In block 610, terminal device 110 obtains input information via an editing interface for editing a target multimedia, where the input information indicates an editing request for the target multimedia.

[0087] In block 620, terminal device 110 sends a first message to a remote device based on the input information for generating guiding information input to a target model.

[0088] In block 630, terminal device 110 presents an editing result of the target multimedia in the editing interface based on a second message received from the remote device, where the second message is generated based on output information generated by the target model according to the guiding information.

[0089] In some embodiments, obtaining the input information includes: obtaining text content and / or voice content input by a user; receiving a triggering operation of the user on at least one editing item in the editing interface.

[0090] In some embodiments, the editing interface includes an interaction area, and the method further includes: providing a feedback message in the interaction area, the feedback message indicating that at least one editing operation has been applied to the target multimedia.

[0091] In some embodiments, process 600 further includes: providing an adjustment control associated with the feedback message; and modifying an editing parameter associated with at least one editing operation applied to the target multimedia based on a selection of the adjustment control.

[0092] Example apparatus and device

[0093] Embodiments of the present disclosure also provide corresponding apparatuses for implementing the above methods or processes. Figure 7 A schematic structural block diagram of an apparatus 700 for multimedia editing according to some embodiments of the present disclosure is shown. The apparatus 700 may be implemented in or included in, for example, the remote device 130 and / or the terminal device 110, or may be implemented in or included in other devices for multimedia editing, such as other terminal devices or service devices. Each module / component in the apparatus 700 may be implemented by hardware, software, firmware, or any combination thereof.

[0094] As shown in the figure, the apparatus 700 includes a receiving module 710 configured to receive a first message from a terminal device, the first message indicating a request to edit a target multimedia.

[0095] The apparatus 700 further includes a guidance information generation module 720 configured to generate guidance information to a target model based on the first message and a set of editing functions used by the terminal device for multimedia editing.

[0096] The apparatus 700 further includes a second information sending module 730 configured to send a second message to the terminal device based on output information of the target model, the second message being used to instruct the terminal device to perform a corresponding editing operation on the target multimedia.

[0097] In some embodiments, the receiving module 710 further includes a first message determination module configured to: content input by a user to the terminal device; or a triggering operation of at least one editing item provided by the user to the terminal device.

[0098] In some embodiments, the guidance information further indicates: a set of materials associated with the target multimedia to be edited; a processing state of at least one material; or at least one processing example, the at least one processing example including an editing request and a corresponding model output.

[0099] In some embodiments, the output information indicates: at least one target editing function in a set of editing functions; and parameters associated with the at least one target editing function.

[0100] In some embodiments, the second information sending module 730 further includes a second message generating module configured to generate a second message based on the output information, the second message including a code representation to be executed by the terminal device.

[0101] In some embodiments, the output information includes a first code representation corresponding to a first programming language, and the second message includes a second code representation corresponding to a second programming language.

[0102] Figure 8 FIG. shows a schematic structural block diagram of a device 800 for multimedia editing according to some embodiments of the present disclosure. The device 800 may be implemented in or included in, for example, the terminal device 110, or may be implemented in or included in other devices for multimedia editing, such as other terminal devices or service devices. Each module / component in the device 800 may be implemented by hardware, software, firmware, or any combination thereof.

[0103] As shown in the figure, the device 800 includes an information acquisition module 810 configured to acquire input information via an editing interface for editing a target multimedia, the input information indicating an editing request for the target multimedia.

[0104] The device 800 further includes a first message sending module 820 configured to send a first message to a remote device based on the input information for generating guiding information input to the target model.

[0105] The device 800 further includes a presenting editing result module 830 configured to present an editing result of the target multimedia in the editing interface based on a second message received from the remote device, where the second message is generated based on output information generated by the target model according to the guiding information.

[0106] In some embodiments, the information acquisition module 810 is further configured to acquire text content and / or voice content input by the user; receive a triggering operation of the user on at least one editing item in the editing interface.

[0107] In some embodiments, the editing interface includes an interaction area, and the presenting editing result module 830 is further configured to provide a feedback message in the interaction area, the feedback message indicating that at least one editing operation has been applied to the target multimedia.

[0108] In some embodiments, the presenting editing result module 830 is further configured to provide an adjustment control associated with the feedback message; and modify an editing parameter associated with at least one editing operation applied to the target multimedia based on a selection of the adjustment control.

[0109] As Figure 9As shown, the electronic device 900 is in the form of a general-purpose electronic device. The components of the electronic device 900 may include, but are not limited to, one or more processors or processing units 910, a memory 920, a storage device 930, one or more communication units 940, one or more input devices 950, and one or more output devices 960. The processing unit 910 may be an actual or virtual processor and be capable of performing various processes according to the programs stored in the memory 920. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to enhance the parallel processing ability of the electronic device 900.

[0110] The electronic device 900 generally includes multiple computer storage media. Such media can be any accessible media that the electronic device 900 can obtain, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 920 may be a volatile memory (such as registers, caches, random access memory (RAM)), a non-volatile memory (such as read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 930 may be a removable or non-removable medium and may include machine-readable media, such as flash drives, magnetic disks, or any other medium that can be used to store information and / or data and can be accessed within the electronic device 900.

[0111] The electronic device 900 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in Figure 9 a disk drive for reading from or writing to a removable, non-volatile magnetic disk (such as a "floppy disk") and an optical disk drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 920 may include a computer program product 925 having one or more program modules configured to perform various methods or actions of the various embodiments of the present disclosure.

[0112] The communication unit 940 enables communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 900 may be implemented by a single computing cluster or multiple computer machines that can communicate through a communication connection. Thus, the electronic device 900 may operate in a networked environment using a logical connection with one or more other servers, network personal computers (PCs), or another network node.

[0113] The input device 950 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. The output device 960 can be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 900 can also communicate with one or more external devices (not shown) as needed through the communication unit 940. The external devices such as a storage device, a display device, etc., communicate with one or more devices that enable a user to interact with the electronic device 900, or communicate with any device that enables the electronic device 900 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication can be performed via an input / output (I / O) interface (not shown).

[0114] According to an exemplary implementation of the present disclosure, there is provided a computer-readable storage medium having computer-executable instructions stored thereon, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, there is also provided a computer program product, the computer program product being tangibly stored on a non-transitory computer-readable medium and including computer-executable instructions, and the computer-executable instructions being executed by a processor to implement the method described above.

[0115] Aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0116] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is produced that implements the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause a computer, a programmable data processing device, and / or other devices to work in a specific manner. Thus, the computer-readable medium storing the instructions includes a manufacture, which includes instructions for implementing various aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0117] The computer-readable program instructions can be loaded onto a computer, other programmable data processing device, or other device, such that a series of operation steps are performed on the computer, other programmable data processing device, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing device, or other device implement the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0118] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various implementations of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a segment of a program, or a portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions noted in the blocks may occur in a different order than noted in the accompanying drawings. For example, two consecutive blocks may actually be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented by a dedicated hardware-based system that performs the specified functions or actions, or by a combination of dedicated hardware and computer instructions.

[0119] The various implementations of the present disclosure have been described above. The above description is exemplary, not exhaustive, and is not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art in the field of the present technology without departing from the scope and spirit of the described implementations. The selection of the terms used herein is intended to best explain the principles of the implementations, the practical application, or the improvement of the technology in the market, or to enable other ordinary skilled persons in the field of the present technology to understand the various implementation manners disclosed herein.

Claims

1. A multimedia editing method, comprising: Receiving a first message from a terminal device, the first message indicating a request to edit a target multimedia; Generating guiding information to a target model based on the first message and a set of editing functions used by the terminal device for multimedia editing; And Sending a second message to the terminal device based on output information of the target model, the second message being used to instruct the terminal device to perform a corresponding editing operation on the target multimedia.

2. The method according to claim 1, wherein the first message is determined based on at least one of the following: Content input by a user to the terminal device; or A triggering operation of the user on at least one editing item provided by the terminal device.

3. The method according to claim 1, wherein the guiding information indicates: A set of materials associated with the target multimedia to be edited; The processing status of at least one material; or At least one processing example, the at least one processing example including an editing request and a corresponding model output.

4. The method according to claim 1, wherein the output information indicates: At least one target editing function in the set of editing functions; and Parameters associated with the at least one target editing function.

5. The method according to claim 1, further comprising: Generating the second message based on the output information, the second message including a code representation to be executed by the terminal device.

6. The method according to claim 5, wherein the output information includes a first code representation corresponding to a first programming language, and the second message includes a second code representation corresponding to a second programming language.

7. A multimedia editing method, comprising: Obtaining input information via an editing interface for editing a target multimedia, the input information indicating an editing request for the target multimedia; Sending a first message to a remote device based on the input information for generating guiding information input to a target model; And Presenting an editing result of the target multimedia in the editing interface based on a second message received from the remote device, wherein the second message is generated based on output information generated by the target model according to the guiding information.

8. The method according to claim 7, wherein obtaining the input information includes: Obtaining text content and / or voice content input by a user; Receiving a triggering operation of the user on at least one editing item in the editing interface.

9. The method according to claim 7, wherein the editing interface includes an interaction area, and the method further comprises: Providing a feedback message in the interaction area, the feedback message indicating that at least one editing operation has been applied to the target multimedia.

10. The method according to claim 9, further comprising: Providing an adjustment control associated with the feedback message; And Modifying editing parameters associated with the at least one editing operation applied to the target multimedia based on a selection of the adjustment control.

11. An apparatus for multimedia editing, comprising: A receiving module, configured to receive a first message from a terminal device, where the first message indicates a request for editing a target multimedia; A guiding information generating module, configured to generate guiding information to a target model based on the first message and a set of editing functions used by the terminal device for multimedia editing; And A second message sending module, configured to send a second message to the terminal device based on output information of the target model, where the second message is used to instruct the terminal device to perform a corresponding editing operation on the target multimedia.

12. An apparatus for multimedia editing, comprising: An information acquisition module, configured to acquire input information via an editing interface for editing a target multimedia, where the input information indicates an editing request for the target multimedia; A first message sending module, configured to send a first message to a remote device based on the input information for generating guiding information input to a target model; And A presenting editing result module, configured to present an editing result of the target multimedia in the editing interface based on a second message received from the remote device, where the second message is generated based on output information generated by the target model according to the guiding information.

13. A remote device, comprising: At least one processing unit; And At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, where the instructions, when executed by the at least one processing unit, cause the remote device to perform the method according to any one of claims 1 to 6.

14. A terminal device, comprising: At least one processing unit; And At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, where the instructions, when executed by the at least one processing unit, cause the terminal device to perform the method according to any one of claims 7 to 10.

15. A computer-readable storage medium, having stored thereon a computer program, where the computer program is executable by a processor to implement the method according to any one of claims 1 to 6 or claims 7 to 10.

Images