Method and apparatus for interaction, and device and storage medium

Abstract

On the basis of the embodiments of the present disclosure, provided are a method and apparatus for interaction, and a device and a storage medium. The method comprises: receiving, on a first interface, an editing request for media content, wherein the editing request comprises a request in a natural language form and instructs the superimposition of media material and / or the adding of a special effect to the media content; on the basis of the editing request, simultaneously presenting, on the first interface, at least one selectable editing mode of the media content and a first editing effect obtained after a first selectable editing mode among the at least one selectable editing mode is applied to the media content; and in response to receiving confirmation for a target editing mode among the at least one selectable editing mode, presenting, on a second interface, media content edited with a target editing effect corresponding to the target editing mode. In this way, a recommendation of at least one selectable editing mode can be presented for a user on the basis of the parsing of an editing request in a natural language form, so that the editing efficiency of media content is significantly improved and an editing process is also simplified.

Description

Method, apparatus, device and storage medium for interaction

[0001] This application claims priority to the Chinese invention patent application entitled “Methods, devices, equipment and storage media for interaction” filed on December 13, 2023, with application number 202311714195.1, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] Example embodiments of the present disclosure relate generally to the field of computers, and more particularly to methods, apparatuses, devices, and computer-readable storage media for interaction. Background Art

[0003] With the development of social applications, more and more users use social applications to publish pictures or videos that show their daily lives or browse content published by other publishers in the applications. As a result, users' demand for personalized editing of the media content to be published is also increasing.

[0004] Summary of the Invention

[0005] In a first aspect of the present disclosure, a method for interaction is provided. The method includes receiving an editing request for media content on a first interface, the editing request including a request in natural language form, the editing request indicating superimposing media materials and / or adding special effects to the media content; based on the editing request, simultaneously presenting on the first interface at least one optional editing mode for the media content and a first editing effect after applying a first optional editing mode of the at least one optional editing mode to the media content; and in response to receiving confirmation of a target editing mode of the at least one optional editing mode, presenting on a second interface the media content edited with a target editing effect corresponding to the target editing mode.

[0006] In a second aspect of the present disclosure, a device for interaction is provided. The device includes a receiving module configured to receive an editing request for media content on a first interface, the editing request including a request in natural language form, the editing request indicating superimposing media materials and / or adding special effects to the media content; a first presentation module configured to simultaneously present, based on the editing request, at least one optional editing mode of the media content and a first editing effect after applying a first optional editing mode of the at least one optional editing mode to the media content on the first interface; and a second presentation module configured to present, in response to receiving confirmation of a target editing mode in the at least one optional editing mode, the media content edited with a target editing effect corresponding to the target editing mode on a second interface.

[0007] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit;

[0008] and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. The instructions, when executed by the at least one processing unit, cause the apparatus to execute the method of the first aspect.

[0009] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the medium, and when the program is executed by a processor, the method of the first aspect is implemented.

[0010] It should be understood that the contents described in the summary of the present invention are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0012] FIG1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

[0013] 2A to 2D are schematic diagrams illustrating exemplary interfaces of an interaction process according to some embodiments of the present disclosure;

[0014] FIG3 shows a block diagram of an interaction process according to some embodiments of the present disclosure;

[0015] FIG4 shows a flowchart of a process for interaction according to some embodiments of the present disclosure;

[0016] FIG5 shows a block diagram of an apparatus for interaction according to some embodiments of the present disclosure; and

[0017] FIG6 shows a block diagram of a device capable of implementing various embodiments of the present disclosure. DETAILED DESCRIPTION

[0018] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0019] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below.

[0020] It is understandable that the image data involved in this technical solution (including but not limited to the data itself, the acquisition, use, storage or deletion of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0021] It is understandable that before using the technical solutions disclosed in the various embodiments of the present disclosure, the type, scope of use, usage scenarios, etc. of the data involved in the present disclosure should be informed to relevant users and authorization should be obtained from relevant users in an appropriate manner in accordance with relevant laws and regulations. The relevant users may include any type of right holders, such as individuals, enterprises, and groups.

[0022] As used herein, the term "model" can learn the association between corresponding inputs and outputs from training data, so that after training is completed, corresponding outputs can be generated for given inputs. The generation of the model can be based on machine learning technology. Deep learning is a machine learning algorithm that processes inputs and provides corresponding outputs by using multiple layers of processing units. A neural network model is an example of a model based on deep learning. In this article, "model" may also be referred to as "machine learning model", "learning model", "machine learning network" or "learning network", and these terms are used interchangeably in this article.

[0023] As mentioned above, when using social applications, users may want to promptly receive content published by publishers with whom they have a high level of social intimacy. This is especially true for content with a predetermined timeliness, as such content is often only accessible within a limited timeframe after being published.

[0024] When editing media content to be published, users often need to manually select editing controls and experiment repeatedly to add assets or special effects. For example, if a user wants to add background music to a piece of content, they need to access their music library and try out the music randomly or in the order listed to find a satisfactory background music. This process requires a lot of time and effort, and users may not always select the desired material.

[0025] Currently, attempts have been made to apply machine learning models to analyze and understand user requests to perform corresponding operations. Therefore, it is expected to realize personalized editing of media content based on media content editing requests in the form of natural language from users.

[0026] The technical solution disclosed in the present invention provides an interactive solution. According to the interactive solution disclosed in the present invention, an editing request for media content can be received on a first interface of a user device. The editing request is a request in a natural language form and the editing request indicates adding media materials and / or adding special effects to the media content. In the first interface, at least one optional editing mode of the media content is presented based on the editing request, and at the same time, a first editing effect after applying a first optional editing mode in at least one optional editing mode to the media content is presented. If confirmation is received for a target editing mode in at least one optional editing mode, the media content edited with a target editing effect corresponding to the target editing mode is presented on the second interface.

[0027] In this way, based on the analysis of editing requests in natural language form, a recommendation of at least one optional editing mode can be presented to the user, thereby significantly improving the efficiency of editing media content and simplifying the editing process. At the same time, a more personalized and user-friendly solution can be provided for media content editing, thereby improving user satisfaction.

[0028] Sample Environment

[0029] First, reference is made to FIG1 , which schematically illustrates a diagram of an example environment 100 in which example implementations according to the present disclosure may be implemented.

[0030] FIG1 shows a schematic diagram of an example environment 100 in which an embodiment of the present disclosure can be implemented. In the example environment 100, a target application 120 is installed in an electronic device 110. A user 102 can interact with the target application 120 via the electronic device 110 and / or an attached device of the electronic device 110. The target application 120 can be a content sharing application that can provide the user 102 with services related to media content consumption, including browsing, commenting, forwarding, creation (e.g., shooting and / or editing), publishing, etc. of media content. In this article, "media content" can be content in various forms, including video, audio, image, image collection, text, etc.

[0031] In the environment 100 of FIG1 , if the target application 120 is active, the electronic device 110 may present a page 140 of the target application 120 to the user 102. The page 140 may be any of the various pages that the target application 120 can provide, such as a media content presentation page, a content creation page, a content editing page, a message page, a personal page, a shopping mall page, and the like.

[0032] In some embodiments, the target application 120 may include or be implemented as a digital assistant. The digital assistant may be configured to have the ability to have intelligent conversations. In some embodiments, the digital assistant may be integrated into the target application 120 and assist in executing task processing within the target application 120 as part of the target application 120. In some other embodiments, the digital assistant may be configured as an independently running application, such as a web application or other types of applications. In such an example, the digital assistant and the target application 120 may be considered to be the same application. The digital assistant is provided to assist users with various task processing requirements in different applications and scenarios. During the interaction with the digital assistant, the user inputs an interactive message, and the digital assistant provides a reply message in response to the user input. Typically, the digital assistant can support users to input questions in natural language, and perform tasks and provide replies based on their understanding of natural language input and their logical reasoning ability.

[0033] In some embodiments, the digital assistant can interact with user 102 as a contact. For example, the digital assistant can be implemented in an instant messaging (IM) application. For example, the digital assistant can interact with user 102 in a single chat session with user 102. In some other embodiments, the digital assistant can also interact with multiple users in a group chat session including multiple users.

[0034] For user 102, the client of the application running part (e.g., electronic device 110 running target application 120) can present an interaction window of target application 120 or digital assistant in the client interface (e.g., page 140), such as a conversation window with the digital assistant. User 102 can enter a conversation message in the conversation window, and target application 120 can determine the reply message of digital assistant 122 and present it to user 102 in the interaction window. In some embodiments, depending on the configuration of target application 120, the interaction message with target application 120 can include messages in multimodal form, such as text messages (e.g., natural language text), voice messages, image messages, video messages, and the like.

[0035] The application running part can be deployed locally on the terminal device (e.g., electronic device 110) of each user 102, and / or can be supported by a server device (e.g., server 130). For example, the terminal device of user 102 can run a client with an application running part, which can support the interaction between the user and the application running part provided by the server. In the case where the application running part runs locally on the user's terminal device, the user 102 can directly use the terminal device to interact with the local application running part. In the case where the application running part runs on the server device, the server device can, based on the communication connection with the terminal device, implement service provision for the client running in the terminal device. The application running part can present the corresponding application page to the user 102 based on the operation of the user 102, so as to output and / or receive information related to the use of the application to the user 102 and / or receive information from the user 102 from the user 102.

[0036] In some embodiments, the implementation of at least part of the functionality of the target application 120 and / or the implementation of at least part of the functionality of the digital assistant in the target application 120 can be implemented based on the model 131. The model 131 can be deployed, for example, in the server 130. During the operation of the target application 120, the capabilities of one or more models (e.g., the model 131) can be called. In the target application 120, the digital assistant can use the model 131 to understand the user input and provide a reply to the user 102 based on the output of the model 131.

[0037] In some embodiments, model 131 may be a machine learning model, a deep learning model, a learning model, a neural network, etc. In some embodiments, model 131 may be based on a language model (LM). A language model can acquire question-answering capabilities by learning from a large amount of corpus. Model 131 may also be based on other appropriate models.

[0038] In some embodiments, the electronic device 110 communicates with the server 130 to enable the supply of services to the target application 120. The electronic device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface for the user (such as a "wearable" circuit, etc.). The server 130 is a computing system / server of various types that can provide computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, and the like.

[0039] It should be understood that the structure and functionality of environment 100 are described for exemplary purposes only and do not imply any limitation on the scope of the present disclosure.

[0040] Interaction process

[0041] Figures 2A to 2D illustrate schematic diagrams of exemplary interfaces for interaction according to some embodiments of the present disclosure. The following describes the interaction process of an embodiment of the present disclosure in conjunction with Figures 2A to 2D. This process can be implemented, at least in part, at the electronic device 110 shown in Figure 1. For ease of discussion, the process will be described with reference to the environment 100 of Figure 1.

[0042] The interface of electronic device 110 (hereinafter also referred to as the "third interface") can present unedited media content to be published. As shown in Figure 2A, interface 200A presents unedited media content to be published. In some embodiments, the third interface can also provide guidance for obtaining an editing request. For example, if electronic device 110 detects a user triggering an operation on control 201 presented in interface 200A, an interface (hereinafter also referred to as the "first interface") capable of receiving an editing request from the user for the media content to be published is presented.

[0043] For example, control 201 of interface 200A can be understood as an entry point for user 102 to interact with target application 120. Once a trigger operation is detected for control 201, electronic device 110 can present an interactive window for target application 120 on the first interface, such as a conversation window with a media editing assistant. As shown in FIG2B , interface 200B presents a conversation window 202 with a media editing assistant. User 102 can enter an edit request for the media content to be published in conversation window 202.

[0044] It should be understood that in addition to triggering the control 201, in some other embodiments, the user 102 can also make the electronic device 110 present the conversation window 202 with the media editing assistant in other ways, such as through voice triggering.

[0045] For example, if the user 102 inputs and sends an editing request for the media content to be published through the conversation window 202, "Help me find a material template suitable for spring," the first interface may present the media editing assistant's reply to the editing request. As shown in FIG2C , on the interface 200B, in response to the user input editing request 211, "Help me find a material template suitable for spring," the electronic device 110 may present the media editing assistant's reply 212, "Try these templates with spring elements," and selection controls 221 to 224 corresponding to a plurality of recommended optional editing modes. While presenting the selection controls 221 to 224 corresponding to a plurality of recommended optional editing modes, the interface 200B may also present the editing effect corresponding to applying one of the plurality of recommended optional editing modes to the media content to be published.

[0046] In some embodiments, the applied optional editing mode may be the first optional editing mode among multiple recommended optional editing modes. In some other embodiments, the applied optional editing mode may also be any other optional editing mode among multiple recommended optional editing modes.

[0047] It should be understood that any number of optional editing modes, such as one or more recommended optional editing modes, can be recommended based on the user's editing request. The number of recommended optional editing modes is not limited herein.

[0048] If the user is satisfied with the editing effect corresponding to the optional editing mode currently applied to the media content to be published, the user can trigger confirmation of the optional editing mode currently applied to the media content to be published. For example, the user can trigger control 214 on interface 200B to exit the dialogue with the media editing assistant to indicate confirmation of the optional editing mode currently applied to the media content to be published.

[0049] If the user wants to try another optional editing mode other than the currently selected editing mode applied to the media content to be published, the user can trigger a selection control corresponding to the other optional editing mode. For example, if the currently selected editing mode applied to the media content to be published is the optional editing mode corresponding to control 221, the user 102 can trigger control 222 to trigger the application of the optional editing mode corresponding to control 222 to the media content to be published.

[0050] If the user is satisfied with the editing effect corresponding to the optional editing mode attempted this time, confirmation of the optional editing mode attempted this time can be triggered. For example, by triggering control 214 on interface 200B to exit the dialogue with the media editing assistant to indicate confirmation of the optional editing mode currently applied to the media content to be published.

[0051] If it is detected that the user confirms the optional editing mode, the optional editing mode is determined as the target editing mode for editing the media content to be published, and the electronic device 110 can then present the editing effect of applying the target editing mode to the media content to be published on another interface (hereinafter also referred to as the "second interface"). As shown in Figure 2D, the editing effect corresponding to the selected target editing mode can be presented in interface 200C.

[0052] Editing Request Understanding and Execution Process

[0053] In the examples described above, the user's editing request for the media content to be published can be associated with one or more functions (also referred to as "tools") that the electronic device 110 can implement. For example, for the user-input editing request "Help me find a material template suitable for spring" shown in Figure 2C, the electronic device 110 may need to perform special effects processing on the media content to be published, such as adjusting the color saturation and brightness and / or adding stickers / text, etc. In addition, the electronic device 110 may also need to perform the operation of adding relaxing and soothing background music to the media content to be published. This requires analyzing and understanding the editing request in the natural language form input by the user.

[0054] As mentioned above, at least some of the functionality of the target application 120 can be implemented based on a model. The model can be deployed in the server 130. During the operation of the target application 120, the capabilities of one or more models can be invoked. In the target application 120, the media editing assistant can use the model to understand user input and provide a response to the user 102's editing request based on the model's output. In this regard, FIG3 shows a block diagram of the interaction process according to some embodiments of the present disclosure.

[0055] As shown in FIG3 , after the electronic device 110 , for example, the target application 120 deployed on the electronic device 110 , receives a user's edit request 211 for the media content to be published, the electronic device 110 provides the edit request 211 to the execution system 302 at the server 130 .

[0056] In some embodiments, the execution system 302 may obtain registration information during the process of the electronic device 110 registering with the server 130. For example, the registration information may include information about available functions supported by the electronic device 110 and / or the target application 120. For example, the available function information may indicate that the electronic device 110 and / or the target application 120 has functions such as adding music, adding special effects, and overlaying materials to the media content for media content editing. In addition, the available function information may include, for example, a music list in the music library, a special effect template list in the special effect library, and a material list in the material library.

[0057] The received available function information (e.g., editing capability information) of the electronic device 110 and / or the target application 120 can be parsed into independent function information at the execution system 302. This function information has a predetermined information format. This function information can, for example, indicate a function name, function description, function classification, and descriptions of model input and model output parameters associated with the available function. An example of the information format of the example function information is shown below.

[0058] Table 1

[0059] Based on the acquired available function information of the electronic device 110 and / or the target application 120 and the received edit request for the media content, the execution system 302 may provide at least one prompt word associated with the edit request and the available function information to the model 131. The model 131 may be, for example, a natural language model.

[0060] For example, if the edit request is "Add interesting music," execution system 302 determines that the function required to execute the edit request is "Add Music," and the prompt is "Interesting Music." In this case, the input provided to model 131 may be: Function Name: "Add Music"; Input Parameters (i.e., prompts) associated with the function: {Keyword: "Interesting Music"}. The output of model 131 may be, for example, the name of the music required for editing and the ID of the music.

[0061] It should be understood that the above merely provides an example of using the model 131 to determine a function associated with an edit request, in order to facilitate understanding of the input and output of the model 131. Input parameters and output parameters associated with a function may also include other parameters shown in Table 1. For example, in the case where the function is to add music, the prompt word may also include a music genre, a music name keyword, etc., depending on the edit request.

[0062] The output of the model 131 is provided to the execution system 302 , which provides the output as a function required for editing media content to the electronic device 110 , so that the electronic device 110 presents at least one selectable editing mode corresponding to the function through the interface of the target application 120 .

[0063] In some embodiments, a user's editing request for media content may be associated with multiple functions. After receiving an indication of the function associated with the editing request provided by the server 130, the electronic device 110 can determine whether the function provided by the server 130 can satisfy the editing request.

[0064] For example, in response to the user input editing request "Help me find a template suitable for spring" shown in FIG2C , in addition to adding relaxing background music, electronic device 110 may need to perform special effects processing on the media content to be published, such as adjusting color saturation and brightness and / or adding stickers / text. In this case, simply adding music is still not enough to effectively implement the editing request.

[0065] Therefore, the electronic device 110 can then request additional functions from the server 130 again, and the execution system 302 can obtain output from the model 131 again based on other functions associated with the editing request, such as adding a template and prompt words associated with the template to be added, such as recommended optional template names and template identifiers, and provide the model output to the electronic device 110.

[0066] If the electronic device 110 determines that the function obtained from the server 130 side is capable of implementing the operation associated with the editing request, at least one optional editing mode corresponding to the obtained function will be presented on the interface of the target application 120, such as controls 221 to 224 corresponding to multiple optional editing modes shown in Figure 2C.

[0067] In addition, the electronic device 110 may also transmit the result of editing performed at the electronic device 110 based on the function provided by the server to the server 130 .

[0068] In this way, based on the analysis of editing requests in natural language form, a recommendation of at least one optional editing mode can be presented to the user, thereby significantly improving the efficiency of editing media content and simplifying the editing process. At the same time, a more personalized and user-friendly solution can be provided for media content editing, thereby improving user satisfaction.

[0069] Example Process

[0070] 4 shows a flow chart of an interaction process 400 according to some embodiments of the present disclosure. The process 400 may be implemented at the electronic device 110. It should be understood that the process 400 may also be implemented at the server 130.

[0071] In block 410 , the electronic device 110 receives an editing request for media content on a first interface, where the editing request includes a request in a natural language format, and the editing request instructs to overlay media materials and / or add special effects to the media content.

[0072] In box 420, based on the editing request, the electronic device 110 simultaneously presents at least one optional editing mode of the media content and a first editing effect after applying a first optional editing mode of the at least one optional editing mode to the media content in the first interface.

[0073] In box 430, if the electronic device 110 receives confirmation for the target editing mode in the at least one optional editing mode, then in box 440, the electronic device 110 presents the media content edited with the target editing effect corresponding to the target editing mode on the second interface.

[0074] In some embodiments, the electronic device 110 may provide guidance for obtaining the editing request in a third interface presenting the unedited media content; and present the first interface in response to receiving a triggering operation for the guidance.

[0075] In some embodiments, the electronic device 110 may present the media content with the first editing effect on the second interface in response to receiving confirmation of the first selectable editing mode.

[0076] In some embodiments, the electronic device 110 can, in response to receiving a selection of a second optional editing mode among the at least one optional editing mode, present in the first interface a second editing effect after applying the second optional editing mode to the media content; and in response to receiving a confirmation of the second optional editing mode, present in the second interface the media content with the second editing effect.

[0077] In some embodiments, the electronic device 110 can determine at least one target function corresponding to the editing request, wherein the at least one target function is determined by: providing at least one prompt word to a target model and obtaining a model output from the target model, the at least one prompt word being generated based on the editing request and information of multiple available functions associated with editing of the media content; and presenting the at least one optional editing mode based on the at least one target function.

[0078] In some embodiments, the information of multiple available functions includes at least one of the following: function name; function description; function classification; and a description of model input and model output parameters associated with the available functions.

[0079] The electronic device 110 can, in response to determining a first target function corresponding to the editing request, determine whether the at least one optional editing mode can be presented based on the first target function; in response to determining that the at least one optional editing mode cannot be presented based on the first target function, determine a second target function corresponding to the editing request; and present the at least one optional editing mode based on the first target function and the second target function.

[0080] Example devices and equipment

[0081] The embodiments of the present disclosure also provide corresponding devices for implementing the above methods or processes. Figure 5 shows a schematic structural block diagram of a device 500 for interaction according to some embodiments of the present disclosure.

[0082] As shown in Figure 5, the device 500 may include a receiving module 510, which is configured to receive an editing request for the media content on a first interface, wherein the editing request includes a request in natural language form, and the editing request indicates superimposing media materials and / or adding special effects to the media content. The device 500 may also include a first presentation module 520, which is configured to simultaneously present at least one optional editing mode of the media content and a first editing effect after applying the first optional editing mode of the at least one optional editing mode to the media content in the first interface based on the editing request. In addition, the device 500 may also include a second presentation module 530, which is configured to present the media content edited with a target editing effect corresponding to the target editing mode on a second interface in response to receiving confirmation of a target editing mode in the at least one optional editing mode.

[0083] In some embodiments, the device 500 may also include a guidance providing module, configured to: provide guidance for obtaining the editing request in a third interface presenting the unedited media content; and a third presentation module, configured to: present the first interface in response to receiving a trigger operation for the guidance.

[0084] In some embodiments, the apparatus 500 may further include a first editing effect presentation module configured to: in response to receiving confirmation for the first optional editing mode, present the media content with the first editing effect on the second interface.

[0085] In some embodiments, the device 500 may also include a second editing effect presentation module, configured to: in response to receiving a selection of a second optional editing mode among the at least one optional editing mode, present in the first interface a second editing effect after applying the second optional editing mode to the media content; and in response to receiving a confirmation of the second optional editing mode, present in the second interface the media content with the second editing effect.

[0086] In some embodiments, the first presentation module 520 can also be configured to: determine at least one target function corresponding to the editing request, wherein the at least one target function is determined by: providing at least one prompt word to a target model and obtaining a model output from the target model, the at least one prompt word being generated based on the editing request and information of multiple available functions associated with the editing of the media content; and presenting the at least one optional editing mode based on the at least one target function.

[0087] In some embodiments, the information of multiple available functions includes at least one of the following: function name; function description; function classification; and a description of model input and model output parameters associated with the available functions.

[0088] In some embodiments, the first presentation module 520 can also be configured to: in response to determining a first target function corresponding to the editing request, determine whether the at least one optional editing mode can be presented based on the first target function; in response to determining that the at least one optional editing mode cannot be presented based on the first target function, determine a second target function corresponding to the editing request; and present the at least one optional editing mode based on the first target function and the second target function.

[0089] The units included in the device 500 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units can be implemented using software and / or firmware, such as machine executable instructions stored on a storage medium. In addition to or as an alternative to machine executable instructions, some or all of the units in the device 500 can be implemented at least in part by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0090] As shown in Figure 6, computing device / server 600 is in the form of a general-purpose computing device. Components of computing device / server 600 may include, but are not limited to, one or more processors or processing units 610, memory 620, storage device 630, one or more communication units 640, one or more input devices 650, and one or more output devices 660. Processing unit 610 may be a real or virtual processor and is capable of performing various processes according to a program stored in memory 620. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to increase the parallel processing capabilities of computing device / server 600.

[0091] The computing device / server 600 typically includes a plurality of computer storage media. Such media can be any available media accessible to the computing device / server 600, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 620 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 630 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk, or any other medium that can be used to store information and / or data (e.g., training data for training) and can be accessed within the computing device / server 600.

[0092] The computing device / server 600 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG6 , a disk drive for reading from or writing to a removable, non-volatile disk (e.g., a “floppy disk”) and an optical drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 620 may include a computer program product 625 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0093] The communication unit 640 enables communication with other computing devices via a communication medium. Additionally, the functionality of the components of the computing device / server 600 can be implemented as a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the computing device / server 600 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or other network nodes.

[0094] Input device 650 may be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 660 may be one or more output devices, such as a display, speaker, printer, etc. Computing device / server 600 may also communicate with one or more external devices (not shown) via communication unit 640 as needed, such as storage devices, display devices, etc., with one or more devices that allow a user to interact with computing device / server 600, or with any device that allows computing device / server 600 to communicate with one or more other computing devices (e.g., a network card, modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0095] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which one or more computer instructions are stored, wherein the one or more computer instructions are executed by a processor to implement the method described above.

[0096] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0097] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0098] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device, so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0099] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0100] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the implementations disclosed herein.

Claims

1. A method for interaction, comprising: Receiving, on a first interface, an editing request for media content, the editing request comprising a request in a natural language format, the editing request indicating superimposing media material and / or adding special effects to the media content; Based on the editing request, in the first interface, simultaneously presenting at least one optional editing mode of the media content and a first editing effect after a first optional editing mode of the at least one optional editing mode is applied to the media content; as well as In response to receiving confirmation of a target editing mode among the at least one selectable editing mode, presenting the media content edited with a target editing effect corresponding to the target editing mode on a second interface.

2. The method according to claim 1, further comprising: In a third interface presenting the unedited media content, providing guidance for obtaining the editing request; In response to receiving a triggering operation for the guidance, presenting the first interface.

3. The method according to claim 1 or 2, further comprising: In response to receiving confirmation for the first selectable editing mode, presenting the media content with the first editing effect on the second interface.

4. The method according to claim 1 or 2, further comprising: In response to receiving a selection of a second selectable editing mode among the at least one selectable editing mode, presenting in the first interface a second editing effect after the second selectable editing mode is applied to the media content; as well as In response to receiving confirmation for the second selectable editing mode, presenting the media content with the second editing effect on the second interface.

5. The method of claim 1 , wherein presenting the at least one selectable editing mode comprises: determining at least one target function corresponding to the editing request, wherein the at least one target function is determined by: providing at least one cue word to a target model, and obtaining a model output from the target model, the at least one cue word being generated based on the editing request and information of a plurality of available functions associated with editing of the media content; as well as The at least one selectable editing mode is presented based on the at least one target function.

6. The method according to claim 5, wherein the information of the plurality of available functions comprises at least one of the following: Function name; Functional description; Functional classification; and Descriptions of the model input and model output parameters associated with the available functions.

7. The method of claim 5, wherein presenting the at least one selectable editing mode based on the at least one target function comprises: In response to determining a first target function corresponding to the editing request, determining whether the at least one selectable editing mode can be presented based on the first target function; In response to determining that the at least one selectable editing mode cannot be presented based on the first target function, determining a second target function corresponding to the editing request; as well as The at least one selectable editing mode is presented based on the first target function and the second target function.

8. A device for interaction, comprising: A receiving module is configured to receive an editing request for media content on a first interface, wherein the editing request includes a request in a natural language format, and the editing request indicates superimposing media materials and / or adding special effects to the media content; A first presentation module is configured to present, in the first interface, based on the editing request, at least one optional editing mode of the media content and a first editing effect after a first optional editing mode of the at least one optional editing mode is applied to the media content; as well as The second presentation module is configured to present, in response to receiving confirmation of a target editing mode in the at least one optional editing mode, the media content edited with a target editing effect corresponding to the target editing mode on a second interface.

9. An electronic device, comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 7 when executed by the at least one processing unit.

10. A computer-readable storage medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the method according to any one of claims 1 to 7.

Images