Media content processing method, apparatus, device, medium, and product

Abstract

The present disclosure relates to a media content processing method, apparatus, device, medium and product. The method includes displaying a first media content in a first interface, the first interface being one of a first conversation interface and a first editing interface, the first media content being obtained after a first media content processing operation on a second media content in the first interface. The method further includes receiving a first operation, the first operation being triggered for the first interface. The method further includes displaying the first media content in a second interface, the second interface being the other one of the first conversation interface and the first editing interface. The method further includes editing the first media content in the second interface. Through the method, the editing state conversion efficiency between the conversation interface and the editing interface can be improved, and the continuity of media content editing and user operation experience can be improved.

Description

Technical Field

[0001] This article covers the field of media content processing in general, and specifically covers media content processing methods, devices, equipment, media and products. Background Technology

[0002] With the continuous development of the mobile internet and digital content ecosystem, images and videos have become important carriers for users to record life, express creativity, share socially, and create content. Users can use media content editing tools on their devices to add filters, beautify images, add stickers, overlay text, configure music, and generate special effects to enhance the expressiveness and dissemination of image content. The development of media content editing technology has lowered the barrier to entry for ordinary users to create visual content, enabling them to more easily achieve personalized expression, aesthetic optimization, and content publishing. Media content editing tools can be standalone applications or integrated into multimedia content sharing or social applications.

[0003] With the continuous advancement of artificial intelligence, computer vision, and mobile computing capabilities, media content editing tools have gradually evolved from basic parameter adjustment tools into comprehensive creation tools integrating intelligent recognition, effect recommendation, automatic enhancement, template generation, and creative assistance. By analyzing image content, subject matter, visual style, color characteristics, and user editing intent, media content editing tools can provide users with richer editing capabilities and more diverse visual effects, helping them generate highly polished multimedia content works in a shorter time. This type of technology helps improve the efficiency of multimedia content editing, enriches users' creative methods, and promotes the widespread application of multimedia content in social media, entertainment, e-commerce, advertising, and digital media scenarios. Summary of the Invention

[0004] This article provides a method, apparatus, device, medium, and product for media content processing.

[0005] According to the first aspect of this document, a media content processing method is provided. The method includes displaying first media content on a first interface, which is one of a first dialog interface and a first editing interface. The first media content is obtained after performing a first media content processing operation on second media content on the first interface. The method also includes receiving a first operation triggered by the first interface. Furthermore, the method includes displaying the first media content on a second interface, which is the other of the first dialog interface and the first editing interface. Finally, the method includes editing the first media content on the second interface. This method improves the efficiency of transitions between editing states in the dialog interface and the editing interface, enhancing the continuity of media content editing and the user experience.

[0006] According to a second aspect of this document, a media content processing apparatus is provided. The apparatus includes a first display module for displaying first media content on a first interface, the first interface being one of a first dialog interface and a first editing interface, the first media content being obtained after performing a first media content processing operation on second media content on the first interface; a first operation receiving module for receiving a first operation triggered by the first interface; a second display module for displaying the first media content on a second interface, the second interface being the other of the first dialog interface and the first editing interface; and a content editing module for editing the first media content on the second interface. This apparatus can improve the efficiency of editing state transitions between the dialog interface and the editing interface, enhancing the continuity of media content editing and the user experience.

[0007] In a third aspect of this document, an electronic device is provided, including at least one processor and a storage device for storing at least one program, which, when executed by the at least one processor, causes the at least one processor to implement the method according to the first aspect of this document. This electronic device enables the continuous presentation of editing results and editing operation information between a dialog interface and an editing interface, improving the efficiency of transitions between different editing interfaces and enhancing the consistency of state and user experience during media content editing.

[0008] In a fourth aspect of this document, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements the method according to the first aspect of this document. The program stored in this computer-readable storage medium enables users to continue to perceive editing results and editing operation information after switching between a dialog interface and an editing interface, thereby improving the efficiency of interface transitions, the display effect of editing status, and the user experience during media content editing.

[0009] In a fifth aspect of this document, a computer program product is provided. This computer program product includes a computer program that, when executed by a processor, implements the method according to the first aspect of this document. Through this computer program product, when the program is executed by the processor, the user can continue to perceive the current editing result and the interface information corresponding to previous editing operations after switching between a dialog interface and an editing interface, thereby improving the display effect of the editing status, the efficiency of interface transitions, and the user experience during the media content editing process.

[0010] It should be understood that the content described in this section is not intended to define the key or essential features of this document, nor is it intended to limit the scope of this document. Other features of this document will become readily apparent from the following description. Attached Figure Description

[0011] The above and other objects, features and advantages of this document will become more apparent from a more detailed description taken in conjunction with the accompanying drawings, wherein like reference numerals generally denote like parts.

[0012] Figure 1 The illustration shows a schematic diagram of an example environment in which the device and / or method may be implemented;

[0013] Figure 2 The illustration shows a sample method for media content processing;

[0014] Figure 3 The diagram illustrates an example of the modular architecture of a dual-interface media content editing system.

[0015] Figure 4 The diagram illustrates an example flow of switching between two interfaces.

[0016] Figure 5 This diagram illustrates an example flow of the mapping from the dialog interface to the editing interface.

[0017] Figure 6 The diagram illustrates an example flow describing the mapping from the editing interface to the dialog interface.

[0018] Figure 7 The diagram illustrates an example flow of cross-interface undo and redo.

[0019] Figure 8 The illustration shows a sample of the editing interface.

[0020] Figure 9 The illustration shows an example of pulling up the input component in the editing interface.

[0021] Figure 10 The illustration shows an example of generating a mask in the editing interface.

[0022] Figure 11 The illustration shows an example of a page after the generated controls are collapsed.

[0023] Figure 12 The illustration shows an example of a multi-round result display interface.

[0024] Figure 13 The illustration shows a sample of the work publishing interface.

[0025] Figure 14 The diagram illustrates an example of a dialog interface.

[0026] Figure 15 The illustration shows an example of creating content through a dialog interface.

[0027] Figure 16 The illustration shows a schematic block diagram of a media content processing device;

[0028] Figure 17 A schematic block diagram is shown for an example device used to implement the contents of this article. Detailed Implementation

[0029] It is understood that the data involved in this article (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0030] It is understandable that before using the technical content disclosed in this article, users should be informed of the type, scope of use, and usage scenarios of the personal information involved in this article in an appropriate manner in accordance with relevant laws and regulations, and their authorization should be obtained.

[0031] For example, upon receiving a user's proactive request, a prompt message can be sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as electronic devices, applications, servers, or storage media, that perform the operations described in this document.

[0032] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0033] It is understood that the above notification and user authorization process is merely illustrative and does not limit the implementation method described in this article. Other methods that comply with relevant laws and regulations may also be applied to the implementation method described in this article.

[0034] The present invention will now be described in more detail with reference to the accompanying drawings. While the drawings illustrate the contents of this document, it should be understood that this document can be implemented in various forms and should not be construed as limited to the contents set forth herein; rather, these contents are provided to provide a more thorough and complete understanding of the document. It should be understood that the drawings and contents of this document are for illustrative purposes only and are not intended to limit the scope of this document.

[0035] In this description, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0036] In existing media content editing technologies, users typically edit media content such as images and videos through either a dialog-based interface or an editing interface. The dialog-based interaction mode allows users to express their editing intentions using natural language, while the editing interface allows for fine-tuning through panels, controls, and sliders. However, in existing technologies, the two interaction modes are usually relatively independent. Editing operations performed by a user in one interaction mode may not be accurately represented in the corresponding interface content when switching to another interaction mode.

[0037] For example, after a user completes operations such as applying filters, effects, beautification, or basic adjustments in the conversational interaction mode, the state of the relevant controls may not remain consistent with the current editing result when switching to the editing interface. Similarly, after adjusting control parameters in the editing mode of the editing interface, the dialogue content may lack descriptions of these operations when switching back to the conversational interface. As a result, existing technologies are prone to problems such as fragmented editing states between different interactive interfaces, discontinuous operation history, and high costs for users to continue editing.

[0038] To address this, this paper proposes a method for media content processing. In this method, a computing device displays first media content on a first interface, which is either a first dialog interface or a first editing interface. The first media content is obtained after performing a first media content processing operation on second media content on the first interface. The computing device then receives a first operation triggered on the first interface. Next, the computing device displays the first media content on a second interface, which is either the first dialog interface or the first editing interface. The computing device then edits the first media content on the second interface. This method allows for continuous presentation of the edited media content and corresponding information when switching between the dialog interface and the editing interface, thereby improving the user's perception of the current editing result and editing history, enhancing the interface transition effect between different interactive interfaces, and improving the media content editing experience.

[0039] The following will describe this article in further detail with reference to the accompanying drawings. Figure 1 An example environment 100 is shown in which the devices and / or methods described herein may be implemented. Figure 1 As shown, environment 100 may include computing device 102 and application 104 running on computing device 102. Computing device 102 can display a corresponding interface, receive user operations, process interface data, and display processing results by running application 104.

[0040] Examples of computing device 102 include, but are not limited to, personal computers, server computers, handheld or laptop devices, mobile devices (such as mobile phones, personal digital assistants (PDAs), media players, etc.), multiprocessor systems, consumer electronics, minicomputers, mainframe computers, and distributed computing environments that include any of the above systems or devices. The application 104 running on the computing device may be a content platform application, a social application, a content creation application, a shopping application, an office application, a live streaming application, or a combined application that includes one or more of the above functions.

[0041] The steps performed by the computing device 102 in this article, such as interface display, information presentation, operation reception, data processing, content updating, page switching, and result display, can all be implemented by the application 104 running in the computing device 102, and will not be described in detail hereafter.

[0042] The above combination Figure 1 A schematic diagram illustrating an example environment in which the devices and / or methods described herein may be implemented is provided below. Figure 2 A diagram illustrating an example method for processing media content according to this article. Figure 2 The method in can be derived from Figure 1 The computing device 102 or any suitable device in the system can be used for execution.

[0043] like Figure 2 As shown, in example method 200, at box 202, the computing device can display first media content in a first interface. The first interface is one of a first dialog interface and a first editing interface. The first media content is obtained after performing a first media content processing operation on second media content in the first interface. For example, the second media content can be an image, video, or other media material to be processed. The first media content processing operation can include adding special effects, applying filters, adjusting screen parameters, beautifying, adding text, adding stickers, or other media content processing operations.

[0044] At box 204, the computing device receives a first operation. The first operation is triggered in response to a first interface. After the first interface is displayed, the computing device can further receive user operations triggered on the first interface for switching between the first dialog interface and the first editing interface.

[0045] For example, if the first interface is a first editing interface, the first operation can be an operation triggered on the input component or an operation triggered on the second prompt content in the input component; if the first interface is a first dialog interface, the first operation can be an operation that triggers the second control in the first dialog interface.

[0046] In one scenario, the first interface can be a first editing interface, and the second interface can be a first dialog interface. The first editing interface may include at least one editing control, and the first media content processing operation may be an operation that triggers one or more of the at least one editing control. For example, a user can process the second media content using filter controls, special effects controls, beauty controls, or adjustment sliders to obtain the first media content.

[0047] In one scenario, the first operation is triggered directly on the first editing interface. For example, a control for switching from the first editing interface to the first dialog interface may be displayed on the first editing interface. The first operation is triggered on this control, such as a click or long press. In another scenario, before receiving the first operation, the computing device may receive a second operation, which is triggered on the first control on the first editing interface. Afterward, the computing device may display an input component on the first editing interface for inputting media content processing instructions in natural language. This input component can serve as a lightweight dialog input entry point in the first editing interface, allowing the user to input media content processing instructions in natural language within the first editing interface without first entering the first dialog interface. In this scenario, the first operation may be triggered on the input component.

[0048] In one scenario, before receiving the first operation, the computing device can receive a first media content processing instruction via an input component and process the first media content based on the instruction. For example, a user can input natural language commands such as "brighter," "change to film style," or "add a fireworks effect" into the input component. The computing device can then continue processing the first media content according to this instruction. Subsequently, after entering the first dialogue interface, the computing device can also display the first media content processing instruction as a dialogue message within the first dialogue interface. Thus, the input content in the lightweight input component can be carried over to the main dialogue interface.

[0049] In one scenario, before receiving the first operation, the computing device can also display a response message corresponding to the first media content processing instruction. For example, after the user inputs a media content processing instruction in natural language form through the input component, the computing device can display a system response message to indicate that it has understood the user's editing intent or is performing the corresponding processing. Subsequently, after entering the first dialogue interface, the computing device can also display the response message in the first dialogue interface. Thus, the interaction process in the input component can form a continuous dialogue record in the first dialogue interface.

[0050] In one scenario, before receiving a second operation, the computing device can display first media content and a first control in a first editing interface. The first control is used to rotate multiple prompts. After the user triggers a third operation based on the rotated prompts, the computing device can display an input component on the first editing interface and display media content processing instructions corresponding to the rotated prompts within the input component. For example, the rotated prompts could be recommended effects, recommended templates, or content like "Chat with AI." For instance, the first control could rotate and display "Add fireworks effects." After the user triggers this prompt, the computing device can display an input component on the first editing interface and automatically display the media content processing instruction "Add fireworks effects to the current image" within the input component.

[0051] In one scenario, the input component may also include multiple prompts. After receiving a fourth operation triggered by the first prompt among the multiple prompts, the computing device can process the first media content based on the first prompt and adjust the control parameters of at least one editing control to correspond to the processed first media content. For example, after a user selects one of the prompts, "Retro Filter," in the input component, the computing device can apply the retro filter to the first media content and simultaneously adjust the selection state and intensity parameters of the filter control. Thus, a correspondence can be established between the natural language prompts and the editing control parameters.

[0052] In one scenario, the input component may also include multiple prompts, and the first action may be triggered by a second prompt. For example, the second prompt could be "Chat with AI" or other prompts used to enter the main dialogue interface. After triggering the second prompt, the user can enter the first dialogue interface from the first editing interface to continue conversational processing around the first media content within the first dialogue interface.

[0053] In one scenario, the computing device may also display at least one thumbnail corresponding to at least one media content processing operation on the first editing interface. The at least one thumbnail may be used to represent media content corresponding to different processing operations, media content corresponding to different generation rounds, or different versions of processing results. After the user triggers a fifth operation on the first thumbnail among the at least one thumbnail, the computing device may display the media content corresponding to the first thumbnail on the first editing interface.

[0054] In one scenario, the first interface can be a first dialog interface, and the second interface can be a first editing interface. The first dialog interface may include a second control, and the first operation may be an operation that triggers the second control. For example, after viewing the first media content in the first dialog interface, the user can trigger the second control to enter the first editing interface and continue editing the first media content using the editing controls. In another scenario, the second control may be an interface closing control.

[0055] At box 206, after receiving the first operation, the computing device can display the first media content on a second interface, which is the other of the first dialog interface and the first editing interface. For example, when the first interface is the first editing interface, the second interface can be the first dialog interface; when the first interface is the first dialog interface, the second interface can be the first editing interface.

[0056] In one scenario, the second interface may further include representation information corresponding to the first media content processing operation. This representation information can be used to characterize the processing procedure of the first media content in the first interface or parameter information corresponding to the processing operation. For example, when the first interface is a first editing interface and the second interface is a first dialog interface, the representation information can be represented as dialog messages; when the first interface is a first dialog interface and the second interface is a first editing interface, the representation information can be represented as control parameters of the editing control.

[0057] In one scenario, the first interface can be a first editing interface, and the second interface can be a first dialog interface. The first editing interface may include at least one editing control, and the first media content processing operation may be an operation that triggers one or more of the at least one editing control. In this case, the display information may include a first dialog message displayed in the first dialog interface, which describes the first media content processing operation. For example, after a user adjusts the filter intensity, adds effects, or modifies the brightness in the first editing interface, when they enter the first dialog interface, the computing device can display a first dialog message describing these processing operations.

[0058] In one scenario, the first interface can be a first dialog interface, and the second interface can be a first editing interface. The first media content processing operation can be triggered by a second dialog message sent from the first dialog interface, and this second dialog message can be used to describe the first media content processing operation. In this case, the information may include control parameters of at least one editing control in the first editing interface. For example, after a user sends "Add a film filter" in the first dialog interface and enters the first editing interface, the computing device can display the selection status and intensity parameters of the corresponding filter in the filter control.

[0059] At box 208, the computing device can edit the first media content in the second interface. For example, when the second interface is the first dialog interface, the user can continue to input media content processing instructions in natural language form to further process the first media content; when the second interface is the first editing interface, the user can continue to trigger editing controls, adjust control parameters, or input natural language instructions through input components to further edit the first media content.

[0060] In one scenario, the first editing interface may further include an input component. The computing device can receive a second media content processing instruction via the input component. This second media content processing instruction is in natural language, and the corresponding control parameters are displayed in the first editing interface. For example, if a user inputs "brighten it a little" in the input component of the first editing interface, the computing device can display the brightness control parameters corresponding to that natural language instruction. Thus, the natural language instruction in the input component can also be mapped to the editing control parameters in the first editing interface.

[0061] This method allows for the continuous display of acquired media content while switching between the first dialogue interface and the first editing interface. It also seamlessly integrates media content processing instructions, dialogue messages, system responses, and editing control parameters in natural language format across different interfaces. This eliminates the need for users to re-enter editing requirements or readjust control parameters after switching interfaces, enabling them to continue editing based on the current media content. This improves the continuity of cross-interface media content processing, editing efficiency, and user experience.

[0062] The above combination Figure 2 A diagram illustrating the example methods for media content processing described in this paper is provided below. Figure 3 A schematic diagram illustrating an example of the modular architecture of a dual-interface media content editing system. Figure 3 Example 300 in the example can be derived from Figure 1 The computing device 102 or any suitable device in the process is processed by running the application.

[0063] like Figure 3 As shown, Example 300 illustrates the modular architecture of a dual-interface interactive switching system for media content editing. The modular architecture may include an interface switching controller 302, an operation stack manager 304, a protocol constraint checker 306, a unified state manager 308, a message mapping engine 310, a dialog interface 312, and an editing interface 314.

[0064] The interface switching controller 302 can be used to coordinate the overall process of interface switching, including state snapshot generation, message mapping execution, interface transition, and constraint checking. The operation stack manager 304 can be used to maintain a unified undo and redo stack across interfaces and record the state differences before and after each editing operation.

[0065] The protocol constraint checker 306 can be used to verify the legality of editing parameters during mode switching to ensure that scene constraints and effect mutual exclusion rules are met. Specifically, the protocol constraint checker 306 can perform scene constraint checks, effect mutual exclusion checks, and single effect constraint checks. Scene constraint checks can be used to compare the current editing capability state with the protocol range supported by the target scene. For example, when switching from the editing interface to the dialogue interface, if the current editing state includes editing effects not supported by the dialogue interface, such as AI-generated effects, the computing device can display a prompt to the user and provide processing options such as automatic removal, retention without display, or cancellation of the switch. Effect mutual exclusion checks can be used to check whether the current editing state includes mutually exclusive effect combinations according to the editing capability constraint rules, such as configuring "one-click to create a video" and "filters" simultaneously. When a conflict is detected, the computing device can determine which editing effects to retain and which to remove based on effect priority rules. Single effect constraint checks can be used to verify whether only one of the same type of editing effect is configured, such as configuring multiple filter effects simultaneously. In the case of multiple editing effects of the same type, the computing device can retain the last configured editing effect.

[0066] The Unified State Manager 308 is used to maintain a unified editing state model across interfaces. This unified editing state model can include a list of materials, hierarchically organized global editing parameters by editing capability type, an operation history list, and a dialogue context. The global editing parameters can include parameters corresponding to editing capabilities such as filters, beautification, basic adjustments, effects, stickers, and music. A unified editing state model can be used to facilitate unified maintenance of editing states across different editing modes. It should be noted that the unified editing state model can also be extended or adjusted based on the editing capabilities, material types, protocol versions, or interface forms supported by the media content editing tool.

[0067] In one scenario, a unified editing state model can organize all editing parameters using a hierarchical structure, with each layer corresponding to an editing capability within the editing operation protocol. For example, filter capabilities could correspond to filter resource identifiers, filter intensity, and enabled status; beautification capabilities could correspond to beautification presets and sub-items; and basic adjustment capabilities could correspond to adjustment sub-items such as brightness, contrast, and saturation. The key design of this state model lies in the editing capability state portion, which can be aligned with the editing capability states and editing operation structures in the intelligent system's input or output protocols. This allows the state structure of each editing capability to directly correspond to its data exchange format configuration. Consequently, the mapping from editing operations to editing interface parameters can be completed based on the unified editing state model without the need for an additional intermediate conversion layer.

[0068] The message mapping engine 310 can be used for bidirectional switching between editing operations, function call operations, and the state of controls in the editing interface panel during mode switching. The dialog interface 312 can correspond to a dialog-style editing interface, and the editing interface 314 can correspond to a graphical user interface-style editing interface.

[0069] The above combination Figure 3 A schematic diagram illustrating an example of the modular architecture of a dual-interface media content editing system is provided below; Figure 4 A schematic diagram illustrating an example flow of switching between two interfaces.

[0070] like Figure 4 As shown, Example 400 illustrates the process of switching between two interfaces. At step 402, this process can be executed after an interface switching trigger event is detected, such as detecting a click on a switching control, to switch between the dialog interface and the editing interface, maintaining consistency between the editing results and the interface content during the switching process.

[0071] In step 404, the computing device may perform snapshot generation. For example, the computing device may record a complete state snapshot of the current mode before the switch, which may contain a complete copy of the unified editing state model. The unified editing state model can be used to represent information such as the current target material, editing results, editing parameters, operation history, and dialogue context.

[0072] In step 406, the computing device can perform constraint checks. For example, a protocol constraint checker can verify whether the current editing state meets the constraint requirements of the target scenario. For example, when switching from the editing interface to the dialog interface, the computing device can check whether there are any editing effects that the dialog interface does not support; if there are unsupported editing effects, it can prompt the user or automatically remove the unsupported editing effects.

[0073] In step 408, the computing device can determine the interface switching direction. The switching direction may include switching from a dialog interface to an editing interface, or vice versa. The computing device can determine the subsequent message mapping process to be executed based on the different switching directions.

[0074] Next, the computing device can invoke the message mapping engine to perform a state transition. In step 410, if the switching direction is from the dialog interface to the editing interface, the computing device can execute the mapping process from the dialog to the editing interface; in step 412, if the switching direction is from the editing interface to the dialog interface, the computing device can execute the mapping process from the editing interface to the dialog interface.

[0075] In step 414, the computing device may execute interface transition animations for interface switching. For example, when switching from a dialog interface to an editing interface, the input box may be collapsed and the editing panel may slide in from the bottom; when switching from an editing interface to a dialog interface, the editing panel may be collapsed, the input box may be expanded, and the dialog message flow may move up.

[0076] In step 416, the computing device can apply the mapped editing state to the target interface controls and the dialog flow. For example, when the target interface is an editing interface, the control state corresponding to the current editing state can be displayed in the corresponding editing panel; when the target interface is a dialog interface, the dialog message corresponding to the current editing state or editing operation can be displayed in the dialog flow.

[0077] In step 418, the computing device can perform a recorded interface switching operation. Specifically, the computing device can insert an interface switching operation record into the operation history. The operation type of this record can be a mode switching operation, and it can record the interface identifiers before and after the switch. This interface switching operation record can serve as an anchor point for subsequent cross-interface undo or redo.

[0078] This method allows computing devices to record a complete snapshot of the state before switching between a dialog interface and an editing interface, and then check it according to the constraints of the target interface. This reduces problems such as loss of editing effects, abnormal interface display, or inconsistent editing states caused by different interface support capabilities.

[0079] The above combination Figure 4 A schematic diagram illustrating an example flow of switching between two interfaces is provided below. Figure 5 A schematic diagram illustrating an example flow of mapping from the dialog interface to the editing interface.

[0080] like Figure 5As shown in Example 500, the mapping process from the dialog interface to the editing interface is illustrated. This process can be executed when the user switches from the dialog interface to the editing interface, and is used to convert the editing operation corresponding to the dialog message into the editing panel state and editing control state in the editing interface.

[0081] In step 502, the computing device can traverse the dialogue messages and extract editing operations. For example, the computing device can traverse the intelligent system's reply messages from the message list of the dialogue context and extract the editing operations and function call operations associated with each reply message. For example, for each intelligent system reply message, the computing device can obtain the operation identifier field associated with the reply message and look up the corresponding operation record from the operation history based on the operation identifier. Further, the computing device can filter out operations of type editing from the found operation records. Function call operations can be reflected as an open panel in the editing interface and can be processed separately in subsequent steps.

[0082] In step 504, the computing device can group the extracted editing operations according to the editing capability type. For example, the computing device can group the editing operations according to editing capability types such as filters, beautification, basic adjustments, special effects, stickers, and music, so that the parameters corresponding to different editing capabilities can be processed separately.

[0083] In step 506, the computing device can perform parameter merging on the grouped editing operations. For the extracted editing operation sequence, it is grouped by editing capability type (filter, beauty, adjustment, effects, etc.), and parameter merging calculation is performed on each group. The parameter merging strategy can include an overlay strategy, an accumulation strategy, and a merging strategy. Through parameter merging, the computing device can determine the control state that each editing capability should ultimately be presented in the editing interface based on the multiple editing operations generated in the multi-turn dialogue.

[0084] In step 508, the computing device can execute an overriding strategy. The overriding strategy can be applied to mutually exclusive editing capabilities, where parameters corresponding to a later editing operation can override parameters corresponding to a previous editing operation. For example, for editing capabilities such as filters and effects that do not support configuring multiple effects simultaneously, the computing device can use the configuration information corresponding to the last editing operation as the merging result.

[0085] In step 510, the computing device can execute an accumulation strategy. The accumulation strategy can be applied to continuous parameters that can be accumulated, such as sub-parameters like brightness, contrast, and saturation in basic adjustments. For the same sub-parameter, the computing device can overwrite the previous parameter value with the parameter value corresponding to the next editing operation; for different sub-parameters, the computing device can merge them into the same sub-item set to obtain the control state that corresponds to multiple basic adjustment sub-items.

[0086] In step 512, the computing device may execute a merging strategy. The merging strategy may be applicable to some mergeable composite editing capabilities, such as beautification capabilities. Beautification capabilities may include preset styles and multiple beautification sub-items. The preset styles may employ an overriding strategy, meaning that later selected preset styles override earlier selected preset styles. Multiple beautification sub-items may employ an accumulating strategy, meaning that different beautification sub-items are merged, while retaining the parameter values ​​corresponding to each beautification sub-item.

[0087] In step 514, the computing device can obtain the merged editing capability status. The merged editing capability status can represent the final state that each editing capability should present in the editing interface, such as the currently selected filter, filter intensity, beauty preset, beauty sub-item intensity, basic adjustment sub-item parameters, and special effects selection status, etc.

[0088] In step 516, the computing device can map the parameters in the merged editing capability states to the control states of the editing interface panel. For example, for the filter capability, the computing device can open the filter panel, locate the filter item corresponding to the resource identifier, and set the intensity slider to the corresponding intensity value; for the beautification capability, the computing device can open the beautification panel and set the preset style selector and each beautification sub-item slider respectively; for the basic adjustment capability, the computing device can open the adjustment panel and set each basic adjustment sub-item slider respectively; for the special effects capability, the computing device can open the special effects panel and locate the special effects item corresponding to the resource identifier; for the music capability, the computing device can locate the selected music item.

[0089] In one scenario, a computing device can convert protocol parameter values ​​into values ​​for editing interface controls. For example, for a slider control, the computing device can determine the slider position based on the parameter values, minimum value, maximum value, and slider range; for a selector control, the computing device can determine the position of the corresponding option in the selector based on the resource identifier; and for a switch control, the computing device can determine the on or off state of the switch control based on its enabled state.

[0090] In step 518, the computing device can execute a panel positioning strategy. The computing device can automatically locate the function panel corresponding to the most recent editing operation in the dialogue. For example, the computing device can determine the most recent editing operation from the merged operation record and locate the corresponding function panel based on the editing capability type corresponding to that operation. Furthermore, the computing device can highlight the modified controls in the function panel, for example, by flashing, outlining, or highlighting, and can display a summary of recent dialogue operations in the information bar at the top of the panel.

[0091] In step 520, the computing device can represent function call operations as panel states. Function call operations output by the intelligent system in dialogue mode, such as opening the effects panel, opening the music panel, and opening the sticker panel, can be represented as the open or closed state of the corresponding panel in the editing interface mode. For example, the function call operation to open the effects panel can be associated with expanding the effects panel; if the location parameter indicates a search page, the computing device can default to entering the search page and pre-filling keywords. The function call operation to open the music panel can be associated with expanding the music panel, and can similarly perform page positioning or search pre-filling based on the location parameter and keywords.

[0092] In step 522, the computing device can determine that the editing interface is ready. At this time, the editing interface can display the editing panel, control status, panel open status, and current editing result corresponding to the editing operation in the dialog interface, so that the user can continue editing based on the current editing result after switching to the editing interface.

[0093] This method can improve the consistency between the dialog editing results and the display status of the editing interface, reducing the need for users to repeatedly search for or reset editing parameters.

[0094] The above combination Figure 5 A diagram illustrating an example flow of mapping from the dialog interface to the editing interface is provided below. Figure 6 A schematic diagram illustrating an example flow of mapping from the editing interface to the dialog interface.

[0095] like Figure 6 As shown, Example 600 illustrates the mapping process from an editing interface to a dialog interface. This process can be executed when the user switches from the editing interface to the dialog interface, and is used to convert editing control operations in the editing interface into readable dialog messages in the dialog interface, and update the dialog context of the intelligent system.

[0096] In step 602, the computing device can acquire the editing operation sequence of the editing interface generated after the last conversation ended. Specifically, the computing device can determine the time point when the last conversation ended by searching for the most recent operation record of the interface switching operation type, and acquire the editing operation records generated in the editing interface after that time point. Each editing operation record may include the operation type and the parameter values ​​before and after the operation. For example, the operation type may include slider adjustment, filter selection, beauty style selection, etc.

[0097] In step 604, the computing device can group and merge the acquired editing operations on the editing interface. For consecutive and related editing operations, the computing device can merge them into an operation group. For example, multiple parameter adjustments within the same panel can be merged into one operation group; multiple consecutive operations within a preset time window can be merged into one operation group; for operations with a reciprocal relationship, they can be canceled or merged, for example, increasing brightness by 5 and then by 3 can be merged into increasing brightness by 8.

[0098] In steps 606, 608, and 610, the computing device can group and merge editing operations according to different rules. For example, in step 608, multiple parameters within the same panel can be merged into one operation group; in step 606, consecutive operations within a preset time window can be merged; and in step 610, inverse operations can be canceled or merged. This process reduces repetitive, fragmented, or unnecessary operation descriptions in dialogue messages, making subsequent generated dialogue messages more concise and clear.

[0099] In step 612, the computing device can generate natural language messages. Specifically, the computing device can convert editing operations on the editing interface into readable messages using a natural language template library based on the operation grouping results. For example, a filter switching operation can be converted into a message describing filter changes and intensity changes; a brightness adjustment operation can be converted into a message describing changes before and after brightness adjustment; multiple basic adjustment operations can be converted into a message describing changes in multiple adjustment sub-items; and a beauty style operation can be converted into a message describing beauty presets and intensity. In one scenario, the correspondence between editing interface operations and natural language templates can be shown in Table 1 below: Table 1

[0100] In step 614, the computing device may insert the generated dialogue message into the dialogue stream. Specifically, the computing device may insert the dialogue message at the end of the dialogue message stream. The dialogue message may be a system-generated message, the content of which may include a natural language description and may be associated with a corresponding editing operation identifier from the editing interface. In one case, the dialogue message may also have visual markers to indicate that the operation originated from the editing interface, such as special colors, icons, or other prompt styles.

[0101] In step 616, the computing device can update the dialogue context of the intelligent system. Specifically, the computing device can update the dialogue context based on the generated dialogue messages and corresponding editing operations in the editing interface, enabling the intelligent system to understand and reference the operation history in the editing interface in subsequent dialogues.

[0102] In steps 618 and 620, the computing device can further convert the editing interface operation into an equivalent editing operation and update the editing capability information and feature word information. For example, the computing device can generate an editing operation equivalent to the editing control operation in the editing interface; at the same time, it can update the current configuration in the editing capability information and update context information such as feature word information. Therefore, when the user continues to input editing intent in the dialog interface, the intelligent system can generate corresponding editing results based on the updated editing state.

[0103] By inserting the generated dialogue messages into the dialogue stream and updating the dialogue context of the intelligent system, the intelligent system can understand and reference previous editing interface operations in subsequent dialogues. This improves the consistency between editing operations in the editing interface and the editing context in the dialogue interface, and reduces the loss of operation history or context breakage caused by interface switching.

[0104] The above combination Figure 6 A schematic diagram illustrating an example flow of mapping from the editing interface to the dialog interface is provided below. Figure 7 A diagram illustrating an example flow of cross-interface undo and redo.

[0105] like Figure 7 As shown in Example 700, a cross-interface undo and redo process is illustrated. This process can be used to uniformly record editing operations from dialog interfaces or editing interface modes, and when a user triggers an undo or redo operation, update the editing results of the target material and the interface content in the current editing interface based on the state differences before and after the operation.

[0106] In step 702, the computing device can receive or determine the source of each editing operation. This editing operation can originate from a dialog mode or from an editing interface. For example, operations originating from a dialog interface can include editing operations or function call operations, while operations originating from an editing interface can include panel operations, control selection operations, or slider adjustment operations, etc.

[0107] In steps 704 and 706, the computing device can maintain a unified operation stack and record an operation record corresponding to each edit operation in the unified operation stack. This operation record may include an operation identifier, an operation source, a hash value of the state before the operation, a hash value of the state after the operation, and state difference information. The operation identifier can be used to uniquely identify the corresponding operation; the operation source can be used to indicate whether the corresponding operation originated from the dialog interface or the editing interface; the hash values ​​of the state before and after the operation can be used to quickly locate and verify the editing state before and after the operation; and the state difference information can be used to record the fields that changed before and after the operation.

[0108] In step 708, the computing device can perform state difference calculation. Specifically, the computing device can compare the unified edit state model before and after the operation and use a recursive comparison method to determine the changed field branches. To reduce storage space, the state difference information can record only the changed fields, without repeatedly recording the unchanged fields.

[0109] In step 710, the computing device can detect user-triggered operations. User-triggered operations may include undo or redo operations. Based on the specific user-triggered operation, the computing device can determine a reverse recovery process or a forward application process for executing state difference information.

[0110] In steps 712 and 714, when a user triggers an undo operation, the computing device can determine the most recent undone operation record from the unified operation stack and perform reverse recovery based on the state difference information in that operation record, restoring the changed fields from their new values ​​to their old values. If the undone operation involves cross-mode parameters, such as undoing an editing operation in the dialog interface while the current display is the editing interface, the computing device can synchronously update the panel control state in the editing interface and mark the corresponding operation as undone to support subsequent redoing.

[0111] In steps 716 and 720, when a user triggers a redo operation, the computing device can find the most recently marked undone operation record in the unified operation stack and apply it positively based on the state difference information in that operation record, updating the changed fields from old values ​​to new values. If the redo operation involves cross-interface parameters, the computing device can also synchronously update the interface content in the current editing interface and re-mark the corresponding operation as applied.

[0112] In step 722, the interface switching operation can be recorded as a special marker in the unified operation stack. Undo and redo operations can bypass this interface switching marker and apply to editing operations in either the interface before or after the interface switch. Thus, even if the user switches between the dialog interface and the editing interface, the computing device can still perform cross-interface undo or redo based on the unified operation stack and state difference information, while maintaining consistency between the current editing result and the current interface content.

[0113] In one scenario, cross-mode consistency assurance of protocol constraints is required. In this case, the protocol constraint checker performs the following verifications during mode switching: Scene constraint check: Compares the current editing capabilities with the protocol range supported by the target scene. For example, when switching from the editing page to the chat page, if the current state contains editing effects not supported by the chat page, the system prompts the user and provides options (automatically remove / keep but not display / cancel the switch). Effect mutual exclusion check: Based on editing capabilities and constraint rules, checks whether the current state contains mutually exclusive effect combinations (e.g., both "One-click to create a video" and "Filters" are configured simultaneously). If a conflict is detected, the effect to be retained or removed is determined according to the effect priority rules. Single effect constraint check: Verifies whether only one of the same type of effect is configured (e.g., multiple filters cannot be configured simultaneously); if a violation exists, the last one is retained.

[0114] This method can reduce problems such as interruption of the undo link, loss of operation history, or asynchronous interface state caused by interface switching, and improve the consistency of state, continuity of operation, and recoverability in the cross-interface media content editing process.

[0115] The above combination Figure 7 A diagram illustrating an example flow of cross-interface undo and redo is provided below. Figure 8 A schematic diagram illustrating an example of a dialog interface.

[0116] like Figure 8 As shown in Example 800, a schematic diagram of an editing interface is illustrated. The computing device can display a material display area for the target material, a first control 804, and an operation control 806 in the editing interface 802. The material display area can be used to display images, videos, or other media materials to be edited, and the first control 804 can be used to receive the user's editing intent, such as the type, style, or description of effects the user wishes to add.

[0117] In one scenario, the effect recommendation information of the first control 804 can be displayed in a light-colored font in the input area to prompt the user to input or select effect content. For example, the computing device can display multiple recommended prompts in a carousel within the first control 804 to recommend multiple effects. For instance, the multiple recommended prompts may include three, and they can be scrolled and switched at predetermined time intervals, such as switching to display one recommended prompt every two seconds. Thus, the user can perceive the available effect types through the carousel of recommended prompts without actively inputting text.

[0118] In one scenario, a user can select a target effect by clicking on a suggested effect prompt, or by typing the desired effect text in the first control 804. For example, a user can enter effect descriptions such as "fireworks effect," "retro film effect," or "dreamy light effect" in the first control 804. The computing device can determine the target effect the user wishes to apply to the target material based on the suggested prompt or the effect text entered by the user. If the user performs an operation on the next control 806, the computing device can generate corresponding effect editing results for the target material based on the target effect selected or entered by the user.

[0119] This method allows computing devices to guide users to input or select special effects through special effects recommendation information in the editing interface, and allows users to further express their personalized special effects needs through text descriptions, thereby reducing the operational cost for users to find special effects and improving the convenience and efficiency of editing media content based on natural language.

[0120] The above combination Figure 8 A schematic diagram illustrating an example of the editing interface is provided below. Figure 9 This is a diagram illustrating an example of how the input component is brought up in the editing interface.

[0121] like Figure 9 As shown in Example 900, this is a schematic diagram of the interface after the input component is pulled up in the editing interface, which can be accessed by clicking... Figure 8 The first control 804 is accessed. The computing device can display input components in the interface 902, which may include a suggested prompt area 904, an input area, and a keyboard area.

[0122] In one scenario, when a user triggers the first control and pulls up the input component, the computing device can expand and display multiple recommended suggestions that were previously displayed in a carousel within the first control in the recommended suggestion area 904. For example, recommended suggestions for multiple effects that were previously displayed in a carousel at predetermined time intervals can be displayed simultaneously in front of the user after the input component is pulled up, allowing the user to directly view and select one of the recommended suggestions. Thus, the user can quickly perceive the multiple recommended effects currently available without waiting for the carousel to switch.

[0123] In one scenario, multiple recommendation entry points can be displayed in the recommendation prompt area, such as " Features include "Special Effects," "Outfit Sharing," and "Doodle Collage." Users can click on any of the recommended entry points to select the desired special effect or editing capability to apply to the target material. The computing device can receive the user's selection action for the recommended entry point, fill the selected recommended special effect or editing capability into the editing intent input area, or determine the subsequent generated editing effect based on the selected recommended special effect or editing capability.

[0124] In one scenario, suggestion information 906 can also be displayed in the suggested word area. Suggestion information 906 can be used to guide users to further express their editing ideas through dialogue, such as prompting users to chat with the intelligent system about their desired style, effects, themes, or screen adjustment needs.

[0125] When a user enters editable content in the input area and triggers the send control 908, the computing device can generate corresponding editing effects based on the user's input text or the user's selected recommended effects, and update the displayed editing results of the target material. The user's input text or selected recommended effects can serve as media content processing instructions. For example, the user can input a description of the desired effect, a description of the visual style, or specific adjustment requirements. The computing device can then add corresponding effects or perform corresponding editing processing on the target material based on these instructions. In one scenario, after the user triggers the send control 908, the page can display a brief send waiting state. The computing device can detect the user's input processing instructions to determine whether the instructions can invoke local editing capabilities to complete the processing. If the detection result indicates that the instructions can invoke local editing capabilities, the computing device can skip displaying the generated mask and directly present the generated editing result; if the detection result indicates that the instructions cannot invoke local editing capabilities, the computing device can display the generated mask and display the corresponding editing result after the processing is complete. Additionally, when switching from the editing interface to the dialog interface, the media content processing instructions can be displayed in the dialog interface.

[0126] This method can improve the visibility of recommended effects, reduce the cost for users to find and input effects, and enhance operational efficiency and interactive consistency during the dialog interface editing process.

[0127] The above combination Figure 9 This diagram illustrates an example of how the input component is brought up in the editing interface. The following section combines... Figure 10 A schematic diagram illustrating an example of generating a mask in the editing interface.

[0128] like Figure 10 As shown in Example 1000, a schematic diagram of mask generation in the editing interface is illustrated. When user input cannot directly complete the processing, the computing device can display the generated mask in the editing interface 1002 to prompt the user that the corresponding editing effect is currently being generated.

[0129] The generation of the mask can include generation progress information 1004. Generation progress information 1004 can include progress text and a progress bar, such as displaying "Generating 30%" and the corresponding progress bar status. Through this generation progress information 1004, users can perceive the current generation progress of the editing effect, reducing uncertainty during the waiting process.

[0130] The generated mask can also display descriptive information about the effects corresponding to the current generation task. For example, the page can display the name of the target effect entered or selected by the user, indicating that the currently generated editing effect corresponds to the user's previous editing intention.

[0131] In one scenario, the generated mask can also display a collapse generation control 1006. After the user triggers the collapse generation control 1006, the computing device can collapse or weaken the display of the generated mask, allowing the user to view other content on the page while the generation task continues. After the generation task is completed, the computing device can update the editing results of the target material in the editing interface 1002.

[0132] Using this method, when generation processing is required, the computing device can display the generation status, generation progress, and special effects information corresponding to the current generation task to the user through the generation mask. This allows the user to clearly perceive that the editing effect is being generated, and the generation process can be reduced by collapsing the generation controls to minimize the obstruction of page browsing or subsequent operations, thereby improving the interactive experience during the generation waiting process.

[0133] The above combination Figure 10 A schematic diagram illustrating an example of generating a mask in the editing interface is shown below. Figure 11 This is a diagram illustrating an example of the page after the input component is collapsed.

[0134] like Figure 11 As shown, Example 1100 illustrates a schematic diagram of the interface after clicking "Collapse Generation Controls" in the editing interface. (Compared to...) Figure 10 Compared to the previously shown generated overlay state, after the user triggers the collapse of the generated controls, the computing device can collapse the generated overlay that was originally covering the page and display the generated prompt area 1104 below the editing interface 1102. Thus, the material display area and other editing controls on the page can be re-presented to the user, while the generated task can still continue.

[0135] In one scenario, the generation prompt area 1104 can be used to indicate that the current generation task is still in progress. For example, the generation prompt area 1104 can display prompts such as "Image generation in progress" to let the user know that the current generation process has not yet ended.

[0136] In one scenario, a cancellation control can also be displayed in the generation prompt area 1104. If the user triggers the cancellation control, the computing device can stop the current generation task and cancel the corresponding generation process. If the user does not trigger the cancellation control, the computing device can continue executing the generation task in the background and update the display of the target material's editing results upon completion.

[0137] In this way, users can continuously perceive the execution status of the current task being generated, and can also continue to view page content or perform other operations while waiting for the result, thereby improving the interactive flexibility during the generation waiting process.

[0138] The above combination Figure 11 This diagram illustrates an example of the page after the generated controls are collapsed. The following section combines... Figure 12 A schematic diagram illustrating an example of a multi-round result display interface.

[0139] like Figure 12 As shown in Example 1200, a schematic diagram of a multi-round generation result display interface is presented in the editing interface. After the generation task has undergone multiple rounds of processing, the computing device can display the task processing results and effect guidance prompts in the prompt box 1204 in interface 1202, as well as the historical generation result display area 1206, to present the generation content corresponding to different rounds. The content displayed in the prompt box 1204 is a response message to the user's input of media content processing instructions. Additionally, when switching from the editing interface to the dialog interface, this response message can be displayed in the dialog interface.

[0140] In one scenario, the historical generation results display area 1206 can show multiple versions of content generated in multiple rounds. These versions can be arranged in the order of generation and can correspond to the user's editing intent in different rounds or the different editing results generated by the system. By simultaneously displaying multiple rounds of generated content in the historical generation results display area 1206, users can intuitively see the differences in effects between different rounds.

[0141] In one scenario, a user can select the generated content corresponding to any round in the historical generation results display area 1206. The computing device can restore the currently displayed target material to the editing result corresponding to the target version selected by the user, thereby achieving the operation of reverting to a previous version. In another scenario, a return control 1208 can also be displayed on the page. The user can trigger the return control 1208 to undo the current operation and return to the special effects operation interface corresponding to the previous operation. Thus, after multiple rounds of generation, the user can still return to view or use the generation results of earlier rounds, or undo the current operation and return to the previous special effects operation interface, without having to re-enter the previous editing intent or re-execute the generation process.

[0142] In this way, computing devices can retain and display the results of each round of generation, allowing users to compare, select, and revert the editing effects of different rounds. This enhances the traceability and version recoverability of results during multi-round generation, and improves the user's operational flexibility and experience in conversational editing.

[0143] The above combination Figure 12 A schematic diagram illustrating an example of a multi-round result display interface is provided below. Figure 13 A schematic diagram illustrating an example of a work publishing interface.

[0144] like Figure 13 As shown in Example 1300, this illustrates a schematic diagram of a work publishing page. After the target material has undergone special effects generation or editing, the computing device can display the work publishing page 1302 so that the user can confirm the generated work before publishing.

[0145] On the work publishing page 1302, the generated work preview area, title input area, work description input area, topic selection area, visibility information, and publishing controls can be displayed. After confirming the work content, users can add publishing information and trigger the publishing controls to publish the work after special effects processing.

[0146] The above combination Figure 13 A schematic diagram illustrating an example of a work publishing interface is provided below. Figure 14 A schematic diagram illustrating an example of a dialog interface.

[0147] like Figure 14 As shown, Example 1400 illustrates a schematic diagram of a dialog interface. A computing device can display the dialog interface 1402. For example, if in Figure 9 Clicking on prompt 906 will take you to the dialog interface. This dialog interface displays a preview area 1404 of the current target material and a dialog input area 1408, allowing the user to continue inputting desired content around the current material. Additionally, the preview area 1404 can display an image previously edited in the editing interface and may further include descriptive text corresponding to the editing operations performed in the editing interface.

[0148] In one scenario, the dialogue input area 1408 can display the material information corresponding to the current material, as well as input prompts for the desired content. Users can continue to input their desired style, effects, visual content, or other editing requirements in this area. The page can also display add controls and send controls. Users can supplement content by adding controls and submit their current input requirements by sending controls, allowing the computing device to continue generating or adjusting the editing results based on those requirements.

[0149] In one scenario, the page can also display a "Go to Publish" control 1406. Users can access the work publishing page via the "Go to Publish" control 1406 if the current editing result meets their needs; if further adjustments are needed, they can continue the conversational interaction in the dialog interface 1402. Thus, this page can serve as a further dialogue entry point after special effects editing, allowing users to refine their editing needs based on the current material or directly enter the subsequent publishing process. Additionally, the dialog interface 1402 also includes a close control (see...). Figure 14 (The top left corner of the screen) allows you to switch back to the editing interface from the dialog interface by clicking the close control.

[0150] The above combination Figure 14 A schematic diagram illustrating an example of a dialog interface is provided below. Figure 15 A diagram illustrating an example of creating content through a dialog interface.

[0151] like Figure 15 As shown, Example 1500 illustrates a diagram of creation after a user inputs their creative intent. The computing device can display a material card corresponding to the current material on page 1502, and display the user's input creative intent, such as "more ceremonial," near the material card to indicate the requirements upon which the current generation task is based.

[0152] The page can display the generated results area 1506. This area can showcase the content generated based on the current creative intent and display the current generation status before generation is complete. For example, the generated results area 1506 can display prompts such as "The following is the video generated for you," and show the current generation progress, such as 30%, in the preview area. This allows users to perceive that their current creative intent has entered the generation processing stage.

[0153] In one scenario, the creative idea input area can still be retained at the bottom of the page, allowing users to continue inputting new creative requirements or further refining their current needs. Thus, the page can both display the generation process and results corresponding to the current creative intent and support users to continue multi-round dialogic creation around the current material. Additionally, if the user clicks the close button on this interface, they can return to the previous interface and process the content using the editing interface's interactive mode. Furthermore, for operations already performed in the dialog interface, the parameters of the editing controls in the editing interface can be adjusted accordingly to adapt to the performed operations.

[0154] Figure 16 A schematic block diagram of a device for processing media content according to this article is shown. Figure 16 As shown, device 1600 can Figure 1The device 1600 is implemented in a computing device 102, and includes a first display module 1602 for displaying first media content in a first interface, the first interface being one of a first dialog interface and a first editing interface, the first media content being obtained after performing a first media content processing operation on second media content in the first interface; a first operation receiving module 1604 for receiving a first operation triggered in response to the first interface; a second display module 1606 for displaying the first media content in a second interface, the second interface being the other of the first dialog interface and the first editing interface; and a content editing module 1608 for editing the first media content in the second interface.

[0155] In one scenario, the first interface is a first editing interface, and the second interface is a first dialog interface. The first editing interface includes at least one editing control, and the first media content processing operation is an operation that triggers one or more of the at least one editing control. Before receiving the first operation, the device 1600 further includes: a second operation receiving module for receiving a second operation triggered on the first control on the first editing interface; and an input component display module for displaying an input component on the first editing interface. The input component is used to input media content processing instructions in natural language form, wherein the first operation is an operation triggered on the input component.

[0156] In one scenario, prior to receiving the first operation, the device 1600 further includes: a first media content processing module, configured to receive a first media content processing instruction via an input component and process the first media content based on the first media content processing instruction; and the device 1600 further includes a processing instruction dialogue message display module, configured to display the first media content processing instruction in the form of a dialogue message in a first dialogue interface.

[0157] In one scenario, before receiving the first operation, the device 1600 further includes: a processing instruction reply message display module, used to display a reply message corresponding to the first media content processing instruction; and the device 1600 further includes a reply message first dialogue interface display module, used to display the reply message in the first dialogue interface.

[0158] In one embodiment, the device 1600 further includes: a first media content and a first control display module, used to display the first media content and the first control in a first editing interface before receiving the second operation, the first control being used to rotate multiple prompts; a third operation receiving module, used to receive a third operation, the third operation being triggered in response to the rotated prompts; and an input component display module, used to display an input component on the first editing interface, the input component displaying media content processing instructions corresponding to the rotated prompts.

[0159] In one scenario, where the input component further includes multiple prompts, the device 1600 further includes: a fourth operation receiving module for receiving a fourth operation triggered in response to the first prompt, the multiple prompts including the first prompt; a first media content first prompt processing module for processing the first media content based on the first prompt; and a control parameter adjustment module for adjusting the control parameters of at least one editing control to correspond to the processed first media content.

[0160] In one scenario, the input component further includes multiple prompts, including a second prompt, and the first operation is triggered in response to the second prompt.

[0161] In one scenario, the first interface is a first dialog interface, the second interface is a first editing interface, the first dialog interface includes a second control, and the first operation is the operation that triggers the second control.

[0162] In one scenario, the second interface may also include representation information corresponding to the first media content processing operation.

[0163] In one scenario, the first interface is a first editing interface, the second interface is a first dialog interface, the first editing interface includes at least one editing control, and the first media content processing operation is an operation that triggers one or more of the at least one editing control; the information includes a first dialog message displayed in the first dialog interface, the first dialog message being used to describe the first media content processing operation.

[0164] In one scenario, the first interface is a first dialog interface, the second interface is a first editing interface, and the first media content processing operation is triggered by a second dialog message sent from the first dialog interface. The second dialog message describes the first media content processing operation and includes control parameters of at least one editing control in the first editing interface.

[0165] In one scenario, where the first editing interface includes an input component, the device 1600 further includes: a second media content processing instruction receiving module for receiving a second media content processing instruction via the input component, the second media content processing instruction being in natural language; and a control parameter display module for displaying control parameters corresponding to the second media content processing instruction in the first editing interface.

[0166] Figure 17 A schematic block diagram of an example device 1700 that can be used to implement this document is shown. Figure 1The computing device 102 can be implemented using device 1700. As shown, device 1700 includes a central processing unit (CPU) 1701, which can perform various appropriate actions and processes according to computer program instructions stored in read-only memory (ROM) 1702 or loaded from storage unit 1708 into random access memory (RAM) 1703. Various programs and data required for the operation of device 1700 can also be stored in RAM 1703. CPU 1701, ROM 1702, and RAM 1703 are interconnected via bus 1704. Input / output (I / O) interface 1705 is also connected to bus 1704.

[0167] Multiple components in device 1700 are connected to I / O interface 1705, including: input unit 1706, such as a keyboard, mouse, etc.; output unit 1707, such as various types of displays, speakers, etc.; storage unit 1708, such as a disk, optical disk, etc.; and communication unit 1709, such as a network card, modem, wireless transceiver, etc. Communication unit 1709 allows device 1700 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0168] The various processes and handling described above, such as method 200, can be executed by processing unit 1701. For example, in one case, method 200 can be implemented as a computer software program tangibly contained in a machine-readable medium, such as storage unit 1708. In another case, part or all of the computer program can be loaded and / or installed on device 1700 via ROM 1702 and / or communication unit 1709. When the computer program is loaded into RAM 1703 and executed by CPU 1701, one or more actions of example method 200 described above can be performed.

[0169] This document can be a method, apparatus, system, and / or computer program product. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for performing various aspects of this document.

[0170] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination of the foregoing. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0171] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0172] The computer program instructions used to perform the operations described herein may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In one scenario, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), is personalized by utilizing state information from the computer-readable program instructions. This electronic circuitry can execute the computer-readable program instructions to implement various aspects of this document.

[0173] Various aspects of this document are described herein with reference to flowchart illustrations and / or block diagrams of the methods, apparatus (systems), and computer program products thereof. It should be understood that each block of the flowchart illustrations and / or block diagrams, as well as combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0174] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0175] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0176] The flowcharts and block diagrams in the accompanying figures illustrate the architecture, functionality, and operation of possible implementations of the systems, methods, and computer program products according to this document. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the figures. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0177] The above description is exemplary and not exhaustive, nor is it limited to the disclosed content. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the description. The terminology used herein is chosen to best explain the principles, practical applications, or technical improvements to technology in the market, or to enable others skilled in the art to understand the disclosure herein.

Claims

1. A media content processing method, comprising: The first media content is displayed in the first interface, which is one of the first dialog interface and the first editing interface. The first media content is obtained after performing the first media content processing operation on the second media content in the first interface. Receive a first operation, which is triggered in response to the first interface; The first media content is displayed on a second interface, which is the other of the first dialog interface and the first editing interface. as well as The first media content can be edited in the second interface.

2. The method according to claim 1, wherein, The first interface is the first editing interface, the second interface is the first dialog interface, the first editing interface includes at least one editing control, the first media content processing operation is an operation that triggers one or more of the at least one editing control, and before receiving the first operation, it further includes: Receive a second operation, which is triggered by a first control on the first editing interface; and An input component is displayed on the first editing interface. The input component is used to input media content processing instructions in natural language form, wherein the first operation is an operation triggered on the input component.

3. The method according to claim 2, further comprising, before receiving the first operation: The system receives a first media content processing instruction via the input component and processes the first media content based on the first media content processing instruction. The method further includes: displaying the first media content processing instruction in the form of a dialogue message in the first dialogue interface.

4. The method according to claim 3, further comprising, before receiving the first operation: Display the response message corresponding to the first media content processing instruction; The method also includes: The reply message is displayed in the first dialogue interface.

5. The method according to claim 2, further comprising: Before receiving the second operation, the first media content and the first control are displayed in the first editing interface, and the first control is used to rotate multiple prompts. Receive a third operation, which is triggered in response to the carousel's prompt content; as well as The input component is displayed on the first editing interface, and the input component displays media content processing instructions corresponding to the prompts in the carousel.

6. The method according to claim 2, wherein, The input component also includes multiple prompts, and the method further includes: Receive a fourth operation, which is triggered in response to the first prompt content, and the plurality of prompt content includes the first prompt content; Process the first media content based on the first prompt; and Adjust the control parameters of the at least one editing control to correspond to the processed first media content.

7. The method according to claim 2, wherein, The input component also includes the plurality of prompts, the plurality of prompts including a second prompt, and the first operation is triggered in response to the second prompt.

8. The method according to claim 1, wherein, The first interface is the first dialog interface, the second interface is the first editing interface, the first dialog interface includes a second control, and the first operation is an operation that triggers the second control.

9. The method according to claim 1, wherein the second interface further includes representation information corresponding to the first media content processing operation.

10. The method according to claim 9, wherein, The first interface is the first editing interface, the second interface is the first dialog interface, the first editing interface includes at least one editing control, and the first media content processing operation is an operation that triggers one or more of the at least one editing control; the representation information includes a first dialog message displayed in the first dialog interface, and the first dialog message is used to describe the first media content processing operation.

11. The method according to claim 9, wherein the first interface is the first dialog interface, the second interface is the first editing interface, the first media content processing operation is triggered by a second dialog message sent in the first dialog interface, the second dialog message is used to describe the first media content processing operation, and the representation information includes control parameters of at least one editing control in the first editing interface.

12. The method of claim 11, wherein the first editing interface includes an input component, and the method further includes: The second media content processing instruction is received via the input component, and the second media content processing instruction is in natural language; as well as The control parameters corresponding to the second media content processing instruction are displayed in the first editing interface.

13. A media content processing apparatus, comprising: The first display module is used to display first media content in a first interface, which is one of a first dialog interface and a first editing interface. The first media content is obtained after performing first media content processing operations on the second media content in the first interface. The first operation receiving module is used to receive a first operation, which is triggered in response to the first interface; The second display module is used to display the first media content on a second interface, which is the other of the first dialog interface and the first editing interface. as well as The content editing module is used to edit the first media content in the second interface.

14. An electronic device comprising: At least one processor; as well as A memory for storing at least one program, which, when executed in the at least one processor, causes the at least one processor to implement the method according to any one of claims 1-12.

15. A computer-readable storage medium having a computer program stored thereon, the computer program, when executed in a processor, implementing the method according to any one of claims 1-12.

16. A computer program product comprising a computer program that, when executed in a processor, implements the method according to any one of claims 1-12.

Images