Method, apparatus, device, storage medium and program product for processing multimedia
By receiving touch operations from multimedia and interface elements, the system displays the analysis process and recommended editing styles, solving the problem of monotonous editing styles in multimedia editing technology and achieving more efficient and personalized multimedia editing.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- BEIJING ZITIAO NETWORK TECH CO LTD
- Filing Date
- 2026-03-23
- Publication Date
- 2026-06-19
AI Technical Summary
Existing multimedia editing technologies rely on manual operation, have a single editing style, cannot adapt to multiple users and multiple application scenarios, and have low editing quality and efficiency.
By receiving touch operations from multimedia and interface elements, the system displays the analysis process, recommends multiple editing styles and adjustment elements, and allows users to select and adjust the intensity of the editing style effects.
It improves the compatibility of editing styles with multimedia, enhances editing efficiency and multimedia quality, and provides a personalized editing experience.
Smart Images

Figure CN122239997A_ABST
Abstract
Description
Technical Field
[0001] The examples in this article generally relate to the field of computers, and in particular to methods, apparatuses, electronic devices, computer-readable storage media, and computer program products for processing multimedia. Background Technology
[0002] Multimedia editing is a crucial task in the field of machine vision, encompassing tasks such as multimedia parsing, visual or acoustic enhancement, and image enhancement. With the development of machine learning technology, it is now possible to utilize machine learning models to perform multimedia editing tasks. Summary of the Invention
[0003] In a first aspect, a method for processing multimedia is provided. The method includes: receiving first multimedia; receiving a first touch operation on a first interface element, the first interface element being used to trigger editing of the first multimedia; displaying text indicating an analysis process of the first multimedia; and on the first interface, displaying second multimedia, multiple recommended effect images, and a first adjustment element, the multiple recommended effect images being configured to preview multiple editing styles, the multiple editing styles being recommended for editing the first multimedia; the second multimedia being obtained by applying the first editing style from the multiple editing styles to the first multimedia; and the first adjustment element corresponding to the first editing style, the first adjustment element being configured to adjust the effect intensity of the first editing style.
[0004] In a second aspect, an apparatus for processing multimedia is provided. The apparatus includes: a first receiving module configured to receive first multimedia; a second receiving module configured to receive a first touch operation on a first interface element, the first interface element being used to trigger editing of the first multimedia; a first display module configured to display text indicating the analysis process of the first multimedia; and a second display module configured to display, on the first interface, second multimedia, multiple recommended effect images, and a first adjustment element, the multiple recommended effect images being configured to preview multiple editing styles recommended for editing the first multimedia; the second multimedia being obtained by applying the first editing style from the multiple editing styles to the first multimedia; and the first adjustment element corresponding to the first editing style, the first adjustment element being configured to adjust the intensity of the effect of the first editing style.
[0005] In a third aspect, an electronic device is provided. The electronic device includes: at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.
[0006] In a fourth aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores computer-executable instructions that can be executed by a processor to implement the method of the first aspect.
[0007] In a fifth aspect, a computer program product is provided, which is tangibly stored in a computer storage medium and includes computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.
[0008] In this way, different editing styles can be provided for different multimedia, which can improve the compatibility between the editing style and the multimedia, and help improve the quality of the second multimedia.
[0009] It should be understood that the content described in this section is not intended to limit the key or important features of the examples in this article, nor is it intended to restrict the scope of the solution. Other features will become readily apparent from the following description. Attached Figure Description
[0010] The above and other features, advantages, and aspects of the various examples herein will become more apparent when taken in conjunction with the accompanying drawings and the following detailed description. In the accompanying drawings, the same or similar reference numerals denote the same or similar elements, wherein: Figure 1 A schematic diagram of an example environment based on some examples is shown; Figure 2 A flowchart illustrating example methods for processing multimedia is shown, based on some examples; Figures 3A to 3I A schematic diagram of a sample interface for processing multimedia is shown, based on some examples; Figure 4 A schematic structural block diagram of an example device for processing multimedia is shown, based on some examples; and Figure 5 A block diagram is shown in which one or more examples of an electronic device can be implemented. Detailed Implementation
[0011] The examples in the text will now be described in more detail with reference to the accompanying drawings. While some examples are shown in the drawings, it should be understood that solutions can be implemented in various forms and should not be construed as limited to the examples presented herein. Rather, these examples are provided to provide a more thorough and complete understanding of the solutions. It should be understood that the drawings and examples in this document are for illustrative purposes only and are not intended to limit the scope of protection of the solutions.
[0012] In the description of the examples in this document, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "an example" or "the example" should be understood as "at least one example". The term "some examples" should be understood as "at least some examples". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. The term "trigger" refers to one or more interactive actions by a user on a terminal device. Further, these interactive actions may be triggered within the same user interface / pop-up window or within different user interfaces / pop-up windows. There is no limitation in this regard. Other explicit and implicit definitions may also be included below.
[0013] It should be noted that, unless explicitly stated otherwise, performing a step in response to A does not mean that the step is performed immediately after A, but may include one or more intermediate steps.
[0014] The examples in this article may involve user data, data acquisition, and / or use. All of these aspects comply with relevant laws, regulations, and rules. In the examples presented here, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, when implementing each example, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained through appropriate means, in accordance with relevant laws and regulations. The specific methods of notification and / or authorization can vary depending on the actual situation and application scenario; the scope of the solution is not limited in this regard.
[0015] In this manual and the sample solutions, any processing of personal information will be conducted only under legal grounds (such as obtaining the consent of the data subject or being necessary for the performance of a contract) and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information beyond what is necessary for basic functions will not affect the user's use of basic functions.
[0016] As mentioned above, multimedia editing is a crucial task in the field of machine vision. Traditionally, after acquiring the multimedia to be edited, it can be displayed, and users can manually perform various editing operations on it. This relies heavily on human intervention and cannot guarantee the quality and efficiency of the editing operations. Although models have been proposed for overall multimedia editing, the usual approach is to return the edited multimedia to the user after automatic editing is completed. The model typically uses a fixed editing template. This results in a relatively monotonous editing style for the multimedia, limiting user options and adjustments, and thus failing to adapt to multiple users and diverse application scenarios.
[0017] In view of this, an improved multimedia processing scheme is proposed. According to this scheme, a terminal device receives first multimedia and a first touch operation on a first interface element, which triggers editing of the first multimedia. The terminal device then displays text that can indicate the analysis process of the first multimedia. The terminal device can display second multimedia, multiple recommended effect images, and a first adjustment element on the first interface. The multiple recommended effect images are configured to preview multiple editing styles. The multiple editing styles are recommended for editing the first multimedia. The second multimedia is obtained by applying the first editing style from the multiple editing styles to the first multimedia. The first adjustment element corresponds to the first editing style and is configured to adjust the intensity of the effect of the first editing style.
[0018] According to the above scheme, upon receiving the first multimedia and the first touch operation, the first multimedia can be analyzed, and multiple recommended effect images matching the first multimedia can be displayed. These multiple recommended effect images correspond to multiple editing styles, allowing the user to choose the desired editing style based on their needs. Adjustment elements for the current application's editing style can be displayed, allowing adjustment of the effect intensity of the current application's editing style. This improves the compatibility between the applicable editing style and the multimedia, increases editing efficiency, and helps improve the quality of the multimedia.
[0019] The following sections, in conjunction with accompanying drawings, further illustrate various examples of solutions used for multimedia processing.
[0020] Figure 1 A schematic diagram of an example environment 100 according to some examples is shown. In this example environment 100, an application 115 is installed on a terminal device 110. A user 140 can interact with the application 115 via the terminal device 110 and / or an attached device of the terminal device 110. In some examples, the application 115 is able to provide multimedia processing services to the user 140. The application 115 can be any suitable application with multimedia processing capabilities.
[0021] exist Figure 1 In environment 100, if application 115 is active, terminal device 110 can display the interface 150 of application 115. Interface 150 may include various interfaces provided by application 115, such as content display interfaces, content creation interfaces, content publishing interfaces, message interfaces, personal homepages, etc. Application 115 can provide content processing functions to process various multimedia within application 115, and the multimedia and processed multimedia can be displayed on the designated interface.
[0022] In some examples, terminal device 110 communicates with server 120 to provide services to application 115. Terminal device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some examples, terminal device 110 may also support any type of user-facing interface (such as "wearable" circuitry).
[0023] Server 120 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. Server 120 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in cloud environments, etc.
[0024] A communication connection can be established between server 120 and terminal device 110. This communication connection can be established via wired or wireless means. The communication connection can include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections. In some examples, server 120 and terminal device 110 can exchange signaling signals through their communication connection.
[0025] In some examples, application 115 can use machine learning model 130 to perform multimedia content processing tasks. Machine learning model 130 can be deployed locally on terminal device 110 or on other devices / systems (e.g., server 120). Application 115 can, for example, directly utilize the locally deployed machine learning model 130 or invoke the machine learning model 130 deployed on other devices / systems via communication connections to generate media content.
[0026] Machine learning model 130 can be based on any suitable model architecture, including but not limited to Transformer models, Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), Deep Neural Networks (DNNs), and so on. In some examples, machine learning model 130 can be based on a language model (LM), for example. Machine learning model 130 can include language models, Large Language Models (LLMs), Vision-Language Models (VLMs), Multimodal Large Language Models (MLLMs), and so on. Language models, by learning from large corpora, possess question-answering capabilities. Machine learning model 130 can also be based on other suitable models. Although only a single machine learning model 130 is shown in the figure, multiple machine learning models can exist. If machine learning model 130 includes multiple models, these multiple models can include models configured to perform the same or similar tasks, or models configured to perform different tasks.
[0027] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this document.
[0028] Figure 2 A flowchart of an example method 200 for multimedia processing, based on some examples, is shown. Method 200 can be implemented on terminal device 110. It should be noted that the operations described with respect to terminal device 110 can be performed by a related application (e.g., application 115) installed on terminal device 110 or by a client. Some operations described with respect to terminal device 110 may require the assistance of server 120 to complete.
[0029] To better illustrate the examples in this article, the following will also combine... Figures 3A to 3I Let's describe method 200. Figures 3A to 3I Schematic diagrams of example interfaces 300A to 300I for content processing are shown, based on some examples. It should be understood that... Figures 3A to 3I The interface shown is merely an example; various interface designs are possible in practice. The graphic elements within the interface can have different arrangements and visual representations, one or more elements can be omitted or replaced, and one or more other elements may also be present. The examples in this document are not limited in this respect.
[0030] In block 210, terminal device 110 receives first multimedia. Multimedia may include any suitable content such as images, videos, and audio. In the following description, unless otherwise specified, multimedia is exemplified as an image. In block 220, terminal device 110 receives a first touch operation on a first interface element, which triggers editing of the first multimedia. It should be understood that these embodiments can also be applied to editing other types of multimedia, such as video or audio.
[0031] Terminal device 110 can receive the first multimedia via any suitable means. The first multimedia may be multimedia acquired by terminal device 110 in real time, multimedia pre-stored locally, or multimedia obtained from other electronic devices. In some examples, terminal device 110 may display a receiving interface. The receiving interface may include, for example, a multimedia acquisition control, and terminal device 110 may receive the first multimedia in response to a touch operation on the multimedia acquisition control. Terminal device 110 may then display the received first multimedia and a first interface element, and may receive a first touch operation on the first interface element.
[0032] refer to Figure 3A and Figure 3B Example interface 300A illustrates an example of a receiving interface. Example interface 300A may include interface element 301 and control 302. Both interface element 301 and control 302 can be considered as multimedia acquisition controls. Terminal device 110 can receive first multimedia in response to a touch operation on interface element 301 / control 302. Terminal device 110 can then display the interface shown in example interface 300B. Example interface 300B includes area 304 and control 305. Terminal device 110 can display the first multimedia in area 304. Control 305 can be considered as a first interface element, and terminal device 110 can receive a first touch operation on control 305.
[0033] In some examples, the receiving interface may also directly include the first interface element. The terminal device 110 can receive the first multimedia in response to a first touch operation on the first interface element. It is understood that the receiving interface can simultaneously include multimedia acquisition controls and the first interface element; the examples in this document do not limit this. See also... Figure 3A Example interface 300A may include control 303. Control 303 can be regarded as a first interface element. Terminal device 110 can receive first multimedia in response to a first touch operation on control 303.
[0034] In some examples, terminal device 110 may display a photo album interface, which may display multimedia already captured by terminal device 110. Terminal device 110 may, in response to receiving a selection of multimedia in the photo album interface, identify that multimedia as the first received multimedia. In some examples, terminal device 110 may display a camera interface, which may preview the content currently captured by the camera of terminal device 110. Terminal device 110 may, in response to triggering a shooting control, identify the multimedia captured in real-time by the camera as the first received multimedia. Of course, terminal device 110 may also have other methods for receiving the first multimedia; these are just some examples.
[0035] Terminal device 110 can determine to perform multimedia processing on the first multimedia in response to receiving the first multimedia and the first touch operation on the first interface element. Terminal device 110 can first analyze the first multimedia and perform subsequent operations based on the analysis results. Since analyzing the first multimedia requires a certain amount of time, in some examples, to avoid the interface becoming unresponsive after the user performs the first touch operation on the first interface element, terminal device 110 can execute the steps shown in box 230 after receiving the first multimedia and the first touch operation on the first interface element. In box 230, terminal device 110 displays text indicating the analysis process of the first multimedia. Thus, by displaying text, the user is prompted that analysis of the first multimedia is currently being performed, avoiding long waiting times and improving the user's interactive experience.
[0036] Terminal device 110 can display a first interface and display text on the first interface, or it can display text on other interfaces. For example, terminal device 110 can display text on the aforementioned interfaces. Figure 3A The received interface shown displays text. For example, terminal device 110 can be configured as described above. Figure 3B The interface shown displays text. The text may include, for example, the text "An image is being analyzed. The image has the following characteristics: XXXXX. The image can be optimized from the following perspectives: XXXXX (where XXXX can be any appropriate text)." The following description uses the example of the terminal device 110 displaying text on the first interface as an example.
[0037] In some examples, the first interface may include an area for displaying multimedia, with which the terminal device 110 may, for example, display text, in association. By way of example only, the terminal device 110 may overlay text on this area, or display text near this area. Reference Figure 3C and Figure 3DExample interfaces 300C and 300D illustrate different examples of the first interface. Both example interfaces 300C and 300D can include area 320, in which the terminal device 110 can display multimedia. In example interface 300C, to facilitate user viewing of text, the terminal device 110 can overlay a mask on the interface and display text 310 on top of the mask. Example interface 300D can include area 330; for illustrative purposes only, area 330 can be located below area 320. The terminal device 110 can display text in area 330.
[0038] Terminal device 110 may, for example, determine multiple editing styles matching the first multimedia by analyzing it, and these multiple editing styles may be recommended for application to the first multimedia. In the examples herein, the term "editing style" may refer to a set of preset parameters or processing methods used when processing multimedia. Editing styles may include the processing of visual information or acoustic information in the multimedia. For example, different editing styles may include different processing methods for image portions and / or different processing methods for human figures in the multimedia. As another example, different editing styles may include different processing methods for sound portions in the multimedia, or different processing methods for video editing aspects (e.g., transitions, scene segmentation, etc.).
[0039] Terminal device 110 can determine multiple editing styles matching the first multimedia in any suitable manner. The number of editing styles can be predetermined or flexibly determined based on actual circumstances, and the examples described herein do not limit this. In some examples, terminal device 110 can acquire multiple candidate styles and determine multiple editing styles matching the first multimedia from among the multiple candidate styles. These multiple candidate styles can be determined in any suitable manner.
[0040] In some examples, the multiple candidate styles can be multiple default candidate styles or multiple pre-defined candidate styles. In some examples, terminal device 110 can acquire a set of portrait styles and a set of image styles. The set of portrait styles includes multiple portrait styles for portraits in multimedia, and the set of image styles includes multiple image styles for non-object elements (e.g., backgrounds) in multimedia. Terminal device 110 can, for example, randomly combine the portrait styles in the set of portrait styles with the image styles in the set of image styles to obtain multiple portrait style-image style groups. Terminal device 110 can, for example, determine multiple candidate styles based on multiple portrait style-image style groups. In some examples, each portrait style-image style group can include at least one portrait style and at least one image style. It is understood that after multiple candidate styles are determined, terminal device 110 can directly store multiple candidate styles and does not need to determine them again in subsequent applications.
[0041] Terminal device 110 can determine multiple editing styles from multiple candidate styles using any suitable method. In some examples, terminal device 110 can use a trained machine learning model 130 to determine multiple editing styles that match the first multimedia. As mentioned above, machine learning model 130 can be based on any suitable model architecture, including but not limited to Transformer models, CNNs, RNNs, DNNs, etc. In some examples, machine learning model 130 can also be based on LMs.
[0042] In some examples, terminal device 110 can obtain historical editing information, which indicates the historical editing information of the multimedia. Terminal device 110 can utilize machine learning model 130, at least based on the historical editing information and the first multimedia, to determine multiple editing styles matching the first multimedia from a pre-configured pool of candidate styles. Specifically, terminal device 110 can use machine learning model 130 to determine the degree of matching between each candidate style and the first multimedia. Terminal device 110 can then rank the multiple candidate styles based on their respective degree of matching. For example, based on this ranking, terminal device 110 can select the multiple editing styles with the highest degree of matching from the multiple candidate styles. Thus, terminal device 110 can use a machine learning model to select multiple editing styles matching the first multimedia from multiple candidate styles, ensuring the accuracy of the multiple editing styles. Therefore, multiple editing styles matching the first multimedia can be determined by combining historical editing information. In this case, even for the same multimedia, the multiple editing styles provided by different terminal devices 110 may differ because their historical editing information may vary. Offering users multiple personalized editing styles can enhance their interactive experience.
[0043] Of course, this is merely an example, and the terminal device 110 can also employ any other suitable method to determine multiple editing styles from multiple candidate styles. For example, in other examples, the terminal device 110 can determine the tags of the first multimedia and the tags of multiple candidate styles, and determine the semantic relevance between the tags of the first multimedia and the tags of each candidate style. The terminal device 110 can, for example, select multiple editing styles from the multiple candidate styles whose semantic relevance to the tags of the first multimedia reaches a threshold based on the semantic relevance between the tags of the first multimedia and the tags of each candidate style. Thus, the terminal device 110 can provide different multiple editing styles in response to different received multimedia, helping to improve the user's interactive experience.
[0044] It should be noted that in some examples, multiple editing styles can be predefined. That is, regardless of the user, the terminal device 110, or the multimedia, the multiple editing styles provided by the terminal device 110 are the same. This can reduce the time spent by the terminal device 110 in determining the editing style and improve analysis efficiency.
[0045] Terminal device 110 can apply multiple editing styles to the first multimedia. In some examples, a first interface element can be used to trigger editing of the first multimedia using a machine learning model (e.g., machine learning model 130). Terminal device 110 can analyze and process the first multimedia using machine learning model 130 in response to a first touch operation on the first interface element. It is understood that machine learning model 130 can include one or more machine learning models, and the functions of these one or more machine learning models can be different. For example, machine learning model 130 can include an analysis model and a processing model. Terminal device 110 can use the analysis model to analyze the first multimedia to determine multiple editing styles, and terminal device 110 can use the processing model to apply multiple editing styles to the first multimedia.
[0046] After determining multiple editing styles, terminal device 110 can execute the steps shown in box 240. In box 240, terminal device 110 displays a second multimedia, multiple recommended effect images, and a first adjustment element on a first interface. The multiple recommended effect images are configured to preview multiple editing styles, which are recommended for editing the first multimedia. The second multimedia is obtained by applying the first editing style from the multiple editing styles to the first multimedia. The first adjustment element corresponds to the first editing style and is configured to adjust the effect intensity of the first editing style.
[0047] In some examples, terminal device 110 can determine the degree of matching between multiple editing styles and the content of a first multimedia. The first editing style can be the editing style with the highest matching degree among the multiple editing styles. In some examples, terminal device 110 can apply multiple editing styles to the first multimedia to obtain multiple multimedia, and the first editing style can be the editing style with the shortest processing time among the multiple editing styles (that is, the fastest speed to apply the first editing style to the first multimedia to obtain another multimedia). In some examples, the first editing style can also be the editing style with the lowest resource consumption. It is understood that only some examples of the first editing style are shown here. The first editing style can be any appropriate editing style among multiple editing styles, or it can be an editing style with a pre-specified type. For example, the first editing style can be specified as the editing style with the highest matching degree.
[0048] In some examples, in response to text instructions, terminal device 110 can directly display a second multimedia presentation, multiple recommended effect images, and a first adjustment element. (See reference) Figure 3C , Figure 3D as well as Figure 3HThe text displayed in example interfaces 300C and 300D can indicate the analysis progress of the first multimedia. For example, the text "30%, estimated to take 10 seconds" can indicate that the analysis progress of the first multimedia is 30%, and 10 seconds are still needed to complete the analysis. Terminal device 110 can respond to this analysis progress indication (e.g., including the text "100%)" to determine that the analysis of the first multimedia is complete, and then directly display the first interface shown in example interface 300H. Terminal device 110 can display the second multimedia in area 320 of example interface 300H. Terminal device 110 can display multiple recommended effect images in example interface 300H, such as the recommended effect images for styles 1 to 4 shown in the figure. Terminal device 110 can also display the first adjustment elements (including adjustment elements 351 and 352) for the first editing style in area 350 of example interface 300H.
[0049] In some examples, terminal device 110 may display multiple editing styles in response to the determination of these styles. At this time, terminal device 110 may display a first multimedia element on the interface, and in response to the completion of applying the first editing style to the first multimedia element, then display a second multimedia element and a first adjustment element for the first editing style. (See reference) Figures 3C to 3F The text displayed by terminal device 110 in example interfaces 300C and 300D can, for example, indicate the progress of determining multiple editing styles. In this case, the text "30%, estimated to take another 10 seconds" can indicate that the progress of determining multiple editing styles is 30%, and it will take another 10 seconds to determine the multiple editing styles that match the first multimedia.
[0050] Terminal device 110, for example, may respond to the determination of multiple editing styles by displaying multiple recommended effect images, and on each of the multiple recommended effect images, displaying progress information indicating the progress of applying the corresponding editing style to a first multimedia device. The progress information may include any suitable type of information such as images, text, numbers, symbols, etc. Terminal device 110 may, for example, respond to... Figure 3C or Figure 3D The text indicates that multiple editing styles have been determined (e.g., including the text "100%)), switching from example interface 300C or example interface 300D to presenting example interface 300E. Example interface 300E shows another example of the first interface. Terminal device 110 can display multiple recommended effect images (e.g., effect images of style 1, style 2, style 3, and style 4 shown in the figure) in area 342 of example interface 300E, each matching one of the multiple editing styles.
[0051] Terminal device 110 can display progress information on each of the multiple recommended effect images. For example, terminal device 110 can overlay the progress information corresponding to editing style 1 onto the effect image of style 1. This progress information may include, for example, the text "80%", which indicates that the current progress of applying editing style 1 to the first multimedia is 80%. It should be noted that, at this time, since the application of multiple editing styles is not yet complete, terminal device 110 can display the first multimedia in area 320 of the example interface 300E. It can be understood that terminal device 110 can replace the first multimedia in area 320 with the second multimedia in response to the generation of the second multimedia. Thus, the user can determine the application progress of each editing style through the progress information corresponding to each editing style. In other examples, after terminal device 110 has determined multiple editing styles, it can maintain the display of text indicating the progress of applying the first editing style to the first multimedia. In this case, the user can also know the application progress of the first editing style through this text.
[0052] Furthermore, in response to the completion of applying a first editing style to the first multimedia, the terminal device 110 can display a second multimedia, multiple recommended effect images, and a first adjustment element. In some examples, the progress of applying different editing styles to the first multimedia may differ (e.g., Figure 3E If the application progress of editing style 1 is 80%, editing style 2 is 75%, editing style 3 is 85%, and editing style 4 is 80%, and the application progress of editing style 4 is 80%, then if the application of any one of the multiple editing styles is completed, the terminal device 110 can prioritize displaying the first multimedia application using that editing style. It can be understood that if the first editing style is the one with the fastest application progress (i.e., the shortest time), the terminal device 110 can respond to the fact that the application of any one of the multiple editing styles is completed first, designate that editing style as the first editing style, and then display the second multimedia application using that editing style. In this case, even if the application of other editing styles is completed subsequently, the terminal device 110 will not automatically switch to displaying multimedia applications using other editing styles.
[0053] If the first editing style is not the editing style with the fastest application progress (for example, the first editing style can be pre-defined as the editing style with the highest matching degree), the terminal device 110 can, in response to the completion of the application of an editing style other than the first editing style among multiple editing styles, first display the multimedia with that editing style applied on the first screen. The terminal device 110 can subsequently, in response to the completion of the application of the first editing style, replace the previously displayed multimedia on the first screen with the second multimedia with the first editing style applied. (See reference) Figure 3FExample interface 300F shows another example of the first interface. As shown in example interface 300F, terminal device 110 can display the multimedia with edit style 1 applied in area 320 in response to the completion of the application of edit style 1. It can be understood that if terminal device 110 displays progress information on the recommended effect image, terminal device 110 can cancel the display of progress information on the recommended effect image in response to the completion of the application of the edit style corresponding to the recommended effect image. As shown in the figure, terminal device 110 can cancel the display of progress information on the recommended effect image of edit style 1.
[0054] At this time, terminal device 110 can continue to apply editing styles other than editing style 1 to the multimedia in the background. If editing style 1 is the first editing style, even if the application of other editing styles is completed (e.g., the application of editing style 3 is completed), terminal device 110 will continue to display the multimedia with editing style 1 applied in area 320. If editing style 1 is not the first editing style, for example, if editing style 3 is the first editing style, then terminal device 110 can replace the previously displayed multimedia with editing style 1 applied in area 320 with the multimedia with editing style 3 applied in response to the completion of the application of editing style 3.
[0055] Therefore, after determining multiple editing styles, these styles can be simultaneously applied to the first multimedia file. If the user subsequently wants to view multimedia files with different editing styles applied, the terminal device 110 does not need to apply them again; it can directly switch the display, enabling the quick display of the corresponding edited multimedia file when the user selects the appropriate editing style. This improves the interactive experience.
[0056] It should be noted that in some examples, if the terminal device 110 predetermines a first editing style among multiple editing styles (e.g., the style with the highest matching degree among multiple editing styles), the terminal device 110 can also apply the first editing style only to the first multimedia element and display progress information only on the recommended effect image corresponding to the first editing style. In this case, the terminal device 110 can directly respond to the progress information indicating that the application of the first editing style is complete, and display the second multimedia element, multiple recommended effect images, and the first adjustment element on the first interface. Therefore, the terminal device 110 can quickly apply the first editing style, reducing resource consumption.
[0057] In some examples, during the analysis and processing of the first multimedia, the terminal device 110 may also stop the determination and / or application of multiple editing styles in response to user interaction. In some examples, the terminal device 110 may, in response to a cancellation instruction for the analysis process, cancel the display of text and display the first multimedia and multiple reference effect images on a first interface. The multiple reference effect images are configured to preview multiple reference editing styles that can be applied to edit the first multimedia. For example, reference... Figure 3C , Figure 3D and Figure 3G Example interface 300C may include a cancel control 312, and example interface 300D may include a cancel control 332. Terminal device 110 can cancel the display of text in response to receiving a touch operation on cancel control 312 / cancel control 332. Terminal device 110 may, for example, display example interface 300G. Terminal device 110 may display first multimedia in area 320 of example interface 300G. Terminal device 110 may display multiple reference effect images corresponding to multiple reference editing styles (e.g., styles A to D shown in the figure) on example interface 300G.
[0058] In some examples, if the terminal device 110 has not yet determined multiple editing styles, the multiple reference editing styles may include default multiple reference editing styles, multiple reference editing styles that have been used frequently by a large number of users recently, multiple reference editing styles recently added to the application, etc. The examples in this document do not limit the multiple reference editing styles. At this time, the multiple reference editing styles (i.e., styles A to D) may differ from the multiple editing styles matched with the first multimedia, and the multiple reference effect images may also differ from the multiple recommended effect images. In some examples, if the terminal device 110 has already determined multiple editing styles (the terminal device 110 may be applying multiple editing styles to the first multimedia at this time), then the multiple reference editing styles can be the multiple editing styles determined by the terminal device 110, that is, the multiple reference effect images, which are also the multiple recommended effect images.
[0059] In some examples, in response to a touch operation on any of the multiple reference effect images, terminal device 110 can display text indicating the analysis process of the first multimedia, and in response to the text indicating the completion of the analysis process of the first multimedia, display second multimedia, multiple recommended effect images, and a first adjustment element. That is, terminal device 110 can continue to perform the analysis and processing of the first multimedia in response to a trigger on any of the multiple reference effect images. For example, terminal device 110 can return from example interface 300G in response to a trigger on any of the reference effect images in the vision interface 300G. Figure 3C or Figure 3DThe first interface shown.
[0060] In some examples, when terminal device 110 has determined multiple editing styles to recommend to the first multimedia and is applying the recommended multiple editing styles to the first multimedia respectively, if terminal device 110 displays progress information for each of the multiple editing styles on the first interface, terminal device 110 can also respond to a cancellation instruction on the progress information by canceling the display of the progress information and displaying multiple recommended effect images corresponding to the first multimedia and the multiple editing styles on the first interface. For example, assuming Figure 3G Styles A through D are equivalent to Figure 3E Styles 1 to 4 in the text Figure 3E The example interface 300E shown may include a cancel control 341. The terminal device 110 has now determined multiple editing styles, and can respond to touch operations on the cancel control 341 by displaying... Figure 3G The example interface 300G is shown. In example interface 300G, terminal device 110 displays the first multimedia and multiple determined editing styles in area 320. Terminal device 110 does not display the progress information of each of the multiple editing styles. It can be understood that terminal device 110 can also respond to the triggering of the recommended effect image corresponding to any of the multiple editing styles, continue to apply multiple editing styles to the first multimedia, and present the progress information of each of the multiple editing styles. That is, terminal device 110 can return from example interface 300G to present example interface 300E.
[0061] In some examples, if the application of some of the multiple editing styles is completed, the terminal device 110 can stop the application of the remaining editing styles in response to a cancellation operation on the applied editing styles. For example, see Reference Figure 3FIn the example interface 300F, after the application of Edit Style 1 is completed, the terminal device 110 can display a cancellation control (e.g., a cross in the upper right corner of each recommended effect image) on the recommended effect images corresponding to Edit Styles 2 to 4. The terminal device 110 can stop the application of Edit Style 2 in response to a touch operation on the cancellation control on a recommended effect image (e.g., the recommended effect image corresponding to Edit Style 2). For example, the terminal device 110 can maintain the application progress of Edit Style 2 at 90%. Of course, in some examples, the terminal device 110 can also display cancellation controls for Edit Styles 2 to 4 in the example interface 300F. In this case, the terminal device 110 can stop the application of Edit Styles 2 to 4 in response to a touch operation on this cancellation control. Similarly, in this case, the terminal device 110 can also continue to present the example interface 300F and the progress information of each of the Edit Styles 2 to 4 in response to the triggering of the recommended effect image corresponding to any of the Edit Styles 2 to 4.
[0062] In some examples, if the application of multiple editing styles is not yet complete, and if the terminal device 110 displays progress information for each of the multiple editing styles (e.g., presenting example interface 300E), the terminal device 110 can display an input area and receive editing instructions for the first multimedia through that input area. The input area may include an input box. The terminal device 110 can receive editing instructions entered by the user through the input box. The input area may also include multiple candidate editing instructions, and the terminal device 110 can, in response to receiving a selection of a candidate editing instruction, determine that candidate editing instruction as the editing instruction. (Continue to refer to...) Figure 3E The example interface 300E may include an input box 343 and multiple candidate editing instructions 344. The terminal device 110 may receive editing instructions input by the user via the input box 343, or receive the user's selection of multiple candidate editing instructions 344. The terminal device 110 may apply an editing style to a first multimedia application based on the received editing instructions.
[0063] After multiple editing styles have been applied, the terminal device 110 can display a second multimedia element, multiple recommended effect images, and a first adjustment element on the first interface. The number of recommended effect images can be a predetermined number; in some examples, this number can be determined based on the terminal device 110's configuration, user configuration, application configuration, etc. Each recommended effect image is configured to preview the corresponding editing style. In some examples, each recommended effect image may also include prompt information for the corresponding editing style, such as the name of the corresponding editing style. In some examples, the order of the multiple recommended effect images on the first interface can be based on the degree of matching between each editing style and the first multimedia element. For example, recommended effect images of editing styles with higher matching degrees are also ranked higher on the first interface. The editing style corresponding to the first recommended effect image can have a higher matching degree with the first multimedia element than the matching degree corresponding to other editing styles.
[0064] In some examples, to help users understand the current application's first editing style, among multiple recommended effect images, the first recommended effect image corresponding to the first editing style can be selected, while the other recommended effect images can be unselected. The terminal device 110 can, for example, highlight the selected recommended effect image. The terminal device 110 can use any appropriate method to highlight the selected recommended effect image; as an example only, the terminal device 110 can highlight the selected recommended effect image by using methods such as highlighting, thickening borders, or adding backgrounds.
[0065] In some examples, if the second recommended effect image corresponds to the second editing style, the terminal device 110 can also respond to a touch operation on the second recommended effect image among multiple recommended effect images, displaying the first multimedia image with the second editing style applied on the first interface. At this time, the terminal device 110 can switch the second recommended effect image to a selected state and switch the first recommended effect image to an unselected state. (See reference...) Figure 3H and Figure 3IExample interfaces 300H and 300I illustrate different examples of the first interface. Taking editing style 1 as the first editing style as an example, as shown in example interface 300H, the terminal device 110 can display the multimedia obtained by applying editing style 1 to the first multimedia application in area 320 upon completion of the application of editing style 1. At this time, the recommended effect image of editing style 1 is selected, while the recommended effect images of editing styles 2 to 4 are all unselected. The terminal device 110 can display example interface 300I upon touch operation on the recommended effect image corresponding to editing style 2. In example interface 300I, the recommended effect image corresponding to editing style 2 is selected, while the recommended effect images corresponding to editing styles 1, 3, and 4 are all unselected. The terminal device 110 displays the multimedia obtained by applying editing style 2 to the first multimedia application in area 320. Thus, supporting the user's selection of multiple editing styles can enrich the interaction methods and improve the user's interactive experience.
[0066] The first adjustment element for the first editing style, displayed on the first interface of the terminal device 110, can be used to adjust the intensity of the effect of the first editing style. In some examples, the first editing style may have one or more parameters, and the first adjustment element can be used to adjust these parameters to adjust the intensity of the effect of the first editing style. The adjustment element may include any appropriate element; as an example only, it may include a slider element, which can adjust the corresponding parameter value by sliding.
[0067] It is understandable that since different editing styles may include different parameters, the adjustment elements corresponding to different editing styles may also be different. When the first editing style is currently being applied, the terminal device 110 can respond to the triggering of the second recommended effect image corresponding to the second editing style by displaying the multimedia obtained by applying the second editing style to the first multimedia on the first interface, with the recommended effect image corresponding to the second editing style being selected. At this time, the terminal device 110 can display a second adjustment element for the second editing style on the first interface, which can be used to adjust the effect intensity of the second editing style.
[0068] Continue to refer to Figure 3H Terminal device 110 can display the first adjustment elements (including adjustment element 351 and adjustment element 352) for editing style 1 in area 350 of the example interface 300H. Adjustment element 351 is used to adjust the object enhancement level of editing style 1, and adjustment element 352 is used to adjust the color intensity of editing style 1. (Reference) Figure 3IThe terminal device 110 can display a second adjustment element (including adjustment element 354 and adjustment element 355) for editing style 2 in area 350 of the example interface 300I. Adjustment element 354 is used to adjust the image sharpness of editing style 2, and adjustment element 355 is used to adjust the color contrast of editing style 2.
[0069] In some examples, region 350 may also include control 353, and terminal device 110 may, for example, de-display region 350 in response to a touch operation on control 353. In some examples, terminal device 110 may display a portion of all adjustment elements for adjusting the parameters of editing style 1 in region 350, and terminal device 110 may also display the remaining adjustment elements for adjusting the parameters of editing style based on interaction with region 350 (e.g., swipe operation, long press operation, etc.).
[0070] Terminal device 110 can receive adjustments to the intensity of the editing style effect of the current application via adjustment elements. Terminal device 110 can, for example, edit a second multimedia file based on the adjusted intensity of the effect. In response to the completion of editing the second multimedia file, terminal device 110 can display the multimedia file on a first interface with the adjusted intensity of the effect applied to the second multimedia file (specifically, at least one parameter adjusted). Thus, it supports users adjusting the intensity of the editing style effect, ensuring the quality of the final displayed multimedia file.
[0071] In some examples, terminal device 110 may also display an input area in a first interface displaying the second multimedia, which is used to receive editing instructions. Editing instructions may be editing requests expressed by a user in natural language. The editing instructions may be provided as a machine learning model, which automatically edits the multimedia based on the editing instructions until the editing goal indicated by the instructions is met. In some examples, terminal device 110 may also receive editing instructions for the second multimedia via the input area to further edit the current second multimedia.
[0072] In some examples, terminal device 110 may receive a first input directly via an input area, which may indicate a first editing instruction. By way of example only, the input area may include an input box, through which terminal device 110 may receive the first input. The first input may, for example, be input by a user, expressed in natural language. In some examples, the input area may display multiple candidate editing instructions, and the first input may be used to select a first editing instruction from among the multiple candidate instructions. For example, terminal device 110 may determine that it has received the first input in response to receiving a touch operation for a candidate editing instruction via the input area, and the first editing instruction indicated by the first input is also the touched candidate editing instruction.
[0073] Continue to refer to Figure 3H and Figure 3I The first interface shown in example interfaces 300H and 300I may also include an input box 343 and multiple candidate editing instructions 344. The terminal device 110 can receive a first input from the user, indicating a first editing instruction, via the input box 343. It is understood that the number of candidate editing instructions 344 can be arbitrary. In some examples, limited by the interface size, the terminal device 110 may display only a portion of the multiple candidate editing instructions 344, and may display the remaining portion based on user interaction (e.g., a swipe operation). For example, if there are a total of 5 candidate editing instructions, the terminal device 110 may first display 3 candidate editing instructions on the first interface, and then display the remaining two candidate editing instructions based on user interaction. The terminal device 110 may also, in response to receiving a touch operation on one of the candidate editing instructions 344, determine that candidate editing instruction as the first candidate editing instruction.
[0074] Terminal device 110 can edit the second multimedia based on a first editing instruction. For example, in response to the completion of editing the second multimedia, terminal device 110 can also display the edited second multimedia on a first interface. As an example only, if the second multimedia includes multiple people, and the first editing instruction is "remove people from the image," then after editing the second multimedia, terminal device 110 will display the multimedia obtained by removing the people from the second multimedia on the first interface. Terminal device 110 can edit the second multimedia based on the first editing instruction in any suitable manner. As an example only, terminal device 110 can use a machine learning model to edit the second multimedia based on the first editing instruction.
[0075] The various examples described herein also provide corresponding apparatus for implementing the methods or processes described above. Figure 4 A schematic structural block diagram of an example device 400 for content processing, based on some examples, is shown. Device 400 may be implemented as or included in terminal device 110. The various modules / components in device 400 may be implemented by hardware, software, firmware, or any combination thereof.
[0076] like Figure 4As shown, the device 400 includes: a first receiving module 410 configured to receive first multimedia; a second receiving module 420 configured to receive a first touch operation on a first interface element, the first interface element being used to trigger editing of the first multimedia; a first display module 430 configured to display text indicating the analysis process of the first multimedia; and a second display module 440 configured to display second multimedia, multiple recommended effect images, and a first adjustment element on the first interface, the multiple recommended effect images being configured to preview multiple editing styles, the multiple editing styles being recommended for editing the first multimedia; the second multimedia is obtained by applying the first editing style from the multiple editing styles to the first multimedia; the first adjustment element corresponds to the first editing style and is configured to adjust the effect intensity of the first editing style.
[0077] In some examples, among multiple recommended effect images, the first recommended effect image is selected and configured to preview the first editing style.
[0078] In some examples, device 400 further includes: a first input area display module configured to display an input area on a first interface; a first input receiving module configured to receive a first input via the input area, the first input indicating a first editing instruction; and a third display module configured to display third multimedia on the first interface, the third multimedia being obtained by applying the first editing instruction to a second multimedia.
[0079] In some examples, the input area includes an input box, which is used to receive the first input.
[0080] In some examples, the input area displays multiple candidate editing instructions, and the first input is used to select the first editing instruction from among the multiple candidate editing instructions.
[0081] In some examples, the device 400 further includes: an adjustment receiving module configured to receive a second input via a first adjustment element, the second input indicating an adjustment of the effect intensity of the first editing style; and a fourth display module configured to display a fourth multimedia, the fourth multimedia being obtained by applying the adjusted effect intensity to the second multimedia.
[0082] In some examples, device 400 further includes: a fifth display module configured to display a fifth multimedia on a first interface in response to a second touch operation on a second recommended effect image among a plurality of recommended effect images, the second recommended effect image being configured to preview a second editing style among a plurality of media styles, the fifth multimedia being obtained by applying the second editing style to the first multimedia; and a sixth display module configured to display a second adjustment element for the second editing style, the second adjustment element being configured to adjust the effect intensity of the second editing style.
[0083] In some examples, the second display module 440 is further configured to display the second multimedia, multiple recommended effect images, and the first adjustment element in response to a textual indication that the analysis process of the first multimedia is complete.
[0084] In some examples, the second display module 440 is further configured to display the second multimedia, multiple recommended effect images, and a first adjustment element in response to a text indication of completion of applying a first editing style to the first multimedia, and wherein the device 400 further includes a first progress information display module configured to display first progress information on other recommended effects besides the first recommended effect image among the multiple recommended effect images, the first progress information indicating the progress of applying the corresponding editing style to the first multimedia.
[0085] In some embodiments, the apparatus 400 further includes: an image display module configured to display a plurality of recommended effect images in response to a textual indication of the determination of a plurality of recommended effect images; and a second progress information display module configured to display second progress information on each of the plurality of recommended effect images, the second progress information indicating the progress of applying a corresponding editing style to a first multimedia application.
[0086] In some examples, the device 400 further includes a second input area display module configured to display an input area in association with second progress information for receiving editing instructions for the first multimedia.
[0087] In some examples, the device 400 further includes: a cancellation display module configured to cancel the display of text in response to a cancellation instruction on the analysis process; and a seventh display module configured to display a first multimedia and a plurality of reference effect images on a first interface, the plurality of reference effect images being configured to preview a plurality of reference editing styles that can be applied to editing the first multimedia.
[0088] In some examples, the device 400 further includes: a text display module configured to display text indicating the analysis process of the first multimedia in response to a third touch operation on a first reference effect image among a plurality of reference effect images; and an eighth display module configured to display a second multimedia, a plurality of recommended effect images, and a first adjustment element in response to the text indicating that the analysis process of the first multimedia is complete.
[0089] In some examples, the first receiving module 410 is further configured to: display a multimedia acquisition control; and receive the first multimedia in response to a fourth touch operation on the multimedia acquisition control; and the second receiving module 420 is further configured to: display the first multimedia and a first interface element in response to receiving the first multimedia; and receive a first touch operation on the first interface element.
[0090] In some examples, the first receiving module 410 is further configured to: display a first interface element; and receive first multimedia in response to a first touch operation on the first interface element.
[0091] In some examples, the order of multiple recommended effect images in the first interface is based on the degree of matching between each of the multiple editing styles and the first multimedia.
[0092] In some examples, the first interface element is used to trigger the editing of the first multimedia using a machine learning model.
[0093] In some examples, multiple editing styles are determined by machine learning models based on the first multimedia.
[0094] In some examples, multiple editing styles are derived from a pre-configured pool of candidate styles, and the multiple editing styles are determined based on: determining the degree of matching between each of the multiple candidate styles and the first multimedia based on historical editing information and the first multimedia; and determining multiple editing styles from the multiple candidate styles based on the degree of matching between each of the multiple candidate styles and the first multimedia.
[0095] The modules included in device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some examples, one or more modules can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the units in device 400 can be implemented at least partially by one or more hardware logic components. By way of example, and not limitation, exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard parts (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), and so on.
[0096] Figure 5 A block diagram of an electronic device 500 in which one or more examples may be implemented is shown. It should be understood that... Figure 5 The electronic device 500 shown is merely exemplary and should not be construed as limiting the functionality and scope of the examples described herein. Figure 5The electronic device 500 shown can be used to implement the terminal device 110 discussed above.
[0097] like Figure 5 As shown, electronic device 500 is in the form of a general-purpose electronic device. Components of electronic device 500 may include, but are not limited to, one or more processing units or processors 510, memory 520, storage devices 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processor 510 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 520. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 500.
[0098] Electronic device 500 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof). Storage device 530 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 500.
[0099] Electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 5 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 520 may include computer program product 525 having one or more program modules configured to perform various methods or actions of various examples.
[0100] The communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 500 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 500 can operate in a networked environment using logical connections to one or more other servers, networked personal computers, or another network node.
[0101] Input device 550 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 560 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 500 can also communicate with one or more external devices (not shown) via communication unit 540 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 500, or with any device that enables electronic device 500 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via an input / output (I / O) interface (not shown).
[0102] A computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. A computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.
[0103] The flowcharts and / or block diagrams of the methods, apparatus, devices, and computer program products referred to herein describe various aspects. It should be understood that each block of the flowcharts and / or block diagrams, as well as combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.
[0104] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.
[0105] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.
[0106] The flowcharts and block diagrams in the accompanying figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to some examples. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the figures. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.
[0107] Various examples have been described above. The foregoing descriptions are exemplary and not exhaustive, nor are they limited to the proposed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the proposed implementations.
Claims
1. A method for processing multimedia, comprising: Receive the first multimedia message; Receive a first touch operation on a first interface element, the first interface element being used to trigger editing of the first multimedia; Display text indicating the analysis process of the first multimedia; as well as On the first interface, a second multimedia, multiple recommended effect images, and a first adjustment element are displayed. The multiple recommended effect images are configured to preview multiple editing styles, and the multiple editing styles are recommended to be applied to editing the first multimedia. The second multimedia is obtained by applying the first editing style from the plurality of editing styles to the first multimedia; The first adjustment element corresponds to the first editing style, and the first adjustment element is configured to adjust the intensity of the effect of the first editing style.
2. The method according to claim 1, wherein among the plurality of recommended effect images, the first recommended effect image is selected, and the first recommended effect image is configured to preview the first editing style.
3. The method according to claim 1, further comprising: The input area is displayed on the first interface; A first input is received via the input area, the first input indicating a first editing instruction; as well as On the first interface, a third multimedia is displayed, which is obtained by applying the first editing command to the second multimedia.
4. The method of claim 3, wherein the input area includes an input box for receiving the first input.
5. The method of claim 3, wherein the input area displays a plurality of candidate editing instructions, and the first input is used to select the first editing instruction from the plurality of candidate editing instructions.
6. The method according to claim 1, further comprising: The second input is received via the first adjustment element, and the second input indicates an adjustment to the intensity of the effect of the first editing style; as well as The fourth multimedia is displayed, and the intensity of the effect is obtained by adjusting the second multimedia application.
7. The method according to claim 1, further comprising: In response to a second touch operation on a second recommended effect image among the plurality of recommended effect images, a fifth multimedia is displayed on the first interface. The second recommended effect image is configured to preview a second editing style among the plurality of media styles. The fifth multimedia is obtained by applying the second editing style to the first multimedia. as well as Displays a second adjustment element for the second editing style, the second adjustment element being configured to adjust the intensity of the effect of the second editing style.
8. The method of claim 1, wherein displaying the second multimedia, the plurality of recommended effect images, and the first adjustment element comprises: In response to the text indication that the analysis process of the first multimedia is complete, the second multimedia, the plurality of recommended effect images, and the first adjustment element are displayed.
9. The method of claim 1, wherein displaying the second multimedia, the plurality of recommended effect images, and the first adjustment element comprises: In response to the completion of applying the first editing style to the first multimedia, the second multimedia, the plurality of recommended effect images, and the first adjustment element are displayed, and The method further includes: In the plurality of recommended effect images, except for the first recommended effect image, a first progress information is displayed on the other recommended effects, the first progress information indicating the progress of applying the corresponding editing style to the first multimedia application.
10. The method of claim 1, further comprising: In response to the text indicating the determination of the plurality of recommended effect images, the plurality of recommended effect images are displayed; as well as On each of the plurality of recommended effect images, a second progress information is displayed, which indicates the progress of applying the corresponding editing style to the first multimedia application.
11. The method of claim 10, further comprising: An input area is displayed in association with the second progress information for receiving editing instructions for the first multimedia.
12. The method according to claim 1, further comprising: In response to a cancellation instruction for the analysis process, the display of the text is cancelled; as well as On the first interface, the first multimedia and multiple reference effect images are displayed. The multiple reference effect images are configured to preview multiple reference editing styles, which can be applied to editing the first multimedia.
13. The method of claim 12, further comprising: In response to a third touch operation on a first reference effect image among the plurality of reference effect images, the text is displayed, the text indicating the analysis process of the first multimedia; as well as In response to the text indication that the analysis process of the first multimedia is complete, the second multimedia, the plurality of recommended effect images, and the first adjustment element are displayed.
14. The method of claim 1, wherein receiving the first multimedia comprises: Display multimedia acquisition control; as well as In response to a fourth touch operation on the multimedia acquisition control, the first multimedia is received; And receiving the first touch operation on the first interface element includes: In response to receiving the first multimedia, the first multimedia and the first interface element are displayed; as well as Receive the first touch operation on the first interface element.
15. The method of claim 1, wherein receiving the first multimedia comprises: Display the first interface element; as well as In response to the first touch operation on the first interface element, the first multimedia is received.
16. An apparatus for processing multimedia, comprising: The first receiving module is configured to receive the first multimedia; The second receiving module is configured to receive a first touch operation on a first interface element, the first interface element being used to trigger editing of the first multimedia. A first display module is configured to display text indicating the analysis process of the first multimedia. as well as The second display module is configured to display a second multimedia, multiple recommended effect images, and a first adjustment element on a first interface. The multiple recommended effect images are configured to preview multiple editing styles, and the multiple editing styles are recommended to be applied to editing the first multimedia. The second multimedia is obtained by applying the first editing style from the plurality of editing styles to the first multimedia; The first adjustment element corresponds to the first editing style, and the first adjustment element is configured to adjust the intensity of the effect of the first editing style.
17. An electronic device comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 15 when executed by the at least one processor.
18. A computer-readable storage medium having stored thereon computer-executable instructions that can be executed by a processor to implement the method according to any one of claims 1 to 15.
19. A computer program product comprising computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the method according to any one of claims 1 to 15.