Method and apparatus for editing media content, device, and storage medium

Abstract

A method and apparatus for editing media content, a device, and a storage medium. The method comprises: in response to receiving a search query on an editing interface of first media content, presenting at least one editing component matching the search query on the editing interface, the at least one editing component being an editing component applicable to the first media content; in response to a triggering operation on a target editing component of the at least one editing component, presenting an editing effect image of the first media content formed under the target editing component on the basis of the target editing component and the first media content.

Description

Methods, apparatus, devices and storage media for editing media content.

[0001] This application claims priority to Chinese Patent Application No. 202411849133.6, filed on December 13, 2024, entitled "Method, Apparatus, Device and Storage Medium for Editing Media Content", the entire contents of which are incorporated herein by reference. Technical Field

[0002] The exemplary embodiments disclosed herein generally relate to the field of computers, and particularly to methods, apparatus, devices, and storage media for editing media content. Background Technology

[0003] With the rapid development of computer technology, more and more applications are now able to provide users with various services. For example, applications with media content editing functions provide users with a wealth of media content editing tools and functions, supporting various operations such as video editing, adding special effects, and audio processing, enabling users to easily create multimedia works.

[0004] How to provide better media content editing services based on applications with media content editing capabilities is an urgent problem to be solved. Summary of the Invention

[0005] In a first aspect of this disclosure, a method for editing media content is provided. The method may include: in response to receiving a search query in an editing interface of the first media content, presenting at least one editing component matching the search query in the editing interface, wherein the at least one editing component is an editing component applicable to the first media content; and in response to a triggering operation on a target editing component of the at least one editing component, presenting an edited image of the first media content formed under the target editing component, based on the target editing component and the first media content.

[0006] In a second aspect of this disclosure, an apparatus for editing media content is provided. The apparatus may include: an editing component presentation module configured to, in response to receiving a search query in an editing interface of first media content, present at least one editing component matching the search query in the editing interface, wherein the at least one editing component is an editing component applicable to the first media content; and a media content editing module configured to, in response to a triggering operation on a target editing component of the at least one editing component, present an edited image of the first media content formed under the target editing component, based on the target editing component and the first media content.

[0007] In a third aspect of this disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the electronic device to perform the method of the first aspect.

[0008] In a fourth aspect of this disclosure, a computer-readable storage medium is provided. The medium stores computer-executable instructions that, when executed by a processor, implement the method of the first aspect.

[0009] In a fifth aspect of this disclosure, a computer program product is provided. The computer program product includes computer-executable instructions that, when executed by a processor, implement the method of the first aspect.

[0010] It should be understood that the description in this section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0011] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0012] Figure 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

[0013] Figure 2 illustrates a flowchart for media content editing according to some embodiments of the present disclosure;

[0014] Figure 3 shows a schematic diagram of a media content editing interface according to some embodiments of the present disclosure;

[0015] Figure 4 shows an example diagram of the feedback results of the editing component according to some embodiments of the present disclosure;

[0016] Figure 5 illustrates a schematic diagram of search keywords according to some embodiments of the present disclosure;

[0017] Figure 6 illustrates a schematic diagram of the presentation of a functional class editing component according to some embodiments of the present disclosure;

[0018] Figure 7 illustrates a schematic diagram of the presentation of a material class editing component according to some embodiments of the present disclosure;

[0019] Figure 8 illustrates an application diagram of a functional class editing component according to some embodiments of the present disclosure;

[0020] Figure 9 illustrates an application diagram of a material class editing component according to some embodiments of the present disclosure;

[0021] Figure 10 illustrates an application diagram of a material class editing component according to other embodiments of the present disclosure;

[0022] Figure 11 shows a schematic structural block diagram of an apparatus for media content editing according to some embodiments of the present disclosure; and

[0023] Figure 12 shows a block diagram of an electronic device that can implement one or more embodiments of the present disclosure. Detailed Implementation

[0024] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0025] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below.

[0026] In this document, unless explicitly stated otherwise, performing a step in response to A does not mean that the step is performed immediately after A, but may include one or more intermediate steps.

[0027] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition, use, storage or deletion of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0028] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, relevant users should be informed of the type, scope of use, and usage scenarios of the information involved in this disclosure through appropriate means in accordance with relevant laws and regulations, and authorization should be obtained from the relevant users. Among them, relevant users may include any type of rights holder, such as individuals, enterprises, and groups.

[0029] For example, in response to receiving an active request from a user, a prompt message is sent to the relevant user to clearly inform the user that the requested operation will require obtaining and using the user's information, thereby enabling the relevant user to choose whether to provide information to the software or hardware such as the electronic device, application, server, or storage medium that performs the operation of the technical solution disclosed herein based on the prompt message.

[0030] As an optional but non-restrictive implementation, in response to a user's active request, a prompt message can be sent to the user, such as a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide information to the electronic device.

[0031] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0032] Figure 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in Figure 1, the example environment 100 may include a terminal device 110 and a server device 150.

[0033] In this example environment 100, terminal device 110 can run an application 120 that supports media content editing. Media content can include, but is not limited to, video, audio, and images (images containing text). The media content to be edited in application 120 can be called media content material. Media content in the editing stage can be called media content draft, where editing operations and media content materials are recorded in the metadata of the media content draft. That is, the metadata can record editing operations and the editing components corresponding to each editing operation. As an example, in a media content editing scenario, after the user triggers an editing component, the media content draft will be updated. This update can include content-related editing processes such as adding stickers or filters to the media content material itself, or content-unrelated editing processes such as segmenting. The edited media content can be called the finished media content.

[0034] User 140 can edit media content materials based on application 120 to generate finished media content. Specifically, the finished media content generated by user 140 based on application 120 can be a second media content (e.g., the finished media content) generated by editing a first media content (e.g., a media content draft or media content material). As an example, terminal device 110 can support adjusting the makeup and hairstyle of characters appearing in the first media content, or adding (dynamic) sticker elements, etc., to generate second media content related to the first media content. As an example, user 140 can interact with application 120 via terminal device 110 and / or its attached devices.

[0035] In environment 100 of Figure 1, if application 120 is active, terminal device 110 can present interface 130 through application 120 to support user interface interaction. Interface 130 can be an interface for editing or generating media content.

[0036] Terminal device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, terminal device 110 may also support any type of user-facing interface (such as "wearable" circuitry).

[0037] Server device 150 can be various types of computing systems / servers capable of providing computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, etc. Server device 150 can, for example, provide backend services for the applications of terminal device 110.

[0038] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure.

[0039] Currently, media content generation applications primarily rely on manually set rules for feature recommendations. This approach often fails to fully cover diverse usage scenarios and user needs, resulting in a limited scope of recommendations. A common problem is that the recommended features don't accurately match the user's actual needs. For example, users frequently struggle to find certain functions or content materials while editing content, directly impacting operational efficiency.

[0040] In other scenarios, many novice users want to achieve specific editing effects but are unsure of the location or name of the corresponding function. Currently, media content generation applications cannot meet this need, forcing users to search for relevant information themselves. In yet another scenario, different content editing applications may use different names for editing components with the same or similar functions. This makes it difficult for users migrating from other applications to quickly find the required editing components (e.g., similar functions have different names in different applications), further increasing the difficulty of use and the learning curve.

[0041] In embodiments of this disclosure, an improved scheme for media content editing is proposed. In this scheme, in response to receiving a search query on the editing interface of the first media content, the terminal device 110 presents at least one editing component matching the search query on the editing interface, wherein the at least one editing component is an editing component applicable to the first media content. In response to a triggering operation on a target editing component of the at least one editing component, an editing effect image of the first media content formed under the target editing component is presented according to the target editing component and the first media content.

[0042] Through the above process, by providing a search function in the editing interface of the primary media content, users can directly input their editing needs or relevant keywords without needing to know the specific names or locations of the editing components required in the current application. Based on the user's input, the application can present suitable candidate editing components, helping users quickly find the required components. Furthermore, users can select and directly apply editing components from search results to edit the current media content. This search function simplifies the function search process, avoids the hassle of searching item by item in the media content editing interface, improves search efficiency, and enhances the quality and efficiency of media content editing.

[0043] Figure 2 illustrates an example flow of a method 200 for editing media content according to some embodiments of the present disclosure. For ease of discussion, method 200 will be described with reference to the environment of Figure 1. In environment 100, media content editing can be performed by terminal device 110, but some of these operations can be performed by requesting server device 150 (e.g., the specific operation of determining editing components can be implemented at server device 150).

[0044] In box 201, in response to receiving a search query in the editing interface of the first media content, the terminal device 110 presents at least one editing component matching the search query in the editing interface. All at least one editing component is an editing component applicable to the first media content. The at least one editing component is selected from multiple candidate editing components applicable to the media content based on a selection strategy related to the type corresponding to the search query or the association between the media content and the editing component.

[0045] The primary media content can be considered a draft of media content currently being edited using editing components. Editing components can be various functional modules or tools used during the editing process of primary media content to modify, enhance, or process multimedia content such as video, audio, and images. Editing components help users perform various editing operations, such as adjusting image effects, enhancing sound quality, and adding special effects, to achieve the purpose of creating and optimizing multimedia content. For example, editing components may include one or more filter components (for applying different filter effects), one or more transition components (for applying transition effects between different video clips), caption components (for adding text content to the video), sound effect components (for adjusting audio effects), clipping components (for trimming, splitting, and merging video clips), sticker components (for adding decorative elements to the video), and so on.

[0046] Search queries can include user input. For example, search queries can include keyword searches, link searches, image searches, and so on. Search query input methods can include voice input, text input, or video (image) input, and so on. In some embodiments, an input entry point for the search query, such as a search bar, can be provided in the editing interface.

[0047] Figure 3 shows a schematic diagram of an editing interface 300 for first media content according to some embodiments of the present disclosure. Application 120 includes a search trigger component 301 in the editing interface of the first media content. In response to a user triggering the search trigger component 301, application 120 displays a search area 302.

[0048] The search area 302 may include a search bar 303 for receiving search queries. Based on the search query, the terminal device 110 may, using a selection strategy, select at least one editing component from a plurality of candidate editing components applicable to the first media content that matches the user's search selection and search query. For example, this selection strategy may be related to the type corresponding to the search query, or to the association between the first media content and the editing component.

[0049] Taking the selection strategy and the type corresponding to the search query as an example, the type corresponding to the search query can include keyword type, video type, or image type, etc. If the search query corresponds to the keyword type, the selection strategy can include determining the feature representation of the query keywords and, based on the feature representation, selecting at least one editing component that matches the user's search query using feature representation similarity. If the search query corresponds to the video type or image type, the selection strategy can include obtaining the metadata of the video or image or extracting the visual feature representation of the video or image, and then selecting at least one editing component that matches the user's search query based on the metadata or based on the visual feature representation.

[0050] Taking the selection strategy and the relationship between the primary media content and the editing components as an example, if the primary media content being edited is video content, and the video content contains a certain scene or style (such as a night scene or moving shot), the terminal device 110 will prioritize the selection of editing components related to that scene or style, such as filters suitable for nighttime optimization or editing components with motion stabilization effects.

[0051] By combining the type of search query with the characteristics of the primary media content, the terminal device 110 can more accurately match candidate editing components suitable for the current editing needs. On the editing interface, the device will display these editing components in an intuitive form (such as a list, icons, or a preview window) in the component display area for the user to further select. For example, referring to Figure 3, editing components can be displayed according to categories, namely functional categories and material categories. The above categories are only illustrative examples; in actual scenarios, multiple categories can be set according to needs.

[0052] In box 202, in response to a triggering operation on a target editing component of at least one editing component, the terminal device 110 presents an edited image of the first media content formed under the target editing component, based on the target editing component and the first media content.

[0053] When a user selects at least one target editing component in the component display area of ​​the editing interface, the terminal device 110 will obtain the relevant attributes and parameters of the selected target editing component. These attributes may include the component type (e.g., filter, sticker, speed change, etc.), applicable scope (e.g., a specific time period or video clip), effect parameters (e.g., color adjustment values, speed change curves, etc.), and other editing-related settings.

[0054] After determining the relevant attributes and parameters of the editing component, the terminal device 110 will edit the first media content based on this information. For example, the relevant attributes and parameters of the editing component may include the editing component's identifier (ID), name (full name or abbreviation, which may correspond to different languages), category or function, filtering conditions (e.g., only applicable to video type media content or only applicable to image type media content), and so on.

[0055] For example, a selected filter effect can be applied to a specified time period to adjust the color tone and lighting of the video. A selected transition effect can be inserted between two video clips to make the transition smoother and more natural. As another example, when user 140 selects a specific media component, terminal device 110 can place the corresponding media component at a specified position or time period within the first media content, and adjust the display effect of the media according to parameters such as size, transparency, and rotation angle set by user 140.

[0056] Through the above process, terminal device 110 can select at least one editing component matching the query from multiple applicable editing components based on a selection strategy and execute the display. This selection strategy combines the type of search query and the relationship between the first media content and the component, making the recommended editing component more in line with the actual editing needs of user 140. This approach overcomes the imperfections often encountered by user 140 when using traditional applications, such as difficulty in finding functions, and improves the accuracy and efficiency of function matching. When user 140 selects a recommended target editing component, terminal device 110 can automatically perform corresponding editing operations on the first media content based on the attributes of that editing component, such as adding stickers, adding filters, or adjusting speed, thereby presenting the edited image of the first media content under the target editing component. This automated editing process reduces the manual operation steps of user 140, making the editing experience simpler and smoother, especially suitable for novice users or users unfamiliar with software functions.

[0057] As previously mentioned, search requests can include various types. The following describes the process of determining an editing component using a search request that includes media content material as an example. In some embodiments of this disclosure, in response to a search request including second media content, a first editing component used in the editing process of the second media content is determined based on the metadata of the second media content. At least one editing component associated with the first editing component is determined from a plurality of candidate editing components.

[0058] A search request can be a video clip (or image) or a link to a video clip (or image). Treating the video clip or its link as secondary media content, which corresponds to media content material, allows us to obtain editing operations performed on the secondary media content through its metadata. Based on these editing operations, we can determine the first editing component used during the editing process of the secondary media content.

[0059] For example, the metadata of the second media content typically includes basic information such as format, resolution, encoder data, and timestamps, as well as editing information corresponding to the second media content (such as editing components used like filters, transitions, and stickers). Based on the metadata of the second media content, the terminal device 110 can directly obtain the first editing components used when the second media content was edited from the editing history or code-level metadata of the second media content. For example, this includes editing components such as filters, effects, transitions, stickers, and subtitle styles used.

[0060] Based on these identified first editing components, terminal device 110 can match at least one editing component corresponding to the first editing component from the editing component library of application 120 and present it in the editing interface for user 140 to select and apply. Figure 4 shows a schematic diagram 400 of the editing component feedback results according to some embodiments of the present disclosure. In Figure 4, the feedback results of the editing components can be presented in different areas according to categories. For example, the example shown in Figure 4 may include functional editing components 401 and material editing components 402. In addition, a help center 403 may be provided to provide user 140 with help in using the editing components.

[0061] Through the above process, editing components can be quickly identified and located, reducing the manual search process for users and improving operational efficiency and editing experience.

[0062] For search requests that include finished media content, the following methods can also be used to determine the editing component. In some embodiments of this disclosure, in response to a search request including third media content, the terminal device 110 can extract a visual feature representation of the third media content. Based on the visual feature representation, a second editing component used in the editing process of the third media content is determined. At least one editing component related to the second editing component is determined from a plurality of candidate editing components.

[0063] In some embodiments, for third-party media content for which metadata cannot be obtained (e.g., the third-party media content may be a finished media content product), the terminal device 110 may use computer vision technology to analyze and extract visual feature representations of the third-party media content. These visual features may include color distribution, texture patterns, shape information, motion trajectories, or more advanced features such as scene detection, object recognition, and motion analysis.

[0064] Based on the visual characteristics of the third-media content, terminal device 110 can determine key elements and editing effects in the third-media content, such as the color tone changes of a certain filter, the style of stickers in the image, or the style of subtitles. Based on the key elements and editing effects, terminal device 110 can determine the second editing component used in the editing process of the third-media content. Based on the second editing component, terminal device 110 can query at least one editing component related to the second editing component in the editing component library of application 120.

[0065] As an example, at least one editing component can be identified based on the similarity between the function of the editing component and the function of the second editing component. This component has the same or similar function as the second editing component. Through this process, the terminal device 110 can find editing components in the application 120's editing component library that have the same or similar style and effect to the third media content, and present these editing components to the user 140 as recommended options. This process not only enables the user 140 to find editing effects that match the referenced media content, but also allows for quick achievement of similar editing effects even when the user 140 is unaware of the name or location of the editing component, thus improving editing efficiency.

[0066] For search requests that include search keywords, the following methods can be used to determine editing components. In some embodiments of this disclosure, in response to a search request including search keywords, at least one editing component that matches the search keywords is determined based on the degree of matching between the search keywords and the description information of each editing component among a plurality of candidate editing components.

[0067] Figure 5 illustrates a schematic diagram 500 of search keywords according to some embodiments of the present disclosure. Terminal device 110 can use Natural Language Processing (NLP) technology to parse the search keywords input by user 140 and extract feature representations corresponding to their core intent and key features. Figure 5 illustrates the input process of search keywords. Based on the input of user 140, complete keywords matching the input of user 140 can be automatically presented. For example, if the example in Figure 5 is "how to make…", then terminal device 110 can generate multiple automatically supplemented keywords, such as "how to make speed-adjustable video", "how to make subtitle editing", etc. In response to user 140 determining complete search keywords, terminal device 110 can compare the feature representation of the search keywords with the description information of each editing component in the editing component library to determine at least one editing component matching the search keywords. The description information of each editing component may include the name, functional summary, applicable scenarios, visual effects, user reviews, etc. of the editing component.

[0068] Terminal device 110 can determine the matching score between the search keyword and the description information of each candidate editing component among multiple candidate editing components based on text matching algorithms such as term frequency-inverse document frequency (TF-IDF) or cosine similarity. For editing components with higher scores, terminal device 110 identifies them as one or more editing components with high relevance to the search keyword and recommends these editing components as search results to user 140.

[0069] This keyword-based matching method helps user 140 quickly locate the desired editing functions without needing to know the specific name or location of each editing component. For example, if user 140 enters "beauty filter" as a search keyword, terminal device 110 can quickly identify editing components related to the search keyword, such as beauty filters and skin tone adjustment tools, in the editing component library based on the encoded representation of the search keyword, and display these editing components to user 140 for quick selection and application. This improvement enhances user 140's operational efficiency in the primary media content editing process, making it more convenient and intuitive. The process of displaying editing components may include sensitive word judgment and encoding representation. Based on the encoded representation of the search keyword, the encoded representation of editing components that are the same as or similar to the encoded representation of the search keyword can be determined in the editing component library. Based on this, editing components related to the search keyword can be determined. For example, the editing component library may include a functional editing component library and a material editing component library. Based on the determined editing components related to the search keyword, sorting, filtering, and other operations can be performed. Finally, the editing components that can be displayed are determined.

[0070] For a search query, the terminal device 110 can typically obtain multiple candidate editing components that match the search query. In this case, noise is inevitable. To address this, in some embodiments of this disclosure, the terminal device 110 can determine at least one editing component from the multiple candidate editing components based on component determination rules. Exemplarily, the component determination rules indicate at least one of the following: the association priority of each editing component among the multiple candidate editing components with the first media content, and the relevance between each editing component among the multiple candidate editing components and the user's historical editing behavior.

[0071] Terminal device 110 can first determine the association priority of each candidate editing component with the first media content. For example, if user 140 is currently editing a video file, and the search keyword is "noise reduction," then terminal device 110 will identify the type of the first media content as video. Based on this, terminal device 110 will filter out editing components with lower association priority with the first media content, such as filtering out the "audio noise reduction" editing component, because it is not suitable for video content. Through this filtering method, unnecessary noise can be effectively reduced, and the relevance of recommended editing components can be improved.

[0072] For candidate editing components, terminal device 110 can also make selections based on the correlation between each candidate editing component and the user's historical editing behavior. For example, terminal device 110 can analyze the types and frequencies of editing components frequently used by user 140 based on their past usage records. For instance, if user 140 has used specific filters or effects multiple times in previous editing processes, terminal device 110 will assign higher priority to such editing components. Through this personalized ranking based on user behavior, it is possible to better predict and meet user 140's current needs, making the recommendation results closer to user 140's usage habits.

[0073] Filtering and sorting can also be used in combination. Based on this, the terminal device 110 not only reduces the time that the user 140 spends searching and selecting, but also improves the convenience and efficiency of operation, enabling the user 140 to find and apply appropriate editing tools more quickly, thereby achieving the desired editing effect.

[0074] For at least one identified editing component, the terminal device 110 may, during the presentation process, present at least one editing component in the editing interface according to its respective category.

[0075] Typically, the editing components obtained by the terminal device 110 based on the search query are divided into two categories: material-based and function-based. The terminal device 110 will display these different categories of editing components on the interface. For example, material-based editing components include visual elements such as stickers and images, while function-based editing components include editing functions such as filter effects, transition effects, and color adjustments.

[0076] To improve the accuracy of the display, the terminal device 110 adopts an intelligent display strategy during the presentation process. For example, the terminal device 110 can determine the category of each candidate editing component and its relevance to the search query. To optimize the presentation, the terminal device 110 can set a relevance threshold; only editing components that meet this threshold will be presented. If, among the candidate results, the matching degree of functional editing components is low or does not meet the threshold requirement, the terminal device 110 will not present these functional editing components, but will only display material editing components that are highly relevant to the search query.

[0077] Figure 6 illustrates a schematic diagram 600 of the presentation of functional editing components according to some embodiments of the present disclosure. In the example corresponding to Figure 6, the search query is "how to make speed-adjustable video", and the terminal device 110 presents functional editing components 401 related to speed adjustment.

[0078] Figure 7 illustrates a presentation diagram 700 of a material editing component according to some embodiments of the present disclosure. In the example corresponding to Figure 7, when the search query is "cute", the terminal device 110 presents material editing components 402 related to "cute".

[0079] Through the above process, the terminal device 110 can reduce content interference that does not match the user 140's search intent, ensuring that the editing components presented to the user 140 better meet their needs and expectations, thereby improving the efficiency of editing operations.

[0080] Terminal device 110 can perform category segmentation on at least one identified editing component and determine the matching degree of each editing component with the search query. If the matching degree of functional components in the candidate results is low or does not meet a certain threshold requirement, terminal device 110 may choose not to display these functional components and only display material components that are more relevant to the search query.

[0081] The advantage of this technical solution is that the terminal device 110 can avoid displaying functional components with low relevance to the user 140's intent in the search results, thereby reducing unnecessary interference and noise. For example, if the majority of the user 140's search results are material-type components (such as images, video clips, etc.), while only a small number of functional components (such as filters, transition effects, etc.) have low matching degree, the device will prioritize displaying only material-type components, avoiding interference from irrelevant or low-matching functional components in the user 140's selection.

[0082] By employing this intelligent strategy of categorizing and combining matching scores, terminal device 110 can more accurately present editing components that best meet user needs, reducing noise interference for user 140.

[0083] Based on a target editing component determined by user 140 from at least one editing component, terminal device 110 can use the target editing component to edit first media content. Specifically, in some embodiments of this disclosure, the applicable scope of the target editing component on the first media content is determined based on the attributes of the target editing component, whereby the applicable scope indicates a target area and / or target time period of the first media content. The target editing component is applied to the target area and / or target time period of the first media content to edit the first media content.

[0084] Terminal device 110 can determine the scope of applicability of a target editing component to the first media content based on its attributes. This scope may include a specific target area of ​​the first media content (e.g., a portion of the image or multiple layers) and / or a target time period (e.g., a specific time frame or segment). For example, when user 140 selects a "highlight" effect as the target editing component, terminal device 110 can obtain the attributes of the target editing component corresponding to "highlight". For instance, the target editing component may be suitable for enhancing image brightness and highlighting certain parts visually.

[0085] On the other hand, the terminal device 110 determines the applicable scope of the target editing component corresponding to the "highlight," as well as the target area or target time period to which it is applied to the first media content. For example, the terminal device 110 can identify that the target editing component corresponding to the "highlight" is suitable for a specific time period (such as a dark scene or night scene) or a specific area of ​​the image (such as a person's face or an important object). During application, the terminal device 110 can apply the "highlight" effect to these defined target areas and / or time periods, thereby improving the visual effect of the image and making it clearer and more vivid. For the application of editing components, different editing components have corresponding jump protocols. Through the jump protocol, the editing component can be applied to the first media content. For example, the terminal device 110 can integrate the parameters corresponding to the editing component (component attributes, applicable scope to the first media content) into a jump request. The application of the editing component is executed based on the jump protocol of the editing component.

[0086] Figure 8 illustrates an application diagram 800 of a functional class editing component according to some embodiments of the present disclosure. For a selected speed-adjustment-related functional class editing component, an editing interface for that functional class editing component can be presented. That is, a speed adjustment interface can be presented so that the user 140 can determine the speed adjustment parameters.

[0087] Figure 9 illustrates an application diagram 900 of a media editing component according to some embodiments of the present disclosure. In response to a media editing component selected by user 140, media 901 corresponding to the media editing component can be displayed at the corresponding position in the first media content. This media can provide an editing adjustment window for user 140 to adjust the size or position of media 901, etc. Figure 10 illustrates an application diagram 1000 of a media editing component according to other embodiments of the present disclosure. In response to user 140's selection to display more components 902 in the interface shown in Figure 9, more media editing components related to search queries can be presented in Figure 10. This provides user 140 with a wider range of choices.

[0088] In determining the applicable scope of a target editing component on the first media content, in some embodiments of this disclosure, the terminal device 110 may determine the applicable conditions of the target editing component based on its attributes. The applicable conditions indicate at least one of the target editing component's type, effect parameters, and association rules with the first media content. The scene characteristics of the first media content are determined, indicating at least one of the first media content's type, scene content, and duration. Based on the attributes and scene characteristics of the target editing component, the applicable scope of the selected candidate editing component is determined.

[0089] The applicable conditions for a target editing component can be at least one of the following: the type of the target editing component (such as filter, subtitle, special effect), effect parameters (such as color intensity, transparency, duration), and association rules with the first media content (such as specific scene type, audio state).

[0090] On the other hand, the scene characteristics of the first media content may include at least one of the following: the type of the first media content (video, audio, image, etc.), the scene content (such as night, indoor, sports, etc.), and the duration (segment length or total video duration).

[0091] Based on the attributes of the target editing component and the scene characteristics of the first media content, the terminal device 110 can determine the specific scope of application of the editing component. For example, if the target editing component is a stabilizer effect suitable for motion scenes, the terminal device 110 will automatically identify the time periods of motion shots in the video and apply the stabilizer effect to these time periods, thereby achieving an editing effect that better meets the needs of the scene.

[0092] Figure 11 shows a schematic structural block diagram of an apparatus 1100 for media content editing according to some embodiments of the present disclosure. The apparatus 1100 may be implemented in or included in a terminal device 110, for example. The various modules / components in the apparatus 1100 may be implemented by hardware, software, firmware, or any combination thereof.

[0093] As shown in Figure 11, the device 1100 includes an editing component presentation module 1101, configured to, in response to a search query received on the editing interface of the first media content, present at least one editing component matching the search query on the editing interface, wherein the at least one editing component is an editing component applicable to the first media content. A media content editing module 1102 is configured to, in response to a trigger operation on a target editing component of the at least one editing component, present an editing effect image of the first media content formed under the target editing component, based on the target editing component and the first media content.

[0094] In some embodiments of this disclosure, the editing component presentation module 1101 may be specifically configured to, in response to a search request including second media content, determine a first editing component used in the editing process of the second media content based on the metadata of the second media content. At least one editing component associated with the first editing component is then determined from a plurality of candidate editing components.

[0095] In some embodiments of this disclosure, the editing component presentation module 1101 may be specifically configured to, in response to a search request including third media content, extract a visual feature representation of the third media content. Based on the visual feature representation, determine a second editing component used in the editing process of the third media content. Determine at least one editing component related to the second editing component from a plurality of candidate editing components.

[0096] In some embodiments of this disclosure, the editing component presentation module 1101 may be specifically configured to, in response to a search request including search keywords, determine at least one editing component that matches the search keywords based on the degree of matching between the search keywords and the description information of each of the multiple candidate editing components.

[0097] In some embodiments of this disclosure, the editing component presentation module 1101 may be specifically configured to determine a plurality of candidate editing components that match a search query. Based on component determination rules, at least one editing component is determined from the plurality of candidate editing components.

[0098] In some embodiments of this disclosure, the component determination rule may indicate at least one of the following: the association priority of each editing component among a plurality of candidate editing components with the first media content, and the relevance of each editing component among a plurality of candidate editing components with the user's historical editing behavior.

[0099] In some embodiments of this disclosure, the editing component presentation module 1101 may also be specifically configured to present at least one editing component in the editing interface by category based on the respective category of at least one editing component.

[0100] In some embodiments of this disclosure, the media content editing module 1102 may be specifically configured to determine the applicable scope of the target editing component on the first media content based on the attributes of the target editing component, wherein the applicable scope indicates the target area and / or target time period of the media content. The target editing component is then applied to the target area and / or target time period of the first media content to edit the first media content.

[0101] In some embodiments of this disclosure, the media content editing module 1102 may further be specifically configured to determine the applicable conditions of the target editing component based on its attributes. The applicable conditions indicate at least one of the target editing component's type, effect parameters, and association rules with the first media content. The scene characteristics of the first media content are determined, indicating at least one of the first media content's type, scene content, and duration. Based on the attributes and scene characteristics of the target editing component, the applicable scope of the selected candidate editing component is determined.

[0102] Figure 12 illustrates a block diagram of an electronic device 1200 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the electronic device 1200 shown in Figure 12 is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. The electronic device 1200 shown in Figure 12 may include or be implemented as the terminal device 110 of Figure 1 or the apparatus 1100 of Figure 11.

[0103] As shown in Figure 12, electronic device 1200 is in the form of a general-purpose electronic device. Components of electronic device 1200 may include, but are not limited to, one or more processors or processing units 1210, memory 1220, storage device 1230, one or more communication units 1240, one or more input devices 1250, and one or more output devices 1260. Processing unit 1210 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 1220. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 1200.

[0104] Electronic device 1200 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 1200, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 1220 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 1230 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 1200.

[0105] Electronic device 1200 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG12, disk drives for reading or writing from removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading or writing from removable, non-volatile optical disks may be provided. In these cases, each drive may be connected to a bus (not shown) via one or more data media interfaces. Memory 1220 may include computer program product 1225 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0106] The communication unit 1240 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 1200 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 1200 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0107] Input device 1250 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 1260 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 1200 can also communicate with one or more external devices (not shown) via communication unit 1240 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 1200, or with any device that enables electronic device 1200 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).

[0108] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0109] According to an exemplary implementation of this disclosure, a computer program product or computer program is provided, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in the various alternative embodiments of FIG2, which will therefore not be described further herein.

[0110] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0111] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0112] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0113] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0114] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for editing media content, comprising: In response to receiving a search query in the editing interface of the first media content, at least one editing component matching the search query is presented in the editing interface, wherein the at least one editing component is an editing component that can be applied to the first media content; as well as In response to a trigger operation on a target editing component of the at least one editing component, an edited effect image formed by the first media content under the target editing component is presented, based on the target editing component and the first media content.

2. The method of claim 1, wherein the at least one editing component is determined by: In response to the search request including second media content, Based on the metadata of the second media content, determine the first editing component used in the editing process of the second media content; and At least one editing component is identified from a plurality of candidate editing components that is associated with the first editing component.

3. The method according to claim 1 or 2, wherein the at least one editing component is determined by: In response to the search request including third-party media content, Extract visual feature representations of the third media content; Based on the visual feature representation, determine the second editing component used in the editing process of the third media content; and At least one editing component associated with the second editing component is determined from a plurality of candidate editing components.

4. The method according to any one of claims 1 to 3, wherein the at least one editing component is determined by: In response to the search request including search keywords, Based on the matching degree between the search keyword and the description information of each candidate editing component among multiple candidate editing components, at least one editing component that matches the search keyword is determined.

5. The method according to any one of claims 1 to 3, wherein the at least one editing component is determined by: Identify multiple candidate editing components that match the search query; and Based on component determination rules, at least one editing component is determined from the plurality of candidate editing components, wherein the component determination rules indicate at least one of the following: The association priority between each of the plurality of candidate editing components and the first media content. The correlation between each editing component among the multiple candidate editing components and the user's historical editing behavior.

6. The method according to any one of claims 1 to 5, wherein presenting at least one editing component matching the search query in the editing interface comprises: Based on the respective categories of the at least one editing component, the at least one editing component is presented in the editing interface according to its category.

7. The method according to any one of claims 1 to 6, wherein editing the first media content based on the target editing component comprises: Based on the attributes of the target editing component, the applicable scope of the target editing component on the first media content is determined, wherein the applicable scope indicates the target area and / or target time period of the first media content; as well as The target editing component is applied to the target area and / or target time period of the first media content to edit the first media content.

8. The method according to claim 7, wherein determining the scope of application of the target editing component to the first media content based on the attributes of the target editing component includes: Based on the attributes of the target editing component, the applicable conditions for the target editing component are determined, wherein the applicable conditions indicate at least one of the type of the target editing component, effect parameters, and association rules with the first media content; Determine the scene characteristics of the first media content, wherein the scene characteristics of the first media content indicate at least one of the type, scene content, and duration of the first media content; as well as Based on the attributes of the target editing component and the scene characteristics, the applicable scope of the selected candidate editing component is determined.

9. An apparatus for editing media content, comprising: An editing component presentation module is configured to, in response to receiving a search query in the editing interface of the first media content, present at least one editing component that matches the search query in the editing interface, wherein the at least one editing component is an editing component that can be applied to the first media content; as well as The media content editing module is configured to, in response to a trigger operation on a target editing component of the at least one editing component, present an edited image of the first media content formed under the target editing component, based on the target editing component and the first media content.

10. An electronic device, comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 8 when executed by the at least one processor.

11. A computer-readable storage medium having stored thereon computer-executable instructions that can be executed by a processor to implement the method according to any one of claims 1 to 8.

12. A computer program product comprising computer-executable instructions that, when executed by a processor, implement the method of any one of claims 1 to 8.

Images