Media content processing method and device, and storage medium and program product

Abstract

Provided in the embodiments of the present disclosure are a media content processing method and device, and a storage medium and a program product. The media content processing method comprises: displaying dialogue content in a dialog window of a first interface, wherein the dialogue content is used for indicating an editing intent of a user for media content to be processed, and the first interface comprises an editing track, an editing effect preview area and the dialog window, the editing track being configured to present a video clip formed on the basis of said media content, and the editing effect preview area being configured to play the video clip formed on the basis of said media content; and on the basis of the dialogue content, editing said media content, so as to obtain target media content, wherein the target media content comprises said media content and editing information. The embodiments of the present disclosure reduce the learning cost of a target user, have simple operations, and increase the level of intelligence of media content generation.

Description

Media content processing method, device, storage medium and program product

[0001] This application claims priority to Chinese Patent Application No. 202311024778.1 filed on August 14, 2023, and the contents of the above-mentioned Chinese patent application disclosure are hereby incorporated by reference in their entirety as a part of this application. Technical Field

[0002] Embodiments of the present disclosure relate to a media content processing method, device, storage medium, and program product. Background Art

[0003] In media content editing software, functional controls are provided at fixed locations on the editing page for editing media content. During the editing process, users need to be familiar with the locations of these functional controls and master their operation methods. The operation is complex, the learning cost is high, and the intelligence level is low, which is not conducive to user operation.

[0004] Summary of the Invention

[0005] Embodiments of the present disclosure provide a media content processing method, device, storage medium, and program product.

[0006] In a first aspect, an embodiment of the present disclosure provides a method for processing media content, including:

[0007] Displaying a conversation content in a conversation window on a first interface; the conversation content is used to indicate a user's editing intention for the media content to be processed; the first interface includes an editing track, an editing effect preview area, and the conversation window, the editing track is used to present a video clip formed based on the media content to be processed, and the editing effect preview area is used to play the video clip formed based on the media content to be processed;

[0008] Performing editing processing on the media content to be processed according to the conversation content to obtain target media content; the target media content includes the media content to be processed and editing information; the editing information is used to indicate the editing operation performed on the media content to be processed;

[0009] A video clip formed based on the target media content is presented on the editing track.

[0010] In a second aspect, an embodiment of the present disclosure provides a media content processing device, including:

[0011] The display module is configured to display the conversation content in a conversation window of a first interface; the conversation content is used to indicate the user's editing intention for the media content to be processed; the first interface includes an editing track, an editing effect preview area, and the conversation window, the editing track is used to present a video clip formed based on the media content to be processed, and the editing effect preview area is used to play the video clip formed based on the media content to be processed;

[0012] an editing module configured to edit the media content to be processed based on the conversation content to obtain target media content; the target media content includes the media content to be processed and editing information; the editing information is used to indicate the editing operation to be performed on the media content to be processed;

[0013] The display module is further configured to present a video clip formed based on the target media content on the editing track.

[0014] In a third aspect, an embodiment of the present disclosure provides an electronic device, including: a processor and a memory;

[0015] The memory stores computer-executable instructions;

[0016] The processor executes the computer-executable instructions stored in the memory, so that the at least one processor performs the media content processing method as described in the first aspect and various possible designs of the first aspect.

[0017] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the media content processing method described in the first aspect and various possible designs of the first aspect is implemented.

[0018] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the media content processing method described in the first aspect and various possible designs of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, a brief introduction will be given below to the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0020] FIG1 is a flow chart of a method for processing media content according to an embodiment of the present disclosure;

[0021] FIG2 is an interactive diagram of a media content processing method provided by an embodiment of the present disclosure;

[0022] 3a to 3d are schematic diagrams of interfaces for a conversation of changing music and editing provided by an embodiment of the present disclosure;

[0023] 4a to 4d are schematic diagrams of interfaces for editing conversation content using a background change process according to an embodiment of the present disclosure;

[0024] FIG5 is a structural block diagram of a media content processing device provided by an embodiment of the present disclosure; and

[0025] FIG6 is a schematic diagram of the hardware structure of a media content processing device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0026] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present disclosure without making any creative efforts shall fall within the scope of protection of the present disclosure.

[0027] To address the aforementioned issues of high operational difficulty and low intelligence in media content editing, the inventors of the present disclosure have discovered that a human-computer dialogue approach can be used to determine the user's editing intent, and then edit the media content to be processed based on this intent to obtain the target media content. Based on this, the present disclosure provides a media content processing method.

[0028] The media content processing method provided by the present disclosure can be implemented by electronic devices, or applications (APPs) in electronic devices, web pages, etc. Electronic devices may include mobile phones, tablet computers, wearable electronic devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), smart TVs, smart screens, high-definition TVs, 4K TVs, smart speakers, smart projectors and other smart home devices. The embodiments of the present disclosure do not impose any restrictions on the specific types of electronic devices. The embodiments of the present disclosure do not limit the type of operating system of the electronic device, for example, Android system, Linux system, Windows system, iOS system, etc.

[0029] 1, which is a flow chart of a media content processing method provided by an embodiment of the present disclosure. The media content processing method includes:

[0030] 101. Displaying the conversation content in a conversation window of the first interface; the conversation content is used to indicate the user's editing intention for the media content to be processed; the first interface includes an editing track, an editing effect preview area and a conversation window, the editing track is used to present a video clip formed based on the media content to be processed, and the editing effect preview area is used to play a video clip formed based on the media content to be processed.

[0031] During the specific implementation process, the media content to be processed can be imported into the editing track of the first interface, and then the initial editing effect of the media content to be processed can be viewed in the editing preview area. In the subsequent editing process of the media content to be processed based on the conversation content, the edited media content to be processed can be presented in real time on the editing track, so that the editing effect of the edited media content to be processed can be viewed in real time through the editing preview area.

[0032] For example, after performing a background-changing editing operation on the media content to be processed based on the conversation content, the editing effect of the media content to be processed after the background is changed can be viewed in the editing effect preview area. Then, after performing a music-changing editing operation, the editing effect of the media content to be processed after the music is changed can be viewed in real time, thereby facilitating the user to input conversation information for the next editing operation based on the editing effect presented in the editing effect preview area.

[0033] Among them, the media content to be processed can be original material (such as pictures, video materials, etc.), and accordingly, the video clip formed based on the media content to be processed can contain one or more frames of images, and can also refer to a video, and can also be a video draft pre-generated based on the original material (such as pictures, video materials, etc.), and the video draft includes the original material and editing information, and the editing information is used to indicate the editing operation performed on the original material. In one embodiment of the present disclosure, the content to be processed is video material; before the conversation content is displayed in the conversation window of the first interface, it also includes: obtaining the video material; presenting the video clip formed based on the video material on the editing track; editing the media content to be processed according to the conversation content to obtain the target media content, including: editing the video material according to the conversation content to obtain a video draft; the video draft includes the video material and editing information; the editing information is used to indicate the editing operation performed on the video material.

[0034] In addition, conversation content can include both user conversation messages and system conversation messages. Conversation messages can include text, numbers, symbols, links, emoticons, images, audio, video clips, and other data types, with no restrictions. Display parameters such as the size, color, display position, and transparency of the editing effect preview area, editing track, and conversation window are also unrestricted.

[0035] There are many ways to input user dialogue information.

[0036] In one implementation, to facilitate guidance for users with less editing experience, an operation control can be displayed within the first interface, allowing the user to express their editing intention by triggering the operation control. Specifically, the conversation content can include first user conversation information, and the media content processing method can further include: displaying a target function control within the first interface; and generating first user conversation information corresponding to the target function control in response to a touch operation on the target function control.

[0037] The target function controls may include controls for changing the scale, changing the music, adding text, replacing the material, adjusting the filter, adding special effects, etc. The target function controls may be displayed in the form of icons, text, symbols, images, etc., or in a combination of multiple forms, which is not limited in this disclosure.

[0038] In another possible implementation, to increase user flexibility in inputting user conversation information, an input area can be provided in the first interface, allowing the user to enter user conversation information within the input area. Specifically, the conversation content can include second user conversation information, and the first interface can include a conversation input area. The media content processing method can further include: obtaining the second user conversation information in response to an input operation performed on the conversation input area. The disclosed embodiment does not limit display parameters such as the input area size, color, display position, and display transparency.

[0039] In another possible implementation, to expand the user's editing ideas, editing suggestion information can be presented in the dialog window of the first interface, allowing the user to enter user dialog information based on the editing suggestion information. The editing suggestion information can be determined based on the media content to be processed. For example, if the media content to be processed includes background music, an editing suggestion to change the music can be provided.

[0040] It should be noted that the above-mentioned various user dialogue information input methods can be implemented separately or in any combination, and the embodiments of the present disclosure do not limit this.

[0041] The conversation information from different objects in the conversation content can be set on the same side or on different sides. For example, the user conversation information from the user can be set on the right side of the conversation window, aligned on the right side, and the system conversation information from the system can be set on the left side of the conversation window, aligned on the left side. The conversation information of both parties can also be aligned on the left side or right side. This is not limited in the embodiments of the present disclosure.

[0042] 102. Edit the media content to be processed according to the conversation content to obtain target media content; the target media content includes the media content to be processed and editing information; the editing information is used to indicate the editing operation performed on the media content to be processed.

[0043] Specifically, after obtaining the conversation content, the editing intention of the conversation content may be identified, and the media content to be processed may be edited based on the editing intention to obtain the target media content.

[0044] Exemplarily, the recognition process can include natural language processing of the conversation content to obtain multiple tags representing the creative intent. Based on these tags, corresponding operation controls (e.g., changing the background, changing the music, adding special effects, etc.) and parameters to be edited (e.g., background style, color, composition, etc.; music author, lyrics, music cover, etc.; candidate special effects styles, location, etc.) are determined. The parameters are then adjusted based on the operation controls to obtain the target media content. The target media content can be video, graphic, image, or other data types.

[0045] For example, the user can input the user dialogue message "Help me change the background to one with blue sky and white clouds". The system can perform natural language processing on the dialogue message to determine the user's editing intention, and then call two related components, such as the cutout component and the component for selecting background replacement. The cutout component is used to cut out objects such as people and scenery other than the background in the editing content to be processed, and the component for selecting background replacement is used to provide the user with a card (control) consisting of multiple candidate backgrounds to be replaced in the dialogue window, and then receive the user's selection operation on the candidate background, so as to realize the editing intention of replacing the background of blue sky and white clouds based on the fusion of the selected candidate background and the cutout result, and obtain the target media content.

[0046] For the case of multiple components (cards), there are many ways to determine the execution order of the components. For example, you can set the order for different cards in advance and then execute them in sequence. Specifically, you can set parameters for each card. The parameter is the first value during card execution, and the parameter is the second value after the card is executed. At this time, the component cannot execute any logic or output any renderable content.

[0047] 103. Present the video clip formed based on the target media content on the editing track.

[0048] Specifically, after the target media content is generated, in order to facilitate viewing of the editing effect of the target media content, the video clips formed based on the target media content may be presented on the editing track.

[0049] From the above description, it can be seen that the media content processing method provided by the present disclosure realizes information interaction between the user and the system by adopting a dialogue method, and then edits the editing content to be processed based on the acquired dialogue content representing the user's editing intention to obtain the target editing content, thereby reducing the learning cost of the target user, simplifying the operation, and improving the intelligence level of media content generation.

[0050] In one embodiment of the present disclosure, based on the embodiment of Figure 1 above, the media content processing method also includes: presenting the media content to be processed on an editing track; obtaining the current position of the preview pointer on the editing track; the preview pointer is used to move along the editing track; determining the editing position of the media content to be processed based on the current position; and editing the media content to be processed based on the conversation content, including: editing the material corresponding to the editing position in the media content to be processed based on the conversation content.

[0051] Specifically, the app's creation page can display multiple video draft covers. Clicking a cover takes you to the first interface, where you can import the video draft corresponding to the cover into the editing track within the first interface. You can then view the editing effects of the video clip formed from the video draft in the editing effect preview area. You can also position the editing effect preview area to the editing image frame corresponding to the preview pointer's position by moving the preview pointer on the editing track. This allows you to edit the editing image frame through a human-computer interaction in the dialogue window.

[0052] In one embodiment of the present disclosure, based on the embodiment of Figure 1 above, editing the media content to be processed according to the conversation content may include: determining the editing intent according to the conversation content; determining the editing tools and editing parameters according to the editing intent; and editing the media content to be processed using the editing tools based on the editing parameters.

[0053] Specifically, natural language processing can be performed on the conversation content to identify the user's editing intent. Based on this editing intent, the corresponding editing tools and editing parameters are determined. The parameters are then adjusted based on the operation controls to obtain the target media content. The target media content can be video, text, images, and other types of data.

[0054] The editing tool refers to a UI component, such as a React component, which is an encapsulated UI component with independent functions. For example, it can be an editing control for changing the background, changing the music, adding special effects, etc. The editing parameters refer to the editing parameters used by the editing tool during editing, such as the style, color, and composition of the background, the author, lyrics, and cover of the music, and the candidate styles and location of special effects.

[0055] In one embodiment of the present disclosure, the conversation content may include user conversation information and system conversation information, and the source of the editing intention comes from, on the one hand, the recognition of the intention of the user conversation information, and on the other hand, the analysis of the user's touch operation of the operation control provided in the system conversation information. Specifically, determining the editing intention based on the conversation content may include: determining the first editing intention in the editing intention based on the fourth user conversation information in the conversation content; determining the operation control and the editing parameters corresponding to the operation control based on the first editing intention; correspondingly, based on the editing parameters, editing the media content to be processed by the editing tool, may include: displaying the operation control in the conversation window of the first interface; adjusting the editing parameters in response to the touch operation acting on the operation control to obtain the target editing parameters, and editing the media content to be processed by the editing tool based on the target editing parameters.

[0056] In one embodiment of the present disclosure, in order to save computing resources of the terminal device, the step of intent recognition can be performed by the server. Specifically, according to the fourth user dialogue information in the dialogue content, determining the first editing intent in the editing intent may include: sending the fourth user dialogue information to the server, so that the server performs natural language processing on the fourth user dialogue information, obtains the corresponding editing intent, assembles and generates a reply script according to the editing intent, and sends the reply script to the client; the reply script includes a function and a parameter keyword corresponding to the function; according to the first editing intent, determining the operation control and the editing parameter corresponding to the operation control may include: receiving the reply script; determining the operation control corresponding to the function according to the reply script; and determining the corresponding editing parameter according to the parameter keyword.

[0057] Specifically, parameter keywords are basic command keywords. To obtain editing parameters, the client must request an interface, assemble, and render them. For example, a music card's response script only passes in the keyword parameter, without information like the label icon, theme title, or musicID. The client must request an interface, assemble, and render the card based on the command keyword.

[0058] For example, as shown in Figure 2, taking the video draft as the editable content, a user enters a statement (user conversation information) in the conversation window of the first interface of the client. Based on this input statement, the client sends an UpsertSessionReq to the server. Upon receiving this request, the server creates a conversation context and performs natural language processing (NLP) on the input statement carried in the UpsertSessionReq. It then identifies the editing intent and determines the editing tool (UI component) based on the editing intent. It then assembles a response script (AnswerScript) and sends an UpsertSessionRsp response to the client based on this response script. This response includes information about the response script. The client interprets the response script and injects the editing parameters (Params) to execute the script. During script execution, a card for a component included in the script is displayed in the conversation window. A user touch operation (click or long press) is received. In response to this touch operation, the editing parameters are adjusted. The video draft is edited based on the adjusted editing parameters. The server then determines whether a preset condition is met. If so (for example, the previous card has been executed), the card for the next component is executed. After multiple sessions, when the editing effect meets the user's needs, the user can trigger a close operation on the first interface of the client to close the draft editor, i.e., the first interface. The client sends a destroy session request DestroySessionReq to the server based on the close instruction.

[0059] In one embodiment of the present disclosure, in order to better guide users in performing editing operations, after determining the editing intent based on user dialogue information, the operation controls for the current editing operation and recommended information for the next editing operation can be determined based on the editing intent. Specifically, after determining the first editing intent in the editing intent based on the user dialogue information in the dialogue content, the following steps may also be included: determining recommended information for the next editing operation based on the first editing intent; displaying the recommended information for the next editing operation in the dialogue window of the first interface, so that the user can enter fifth user dialogue information based on the recommended information for the next editing operation; and the fifth user dialogue information is used to indicate the second editing intent in the editing intent.

[0060] Specifically, the dialog window of the first interface may display multiple user dialogue messages entered by the user, and each user dialogue message may identify an editing intent. These editing intents collectively constitute the editing intent corresponding to the user dialogue message. Of course, if the dialogue content also includes system dialogue messages, the system dialogue messages may include operation controls and editing parameters determined based on the editing intent determined based on the user dialogue messages. Touching the operation controls in the system dialogue messages may then retrieve the user editing intent determined based on the system dialogue messages.

[0061] The following is an example description of the editing process of changing music with reference to FIG3a to FIG3d.

[0062] After the application (media content editing application) is started, the user interface 31 shown in Figure 3a can be displayed on the mobile phone, where the user interface 31 is a conversational editing page (i.e., the first interface). The conversational editing page is mainly used to present and obtain the conversation content between the user and the system, and obtain the target media content based on the conversation content editing.

[0063] 3a , the user interface 31 includes a dialogue window 301, a user preview area 302, an editing track 303, and a dialogue input area 304. The user preview area 302 displays a video editing frame of the media content to be processed, indicated by a preview pointer. The editing track 303 includes a preview pointer, which is used to indicate the editing position. The dialogue window 301 displays some operation suggestions for the media content to be processed, such as "change music", "add packaging", "smart copywriting", and "replace material". The dialogue input area 304 is used to enter user dialogue information. Based on the suggestions, the user can enter user dialogue information in the dialogue input area 304 to indicate the editing intention. For example, suppose the user wants to perform the editing process of "changing music".

[0064] Continuing with reference to Figure 3b, the dialogue input area 304 of the user interface 32 displays the user dialogue information "Change Music" input by the user. The system obtains the user dialogue information and performs intent recognition on the user dialogue information. Based on the recognized editing intent, the operation controls and editing parameters of the current operation are determined to display the operation controls in the dialogue window. The editing parameters can be adjusted by the user's touch operation on the operation controls.

[0065] Continuing with reference to FIG3c, the dialogue input area 304 of the user interface 33 displays the user dialogue information "Change Music" based on the user input, and the system dialogue information fed back by the system. The system dialogue information includes the operation controls for the current operation determined based on the user's editing intent. As shown in FIG3c, the operation controls include editing parameters such as multiple candidate music (original, music 1, music 2, music 3) for the user to select, and also include adjustment controls and the editing parameters corresponding to the adjustment controls. In addition, below the system dialogue information, the suggested information for the next operation "Light-tempo music" and "Recommended popular music" is also displayed. This suggested information can be determined by the system based on the editing intent of the user dialogue information "Change Music". In other words, according to the editing intent, both the operation controls for the current operation and the recommended information for the next operation are determined. Based on this, it is more conducive to the user to efficiently perform subsequent editing processes.

[0066] Continuing with reference to FIG3d , a user touch operation (click or long press) on the adjustment control is received. In response to the touch operation, further operation controls, such as cropping and volume, are displayed in the dialogue input area 304 of the user interface 32 for selecting segments and adjusting the volume.

[0067] 3b to 3d also include a user preview area 302, an editing track 303, and a dialogue input area 304. For descriptions of these areas, please refer to the description of FIG. 3a and will not be repeated here.

[0068] It should be noted that the embodiments shown in Figures 3a to 3d are only examples of the media content processing method provided by the embodiments of the present disclosure. In actual scenarios, the display method, presentation form, related control setting method of the conversation content, as well as the layout, display parameters, and implementation methods of controls and entrances of some pages can be flexibly set according to needs.

[0069] The following is an example description of the background changing editing process with reference to FIG. 4 a - FIG. 4 d .

[0070] After the application (media content editing application) is started, the user interface 41 shown in Figure 4a can be displayed on the mobile phone, where the user interface 41 is a conversational editing page (i.e., the first interface). The conversational editing page is mainly used to present and obtain the conversation content between the user and the system, and obtain the target media content based on the conversation content editing.

[0071] As shown in Figure 4a, user interface 41 includes a dialog window 301, a user preview area 302, an editing track 304, and a dialog input area 304. User preview area 302 displays a video editing frame of the media content to be processed, indicated by a preview pointer. Editing track 304 includes a preview pointer that indicates the editing position. Dialog window 301 displays a number of suggested operations for the media content to be processed, including "Change Aspect," "Add Package," "Smart Add Copy," and "Replace Material." Dialog input area 304 is used to enter user dialog information. Based on the suggestions, the user can enter user dialog information in dialog input area 304 to indicate their editing intentions. As shown in Figure 4a, assuming the user wants to perform the "Change Aspect" editing process, the user dialog information "Change Aspect" entered by the user will be displayed in dialog input area 304 of user interface 41.

[0072] Continuing with FIG4b , the system obtains the user dialogue message "Change Aspect Ratio" and performs intent recognition on the user dialogue message. Based on the recognized editing intent, the system determines the operation controls and editing parameters for the current operation corresponding to the editing intent of "Change Aspect Ratio," and displays the operation controls in the dialogue window. The editing parameters can be adjusted by the user touching the operation controls. As shown in FIG4b , the dialogue input area 304 of the user interface 42 displays the user dialogue message "Change Aspect Ratio" input by the user, and the system dialogue message fed back by the system. The system dialogue message includes the operation controls for the current operation determined based on the user's editing intent, and the operation controls include multiple editing parameters such as candidate aspect ratios (original, 9:16, 16:9, 1:1, and 4:3) for the user to select. Upon receiving the user's touch operation for 9:16, as shown in FIG4a and FIG4b , the image frame in the editing effect preview area switches from the original aspect ratio to 9:16.

[0073] In addition, below the system dialog message, suggested next actions are displayed, including "Smart Packaging," "Adjust Filters," and "Add Special Effects." These suggestions are likely based on the user's editing intent, such as "Change Scale," in the dialog message. In other words, the editing intent determines both the current action controls and the next action recommendations. This makes subsequent editing more efficient for users.

[0074] Continuing with reference to Figure 4c, in order to facilitate users to perform editing operations on image frames, an editing function can be provided in the editing effect preview area. As shown in Figure 4c, the user's touch operation (click or long press) on the image area in the editing effect preview area 302 of the user interface 43 is received. In response to the touch operation, the image area can be switched to a selected state.

[0075] Continuing with FIG4d , a user touch operation (click or drag) on ​​the selected box is received. In response to the touch operation, the image within the image area is magnified based on the magnification factor of the selected box. Exemplarily, the image magnification factor can be fuzzily determined based on the magnification factor of the selected box. Exemplarily, in one case, if the magnification factor of the selected box is greater than 1, the image is magnified by a preset factor, such as 1.1. In another case, the magnification factor of the selected box is divided into multiple intervals, with different intervals corresponding to different image magnification factors. For example, magnification factors of 1-1.2 and 1.2-1.3 correspond to image magnification factors of 1.1 and 1.2, respectively.

[0076] 4 b to 4 d further include a user preview area 302 , an editing track 304 , and a dialogue input area 304 . The description of these areas can be found in the description of FIG. 4 a , and will not be repeated here.

[0077] It should be noted that the embodiments shown in Figures 4a to 4d are only examples of the media content processing method provided by the embodiments of the present disclosure. In actual scenarios, the display method, presentation form, related control setting method of the conversation content, as well as the layout, display parameters, and implementation methods of controls and entrances of some pages can be flexibly set according to needs.

[0078] Corresponding to the media content processing method of the above embodiment, FIG5 is a block diagram of the structure of the media content processing device provided by the embodiment of the present disclosure. For ease of illustration, only the parts relevant to the embodiment of the present disclosure are shown. Referring to FIG5, the media content processing device 50 includes: a display module 501 and an editing module 502.

[0079] The display module 501 is configured to display the conversation content in the conversation window of the first interface; the conversation content is used to indicate the user's editing intention for the media content to be processed; the first interface includes an editing track, an editing effect preview area, and a conversation window; the editing track is used to present a video clip formed based on the media content to be processed, and the editing effect preview area is used to play the video clip formed based on the media content to be processed;

[0080] The generating module 502 is configured to edit the media content to be processed according to the conversation content to obtain target media content; the target media content includes the media content to be processed and editing information; the editing information is used to indicate the editing operation to be performed on the media content to be processed;

[0081] The display module 501 is further configured to present a video clip formed based on the target media content on the editing track.

[0082] In one embodiment of the present disclosure, the display module 501 is further configured to: display the target function control in the first interface; and generate first user dialogue information corresponding to the target function control in response to a touch operation on the target function control.

[0083] In one embodiment of the present disclosure, the conversation content includes second user conversation information, the first interface includes a conversation input area, and the display module 501 is further configured to: obtain the second user conversation information in response to an input operation acting on the conversation input area.

[0084] In one embodiment of the present disclosure, the conversation content includes third user conversation information, and the display module 501 is further configured to: display at least one editing operation recommendation information in the first interface; the editing operation recommendation information is determined based on the media content to be processed; and obtain the third user conversation information in response to an input operation triggered by at least one prompt information acting on the conversation input area.

[0085] In one embodiment of the present disclosure, the generation module 502 is specifically configured to: determine the editing intention according to the conversation content; determine the editing tool and editing parameters according to the editing intention; and edit the media content to be processed using the editing tool based on the editing parameters.

[0086] In one embodiment of the present disclosure, the generation module 502 is specifically configured to: determine the first editing intention in the editing intention based on the fourth user dialogue information in the dialogue content; determine the operation control and the editing parameters corresponding to the operation control based on the first editing intention; display the operation control in the dialogue window of the first interface; adjust the editing parameters in response to the touch operation acting on the operation control to obtain the target editing parameters, and edit the media content to be processed through the editing tool based on the target editing parameters.

[0087] In one embodiment of the present disclosure, the generation module 502 is specifically configured to: send the fourth user conversation information to the server, so that the server performs natural language processing on the fourth user conversation information, obtains the corresponding editing intention, assembles and generates a reply script according to the editing intention, and sends the reply script to the client; the reply script includes a function and parameter keywords corresponding to the function; receives the reply script; determines the operation control corresponding to the function according to the reply script; and determines the corresponding editing parameters according to the parameter keywords.

[0088] In one embodiment of the present disclosure, the generation module 502 is also configured to: determine the recommended information for the next editing operation based on the first editing intention; display the recommended information for the next editing operation in the dialogue window of the first interface, so that the user can enter the fifth user dialogue information based on the recommended information for the next editing operation; the fifth user dialogue information is used to indicate the second editing intention in the editing intention.

[0089] In one embodiment of the present disclosure, the generation module 502 is further configured to: present the media content to be processed on the editing track; obtain the current position of the preview pointer on the editing track; the preview pointer is used to move along the editing track; determine the editing position of the media content to be processed based on the current position; and edit the material corresponding to the editing position in the media content to be processed based on the conversation content.

[0090] In one embodiment of the present disclosure, the generation module 502 is further configured to: obtain video material; present a video clip formed based on the video material on an editing track; edit the video material according to the content of the conversation to obtain a video draft; the video draft includes the video material and editing information; the editing information is used to indicate the editing operations performed on the video material.

[0091] The device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail in this embodiment.

[0092] In order to implement the above embodiment, the embodiment of the present disclosure further provides an electronic device.

[0093] 6 , which shows a schematic diagram of the structure of an electronic device 900 suitable for implementing an embodiment of the present disclosure. The electronic device 900 may be a terminal device or a server. The terminal device may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable media players (PMPs), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), and fixed terminals such as digital TVs and desktop computers. The electronic device shown in FIG6 is merely an example and should not limit the functions and scope of use of the embodiments of the present disclosure.

[0094] As shown in Figure 6, the electronic device 900 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 into a random access memory (RAM) 903. Various programs and data required for the operation of the electronic device 900 are also stored in the RAM 903. The processing device 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0095] Typically, the following devices may be connected to the I / O interface 905: an input device 906 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 907 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 908 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 909. The communication device 909 may allow the electronic device 900 to communicate with other devices wirelessly or by wire to exchange data. Although FIG6 shows an electronic device 900 with various devices, it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or have alternatively.

[0096] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via the communication device 909, or installed from the storage device 908, or installed from the ROM 902. When the computer program is executed by the processing device 901, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0097] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0098] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0099] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0100] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet Service Provider).

[0101] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0102] The units involved in the embodiments described in this disclosure may be implemented in software or hardware. In some cases, the name of a unit does not limit the unit itself. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses."

[0103] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0104] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0105] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0106] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0107] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A media content processing method, comprising: Displaying the conversation content in the conversation window of the first interface; wherein the conversation content is used to indicate the user's editing intention for the media content to be processed; the first interface includes an editing track, an editing effect preview area and the conversation window, the editing track is used to present a video clip formed based on the media content to be processed, and the editing effect preview area is used to play the video clip formed based on the media content to be processed; According to the conversation content, the media content to be processed is edited to obtain target media content; wherein the target media content includes the media content to be processed and editing information; the editing information is used to indicate the editing operation performed on the media content to be processed; A video clip formed based on the target media content is presented on the editing track.

2. The method according to claim 1, wherein: The conversation content includes first user conversation information, and the method further includes: Displaying a target function control in the first interface; In response to the touch operation acting on the target function control, the first user dialogue information corresponding to the target function control is generated.

3. The method according to claim 1, wherein: The conversation content includes second user conversation information, the first interface includes a conversation input area, and the method further includes: In response to an input operation applied to the dialogue input area, the second user dialogue information is acquired.

4. The method according to claim 3, wherein: The conversation content includes conversation information of a third user, and the method further includes: Displaying at least one editing operation recommendation information in the first interface; wherein the editing operation recommendation information is determined according to the media content to be processed; In response to an input operation acting on the dialogue input area and triggered by the at least one prompt information, the third user dialogue information is acquired.

5. The method according to any one of claims 1 to 4, wherein: The editing process of the to-be-processed media content according to the conversation content includes: Determining the editing intention according to the content of the conversation; Determine editing tools and editing parameters according to the editing intention; Based on the editing parameters, the to-be-processed media content is edited by the editing tool.

6. The method according to claim 5, wherein: The editing intention includes a first editing intention, and determining the editing intention according to the conversation content includes: Determining a first editing intention among the editing intentions according to the fourth user conversation information in the conversation content; Determining, according to the first editing intention, an operation control and an editing parameter corresponding to the operation control; The editing process of the to-be-processed media content by using the editing tool based on the editing parameter includes: Displaying the operation control in the dialog window of the first interface; In response to a touch operation on the operation control, the editing parameter is adjusted to obtain a target editing parameter, and based on the target editing parameter, the to-be-processed media content is edited by the editing tool.

7. The method according to claim 6, wherein: The determining, according to the fourth user dialogue information in the dialogue content, the first editing intention in the editing intentions includes: Sending the fourth user dialogue information to a server, so that the server performs natural language processing on the fourth user dialogue information, obtains a corresponding editing intent, assembles and generates a reply script according to the editing intent, and sends the reply script to the client; wherein the reply script includes a function and a parameter keyword corresponding to the function; The determining, according to the first editing intention, an operation control and an editing parameter corresponding to the operation control includes: receiving the reply script; Determine the operation control corresponding to the function according to the reply script; The corresponding editing parameters are determined according to the parameter keywords.

8. The method according to claim 6, wherein: The editing intention further includes a second editing intention. After determining the first editing intention in the editing intention according to the user dialogue information in the dialogue content, the method further includes: Determining recommended information for a next editing operation according to the first editing intention; The recommended information for the next editing operation is displayed in the dialog window of the first interface, so that the user can input fifth user dialog information according to the recommended information for the next editing operation; wherein the fifth user dialog information is used to indicate the second editing intention in the editing intention.

9. The method according to any one of claims 1 to 4, further comprising: Presenting the to-be-processed media content on the editing track; Acquire the current position of the preview pointer on the editing track; wherein the preview pointer is used to move along the editing track; Determining an editing position of the to-be-processed media content according to the current position; The editing process of the to-be-processed media content according to the conversation content includes: According to the conversation content, the material corresponding to the editing position in the media content to be processed is edited.

10. The method according to any one of claims 1 to 4, wherein: The content to be processed is video material; Before displaying the conversation content in the conversation window of the first interface, the method further includes: Get video material; Presenting a video clip formed based on the video material on the editing track; The step of editing the to-be-processed media content according to the conversation content to obtain target media content includes: According to the conversation content, the video material is edited to obtain a video draft; wherein the video draft includes the video material and editing information; the editing information is used to indicate the editing operation performed on the video material.

11. A video processing device, comprising: The display module is configured to display the conversation content in the conversation window of the first interface; The dialogue content is used to indicate the user's editing intention for the media content to be processed; the first interface includes an editing track, an editing effect preview area and the dialogue window, the editing track is used to present a video clip formed based on the media content to be processed, and the editing effect preview area is used to play a video clip formed based on the media content to be processed; an editing module configured to edit the media content to be processed according to the conversation content to obtain target media content; wherein the target media content includes the media content to be processed and editing information; the editing information is used to indicate the editing operation performed on the media content to be processed; and The display module is further configured to present a video clip formed based on the target media content on the editing track.

12. An electronic device, characterized in that: include: Processor and memory; Wherein, the memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor executes the media content processing method according to any one of claims 1 to 9.

13. A computer-readable storage medium, wherein: The computer-readable storage medium stores computer-executable instructions, and when the processor executes the computer-executable instructions, the media content processing method according to any one of claims 1 to 9 is implemented.

14. A computer program product comprising a computer program, wherein: When the computer program is executed by a processor, the media content processing method according to any one of claims 1 to 9 is implemented.

Images