Media content processing method and device, storage medium and program product

Abstract

The embodiment of the invention provides a media content processing method and device, a storage medium and a program product, and the method comprises the steps that dialogue content is displayed in a dialogue window of a first interface, the dialogue content is used for indicating an editing intention of a user on to-be-processed media content, and the first interface comprises an editing track, an editing effect preview area and the dialogue window; the editing track is used for presenting a video clip formed based on the to-be-processed media content, the editing effect preview area is used for playing the video clip formed based on the to-be-processed media content, the to-be-processed media content is edited according to the dialogue content, target media content is obtained, and the target media content comprises the to-be-processed media content and editing information. According to the method provided by the embodiment of the invention, the learning cost of the target user is reduced, the operation is simple, and the intelligent level of media content generation is improved.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of artificial intelligence technology, and in particular, to a media content processing method, device, storage medium, and program product. Background Art

[0002] In existing media content editing software, function controls are provided at fixed positions on the editing page for editing media content. During the editing process, users need to be familiar with the locations of these function controls and master their operation methods. The operation is complicated, the learning cost is high, the intelligence level is low, and it is not conducive to user operation. Summary of the invention

[0003] The embodiments of the present disclosure provide a media content processing method, device, storage medium and program product to simplify operations and improve the intelligence level during the media content editing process.

[0004] In a first aspect, an embodiment of the present disclosure provides a media content processing method, including:

[0005] Displaying the conversation content in the conversation window of the first interface; the conversation content is used to indicate the user's editing intention for the media content to be processed; the first interface includes an editing track, an editing effect preview area and the conversation window, the editing track is used to present a video clip formed based on the media content to be processed, and the editing effect preview area is used to play the video clip formed based on the media content to be processed;

[0006] According to the conversation content, the media content to be processed is edited to obtain target media content; the target media content includes the media content to be processed and editing information; the editing information is used to indicate the editing operation performed on the media content to be processed;

[0007] A video clip formed based on the target media content is presented on the editing track.

[0008] In a second aspect, an embodiment of the present disclosure provides a media content processing device, including:

[0009] The display module is used to display the conversation content in the conversation window of the first interface; the conversation content is used to indicate the user's editing intention for the media content to be processed; the first interface includes an editing track, an editing effect preview area and the conversation window, the editing track is used to present a video clip formed based on the media content to be processed, and the editing effect preview area is used to play a video clip formed based on the media content to be processed;

[0010] An editing module, used for editing the media content to be processed according to the conversation content to obtain target media content; the target media content includes the media content to be processed and editing information; the editing information is used to indicate the editing operation performed on the media content to be processed;

[0011] A video clip formed based on the target media content is presented on the editing track.

[0012] In a third aspect, an embodiment of the present disclosure provides an electronic device, including: a processor and a memory;

[0013] The memory stores computer-executable instructions;

[0014] The processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the media content processing method as described in the first aspect and various possible designs of the first aspect.

[0015] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the media content processing method described in the first aspect and various possible designs of the first aspect is implemented.

[0016] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the media content processing method as described in the first aspect and various possible designs of the first aspect.

[0017] The media content processing method, device, storage medium and program product provided by the present embodiment include: displaying the conversation content in the conversation window of the first interface, the conversation content is used to indicate the user's editing intention for the media content to be processed, the first interface includes an editing track, an editing effect preview area and a conversation window, the editing track is used to present a video clip formed based on the media content to be processed, the editing effect preview area is used to play a video clip formed based on the media content to be processed, according to the conversation content, the media content to be processed is edited to obtain the target media content, the target media content includes the media content to be processed and editing information, the editing information is used to indicate the editing operation performed on the media content to be processed, and the video clip formed based on the target media content is presented on the editing track. The media content processing method provided by the present embodiment of the disclosure realizes information interaction between the user and the system by adopting a dialogue mode, and then edits the edited content to be processed based on the acquired conversation content representing the user's editing intention to obtain the target edited content, thereby reducing the learning cost of the target user, simplifying the operation and improving the intelligent level of media content generation. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0019] Figure 1 A schematic diagram of a flow chart of a media content processing method provided by an embodiment of the present disclosure;

[0020] Figure 2 An interactive schematic diagram of a media content processing method provided by an embodiment of the present disclosure;

[0021] Figures 3a to 3d A schematic diagram of an interface for a conversation content for changing music and editing provided by an embodiment of the present disclosure;

[0022] Figures 4a to 4d A schematic diagram of an interface for a conversation content with a background change and editing process provided by an embodiment of the present disclosure;

[0023] Figure 5 A structural block diagram of a media content processing device provided in an embodiment of the present disclosure;

[0024] Figure 6 A schematic diagram of the hardware structure of a media content processing device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0025] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0026] In view of the above-mentioned problems of the existing media content editing methods being difficult to operate and having a low level of intelligence, the inventors of the present disclosure have found that a human-computer dialogue method can be used to determine the user's editing intention, and then the media content to be processed is edited based on the editing intention to obtain the target media content. Based on this, the embodiments of the present disclosure provide a media content processing method.

[0027] The media content processing method provided in the present disclosure can be implemented by electronic devices, or applications (APP) in electronic devices, web pages, etc. Electronic devices may include mobile phones, tablet computers, wearable electronic devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPC), netbooks, personal digital assistants (PDA), smart TVs, smart screens, high-definition TVs, 4K TVs, smart speakers, smart projectors and other smart home devices. The embodiments of the present disclosure do not impose any restrictions on the specific types of electronic devices. The embodiments of the present disclosure do not limit the types of operating systems of electronic devices, for example, Android systems, Linux systems, Windows systems, iOS systems, etc.

[0028] Reference Figure 1 , Figure 1 A flow chart of a media content processing method provided by an embodiment of the present disclosure. The media content processing method includes:

[0029] 101. Displaying a conversation content in a conversation window of a first interface; the conversation content is used to indicate a user's editing intention for the media content to be processed; the first interface includes an editing track, an editing effect preview area, and the conversation window, the editing track is used to present a video clip formed based on the media content to be processed, and the editing effect preview area is used to play a video clip formed based on the media content to be processed.

[0030] In the specific implementation process, the media content to be processed can be imported into the editing track of the first interface, and then the initial editing effect of the media content to be processed can be viewed in the editing preview area. In the subsequent editing and processing of the media content to be processed based on the conversation content, the edited media content to be processed can be presented in real time on the editing track, so that the editing effect of the edited media content to be processed can be viewed in real time through the editing preview area.

[0031] For example, after an editing operation of changing the background of the media content to be processed is performed based on the conversation content, the editing effect of the media content to be processed after the background is changed can be viewed in the editing effect preview area. Then, after performing the music changing editing operation, the editing effect of the media content to be processed after the music is changed can be viewed in real time. This makes it convenient for the user to input conversation information for the next editing operation based on the editing effect presented in the editing effect preview area.

[0032] Among them, the media content to be processed can be original material (such as pictures, video materials, etc.), and accordingly, the video clip formed based on the media content to be processed can contain one or more frames of images, and can also refer to a video, and can also be a video draft generated in advance based on the original material (such as pictures, video materials, etc.), and the video draft includes the original material and editing information, and the editing information is used to indicate the editing operation performed on the original material. In one embodiment of the present disclosure, the content to be processed is a video material; before displaying the conversation content in the conversation window of the first interface, it also includes: obtaining the video material; presenting the video clip formed based on the video material on the editing track; editing the media content to be processed according to the conversation content to obtain the target media content, including: editing the video material according to the conversation content to obtain a video draft; the video draft includes the video material and editing information; the editing information is used to indicate the editing operation performed on the video material.

[0033] In addition, the conversation content may include user conversation information from the user, and may also include system conversation information from the system. Conversation information may include text, numbers, symbols, links, emoticons, pictures, audio, video clips and other types of data, without limitation; there is no limitation on display parameters such as the size, color, display position, and display transparency of the editing effect preview area, editing track, and conversation window.

[0034] There are many ways to input user dialogue information.

[0035] In an achievable manner, in order to facilitate the guidance of users with less editing experience, an operation control may be displayed in the first interface, so that the user can express the editing intention by triggering the operation control. Specifically, the dialogue content may include first user dialogue information, and the method may further include: displaying a target function control in the first interface; and generating the first user dialogue information corresponding to the target function control in response to a touch operation on the target function control.

[0036] Among them, the target function control can be a control for changing the ratio, changing the music, adding text intelligently, replacing the material, adjusting the filter, adding special effects, etc. The target function control can be displayed in the form of icons, text, symbols, pictures, etc., or can be displayed in a combination of multiple forms, which is not limited in the present disclosure.

[0037] In another possible implementation, in order to improve the flexibility of the user inputting the user dialogue information, an input area may be set in the first interface so that the user can input the user dialogue information in the input area. Specifically, the dialogue content may include the second user dialogue information, the first interface may include the dialogue input area, and the method may further include: in response to the input operation acting on the dialogue input area, obtaining the second user dialogue information. The embodiment of the present disclosure does not limit the display parameters such as the size, color, display position, and display transparency of the input area.

[0038] In another possible implementation, in order to expand the user's editing ideas, editing suggestion information can be presented in the dialogue window of the first interface, so that the user can input user dialogue information based on the editing suggestion information. The editing suggestion information can be determined according to the media content to be processed. For example, if the media content to be processed includes background music, an editing suggestion of changing the music can be given.

[0039] It should be noted that the above-mentioned various user dialogue information input methods can be implemented separately or in any combination, and the embodiments of the present disclosure are not limited to this.

[0040] The conversation information from different objects in the conversation content can be set on the same side or on different sides. For example, the user conversation information from the user can be set on the right side of the conversation window and aligned on the right, and the system conversation information from the system can be set on the left side of the conversation window and aligned on the left. The conversation information of both parties can also be aligned on the left or right, which is not limited to the embodiments of the present disclosure.

[0041] 102. Edit the media content to be processed according to the conversation content to obtain target media content; the target media content includes the media content to be processed and editing information; the editing information is used to indicate the editing operation performed on the media content to be processed.

[0042] Specifically, after obtaining the conversation content, the editing intention of the conversation content may be identified, and the media content to be processed may be edited based on the editing intention to obtain the target media content.

[0043] Exemplarily, the above recognition process can be to perform natural language processing on the conversation content, obtain multiple tags representing the creative intent, determine the corresponding operation controls (such as changing the background, changing the music, adding special effects, etc.) and the parameters to be edited (such as the style, color, composition and other parameters of the background, the author, lyrics, music cover and other parameters of the music, the candidate style of the special effects, the location of adding special effects and other parameters) based on the multiple tags, and then adjust the parameters based on the operation controls to obtain the target media content. The target media content can be video, graphic, picture and other types of data.

[0044] Exemplarily, the user can input the user dialogue message "Help me change the background to one with blue sky and white clouds", and the system can perform natural language processing on the dialogue message to determine the user's editing intent, and then call two related components, such as a matting component and a component for selecting a background replacement. The matting component is used to matte objects such as people and scenery other than the background in the editing content to be processed, and the component for selecting a background replacement is used to provide the user with a card (control) consisting of multiple candidate backgrounds to be replaced in the dialogue window, and then receive the user's selection operation on the candidate background, thereby realizing the editing intention of replacing the background of blue sky and white clouds based on the selected candidate background and the matting result, and obtaining the target media content.

[0045] In the case of multiple components (cards), there are many ways to determine the execution order of the components. For example, you can set the order for different cards in advance and then execute them in sequence. Specifically, you can set parameters for each card. During the execution of the card, the parameter is the first value. After the card is executed, the parameter is the second value. At this time, the component cannot execute any logic or output any renderable content.

[0046] 103. Present a video clip formed based on the target media content on the editing track.

[0047] Specifically, after the target media content is generated, in order to facilitate viewing of the editing effect of the target media content, the video clips formed based on the target media content may be presented on the editing track.

[0048] From the above description, it can be seen that the media content processing method provided by the present invention realizes information interaction between the user and the system by adopting a dialogue mode, and then edits the edited content to be processed based on the acquired dialogue content representing the user's editing intention to obtain the target edited content, thereby reducing the learning cost of the target user, simplifying the operation, and improving the intelligence level of media content generation.

[0049] In one embodiment of the present disclosure, in the above Figure 1 Based on the embodiment, the method also includes: presenting the media content to be processed on the editing track; obtaining the current position of the preview pointer on the editing track; the preview pointer is used to move along the editing track; determining the editing position of the media content to be processed according to the current position; and editing the media content to be processed according to the conversation content, including: editing the material corresponding to the editing position in the media content to be processed according to the conversation content.

[0050] Specifically, the cover of multiple video drafts can be presented in the creation page of the application. Clicking on the cover can enter the first interface, and the video draft corresponding to the cover can be imported into the editing track in the first interface. Thus, the editing effect of the video clip formed by the video draft can be viewed in the editing effect preview area, and the screen of the editing effect preview area can be positioned to the editing image frame corresponding to the position of the preview pointer by moving the position of the preview pointer on the editing track. Therefore, the editing process of the editing image frame can be realized by conducting a human-computer dialogue in the dialogue window.

[0051] In one embodiment of the present disclosure, in the above Figure 1 Based on the embodiment, the editing of the media content to be processed according to the conversation content may include: determining the editing intent according to the conversation content; determining the editing tool and editing parameters according to the editing intent; and editing the media content to be processed through the editing tool based on the editing parameters.

[0052] Specifically, natural language processing can be performed on the conversation content to identify the user's editing intention, and the corresponding editing tools and editing parameters can be determined based on the editing intention. Then, the parameters can be adjusted based on the operation control to obtain the target media content. The target media content can be video, graphic, image, and other types of data.

[0053] The editing tool refers to a UI component, such as a react component, that is, an encapsulated UI component with independent functions. For example, editing controls such as changing the background, changing the music, and adding special effects, and the editing parameters refer to the editing parameters used by the editing tool when performing editing processing, such as the style, color, composition and other parameters of the background, the author, lyrics, and cover of the music, and the candidate styles of special effects and the location of adding special effects.

[0054] In one embodiment of the present disclosure, the conversation content may include user conversation information and system conversation information, and the source of the editing intent comes from the intention recognition of the user conversation information on the one hand, and from the user's analysis of the touch operation of the operation control provided in the system conversation information on the other hand. Specifically, the determining of the editing intent according to the conversation content may include: determining the first editing intent in the editing intent according to the fourth user conversation information in the conversation content; determining the operation control and the editing parameters corresponding to the operation control according to the first editing intent; correspondingly, editing the media content to be processed by the editing tool based on the editing parameters may include: displaying the operation control in the conversation window of the first interface; adjusting the editing parameters in response to the touch operation acting on the operation control to obtain the target editing parameters, and editing the media content to be processed by the editing tool based on the target editing parameters.

[0055] In one embodiment of the present disclosure, in order to save computing resources of the terminal device, the step of intent recognition can be performed by the server. Specifically, the determining the first editing intent in the editing intent according to the fourth user dialogue information in the dialogue content may include: sending the fourth user dialogue information to the server, so that the server performs natural language processing on the fourth user dialogue information, obtains the corresponding editing intent, assembles and generates a reply script according to the editing intent, and sends the reply script to the client; the reply script includes a function and a parameter keyword corresponding to the function; according to the first editing intent, determining the operation control and the editing parameter corresponding to the operation control may include: receiving the reply script; determining the operation control corresponding to the function according to the reply script; determining the corresponding editing parameter according to the parameter keyword.

[0056] Specifically, the parameter keywords are basic command keywords. The acquisition of editing parameters requires the client to request the interface, assemble and render by itself. For example, in the reply script, only the keyword parameter of a music card is passed in, and information such as the label icon, theme title, and music ID is not passed in. The client needs to request the interface, assemble and render by itself based on the command keywords.

[0057] For example, Figure 2As shown, taking the video draft as an example of the edited content to be processed, the user enters a statement (user dialogue information) in the dialogue window of the first interface of the client, and the client sends an insert session request (UpsertSessionReq) to the server based on the input statement. After receiving the request, the server creates a session context, performs natural language processing NLP on the input statement carried by the insert session request, and identifies the editing intention, determines the editing tool (UI component) based on the editing intention, and then assembles the answer script AnswerScript, and sends an insert session response UpsertSessionRsp to the client based on the answer script, and the insert session response includes the information of the answer script. The client interprets the answer script and injects the editing parameter Params, and then executes the script Script. In the process of executing the script, a card of a component contained in the script is displayed in the dialogue window, and the user's touch operation (click or long press) is received. In response to the touch operation, the editing parameters are adjusted, and the video draft is edited based on the adjusted editing parameters. It is determined whether the preset conditions are met. If they are met (for example, the previous card is executed), the card of the next component is executed. After multiple sessions, when the editing effect meets the user's needs, the user can trigger a closing operation on the first interface of the client to close the draft editor, i.e., the first interface. The client sends a session destruction request DestroSessionReq to the server based on the closing instruction.

[0058] In one embodiment of the present disclosure, in order to better guide the user to perform editing operations, after determining the editing intent based on the user dialogue information, the operation controls of the current editing operation and the recommended information of the next editing operation can be determined based on the editing intent. Specifically, after determining the first editing intent in the editing intent based on the user dialogue information in the dialogue content, it can also include: determining the recommended information of the next editing operation based on the first editing intent; displaying the recommended information of the next editing operation in the dialogue window of the first interface, so that the user can enter the fifth user dialogue information based on the recommended information of the next editing operation; the fifth user dialogue information is used to indicate the second editing intent in the editing intent.

[0059] Specifically, there may be multiple user dialogue information input by the user displayed in the dialogue window of the first interface, and each user dialogue information may identify an editing intent. These editing intentions collectively constitute the editing intent corresponding to the user dialogue information. Of course, if the dialogue content also includes system dialogue information, the system dialogue information may include the editing intent determined based on the user dialogue information, the operation controls and editing parameters determined, then the user editing intent determined based on the system dialogue information may be obtained based on the touch operation of the operation controls of the system dialogue information.

[0060] The following combination Figure 3a-3d , the editing process of changing music is illustrated with examples.

[0061] After the application (media content editing application) is launched, it can be displayed on the mobile phone Figure 3a The user interface 31 shown is a conversational editing page (ie, a first interface), which is mainly used to present and obtain the conversation content between the user and the system, and to obtain the target media content based on the conversation content.

[0062] Reference Figure 3a As shown, the user interface 31 includes a dialogue window 301, a user preview area 302, an editing track 303, and a dialogue input area 304. The user preview area 302 displays a picture of a video editing frame of the media content to be processed indicated by the preview pointer. The editing track 303 includes a preview pointer, which is used to indicate the editing position. The dialogue window 301 displays some operation suggestions for the media content to be processed, such as "change music", "add packaging", "smart copywriting", and "replace material". The dialogue input area 304 is used to input user dialogue information. The user can enter user dialogue information in the dialogue input area 304 based on the suggestions to indicate the editing intention. For example, it is assumed that the user wants to perform the editing process of "changing music".

[0063] Continue to refer to Figure 3b The dialogue input area 304 of the user interface 32 displays the user dialogue information “change music” input by the user. The system obtains the user dialogue information and performs intent recognition on the user dialogue information. Based on the recognized editing intent, the operation control and editing parameters of the current operation are determined to display the operation control in the dialogue window. The editing parameters can be adjusted by the user's touch operation on the operation control.

[0064] Continue to refer to Figure 3c The dialogue input area 304 of the user interface 33 displays the user dialogue information "Change Music" based on the user input and the system dialogue information fed back by the system. The system dialogue information includes the operation controls of the current operation determined based on the user's editing intention, such as Figure 3c As shown, the operation control includes multiple candidate music (original, music 1, music 2, music 3) and other editing parameters for users to choose from, and also includes adjustment controls and editing parameters corresponding to the adjustment controls. In addition, the suggestion information for the next operation "music with a light rhythm" and "recommended popular music" are also displayed below the system dialogue information. The suggestion information can be determined by the system according to the editing intention of the user dialogue information "change music", that is, according to the editing intention, both the operation control of the current operation and the recommended information for the next operation are determined. Based on this, it is more conducive to users to efficiently perform subsequent editing processes.

[0065] Continue to refer to Figure 3d , receiving the user's touch operation (click or long press) on the adjustment control, in response to the touch operation, further operation controls are displayed in the dialogue input area 304 of the user interface 32, cropping and volume for selecting clips and adjusting the volume.

[0066] Figure 3b to Figure 3d It also includes a user preview area 302, an editing track 303, and a dialogue input area 304. For descriptions of each area, please refer to Figure 3a The description is not repeated here.

[0067] It should be noted that Figures 3a to 3d The illustrated embodiments are merely examples of the media content processing method provided by the embodiments of the present disclosure. In actual scenarios, the display method, presentation form, related control setting method of the conversation content, as well as the layout of some pages, display parameters, and the implementation method of controls and entrances can be flexibly set according to needs.

[0068] The following combination Figure 4a-4d , an example is given to illustrate the editing process of changing the background.

[0069] After the application (media content editing application) is launched, it can be displayed on the mobile phone Figure 4a The user interface 41 is shown, wherein the user interface 41 is a conversational editing page (ie, a first interface), which is mainly used to present and obtain the conversation content between the user and the system, and to obtain the target media content based on the conversation content.

[0070] Reference Figure 4a As shown, the user interface 41 includes a dialogue window 301, a user preview area 302, an editing track 304, and a dialogue input area 304. The user preview area 302 displays a video editing frame of the media content to be processed indicated by the preview pointer. The editing track 304 includes a preview pointer, which is used to indicate the editing position. The dialogue window 301 displays some operation suggestions for the media content to be processed, such as "change ratio", "add packaging", "smart copywriting", and "replace material". The dialogue input area 304 is used to input user dialogue information. The user can enter user dialogue information in the dialogue input area 304 based on the suggestions to indicate the editing intention. Figure 4a As shown, assuming that the user wants to perform an editing process of “changing the ratio”, the user dialogue information “changing the ratio” input by the user is displayed in the dialogue input area 304 of the user interface 41 .

[0071] Continue to refer to Figure 4b, the system obtains the user dialogue information "change ratio", and performs intent recognition on the user dialogue information. Based on the recognized editing intent, the system determines the operation control and editing parameters of the current operation corresponding to the editing intent of "change ratio", so as to display the operation control in the dialogue window. The editing parameters can be adjusted by the user's touch operation on the operation control. Figure 4b As shown, the dialogue input area 304 of the user interface 42 displays the user dialogue information "Change ratio" based on the user input and the system dialogue information fed back by the system. The system dialogue information includes the operation control of the current operation determined based on the user's editing intention. The operation control includes multiple editing parameters such as candidate ratios (original, 9:16, 16:9, 1:1, 4:3) for the user to select. The user's touch operation on 9:16 is received, combined with the Figure 4a and Figure 4b As shown, the image frame in the editing effect preview area is switched from the original ratio to a 9:16 ratio.

[0072] In addition, the system displays the suggested information for the next operation, "Smart Packaging", "Adjusting Filters", and "Adding Special Effects" below the dialogue information. The suggested information can be determined by the system based on the editing intent of the user dialogue information "Change Scale". In other words, the editing intent determines both the operation controls for the current operation and the recommended information for the next operation. Based on this, it is more conducive to the user to efficiently perform subsequent editing processing.

[0073] Continue to refer to Figure 4c In order to facilitate users to edit image frames, editing functions can be provided in the editing effect preview area, such as Figure 4c As shown, a touch operation (click or long press) of the user on the image area in the editing effect preview area 302 of the user interface 43 is received, and in response to the touch operation, the image area can be switched to a selected state.

[0074] Continue to refer to Figure 4d , receiving a user's touch operation (click or drag) on ​​the selected box, and in response to the touch operation, amplifying the image in the image area based on the magnification of the selected box. Exemplarily, the magnification of the image can be fuzzily determined based on the magnification of the selected box. Exemplarily, in one case, if the magnification of the selected box is greater than 1, the image is magnified by a preset multiple, such as 1.1. In another case, the magnification of the selected box is divided into multiple intervals, and different intervals correspond to different image magnifications. For example, the magnification of the selected box 1-1.2, 1.2-1.3, respectively correspond to image magnifications of 1.1 and 1.2.

[0075] Figure 4b to Figure 4d It also includes a user preview area 302, an editing track 304, and a dialogue input area 304. For descriptions of each area, please refer to Figure 4aThe description is not repeated here.

[0076] It should be noted that Figures 4a to 4d The illustrated embodiments are merely examples of the media content processing method provided by the embodiments of the present disclosure. In actual scenarios, the display method, presentation form, related control setting method of the conversation content, as well as the layout of some pages, display parameters, and the implementation method of controls and entrances can be flexibly set according to needs.

[0077] Corresponding to the media content processing method of the above embodiment, Figure 5 The structure block diagram of the media content processing device provided by the embodiment of the present disclosure. For the convenience of explanation, only the part related to the embodiment of the present disclosure is shown. Figure 5 The device 50 includes: a display module 501 and an editing module 502.

[0078] The display module 501 is used to display the conversation content in the conversation window of the first interface; the conversation content is used to indicate the user's editing intention for the media content to be processed; the first interface includes an editing track, an editing effect preview area and the conversation window, the editing track is used to present a video clip formed based on the media content to be processed, and the editing effect preview area is used to play a video clip formed based on the media content to be processed;

[0079] A generating module 502 is used to edit the media content to be processed according to the conversation content to obtain target media content; the target media content includes the media content to be processed and editing information; the editing information is used to indicate the editing operation performed on the media content to be processed;

[0080] The display module 501 is further configured to present a video clip formed based on the target media content on the editing track.

[0081] In one embodiment of the present disclosure, the display module 501 is further used to: display a target function control in the first interface; and generate the first user dialogue information corresponding to the target function control in response to a touch operation on the target function control.

[0082] In one embodiment of the present disclosure, the conversation content includes second user conversation information, the first interface includes a conversation input area, and the display module 501 is further used to: respond to an input operation acting on the conversation input area, and obtain the second user conversation information.

[0083] In one embodiment of the present disclosure, the conversation content includes third user conversation information, and the display module 501 is also used to: display at least one editing operation recommendation information in the first interface; the editing operation recommendation information is determined based on the media content to be processed; and obtain the third user conversation information in response to an input operation triggered by the at least one prompt information acting on the conversation input area.

[0084] In one embodiment of the present disclosure, the generation module 502 is specifically used to: determine the editing intention according to the conversation content; determine the editing tool and editing parameters according to the editing intention; and edit the media content to be processed through the editing tool based on the editing parameters.

[0085] In one embodiment of the present disclosure, the generation module 502 is specifically used to: determine the first editing intention in the editing intention based on the fourth user dialogue information in the dialogue content; determine the operation control and the editing parameters corresponding to the operation control based on the first editing intention; display the operation control in the dialogue window of the first interface; adjust the editing parameters in response to the touch operation acting on the operation control to obtain the target editing parameters, and based on the target editing parameters, edit the media content to be processed through the editing tool.

[0086] In one embodiment of the present disclosure, the generation module 502 is specifically used to: send the fourth user conversation information to the server, so that the server performs natural language processing on the fourth user conversation information, obtains the corresponding editing intent, assembles and generates a reply script according to the editing intent, and sends the reply script to the client; the reply script includes a function and parameter keywords corresponding to the function; receives the reply script; determines the operation control corresponding to the function according to the reply script; determines the corresponding editing parameters according to the parameter keywords.

[0087] In one embodiment of the present disclosure, the generation module 502 is also used to: determine the recommended information for the next editing operation based on the first editing intention; display the recommended information for the next editing operation in the dialog window of the first interface, so that the user can input the fifth user dialog information based on the recommended information for the next editing operation; the fifth user dialog information is used to indicate the second editing intention in the editing intention.

[0088] In one embodiment of the present disclosure, the generation module 502 is also used to: present the media content to be processed on the editing track; obtain the current position of the preview pointer on the editing track; the preview pointer is used to move along the editing track; determine the editing position of the media content to be processed according to the current position; and edit the material corresponding to the editing position in the media content to be processed according to the conversation content.

[0089] In one embodiment of the present disclosure, the generation module 502 is also used to: obtain video material; present a video clip formed based on the video material on the editing track; edit the video material according to the conversation content to obtain a video draft; the video draft includes the video material and editing information; the editing information is used to indicate the editing operation performed on the video material.

[0090] The device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effect are similar, and this embodiment will not be repeated here.

[0091] In order to implement the above embodiment, the embodiment of the present disclosure also provides an electronic device.

[0092] Reference Figure 6 , which shows a schematic diagram of the structure of an electronic device 900 suitable for implementing the embodiment of the present disclosure, and the electronic device 900 may be a terminal device or a server. The terminal device may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable media players (PMPs), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 6 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0093] like Figure 6As shown, the electronic device 900 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 to a random access memory (RAM) 903. In the RAM 903, various programs and data required for the operation of the electronic device 900 are also stored. The processing device 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0094] Typically, the following devices may be connected to the I / O interface 905: input devices 906 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 907 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 908 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 909. The communication device 909 may allow the electronic device 900 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 6 The electronic device 900 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0095] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 909, or installed from a storage device 908, or installed from a ROM 902. When the computer program is executed by the processing device 901, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0096] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0097] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0098] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0099] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0100] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0101] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".

[0102] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0103] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0104] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0105] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0106] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A media content processing method, characterized in that: The method comprises: Displaying the conversation content in the conversation window of the first interface; the conversation content is used to indicate the user's editing intention for the media content to be processed; the first interface includes an editing track, an editing effect preview area and the conversation window, the editing track is used to present a video clip formed based on the media content to be processed, and the editing effect preview area is used to play the video clip formed based on the media content to be processed; According to the conversation content, the media content to be processed is edited to obtain target media content; the target media content includes the media content to be processed and editing information; the editing information is used to indicate the editing operation performed on the media content to be processed; A video clip formed based on the target media content is presented on the editing track.

2. The method according to claim 1, characterized in that: The conversation content includes first user conversation information, and the method further includes: Displaying a target function control in the first interface; In response to the touch operation acting on the target function control, the first user dialogue information corresponding to the target function control is generated.

3. The method according to claim 1, characterized in that The conversation content includes second user conversation information, the first interface includes a conversation input area, and the method further includes: In response to an input operation applied to the dialogue input area, the second user dialogue information is acquired.

4. The method according to claim 3, characterized in that: The conversation content includes conversation information of a third user, and the method further includes: Displaying at least one editing operation recommendation information in the first interface; the editing operation recommendation information is determined according to the media content to be processed; In response to an input operation acting on the dialogue input area and triggered by the at least one prompt information, the third user dialogue information is acquired.

5. The method according to any one of claims 1 to 4, characterized in that: The editing process of the to-be-processed media content according to the conversation content includes: Determining the editing intention according to the content of the conversation; Determine editing tools and editing parameters according to the editing intention; Based on the editing parameters, the to-be-processed media content is edited by the editing tool.

6. The method according to claim 5, characterized in that The editing intention includes a first editing intention, and determining the editing intention according to the conversation content includes: Determining a first editing intention among the editing intentions according to the fourth user conversation information in the conversation content; Determining, according to the first editing intention, an operation control and an editing parameter corresponding to the operation control; The editing process of the to-be-processed media content by using the editing tool based on the editing parameter includes: Displaying the operation control in the dialog window of the first interface; In response to a touch operation on the operation control, the editing parameter is adjusted to obtain a target editing parameter, and based on the target editing parameter, the to-be-processed media content is edited by the editing tool.

7. The method according to claim 6, characterized in that The determining, according to the fourth user dialogue information in the dialogue content, the first editing intention in the editing intentions includes: Sending the fourth user dialogue information to a server, so that the server performs natural language processing on the fourth user dialogue information, obtains a corresponding editing intent, assembles and generates a reply script according to the editing intent, and sends the reply script to the client; the reply script includes a function and a parameter keyword corresponding to the function; The determining, according to the first editing intention, an operation control and an editing parameter corresponding to the operation control includes: receiving the reply script; Determine the operation control corresponding to the function according to the reply script; The corresponding editing parameters are determined according to the parameter keywords.

8. The method according to claim 6, characterized in that The editing intention further includes a second editing intention. After determining the first editing intention in the editing intention according to the user dialogue information in the dialogue content, the method further includes: Determining recommended information for a next editing operation according to the first editing intention; The recommended information for the next editing operation is displayed in the dialog window of the first interface, so that the user can input the fifth user dialog information according to the recommended information for the next editing operation; the fifth user dialog information is used to indicate the second editing intention in the editing intention.

9. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: Presenting the to-be-processed media content on the editing track; Acquire the current position of the preview pointer on the editing track; the preview pointer is used to move along the editing track; Determining an editing position of the to-be-processed media content according to the current position; The editing process of the to-be-processed media content according to the conversation content includes: According to the conversation content, the material corresponding to the editing position in the media content to be processed is edited.

10. The method according to any one of claims 1 to 4, characterized in that: The content to be processed is video material; Before displaying the conversation content in the conversation window of the first interface, the method further includes: Get video material; Presenting a video clip formed based on the video material on the editing track; The step of editing the to-be-processed media content according to the conversation content to obtain target media content includes: According to the content of the conversation, the video material is edited to obtain a video draft; the video draft includes the video material and editing information; the editing information is used to indicate the editing operation performed on the video material.

11. A video processing device, characterized in that: include: A display module, used to display the conversation content in the conversation window of the first interface; The dialogue content is used to indicate the user's editing intention for the media content to be processed; The first interface includes an editing track, an editing effect preview area, and the dialog window, wherein the editing track is used to present a video clip formed based on the media content to be processed, and the editing effect preview area is used to play a video clip formed based on the media content to be processed; An editing module, used for editing the to-be-processed media content according to the conversation content to obtain target media content; The target media content includes the media content to be processed and editing information; the editing information is used to indicate the editing operation performed on the media content to be processed; A video clip formed based on the target media content is presented on the editing track.

12. An electronic device, characterized in that: include: Processor and memory; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor executes the media content processing method according to any one of claims 1 to 9.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and when the processor executes the computer-executable instructions, the media content processing method according to any one of claims 1 to 9 is implemented.

14. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the media content processing method according to any one of claims 1 to 9 is implemented.

Images