A media content creation method and device, electronic equipment and storage medium

Abstract

This paper provides a media content creation method, apparatus, electronic device, and storage medium. The method includes: displaying a media content creation flow, the media content creation flow including a first node, the first node including at least one layer; displaying a first control in response to an interactive operation on the first node; displaying editable content on the first node in response to the first control being in a first state, wherein the editable content includes descriptive information of the layer; and displaying the editing result of the editable content and the editing result of the at least one layer in response to an editing operation on the editable content. This paper addresses the problem of low creation efficiency in related media content creation methods by allowing layer editing within the media content creation flow to obtain media content that meets expectations, thereby improving the efficiency of media content creation.

Description

Technical Field

[0001] This article relates to computer technology, and in particular to a method, apparatus, electronic device and storage medium for creating media content. Background Technology

[0002] With the development of computer technology, media content creation applications are becoming increasingly intelligent. Some media content creation tools can quickly generate media content such as images or videos based on text or reference images. However, the presentation quality of media content generated in this way often falls short of expectations, requiring creators to export the generated media content to editing tools for further editing, thus impacting the efficiency of media content creation. Summary of the Invention

[0003] This article provides a method, device, electronic device, and storage medium for media content creation, which can improve the efficiency of media content creation.

[0004] Firstly, this article provides a method for creating media content, including: The media content creation workflow is displayed, which includes a first node, the first node including at least one layer, wherein the media content creation workflow is used for media content creation, and the first node is used for editing the at least one layer; In response to an interactive action on the first node, display the first control; In response to the first control being in a first state, editable content is displayed on the first node, wherein the editable content includes the description information of the layer; In response to an editing operation on the edited content, the editing result of the edited content and the editing result of the at least one layer are displayed, wherein the editing result of the at least one layer conforms to the content corresponding to the at least one layer in the editing result of the edited content.

[0005] Secondly, this article also provides a media content creation device, including: The first display module is used to display the media content creation flow, which includes a first node, the first node including at least one layer, wherein the media content creation flow is used for media content creation, and the first node is used for editing the at least one layer; The second display module is used to display the first control in response to the interactive operation on the first node; The third display module is used to display editable content on the first node in response to the first control being in the first state, wherein the editable content includes the description information of the layer; The fourth display module is used to respond to the editing operation on the edited content and display the editing result of the edited content and the editing result of the at least one layer, wherein the editing result of the at least one layer conforms to the content corresponding to the at least one layer in the editing result of the edited content.

[0006] Thirdly, this document also provides an electronic device, which includes: One or more processors; Storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the media content creation method.

[0007] Fourthly, this document also provides a storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to perform the media content creation method.

[0008] This paper presents a media content creation method, demonstrating a media content creation flow where the first node includes at least one layer. In response to interactive operations on the first node, a first control is displayed. In response to the first control being in a first state, editable content, including descriptive information about the layer, is displayed on the first node. In response to editing operations on the editable content, the editing results of the edited content and the layer are displayed, with the layer's editing result matching the corresponding content in the edited content. This paper addresses the low efficiency of related media content creation methods by adding a first node to the media content creation flow and displaying editable content within it, thus converting layers from image information to descriptive information. It also enables precise editing of at least one layer through editing operations on the editable content, allowing for editing of layers within the media content creation flow to obtain media content that meets expectations, thereby improving the efficiency of media content creation. Attached Figure Description

[0009] The above and other features, advantages, and aspects of the various examples herein will become more apparent when taken in conjunction with the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.

[0010] Figure 1 This is an application scenario diagram of the media content creation method presented in this article; Figure 2 This is a flowchart illustrating a media content creation method presented in this article; Figure 3This is a schematic diagram of a media content creation flow provided in this article; Figure 4 This is a flowchart illustrating another media content creation method presented in this article; Figure 5 This is a schematic diagram of a node editing page provided in this article; Figure 6 A schematic diagram of the structure of a media content creation device provided in this article; Figure 7 This is a schematic diagram of the structure of an electronic device provided in this article. Detailed Implementation

[0011] The present invention will now be described in more detail with reference to the accompanying drawings. While some examples of the present invention are shown in the drawings, it should be understood that the present invention can be implemented in various forms and should not be construed as limited to the examples set forth herein; rather, these examples are provided to provide a more thorough and complete understanding of the present invention. It should be understood that the accompanying drawings and examples are for illustrative purposes only and are not intended to limit the scope of this invention.

[0012] It should be understood that the steps described in the method embodiments herein may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of this document is not limited in this respect.

[0013] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one example" means "at least one example"; the term "another example" means "at least one additional example"; the term "some examples" means "at least some examples". Definitions of other terms will be given in the following description.

[0014] It should be noted that the concepts of "first" and "second" mentioned in this article are only used to distinguish different devices, modules or units, and are not used to limit the order of the functions performed by these devices, modules or units or their interdependencies.

[0015] It should be noted that the terms "one" and "more" used in this document are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0016] The names of messages or information exchanged between multiple devices in the embodiments herein are for illustrative purposes only and are not intended to limit the scope of these messages or information.

[0017] It is understandable that before using the technical solutions disclosed in the examples in this article, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this article in an appropriate manner in accordance with relevant laws and regulations, and their authorization should be obtained.

[0018] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as electronic devices, applications, servers, or storage media, that perform the operations described herein, based on the prompt message.

[0019] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0020] It is understood that the above notification and user authorization process is merely illustrative and does not limit the implementation method described in this article. Other methods that comply with relevant laws and regulations may also be applied to the implementation method described in this article.

[0021] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0022] Figure 1 This diagram illustrates an application scenario of the media content creation method presented in this article. It should be noted that... Figure 1 This is merely an example of how this disclosure can be applied in one situation to help those skilled in the art understand the technical content of this disclosure in one situation, and does not mean that this disclosure cannot be used in other devices, systems, environments or scenarios.

[0023] like Figure 1 As shown, the system may include a server 110, a network 120, several terminal devices 130, and a database 140. The terminal devices include at least one of mobile terminals and PCs.

[0024] Server 110 can be a physical server containing a single host, or it can be a virtual server hosted in a host cluster. During operation, server 110 can run server-side programs for media content creation applications, thus acting as a server for these applications. Examples of media content creation applications include editing software.

[0025] exist Figure 1 In the system configuration described, server 110 may include one or more components that implement the functions performed by server 110. These components may include at least one of software components and hardware components executable by one or more processors. A user operating terminal device 130 can interact with server 110 using a client to utilize the services provided by these components. It is understood that different system configurations may exist. Figure 1 This is a schematic diagram illustrating an application scenario for implementing a media content creation method under a given condition.

[0026] Terminal device 130 connects to server 110 via network 120. Typically, network 120 can be any type of network, and it can use any of the various available protocols (including TCP / IP (Transmission Control Protocol / Internet Protocol) and IPX (Internet Packet Exchange)) to support data communication. Network 120 can include various connection types, such as wired communication links, wireless communication links, or fiber optic cables.

[0027] Database 140 can be used to store design drafts, layer information, and edited content of media content, etc. Database 140 can reside in various locations. For example, database 120 used by server 110 can be local to server 110, or it can be located remotely to server 110 and can communicate with server 110 via network 120 or a dedicated connection. Database 140 can be of different types. In some cases, database 140 used by server 110 can be a relational database. One or more of these databases 140 can store, update, and retrieve database 140 and data from database 140 in response to commands.

[0028] In some cases, one or more of the databases 140 may also be used by applications to store application data. The databases 140 used by applications may be of different types, such as key-value stores, object stores, or regular storage types supported by the file system.

[0029] It should be noted that, Figure 1 The system can be configured and operated in various ways to realize media content creation methods and devices in various situations.

[0030] Figure 2This is a flowchart illustrating a media content creation method provided in this paper. This paper applies to media content creation scenarios. This method can be executed by a media content creation device, which can be implemented in the form of software and / or hardware. Optionally, it can be implemented through an electronic device, such as a mobile terminal, a PC, or a server.

[0031] like Figure 2 As shown, the method includes: S210. Display the media content creation flow, wherein the media content creation flow includes a first node, the first node includes at least one layer, wherein the media content creation flow is used for media content creation, and the first node is used for editing the at least one layer.

[0032] The media content creation workflow can be a series of interconnected media content creation tasks. It includes multiple task nodes, each representing a media content creation task. Media content creation includes tasks such as special effects creation and poster creation. These tasks include asset loading, media content generation, and editing. During the execution of the media content creation workflow, the tasks are executed according to the sequence of the task nodes.

[0033] The first node is a task node in the media content creation workflow used for media content editing. Optionally, the first node is a container that carries media content editing services. For example, the first node can be an image editor node. The first node performs operations such as cutout, compositing, and local adjustments on the input material, and outputs a composite image, a mask or layer mask corresponding to the composite image, etc. The input material can be material uploaded from the media resource library. Alternatively, the input material can also be media content generated by the previous node of the first node. This document does not specifically limit this. In the first node, materials uploaded by different material nodes are displayed on different layers. The layers include at least one of text layers, image layers, and video layers. The first node merges different layers to obtain a composite image.

[0034] In some cases, the media content creation workflow includes material nodes, a first node, and a second node. Material nodes are used to upload the materials needed for media content creation to the media content creation workflow. Material nodes include at least one of text nodes, image nodes, and video nodes. Connecting a material node to the input port of the first node displays a layer in the second area of ​​the first node, on which the material is displayed. At least one of the parameters of the layer, such as transparency, brightness, resolution, and size, can be adjusted. Alternatively, at least two material nodes can be connected to the input port of the first node to output a composite image of at least two materials or a mask corresponding to the composite image. At least two layers are displayed in the second area of ​​the first node. The layers are used to display the input materials. The first node is connected to the input port of the second node to edit at least two layers in at least one dimension, such as style and layout, based on the editing content in the first node. The editing content is associated with the style and layout information of at least two layers. Optionally, the editing content is code used to describe the layer information. Compared with directly inputting the composite image into the intelligent system, describing the layer information in the form of code makes it easier for the intelligent system to obtain the layer information more accurately. For example, the edited content includes information such as layer position, transparency, brightness, resolution, size, and layer level. In some cases, the second node represents the intelligent system. Connecting the first node to the input port of the second node allows the edited content to be input into the intelligent system, which then automatically edits the local structure, proportions, and composition of the composite image according to the editing expectations. Specifically, editing the local structure includes adding markers and QR codes, etc.

[0035] In this paper, an intelligent system is defined as a system capable of autonomous control based on machine learning models. An intelligent system is, for example, a virtual object or physical entity that can make decisions and autonomously execute actions based on machine learning models to achieve preset goals or complete preset tasks. An intelligent system can be an automated program that understands user intent and can utilize models or invoke tools to complete various types of tasks. In some contexts, examples of intelligent systems may include, but are not limited to, agents, bots, chatbots, and digital assistants. Alternatively, an intelligent system can also be an intelligent role implemented based on machine learning models. An intelligent system can perform specified types of tasks based on user requests derived from generative models (e.g., language models, multimodal models).

[0036] S220. In response to an interactive operation on the first node, display the first control.

[0037] The state of the first control indicates whether to display the editable content in the first node. For example, the first control can be a toggle switch. The state of the first control includes a first state and a second state, corresponding to the on and off states of the toggle switch, respectively. Clicking the first control switches between the first and second states. When the first control is in the first state, the editable content is displayed in the first node. When the first control is in the second state, the editable content is not displayed in the first node.

[0038] For example, in response to an interactive operation on a first region of the first node, the first control is displayed, wherein the first region includes a second control for connecting a portion of the nodes in the media content creation stream.

[0039] In some cases, clicking the first area within the first node will display the toolbar corresponding to the first node, which includes the first control, etc. The first area is a local area within the first node excluding the second area. The second area can be the canvas area of ​​the first node.

[0040] Figure 3 This is a schematic diagram illustrating a media content creation flow as presented in this article. Figure 3 As shown, the media content creation flow 300 includes material nodes 310 and a first node 320. The first node 320 includes a first area 330 and a second area 370. The first area 330 includes at least two second controls 340. The at least two second controls include an input port and an output port of the first node 320. For example, three material nodes 310 are connected to the input ports of the first node 320 respectively. In response to a click operation on the first area 330, a toolbar 350 is displayed at the top of the first node 320. The toolbar 350 includes a first control 360. The first control 360 is in a second state.

[0041] S230. In response to the first control being in the first state, display the edit content on the first node, wherein the edit content includes the description information of the layer.

[0042] The coded content consists of the layer's code description information displayed in the first node. This code description information represents the layer's style, layout, and data. The layer's style and layout include its resolution, brightness, transparency, layer hierarchy, composition, and position. The layer's data can include text and resource links. An intelligent system can identify the second area of ​​the first node to obtain the layer's code description, which can then be used for editing.

[0043] In some cases, in response to the first control being in a first state, an editing area is displayed on the first node, the editing area including the edited content.

[0044] The editing area is the region within the first node used to display edited content. When the first control is in its second state, the first node includes a first region and a second region, with the second region having a larger area than the first region. The second region is used to display at least one layer. In response to the first control being in its first state, the area of ​​at least one of the first and second regions is reduced so that the first node includes the first region, the second region, and the editing area.

[0045] See Figure 3 As shown, in response to a click operation on the first control 360, the first control 360 is switched to a first state. The first node 320 includes a first area 330, a second area 370, and an editing area 380. The editing area 380 includes the edited content.

[0046] In other cases, in response to a trigger operation on the first control, the control state is switched, wherein the control state includes the first state and a second state. In response to the first control being in the second state, the editing area in the first node is hidden.

[0047] See Figure 3 As shown, in response to a click operation on the first control 360, the first control 360 is switched to the second state. Section 320 includes a first area 330 and a second area 370, but does not display the editing area 380.

[0048] S240. In response to the editing operation on the edited content, display the editing result of the edited content and the editing result of the at least one layer, wherein the editing result of the at least one layer conforms to the content corresponding to the at least one layer in the editing result of the edited content.

[0049] The edit result represents the edited code description information. The edit result of at least one layer is presented as the edited composite image. For adjustments to local details, only the relevant content in the code description information needs to be adjusted. For adjustments to the composition, the content related to multiple layers in the code description information needs to be adjusted.

[0050] In some cases, an input port connects the first node to the second node, where the second node is a node representing the intelligent system. In response to inputting editing request information to the second node, the editing result of the edited content and the editing result of the at least one layer are displayed, wherein the editing result of the edited content is output by the intelligent system and conforms to the editing request information.

[0051] The editing request information is used to instruct the intelligent system to perform editing operations on the content in accordance with expectations.

[0052] For example, the input port connecting the first node to the second node includes: In response to the encapsulation operation for the first node, a component node is displayed, wherein the component node is a media content creation stream segment containing the first node. In response to the generation event of the second node, the second node is displayed. In response to the node connection operation, the component node is connected to the input port of the second node. This example facilitates intelligent system invocation by encapsulating the media content creation stream segment containing the first node into a component node. Connecting the component node to the input port of the second node enables the input of the edited content of the first node into the second node. For example, if the second media content creation stream needs to obtain the composite image or composite image mask output by the first node in the first media content creation stream, it can be done by encapsulating the media content creation stream segment or media content creation stream containing the first node into a component node, making it convenient for the second media content creation stream to call the component node to obtain the composite image or composite image mask output by the first node.

[0053] For example, the second node includes an input area, which includes a send control. In response to an input operation within the input area, editing requirement information is displayed in the input area. This editing requirement information can be an explicit instruction or an editing expectation, requesting the intelligent system to generate multiple candidate editing results based on the editing expectation. The editing results of the layers corresponding to the multiple candidate editing results are displayed so that the creator can select the editing result that meets the expectation.

[0054] In response to a trigger operation on the send control, editing requirements and code description information are input into the intelligent system. The intelligent system then rewrites the code description information based on the editing requirements to obtain the edited content. Since the encoded content is the layer's description information, the layer's edited result is determined based on the edited content. A new first node is created, and a second node is connected to the input port of this new first node. This new first node displays the edited content and at least one layer's edited result, and outputs the expected composite image or a mask corresponding to the composite image through the output port of the new first node. This example achieves precise control over layer structure and style by rewriting code description information through the intelligent system, eliminating the need for manual adjustments, thus improving the automation and intelligence of media content creation and increasing efficiency. Furthermore, for poster generation scenarios, the intelligent system can call the first node to generate a mask and invoke the poster generation process to automatically generate the poster based on this mask.

[0055] Optionally, displaying the editing result of the edited content and the editing result of the at least one layer in response to an editing operation on the edited content includes: displaying the editing result of the edited content and the editing result of the at least one layer in response to a drag operation on the at least one layer. This example achieves linked adjustment of the edited content by adjusting layers.

[0056] The drag-and-drop operation is used to adjust the position and size of layers. In response to a drag-and-drop operation on a layer, at least one of the parameters, such as the layer's position and size, is updated within the second area. Accordingly, the corresponding content in the code description information is updated based on the layer's editing result.

[0057] For example, dragging layer A from position x in the second area to position v, where the coordinates of position x are (20, 45) and the coordinates of position v are (50, 90), will display layer A at position v in the second area. Accordingly, the coordinate parameters in the position description information of layer A in the code description information will be updated from (20, 45) to (50, 90).

[0058] Optionally, the step of displaying the editing result of the edited content and the editing result of the at least one layer in response to the editing operation of the edited content includes: displaying the editing result of the edited content and the editing result of the at least one layer in response to the parameter editing operation of the at least one layer, wherein the parameter editing operation is associated with the editing item in the node editing page, and the node editing page is the editing page corresponding to the first node.

[0059] In some cases, the node editing page corresponding to the first node is displayed. This node editing page includes at least one editing item. The editing item is used to control the layer's parameters. Parameter editing operations on at least one layer include interactive operations on the editing items. The layer's parameters are adjusted through interactive operations on the editing items. For example, at least one editing item includes at least one of the following: transparency, brightness, position, size, and rotation.

[0060] See Figure 3 As shown, clicking the second area 370 of the first node 320 displays the node editing page 390. The node editing page 390 includes at least one editing item 3100. Through interactive operations on at least one editing item 3100, the parameters of the layer are adjusted, and the adjusted parameters are presented as the editing result of the layer. Based on the editing result of the layer, the editing result of the content is determined and displayed in the editing area 380.

[0061] Optionally, displaying the editing result of the edited content and the editing result of the at least one layer in response to an editing operation on the edited content includes: displaying the editing result of the edited content and the editing result of the at least one layer in response to a rewrite operation on the edited content. This example achieves linked adjustment of layers by rewriting the edited content.

[0062] This article demonstrates how to automatically rewrite and edit content using an intelligent system, simultaneously modify layers, manually rewrite and edit content, drag and drop layers, or adjust layer parameters to simultaneously modify content. This provides a variety of layer editing methods through the first node.

[0063] This paper presents a media content creation workflow, where the first node includes at least one layer. In response to interactive operations on the first node, a first control is displayed. In response to the first control being in a first state, editable content, including descriptive information about the layer, is displayed on the first node. In response to editing operations on the editable content, the editing results of the edited content and the layer are displayed, with the layer's editing result matching the corresponding content in the edited content. This paper achieves the conversion of layers from image information to descriptive information by adding a first node to the media content creation workflow and displaying editable content within it. It also enables precise editing of at least one layer through editing operations on the editable content, addressing the low efficiency problem of related media content creation methods. Layers can be edited within the media content creation workflow to obtain media content that meets expectations, enriching layer editing methods and improving the efficiency of media content creation.

[0064] Figure 4 This is a flowchart illustrating another media content creation method presented in this article. Based on the examples above, it adds restrictions on the editable items that display the content of the node editing page at the first node.

[0065] like Figure 4 As shown, the method includes: S410. Display the media content creation flow, wherein the media content creation flow includes a first node, the first node includes at least one layer, wherein the media content creation flow is used for media content creation, and the first node is used for editing the at least one layer.

[0066] S420. In response to an interactive operation on the first node, display a first control, wherein the first control is in a second state.

[0067] S430. In response to an interactive operation on the first node, a node editing page is displayed, the node editing page including at least one editing item and a fourth control, wherein the at least one editing item is used to edit the at least one layer.

[0068] The node editing page is the editing page corresponding to the first node. In other words, the node editing page is a subpage of the first node. The node editing page is displayed based on the interactive operations performed on the first node.

[0069] For example, the interactive operation for the first node includes at least one of the following: A trigger operation for a third control associated with the first node; and a trigger operation for a second region in the first node, wherein the second region is used to preview the at least one layer.

[0070] In some cases, a third control is displayed in the toolbar at the top of the first node. This third control triggers the display of the node editing page corresponding to the first node. The node editing page includes at least one editing item. The current parameters of at least one editing item are associated with information from at least one layer within the second area. For example, the current parameters of at least one editing item include the transparency, brightness, size, rotation angle, and position of at least one layer.

[0071] In other cases, in response to a click on a non-layered area within the second region, the node editing page is displayed. The non-layered area refers to the region within the second region that is not occupied by layers.

[0072] Optionally, a sixth control is displayed in the second area, and a node editing page is displayed in response to a click on the sixth control.

[0073] Figure 5 This is a schematic diagram of a node editing page provided in this article. For example... Figure 5 In response to an interactive operation on the first node 510, a node editing page 520 is displayed. The node editing page 520 includes at least one editing item 530, a layer 540, and a fourth control 550. The layer 540 is used to hold source material. A fifth control 560 is displayed at the position corresponding to the editing item 530.

[0074] S440, In response to a selection operation for at least one editable item, display the selected editable item at the first node.

[0075] For example, a fifth control is displayed at the position corresponding to the edit item. This fifth control triggers the display of the edit item on the first node. In response to a trigger operation on the fifth control corresponding to at least one edit item, the rendering position of at least one edit item is adjusted to the first node. This example allows creators to display frequently adjusted edit items on the first node according to their usage habits, avoiding the need to enter the node editing page to edit the edit items, saving the steps of switching between the node editing page and the first node, and simplifying the layer editing method.

[0076] See Figure 5 In response to a click operation on the fifth control 560, the editing item 530 corresponding to the clicked fifth control 560 in the node editing page 520 is transferred to the first node 510 for display.

[0077] In response to a trigger operation on the fourth control, the node editing page switches to the first node. The fourth control is used to trigger a return from the node editing page to the first node. In response to the trigger operation on the fourth control, the node editing page exits, and the first node is displayed. The editable item corresponding to the clicked fifth control is displayed on the first node.

[0078] See Figure 5 In response to a click on the fourth control 550, exit the node display page 520 to display the first node 510.

[0079] S450, In response to a trigger operation on the first control, the first control is converted to a first state.

[0080] S460. In response to the first control being in the first state, display the edit content on the first node, wherein the edit content includes the description information of the layer.

[0081] S470. In response to the editing operation on the edited content, display the editing result of the edited content and the editing result of the at least one layer, wherein the editing result of the at least one layer conforms to the content corresponding to the at least one layer in the editing result of the edited content.

[0082] The technical solution presented in this paper displays a node editing page in response to interactive operations on the first node. The node editing page includes at least one editing item. In response to a selection operation on at least one editing item, the selected editing item is displayed on the first node. This achieves the goal of displaying a specific editing item on the first node, avoiding the need to enter the node editing page to edit the editing item, saving the steps of switching between the node editing page and the first node, and simplifying the layer editing method.

[0083] Figure 6This is a schematic diagram of the structure of a media content creation device provided in this article. The device can be implemented in the form of software and / or hardware, and optionally, in the form of electronic devices, such as mobile terminals, PCs, or servers.

[0084] like Figure 6 As shown, the device includes: a first display module 610, a second display module 620, a third display module 630, and a fourth display module 640.

[0085] The first display module 610 is used to display the media content creation flow, which includes a first node, the first node including at least one layer, wherein the media content creation flow is used for media content creation, and the first node is used for editing the at least one layer; The second display module 620 is used to display the first control in response to the interactive operation on the first node; The third display module 630 is used to display editable content on the first node in response to the first control being in the first state, wherein the editable content includes the description information of the layer; The fourth display module 640 is used to display the editing result of the edited content and the editing result of the at least one layer in response to the editing operation on the edited content, wherein the editing result of the at least one layer conforms to the content corresponding to the at least one layer in the editing result of the edited content.

[0086] Optionally, the fourth display module 640 is specifically used for: In response to a drag operation on the at least one layer, the editing result of the edited content and the editing result of the at least one layer are displayed.

[0087] Optionally, the fourth display module 640 is specifically used for: In response to a parameter editing operation on the at least one layer, the editing result of the edited content and the editing result of the at least one layer are displayed, wherein the parameter editing operation is associated with an editing item in the node editing page, and the node editing page is the editing page corresponding to the first node.

[0088] Optionally, the fourth display module 640 is specifically used for: In response to a rewrite operation on the edited content, the edited content and the edited at least one layer are displayed.

[0089] Optionally, the fourth display module 640 is specifically used for: An input port connecting the first node to the second node, wherein the second node is a node representing the intelligent system; In response to inputting editing requirement information to the second node, the editing result of the edited content and the editing result of the at least one layer are displayed, wherein the editing result of the edited content is output by the intelligent system and conforms to the editing requirement information.

[0090] Optionally, the input port connecting the first node to the second node includes: In response to the encapsulation operation for the first node, a component node is displayed, wherein the component node is a media content creation stream segment containing the first node; In response to the generation event of the second node, display the second node; In response to a node connection operation, the component node is connected to the input port of the second node.

[0091] Optionally, the second display module 620 is specifically used for: In response to an interactive operation targeting a first region within the first node, the first control is displayed, wherein the first region includes a second control for connecting a portion of the nodes in the media content creation flow.

[0092] Optionally, the third display module 630 is specifically used for: In response to the first control being in the first state, an editing area is displayed in the first node, the editing area including the editing content.

[0093] Optionally, it also includes: In response to a trigger operation on the first control, the control state is switched, wherein the control state includes the first state and the second state; In response to the first control being in the second state, the editing area in the first node is hidden.

[0094] Optionally, the first control in the second state further includes: In response to an interactive operation on the first node, a node editing page is displayed, the node editing page including at least one editing item, wherein the at least one editing item is used to edit the at least one layer; In response to a selection operation for at least one editable item, the selected editable item is displayed in the first node.

[0095] Optionally, the interactive operation for the first node includes at least one of the following: Triggering operations for the third control associated with the first node; A trigger operation is performed on the second region of the first node, wherein the second region is used to preview the at least one layer.

[0096] Optionally, it also includes: A fourth control is displayed on the node editing page; In response to a trigger operation on the fourth control, the node editing page switches to the first node.

[0097] The media content creation device provided in this article can execute the media content creation methods provided in any of the examples in this article, and has the corresponding functional modules and beneficial effects of the execution methods.

[0098] It is worth noting that the various units and modules included in the above-mentioned device are divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the scope of protection of this document.

[0099] Figure 7 This is a schematic diagram of the structure of an electronic device provided in this article. See below for reference. Figure 7 It shows an electronic device suitable for implementing this paper (e.g. Figure 7 The diagram below shows the structure of the terminal device or server 700. The terminal device in this document may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital radio receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. Figure 7 The electronic device shown is merely an example and should not impose any limitations on the functionality and scope of this article.

[0100] like Figure 7 As shown, the electronic device 700 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 701, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage device 708 into a random access memory (RAM) 703. The RAM 703 also stores various programs and data required for the operation of the electronic device 700. The processing unit 701, ROM 702, and RAM 703 are interconnected via a bus 704. An edit / output (I / O) interface 705 is also connected to the bus 704.

[0101] Typically, the following devices can be connected to I / O interface 705: input devices 706 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 707 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 708 including, for example, magnetic tapes, hard disks, etc.; and communication devices 709. Communication device 709 allows electronic device 700 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 7 An electronic device 700 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0102] In particular, according to the examples herein, the processes described in the above-referenced flowcharts can be implemented as computer software programs. For example, the examples herein include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such an example, the computer program can be downloaded and installed from a network via communication device 709, or installed from storage device 708, or installed from ROM 702. When the computer program is executed by processing device 701, it performs the functions defined in the methods herein.

[0103] The names of messages or information exchanged between multiple devices in the embodiments herein are for illustrative purposes only and are not intended to limit the scope of these messages or information.

[0104] The electronic device provided herein and the media content creation method provided in the above examples belong to the same inventive concept. Technical details not described in detail in this example can be found in the above examples, and this example has the same beneficial effects as the above examples.

[0105] This article provides a computer storage medium on which a computer program is stored, which, when executed by a processor, implements the media content creation method provided in the above example.

[0106] It should be noted that the computer-readable medium described above can be a computer-readable signal medium, a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this document, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0107] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.

[0108] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0109] The aforementioned computer-readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to: The media content creation workflow is displayed, which includes a first node, the first node including at least one layer, wherein the media content creation workflow is used for media content creation, and the first node is used for editing the at least one layer; In response to an interactive action on the first node, display the first control; In response to the first control being in a first state, editable content is displayed on the first node, wherein the editable content includes the description information of the layer; In response to an editing operation on the edited content, the editing result of the edited content and the editing result of the at least one layer are displayed, wherein the editing result of the at least one layer conforms to the content corresponding to the at least one layer in the editing result of the edited content.

[0110] Computer program code for performing the operations described herein may be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code may execute entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0111] The flowcharts and block diagrams in the accompanying figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to the various examples herein. In this respect, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the figures. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram and / or flowchart, and combinations of blocks in block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0112] The units described herein can be implemented in software or hardware. The names of the units are not, in some cases, limiting to the unit itself.

[0113] The functions described above in this document can be performed at least in part by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SoCs), complex programmable logic devices (CPLDs), and so on.

[0114] In the context of this document, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0115] The above description is merely a preferred example and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of disclosure herein is not limited to technical solutions formed by specific combinations of the above-described technical features, but also includes other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-disclosed concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed herein that have similar functions.

[0116] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. Multitasking and parallel processing may be advantageous in certain contexts. Similarly, while some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of this paper. Certain features described in the context of a single example can also be implemented in combination in a single example. Conversely, various features described in the context of a single example can also be implemented individually or in any suitable sub-combination in multiple examples.

[0117] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. A method for creating media content, comprising: The media content creation workflow is displayed, which includes a first node, the first node including at least one layer, wherein the media content creation workflow is used for media content creation, and the first node is used for editing the at least one layer; In response to an interactive action on the first node, display the first control; In response to the first control being in a first state, editable content is displayed on the first node, wherein the editable content includes the description information of the layer; In response to an editing operation on the edited content, the editing result of the edited content and the editing result of the at least one layer are displayed, wherein the editing result of the at least one layer conforms to the content corresponding to the at least one layer in the editing result of the edited content.

2. The method according to claim 1, wherein displaying the editing result of the edited content and the editing result of the at least one layer in response to an editing operation on the edited content includes: In response to a drag operation on the at least one layer, the editing result of the edited content and the editing result of the at least one layer are displayed.

3. The method according to claim 1, wherein displaying the editing result of the edited content and the editing result of the at least one layer in response to an editing operation on the edited content includes: In response to a parameter editing operation on the at least one layer, the editing result of the edited content and the editing result of the at least one layer are displayed, wherein the parameter editing operation is associated with an editing item in the node editing page, and the node editing page is the editing page corresponding to the first node.

4. The method according to claim 1, wherein displaying the editing result of the edited content and the editing result of the at least one layer in response to an editing operation on the edited content includes: In response to a rewrite operation on the edited content, the edited content and the edited at least one layer are displayed.

5. The method according to claim 1, wherein displaying the editing result of the edited content and the editing result of the at least one layer in response to an editing operation on the edited content comprises: An input port connecting the first node to the second node, wherein the second node is a node representing the intelligent system; In response to inputting editing requirement information to the second node, the editing result of the edited content and the editing result of the at least one layer are displayed, wherein the editing result of the edited content is output by the intelligent system and conforms to the editing requirement information.

6. The method according to claim 5, wherein the input port connecting the first node to the second node comprises: In response to the encapsulation operation for the first node, a component node is displayed, wherein the component node is a media content creation stream segment containing the first node; In response to the generation event of the second node, display the second node; In response to a node connection operation, the component node is connected to the input port of the second node.

7. The method according to claim 1, wherein displaying the first control in response to an interactive operation on the first node includes: In response to an interactive operation on a first area of ​​the first node, the first control is displayed, wherein the first area includes a second control, the second control being used to connect a portion of the nodes in the media content creation flow.

8. The method according to claim 1, wherein displaying editable content on the first node in response to the first control being in a first state includes: In response to the first control being in the first state, an editing area is displayed in the first node, the editing area including the editing content.

9. The method according to claim 8, further comprising: In response to a trigger operation on the first control, the control state is switched, wherein the control state includes the first state and the second state; In response to the first control being in the second state, the editing area in the first node is hidden.

10. The method according to claim 1, wherein the first control is in a second state, further comprising: In response to an interactive operation on the first node, a node editing page is displayed, the node editing page including at least one editing item, wherein the at least one editing item is used to edit the at least one layer; In response to a selection operation for at least one editable item, the selected editable item is displayed in the first node.

11. The method of claim 10, wherein the interactive operation for the first node includes at least one of the following: Triggering operations for the third control associated with the first node; triggering operations for a second region in the first node, wherein The second area is used to preview the at least one layer.

12. The method of claim 10, further comprising: A fourth control is displayed on the node editing page; In response to a trigger operation on the fourth control, the node editing page switches to the first node.

13. A media content creation device, comprising: The first display module is used to display the media content creation flow, which includes a first node, the first node including at least one layer, wherein the media content creation flow is used for media content creation, and the first node is used for editing the at least one layer; The second display module is used to display the first control in response to the interactive operation on the first node; The third display module is used to display editable content on the first node in response to the first control being in the first state, wherein the editable content includes the description information of the layer; The fourth display module is used to respond to the editing operation on the edited content and display the editing result of the edited content and the editing result of the at least one layer, wherein the editing result of the at least one layer conforms to the content corresponding to the at least one layer in the editing result of the edited content.

14. An electronic device, the electronic device comprising: One or more processors; Storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the media content creation method as described in any one of claims 1-12.

15. A storage medium comprising computer-executable instructions, which, when executed by a computer processor, are used to perform the media content creation method as described in any one of claims 1-12.

Images