Method and apparatus for generating media content, device, and storage medium

Abstract

Embodiments of the present disclosure relate to a method and apparatus for generating media content, a device, and a storage medium. The method presented herein comprises: based on a selection of multiple items of reference media content, displaying multiple items of reference media content on a canvas assembly; acquiring target media content generated on the basis of the multiple items of reference media content, the target media content having a size corresponding to the canvas assembly, the target media content having multiple picture portions corresponding to the multiple items of reference media content, and the position of the multiple picture portions in the target media content being determined on the basis of display positions of the multiple items of reference media content in the canvas assembly; and providing the target media content. In this way, the embodiments of the present disclosure can improve the quality of media content.

Description

Method, device, equipment and storage medium for generating media content Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to a method, apparatus, device, and computer-readable storage medium for generating media content. Background Art

[0002] In recent years, with the development of computer technology, media content has become an important carrier for sharing or obtaining information. In the process of editing media content, people expect to obtain higher quality media content.

[0003] Summary of the Invention

[0004] In a first aspect of the present disclosure, a method for generating media content is provided. The method includes: displaying the multiple reference media contents in a canvas component based on a selection of the multiple reference media contents; acquiring target media content generated based on the multiple reference media contents, the target media content having a size corresponding to the canvas component and having multiple screen portions corresponding to the multiple reference media contents, the positions of the multiple screen portions in the target media content being determined based on the display positions of the multiple reference media contents in the canvas component; and providing the target media content.

[0005] In a second aspect of the present disclosure, a device for generating media content is provided. The device includes: a presentation module configured to display multiple reference media contents in a canvas component based on selection of the multiple reference media contents; a content module configured to obtain target media content generated based on the multiple reference media contents, wherein the target media content has a size corresponding to the canvas component and has multiple screen portions corresponding to the multiple reference media contents, and the positions of the multiple screen portions in the target media content are determined based on the display positions of the multiple reference media contents in the canvas component; and a providing module configured to provide the target media content.

[0006] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the device to perform the method of the first aspect.

[0007] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.

[0008] It should be understood that the content described in this summary section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0010] FIG1 shows a schematic diagram of an example environment capable of implementing some embodiments of the present disclosure;

[0011] 2A to 2D illustrate example interfaces according to some embodiments of the present disclosure;

[0012] FIG3 illustrates a flow chart of an example process for generating media content according to some embodiments of the present disclosure;

[0013] FIG4 shows a schematic structural block diagram of an example apparatus for generating media content according to some embodiments of the present disclosure; and

[0014] FIG5 shows a block diagram of an electronic device capable of implementing various embodiments of the present disclosure. DETAILED DESCRIPTION

[0015] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0016] It should be noted that the titles of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and any type of embodiment may be included under any section / subsection. Furthermore, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or in different sections / subsections.

[0017] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.

[0018] The embodiments of the present disclosure may involve user data, data acquisition and / or use, etc. These aspects shall comply with the corresponding laws, regulations and relevant provisions. In the embodiments of the present disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are carried out on the premise that the user is aware of and confirms them. Accordingly, when implementing the various embodiments of the present disclosure, the types, scope of use, and usage scenarios of the data or information that may be involved should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with the relevant laws and regulations. The specific notification and / or authorization method may vary according to the actual situation and application scenario, and the scope of the present disclosure is not limited in this respect.

[0019] If this specification and the solutions in the examples involve the processing of personal information, such processing will be done only with a legitimate basis (such as with the consent of the subject of personal information or as necessary for the performance of a contract) and only within the prescribed or agreed scope. A user's refusal to process personal information other than that required for basic functions will not affect the user's use of basic functions.

[0020] As briefly mentioned above, people expect to improve the quality of media content. Taking images as an example of media content, the composition of some images may not meet the user's expectations, and people expect to be able to automatically expand the picture based on existing images.

[0021] Embodiments of the present disclosure provide a method for generating media content. According to the method, multiple reference media contents can be displayed in a canvas component based on selection of multiple reference media contents; target media content generated based on the multiple reference media contents is obtained, where the target media content has a size corresponding to the canvas component and has multiple screen portions corresponding to the multiple reference media contents, and the positions of the multiple screen portions in the target media content are determined based on the display positions of the multiple reference media contents in the canvas component; and the target media content is provided.

[0022] In this way, the embodiments of the present disclosure can help users generate expanded target media content based on multiple reference media content, thereby improving the quality of the media content.

[0023] Various example implementations of this solution are described in detail below in conjunction with the accompanying drawings.

[0024] Sample Environment

[0025] FIG1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in FIG1 , the example environment 100 may include an electronic device 110 .

[0026] In this example environment 100, electronic device 110 may run an application 120 that supports interface interaction. Application 120 may be any suitable type of application for interface interaction, examples of which may include, but are not limited to, a media editing application or other suitable applications. User 140 may interact with application 120 via electronic device 110 and / or its attached devices.

[0027] In the environment 100 of FIG. 1 , if the application 120 is in an active state, the electronic device 110 may present an interface 150 for supporting interface interaction through the application 120 .

[0028] In some embodiments, the electronic device 110 communicates with the server 130 to enable the provision of services for the application 120. The electronic device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a handheld computer, a portable game terminal, a VR / AR device, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface for the user (such as a "wearable" circuit, etc.).

[0029] The server 130 may be a standalone physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and big data and artificial intelligence platforms. For example, the server 130 may include a computing system / server such as a mainframe, an edge computing node, a computing device in a cloud environment, and the like. The server 130 may provide background services for the application 120 that supports virtual scenes in the electronic device 110.

[0030] A communication connection may be established between the server 130 and the electronic device 110. The communication connection may be established in a wired or wireless manner. The communication connection may include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus (USB) connection, a Wireless Fidelity (WiFi) connection, etc., and the embodiments of the present disclosure are not limited in this respect. In the embodiments of the present disclosure, the server 130 and the electronic device 110 may implement signaling interaction through the communication connection between the two.

[0031] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the present disclosure.

[0032] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

[0033] Example Interaction

[0034] 2A to 2D illustrate example interfaces 200A to 200D according to some embodiments of the present disclosure. Interfaces 200A to 200D may be provided by, for example, the electronic device 110 shown in FIG1 .

[0035] In some embodiments, electronic device 110 may display at least one reference media content in a canvas component based on a user's selection of at least one reference media content (e.g., from an application storing reference media content, such as a photo album application or a webpage). The canvas component may reside in application 120 as described above.

[0036] In some embodiments, the media content may include any appropriate type of media with picture content, such as images, videos, etc. For the convenience of description, the embodiments of the present disclosure will be described below using images as an example of media content.

[0037] As an example, the reference media content may be image content. The electronic device 110 may accept the first image content 206 selected by the user and display the image content 206 in the canvas component 205 in the interface 200A of FIG. 2A .

[0038] In some embodiments, electronic device 110 may obtain target media content generated based on at least one reference media content. The target media content has a size corresponding to the canvas component and has at least one screen portion corresponding to the at least one reference media content. The position of the at least one screen portion in the target media content is determined based on the display position of the at least one reference media content in the canvas component.

[0039] As an example, the reference media content may be image content. In interface 200A of FIG2A , electronic device 110 may obtain target image content (i.e., target media content) generated based on first image content 206. The target image content is the same size as canvas component 205, and includes a first screen portion corresponding to first screen content 206. The first screen portion has exactly the same size and content as the first screen content, and the relative position of the first screen portion in the target image content is also the same as the relative position of the first image content in canvas component 205.

[0040] In some embodiments, the electronic device 110 may also provide the generated target media content. For example, the electronic device 110 may present a new interface in the application 120 as described above to provide the target media content.

[0041] In some embodiments, the electronic device 110 may further provide an input control 210 in the interface 200A of FIG2A . Furthermore, the electronic device 110 may receive guidance information input by the user in natural language in the input control 210. The guidance information may be used to describe the media content to be generated, and the target media content may be generated based on at least one reference media content and the guidance information.

[0042] As an example, the guidance information may be used to describe the scene of the media content to be generated (e.g., a rainy day). In this case, elements matching the scene (e.g., dark clouds, raindrops, etc.) may be added to the target media content generated by the electronic device 110. In addition, the electronic device 110 may also adjust the color of the entire screen of the media content to be generated according to the scene described in the guidance information (e.g., the entire screen of a rainy day is grayish), so that the target media content as a whole conforms to the scene described in the guidance information.

[0043] In some embodiments, the electronic device 110 may further provide a preset control (not shown) in the interface 200A of FIG. 2A . The preset control may include a variety of preset scenes (such as sunny days, rainy days, snowy days, holiday scenes, etc.) and / or a variety of elements (such as hats, small animals, plants, etc.). Furthermore, the electronic device 110 may receive a user's selection of a preset scene or preset element in the preset control in response to the triggering of the preset control, and use the preset scene or preset element as the aforementioned guidance information. As an example, a variety of preset scenes and / or a variety of elements may be presented in a visual form in the interface 200A.

[0044] In some embodiments, the electronic device 110 may display at least one reference media content in the canvas component 205 based on the selection of at least one reference media content, which may include: displaying the first media content of the at least one reference media content in the canvas component. That is, the at least one reference media content initially selected by the user can be referred to as the first media content, and all first media content can be displayed in the canvas component 205. As an example, as shown in the interface 200A of Figure 2A, the image content 206 can be referred to as the first media content displayed in the canvas component 205. It should be noted that the display of one image of the image content 206 in the interface 200A is only for illustrative purposes. The user can select one or more image contents as multiple first media contents to be displayed in the canvas component 205 as needed. The present invention does not limit the number of first media contents.

[0045] In some embodiments, the electronic device 110 may provide an add entry. Further, the electronic device 110 may receive a selection of a second media content from multiple reference media contents in response to a trigger of the add entry, and display the selected second media content in the canvas component 205. As an example, the electronic device 110 may provide an add picture control 220 (equivalent to an add entry) in the interface 200A of FIG. 2A , and present a selection page including multiple second media contents in response to a trigger of the add picture control 220. The electronic device 110 may receive at least one media content selected by the user in the selection page as at least one second media content, and present the at least one second media content in the canvas component 205.

[0046] 2B . In the interface 200B, the electronic device 110 may display the first media content 206 initially selected by the user and the second media content 207 added by the user via the add picture control 220 in the canvas component 206 .

[0047] In some embodiments, the electronic device 110 may receive at least one reference media content selected by the user as at least one first media content, and in response to the user's request to expand the first media content, present the canvas component 205. Furthermore, the electronic device 110 may display the first media content in the canvas component 205. That is, the electronic device 110 may first receive the reference media content selected by the user as the first media content, then display the canvas component 205, and then display the first media content in the canvas component 205.

[0048] In yet other embodiments, the electronic device 110 may also present the canvas component 205 and the add entry in the aforementioned application 120. Furthermore, in response to a triggering of the add entry, the electronic device 110 may receive a selection of a first media content from a plurality of reference media contents and display the selected first media content in the canvas component 205. In other words, the electronic device 110 may first display the canvas component 205, then receive the user-selected reference media content as the first media content through the add entry, and then display the first media content in the canvas component 205.

[0049] It should be noted that the aforementioned first media content and second media content are relative. The at least one reference media content selected by the user for the first time can be called the first media content. On the premise that the first media content exists on the canvas component 205, the reference media content newly added through the addition entrance can be called the second media content.

[0050] In some embodiments, the electronic device 110 may receive a selection of media content from among the multiple reference media contents in the canvas component 205, and in response to the received adjustment operation, adjust the media content in the canvas component 205 according to the adjustment operation. It should be noted that the adjusted media content may be one or more selected reference media contents from among all reference media contents currently presented by the canvas component 205.

[0051] In some embodiments, based on the selection of the third media content, the electronic device 110 may display the third media content and other unselected reference media content differently in the canvas component 205. For example, the differentiating display may include highlighting the third media content and / or reducing the transparency of other reference media content.

[0052] In some embodiments, the electronic device 110 may adjust the third media content in the canvas component 205, including but not limited to: adjusting the display position of the third media content in the canvas component 205; adjusting the display direction of the third media content in the canvas component 205; adjusting the display size of the third media content in the canvas component 205, and removing part of the screen content of the third media content.

[0053] As an example, the electronic device 110 may remove part of the third media content in the canvas component 205 by removing the background of the third media content (for example, cropping an image containing a portrait to retain only the portrait portion). The electronic device 110 may also remove the entire third media content in the canvas component 205. It should be noted that the electronic device 110 may also receive user adjustments to the third media content and display the adjusted third media content in real time in the canvas component 205.

[0054] In some embodiments, electronic device 110 may display interface 200C as shown in FIG2C after receiving a user adjustment operation on the reference media content in interface 200B of FIG2B (adjusting the display direction, display position, display size, and removing the background of image content 207, and adjusting the display position and display size of image content 206). Electronic device 110 may display the adjusted image content 206 and image content 207 in canvas component 205 of interface 200C of FIG2C.

[0055] In some embodiments, the electronic device 110 may further provide a scale adjustment control and, in response to a selection of the scale adjustment control, adjust the scale of the canvas component 205. For example, the electronic device 110 may provide a scale adjustment control 225 in the interface 200A of FIG. 2A . In response to triggering the scale adjustment control 225, the electronic device 110 may display a plurality of preset scale options for selection. Furthermore, the electronic device 110 may receive a user selection of a target scale option from the plurality of preset scale options and then adjust the scale of the canvas component 205 to the scale corresponding to the target scale option.

[0056] In some embodiments, the electronic device 110 may also display the current scale of the canvas component 205 in the scale adjustment control 225 .

[0057] In some embodiments, the electronic device 110 may further display a scale input area in response to triggering of the scale adjustment control 225 , receive a custom scale input by the user, and adjust the scale of the canvas component 205 to the custom scale.

[0058] In some embodiments, the electronic device 110 may further provide an arrangement control (not shown) in the interface 200C of FIG. 2C , and in response to the triggering of the arrangement control, display multiple arrangement options. Further, the electronic device 110 may receive a user's selection of a target arrangement option from the multiple arrangement options, and adjust the arrangement of the multiple reference media contents presented in the canvas component 205 to an arrangement associated with the target arrangement option. As an example, the multiple arrangement options may include a one-touch horizontal arrangement option, a one-touch vertical arrangement option, and the like.

[0059] Furthermore, the electronic device 110 may acquire target media content generated based on a plurality of reference media content (eg, the image content 206 and the image content 207 ), and may provide the target media content accordingly.

[0060] In some embodiments, as shown in FIG2C , the electronic device 110 may provide a generation control 215 in the interface 200C. Further, the electronic device 110 may generate target image content associated with the canvas component 205, the image content 206, the image content 207, and the guide information in response to triggering of the generation control 215. As an example, as shown in the interface 200C of FIG2C , the electronic device 110 may provide the image content 206, the image content 207, and the guide information to the target model. The target model may fill the blank area of ​​the canvas component 205 according to the guide information and the background of the image content 206, and generate target media content that matches the size of the canvas component 205.

[0061] In some embodiments, the electronic device 110 can display target image content 250 generated based on the content in interface 200C of Figure 2C in interface 200D of Figure 2D. As shown in Figure 2D, target image content 250 has screen portions corresponding to image 206 and image content 207. As shown in the figure, the size, position, angle, and other display information of these multiple screen portions in target image content 250 completely match the size, position, and angle in the corresponding multiple reference image canvas components. In other words, the target media content retains the screen content of the multiple reference media contents used to generate the target media content at the corresponding positions.

[0062] In some embodiments, the electronic device 110 also provides a return control 235 in the interface 200D of Figure 2D, which can return to the interface 200D as shown in Figure 2C in response to the triggering of the return control 235 to adjust the canvas component 205, the reference media content on the canvas component 205, and the guidance information.

[0063] In some embodiments, the electronic device 110 further provides a save control 240 in the interface 200D of FIG. 2D , and can download the generated target media content in response to triggering of the save control 240 .

[0064] In some embodiments, the electronic device 110 further provides a regeneration control 245 in the interface 200D of FIG. 2D , and in response to triggering of the regeneration control 245 , calls the target model to generate target media content based on the guidance information and the reference image content.

[0065] The following further describes the process of generating target media content based on multiple reference media content.

[0066] In some embodiments, the electronic device 110 and / or the server 130 generates intermediate media content based on the multiple reference media contents in the canvas component 205. In some embodiments, taking FIG2C as an example, the electronic device 110 and / or the server 130 may generate an intermediate image based on the canvas component and the image content 206 and the image content 207. Such an intermediate image has a first portion corresponding to the image content 206 and the image content 207, and also has a second portion corresponding to blank content (e.g., with a transparency of 0), that is, the portion of the canvas component not covered by the image content 206 or the image content 207.

[0067] In some embodiments, the electronic device 110 may provide the target model with reference media content, causing the target model to fill in the second portion based on the first portion of the reference media content, and obtain the target media content generated by the target model. For example, the electronic device 110 may provide the target model with an intermediate image to instruct the target model to fill in areas with zero transparency in the intermediate image.

[0068] Thus, when generating target media content, the target model can consider the frame information of multiple reference media contents, ensuring that the filled frame portion is continuous with the frames of the existing reference media content. Furthermore, if the user enters prompt information, the target model can also fill in the blank portion based on the prompt information, for example, to ensure that the filled frame matches the prompt information.

[0069] Taking FIG2D as an example, the prompt information may describe that the two characters are in an outdoor cloudy scene. Accordingly, the background image filled with the target model may include image elements corresponding to clouds.

[0070] In some embodiments, the embodiments of the present disclosure may further support users in performing secondary creation on published works, such as creating new media content by expanding on the published works and newly added media content.

[0071] As an example, the electronic device 110 may receive a preset operation of a user on a published work, and accordingly provide the canvas component 205 as described above, and add the work as reference media content in the canvas component 205. In some embodiments, the work may be published by the user or a different user.

[0072] In some embodiments, the electronic device 110 may receive one or more other reference media content added by the user to the canvas component. Such one or more reference media content may include, for example, media content uploaded, captured, or generated by the user. For example, the user may generate corresponding reference media content by inputting a prompt word.

[0073] Furthermore, the electronic device 110 may appropriately edit the multiple reference media contents in the canvas component based on the method described above, and generate target media content based on the selected work and the newly added reference media content.

[0074] Furthermore, the electronic device 110 may also publish the work corresponding to the target media content based on the publishing request of the user, for example.

[0075] For example, a user can select an image work posted by another user and upload, photograph, or generate another image or multiple images into the canvas component to obtain an expanded image based on the multiple images. Furthermore, the user can publish the expanded image as a new work, thus achieving secondary creation based on the original image work.

[0076] Example Process

[0077] 3 shows a flow chart of an example process 300 for generating media content according to some embodiments of the present disclosure. Process 300 may be implemented at electronic device 110. Process 300 is described below with reference to FIG1.

[0078] As shown in the figure, in block 310 , the electronic device 110 displays a plurality of reference media contents in a canvas component based on selection of the plurality of reference media contents.

[0079] In box 320, the electronic device 110 obtains target media content generated based on multiple reference media contents, the target media content has a size corresponding to the canvas component, and the target media content has multiple screen parts corresponding to the multiple reference media contents, and the positions of the multiple screen parts in the target media content are determined based on the display positions of the multiple reference media contents in the canvas component.

[0080] At block 330 , the electronic device 110 provides the target media content.

[0081] In some embodiments, the method 300 further includes: acquiring guidance information via an input control, where the guidance information is used to describe the media content to be generated, wherein the target media content is generated based on a plurality of reference media content and the guidance information.

[0082] In some embodiments, displaying multiple reference media contents in a canvas component based on a selection of multiple reference media contents includes: displaying a first media content among the multiple reference media contents in the canvas component; receiving a selection of a second media content among the multiple reference media contents based on triggering an add entry; and displaying the selected second media content in the canvas component.

[0083] In some embodiments, displaying a first media content of the plurality of reference media content in a canvas component includes: rendering a canvas component based on an expansion request for the first media content; and displaying the first media content in the canvas component.

[0084] In some embodiments, displaying a first media content among multiple reference media contents in a canvas component includes: presenting a canvas component and adding an entry; receiving a selection of the first media content among the multiple reference media contents based on triggering the addition of the entry; and displaying the selected first media content in the canvas component.

[0085] In some embodiments, the method 300 further includes: receiving a selection of third media content from among the plurality of reference media content in the canvas component; and adjusting the third media content in the canvas component based on the received adjustment operation.

[0086] In some embodiments, adjusting the third media content in the canvas component includes at least one of the following: adjusting the display position of the third media content in the canvas component; adjusting the display direction of the third media content in the canvas component; adjusting the display size of the third media content in the canvas component; and removing part of the screen content of the third media content.

[0087] In some embodiments, method 300 further includes: based on the selection of the third media content, displaying the third media content and other unselected reference media content in a canvas component in a differentiated manner.

[0088] In some embodiments, method 300 further includes adjusting a scale of the canvas component based on the selection of a scale adjustment control.

[0089] In some embodiments, the target media content is generated based on the following process: generating intermediate media content based on multiple reference media contents in the canvas component, the intermediate media content including a first part and a second part, the first part corresponding to the screen content of the multiple reference media contents, and the second part corresponding to the blank content; providing the reference media content to the target model to instruct the target model to fill the second part based on the first part of the reference media content; and obtaining the target media content generated by the target model.

[0090] In some embodiments, displaying multiple reference media contents in a canvas component based on selection of multiple reference media contents includes: presenting a canvas component based on a preset operation of a first work, the canvas component displaying fourth media content associated with the first work, the first work being associated with a first user; and displaying fifth media content input by a second user in the canvas component.

[0091] In some embodiments, the fifth media content is generated based on prompt information input by the second user.

[0092] In some embodiments, method 300 further includes: publishing a second work associated with a second user based on the target media content.

[0093] Example devices and equipment

[0094] Embodiments of the present disclosure also provide corresponding devices for implementing the above-mentioned methods or processes. FIG4 shows a schematic structural block diagram of an example device 400 for generating media content according to certain embodiments of the present disclosure. Device 400 can be implemented as or included in an electronic device. The various modules / components in device 400 can be implemented by hardware, software, firmware, or any combination thereof.

[0095] As shown in Figure 4, the device 400 includes a presentation module 410, which is configured to display multiple reference media contents in a canvas component based on the selection of multiple reference media contents; a content module 420, which is configured to obtain target media content generated based on the multiple reference media contents, the target media content has a size corresponding to the canvas component, and the target media content has multiple screen parts corresponding to the multiple reference media contents, and the positions of the multiple screen parts in the target media content are determined based on the display positions of the multiple reference media contents in the canvas component; and a providing module, which is configured to provide the target media content.

[0096] In some embodiments, the content module 420 is further configured to: obtain guidance information via an input control, where the guidance information is used to describe the media content to be generated, wherein the target media content is generated based on a plurality of reference media content and the guidance information.

[0097] In some embodiments, the presentation module 410 is further configured to: display multiple reference media contents in a canvas component based on a selection of multiple reference media contents, including: displaying a first media content among the multiple reference media contents in the canvas component; receiving a selection of a second media content among the multiple reference media contents based on a triggering of an add entry; and displaying the selected second media content in the canvas component.

[0098] In some embodiments, the presentation module 410 is further configured to: display a first media content among the plurality of reference media content in a canvas component, comprising: presenting a canvas component based on an expansion request for the first media content; and displaying the first media content in the canvas component.

[0099] In some embodiments, the presentation module 410 is further configured to: display the first media content among multiple reference media contents in the canvas component, including: presenting the canvas component and adding an entry; based on triggering the adding entry, receiving a selection of the first media content among multiple reference media contents; and displaying the selected first media content in the canvas component.

[0100] In some embodiments, the presentation module 410 is further configured to: receive a selection of third media content from among the plurality of reference media content in the canvas component; and adjust the third media content in the canvas component based on the received adjustment operation.

[0101] In some embodiments, the presentation module 410 is further configured to: adjust the third media content in the canvas component, including at least one of the following: adjust the display position of the third media content in the canvas component; adjust the display direction of the third media content in the canvas component; adjust the display size of the third media content in the canvas component; remove part of the screen content of the third media content.

[0102] In some embodiments, the presentation module 410 is further configured to: based on the selection of the third media content, display the third media content and other unselected reference media content in a distinctive manner in the canvas component.

[0103] In some embodiments, the rendering module 410 is further configured to adjust the scale of the canvas component based on the selection of the scale adjustment control.

[0104] In some embodiments, the content module 420 is further configured to: generate target media content based on the following process: generate intermediate media content based on multiple reference media contents in the canvas component, the intermediate media content including a first part and a second part, the first part corresponds to the screen content of the multiple reference media contents, and the second part corresponds to the blank content; provide the reference media content to the target model to instruct the target model to fill the second part based on the first part of the reference media content; and obtain the target media content generated by the target model.

[0105] In some embodiments, the content module 420 is further configured to: display multiple reference media contents in a canvas component based on the selection of multiple reference media contents, including: presenting a canvas component based on a preset operation of the first work, the canvas component displaying fourth media content associated with the first work, the first work being associated with the first user; and displaying fifth media content input by the second user in the canvas component.

[0106] In some embodiments, the content module 420 is further configured to generate the fifth media content based on the prompt information input by the second user.

[0107] In some embodiments, the content module 420 is further configured to publish a second work associated with the second user based on the target media content.

[0108] FIG5 shows a block diagram of an electronic device 500 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the electronic device 500 shown in FIG5 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. The electronic device 500 shown in FIG5 can be used in electronic devices.

[0109] As shown in FIG5 , electronic device 500 is a general-purpose electronic device. Components of electronic device 500 may include, but are not limited to, one or more processors or processing units 510, memory 520, storage device 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processing unit 510 may be a real or virtual processor and is capable of performing various processes according to programs stored in memory 520. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to enhance the parallel processing capabilities of electronic device 500.

[0110] The electronic device 500 typically includes a plurality of computer storage media. Such media can be any accessible media that can be obtained by the electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 520 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 530 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk, or any other medium that can be used to store information and / or data and can be accessed within the electronic device 500.

[0111] The electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 5 , a disk drive for reading from or writing to a removable, non-volatile disk (e.g., a “floppy disk”) and an optical drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 520 may include a computer program product 525 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0112] The communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device 500 can be implemented in a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the electronic device 500 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0113] Input device 550 may be one or more input devices, such as a mouse, keyboard, or trackball. Output device 560 may be one or more output devices, such as a display, a speaker, or a printer. Electronic device 500 may also communicate with one or more external devices (not shown) via communication unit 540 as needed, such as a storage device, a display device, or the like, with one or more devices that allow a user to interact with electronic device 500, or with any device that allows electronic device 500 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0114] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0115] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0116] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0117] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0118] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0119] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, not exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for generating media content, comprising: Based on the selection of the plurality of reference media contents, displaying the plurality of reference media contents in the canvas component; Acquire target media content generated based on the multiple reference media contents, wherein the target media content has a size corresponding to the canvas component and has multiple screen portions corresponding to the multiple reference media contents, and positions of the multiple screen portions in the target media content are determined based on display positions of the multiple reference media contents in the canvas component; as well as The target media content is provided.

2. The method according to claim 1, further comprising: Guidance information is acquired via an input control, where the guidance information is used to describe media content to be generated, wherein the target media content is generated based on the plurality of reference media content and the guidance information.

3. The method of claim 1 , wherein displaying the plurality of reference media contents in the canvas component based on selection of the plurality of reference media contents comprises: Displaying a first media content among the plurality of reference media content in the canvas component; Based on a triggering of the adding entry, receiving a selection of a second media content from the plurality of reference media contents; as well as The selected second media content is displayed in the canvas component.

4. The method of claim 3, wherein displaying a first media content among the plurality of reference media content in the canvas component comprises: Based on the extended request for the first media content, presenting the canvas component; as well as The first media content is displayed in the canvas component.

5. The method of claim 3, wherein displaying a first media content among a plurality of reference media content in the canvas component comprises: Present the canvas component and the add entry; Based on the triggering of the adding entry, receiving the plurality of reference media contents Selection of first media content; as well as The selected first media content is displayed in the canvas component.

6. The method according to claim 1, further comprising: receiving a selection of a third media content among the plurality of reference media contents in the canvas component; as well as Based on the received adjustment operation, the third media content in the canvas component is adjusted.

7. The method of claim 6, wherein adjusting the third media content in the canvas component comprises at least one of: Adjusting the display position of the third media content in the canvas component; Adjusting the display direction of the third media content in the canvas component; Adjusting the display size of the third media content in the canvas component; Part of the screen content of the third media content is removed.

8. The method according to claim 6, further comprising: Based on the selection of the third media content, the third media content and other unselected reference media content are displayed distinctively in the canvas component.

9. The method according to claim 1, further comprising: Based on the selection of the scale adjustment control, the scale of the canvas component is adjusted.

10. The method of claim 1, wherein the target media content is generated based on the following process: Generate intermediate media content based on the multiple reference media contents in the canvas component, the intermediate media content including a first part and a second part, the first part corresponding to the screen content of the multiple reference media contents, and the second part corresponding to blank content; providing the reference media content to a target model to instruct the target model to populate the second portion based on the first portion of the reference media content; as well as The target media content generated by the target model is acquired.

11. The method of claim 1 , wherein displaying the plurality of reference media contents in a canvas component based on selection of the plurality of reference media contents comprises: Based on a preset operation on a first work, presenting the canvas component, wherein the canvas component displays fourth media content associated with the first work, where the first work is associated with a first user; as well as Fifth media content input by a second user is displayed in the canvas component. 12 . The method according to claim 11 , wherein the fifth media content is generated based on prompt information input by the second user.

13. The method according to claim 11, further comprising: Based on the target media content, a second work associated with the second user is published.

14. An apparatus for generating media content, comprising: a presentation module configured to display the plurality of reference media contents in a canvas component based on a selection of the plurality of reference media contents; a content module configured to obtain target media content generated based on the plurality of reference media contents, wherein the target media content has a size corresponding to the canvas component and has a plurality of screen portions corresponding to the plurality of reference media contents, and positions of the plurality of screen portions in the target media content are determined based on display positions of the plurality of reference media contents in the canvas component; The providing module is configured to provide the target media content.

15. An electronic device comprising: at least one processing unit; as well as At least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 13 when executed by the at least one processing unit.

16. A computer-readable storage medium having a computer program stored thereon, wherein the computer program is executable by a processor to implement the method according to any one of claims 1 to 13.

Images