Method and apparatus for generating media content, and device and medium

Abstract

The embodiments of the present disclosure relate to a method and apparatus for generating media content, and a device, a medium and a program product. The method for generating media content provided herein comprises: displaying a media generation interface, which comprises a content presentation area and an information input area, wherein the information input area comprises an input component, and the input component comprises a type switching control and a parameter setting control (310); determining a target media type by means of the type switching control, and acquiring a group of generation parameters by means of the parameter setting control (320); in response to the reception of a generation request, triggering a target generation model to generate, on the basis of the group of generation parameters, at least one piece of media content corresponding to the target media type (330); and in the content presentation area of the media generation interface, displaying a first message corresponding to the generation request, wherein the first message comprises the at least one piece of generated media content (340).

Description

Method, device, equipment and medium for generating media content

[0001] The present application claims priority to the Chinese patent application No. 202410869704.6, filed on June 28, 2024, entitled "Method, device, equipment and medium for generating media content", the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0002] The example embodiments of the present disclosure generally relate to the field of computer, and in particular, to a method, device, equipment and medium for generating media content. BACKGROUND

[0003] With the development of computer technology, the Internet has become an important platform for people to share and communicate. People can generate and publish media content such as videos, audios, pictures, and texts on the Internet to meet the needs of sharing and communication.

[0004] Currently, there are many applications that can provide users with the functions of generating and publishing media content and interacting based on media content. However, the generation methods of these applications for media content are very limited, and most of them need to rely on pre-provided materials of users to generate, so it is difficult to fully meet the expression needs of users, and the generation efficiency is low. SUMMARY

[0005] In a first aspect of the present disclosure, a method for generating media content is provided. The method comprises: displaying a media generation interface, the media generation interface comprising a content display area and an information input area, the information input area comprising an input component, the input component comprising a type switching control and a parameter setting control; determining a target media type through the type switching control, and obtaining a set of generation parameters through the parameter setting control; in response to receiving a generation request, triggering a target generation model to generate at least one item of media content corresponding to the target media type based on the set of generation parameters; and displaying a first message corresponding to the generation request in the content display area of the media generation interface, the first message comprising the generated at least one item of media content.

[0006] In a second aspect of the disclosure, an apparatus for generating media content is provided. The apparatus includes: an interface display module configured to display a media generation interface, the media generation interface including a content display area and an information input area, the information input area including an input component, the input component including a type switching control and a parameter setting control; a media type determination module configured to determine a target media type through the type switching control, and obtain a set of generation parameters through the parameter setting control; a media content generation module configured to, in response to receiving a generation request, trigger a target generation model to generate at least one item of media content corresponding to the target media type based on the set of generation parameters; and a message display module configured to display, in the content display area of the media generation interface, a first message corresponding to the generation request, the first message including the generated at least one item of media content.

[0007] In a third aspect of the disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. The instructions, when executed by the at least one processing unit, cause the device to perform the method of the first aspect or the second aspect.

[0008] In a fourth aspect of the disclosure, a computer-readable storage medium is provided. The computer-readable storage medium has stored thereon a computer program, the computer program being executable by a processor to implement the method of the first aspect or the second aspect.

[0009] In a fifth aspect of the disclosure, a computer program product is provided, comprising a computer program, wherein the computer program, when executed by a processor, implements the method according to the first aspect of the disclosure.

[0010] It should be understood that the content described in this section is not intended to limit the key features or important features of the embodiments of the disclosure, nor is it intended to limit the scope of the disclosure. Other features of the disclosure will become apparent through the following description. BRIEF DESCRIPTION OF DRAWINGS

[0011] The above and other features, advantages, and aspects of embodiments of the disclosure will become more apparent by describing in detail some embodiments thereof with reference to the annexed drawings in which:

[0012] FIG. 1 shows a schematic diagram of an example environment in which embodiments according to the disclosure can be implemented;

[0013] FIGS. 2A to 2J show example interfaces according to some embodiments of the disclosure;

[0014] FIG. 3 shows a flowchart of an example process for generating media content according to some embodiments of the disclosure;

[0015] FIG. 4 shows a schematic block diagram of an example apparatus for generating media content, according to some embodiments of the present disclosure; and

[0016] FIG. 5 shows a block diagram of an electronic device that can implement various embodiments of the present disclosure. DETAILED DESCRIPTION

[0017] Embodiments of the present disclosure will be described in more detail with reference to the drawings. While certain embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be embodied in various forms and should not be interpreted as being limited to the embodiments set forth herein; rather, these embodiments are provided so that the present disclosure can be more thoroughly and completely understood. It should be understood that the drawings and embodiments of the present disclosure are only for illustrative purposes and are not intended to limit the scope of protection of the present disclosure.

[0018] It should be noted that the titles of any sections / sub-sections provided herein are not limiting. Various embodiments are described throughout this document and any type of embodiment can be included under any section / sub-section. Furthermore, embodiments described in any section / sub-section can be combined with any other embodiment described in the same section / sub-section and / or a different section / sub-section in any manner.

[0019] In the description of embodiments of the present disclosure, the term "includes" and its derivatives, such as "including," should be understood in an open, inclusive sense, that is, "including, but not limited to." The term "based on" should be understood as "based at least in part on." The term "one embodiment" or "an embodiment" should be understood as "at least one embodiment." The term "some embodiments" should be understood as "at least some embodiments." Other explicitly and implicitly recited definitions can also be found in the following text. The terms "first," "second," etc. can refer to different or the same objects. Other explicit and implicit definitions can also be found in the following text.

[0020] Data of users, acquisition and / or use of data, etc. can be involved in embodiments of the present disclosure. These aspects all comply with corresponding laws and regulations and relevant provisions. In embodiments of the present disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are performed on the premise that the user is aware of and confirms. Accordingly, when implementing various embodiments of the present disclosure, the type of data or information that can be involved, the scope of use, the scenario of use, etc. should be informed to the user and authorized by the user in a proper manner according to relevant laws and regulations. The specific informing and / or authorization manner can vary according to actual situations and application scenarios, and the scope of the present disclosure is not limited in this aspect.

[0021] In the specification and embodiments of the present disclosure, if personal information processing is involved, the processing will be performed on the premise of legality (for example, obtaining the consent of the subject of personal information, or being necessary for the performance of a contract, etc.), and will be processed only within the prescribed or agreed range. The user refuses to process personal information other than the necessary information required for the basic function, which does not affect the user's use of the basic function.

[0022] Currently, the application software cannot meet the user's demand for the richness and convenience of generating media content when generating media content for the user.

[0023] Embodiments of the present disclosure provide a scheme for generating media content. According to the scheme, a media generation interface is displayed, the media generation interface includes a content display area and an information input area, the information input area includes an input component, and the input component includes a type switching control and a parameter setting control. Then, the target media type is determined through the type switching control, and a set of generation parameters is obtained through the parameter setting control. Then, in response to receiving a generation request, triggering the target generation model to generate at least one item of media content corresponding to the target media type based on the set of generation parameters. Accordingly, in the content display area of the media generation interface, a first message corresponding to the generation request is displayed, and the first message includes the generated at least one item of media content.

[0024] In this way, embodiments of the present disclosure can simplify the user's operation process for generating media content, avoid the complexity when generating media content, effectively improve the efficiency of media content generation, and improve the richness of media content, and improve the quality of the generated media content.

[0025] Additionally, embodiments of the present disclosure can reduce the demand for interface size through a unified input framework, thereby better supporting small-screen devices such as mobile devices.

[0026] Various example implementations of the scheme are described in further detail below in conjunction with the accompanying drawings.

[0027] Example Environment

[0028] FIG. 1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in FIG. 1, the example environment 100 can include an electronic device 110.

[0029] In this example environment 100, the electronic device 110 can run an application 120 that supports interface interaction. The application 120 can be any appropriate type of application for interface interaction, examples of which can include, but are not limited to, a video application, a social application, or other appropriate application. A user 140 can interact with the application 120 via the electronic device 110 and / or its attached devices.

[0030] In the environment 100 of FIG. 1, the electronic device 110 can present an interface 150 for supporting interface interaction through the application 120 if the application 120 is in an active state.

[0031] In some embodiments, the electronic device 110 communicates with the server 130 to implement provisioning of services for the application 120. The electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal including a mobile handset, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a palmtop computer, a portable gaming terminal, a VR / AR device, a Personal Communication System (PCS) device, a personal navigation device, a Personal Digital Assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an electronic book device, a game device, or any combination thereof, including an accessory or peripheral device for the foregoing, or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface for the user (such as “wearable” circuitry, etc.).

[0032] The server 130 can be a standalone physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and basic cloud computing services such as big data and artificial intelligence platforms. The server 130 may, for example, include a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, and the like. The server 130 can provide background services for the application 120 in the electronic device 110 that supports a virtual scene.

[0033] A communication connection can be established between the server 130 and the electronic device 110. The communication connection can be established by wired or wireless means. The communication connection can include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus (USB) connection, a Wireless Fidelity (WiFi) connection, and the like, and embodiments of the present disclosure are not limited in this regard. In embodiments of the present disclosure, the server 130 and the electronic device 110 can implement signaling interaction through the communication connection therebetween.

[0034] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only, and do not imply any limitation on the scope of the present disclosure.

[0035] Some example embodiments of the present disclosure will be hereinafter described with continuous reference to the drawings.

[0036] Example interactions

[0037] An example interaction process according to embodiments of the present disclosure will be described hereinafter with reference to the drawings.

[0038] FIGS. 2A-2J illustrate example interfaces 200A-200J according to some embodiments of the present disclosure. The interfaces 200A-200J can be provided by the electronic device 110 shown in FIG. 1. The interfaces 200A-200I are also referred to as media generation interfaces. Through the media generation interfaces, the electronic device 110 can generate media content by receiving operations of a user. The interface 200J is also referred to as a media viewing interface.

[0039] As shown in FIG. 2A, the interface 200A can include a content presentation region 202 and an information input region. The information input region may, for example, include an input component 206. As will be introduced hereinafter, the input component 206 can be used to obtain a set of generation parameters for generating media content.

[0040] In some embodiments, if the media generation interface is not associated with a historical generation request, the electronic device 110 can present, in the media generation interface, a plurality of entries corresponding to a plurality of media types. As shown in FIG. 2A, illustratively, when the user initially generates media content in the media generation interface, the electronic device 110 can present, in the media generation interface, entries corresponding to a plurality of media types respectively, such as an image generation entry 204-1, a video generation entry 204-2, and the like.

[0041] In some embodiments, if a selection of a target entry 204-1 of the plurality of entries is received, the electronic device 110 can associate a type switching control 208 in the input component 206 to the target media type (e.g., image) to indicate that the input component 206 corresponds to an image generation mode.

[0042] Still referring to FIG. 2A, after receiving the selection of the target entry 204-1 of the plurality of entries by the user, the electronic device 110 can present, with the switching control 208, a visual style corresponding to the target media type. This can enable the user to more accurately determine the selected target media type.

[0043] In some embodiments, as shown in FIG. 2B, if the media generation interface is associated with a historical generation request, the electronic device 110 can present, in the media generation interface 200B, a second message 210 corresponding to the historical generation request. As shown in FIG. 2B, the second message 210 can include historical media content generated based on the historical generation request.

[0044] In such embodiments, when the user is not generating the media content for the first time, but has a historical generation record, the historical media content and other messages associated therewith can be directly presented in the media generation interface without the multiple entries described above. This also facilitates the user to re-edit the historical media content. In some embodiments, an information input area is included in the media generation interface where the historical media content is located, to enable the user to input multiple generation parameters.

[0045] Further, the electronic device 110 can determine the target media type through the type switching control, and obtain a set of generation parameters through one or more parameter setting controls. For example, as shown in FIG. 2C, in the image generation mode, the electronic device 110 can obtain a set of generation parameters through the input component 206. Such generation parameters can include, but are not limited to, for example, a prompt item for describing the media generation content, a model (such as a machine learning model) for generating the media content, a model number and / or a version number, an aspect ratio of the media content display, and the like.

[0046] Further, if a generation request is received, the electronic device 110 can trigger the target generation model to generate at least one item of media content corresponding to the target media type based on the set of generation parameters.

[0047] In some embodiments, the prompt item in the set of parameters for generating image content can be reviewed. Accordingly, as shown in FIG. 2C, during the review process, the electronic device 110 can display the prompt information 210.

[0048] Further, as shown in FIG. 2D, in the content display area 202 of the media generation interface 200D, the electronic device 110 can display a message 212 corresponding to the generation request, the message 212 including the generated at least one item of media content 214. For example, the first message can also include a user identifier, a user name, at least one interactive icon associated with the at least one item of media content, and the like.

[0049] In some embodiments, after determining that the prompt item in the set of generation parameters passes the review, the electronic device 110 can display at least one image component in the message 212 of the content display area 202. If at least one image is obtained based on the set of generation parameters, the electronic device 110 can display the at least one image in the at least one image component.

[0050] Exemplarily, upon receiving the inputted prompt via the parameter setting control, the electronic device 110 can review the prompt. In another example, the electronic device 110 can send the prompt to the server 130, which can review the prompt and send the review result to the electronic device 110. If the review result is a review failure, prompt information about the review failure can be displayed in the media generation interface to remind the user to change the generation parameters. If the review result is a review pass, the electronic device 110 can display the generated at least one image component in the first message of the content display area. As an example, one image can be displayed in each image component.

[0051] Exemplarily, upon the electronic device 110 or the server 130 reviewing the prompt, the review can be specifically on whether the prompt contains non-compliant information, etc. Upon reviewing the type parameter and / or version number parameter, etc. of a model (e.g., a machine learning model) in the set of generation parameters, the review can be specifically on the availability of the model, etc. It should be understood that the review criteria for the set of generation parameters can be set according to specific scenarios, which are not limited herein.

[0052] In some embodiments, as shown in FIG. 2E, in addition to the type switching control 208, the input component 206 can further include one or more parameter setting controls, e.g., a control for inputting a prompt, a control for configuring a model version, a control for configuring a reference image, a control for configuring other generation parameters, etc.

[0053] In some embodiments, to improve the efficiency of interface interaction, the input component 206 can maintain a unified component framework when being switched to generation parameters for inputting different types of media content. Specifically, as shown in FIG. 2E, upon receiving the selection of the type switching control 208, the electronic device 110 can present the image generation entry 216 and the video generation entry 218.

[0054] Further, the electronic device 110 can receive the selection of the video generation entry 218 and can switch the input component 206 to a video generation mode. As shown in FIG. 2E, the type switching control 208 can be switched to display a graphical identifier corresponding to a video. As an example, the type switching control 208 can present different styles of graphical identifiers when the input component 206 is used to generate image content and video content.

[0055] Additionally, as shown in FIGS. 2C and 2E, the input component 206 can maintain the same plurality of parameter controls when generating different types of media content. As an example, the layout of the plurality of parameter controls in the input component 206 can remain unchanged. As another example, the type of parameters inputted by the plurality of parameter controls can remain unchanged. As yet another example, the parameters inputted in the plurality of parameter controls can also remain unchanged during the switching process.

[0056] For example, when switching from the image generation mode shown in FIG. 2C to the video generation mode shown in FIG. 2E, the prompt items inputted in the prompt item input controls in the input component 206 can remain unchanged.

[0057] In some embodiments, as shown in FIG. 2F, the electronic device 110 can display a message 220 corresponding to the generation request, and the electronic device 110 can display a video component 222 in the message 220 of the content display area. If a target video frame of the video content generated based on the set of generation parameters is obtained, the electronic device 110 can display the target video frame in the video component in a first style.

[0058] As shown in FIG. 2F, the electronic device 110 can overlay a layer of mask on the target video frame, so that the user first watches a relatively hazy video frame of the video content to be displayed. In some embodiments, the target video frame can be the first frame of the video content to be displayed. As an example, the video first frame can be returned by the server 130 to the electronic device 110.

[0059] The embodiments of the present disclosure can avoid the user's boredom during the waiting process for the video content generation by displaying the target video frame when the video content has not been generated completely, which is conducive to increasing the user stickiness. In addition, during the waiting process for the video content generation, the video content generated by the server 130 can be cached, and when the caching is completed, the video content can be displayed in the video component in the electronic device 110.

[0060] In some embodiments, before the video content generation is completed, the electronic device 110 can display a generation progress of the video content in the video component, and the generation progress is superimposed on the target video frame. Still referring to FIG. 2F, in order to enable the user to understand the generation progress of the video content, the electronic device 110 can superimpose the generation progress 224 on the target video frame.

[0061] Further, as shown in FIG. 2G, if the video content generation is completed, the electronic device 110 can display the target video frame in the video component 222 in a second style to indicate that the video content can be played via the video component 222. For example, the electronic device 110 can stop displaying the mask superimposed on the video frame.

[0062] Further, as shown in Fig. 2H, upon receiving the media content (e.g., image content or video content) generated for the above-described process, the electronic device 110 may, for example, present a window 224, and can display one or more interaction entry in the window 224, such as interaction entry 226, interaction entry 228, and interaction entry 230.

[0063] As an example, the interaction entry 226 may, for example, trigger generating new media content with the selected image as a reference image. The interaction entry 228 may, for example, trigger generating video content based on the selected image. The interaction entry 230 may, for example, be used for sharing the generated media content.

[0064] As an example, the electronic device 110 may, for example, present an edit window 232 based on the selection of the interaction entry 226 or other preset operation. The edit window 232 may, for example, be floated from the bottom of the interface 200I, and may, for example, be collapsed in a preset direction in response to a sliding operation (e.g., a downward sliding operation) of the user on the edit window 232. In this way, the embodiments of the present disclosure may, for example, further provide utilization efficiency for the interface, and improve the user’s interaction experience.

[0065] In some embodiments, such an edit window 232 may, for example, be used for further editing of the media content. Alternatively, as shown in Fig. 2I, such an edit window 232 may, for example, also be used for determining reference information according to the selected media content, for generating new media content.

[0066] As shown in Fig. 2I, the edit window 232 may, for example, provide a plurality of information acquisition controls corresponding to a plurality of preset reference information types, such as information acquisition control 236. Further, in response to the selection of the information acquisition control 236, the electronic device 110 may, for example, generate the reference information (e.g., edge contour information) corresponding to the information control 236 based on the selected media content.

[0067] In some embodiments, the electronic device 110 may, for example, also provide a viewing control 238 in the edit window 232, and may, for example, receive the selection of the viewing control 238. Further, the electronic device 110 may, for example, display an interface element 234 for indicating the reference information in the edit window 232. For example, the interface element 234 may, for example, be used for representing the edge contour information of a predetermined object in the image.

[0068] In some embodiments, upon receiving a viewing request, the electronic device 110 can display a media viewing interface 200J as shown in FIG. 2J, and display the published media contents in the media viewing interface 200J. For example, such a viewing request can include a viewing request initiated based on a proper operation of the user. In some embodiments, the media generation interface can have a media viewing entry, and the electronic device 110 can display the media viewing interface by receiving a triggering operation such as a click operation of the user on the media viewing entry. The media viewing entry can be identified by text, symbols, icons, etc. for indicating media viewing. For example, the media viewing entry can be identified by a word “Explore” or other words. In other embodiments, the electronic device 110 can display the media viewing interface based on a left swipe or right swipe operation of the user on the media generation interface, etc.

[0069] For example, the multiple media contents can include media contents published by other users. The media contents published by other users can be generated in the manner of generating media contents described in embodiments of the present disclosure.

[0070] In some embodiments, the multiple media contents can include at least one video content 240 and at least one image content 242 and 244. In the conventional manner of generating media contents, usually only one type of media content among video contents and image contents is displayed in an interface. Embodiments of the present disclosure present at least one video content and at least one image content in the media viewing interface, and can additionally present other types of media contents such as audio, etc. By presenting multiple types of media contents in the media viewing interface, the effect of rich media contents can be achieved. In this way, when recommending viewable media contents, the electronic device 110 can recommend multiple types of media contents at one time based on the same or similar theme, facilitating the selection of the user.

[0071] In some embodiments, when displaying the published multiple media contents in the media viewing interface, the electronic device 110 can display the at least one video content 240 in the media viewing interface in a first layout style, and display the at least one image content 242 and 244 in the media viewing interface in a second layout style. In some embodiments, the first layout style includes a single-column mode; and / or the second layout style includes a multi-column mode.

[0072] Exemplarily, taking the example of the plurality of horizontal cell regions included in the media viewing interface 200J, the single-column mode may, for example, display only one column of video content 240 in a certain horizontal region in the media viewing interface 200J, and the multi-column mode may, for example, display multiple columns of image content, such as image content 242 and image content 244, in another horizontal cell region in the media viewing interface. In some embodiments, the video content or image content of each column may be a work published by another user for a single time.

[0073] In the embodiments of the present disclosure, by displaying a plurality of media contents in different layout styles in the media viewing interface, the user can quickly learn the types of the media contents, which is beneficial to improving the viewing efficiency of the user on the media contents and saving the time of the user.

[0074] Based on the above-described interaction process, the embodiments of the present disclosure can simplify the operation process of the user for generating the media content, avoid the complexity in generating the media content, effectively improve the efficiency of generating the media content, and improve the richness of the media content and the quality of the generated media content.

[0075] Example process

[0076] FIG. 3 shows a flowchart of an example interaction process 300 according to some embodiments of the present disclosure. The process 300 can be implemented at the electronic device 110. The process 300 is described below with reference to FIG. 1.

[0077] As shown, at block 310, the electronic device 110 can display a media generation interface, the media generation interface including a content display region and an information input region, the information input region including an input component, the input component including a type switching control and a plurality of parameter setting controls, wherein the input component maintains to provide the same plurality of parameter controls when the type switching control switches different media types.

[0078] At block 320, the electronic device 110 can determine a target media type through the type switching control, and obtain a set of generation parameters through the plurality of parameter setting controls.

[0079] At block 330, in response to receiving a generation request, the electronic device 110 can trigger a target generation model to generate at least one item of media content corresponding to the target media type based on the set of generation parameters.

[0080] At block 340, the electronic device 110 can display a first message corresponding to the generation request in the content display region of the media generation interface, the first message including the generated at least one item of media content.

[0081] In some embodiments, the process 300 further includes: displaying, in the type switching control, a first graphical identifier corresponding to the target media type, and displaying, in the content presentation area, a second graphical identifier associated with the first message, wherein the first graphical identifier and the second graphical identifier have corresponding visual styles.

[0082] In some embodiments, the process 300 further includes: in response to the media generation interface being associated with the historical generation request, presenting, in the media generation interface, a second message corresponding to the historical generation request, the second message including historical media content generated based on the historical generation request.

[0083] In some embodiments, the process 300 further includes: in response to the media generation interface being not associated with the historical generation request, presenting, in the media generation interface, a plurality of entries corresponding to a plurality of media types; and in response to a selection of a target entry of the plurality of entries, associating the type switching control to a target media type, the target entry being associated with the target media type.

[0084] In some embodiments, the target media type is an image, and displaying, in the content presentation area of the media generation interface, the first message corresponding to the generation request includes: in response to a set of generation parameters being approved, displaying at least one image component in the first message of the content presentation area; and in response to obtaining at least one image generated based on the set of generation parameters, displaying the at least one image in the plurality of image components.

[0085] In some embodiments, the target media type is a video, and displaying, in the content presentation area of the media generation interface, the first message corresponding to the generation request includes: displaying a video component in the first message of the content presentation area; in response to obtaining a target video frame of video content generated based on the set of generation parameters, displaying the target video frame in the first style in the video component; and in response to the video content being generated, displaying the target video frame in the second style in the video component to indicate that the video content is playable via the video component.

[0086] In some embodiments, the process 300 further includes: before the video content is generated, displaying a generation progress of the video content in the video component, the generation progress being superimposed on the target video frame.

[0087] In some embodiments, the process 300 further includes: in response to a preset operation on at least one item of media content in the first message, displaying an edit window; and in response to a sliding operation on the edit window, retracting the edit window in a preset direction.

[0088] In some embodiments, the editing window includes: a first editing window for editing the at least one item of media content; or a second editing window for determining reference information from the at least one item of media content, the reference information being used to generate new media content.

[0089] In some embodiments, the second editing window includes a plurality of information obtaining controls corresponding to a plurality of preset reference information types, and the process 300 further includes: in response to selection of a target information obtaining control in the plurality of information obtaining controls, generating reference information corresponding to the target information control based on the at least one item of media content.

[0090] In some embodiments, the process 300 further includes: in response to selection of a viewing control in the second editing window, displaying an interface element for indicating the reference information in the second editing window.

[0091] In some embodiments, the process 300 further includes: in response to receiving the viewing request, displaying a media viewing interface; and displaying the published items of media content in the media viewing interface.

[0092] In some embodiments, the items of media content include at least one item of video content and at least one item of image content, and displaying the published items of media content in the media viewing interface includes: displaying the at least one item of video content in the media viewing interface in a first layout style; and displaying the at least one item of image content in the media viewing interface in a second layout style.

[0093] In some embodiments, the first layout style includes a single-column mode; and / or the second layout style includes a multi-column mode.

[0094] Example apparatus and device

[0095] Embodiments of the present disclosure also provide a corresponding apparatus for implementing the above method or process. FIG. 4 shows a schematic structural block diagram of an example interaction apparatus 400 according to certain embodiments of the present disclosure. The apparatus 400 can be implemented as or included in the electronic device 110. Various modules / components in the apparatus 400 can be implemented by hardware, software, firmware, or any combination thereof.

[0096] As shown in FIG. 4, the apparatus 400 includes an interface display module 410 configured to display a media generation interface, the media generation interface including a content display area and an information input area, the information input area including an input component, the input component including a type switching control and a parameter setting control; a media type determination module 420 configured to determine a target media type through the type switching control, and obtain a set of generation parameters through the parameter setting control; a media content generation module 430 configured to, in response to receiving a generation request, trigger a target generation model to generate at least one item of media content corresponding to the target media type based on the set of generation parameters; and a message display module 440 configured to display, in the content display area of the media generation interface, a first message corresponding to the generation request, the first message including the generated at least one item of media content.

[0097] In some embodiments, the apparatus 400 further includes a graphical identifier display module configured to display, in the type switching control, a first graphical identifier corresponding to the target media type, and display, in the content display area, a second graphical identifier associated with the first message, wherein the first graphical identifier and the second graphical identifier have corresponding visual styles.

[0098] In some embodiments, the apparatus 400 further includes a historical generation request association module configured to, in response to the media generation interface being associated with a historical generation request, present, in the media generation interface, a second message corresponding to the historical generation request, the second message including historical media content generated based on the historical generation request.

[0099] In some embodiments, the apparatus 400 further includes an entry presentation module configured to, in response to the media generation interface not being associated with a historical generation request, present, in the media generation interface, a plurality of entries corresponding to a plurality of media types; and in response to selection of a target entry in the plurality of entries, associate the type switching control to a target media type, the target entry being associated with the target media type.

[0100] In some embodiments, the target media type is an image, and the message display module 440 is further configured to, in response to the set of generation parameters passing review, display, in the first message of the content display area, at least one image component; and in response to obtaining at least one image generated based on the set of generation parameters, display the at least one image in the plurality of image components.

[0101] In some embodiments, the target media type is video, and the message display module 440 is further configured to display, in the first message of the content display area, a video component; in response to obtaining a target video frame of the video content generated based on the set of generation parameters, display the target video frame in the first style in the video component; and in response to the video content generation being completed, display the target video frame in the second style in the video component to indicate that the video content is playable via the video component.

[0102] In some embodiments, the apparatus 400 includes a generation progress display module configured to display, in the video component, a generation progress of the video content before the video content generation is completed, the generation progress being superimposed on the target video frame.

[0103] In some embodiments, the apparatus 400 includes an edit window display module configured to display, in response to a preset operation on at least one item of media content in the first message, an edit window; and in response to a sliding operation on the edit window, retract the edit window in a preset direction.

[0104] In some embodiments, the edit window includes: a first edit window for editing the at least one item of media content; or a second edit window for determining reference information based on the at least one item of media content, the reference information being used to generate new media content.

[0105] In some embodiments, the second edit window includes a plurality of information acquisition controls of a plurality of preset reference information types, and the apparatus 400 further includes a reference information generation module configured to generate, in response to a selection of a target information acquisition control of the plurality of information acquisition controls, reference information corresponding to the target information control based on the at least one item of media content.

[0106] In some embodiments, the apparatus 400 further includes an interface element display module configured to display, in response to a selection of a viewing control in the second edit window, an interface element for indicating the reference information in the second edit window.

[0107] In some embodiments, the apparatus 400 further includes a viewing interface display module configured to display, in response to receiving a viewing request, a media viewing interface; and display, in the media viewing interface, the published plurality of items of media content.

[0108] In some embodiments, the plurality of items of media content includes at least one item of video content and at least one item of image content, and the viewing interface display module is further configured to display, in the media viewing interface, the at least one item of video content in a first layout style; and display, in the media viewing interface, the at least one item of image content in a second layout style.

[0109] In some embodiments, the first layout style includes a single-column mode; and / or the second layout style includes a multi-column mode.

[0110] FIG. 5 illustrates a block diagram of an electronic device 500 in which one or more embodiments of the disclosure can be implemented. It should be understood that the electronic device 500 illustrated in FIG. 5 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. The electronic device 500 illustrated in FIG. 5 can be used to implement the electronic device 110 of FIG. 1.

[0111] As shown in FIG. 5, the electronic device 500 is in the form of a general electronic device. Components of the electronic device 500 can include, but are not limited to, one or more processors or processing units 510, a memory 520, a storage device 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. The processing unit 510 can be a real or virtual processor and is capable of executing various processing in accordance with programs stored in the memory 520. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to improve parallel processing capability of the electronic device 500.

[0112] The electronic device 500 typically includes a number of computer storage media. Such media can be any available media that is accessible by the electronic device 500 and includes both volatile and non-volatile media, removable and non-removable media. The memory 520 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read only memory (ROM), electrically erasable programmable read only memory (EEPROM), flash memory), or some combination thereof. The storage device 530 can be a removable or non-removable media and can include a machine-readable medium, such as a flash drive, a magnetic disk drive, or any other medium that can be used to store information and / or data and that can be accessed by the electronic device 500.

[0113] The electronic device 500 can further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 5, a disk drive for reading from or writing to a removable, non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable, non-volatile optical disk (e.g., a CD-ROM) can be provided. In such instances, each drive can be connected to the bus (not shown) by one or more data media interfaces. The memory 520 can include a computer program product 525 having one or more program modules configured to carry out the various methods or actions of the various embodiments of the present disclosure.

[0114] The communication unit 540 enables communication through the communication medium with other electronic devices. Additionally, the functionality of the components of the electronic device 500 can be implemented in a single computing cluster or a plurality of computer machines that are capable of communicating over a communication connection. As such, the electronic device 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0115] The input device 550 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. The output device 560 can be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 500 can also communicate with one or more external devices (not shown), such as a storage device, a display device, etc., through the communication unit 540, as necessary, with one or more devices that enable a user to interact with the electronic device 500, or with any device (e.g., a network card, a modem, etc.) that enables the electronic device 500 to communicate with one or more other electronic devices. Such communication can be carried out via an input / output (I / O) interface (not shown).

[0116] According to an example implementation of the present disclosure, there is provided a computer-readable storage medium having computer-executable instructions stored thereon, where the computer-executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, there is also provided a computer program product tangibly stored on a non-transitory computer-readable medium and including computer-executable instructions, where the computer-executable instructions are executed by a processor to implement the method described above.

[0117] Various aspects of the disclosure are now described with reference to the drawings. In general, the drawings described below are diagrammatic and schematic representations of actual or conceptual structures and processes, and are not limiting of the scope of the present disclosure. In the drawings, the same reference numerals are used to represent similar components. The embodiments of the present disclosure will be described with reference to the drawings, beginning with FIG. 1.

[0118] These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can include a non-transitory computer readable storage medium that can direct a computer, a programmable data processing apparatus, and / or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including a manufacture including instructions which implement aspects of the function / act specified in the flowchart and / or block diagram block or blocks.

[0119] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0120] The flow diagrams and the block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various implementations of the present disclosure. In this regard, each block in the flow diagrams and the block diagrams can represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logic functions (s). In some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in some cases, be executed substantially concurrently, or the blocks can sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and / or flowchart illustrations, and combinations thereof, can be implemented by a dedicated hardware-based system that performs the specified functions or acts, or combinations of hardware and software.

[0121] Having described above several implementations, the foregoing is meant to be illustrative of the various implementations of the present disclosure. The foregoing description is not meant to be exhaustive or to limit the disclosure to the precise forms disclosed. Many modifications and variations of the described implementations are possible in light of the above teachings. It was chosen to describe the principles of the disclosure in its best mode and not as an exercise of the inventor's ability to adopt concepts to the practice. The terminology used by the inventor in this disclosure has been carefully chosen to best describe the principles of the disclosure. However, the use of certain terms will not be held to a strict juridical or literal interpretation and the use of "including," "comprising" or "having" and variations thereof are meant to encompass the items listed thereafter and equivalents thereof as well as additional items.

Claims

1. A method of generating media content, comprising: displaying a media generation interface, the media generation interface comprising a content presentation area and an information input area, the information input area comprising an input component, the input component comprising a type switching control and a parameter setting control; determining, via the type switching control, a target media type, and obtaining a set of generation parameters via the parameter setting control; in response to receiving a generation request, triggering a target generation model to generate at least one item of media content corresponding to the target media type based on the set of generation parameters; and displaying, in the content presentation area of the media generation interface, a first message corresponding to the generation request, the first message comprising the generated at least one item of media content.

2. The method of claim 1, further comprising: displaying, in the type switching control, a first graphical identifier corresponding to the target media type, and displaying, in the content presentation area, a second graphical identifier associated with the first message, wherein the first graphical identifier and the second graphical identifier have corresponding visual styles.

3. The method of claim 1, further comprising: in response to the media generation interface being associated with a historical generation request, presenting, in the media generation interface, a second message corresponding to the historical generation request, the second message comprising historical media content generated based on the historical generation request.

4. The method of claim 1, further comprising: in response to the media generation interface being unassociated with a historical generation request, presenting, in the media generation interface, a plurality of entries corresponding to a plurality of media types; and in response to a selection of a target entry of the plurality of entries, associating the type switching control to the target media type, the target entry being associated with the target media type.

5. The method of claim 1, wherein the target media type is an image, and displaying, in the content presentation area of the media generation interface, a first message corresponding to the generation request comprises: in response to a review pass of a prompt item in the set of generation parameters, displaying at least one image component in the first message of the content presentation area; and in response to obtaining at least one image generated based on the set of generation parameters, displaying the at least one image in the plurality of image components.

6. The method of claim 1, wherein the target media type is a video, and displaying, in the content presentation area of the media generation interface, a first message corresponding to the generation request comprises: displaying a video component in the first message of the content presentation area; in response to obtaining a target video frame of video content generated based on the set of generation parameters, displaying the target video frame in the video component in a first style; and in response to the video content being generated, displaying the target video frame in the video component in a second style to indicate that the video content is playable via the video component.

7. The method of claim 6, further comprising: Before the video content generation is completed, a generation progress of the video content is displayed in the video component, the generation progress being superimposed on the target video frame. 8.The method of claim 1, further comprising: in response to a preset operation on the at least one item of media content in the first message, displaying an edit window; and in response to a sliding operation on the edit window, retracting the edit window in a preset direction. 9.The method of claim 8, wherein the edit window comprises: a first edit window for editing the at least one item of media content; or a second edit window for determining reference information from the at least one item of media content, the reference information being used to generate new media content. 10.The method of claim 9, wherein the second edit window comprises a plurality of information acquisition controls of a plurality of preset reference information types, the method further comprising: in response to a selection of a target information acquisition control in the plurality of information acquisition controls, generating the reference information corresponding to the target information control based on the at least one item of media content. 11.The method of claim 10, further comprising: in response to a selection of a viewing control in the second edit window, displaying an interface element for indicating the reference information in the second edit window. 12.The method of claim 1, further comprising: in response to receiving a viewing request, displaying a media viewing interface; and displaying a plurality of items of published media content in the media viewing interface. 13.The method of claim 12, wherein the plurality of items of media content comprises at least one item of video content and at least one item of image content, and displaying a plurality of items of published media content in the media viewing interface comprises: displaying the at least one item of video content in a first layout style in the media viewing interface; and displaying the at least one item of image content in a second layout style in the media viewing interface. 14.The method of claim 13, wherein the first layout style comprises a single-column mode; and / or the second layout style comprises a multi-column mode. 15.An apparatus for generating media content, comprising: an interface display module configured to display a media generation interface, the media generation interface comprising a content display region and an information input region, the information input region comprising an input component, the input component comprising a type switching control and a parameter setting control; a media type determination module configured to determine a target media type through the type switching control, and to obtain a set of generation parameters through the parameter setting control; a media content generation module configured to, in response to receiving a generation request, trigger a target generation model to generate at least one item of media content corresponding to the target media type based on the set of generation parameters; and a message display module configured to display a first message corresponding to the generation request in the content display region of the media generation interface, the first message comprising the generated at least one item of media content. 16.An electronic device, comprising: at least one processing unit; and ​ ​ ​ ​ at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions when executed by the at least one processing unit cause the electronic device to perform the method according to any one of claims 1 to 14.

17. A computer readable storage medium having stored thereon a computer program, the computer program being executable by a processor to implement the method according to any one of claims 1 to 14.

18. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 14.

Images