Media content generation method and apparatus, and device and storage medium
By displaying multiple creation entry points on electronic devices and using different generation algorithms to generate media content, the problem of low efficiency in different creation scenarios is solved, and more efficient media content creation is achieved.
Patent Information
- Application Number
- PCT/CN2025/091815
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-04-29
- Filing Date
- 2025-04-28
- Publication Date
- 2025-11-06
AI Technical Summary
In existing technologies, there is still a problem of inefficiency in generating media content for different creative scenarios on electronic devices.
By displaying multiple creation entry points in the interface and showing the corresponding creation scene interface based on the user's selection, different generation algorithms are used to generate media content associated with the creation scene, providing editing interfaces for different creation scenes in the same creation chain.
It improves the efficiency of media content creation by providing an editing interface with multiple creation scenarios, enhancing users' ability to generate media content on electronic devices.
Smart Images

Figure CN2025091815_06112025_PF_FP_ABST
Abstract
Description
Media content generation method, device, equipment and storage medium
[0001] The present application claims priority to the Chinese patent application No. 202410536079.3, filed on April 29, 2024, entitled "Media content generation method, device, equipment and storage medium", the whole content of which is incorporated herein by reference. TECHNICAL FIELD
[0002] The example embodiments of the present disclosure generally relate to the field of computer, in particular, to a media content generation method, device, equipment and computer readable storage medium. BACKGROUND
[0003] With the rapid development of intelligence, various forms of electronic devices can greatly enrich people's daily life. For example, a user can generate media content based on some electronic devices. How to generate media content is a focus problem. SUMMARY
[0004] In a first aspect of the present disclosure, a media content generation method is provided. The method comprises: displaying a plurality of creation entrances corresponding to different creation scenarios in a first interface, the plurality of creation entrances comprising at least a first creation entrance and a second creation entrance, the first creation entrance and the second creation entrance corresponding to a same creation link, the creation link indicating a flow of generating media content based on user input information; based on selection of the first creation entrance, displaying a second interface corresponding to a first creation scenario, the first creation scenario corresponding to the first creation entrance; and based on target creation information obtained via the second interface, generating target media content associated with the first creation scenario according to a first generation algorithm corresponding to the first creation entrance, wherein the first generation algorithm is different from a second generation algorithm corresponding to the second creation entrance.
[0005] In a second aspect of the present disclosure, a device for media content generation is provided. The device comprises: a first display module configured to display a plurality of creation entrances corresponding to different creation scenarios in a first interface, the plurality of creation entrances comprising at least a first creation entrance and a second creation entrance, the first creation entrance and the second creation entrance corresponding to a same creation link, the creation link indicating a flow of generating media content based on user input information; and a second display module configured to, based on selection of the first creation entrance, display a second interface corresponding to a first creation scenario, the first creation scenario corresponding to the first creation entrance; and a generation module configured to, based on target creation information obtained via the second interface, generate target media content associated with the first creation scenario according to a first generation algorithm corresponding to the first creation entrance, wherein the first generation algorithm is different from a second generation algorithm corresponding to the second creation entrance.
[0006] In a third aspect of the disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. The instructions, when executed by the at least one processing unit, cause the device to perform the method of the first aspect.
[0007] In a fourth aspect of the disclosure, a computer-readable storage medium is provided. The computer-readable storage medium has stored thereon a computer program, which is executable by a processor to implement the method of the first aspect.
[0008] It should be understood that all statements herein made regarding the content of this Background section are intended to be non-limiting and are not intended to limit the scope of the disclosure. Other aspects of the disclosure will become apparent from the following description, which is given by way of example only. BRIEF DESCRIPTION OF DRAWINGS
[0009] The above and other features, aspects and advantages of embodiments of the disclosure will become more apparent from the following detailed description, taken in conjunction with the accompanying drawings, in which like reference numerals denote like elements, and wherein:
[0010] FIG. 1 shows a schematic diagram of an example environment in which embodiments of the disclosure can be implemented;
[0011] FIGS. 2A to 2D show schematic diagrams of example interfaces according to some embodiments of the disclosure;
[0012] FIG. 3 shows a schematic diagram of an example interface according to some embodiments of the disclosure;
[0013] FIG. 4 shows a flowchart of a process of media content generation according to some embodiments of the disclosure;
[0014] FIG. 5 shows a schematic structural block diagram of an apparatus for media content generation according to certain embodiments of the disclosure;
[0015] FIG. 6 shows a block diagram of an electronic device capable of implementing a number of embodiments of the disclosure. DETAILED DESCRIPTION
[0016] Embodiments of the disclosure will be described below in greater detail with reference to the accompanying drawings. While certain embodiments of the disclosure are shown in the drawings, it is understood that the disclosure can be embodied in various forms and should not be interpreted as being limited to the embodiments set forth herein; rather, these embodiments are provided so as to more completely and thoroughly understand the disclosure. It should be understood that the drawings and embodiments of the disclosure are merely for illustrative purposes and are not intended to limit the scope of protection of the disclosure.
[0017] It should be noted that the headings provided in any section / subsection of the disclosure herein are not limitations. Various embodiments are described throughout this document and any type of embodiment can be included under any section / subsection. Furthermore, embodiments described in any section / subsection can be combined with any other embodiments described in the same section / subsection and / or different section / subsection in any manner.
[0018] In the description of embodiments of the disclosure, the term "includes" and its conjugates are open-ended, that is, "includes but is not limited to". The term "based on" is understood as "based at least in part on". The term "one embodiment" or "the embodiment" is understood as "at least one embodiment". The term "some embodiments" is understood as "at least some embodiments". Other explicit and implicit definitions can also be included below. The terms "first", "second", etc. can refer to different or the same objects. Other explicit and implicit definitions can also be included below.
[0019] Data of users, acquisition and / or use of data, etc. can be involved in embodiments of the disclosure. These aspects all comply with the corresponding laws and regulations and relevant provisions. In embodiments of the disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are carried out on the premise that the user is aware of and confirms. Accordingly, in the implementation of various embodiments of the disclosure, the type of data or information that can be involved, the scope of use, the use scenario, etc. should be notified to the user and authorized by the user according to the relevant laws and regulations through appropriate means. The specific notification and / or authorization method can vary according to the actual situation and application scenario, and the scope of the disclosure is not limited in this regard.
[0020] In the description and embodiments of the present specification, if personal information processing is involved, it will be processed on the premise of legality (for example, obtaining the consent of the subject of personal information, or being necessary for the performance of a contract, etc.), and only within the prescribed or agreed range. Users refuse to process personal information other than the necessary information required for basic functions, which will not affect the user's use of basic functions.
[0021] Embodiments of the present disclosure propose a media content generation scheme. According to the scheme, a plurality of creation entrances corresponding to different creation scenarios can be displayed in a first interface, the plurality of creation entrances at least including a first creation entrance and a second creation entrance, the first creation entrance and the second creation entrance corresponding to a same creation link, the creation link indicating a flow of generating media content based on user input information; further, based on selection of the first creation entrance, a second interface corresponding to a first creation scenario is displayed, the first creation scenario corresponding to the first creation entrance; and based on target creation information acquired via the second interface, target media content associated with the first creation scenario is generated according to a first generation algorithm corresponding to the first creation entrance, wherein the first generation algorithm is different from a second generation algorithm corresponding to the second creation entrance.
[0022] Based on such a manner, embodiments of the present disclosure can provide corresponding editing interfaces for different creation scenarios in a same creation link, thereby improving the efficiency of media content creation.
[0023] Example environment
[0024] FIG. 1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in FIG. 1, the example environment 100 can include an electronic device 110.
[0025] In the example environment 100, the electronic device 110 can run an application 120 supporting interface interaction. The application 120 can be any appropriate type of application for interface interaction. A target user 140 can generate target media content based on the application 120, where the target media content can be in the form of video, voice, text, etc. or any appropriate form of media content, etc. The target user 140 can interact with the application 120 via the electronic device 110 and / or its attached devices.
[0026] In the environment 100 of FIG. 1, if the application 120 is in an active state, the electronic device 110 can present an interface 150 for supporting interface interaction through the application 120. The interface 150 can be an interface containing creation entrances corresponding to different creation scenarios, to support that the user can select to generate target media content associated with what creation scenario based on these creation entrances. The interface 150 can also be an interface corresponding to a creation scenario corresponding to a creation entrance selected by the user, which can contain a set of controls for the user to acquire creation information in this interface, to support that the creation information is input based on the set of controls, to generate media content based on the input creation information.
[0027] In some embodiments, the electronic device 110 communicates with the server 130 to enable provisioning of services of the application 120. The electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal including a mobile handset, a tablet computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a palmtop computer, a portable gaming terminal, a VR / AR device, a Personal Communication System (PCS) terminal, a personal navigation device, a Personal Digital Assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an electronic book device, a game device, or any combination thereof, including an accessory or peripheral device for the foregoing, or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface to the user (such as “wearable” circuitry, etc.).
[0028] The server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and basic cloud computing services such as big data and artificial intelligence platforms. The server 130 may, for example, include a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, and the like. The server 130 can provide background services for the application 120 in the electronic device 110 that supports interface interaction.
[0029] A communication connection can be established between the server 130 and the electronic device 110. The communication connection can be established by wired or wireless means. The communication connection can include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus (USB) connection, a Wireless Fidelity (WiFi) connection, and the like, and embodiments of the present disclosure are not limited in this regard. In embodiments of the present disclosure, the server 130 and the electronic device 110 can implement signaling interaction through the communication connection therebetween.
[0030] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only, and do not imply any limitation on the scope of the present disclosure.
[0031] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.
[0032] Example Interaction
[0033] An example interaction process according to embodiments of the present disclosure will be described below with reference to FIGS. 2A-3. FIGS. 2A-3 illustrate example interfaces 200A-300 that can be provided by the electronic device 110 shown in FIG. 1, for example, according to some embodiments of the present disclosure.
[0034] As shown in FIG. 2A, the electronic device 110 can present an interface 200A (a first interface), for example, in which a plurality of creation entrances corresponding to different creation scenarios can be displayed. The creation scenario can be any appropriate scenario, such as a music card point scenario, an emotional chicken soup scenario, a daily Vlog (Video Blog) scenario, a novel story scenario, a knowledge popularization scenario, and the like. Taking FIG. 2A as an example, the interface 200A can display a creation entrance 210 corresponding to a music card point scenario, a creation entrance 220 corresponding to an emotional chicken soup scenario, a creation entrance 230 corresponding to a daily Vlog, a creation entrance 240 corresponding to a novel story scenario, a creation entrance 250 corresponding to a knowledge popularization scenario, and the like.
[0035] In some embodiments, the plurality of creation entrances displayed in the interface 200A can include at least a first creation entrance and a second creation entrance corresponding to the same creation link. The creation link indicates a flow of generating media content based on user input information. The creation link can include at least one of: a first creation link based on a script, a second creation link based on materials, and a third creation link based on music. The first creation link based on a script can include: determining script content based on user input information; obtaining a first set of materials matched with the script content; generating media content based on the matched first set of materials. The second creation link based on materials can include: determining a second set of materials based on user input information; generating at least one content element based on the second set of materials; generating media content based on the second set of materials and the at least one content element. The third creation link based on music can include: determining a target music effect based on user input information; obtaining a third set of materials matched with the target music effect; generating media content based on the matched third set of materials. The materials can be image materials, and can also be video materials, and the like. It should be noted that the first creation entrance and the second creation entrance are only used to represent that there are different creation entrances corresponding to the same creation link in the plurality of creation entrances displayed in the interface 200A, and do not limit the number of different creation entrances corresponding to the same creation link, i.e., the number of creation entrances corresponding to the same creation link can be two or more.
[0036] In some embodiments, each creative link can be associated with a media element. The media element can be a script element, a material element, a music element, etc. The first creative link based on script can also be a script-priority link, which indicates that the script element has a higher priority than other media elements. The second creative link based on material can also be a material-priority link, which indicates that the material element has a higher priority than other media elements. The third creative link based on music can also be a music-effect-priority link, which indicates that the music element has a higher priority than other media elements.
[0037] Taking FIG. 2A as an example, the three creative entrances corresponding to the emotional chicken soup scenario, the novel story scenario, and the knowledge popularization scenario in the interface 200A can all correspond to script-priority links. The two creative entrances corresponding to the music highlight scenario and the daily Vlog scenario can all correspond to material-priority links.
[0038] In some embodiments, the user 140 can select the first creative entrance by clicking the first creative entrance. In this case, the electronic device 110 can receive the selection of the first creative entrance and display a second interface corresponding to a first creative scenario, where the first creative scenario corresponds to the first creative entrance. The user 140 can also select the second creative entrance by clicking the second creative entrance. In this case, the electronic device 110 can receive the selection of the second creative entrance and display a third interface corresponding to a second creative scenario, where the second creative scenario corresponds to the second creative entrance. In some embodiments, the first creative scenario and the second creative scenario are used to generate media content of the same type associated with different content themes. As an example, the novel story scenario and the knowledge popularization scenario corresponding to the script-priority link are respectively used to generate media content of a novel story theme and media content of a script type of a knowledge popularization theme.
[0039] In some embodiments, the interfaces corresponding to different creation scenarios are not completely the same. For any two creation entrances corresponding to different creation links, the interfaces corresponding to the creation scenarios of the two creation entrances displayed by the electronic device 110 are not the same after the two creation entrances are selected. For any two creation entrances corresponding to the same creation link, the interfaces corresponding to the creation scenarios of the two creation entrances displayed by the electronic device 110 are also not the same after the two creation entrances are selected, i.e., the first interface and the second interface are not completely the same. As an example, the second interface corresponding to the first creation scenario includes a first set of controls for obtaining creation information, which is different from a second set of controls for obtaining creation information included in the third interface corresponding to the second creation scenario, where the first set of controls and the second set of controls are used to obtain creation information. The creation information is used to generate media content.
[0040] In some embodiments, the first set of controls includes a first control for inputting a prompt item, and the second set of controls includes a second control for inputting a prompt item. The prompt item is used to indicate what creation information is input. The first control is associated with the first recommendation entrance, and the second control is associated with the second recommendation entrance.
[0041] In some embodiments, the first recommendation entrance and the second recommendation entrance are configured to generate corresponding suggested prompt items based on different recommendation logics. The first recommendation entrance is configured to generate a suggested prompt item based on a target recommendation logic corresponding to the first creation scenario. The second recommendation entrance is configured to generate a suggested prompt item based on a recommendation logic corresponding to the second creation scenario. The target recommendation logic corresponding to the first creation scenario is not the same as the recommendation logic corresponding to the second creation scenario. As an example, the suggested prompt item can be obtained based on the creation scenario and / or user input information. The user input information can include but is not limited to material information such as images and / or videos.
[0042] FIGS. 2B-2D are schematic examples of interfaces corresponding to different creation scenarios according to some embodiments of the present disclosure. It should be understood that although FIGS. 2B-2D are described as examples, this is only exemplary.
[0043] As shown in FIG. 2B, the electronic device 110 may, for example, present the interface 200B, which can be an interface displayed after the user 140 clicks the creation entry 210 corresponding to the music card point. The interface 200B can include a set of controls 260 to support the user 140 inputting creation information based on the set of controls 260. The set of controls 260 can include a material adding control 261, an information description control 262 (a control for inputting a prompt item) corresponding to the music card point video. The user 140 can select a first target material for generating the music card point video by clicking the material adding control 261, and the first target material can be an image or a video, etc., and the first target material can be a locally saved material of the electronic device 110 or a material that can be uploaded through other appropriate means. The user 140 can also input description information of the music card point video to be generated in the information description control 262. The description information can be information of a style of the music card point video to be generated, a time length of the music card point video, etc. The interface 200B can also include a control 263 corresponding to creating the music card point video. The user 140 can click the control 263 to cause the electronic device 110 to generate the music card point video according to the target material and the description information input by the user 140 based on the set of controls 260.
[0044] As shown in FIG. 2C, the electronic device 110 may, for example, present the interface 200C, which can be an interface displayed after the user 140 clicks the creation entry 230 corresponding to the daily Vlog. The interface 200C can include a set of controls 270 to support the user 140 inputting creation information based on the set of controls 270. The set of controls 270 can include a material adding control 271, a selection control 272 corresponding to whether to use a dubbing, an information description control 273 (a control for inputting a prompt item) corresponding to the daily Vlog. The user 140 can select a second target material for generating the daily Vlog by clicking the material adding control 271, and the second target material can be an image or a video, etc., and the second target material can be a locally saved material of the electronic device 110 or a material that can be uploaded through other appropriate means. The user 140 can also select whether to use a dubbing by clicking the selection control 272 corresponding to whether to use a dubbing. The user 140 can also input description information of the daily Vlog to be generated in the information description control 273. The description information can be information of a style of the daily Vlog to be generated, information of a special effect added in the daily Vlog to be generated, etc. The interface 200C can also include a control 274 corresponding to creating the daily Vlog. The user 140 can click the control 274 to cause the electronic device 110 to generate the daily Vlog according to the creation information (e.g., the second target material, the description information of the daily Vlog to be generated, the dubbing, etc.) input by the user 140 based on the set of controls 270.
[0045] As shown in FIG. 2D, the electronic device 110 may, for example, present an interface 200D, which can be an interface displayed after the user 140 clicks the creation entry 250 corresponding to the knowledge popularization scenario. The interface 200D can include a set of controls 280 to support the user 140 inputting creation information based on the set of controls 280. The set of controls 280 can include a copy adding control 281, a selection control 282 corresponding to a visual effect, a selection control 283 corresponding to a dubbing material source, a selection control 284 corresponding to background music, and the like. The user 140 can input a target copy by clicking the copy adding control 281. The user 140 can also select a target visual effect corresponding to the knowledge popularization video to be generated by clicking the selection control 282 corresponding to the visual effect. The user 140 can also select a target dubbing material corresponding to the knowledge popularization video to be generated by clicking the selection control 283 corresponding to the dubbing material source. The user 140 can also select a target background music corresponding to the knowledge popularization video to be generated by clicking the selection control 284 corresponding to the background music. The interface 200D can also include a control 285 for creating a knowledge popularization video. The user 140 can click the control 285 to cause the electronic device 110 to generate a knowledge popularization video according to the target copy, the target visual effect, the target dubbing material, and the target background music input by the user 140 based on the set of controls 280.
[0046] In some embodiments, the electronic device 110 can generate target media content associated with the first creation scenario according to a first generation algorithm corresponding to the first creation entry based on the target creation information obtained from the second page. The electronic device 110 can also generate media content associated with the second creation scenario according to a second generation algorithm corresponding to the second creation entry based on the creation information obtained from the third page. The first generation algorithm is different from the second generation algorithm.
[0047] In some embodiments, the first generation algorithm corresponds to a first generation model, and the second generation algorithm can correspond to a second generation model. In some embodiments, the first generation model and the second generation model are trained using sample materials corresponding to different scenarios. For example, the first generation model can be trained based on sample materials in a novel story scenario, and the second generation model can be trained based on sample materials in a knowledge popularization scenario.
[0048] Referring back to FIG. 2A, the interface 200A can further include a task management entry 211 to support the user 140 to view a task management page. The task management page can present task information describing a set of tasks created based on a plurality of creation entries displayed in the interface 200A, the tasks being tasks for generating media content. The set of tasks includes a plurality of tasks executed at least partially in parallel, the plurality of tasks being associated with the same creation entry or associated with different creation entries, i.e., tasks created based on different creation entries, or at least part of the tasks created based on the same creation entry are executed in parallel, without waiting for one task to be executed before executing the next task, effectively improving the efficiency of task execution. The set of tasks includes tasks created for generating media content corresponding to various creation scenarios based on creation information obtained from interfaces corresponding to the various creation scenarios, such as the second interface, the third interface, etc. For example, the set of tasks includes a target task created for generating target media content based on target creation information obtained via the second interface.
[0049] The user 140 can click the task management entry 211 in the interface 200A, and the electronic device 110 can provide a task management interface 300. As shown in FIG. 3, the interface 300 can display task information corresponding to task 310, task information corresponding to task 320, and so on. In some embodiments, the task information indicates at least one of the following: a processing status of the corresponding task, a creation scenario corresponding to the corresponding task, a preview of media content generated by the corresponding task, and at least part of creation information corresponding to the corresponding task. The processing status of the task can include a generating state and a generated state. The interface 300 can further display a time 311 of starting to generate media content corresponding to task 310, and a time 312 of starting to generate media content corresponding to task 320.
[0050] In some embodiments, the interface 300 can display a generated text identifier or image identifier for a task that has been generated, to represent that the processing status of this task is in the generated state. Taking FIG. 3 as an example, the interface 300 can display a generated text identifier 330 for task 310, to represent that task 310 is in the generated state.
[0051] In some embodiments, the interface 300 can display a generating text identifier or image identifier for a task that is in the generating state, to represent that the processing status of this task is in the generating state. The interface 300 can further display a generation progress corresponding to the task that is in the generating state. In some embodiments, the generation progress can be displayed in the form of text, and can also be displayed in the form of a progress bar, etc. Taking FIG. 3 as an example, the interface 300 can display a progress bar 340 corresponding to task 320, and can also display a text 350 indicating that the generation progress is 78%.
[0052] As an example, FIG. 3, the interface 300 can display text or image indicating that the creation scenario corresponding to the task 310 is "emotional chicken soup scenario" and the creation scenario corresponding to the task 320 is "novel story scenario."
[0053] In some embodiments, the interface 300 can further display a cover corresponding to a generated task as a preview of the media content generated by the task. The cover can be an image. In some embodiments, the cover can be a predetermined cover for the user 140, and can also be a cover selected by the electronic device 110 from the generated media content based on predetermined rules. As an example, if the task is a task in the generated state, i.e., the media content corresponding to the task has been generated, the electronic device can select a first frame image corresponding to the media content as the cover, and can also select a highlight image in the media content as the cover, and so on. As another example, if the task is a task in the generating state, the electronic device can select a predetermined image as the cover of the task. As an example, FIG. 3, the interface 300 can display a cover 360 corresponding to the task 310 for the task 310. For the task 320, the interface 300 can display a predetermined image as the cover corresponding to the task 320, which includes a video icon in the predetermined image.
[0054] In some embodiments, the interface 300 can further display at least part of the creation information corresponding to the respective task. As an example, the interface 300 can display all of the creation information corresponding to the respective task. As another example, for the respective task in a group of tasks in the interface 300, the interface 300 can further display an indication of a target part in the target creation information corresponding to the respective task, which is determined based on the target creation scenario corresponding to the respective task. As an example, FIG. 3, the interface 300 can display the description corresponding to the task 310 and the task 320.
[0055] In some embodiments, the interface 300 associated with the task information provides management controls for managing a group of tasks, wherein the management controls include at least one of the following: a control for deleting the respective task, a control for pausing the respective task, a control for stopping the respective task, a control for re-executing the respective task.
[0056] In some embodiments, for each task displayed in the interface 300, the user 140 can perform a predetermined operation on the task, so that the electronic device 110 can display, in the interface 300, a control 380 for deleting the task in response to receiving the predetermined operation. The predetermined operation can be a sliding operation, a clicking operation, or the like on a predetermined position of the task, which will not be described herein. As an example, the predetermined operation can be a left sliding operation on the task. The user 140 can delete the task 310 by clicking the control 380 for deleting the task 310.
[0057] In some embodiments, the user 140 can also select a first task that has been completed from the group of tasks displayed in the interface 300 to view the first media content generated by the first task. For each generated task, the interface 300 can also display a viewing control of the media content corresponding to the generated task to support the user 140 to view the generated media content corresponding to the task. Taking FIG. 3 as an example, for the task 310, the interface 300 can display a viewing control 370 of the media content corresponding to the task 310. The user 140 can click the viewing control 370, and the electronic device can present a viewing window of the media content generated by the task 310, in which the media content can be displayed.
[0058] In some embodiments, the electronic device 110 can also predefine a validity period of each task, i.e., how long the task will become an expired task after being generated. In some embodiments, the validity period of each task can be set according to requirements. When the task expires, the display area corresponding to the expired task in the interface 300 can display the expired task. Taking FIG. 3 as an example, the display area corresponding to the expiration of the task in the interface 300 can display the expired task 390.
[0059] In order to facilitate the user 140 to view the situation of the group of tasks in the first interface, in some embodiments, the task management entry in the first interface can also present prompt information associated with the group of tasks. If there is generated media content, the first interface can provide first prompt information associated with the number of generated media content. Returning to FIG. 2A, the interface 200A can display the first prompt information 212 that “three media contents have been generated”. In some embodiments, if there is media content being generated, the first interface can also provide second prompt information associated with the number of media content being generated.
[0060] In order to facilitate the reminder, the interface 200A can also display a prompt element that the task in the generated state has not been viewed, which can be a text element, an image element, or a character element, etc. Taking FIG. 2A as an example, the interface 200A can display the character element 213 to prompt that there is a task in the generated state that has not been viewed.
[0061] Based on such a manner, embodiments of the present disclosure can provide corresponding editing interfaces for different creation scenarios in the same creation link, thereby improving the efficiency of media content creation.
[0062] Example process
[0063] FIG. 4 shows a flowchart of a process 400 of media content generation, according to some embodiments of the present disclosure. The process 400 can be implemented at the electronic device 110. The process 400 is described below with reference to FIG. 1.
[0064] At block 410, the electronic device 110 displays, in a first interface, a plurality of creation entrances corresponding to different creation scenarios, the plurality of creation entrances including at least a first creation entrance and a second creation entrance, the first creation entrance and the second creation entrance corresponding to a same creation link, the creation link indicating a flow of generating media content based on user input information.
[0065] At block 420, the electronic device displays, based on a selection of the first creation entrance, a second interface corresponding to a first creation scenario, the first creation scenario corresponding to the first creation entrance.
[0066] At block 430, the electronic device 110 generates, based on target creation information obtained via the second interface, target media content associated with the first creation scenario according to a first generation algorithm corresponding to the first creation entrance, wherein the first generation algorithm is different from a second generation algorithm corresponding to the second creation entrance.
[0067] In some embodiments, the creation link includes at least one of: a first creation link based on a script, including: determining script content based on the user input information; obtaining a first set of materials matching the script content; generating media content based on the matched first set of materials; a second creation link based on materials, including: determining a second set of materials based on the user input information; generating at least one content element based on the second set of materials; generating media content based on the second set of materials and the at least one content element; a third creation link based on music, including: determining a target music effect based on the user input information; obtaining a third set of materials matching the target music effect; generating media content based on the matched third set of materials.
[0068] In some embodiments, the first generation algorithm corresponds to a first generation model, the second generation algorithm corresponds to a second generation model, and the first generation model and the second generation model are trained using sample materials corresponding to different scenarios.
[0069] In some embodiments, the second creation entrance corresponds to a second creation scenario, and the first creation scenario and the second creation scenario are used to generate media content of a same type associated with different content themes.
[0070] In some embodiments, the second interface includes a first set of controls for obtaining the authoring information, the first set of controls being different from a second set of controls for obtaining the authoring information in a third interface corresponding to the second authoring portal.
[0071] In some embodiments, the first set of controls includes a first control for inputting the prompt item, the second set of controls includes a second control for inputting the prompt item, the first control is associated with the first recommendation portal, the second control is associated with the second recommendation portal, and the first recommendation portal and the second recommendation portal are configured to generate corresponding suggested prompt items based on different recommendation logic.
[0072] In some embodiments, the process 400 further includes: based on the target authoring information obtained via the second interface, creating a target task for generating target media content; and based on the received viewing request, presenting a task management interface, the task management interface presenting task information, the task information describing a set of tasks created based on the plurality of authoring portals, the set of tasks including the target task.
[0073] In some embodiments, presenting the task management interface includes: based on a selection of a task management portal in the first interface, presenting the task management interface.
[0074] In some embodiments, the task management portal presents prompt information associated with the set of tasks.
[0075] In some embodiments, the task information indicates at least one of: a processing status of a respective task; an authoring scenario corresponding to the respective task; a preview of media content generated by the respective task; at least a portion of authoring information corresponding to the respective task.
[0076] In some embodiments, the task information associated with a respective task in the set of tasks is for indicating a target portion in the corresponding target authoring information, the target portion being determined based on a target authoring scenario corresponding to the respective task.
[0077] In some embodiments, the process 400 further includes: in association with the task information, providing management controls for managing the set of tasks, wherein the management controls include at least one of: a control for deleting a respective task; a control for pausing a respective task; a control for stopping a respective task; a control for re-executing a respective task.
[0078] In some embodiments, the process 400 further includes: based on a selection of a first task in the set of tasks that has been completed, presenting a viewing window of first media content generated based on the first task.
[0079] In some embodiments, the set of tasks includes a plurality of tasks that are executed at least partially in parallel, the plurality of tasks being associated with the same authoring entry or associated with different authoring entries.
[0080] Example apparatus and device
[0081] Embodiments of the present disclosure also provide a corresponding apparatus for implementing the above method or process. FIG. 5 shows a schematic structural block diagram of an apparatus 500 for providing media content according to certain embodiments of the present disclosure. The apparatus 500 can be implemented as or included in the electronic device 110 as discussed above. Various modules / components in the apparatus 500 can be implemented by hardware, software, firmware, or any combination thereof.
[0082] As shown in FIG. 5, the apparatus 500 includes a first display module 510 configured to display a plurality of authoring entries corresponding to different authoring scenarios in a first interface, the plurality of authoring entries including at least a first authoring entry and a second authoring entry, the first authoring entry and the second authoring entry corresponding to a same authoring link, the authoring link indicating a flow for generating media content based on user input information; a second display module 520 configured to display a second interface corresponding to a first authoring scenario based on selection of the first authoring entry, the first authoring scenario corresponding to the first authoring entry; and a generation module 530 configured to generate target media content associated with the first authoring scenario according to a first generation algorithm corresponding to the first authoring entry based on target authoring information obtained via the second interface, wherein the first generation algorithm is different from a second generation algorithm corresponding to the second authoring entry.
[0083] In some embodiments, the authoring link includes at least one of: a first authoring link based on a script, including: determining script content based on the user input information; obtaining a first set of materials matching the script content; generating the media content based on the matched first set of materials; a second authoring link based on materials, including: determining a second set of materials based on the user input information; generating at least one content element based on the second set of materials; generating the media content based on the second set of materials and the at least one content element; a third authoring link based on music, including: determining a target music effect based on the user input information; obtaining a third set of materials matching the target music effect; generating the media content based on the matched third set of materials.
[0084] In some embodiments, the first generation algorithm corresponds to a first generation model, the second generation algorithm corresponds to a second generation model, and the first generation model and the second generation model are trained using sample materials corresponding to different scenarios.
[0085] In some embodiments, the second creation portal corresponds to a second creation scenario, and the first creation scenario and the second creation scenario are used to generate media content of a same type that is associated with different themes and different content themes.
[0086] In some embodiments, the second interface includes a first set of controls for obtaining the creation information, and the first set of controls is different from a second set of controls in a third interface corresponding to the second creation portal for obtaining the creation information.
[0087] In some embodiments, the first set of controls includes a first control for inputting a prompt item, and the second set of controls includes a second control for inputting the prompt item, the first control is associated with the first recommendation portal, the second control is associated with the second recommendation portal, and the first recommendation portal and the second recommendation portal are configured to generate corresponding suggested prompt items based on different recommendation logics.
[0088] In some embodiments, the apparatus 500 further includes a creating module configured to create, based on the target creation information obtained via the second interface, a target task for generating target media content; and a first presenting module configured to present, based on the received viewing request, a task management interface, the task management interface presenting task information, the task information describing a set of tasks created based on the plurality of creation portals, the set of tasks including the target task.
[0089] In some embodiments, presenting the task management interface includes presenting the task management interface based on a selection of a task management portal in the first interface.
[0090] In some embodiments, the task management portal presents prompt information associated with the set of tasks.
[0091] In some embodiments, the task information indicates at least one of: a processing status of a corresponding task; a creation scenario corresponding to the corresponding task; a preview of media content generated by the corresponding task; and at least part of the creation information corresponding to the corresponding task.
[0092] In some embodiments, the task information associated with a corresponding task in the set of tasks is used to indicate a target part in the corresponding target creation information, the target part being determined based on a target creation scenario corresponding to the corresponding task.
[0093] In some embodiments, the apparatus 500 further includes a providing module configured to provide, in association with the task information, a management control for managing the set of tasks, wherein the management control includes at least one of: a control for deleting a corresponding task; a control for pausing a corresponding task; a control for stopping a corresponding task; and a control for re-executing a corresponding task.
[0094] In some embodiments, the apparatus 500 further includes a second presentation module configured to present, based on the selection of the first task that has been completed from the set of tasks, a viewing window of the first media content generated based on the first task.
[0095] In some embodiments, the set of tasks includes a plurality of tasks that are executed at least partially in parallel, the plurality of tasks being associated with a same authoring portal or associated with different authoring portals.
[0096] The units included in the apparatus 500 can be implemented by various means, including software, hardware, firmware, or any combination of these. In some embodiments, one or more units can be implemented using software and / or firmware, e.g., machine-executable instructions stored on a storage medium. In addition to or alternatively, some or all of the units of the apparatus 500 can be implemented at least partially by one or more hardware logic components. As an example and not by way of limitation, example types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SOCs), complex programmable logic devices (CPLDs), etc.
[0097] FIG. 6 shows a block diagram of an electronic device 600 in which one or more embodiments of the disclosure can be implemented. It should be understood that the electronic device 600 illustrated in FIG. 6 is merely an example and should not be construed to limit the functionality and scope of the embodiments described herein. The electronic device 600 illustrated in FIG. 6 can be used to implement the electronic device 110 illustrated in FIG. 1.
[0098] As shown in FIG. 6, the electronic device 600 is in the form of a general electronic device. Components of the electronic device 600 can include, but are not limited to, one or more processors or processing units 610, a memory 620, a storage device 630, one or more communication units 640, one or more input devices 650, and one or more output devices 660. The processing unit 610 can be a real or virtual processor and is capable of executing various processing according to programs stored in the memory 620. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capability of the electronic device 600.
[0099] The electronic device 600 typically includes a plurality of computer storage media. Such media can be any available media that is accessible by the electronic device 600 and includes both volatile and nonvolatile media, removable and non-removable media. The memory 620 can be volatile (such as register, cache, RAM), non-volatile (such as ROM, EEPROM, flash memory), or some combination of the two. The storage device 630 can be a removable or non-removable media, and can include machine-readable media, such as flash drives, magnetic disks, or any other media that can be used to store information and / or data (e.g., training data for training) and that can be accessed by the electronic device 600.
[0100] The electronic device 600 can further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 6, a disk drive for reading from or writing to a removable, non- volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable, non-volatile optical disk (e.g., a CD-ROM) can be provided. In such instances, each drive can be connected to the bus (not shown) by one or more data media interfaces. The memory 620 can include a computer program product 625 having one or more program modules configured to carry out the various methods or actions of the various embodiments of the present disclosure.
[0101] The communication unit 640 enables communications with other electronic devices over a communication medium. Additionally, the functionality of the components of the electronic device 600 can be implemented in a single computing cluster or a plurality of computer machines that are capable of communicating with one another over a communication connection. As such, the electronic device 600 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network nodes in the networking environment.
[0102] The input device 650 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. The output device 660 can be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 600 can also communicate with one or more external devices (not shown) such as a storage device, a display device, etc. through the communication unit 640, as needed, one or more devices that enable a user to interact with the electronic device 600, or any devices (e.g., a network card, a modem, etc.) that enable the electronic device 600 to communicate with one or more other electronic devices. Such communication can be carried out via an input / output (I / O) interface (not shown).
[0103] According to an example implementation of the present disclosure, a computer readable storage medium is provided having computer executable instructions stored thereon, where the computer executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, a computer program product is also provided that is tangibly stored on a non-transitory computer readable medium and includes computer executable instructions, where the computer executable instructions are executed by a processor to implement the method described above.
[0104] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.
[0105] These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can include a non-transitory computer readable storage medium. The instructions stored on the computer readable storage medium can be used to program a computer, a programmable data processing apparatus, and / or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.
[0106] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.
[0107] The computer program product of the present disclosure can have a signal including said computer program. This signal can be electronic, electromagnetic, optical, or any other suitable type of signal. Such a signal can be provided through a communication connection, such as electrical wiring, optical fiber, wireless interface, etc. Examples of computer program products include computer program implemented on a personal computer, server, or other networked device. A non-transitory computer readable medium, such as a floppy disk, CD-ROM, DVD-ROM, Blu-ray Disc, hard disk, or memory stick, can also be used to implement the present disclosure. The computer program product of the present disclosure can also be provided as a service to download and use the computer program over a network, such as the Internet.
[0108] Having described several implementations of the present disclosure, it will be clear to those skilled in the art that many modifications, additions, and substitutions are possible without departing from the scope and spirit of the described implementations. Many modifications and variations of the present disclosure are possible in light of the above teachings. It is, therefore, to be understood that within the scope of the appended claims, the present disclosure can be practiced otherwise than as specifically described. While the present disclosure has been described with reference to the implementation figures, it will be understood by those skilled in the art that various changes can be made and equivalents can be substituted for elements thereof without departing from the scope of the present disclosure. In addition, many modifications can be made to adapt to a particular situation and the teachings of the present disclosure to a specific implementation, without departing from the central novel teachings of the application. The implementation(s) illustrated and described herein are meant only to serve as examples. Departures in form and detail are within the scope of the disclosure. Therefore, one skilled in the art can restructure the implementation(s) as needed, while still adhering to the principles of the present disclosure.
Claims
1. A method for generating media content, comprising: displaying, in a first interface, a plurality of creation portals corresponding to different creation scenarios, the plurality of creation portals comprising at least a first creation portal and a second creation portal, the first creation portal and the second creation portal corresponding to a same creation link, the creation link indicating a flow for generating media content based on user input information; based on a selection of the first creation portal, displaying a second interface corresponding to a first creation scenario, the first creation scenario corresponding to the first creation portal; and based on target creation information obtained via the second interface, generating target media content associated with the first creation scenario according to a first generation algorithm corresponding to the first creation portal, wherein the first generation algorithm is different from a second generation algorithm corresponding to the second creation portal.
2. The method of claim 1, wherein the creation link comprises at least one of: determining script content based on user input information; The first creative link based on the script includes: obtaining a first set of assets matching the script content; generating media content based on the matched first set of assets; a second creation link based on assets, comprising: determining a second set of assets based on user input information; generating at least one content element based on the second set of assets; generating media content based on the second set of assets and the at least one content element; a third creation link based on music, comprising: determining a target music effect based on user input information; obtaining a third set of assets matching the target music effect; generating media content based on the matched third set of assets.
3. The method of claim 1, wherein the first generation algorithm corresponds to a first generation model, the second generation algorithm corresponds to a second generation model, and the first generation model and the second generation model are trained using sample assets corresponding to different scenarios.
4. The method of claim 1, wherein the second creation portal corresponds to a second creation scenario, the first creation scenario and the second creation scenario are used to generate media content of a same type associated with different content themes.
5. The method of claim 1, wherein the second interface comprises a first set of controls for obtaining creation information, the first set of controls being different from a second set of controls for obtaining creation information in a third interface corresponding to the second creation portal.
6. The method of claim 5, wherein the first set of controls comprises a first control for inputting a prompt item, the second set of controls comprises a second control for inputting a prompt item, the first control is associated with a first recommendation portal, the second control is associated with a second recommendation portal, and the first recommendation portal and the second recommendation portal are configured to generate corresponding suggested prompt items based on different recommendation logics.
7. The method of claim 1, further comprising: based on the target creation information obtained via the second interface, creating a target task for generating the target media content; and based on the received view request, presenting a task management interface, the task management interface presenting task information, the task information describing a set of tasks created based on the plurality of authoring portals, the set of tasks including the target task. 8.The method of claim 7, wherein presenting the task management interface comprises: based on a selection of a task management portal in the first interface, presenting the task management interface. 9.The method of claim 8, wherein the task management portal presents prompt information associated with the set of tasks. 10.The method of claim 7, wherein the task information indicates at least one of: a processing status of a respective task; an authoring scenario corresponding to a respective task; a preview of media content generated by a respective task; at least a portion of authoring information corresponding to a respective task. 11.The method of claim 10, wherein the task information associated with a respective task in the set of tasks is configured to indicate a target portion in corresponding target authoring information, the target portion being determined based on a target authoring scenario corresponding to the respective task. 12.The method of claim 7, further comprising: in association with the task information, providing management controls for managing the set of tasks, wherein the management controls comprise at least one of: a control for deleting a respective task; a control for pausing a respective task; a control for stopping a respective task; a control for re-executing a respective task. 13.The method of claim 7, further comprising: based on a selection of a first task in the set of tasks that has been completed, presenting a view window of first media content generated based on the first task. 14.The method of claim 7, wherein the set of tasks comprises a plurality of tasks executed at least partially in parallel, the plurality of tasks being associated with a same authoring portal or associated with different authoring portals. 15.An apparatus for media content generation, comprising: a first display module configured to display a plurality of authoring portals corresponding to different authoring scenarios in a first interface, the plurality of authoring portals comprising at least a first authoring portal and a second authoring portal, the first authoring portal and the second authoring portal corresponding to a same authoring link, the authoring link indicating a flow of generating media content based on user input information; a second display module configured to, based on a selection of the first authoring portal, display a second interface corresponding to a first authoring scenario, the first authoring scenario corresponding to the first authoring portal; and a generation module configured to, based on target authoring information obtained via the second interface, generate target media content associated with the first authoring scenario according to a first generation algorithm corresponding to the first authoring portal, wherein the first generation algorithm is different from a second generation algorithm corresponding to the second authoring portal. 16.An electronic device, comprising: at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions when executed by the at least one processing unit cause the electronic device to perform the method according to any one of claims 1 to 14.
17. A computer readable storage medium having stored thereon a computer program, the computer program being executed by a processor to implement the method according to any one of claims 1 to 14.
Citation Information
Patent Citations
Method and device for synthesizing video file by mobile terminal
CN105657538A
Video generation method and device, electronic equipment and storage medium
CN112866796A
Video production method and device, electronic equipment and storage medium
CN113923515A
Editing template searching method and device
CN115269889A
Image processing method and device and readable storage medium
CN115546855A