Content generation method, device, electronic device, storage medium and program product

Abstract

The present disclosure relates to a content generation method, device, electronic device, storage medium and program product, and relates to the field of computer technology. The content generation method of the present disclosure includes: generating first generated content according to the first information in response to a user inputting first information; displaying the first generated content; determining a generation function recommended to the user according to the first generated content and its type, wherein the generation function is used to continue to generate second generated content based on the first generated content, and different types of second generated content correspond to different generation functions; and displaying relevant information of the generation function.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a content generation method, device, electronic device, storage medium and program product. Background Art

[0002] Generative Artificial Intelligence is a new type of artificial intelligence that can generate original content for users based on large amounts of data.

[0003] Users can interact with applications based on generative artificial intelligence technology and input their demand information. The applications can then use generative artificial intelligence technology to generate corresponding content based on the demand information. Summary of the invention

[0004] This summary is provided to introduce concepts in a brief form that will be described in detail in the detailed description below. This summary is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0005] According to some embodiments of the present disclosure, a content generation method is provided, including: in response to a user inputting first information, generating first generative content according to the first information; displaying the first generative content; determining a generation function recommended to the user according to the first generative content and its type, wherein the generation function is used to continue to generate second generative content based on the first generative content, and different types of second generative content correspond to different generation functions; and displaying relevant information of the generation function.

[0006] According to some other embodiments of the present disclosure, there is provided a content generating device, comprising: a first generating module, configured to generate first generated content in response to first information input by a user and according to the first information; a first display module, configured to display the first generated content; a determining module, configured to determine a generating function recommended to the user according to the first generated content and its type, wherein the generating function is used to continue to generate second generated content based on the first generated content, and different generating functions correspond to different types of the second generated content; and a second display module, configured to display relevant information of the generating function.

[0007] According to some further embodiments of the present disclosure, an electronic device is provided, including: a processor; and a memory coupled to the processor, for storing instructions, which, when executed by the processor, causes the processor to execute the content generation method of any embodiment of the present disclosure.

[0008] According to some further embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, wherein when the program is executed by a processor, the content generating method of any embodiment of the present disclosure is implemented.

[0009] According to still some embodiments of the present disclosure, a computer program product is provided, comprising instructions, which, when executed by a processor, cause the processor to execute the content generating method according to any embodiment of the present disclosure.

[0010] Other features and advantages of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The preferred embodiments of the present disclosure are described below with reference to the accompanying drawings. The drawings described herein are used to provide a further understanding of the present disclosure. Each of the drawings together with the following detailed description is included in this specification and forms a part of the specification, and is used to explain the present disclosure. It should be understood that the drawings described below only relate to some embodiments of the present disclosure and do not constitute a limitation on the present disclosure. In the drawings:

[0012] Figure 1 A schematic diagram showing a flow chart of a content generation method according to some embodiments of the present disclosure;

[0013] Figure 2 A schematic diagram showing an interactive interface in some embodiments of the present disclosure;

[0014] Figure 3 Schematic diagrams showing interaction interfaces in other embodiments of the present disclosure;

[0015] Figure 4 Schematic diagrams showing interaction interfaces in some other embodiments of the present disclosure;

[0016] Figure 5 A schematic diagram showing an interactive interface in some embodiments of the present disclosure;

[0017] Figure 6 Schematic diagrams showing interaction interfaces in some other embodiments of the present disclosure;

[0018] Figure 7 A schematic diagram showing the structure of a content generating device according to some embodiments of the present disclosure;

[0019] Figure 8 A schematic diagram showing the structure of an electronic device according to some embodiments of the present disclosure;

[0020] Fig. 9 A schematic diagram showing the structure of a computer system according to some embodiments of the present disclosure.

[0021] It should be understood that, for ease of description, the sizes of the various parts shown in the drawings are not necessarily drawn according to the actual proportional relationship. The same or similar reference numerals are used in the various drawings to represent the same or similar parts. Therefore, once an item is defined in one drawing, it may not be further discussed in subsequent drawings. DETAILED DESCRIPTION

[0022] The following will be combined with the drawings in the embodiments of the present disclosure to clearly and completely describe the technical solutions in the embodiments of the present disclosure, but it is obvious that the described embodiments are only part of the embodiments of the present disclosure, rather than all the embodiments. The following description of the embodiments is actually only illustrative and is by no means intended to limit the present disclosure and its application or use. It should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein.

[0023] It should be understood that the various steps recorded in the method embodiments of the present disclosure can be performed in different orders, and / or performed in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown in the execution. The scope of the present disclosure is not limited in this respect. Unless otherwise specifically stated, the relative arrangement, numerical expressions and numerical values ​​of the parts and steps set forth in these embodiments should be interpreted as being merely exemplary and do not limit the scope of the present disclosure.

[0024] The term "include" and its variations used in the present disclosure mean an open term that includes at least the following elements / features but does not exclude other elements / features, that is, "including but not limited to". In addition, the term "include" and its variations used in the present disclosure mean an open term that includes at least the following elements / features but does not exclude other elements / features, that is, "including but not limited to". Therefore, include is synonymous with include. The term "based on" means "based at least in part on".

[0025] References throughout this specification to "one embodiment," "some embodiments," or "an embodiment" mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. For example, the term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; and the term "some embodiments" means "at least some embodiments." Furthermore, the appearances of the phrases "in one embodiment," "in some embodiments," or "in an embodiment" in various places throughout this specification do not necessarily all refer to the same embodiment, but may do so.

[0026] It should be noted that the concepts of "first", "second", etc. mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units. Unless otherwise specified, the concepts of "first", "second", etc. are not intended to imply that the objects described in this way must be in a given order in time, space, ranking, or any other manner.

[0027] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0028] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0029] The embodiments of the present disclosure are described in detail below in conjunction with the accompanying drawings, but the present disclosure is not limited to these specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. In addition, in one or more embodiments, specific features, structures or characteristics can be combined in any suitable manner that will be clear from the present disclosure by a person of ordinary skill in the art.

[0030] Generative AI can usually only generate generative content corresponding to the demand information currently input by the user. If the user wants the generative AI to further generate other content based on the currently generated content, it is necessary to further input information expressing this intention through human-computer interaction.

[0031] In order to better inspire the creative inspiration of users, enable users to use generative artificial intelligence to generate more complex and diverse works, and make generative artificial intelligence more effectively used, the present disclosure proposes a content generation method, which can generate first generative content according to first information input by the user, and then recommend to the user a generation function of continuing to generate second generative content based on the first generative content and its type, thereby guiding the user to continue to generate content using generative artificial intelligence. Figures 1 to 6 Some embodiments of the content generation method of the present disclosure are described.

[0032] The content generation method of the disclosed embodiment can be performed by a content generation device, and the content generation device can be implemented in hardware and / or software. For example, the content generation device is an agent, a robot, an interactive application, etc. The user can have a human-computer dialogue with the content generation device. For example, the user can use oral natural language input (i.e., speech) to provide commands and / or requests to the content generation device, which in some cases can be converted into text and then processed, and / or by providing text (e.g., typing) natural language input.

[0033] The content generation device may have a generation function based on generative artificial intelligence technology. For example, the content generation device may be configured with a corresponding generative model, or it may cooperate with other intelligent tools with generation functions to provide users with generation functions during the interaction process. The present disclosure does not impose any restrictions on this.

[0034] Figure 1 Flowcharts of some embodiments of the method for generating content of the present disclosure. Figure 1 As shown, the method of this embodiment includes: steps S102 to S108.

[0035] In step S102, in response to a user inputting first information, first generative content is generated according to the first information.

[0036] For example, an interactive interface corresponding to the user can be displayed in the content generation device, and the user can input the first information in various forms such as voice and text, which are not limited here. After the user inputs the first information, the first information can be displayed in the interactive interface. The first information can include the type of the first generative content, and can also include some descriptive information of the first generative content. For example, the first information is "Please help me generate a poem describing a beautiful woman." The generative model can be called to generate the first generative content based on the first information.

[0037] In step S104, the first generated content is displayed.

[0038] The first generated content can be displayed in the interactive interface, or in a floating layer, window, panel or other page form, which is not limited here. The display style of the first generated content can be determined according to the type of the first generated content.

[0039] In step S106, a generation function recommended to the user is determined according to the first generation content and its type.

[0040] The generation function is used to continue to generate second generative content based on the first generative content, and different types of second generative content correspond to different generation functions. The type of the second generative content can be different from the type of the first generative content, and the type can include media type (e.g., text, image, audio, video), and can also include genre (e.g., poetry, prose, story, etc.), without being limited to the examples given.

[0041] Based on the first generative content and its type, the type of the second generative content that is more suitable for continued generation based on the first generative content can be determined, so that the generative function recommended to the user can be more in line with the user's intention, can better inspire the user's further creative inspiration, and promote the effective use of the generative function.

[0042] In step S108, relevant information of the generation function is displayed.

[0043] The control of the generation function, the recommended information of the generation function, etc. can be displayed, which is not limited to the examples given. The relevant information of the generation function can be displayed in the interactive interface, or in the form of a floating layer, window, panel or other page, which is not limited here.

[0044] The content generation method of the above embodiment, in response to the user inputting the first information, generates and displays the first generative content according to the first information, and then automatically recommends to the user a generation function that can continue to generate the second generative content based on the first generative content and its type, and displays the relevant information of the generation function. The user can continue to create according to the generation function, which provides a convenient way for the user to create continuously and improves the efficiency of the user to create continuously using the generation function. And according to the first generative content and its type, it can be determined that the type of the second generative content that is more suitable for continued generation based on the first generative content, so that the generation function recommended to the user can be more in line with the user's intention, can better inspire the user's inspiration for further creation, and promote the effective use of the generation function.

[0045] Combine the following Figure 2 The interactive interface describes some embodiments of how to display information in the content generation method of the above embodiment.

[0046] like Figure 2The interactive interface between the user and agent A is shown. The user inputs the first information 201 "Please help me generate a poem describing a beautiful woman". The generated first generative content 202 "A Beautiful Woman Like a Painting", which is a poem describing a beautiful woman, can be displayed in the interactive interface. Furthermore, the interactive interface can further display the relevant information 203 of the generation function for continuing to generate the second generative content based on the first generative content "Based on this poem, help me generate a picture". The user can further use the generation function to create according to the relevant information of the generation function.

[0047] like Figure 2 As shown, one or more auxiliary operation controls 204 may also be displayed for the first generated content, for example, one or more of a copy control, a voice playback control, a forwarding control, and a regeneration control. In response to the user's triggering operation on the copy control, the first generated content may be copied, and the user may paste the copied content into other interfaces or applications. In response to the user's triggering operation on the voice playback control, the voice corresponding to the first generated content is played. In response to the user's triggering operation on the forwarding control, the first generated content may be forwarded through one or more channels. In response to the user's triggering operation on the regeneration control, the first generated content is regenerated based on the first information.

[0048] During the interaction process with the user, the content generating device can automatically recommend to the user a generating function for continuing to generate the second generating content, which facilitates the user's operation and can improve the user's utilization rate of the generating function.

[0049] The following describes how to determine the generation function recommended to the user in detail in conjunction with some embodiments.

[0050] In some embodiments, semantic information of a first generative content is identified; based on the semantic information, a first type that matches the semantic information is determined; a second type that matches the type of the first generative content is determined; based on the first type and the second type, a type of a second generative content is determined; and based on the type of the second generative content, a generative function recommended to the user is determined.

[0051] By understanding the semantics of the first generative content, the first type that matches the semantic information can be determined. For example, at least one of the theme and style of the first generative content can be determined based on the semantic information, and the first type that matches at least one of the theme and style can be determined. For example, themes related to beautiful women are more matched with types such as pictures, and themes related to fairy tales may be more matched with types such as picture books and animations. For example, classical style is more matched with types such as classical music, and abstract style is more matched with types such as images.

[0052] A machine learning model may be used to perform semantic understanding on the first generative content, thereby determining a first type that matches the semantic information.

[0053] According to the type of the first generated content, a second type matching the type of the first generated content can be determined. For example, a matching relationship between different types can be preconfigured, and the second type matching the type of the first generated content can be determined according to the matching relationship.

[0054] When the first type and the second type are determined, the intersection or union of the first type and the second type may be determined as the type of the second generative content. Further, the generated function recommended to the user is determined according to the type of the second generative content.

[0055] Compared with randomly or fixedly recommending one or more types of generation functions to users, the method of the above embodiment determines the type of the second generation content according to the semantic information and type of the first generation content, thereby determining the generation function recommended to the user, which is more in line with the user's intention and needs to continuously generate multiple contents, thereby making the recommended generation function more accurate and appropriate, and improving the utilization rate and effectiveness of the generation function.

[0056] After the relevant information of the recommended generation function is displayed to the user, the user may trigger the generation function to generate the second generation content. The method of generating the second generation content is described below in conjunction with some embodiments.

[0057] In some embodiments, in response to a user triggering operation on a generation function, second generative content is generated according to types of the first generative content and the second generative content; and the second generative content is displayed.

[0058] For example, the relevant information of the generation function includes a control of the generation function, and in response to a user triggering operation on the control of the generation function, the second generation content is generated according to the types of the first generation content and the second generation content; and the second generation content is displayed.

[0059] like Figure 2 As shown, the relevant information 203 of the generation function can be a control of the generation function, on which the relevant description information of the generation function "help me generate a picture based on this poem" is displayed. The user's triggering operation on the control of the generation function is, for example, a click or the like, and in response to the triggering operation, the second generation content can be displayed in the interactive interface. The second generation content can also be displayed in an interface in the form of a new page, a floating layer, a panel, a window, etc. in response to the triggering operation, which is not limited here.

[0060] The relevant information of the generation function may be recommendation information of the generation function, for example, recommendation information of the generation function sent by the agent to the user and displayed in the interactive interface. The user may trigger the generation function through the recommendation information, for example, confirming and replying to the recommendation information, clicking on the recommendation information, etc., without limitation to the examples given.

[0061] In some embodiments, in response to a user's triggering operation on a generation function, an interactive interface of an intelligent agent corresponding to the generation function is displayed, and a generation instruction corresponding to the generation function is displayed in the interactive interface; in response to a user's sending operation on the generation instruction corresponding to the generation function, a second generation content is generated and displayed according to the types of the first generation content and the second generation content.

[0062] In the case where the generating function and the currently interacting intelligent agent belong to different intelligent agents (or intelligent tools), in response to the triggering of the generating function, the interactive interface of the intelligent tool corresponding to the generating function is displayed, and the generating instruction (or prompt information) corresponding to the generating function can be displayed in the interactive interface as the generating instruction input by the user. In response to the sending operation of the user, it can be used as the generating instruction of the user, and the second generating content is generated according to the generating instruction.

[0063] In some embodiments, in response to a user's triggering operation on a generation function, prompt information corresponding to the generation function is displayed, and in response to a user's confirmation operation on the prompt information corresponding to the generation function, second generation content is generated and displayed according to the types of the first generation content and the second generation content.

[0064] In response to the triggering of the generation function, a prompt message (Prompt) corresponding to the generation function may be displayed. The prompt message may be displayed in the input display area of ​​the interactive interface, and in response to the user's confirmation operation (or sending operation), it may be used as the user's generation instruction to generate the second generation content according to the prompt message.

[0065] The display form of the relevant information of the generation function and the specific form of the user's triggering operation can be set according to actual needs and are not limited to the above examples.

[0066] In some embodiments, generating the second generative content according to the types of the first generative content and the second generative content includes: determining a style corresponding to the first generative content according to the first generative content; generating first prompt information according to the first generative content and the style corresponding to the first generative content; calling a machine learning model corresponding to the type of the second generative content, and generating the second generative content according to the first prompt information.

[0067] Since the second generative content is generated based on the first generative content, the styles of the two should be consistent. Therefore, the style of the first generative content can be determined first, and then the first prompt information can be generated based on the first generative content and its style to improve the accuracy of the second generative content. For example, the first generative content is a poem describing a beautiful woman, and the style of the poem is Chinese style. The first prompt information can be "Help me generate music: quiet, Chinese style, lyrics are...". The first prompt information can also include feature description information of the second generative content, such as the sound characteristics of the music, the picture characteristics of the image, and other description information, not limited to the examples given.

[0068] Different machine learning models can be used to generate different types of content. The machine learning model is a generative model, and the second generative content can be generated according to the first prompt information. The first prompt information can be displayed, for example, the first prompt information is displayed in the input display area, and in response to the user's confirmation operation (or sending operation) of the first prompt information, the machine learning model corresponding to the type of the second generative content is called, and the second generative content is generated according to the first prompt information. In response to the user's modification operation of the first prompt information, the modified first prompt information is displayed, and in response to the user's confirmation operation of the modified first prompt information, the machine learning model corresponding to the type of the second generative content is called, and the second generative content is generated according to the first prompt information. By displaying the first prompt information and allowing the user to modify the first prompt information, the accuracy of the generated second generative content can be improved to meet the needs of the user.

[0069] The method of the above embodiment, in response to the user triggering the generation function, automatically continues to generate the second generative content based on the first generative content, without requiring the user to perform too many operations, thereby improving the efficiency of the user's continuous creation.

[0070] Combine the following Figure 3 Describe some embodiments of the interactive interface after the user triggers the generation function. For example, the user clicks Figure 2 Related information of the generation function 203 "Based on this poem, help me generate a picture", can be displayed Figure 3 In the interactive interface in the interactive interface, the prompt information 301 can be directly displayed in the interactive area of ​​the interactive interface as the generation instruction sent by the user. The prompt information can also be displayed in the input display area 303, and the user can modify the prompt information. In response to the user's confirmation operation (send operation), the prompt information 301 is displayed in the interactive area. Then, the picture (second generated content) 302 generated according to the prompt information 301 is displayed. There can be multiple pictures, and multiple pictures can support sliding switching display. It is also possible not to display the prompt information 301 and directly display the generated picture 302.

[0071] like Figure 3 As shown, a regeneration control 304 and / or a control 305 for a continue generation function may also be displayed. In response to a user triggering operation on the regeneration control 304, a regenerated picture is displayed. In response to a user triggering operation on the control 305 for a continue generation function, a third generative content is further generated. The specific generation and display methods may refer to the aforementioned embodiments, which will not be described in detail here.

[0072] In order to make the generated second generative content more accurate, a configuration function may be provided for the user. Based on the first generative content, the user may further configure reference information for generating the second generative content, which is described below in conjunction with some embodiments.

[0073] In some embodiments, in response to a second user operation on a control of the generate function, one or more configuration controls associated with the generate function are displayed, wherein the one or more configuration controls are used to configure reference information for generating the second generative content.

[0074] The second operation is, for example, an operation such as clicking, and in response to the second operation, one or more configuration controls associated with the generation function can be displayed in an interactive interface, a new page, a floating layer, a panel, a window, or any other form of interface. The user can configure reference information of different aspects of the second generative content through different configuration controls. For example, one or more configuration controls include: a configuration control of a template, a template selection control, a style configuration control, an upload control, a feature addition control, and one or more configuration controls corresponding to the type of the second generative content. For example, in the case where the type of the second generative content includes an image (image, video, or picture book, etc.), the configuration control corresponding to the type of the second generative content includes at least one of a special effect addition control and a size configuration control. For example, in the case where the type of the second generative content includes audio (audio, video, or audiobook, etc.), the configuration control corresponding to the type of the second generative content includes at least one of a sound selection control and a lyrics configuration control. According to the type of the second generative content, one or more configuration controls corresponding to the type can be displayed.

[0075] In some embodiments, in response to a user's operation on a target configuration control in one or more configuration controls, target reference information of the configuration is obtained; in response to a user's confirmation operation on generating a second generative content, the second generative content is generated according to the types of the first generative content and the second generative content and the target reference information.

[0076] There may be one or more target configuration controls, and there may be one or more target reference information. The second generative content may be generated more accurately by combining the target reference information configured by the user with the types of the first generative content and the second generative content.

[0077] Specifically, in some embodiments, second prompt information is generated based on the first generative content and the target reference information; a machine learning model corresponding to the type of the second generative content is called to generate the second generative content based on the second prompt information.

[0078] The second prompt information may include target reference information. For example, if the target reference information is the style information of the picture configured by the user, the second prompt information may include the style information. The second prompt information may be displayed, for example, the second prompt information is displayed in the input display area. In response to the user's confirmation operation (or sending operation) on the second prompt information, the machine learning model corresponding to the type of the second generative content is called, and the second generative content is generated according to the second prompt information. In response to the user's modification operation on the second prompt information, the modified second prompt information is displayed. In response to the user's confirmation operation on the modified second prompt information, the machine learning model corresponding to the type of the second generative content is called, and the second generative content is generated according to the second prompt information.

[0079] The specific form and function of the target configuration control and the method of obtaining target reference information are described below in conjunction with some embodiments.

[0080] In some embodiments, the target configuration control includes a configuration control or a template selection control for a first target template, and in response to a user operation on the configuration control of the first target template, the first target template is used as target reference information, wherein the first target template matches the type of the second generative content; or in response to a user operation on the template selection control, multiple candidate templates are displayed, and in response to a user selection operation of a second target template from the multiple candidate templates, the second target template is used as target reference information, wherein the multiple candidate templates match the type of the second generative content.

[0081] The configuration control or template selection control of the first target template can be used to configure the template for generating the second generated content. The configuration control of the first target template can be used to directly configure the first target template, and the template selection control can provide the user with multiple candidate templates for the user to choose.

[0082] like Figure 4As shown, in the case where the type of the second generative content is an image, in response to the user's triggering operation on the generation function, the configuration control 401 of one or more templates can be displayed in the image generation panel, and the corresponding template image can also be displayed when the configuration control 401 of the template is displayed. In response to the user's selection operation of the configuration control of the first target template in the configuration control 401 of the one or more templates, the first target template is used as the target reference information. For example, in response to the user's selection operation of the configuration control of the first target template, the first generative content can be displayed in the input display area 403, and the information of the first target template (for example, the identification or feature information of the first target template, etc.) can also be displayed.

[0083] like Figure 4 As shown, in response to the user's triggering operation on the generation function, a template selection control 402 can be displayed in the image generation panel, and in response to the user's triggering operation on the template selection control 402, multiple candidate templates can be displayed, and in response to the user's selection operation on the second target template, the second target template is used as the target reference information. For example, in response to the user's selection operation on the second target template, the first generated content can be displayed in the input display area 403, and the information of the second target template (for example, the identification or feature information of the second target template, etc.) can also be displayed. Multiple candidate templates can be displayed in an interface in the form of a new page, a floating layer, a panel or a window, etc., without limitation here.

[0084] like Figure 5 As shown, in the case where the type of the second generated content is audio, in response to the user's triggering operation on the generation function, a configuration control 501 of one or more templates can be displayed in the audio generation panel, and a template selection control 502 can be displayed. Figure 4 Similar, no further elaboration is required here.

[0085] In some embodiments, the target configuration control includes a style configuration control, which displays multiple candidate styles in response to a user's operation on the style configuration control, wherein the multiple candidate styles match the type of the second generative content; and in response to a user's selection operation of a target style from the multiple candidate styles, uses the target style as target reference information.

[0086] The user can configure the style of the second generative content through the style configuration control. Multiple candidate styles match the type of the second generative content. For example, if the type of the second generative content is an image, then multiple candidate styles are image styles. Multiple candidate styles can be sorted and displayed from large to small according to the degree of match with the style of the first generative content. For example, the style ranked first among multiple candidate styles is the same as the style of the first generative content. The user's selection of the target style can make the style of the subsequently generated second generative content the target style.

[0087] like Figure 4 As shown, a style selection control 404 may be displayed in the image generation panel, such as Figure 5 As shown, a style selection control 504 may be displayed in the audio generation panel. In response to the user's operation on the style configuration control, multiple candidate styles may be displayed in a drop-down menu. In response to the user's selection operation of a target style among the multiple candidate styles, the target style is used as target reference information. In response to the selection operation of the target style, the first generative content and the target style may be displayed in the input display area 403 or 503.

[0088] In some embodiments, the target configuration control includes an upload control, and in response to a user's operation on the upload control, one or more upload channels are displayed; in response to a user's selection operation on a target channel from the one or more upload channels, one or more candidate files corresponding to the target channel are displayed, wherein the one or more candidate files are of the same type as the second generated content; in response to a user's selection operation on a target file from the one or more candidate files, the target file is used as target reference information.

[0089] The upload control is used to upload a target file of the same type as the second generative content. The target file can be used as a template so that the subsequently generated second generative content is similar in style to the target file.

[0090] like Figure 4 As shown, an upload control 405 may be displayed in the image generation panel, such as Figure 5 As shown, an upload control 505 may be displayed in the audio generation panel. In response to the user's triggering operation on the upload control, one or more upload channels may be displayed, for example, the one or more upload channels include a local photo album, a camera shot, etc., but are not limited to the examples given. The user may upload reference images, reference songs, etc. as target files through different upload channels.

[0091] In some embodiments, the target configuration control includes a feature adding control, and in response to a user operating the feature adding control, a first input interface is displayed; in response to the user inputting feature information for generating the second generative content in the first input interface, the feature information is used as target reference information.

[0092] The user can input feature information used to generate the second generative content as target reference information by triggering the feature adding control. The feature information can be used as prompt information for generating the second generative content, or the feature information can be summarized as prompt information for the second generative content. For example, the feature information may include descriptive information of the background, foreground, hue, light, atmosphere, etc. of the image, and may include descriptive information of the rhythm, melody, instruments, etc. of the audio, etc., and is not limited to the examples given. In response to the user's operation of the feature adding control, the first generative content can be displayed in the first input interface, and the user can continue to input feature information in the first input interface to be displayed together with the first generative content. The first input interface can be such as Figure 4 or Figure 5 The generation panel shown may also be other interfaces, which is not limited here.

[0093] In some embodiments, in response to the second generative content including an image, the target configuration control includes a special effect adding control or a size configuration control, and in response to a user's operation on the special effect adding control, multiple candidate special effects are displayed, and in response to a user's selection of a target special effect from the multiple candidate special effects, the target special effect is used as target reference information; or in response to a user's operation on the size configuration control, multiple candidate sizes are displayed, and in response to a user's selection of a target size from the multiple candidate sizes, the target size is used as target reference information.

[0094] The second generated content includes an image, for example, the second generated content is an image, a video, an audio book, etc., but is not limited to the examples given. A special effect adding control can be provided to the user for adding special effects to the image, or a size configuration control can be provided to the user for configuring the size of the image.

[0095] like Figure 4 As shown, a special effect adding control 406 and a size configuration control 407 are displayed in the image generation panel. In response to the user's triggering operation on the special effect adding control 406, multiple candidate special effects can be displayed, and in response to the user's selection operation on the target special effect, the name of the target special effect can be displayed in the input display area 403. In response to the user's triggering operation on the size configuration control 407, multiple candidate sizes can be displayed, and in response to the user's selection operation on the target size, the target size can be displayed in the input display area 403.

[0096] When the second generative content includes an image, various controls corresponding to the features of the image, such as a light selection control and a hue selection control, may also be displayed to provide the user with more specific and detailed configuration options.

[0097] In some embodiments, in response to the second generative content including audio, the target configuration control includes a sound selection control or a lyrics configuration control, in response to the user's operation on the sound selection control, multiple candidate sounds are displayed, and in response to the user's selection of a target sound from the multiple candidate sounds, the target sound is used as target reference information; or in response to the user's operation on the lyrics configuration control, a second input interface is displayed, and in response to the user entering lyrics in the second input interface, the lyrics are used as target reference information.

[0098] The second generated content includes audio, for example, the second generated content is audio, video or audio book, etc., not limited to the examples. A sound selection control can be provided for the user to configure the sound characteristics of the audio, for example, the sound is male voice, female voice, child voice, etc. A lyrics configuration control can be provided for the user to add or modify lyrics.

[0099] like Figure 5 As shown, a sound selection control 506 and a lyrics configuration control 507 are displayed in the image generation panel. In response to the user's triggering operation on the sound selection control 506, multiple candidate sounds can be displayed, and in response to the user's selection operation on the target sound, the information of the target sound can be displayed in the input display area 503. In response to the user's triggering operation on the lyrics configuration control 507, a second input interface can be displayed, and the user can enter lyrics in the second input interface. The first generated content can also be displayed in the second input interface. When the first generated content is used as lyrics, the user can also add or modify lyrics. The second input interface can be Figure 5 The audio generation panel shown in may also be other interfaces, which is not limited here.

[0100] When the second generative content includes audio, various controls corresponding to the characteristics of the audio, such as instrument selection controls and melody selection controls, may also be displayed to provide the user with more specific and detailed configuration options.

[0101] The above embodiments can be applied individually or in any combination. After the generation function is recommended to the user, by providing the user with one or more configuration controls associated with the generation function, the user can configure the reference information of the second generation content more conveniently and accurately, thereby improving the convenience and efficiency of the user's operation and making the generated second generation content more accurate.

[0102] If the user selects the generation function to further generate music based on the generated poem, and through Figure 5 In the style selection control 504, if the target style of quiet and Chinese style is selected, the corresponding prompt information can be displayed in the input display area 503. Figure 6As shown, in response to the user's confirmation operation (send operation), the prompt information 601 is displayed in the interactive area as the generation instruction sent by the user, and then the generated music 602 is displayed according to the prompt information. The user can modify and edit the prompt information in the display area to make the generated second generation content more accurate.

[0103] After the second generative content is generated, a function of continuing to generate may be recommended to the user until the generation is no longer possible or the user chooses not to continue the generation.

[0104] In some embodiments, based on the second generative content and its type, it is determined whether to recommend a continue generation function to the user; in response to determining to recommend the continue generation function to the user, based on the second generative content and its type, the continue generation function recommended to the user is determined, wherein the continue generation function is used to continue generating third generative content based on the second generative content, different types of third generative content corresponding to different continue generation functions; and relevant information of the continue generation function is displayed.

[0105] For example, if the first generative content is a poem and the second generative content is music, a music video can be continuously generated. According to the second generative content and its type, it can be determined whether it is suitable to continue to generate the third generative content based on the second generative content. If it is not suitable, it is determined that the function of continuing to generate is no longer recommended to the user. How to determine the function of continuing to generate recommended to the user can refer to the embodiment of how to determine the function of recommending to the user in the aforementioned embodiment, which will not be repeated here.

[0106] In some embodiments, in response to a user's triggering operation on a continue generation function, a third generative content is generated and displayed according to the types of the second generative content and the third generative content; or in response to a user's triggering operation on the continue generation function, an interactive interface of an intelligent agent corresponding to the continue generation function is displayed, and a generation instruction corresponding to the continue generation function is displayed in the interactive interface, and in response to a user's sending operation of the generation instruction corresponding to the continue generation function, the third generative content is generated and displayed according to the types of the second generative content and the third generative content; or in response to a user's triggering operation on the continue generation function, prompt information corresponding to the continue generation function is displayed, and in response to a user's confirmation operation on the prompt information corresponding to the continue generation function, the third generative content is generated and displayed according to the types of the second generative content and the third generative content.

[0107] Regarding the triggering of the continue generation function, how to display relevant information, and how the user performs operations, etc., reference may be made to the aforementioned embodiments and will not be repeated here.

[0108] In the above embodiment, after generating the second generative content, the continued generation function for continuing to generate the third generative content can also be recommended to the user, providing a convenient way for users to continuously create, improving the efficiency of users to continuously create using the generation function, and being able to better inspire users' further creative inspiration and promote the effective use of the generation function.

[0109] The present disclosure also provides a content generation device, Figure 7 Give a description.

[0110] Figure 7 FIG. 1 is a structural diagram of some embodiments of the content generation device of the present disclosure. Figure 7 As shown, the content generating device 70 of this embodiment includes: a first generating module 710 , a first display module 720 , a determining module 730 , and a second display module 740 .

[0111] The first generating module 710 is configured to generate first generated content according to the first information in response to a user inputting first information.

[0112] The first display module 720 is configured to display the first generated content.

[0113] The determination module 730 is configured to determine a generation function recommended to the user based on the first generative content and its type, wherein the generation function is used to continue to generate the second generative content based on the first generative content, and different types of the second generative content correspond to different generation functions.

[0114] The second display module 740 is configured to display relevant information of the generation function.

[0115] In some embodiments, the determination module 730 is configured to identify semantic information of a first generative content; determine a first type that matches the semantic information based on the semantic information; determine a second type that matches the type of the first generative content; determine a type of a second generative content based on the first type and the second type; and determine a generation function recommended to the user based on the type of the second generative content.

[0116] In some embodiments, the content generating device 70 further includes: a second generating module 750, configured to generate second generated content according to the types of the first generated content and the second generated content in response to a user's triggering operation on a generating function; and a third display module 760, configured to display the second generated content.

[0117] In some embodiments, the second generation module 750 is configured to determine the style corresponding to the first generative content based on the first generative content; generate first prompt information based on the first generative content and the style corresponding to the first generative content; call the machine learning model corresponding to the type of the second generative content, and generate the second generative content based on the first prompt information.

[0118] In some embodiments, the third display module 760 is further configured to display one or more configuration controls associated with the generation function in response to a user triggering operation on the generation function, wherein the one or more configuration controls are used to configure reference information for generating the second generative content.

[0119] In some embodiments, the second generation module 750 is configured to obtain the configured target reference information in response to the user's operation on the target configuration control in one or more configuration controls; and generate the second generative content according to the type and target reference information of the first generative content and the second generative content in response to the user's confirmation operation on generating the second generative content.

[0120] In some embodiments, the second generation module 750 is configured to generate second prompt information based on the first generative content and the target reference information; call a machine learning model corresponding to the type of the second generative content, and generate the second generative content based on the second prompt information.

[0121] In some embodiments, the target configuration control includes a configuration control or a template selection control for a first target template, and the second generation module 750 is configured to use the first target template as target reference information in response to a user operation on the configuration control of the first target template, wherein the first target template matches the type of the second generative content; or the third display module 760 is further configured to display multiple candidate templates in response to a user operation on the template selection control, and the second generation module 750 is configured to use the second target template as target reference information in response to a user selection operation on a second target template from the multiple candidate templates, wherein the multiple candidate templates match the type of the second generative content.

[0122] In some embodiments, the target configuration control includes a style configuration control, and the third display module 760 is further configured to display multiple candidate styles in response to the user's operation on the style configuration control, wherein the multiple candidate styles match the type of the second generative content; the second generation module 750 is configured to use the target style as target reference information in response to the user's selection operation of the target style from the multiple candidate styles.

[0123] In some embodiments, the target configuration control includes an upload control, and the third display module 760 is further configured to display one or more upload channels in response to a user operation on the upload control; in response to a user selection operation on a target channel from one or more upload channels, display one or more candidate files corresponding to the target channel, wherein the one or more candidate files are of the same type as the second generative content; the second generation module 750 is configured to use the target file as target reference information in response to a user selection operation on a target file from one or more candidate files.

[0124] In some embodiments, the target configuration control includes a feature adding control, and the third display module 760 is also configured to display the first input interface in response to the user's operation on the feature adding control; the second generation module 750 is configured to respond to the user inputting feature information for generating the second generative content in the first input interface, and use the feature information as target reference information.

[0125] In some embodiments, in response to the second generative content including an image, the target configuration control including a special effect adding control or a size configuration control, the third display module 760 is further configured to display multiple candidate special effects in response to the user's operation on the special effect adding control, and the second generation module 750 is configured to use the target special effect as target reference information in response to the user's selection operation of a target special effect from multiple candidate special effects; or, the third display module 760 is further configured to display multiple candidate sizes in response to the user's operation on the size configuration control, and the second generation module 750 is configured to use the target size as target reference information in response to the user's selection operation of a target size from multiple candidate sizes.

[0126] In some embodiments, in response to the second generative content including audio, the target configuration control includes a sound selection control or a lyrics configuration control, the third display module 760 is further configured to display multiple candidate sounds in response to the user's operation on the sound selection control, and the second generation module 750 is configured to use the target sound as target reference information in response to the user's selection operation on the target sound among the multiple candidate sounds; or the third display module 760 is further configured to display a second input interface in response to the user's operation on the lyrics configuration control, and the second generation module 750 is configured to use the lyrics as target reference information in response to the user entering lyrics on the second input interface.

[0127] In some embodiments, the determination module 730 is further configured to determine whether to recommend a continue generation function to the user based on the second generative content and its type; in response to determining to recommend the continue generation function to the user, determine the continue generation function recommended to the user based on the second generative content and its type, wherein the continue generation function is used to continue generating third generative content based on the second generative content, and different types of third generative content correspond to different continue generation functions; the third display module 760 is further configured to display relevant information of the continue generation function.

[0128] In some embodiments, the content generation device 70 further includes a third generation module 770, which is configured to generate third generated content according to the types of the second generated content and the third generated content in response to the user's triggering operation on the continue generation function, and the third display module 760 is further configured to display the third generated content; or, the third display module 760 is further configured to display the interactive interface of the intelligent agent corresponding to the continue generation function in response to the user's triggering operation on the continue generation function, and display the generation instructions corresponding to the continue generation function in the interactive interface, and the third generation module 770 is configured to generate the third generated content according to the types of the second generated content and the third generated content in response to the user's triggering operation on the continue generation function. The third display module 760 is further configured to display the third generative content in response to the sending operation of the corresponding generation instruction, and generates the third generative content according to the types of the second generative content and the third generative content. The third display module 760 is further configured to display the third generative content; or the third display module 760 is further configured to display the prompt information corresponding to the continue generation function in response to the user's triggering operation on the continue generation function, and the third generation module 770 is configured to generate the third generative content according to the types of the second generative content and the third generative content in response to the user's confirmation operation on the prompt information corresponding to the continue generation function, and the third display module 760 is further configured to display the third generative content.

[0129] In some embodiments, the third display module 760 is also configured to display the interactive interface of the intelligent agent corresponding to the generation function in response to the user's triggering operation on the generation function, and display the generation instruction corresponding to the generation function in the interactive interface, and the second generation module 750 is configured to generate the second generation content according to the types of the first generation content and the second generation content in response to the user's sending operation of the generation instruction corresponding to the generation function; or the third display module 760 is also configured to display the prompt information corresponding to the generation function in response to the user's triggering operation on the generation function, and the second generation module 750 is configured to generate the second generation content according to the types of the first generation content and the second generation content in response to the user's confirmation operation on the prompt information corresponding to the generation function.

[0130] It should be noted that the above-mentioned units (modules) are only logical modules divided according to the specific functions they implement, and are not used to limit the specific implementation methods. For example, they can be implemented in software, hardware, or a combination of software and hardware. In actual implementation, the above-mentioned units can be implemented as independent physical entities, or can also be implemented by a single entity (for example, a processor (CPU or DSP, etc.), an integrated circuit, etc.). In addition, the above-mentioned units are shown with dotted lines in the drawings to indicate that these units may not actually exist, and the operations / functions they implement can be implemented by the processing circuit itself.

[0131] In addition, although not shown, the device may also include a memory, which may store various information generated by the device, various units contained in the device during operation, programs and data for operation, data to be sent by the communication unit, etc. The memory may be a volatile memory and / or a non-volatile memory. For example, the memory may include, but is not limited to, a random access memory (RAM), a dynamic random access memory (DRAM), a static random access memory (SRAM), a read-only memory (ROM), and a flash memory. Of course, the memory may also be located outside the device. Optionally, although not shown, the device may also include a communication unit, which may be used to communicate with other devices. In one example, the communication unit may be implemented in an appropriate manner known in the art, such as including communication components such as an antenna array and / or a radio frequency link, various types of interfaces, communication units, etc. It will not be described in detail here. In addition, the device may also include other components not shown, such as a radio frequency link, a baseband processing unit, a network interface, a processor, a controller, etc. It will not be described in detail here.

[0132] Some embodiments of the present disclosure also provide an electronic device. Figure 8 Block diagrams of some embodiments of the electronic device of the present disclosure are shown. For example, in some embodiments, the electronic device 80 can be various types of devices, for example, can include but are not limited to mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. For example, the electronic device 80 can include a display panel for displaying data and / or execution results used in the scheme of the present disclosure. For example, the display panel can be of various shapes, such as a rectangular panel, an elliptical panel, or a polygonal panel, etc. In addition, the display panel can be not only a flat panel, but also a curved panel, or even a spherical panel.

[0133] like Figure 8 As shown, the electronic device 80 of this embodiment includes: a memory 81 and a processor 82 coupled to the memory 81. It should be noted that Figure 8 The components of the electronic device 80 shown are only exemplary and non-limiting. The electronic device 80 may also have other components according to actual application requirements. The processor 82 may control other components in the electronic device 80 to perform desired functions.

[0134] In some embodiments, the memory 81 is used to store one or more computer-readable instructions. When the processor 82 is used to execute the computer-readable instructions, the computer-readable instructions are executed by the processor 82 to implement the method according to any of the above embodiments. For the specific implementation of each step of the method and the related explanation content, please refer to the above embodiments, and the repetition will not be repeated here.

[0135] For example, the processor 82 and the memory 81 may communicate with each other directly or indirectly. For example, the processor 82 and the memory 81 may communicate with each other through a network. The network may include a wireless network, a wired network, and / or any combination of a wireless network and a wired network. The processor 82 and the memory 81 may also communicate with each other through a system bus, which is not limited by the present disclosure.

[0136] For example, the processor 82 may be embodied as various appropriate processors, processing devices, etc., such as a central processing unit (CPU), a graphics processing unit (GPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The central processing unit (CPU) may be an X86 or ARM architecture, etc. For example, the memory 81 may include any combination of various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The memory 81 may include, for example, a system memory, which may store, for example, an operating system, an application, a boot loader (Boot Loader), a database, and other programs. Various applications and various data may also be stored in the storage medium.

[0137] In addition, according to some embodiments of the present disclosure, various operations / processes according to the present disclosure, when implemented by software and / or firmware, can be transmitted from a storage medium or a network to a computer system having a dedicated hardware structure, such as Fig. 9 The computer system (or electronic device) 90 shown is installed with the programs constituting the software, and when the various programs are installed, the computer system can execute various functions, including the functions described above. Fig. 9 is a block diagram illustrating an example structure of a computer system that can be employed in an embodiment according to the present disclosure.

[0138] exist Fig. 9 In the embodiment, a central processing unit (CPU) 901 performs various processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage section 908 to a random access memory (RAM) 903. In the RAM 903, data required when the CPU 901 performs various processes, etc., is also stored as needed. The central processing unit is merely exemplary, and it may also be other types of processors, such as the various processors described above. The ROM 902, the RAM 903, and the storage section 908 may be various forms of computer-readable storage media, as described below. It should be noted that although Fig. 9 ROM 902, RAM 903 and storage section 908 are shown separately in the figure, but one or more of them may be combined or located in the same or different memory or storage modules.

[0139] The CPU 901, the ROM 902, and the RAM 903 are connected to one another via a bus 904. An input / output interface 905 is also connected to the bus 904.

[0140] The following components are connected to the input / output interface 905: an input section 906, such as a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output section 907, including a display, such as a cathode ray tube (CRT), a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage section 908, including a hard disk, a magnetic tape, etc.; and a communication section 909, including a network interface card such as a LAN card, a modem, etc. The communication section 909 allows communication processing to be performed via a network such as the Internet. It is easy to understand that although Fig. 9 The various devices or modules in the computer system 90 are shown to communicate via a bus 904, but they may also communicate via a network or other means, wherein the network may include a wireless network, a wired network, and / or any combination of a wireless network and a wired network.

[0141] A drive 910 is also connected to the input / output interface 905 as needed. A removable medium 911 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory or the like is mounted on the drive 910 as needed so that a computer program read therefrom is installed into the storage section 908 as needed.

[0142] In the case where the above-described series of processing is realized by software, a program constituting the software can be installed from a network such as the Internet or a storage medium such as the removable medium 911 .

[0143] According to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 909, or installed from a storage device 908, or installed from a ROM 902. When the computer program is executed by the CPU 901, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0144] It should be noted that in the context of the present disclosure, a computer-readable medium may be a tangible medium that may contain or store a program for use by an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. A computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. A computer-readable storage medium may be, for example, but not limited to: an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that may be used by an instruction execution system, device or device or used in combination with it. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, device, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0145] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0146] In some embodiments, a computer program is further provided, comprising: instructions, which, when executed by a processor, cause the processor to execute any of the methods in the above embodiments. For example, the instructions may be embodied as computer program codes.

[0147] In embodiments of the present disclosure, computer program codes for performing the operations of the present disclosure may be written in one or more programming languages ​​or combinations thereof, including but not limited to object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code may be executed entirely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or entirely on a remote computer or server. In situations involving a remote computer, the remote computer may be connected to the user's computer via any type of network (including a local area network (LAN) or a wide area network (WAN)), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet).

[0148] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0149] The modules, components or units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the names of the modules, components or units do not, in some cases, limit the modules, components or units themselves.

[0150] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0151] According to some embodiments of the present disclosure, a content generation method is provided, including: in response to a user inputting first information, generating first generative content according to the first information; displaying the first generative content; determining a generation function recommended to the user according to the first generative content and its type, wherein the generation function is used to continue to generate second generative content based on the first generative content, and different types of second generative content correspond to different generation functions; and displaying relevant information of the generation function.

[0152] In some embodiments, determining a generative function recommended to a user based on first generative content and its type includes: identifying semantic information of the first generative content; determining a first type that matches the semantic information based on the semantic information; determining a second type that matches the type of the first generative content; determining a type of the second generative content based on the first type and the second type; and determining a generative function recommended to the user based on the type of the second generative content.

[0153] In some embodiments, the content generation method further includes: generating second generated content according to types of the first generated content and the second generated content in response to a user triggering operation on a generation function; and displaying the second generated content.

[0154] In some embodiments, generating the second generative content according to the types of the first generative content and the second generative content includes: determining a style corresponding to the first generative content according to the first generative content; generating first prompt information according to the first generative content and the style corresponding to the first generative content; calling a machine learning model corresponding to the type of the second generative content, and generating the second generative content according to the first prompt information.

[0155] In some embodiments, the content generation method further includes: in response to a user triggering operation on the generation function, displaying one or more configuration controls associated with the generation function, wherein the one or more configuration controls are used to configure reference information for generating the second generative content.

[0156] In some embodiments, the content generation method also includes: in response to a user's operation on a target configuration control in one or more configuration controls, obtaining target reference information of the configuration; in response to a user's confirmation operation on generating a second generative content, generating a second generative content according to the type of the first generative content and the second generative content and the target reference information.

[0157] In some embodiments, generating the second generative content according to the types of the first generative content and the second generative content and the target reference information includes: generating second prompt information according to the first generative content and the target reference information; calling a machine learning model corresponding to the type of the second generative content, and generating the second generative content according to the second prompt information.

[0158] In some embodiments, the target configuration control includes a configuration control or a template selection control of a first target template, and in response to a user operation on a target configuration control in one or more configuration controls, obtaining the configured target reference information includes: in response to the user operation on the configuration control of the first target template, using the first target template as the target reference information, wherein the first target template matches the type of the second generative content; or in response to the user operation on the template selection control, displaying multiple candidate templates, and in response to the user selecting a second target template from the multiple candidate templates, using the second target template as the target reference information, wherein the multiple candidate templates match the type of the second generative content.

[0159] In some embodiments, the target configuration control includes a style configuration control, and in response to a user's operation on a target configuration control in one or more configuration controls, obtaining the configured target reference information includes: in response to the user's operation on the style configuration control, displaying multiple candidate styles, wherein the multiple candidate styles match the type of the second generative content; in response to the user's selection operation of a target style in the multiple candidate styles, using the target style as the target reference information.

[0160] In some embodiments, the target configuration control includes an upload control, and in response to a user operation on a target configuration control in one or more configuration controls, obtaining the configured target reference information includes: in response to the user operation on the upload control, displaying one or more upload channels; in response to the user selection operation on a target channel in the one or more upload channels, displaying one or more candidate files corresponding to the target channel, wherein the one or more candidate files are of the same type as the second generated content; in response to the user selection operation on a target file in the one or more candidate files, using the target file as target reference information.

[0161] In some embodiments, the target configuration control includes a feature adding control, and in response to a user's operation on a target configuration control in one or more configuration controls, obtaining the configured target reference information includes: displaying a first input interface in response to the user's operation on the feature adding control; in response to the user inputting feature information for generating second generative content in the first input interface, using the feature information as target reference information.

[0162] In some embodiments, in response to the second generative content including an image, the target configuration control including a special effect adding control or a size configuration control, and in response to a user operation on a target configuration control among the one or more configuration controls, obtaining the configured target reference information includes: in response to the user operation on the special effect adding control, displaying multiple candidate special effects, and in response to the user selecting a target special effect among the multiple candidate special effects, using the target special effect as target reference information; or in response to the user operation on the size configuration control, displaying multiple candidate sizes, and in response to the user selecting a target size among the multiple candidate sizes, using the target size as target reference information.

[0163] In some embodiments, in response to the second generative content including audio, the target configuration control including a sound selection control or a lyrics configuration control, and in response to a user's operation on a target configuration control in one or more configuration controls, obtaining the configured target reference information includes: in response to the user's operation on the sound selection control, displaying multiple candidate sounds, and in response to the user's selection of a target sound from the multiple candidate sounds, using the target sound as target reference information; or in response to the user's operation on the lyrics configuration control, displaying a second input interface, and in response to the user entering lyrics in the second input interface, using the lyrics as target reference information.

[0164] In some embodiments, the content generation method also includes: determining whether to recommend a continue generation function to the user based on the second generative content and its type; in response to determining to recommend the continue generation function to the user, determining the continue generation function recommended to the user based on the second generative content and its type, wherein the continue generation function is used to continue to generate third generative content based on the second generative content, different types of third generative content corresponding to different continue generation functions; and displaying relevant information of the continue generation function.

[0165] In some embodiments, the content generation method also includes: in response to a user's triggering operation on a continue generation function, generating and displaying a third generative content according to the types of the second generative content and the third generative content; or in response to a user's triggering operation on the continue generation function, displaying an interactive interface of an intelligent agent corresponding to the continue generation function, and displaying a generation instruction corresponding to the continue generation function in the interactive interface, and in response to a user's sending operation of a generation instruction corresponding to the continue generation function, generating and displaying the third generative content according to the types of the second generative content and the third generative content; or in response to a user's triggering operation on the continue generation function, displaying prompt information corresponding to the continue generation function, and in response to a user's confirmation operation on the prompt information corresponding to the continue generation function, generating and displaying the third generative content according to the types of the second generative content and the third generative content.

[0166] In some embodiments, the content generation method also includes: in response to a user's triggering operation on a generation function, displaying an interactive interface of an intelligent agent corresponding to the generation function, and displaying a generation instruction corresponding to the generation function in the interactive interface; in response to a user's sending operation on the generation instruction corresponding to the generation function, generating and displaying a second generation content according to the types of the first generation content and the second generation content; or in response to a user's triggering operation on the generation function, displaying prompt information corresponding to the generation function; in response to a user's confirmation operation on the prompt information corresponding to the generation function, generating and displaying the second generation content according to the types of the first generation content and the second generation content.

[0167] According to some other embodiments of the present disclosure, a content generation device is provided, including: a first generation module, configured to generate first generative content in response to first information input by a user according to the first information; a first display module, configured to display the first generative content; a determination module, configured to determine a generation function recommended to the user according to the first generative content and its type, wherein the generation function is used to continue to generate second generative content based on the first generative content, and different types of the second generative content correspond to different generation functions; and a second display module, configured to display relevant information of the generation function.

[0168] According to some further embodiments of the present disclosure, an electronic device is provided, including: a processor; and a memory coupled to the processor, for storing instructions, which, when executed by the processor, causes the processor to execute the content generation method of any embodiment of the present disclosure.

[0169] According to some further embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the content generating method of any embodiment of the present disclosure is executed.

[0170] According to some further embodiments of the present disclosure, a computer program product is provided, including: instructions, which implement the content generating method of any embodiment of the present disclosure when the instructions are executed by a processor.

[0171] According to some further embodiments of the present disclosure, a computer program is provided, comprising: instructions, which implement the content generating method of any embodiment of the present disclosure when the instructions are executed by a processor.

[0172] The above descriptions are only some embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, a technical solution formed by replacing the above features with the technical features with similar functions disclosed in the present disclosure (but not limited to).

[0173] In the description provided herein, many specific details are set forth. However, it is understood that embodiments of the present invention can be implemented without these specific details. In other cases, well-known methods, structures, and techniques are not presented in detail in order not to obscure the understanding of the description.

[0174] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0175] Although some specific embodiments of the present disclosure have been described in detail by way of example, it should be understood by those skilled in the art that the above examples are for illustration only and are not intended to limit the scope of the present disclosure. It should be understood by those skilled in the art that the above embodiments may be modified without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. A content generation method, comprising: In response to a user inputting first information, generating first generative content according to the first information; displaying the first generated content; Determining a generation function recommended to the user according to the first generation content and its type, comprising: identifying semantic information of the first generation content, determining a first type matching the semantic information according to the semantic information, determining a second type matching the type of the first generation content, determining a type of the second generation content according to the first type and the second type, and determining the generation function recommended to the user according to the type of the second generation content, wherein the generation function is used to continue to generate the second generation content based on the first generation content, and different types of the second generation content correspond to different generation functions; Displays information about the build function.

2. The content generation method according to claim 1, further comprising: In response to the user's triggering operation on the generation function, generating the second generated content according to the types of the first generated content and the second generated content; The second generated content is displayed.

3. The content generation method according to claim 2, wherein: The generating the second generated content according to the types of the first generated content and the second generated content comprises: Determining, according to the first generative content, a style corresponding to the first generative content; Generate first prompt information according to the first generative content and the style corresponding to the first generative content; Call a machine learning model corresponding to the type of the second generative content, and generate the second generative content according to the first prompt information.

4. The content generation method according to claim 1, further comprising: In response to the user's triggering operation on the generating function, one or more configuration controls associated with the generating function are displayed, wherein the one or more configuration controls are used to configure reference information for generating the second generative content.

5. The content generation method according to claim 4, further comprising: In response to the user's operation on a target configuration control among the one or more configuration controls, acquiring target reference information of the configuration; In response to the user's confirmation operation on generating the second generated content, the second generated content is generated according to the first generated content, the type of the second generated content and the target reference information.

6. The content generation method according to claim 5, wherein: The generating the second generated content according to the first generated content, the type of the second generated content and the target reference information comprises: Generate second prompt information according to the first generated content and the target reference information; Call a machine learning model corresponding to the type of the second generative content, and generate the second generative content according to the second prompt information.

7. The content generation method according to claim 5, wherein: The target configuration control includes a configuration control or a template selection control of a first target template, and in response to the user operating a target configuration control in the one or more configuration controls, acquiring the configured target reference information includes: In response to the user's operation on a configuration control of the first target template, using the first target template as the target reference information, wherein the first target template matches a type of the second generative content; or In response to the user's operation on the template selection control, multiple candidate templates are displayed, and in response to the user's selection operation on a second target template among the multiple candidate templates, the second target template is used as the target reference information, wherein the multiple candidate templates match the type of the second generative content.

8. The content generation method according to claim 5, wherein: The target configuration control includes a style configuration control, and in response to the user's operation on a target configuration control in the one or more configuration controls, obtaining the configured target reference information includes: In response to the user's operation on the style configuration control, displaying a plurality of candidate styles, wherein the plurality of candidate styles match the type of the second generative content; In response to the user's selection operation of a target style from among the plurality of candidate styles, the target style is used as the target reference information.

9. The content generation method according to claim 5, wherein: The target configuration control includes an upload control, and in response to the user operating a target configuration control in the one or more configuration controls, obtaining the configured target reference information includes: In response to the user's operation on the upload control, displaying one or more upload channels; In response to the user's selection operation on a target channel among the one or more upload channels, displaying one or more candidate files corresponding to the target channel, wherein the one or more candidate files are of the same type as the second generated content; In response to the user's selection operation of a target file from the one or more candidate files, the target file is used as the target reference information.

10. The content generation method according to claim 5, wherein: The target configuration control includes a feature adding control, and in response to the user's operation on a target configuration control in the one or more configuration controls, obtaining the configured target reference information includes: In response to the user's operation of adding a control to the feature, displaying a first input interface; In response to the user inputting feature information for generating the second generative content in the first input interface, the feature information is used as the target reference information.

11. The content generation method according to claim 5, wherein: In response to the second generated content including an image, the target configuration control including a special effect adding control or a size configuration control, and in response to the user operating a target configuration control among the one or more configuration controls, obtaining the configured target reference information includes: In response to the user's operation on the special effect adding control, multiple candidate special effects are displayed, and in response to the user's selection operation on a target special effect from the multiple candidate special effects, the target special effect is used as the target reference information; or In response to the user's operation on the size configuration control, a plurality of candidate sizes are displayed; in response to the user's selection operation on a target size from the plurality of candidate sizes, the target size is used as the target reference information.

12. The content generation method according to claim 5, wherein: In response to the second generated content including audio, the target configuration control including a sound selection control or a lyrics configuration control, and in response to the user operating a target configuration control among the one or more configuration controls, acquiring the configured target reference information includes: In response to the user's operation on the sound selection control, multiple candidate sounds are displayed, and in response to the user's selection operation on a target sound among the multiple candidate sounds, the target sound is used as the target reference information; or In response to the user's operation on the lyrics configuration control, a second input interface is displayed, and in response to the user inputting lyrics in the second input interface, the lyrics are used as the target reference information.

13. The content generation method according to claim 2 or 5, further comprising: determining, according to the second generated content and its type, whether to recommend a continue generation function to the user; In response to determining to recommend a continue generation function to the user, determining the continue generation function recommended to the user according to the second generated content and its type, wherein the continue generation function is used to continue to generate third generated content based on the second generated content, and different types of the third generated content correspond to different continue generation functions; Displays information related to the continue generation function.

14. The content generation method according to claim 13, further comprising: In response to the user's triggering operation on the continuing generation function, generating and displaying the third generated content according to the types of the second generated content and the third generated content; or In response to the user's triggering operation on the continue generation function, an interactive interface of an agent corresponding to the continue generation function is displayed, and a generation instruction corresponding to the continue generation function is displayed in the interactive interface; in response to the user's sending operation on the generation instruction corresponding to the continue generation function, the third generation content is generated and displayed according to the types of the second generation content and the third generation content; or In response to the user's triggering operation on the continue generation function, prompt information corresponding to the continue generation function is displayed; in response to the user's confirmation operation on the prompt information corresponding to the continue generation function, the third generative content is generated and displayed according to the types of the second generative content and the third generative content.

15. The content generation method according to any one of claims 1 to 12, further comprising: In response to the user's triggering operation on the generation function, an interactive interface of an intelligent agent corresponding to the generation function is displayed, and a generation instruction corresponding to the generation function is displayed in the interactive interface; in response to the user's sending operation on the generation instruction corresponding to the generation function, the second generation content is generated and displayed according to the types of the first generation content and the second generation content; or In response to the user's triggering operation on the generation function, prompt information corresponding to the generation function is displayed; in response to the user's confirmation operation on the prompt information corresponding to the generation function, the second generation content is generated and displayed according to the types of the first generation content and the second generation content.

16. A content generating device, comprising: A first generating module is configured to generate first generated content according to first information input by a user in response to the first information; A first display module, configured to display the first generated content; A determination module is configured to determine a generation function recommended to the user according to the first generation content and its type, comprising: identifying semantic information of the first generation content, determining a first type matching the semantic information according to the semantic information, determining a second type matching the type of the first generation content, determining a type of the second generation content according to the first type and the second type, and determining the generation function recommended to the user according to the type of the second generation content, wherein the generation function is used to continue to generate the second generation content based on the first generation content, and different types of the second generation content correspond to different generation functions; The second display module is configured to display relevant information of the generating function.

17. An electronic device comprising: processor; as well as A memory coupled to the processor, for storing instructions, wherein when the instructions are executed by the processor, the processor executes the content generation method according to any one of claims 1 to 15.

18. A computer-readable storage medium having a computer program stored thereon, wherein: When the program is executed by a processor, the content generating method according to any one of claims 1 to 15 is implemented.

19. A computer program product comprising instructions, which, when executed by a processor, cause the processor to perform the content generation method according to any one of claims 1 to 15.

Images