Cartoon generation method and device, electronic equipment and storage medium

Through electronic devices generation and dubbing comics, the problems of low efficiency and single expression of traditional manual hand-painting technology are solved, and the comic generation with efficient creation and diversified experience are achieved.

CN119295578AActive Publication Date: 2025-01-10BAIDU COM TIMES TECH (BEIJING) CO LTD

Patent Information

Application Number
CN202411285892.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-13
Publication Date
2025-01-10
Estimated Expiration
2044-09-13

AI Technical Summary

Technical Problem

Current comic creation relies on traditional manual hand-painted technology, which is inefficient and has a single form of expression, making it difficult to meet the users' needs for efficient creation and diversified experience in the digital era.

Method used

By obtaining multiple target storyboard scripts, using electronic devices to generate target comic picture books and dubbing, they form audio comics to meet users' efficient creation and diversified experience needs.

Benefits of technology

It improves the efficiency of comic creation, enriches the expression form, and meets the dual needs of users for efficient creation and diversified experience in the digital era.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119295578A_ABST
    Figure CN119295578A_ABST
Patent Text Reader

Abstract

The invention provides a cartoon generation method and device, electronic equipment and a storage medium, and relates to the technical field of computers, in particular to the technical fields of artificial intelligence, large language models, natural language processing and the like. The specific implementation scheme is as follows: acquiring a plurality of target split scripts; in response to the cartoon generation request processing operation, sending a cartoon generation request carrying a plurality of target split scripts to the first electronic equipment; wherein the first electronic equipment is used for generating a target cartoon picture book based on a plurality of target split scripts carried in a cartoon generation request, and dubbing the target cartoon picture book to obtain a first target voiced cartoon; and receiving and playing the first target audio cartoon.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, in particular to the technical fields of artificial intelligence, large language models, natural language processing, etc., and specifically to a comic generation method, device, electronic device and storage medium. Background Art

[0002] Current comic creation mainly relies on traditional manual hand-drawing technology, which not only has low creation efficiency but also has a single form of expression, making it difficult to meet the dual needs of users in the digital age for efficient creation and diversified experience. Summary of the invention

[0003] The present disclosure provides a comic generation method, device, electronic device and storage medium.

[0004] According to a first aspect of the present disclosure, there is provided a comic generation method, comprising:

[0005] Get multiple target storyboards;

[0006] In response to the comic generation request processing operation, a comic generation request carrying multiple target storyboards is sent to a first electronic device; wherein the first electronic device is used to generate a target comic picture book based on the multiple target storyboards carried in the comic generation request, and dub the target comic picture book to obtain a first target audio comic;

[0007] Receive and play the first target audio comic.

[0008] According to a second aspect of the present disclosure, a comic generation method is provided, comprising:

[0009] receiving a comic generation request carrying multiple target storyboards;

[0010] Based on the multiple target storyboards carried in the comic generation request, a target comic picture book is generated, and the target comic picture book is dubbed to obtain a first target audio comic;

[0011] The first target audio comic is sent to the second electronic device.

[0012] According to a third aspect of the present disclosure, there is provided a comic generation device, comprising:

[0013] A script acquisition unit, used for acquiring multiple target storyboard scripts;

[0014] A comic generation request sending unit is used to send a comic generation request carrying multiple target storyboards to a first electronic device in response to a comic generation request processing operation; wherein the first electronic device is used to generate a target comic picture book based on the multiple target storyboards carried in the comic generation request, and dub the target comic picture book to obtain a first target audio comic;

[0015] The first audio comic receiving unit is used to receive and play the first target audio comic.

[0016] According to a fourth aspect of the present disclosure, there is provided a comic generation device, comprising:

[0017] A comic generation request receiving unit, used for receiving a comic generation request carrying a plurality of target storyboards;

[0018] A comic generation unit, configured to generate a target comic picture book based on multiple target storyboards carried in the comic generation request, and dub the target comic picture book to obtain a first target audio comic;

[0019] The first audio comic sending unit is used to send the first target audio comic to the second electronic device.

[0020] According to a fifth aspect of the present disclosure, there is provided an electronic device, including:

[0021] at least one processor;

[0022] a memory communicatively coupled to the at least one processor;

[0023] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the method provided by the embodiment of the present disclosure.

[0024] According to a sixth aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable the computer to execute the method provided according to an embodiment of the present disclosure.

[0025] According to a seventh aspect of the present disclosure, a computer program product is provided, including a computer program, which implements the method provided according to the embodiment of the present disclosure when executed by a processor.

[0026] The use of the present disclosure can improve the efficiency of comic creation and, at the same time, enrich the comic expression forms to meet the dual needs of users in the digital age for efficient creation and diversified experience.

[0027] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

[0029] Figure 1 A flowchart of a comic book generation method provided by an embodiment of the present disclosure;

[0030] Figure 2 A schematic diagram of a process for obtaining a target comic theme provided by an embodiment of the present disclosure;

[0031] Figure 3 A schematic diagram of a theme setting interface corresponding to a target comic type provided by an embodiment of the present disclosure;

[0032] Figure 4 A flowchart illustrating a first method of entering a theme setting interface corresponding to a target comic type provided by an embodiment of the present disclosure;

[0033] Figure 5 A flowchart illustrating a second method of entering a theme setting interface corresponding to a target comic type provided by an embodiment of the present disclosure;

[0034] Figure 6 A flowchart illustrating the process of setting a first target comic theme provided by an embodiment of the present disclosure;

[0035] Figure 7 A flowchart illustrating the process of setting a second target comic theme provided by an embodiment of the present disclosure;

[0036] Figure 8 A diagram illustrating a generation process of multiple target comic scripts provided by an embodiment of the present disclosure;

[0037] Fig. 9 A diagram illustrating a generation process of a first target audio comic provided by an embodiment of the present disclosure;

[0038] Fig.10 A flowchart illustrating a process of receiving and playing a first target audio comic provided by an embodiment of the present disclosure;

[0039] Fig.11 An auxiliary illustration of a comic sharing mechanism provided in an embodiment of the present disclosure;

[0040] Fig.12 A flowchart of a comic book generation method provided by an embodiment of the present disclosure;

[0041] Fig.13 A schematic diagram of an interaction process between a terminal device and a server provided in an embodiment of the present disclosure;

[0042] Fig.14 A schematic diagram of a scene of a comic generation method provided by an embodiment of the present disclosure;

[0043] Fig.15 A schematic structural block diagram of a comic generation device provided in an embodiment of the present disclosure;

[0044] Fig.16 A schematic structural block diagram of a comic generation device provided in an embodiment of the present disclosure;

[0045] Fig.17 A schematic structural block diagram of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0046] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope of the present disclosure. Similarly, for the sake of clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0047] The embodiment of the present disclosure provides a comic book generation method, which can be applied to a second electronic device. The second electronic device can be a terminal device. Here, the terminal device can be a conventional computer (desktop computer, laptop computer, etc.), a car computer, a tablet computer, a smart phone, a personal digital assistant or other similar computing device. Figure 1 The flowchart diagram shown is used to illustrate a comic book generation method provided by an embodiment of the present disclosure. It should be noted that although a logical sequence is shown in the flowchart diagram, in some cases, the steps shown or described may also be performed in other sequences.

[0048] Step S101, obtaining multiple target storyboards.

[0049] Each of the target storyboards in the plurality of target storyboards is used to describe a target storyboard screen in the first target audio comic to be generated, and the target storyboard screen may include character images, character actions, character expressions, background details, etc. Here, the character images may be people, animals, other objects, etc.

[0050] Step S102: In response to the comic generation request processing operation, a comic generation request carrying multiple target storyboards is sent to the first electronic device.

[0051] Among them, the comic generation request processing operation can be triggered by the user; the first electronic device can be used to generate a target comic picture book based on the multiple target storyboards carried in the comic generation request, and dub the target comic picture book to obtain a first target audio comic. Here, the target comic picture book may include multiple target storyboard screens corresponding to the multiple target storyboard scripts. Based on this, in the embodiment of the present disclosure, when dubbing the target comic picture book, each target storyboard screen in the multiple target storyboard screens can be used as a screen to be dubbed, and the target storyboard script corresponding to the screen to be dubbed is used to dub the screen to be dubbed.

[0052] Step S103, receiving and playing the first target audio comic.

[0053] By adopting the comic generation method provided by the embodiment of the present disclosure, the second electronic device can obtain multiple target storyboards, and in response to the comic generation request processing operation, send the comic generation request carrying multiple target storyboards to the first electronic device, so that the first electronic device generates a target comic picture book based on the multiple target storyboards carried in the comic generation request, and dubs the target comic picture book to obtain the first target audio comic, after which the second electronic device can receive and play the first target audio comic. In this way, not only the traditional manual hand-drawing technology is replaced by the automated comic creation process to improve the efficiency of comic creation, but also the comic expression form is enriched by incorporating sound elements, thus meeting the dual needs of users in the digital age for efficient creation and diversified experience.

[0054] Furthermore, in the embodiment of the present disclosure, for multiple target storyboards, as a first optional implementation mode, they can be directly generated by user input, which makes the generation of multiple target storyboards more flexible and controllable, and therefore can ensure that the multiple target storyboards are highly consistent with user expectations, thereby improving the user experience.

[0055] In the embodiment of the present disclosure, for multiple target storyboards, as a second optional implementation, they can also be generated in a relatively automated manner. Figure 2 In the embodiment of the present disclosure, step S101, i.e., "obtaining multiple target storyboards" may include:

[0056] Step S201-1, obtaining a target comic theme.

[0057] The target comic theme can be used to represent the theme information of the first target audio comic to be generated. For example, the target comic theme can be "The fairy's magic wand - facing difficulties and solving them actively"; for another example, the target comic theme can be "Ode to the Goose - Luo Binwang of the Tang Dynasty"; for another example, the target comic theme can be "The fairy's magic wand - facing difficulties and solving them actively".

[0058] In one example, step S201-1, i.e., "obtaining a target comic theme", may include:

[0059] In response to the comic type setting operation, displaying a theme setting interface corresponding to the target comic type;

[0060] In response to a comic theme setting operation triggered on a theme setting interface corresponding to a target comic type, a target comic theme is obtained.

[0061] Among them, the comic type setting operation can be triggered by the user; the target comic type can be any one of multiple candidate comic types (for example, bedtime stories, poetry enlightenment, safety education, character development, emotions & relationships, and cognitive science).

[0062] Please combine Figure 3 , exemplarily, in addition to displaying the target comic type, the theme setting interface corresponding to the target comic type (e.g., safety education) can also display other candidate comic types (e.g., bedtime stories, poetry enlightenment, character development, emotions & relationships, and cognitive science) among multiple candidate comic types. At the same time, the theme setting interface corresponding to the target comic type can also provide a theme editing window 301 for displaying the target comic theme, and a first virtual button 302 for triggering a script acquisition request processing operation. The first virtual button 302 can be a "generate comic" button; in response to the script acquisition request processing operation, a script acquisition request carrying the target comic theme can be sent to the first electronic device.

[0063] Here, the plurality of candidate comic types may be determined by the first electronic device, and the first electronic device may determine the plurality of candidate comic types in the following manner:

[0064] Obtain the overall search term collection of Internet search and discovery platforms;

[0065] Select a target number of popular search terms related to the comic search task from the overall search term collection;

[0066] Based on the target number of popular search terms, multiple candidate comic types are generated.

[0067] Among them, the Internet search and discovery platform may include an Internet search engine platform, a social media platform, an online video sharing website, etc.; the target number can be set according to actual application requirements, for example, it can be set to 20, and the embodiments of the present disclosure do not limit this.

[0068] After obtaining the target number of popular search terms, the target number of popular search terms can be processed by screening, deduplication, synonym merging, etc. to generate multiple candidate comic types.

[0069] Further, in a specific example, in step S201-1, "in response to the comic type setting operation, displaying a theme setting interface corresponding to the target comic type" may include:

[0070] When the main interface of the comic generation webpage has been entered, in response to a comic type setting operation triggered on the main interface of the comic generation webpage, a target comic type is selected from multiple candidate comic types to enter a theme setting interface corresponding to the target comic type.

[0071] In actual implementation, the main interface of the comic generation webpage can be entered based on the original Uniform Resource Locator (URL) (i.e., the URL pointing to the main interface of the comic generation webpage), and the bedtime story is selected as the target comic type by default. After entering the main interface of the comic generation webpage, a new target comic type can be selected from multiple candidate comic types in response to a comic type setting operation triggered on the main interface of the comic generation webpage to enter a theme setting interface corresponding to the new target comic type. The comic type setting operation can be a mouse click operation, a touch operation, a voice input operation, etc., which is not limited in the embodiments of the present disclosure.

[0072] Please combine Figure 4 For example, the original URL may be https: / / xxxxxxxxxx. Based on the original URL, the main interface of the comic generation webpage entered by default selects bedtime stories as the target comic type. After entering the main interface of the comic generation webpage, in response to a comic type setting operation triggered on the main interface of the comic generation webpage, a new target comic type (e.g., safety education) may be selected from a plurality of candidate comic types to enter a theme setting interface corresponding to the new target comic type.

[0073] In another specific example, the “in response to the comic type setting operation, displaying a theme setting interface corresponding to the target comic type” in step S201-1 may also include:

[0074] In response to the comic type setting operation, the original URL is modified to obtain a target URL, so as to enter a theme setting interface corresponding to the target comic type based on the target URL.

[0075] The comic type setting operation may be a keyboard input operation, a voice input operation, etc., and the embodiment of the present disclosure does not limit this.

[0076] Please combine Figure 5 For example, the original URL may be https: / / xxxxxxxxxx, and in response to the comic type setting operation, the original URL may be modified to obtain the target URL. The target URL may be https: / / xxxxxxxxxxkeyword=target comic type (e.g., safety education). Thereafter, the second electronic device may enter a theme setting interface corresponding to the target comic type based on the target URL.

[0077] That is, in the disclosed embodiment, the second electronic device can not only select a target comic type from a plurality of candidate comic types in response to a comic type setting operation triggered on the main interface of the comic generation webpage when the main interface of the comic generation webpage has been entered, so as to enter a theme setting interface corresponding to the target comic type, but can also modify the original URL (i.e., the URL pointing to the main interface of the comic generation webpage) in response to the comic type setting operation to obtain a target URL, so as to enter a theme setting interface corresponding to the target comic type based on the target URL. In this way, a diversified way of entering the theme setting interface corresponding to the target comic type can be provided for the user, so that the user can flexibly select according to their own needs, thereby improving the user experience.

[0078] Further, in a specific example, the step S201-1 of "obtaining a target comic theme in response to a comic theme setting operation triggered on a theme setting interface corresponding to the target comic type" may include:

[0079] In response to a comic theme setting operation triggered on a theme setting interface corresponding to a target comic type, a target comic theme input in a theme editing window is obtained.

[0080] The comic theme setting operation may be a keyboard input operation, a voice input operation, etc., and the embodiments of the present disclosure do not limit this.

[0081] Please combine Figure 6For example, after entering the theme setting interface corresponding to the target comic type (e.g., safety education), the target comic theme entered in the theme editing window can be obtained in response to the comic theme setting operation triggered on the theme setting interface corresponding to the target comic type. Here, the target comic theme is: Help me create a comic, and the theme is: Playing with fire is dangerous - cultivate children's awareness of fire safety.

[0082] In another specific example, the step S201-1 of "obtaining a target comic theme in response to a comic theme setting operation triggered on a theme setting interface corresponding to a target comic type" may also include:

[0083] In response to a comic theme setting operation triggered on a theme setting interface corresponding to a target comic type, a target comic theme is selected from a plurality of candidate comic themes under the target comic type.

[0084] As mentioned above, in addition to displaying the target comic type, the theme setting interface corresponding to the target comic type can also display other candidate comic types (for example, bedtime stories, poetry enlightenment, character development, emotions & relationships, and cognitive science) in addition to the target comic type. At the same time, the theme setting interface corresponding to the target comic type can also provide a theme editing window for inputting the target comic theme, and a first virtual button for triggering a request processing operation. Under this premise, the theme editing window can also provide a second virtual button for triggering a theme window display operation. In response to the theme window display operation, a comic theme selection window can be displayed in the theme setting interface corresponding to the target comic type, and multiple candidate comic themes under the target comic type can be displayed in the comic theme selection window. In this way, the user can trigger the comic theme setting operation in the comic theme selection window and select the target comic theme from multiple candidate comic themes under the target comic type.

[0085] For example, if the target comic genre is bedtime stories, multiple candidate comic themes under the target comic genre may include:

[0086] (1) The fairy’s magic wand: proactively solve problems when faced with them.

[0087] (2) The Prince’s Adventure in the Deep Forest—Searching for Courage and Exploring the Unknown.

[0088] (3) Sit back and wait for the rabbit to come to you - don’t “get something for nothing and be inflexible”.

[0089] …

[0090] For example, if the target comic genre is poetry enlightenment, multiple candidate comic themes under the target comic genre may include:

[0091] (1) Ode to the Goose—Luo Binwang, Tang Dynasty.

[0092] (2) Climbing the Quehe Tower—Wang Zhihuan, Tang Dynasty.

[0093] (3) “Out to the Frontier” by Wang Changling, Tang Dynasty.

[0094] …

[0095] For example, if the target comic genre is bedtime stories, multiple candidate comic themes under the target comic genre may include:

[0096] (1) The fairy’s magic wand: proactively solve problems when faced with them.

[0097] (2) The Prince’s Adventure in the Deep Forest—Searching for Courage and Exploring the Unknown.

[0098] (3) Sit back and wait for the rabbit to come to you - don’t “get something for nothing and be inflexible”.

[0099] …

[0100] For example, if the target comic type is safety education, multiple candidate comic topics under the target comic type may include:

[0101] (1) Say no to bullying—cultivate children’s anti-bullying awareness.

[0102] (2) Playing with fire is dangerous - cultivate children's awareness of fire safety.

[0103] (3) Do not open the door to strangers - cultivate children's awareness of being wary of strangers.

[0104] …

[0105] For example, if the target comic genre is character development, multiple candidate comic themes under the target comic genre may include:

[0106] (1) The victory of the little rabbits: Sharing and cooperation are the keys to the city’s success.

[0107] (2) Frog in the Well - Break the limitations of cognition and broaden your horizons.

[0108] (3) Yugong moves mountains - perseverance and persistence.

[0109] …

[0110] For example, if the target comic genre is emotion & relationship, multiple candidate comic themes under the target comic genre may include:

[0111] (1) Express anger reasonably - let children express their emotions reasonably and actively solve problems when faced with difficulties.

[0112] (2) Respond to challenges calmly - let children not panic when encountering problems, but solve them calmly and proactively.

[0113] (3) Learn to say “no” – let children know how to refuse others.

[0114] …

[0115] For example, if the target comic genre is cognitive science, multiple candidate comic themes under the target comic genre may include:

[0116] (1) What’s in the forest? – Understanding nature (popular science about forest animals).

[0117] (2) What is in the ocean? - Understanding nature (popular science on ocean knowledge).

[0118] (3) Their occupations - understanding human society (social occupational science popularization).

[0119] …

[0120] Please combine Figure 7 , exemplarily, in addition to displaying the target comic type, the theme setting interface corresponding to the target comic type (e.g., safety education) can also display other candidate comic types (e.g., bedtime stories, poetry enlightenment, character development, emotions & relationships, and cognitive science) in multiple candidate comic types. At the same time, the theme setting interface corresponding to the target comic type can also provide a theme editing window 701 for displaying the target comic theme, and a first virtual button 702 for triggering a request processing operation. Under this premise, the theme editing window 701 can also provide a second virtual button 701-1 for triggering a theme window display operation. Among them, the second virtual button 701-1 can be a "simulated story library (directly selectable)" button; in response to the theme window display operation, a comic theme selection window 703 can be displayed in the theme setting interface corresponding to the target comic type, and multiple candidate comic themes under the target comic type can be displayed in the comic theme selection window 703. In this way, the user can trigger the comic theme setting operation in the comic theme selection window 703 and select the target comic theme from multiple candidate comic themes under the target comic type. Specifically, by clicking the "go to use" button corresponding to the target comic theme, the comic theme setting operation can be triggered, the display page of the theme editing window 701 can be jumped back, and the target comic theme can be displayed in the theme editing window 701. Here, the target comic theme is "playing with fire is dangerous" - cultivating children's awareness of fire safety.

[0121] That is, in the disclosed embodiment, the second electronic device can not only obtain the target comic theme input in the theme editing window in response to the comic theme setting operation triggered on the theme setting interface corresponding to the target comic type, but also select the target comic theme from multiple candidate comic themes under the target comic type in response to the comic theme setting operation triggered on the theme setting interface corresponding to the target comic type. In this way, a diversified method for obtaining the target comic theme can be provided for the user, so that the user can flexibly select according to their own needs, thereby improving the user experience.

[0122] In the above manner, in the embodiment of the present disclosure, the second electronic device can respond to the comic type setting operation, display the theme setting interface corresponding to the target comic type, and respond to the comic theme setting operation triggered on the theme setting interface corresponding to the target comic type, to obtain the target comic theme. In this way, the user can not only continuously perform comic type setting and comic theme setting in the same setting process, thereby improving the efficiency of comic creation, but also complete the comic type setting and comic theme setting completely according to their own needs, so as to ensure that the target comic type and the target comic theme are highly consistent with the user's expectations, thereby improving the user experience.

[0123] Step S201 - 2 , in response to the script acquisition request processing operation, sending a script acquisition request carrying the target comic theme to the first electronic device.

[0124] The script acquisition request processing operation may be a mouse click operation, a touch operation, a voice input operation, etc., which is not limited in the embodiments of the present disclosure; the first electronic device may be used to generate a comic story based on the target comic theme carried in the script acquisition request, and split the comic story to obtain multiple initial storyboard scripts. Here, the first electronic device may generate 10 to 20 initial storyboard scripts by default.

[0125] In one example, the first electronic device can use a large language model to generate a comic story based on the target comic theme carried in the script acquisition request, and split the comic story to obtain multiple initial storyboard scripts. Among them, the large language model can be a pre-trained neural network model, which has general language knowledge, world knowledge, professional knowledge in various fields, etc., and is stored in the model in the form of parameters. Specifically, the large language model can be an autoregressive generative model of the Transformer architecture.

[0126] Further, in the disclosed embodiment, the second electronic device can send a script acquisition request carrying a target comic type and a target comic theme to the first electronic device in response to the script acquisition request processing operation, so that the first electronic device generates a comic story based on the target comic type and the target comic theme carried in the script acquisition request, and splits the comic story to obtain multiple initial storyboards. For example, the first electronic device uses a large language model to generate a comic story based on the target comic type and the target comic theme carried in the script acquisition request, and splits the comic story to obtain multiple initial storyboards. In this way, the user experience can be further improved by improving the fit between the generated comic story and the user's expectations and improving the fit between the multiple initial storyboards and the user's expectations.

[0127] Step S201-3, receiving and displaying multiple initial storyboard scripts.

[0128] The multiple initial storyboard scripts may be text information in a lightweight markup language (eg, Markdown format).

[0129] Step S201-4, based on the multiple initial storyboards, obtain multiple target storyboards.

[0130] In one example, multiple initial storyboards may be used as multiple target storyboards.

[0131] In another example, the second electronic device can edit multiple initial storyboards in response to the storyboard editing operation to obtain multiple target storyboards to improve the fit between the multiple target storyboards and the user's expectations, thereby improving the user experience. The storyboard editing operation can be a keyboard input operation, a voice input operation, etc., which is not limited in the embodiments of the present disclosure; editing multiple initial storyboards can be adding, deleting or modifying the multiple initial storyboards.

[0132] Please combine Figure 8 For example, the first electronic device splits the comic story "Little Rabbit Playing with Fire" and obtains 14 initial storyboards, including:

[0133] 1.The little rabbit hops and plays in the forest.

[0134] 2. Tiaotiao saw a fire in the distance and went over to it curiously.

[0135] 3. Tiaotiao thought, what is fire? It looks very interesting.

[0136] 4. It found a small stick and tried to get closer to the fire.

[0137] 5. Suddenly, the small wooden stick was lit, and Tiaotiao was so scared that he threw it away quickly.

[0138] 6. Tiao Tiao jumped up in panic, but the fire grew stronger and stronger.

[0139] 7. Tiaotiao was scared because he remembered what his mother had said: playing with fire is very dangerous.

[0140] 8. Tiaotiao asked the animals in the forest to help put out the fire.

[0141] …

[0142] 13. Tiaotiao also became more sensible, and he played happily with the other boys in the forest.

[0143] 14. They learned how to use fire safely and how to protect themselves.

[0144] After that, by clicking the "Edit Script" button and triggering the storyboard editing operation, multiple initial storyboards are edited. For example, the first initial storyboard "The little rabbit jumps and plays in the forest" is modified to "On a sunny morning, the little rabbit jumps and plays in the forest" as a target storyboard; for another example, an initial storyboard "Every corner of the forest is full of laughter and joy, and the little animals live a happy life" is added as the 15th target storyboard. Finally, 15 target storyboards can be obtained, including:

[0145] 1.On a sunny morning, the little rabbit jumped and played in the forest.

[0146] 2. Tiaotiao saw a fire in the distance and went over to it curiously.

[0147] 3. Tiaotiao thought, what is fire? It looks very interesting.

[0148] 4. It found a small stick and tried to get closer to the fire.

[0149] 5. Suddenly, the small wooden stick was lit, and Tiaotiao was so scared that he threw it away quickly.

[0150] 6. Tiao Tiao jumped up in panic, but the fire grew stronger and stronger.

[0151] 7. Tiaotiao was scared because he remembered what his mother had said: playing with fire is very dangerous.

[0152] 8. Tiaotiao asked the animals in the forest to help put out the fire.

[0153] …

[0154] 13. Tiaotiao also became more sensible, and he played happily with the other boys in the forest.

[0155] 14. They learned how to use fire safely and how to protect themselves.

[0156] 15. Every corner of the forest is filled with laughter and joy, and the little animals live a happy life.

[0157] After obtaining 15 target storyboards, you can click the "Generate Comics" button to trigger the comic generation request processing operation to enter the subsequent step - step S102, that is, "respond to the comic generation request processing operation, send a comic generation request carrying multiple target storyboards to the first electronic device."

[0158] Through step S201-1, step S201-2, step S201-3 and step S201-4, in the embodiment of the present disclosure, the second electronic device can obtain the target comic theme, and in response to the script acquisition request processing operation, send the script acquisition request carrying the target comic theme to the first electronic device, so that the first electronic device generates a comic story based on the target comic theme carried in the script acquisition request, and then splits the comic story to obtain multiple initial storyboard scripts, after which the second electronic device can receive and display the multiple initial storyboard scripts, and obtain multiple target storyboard scripts based on the multiple initial storyboard scripts. That is to say, in the embodiment of the present disclosure, in addition to being directly generated by user input, multiple target comic scripts can also be automatically generated through the interaction between the second electronic device and the first electronic device, thereby further improving the efficiency of comic creation.

[0159] In some optional implementations, step S102, that is, "sending a comic generation request carrying multiple target storyboards to the first electronic device in response to the comic generation request processing operation" may include:

[0160] Determining a user preferred style; wherein the user preferred style includes at least one of a target painting style and a target dubbing style;

[0161] Generate a comic generation request carrying multiple target storyboards and user preferred styles;

[0162] In response to the comic generation request processing operation, the comic generation request is sent to a first electronic device; wherein the first electronic device is used to generate a target comic picture book based on multiple target storyboards and user preference styles carried in the comic generation request, and dub the target comic picture book to obtain a first target audio comic.

[0163] Among them, the target painting style can be any one of multiple candidate painting styles (for example, fresh cartoon, childlike illustration and 3D cartoon); the target dubbing style can be any one of multiple candidate dubbing styles (for example, gentle sister, magnetic affection, warm commentary and lyrical sweetness).

[0164] In one example, the second electronic device can select a target painting style from multiple candidate painting styles in response to a painting style selection operation, and select a target dubbing style from multiple candidate dubbing styles in response to a dubbing style selection operation. The painting style selection operation and the dubbing style selection operation can be a mouse click operation, a touch operation, a voice input operation, etc., which is not limited in the embodiments of the present disclosure.

[0165] After determining the user's preferred style, the second electronic device may generate a comic generation request carrying multiple target storyboards and the user's preferred style, and in response to the comic generation request processing operation, send the comic generation request to the first electronic device, so that the first electronic device generates a target comic picture book based on the multiple target storyboards and the user's preferred style carried in the comic generation request, and dubs the target comic picture book to obtain a first target audio comic. The target comic picture book may be a comic picture book in Bdjson format and subjected to Gaussian blur processing.

[0166] In one example, the first electronic device can use a multimodal large model to generate a target comic book based on multiple target storyboards and user preference styles carried in a comic generation request, and dub the target comic book processed by Gaussian blur to obtain a first target audio comic. For example, the first electronic device can use a multimodal large model to understand the target painting style in the multiple target storyboards and user preference styles carried in the comic generation request, generate a comic book to be adjusted, and by understanding the multiple target storyboards, user preference styles, and the relationship between the elements (e.g., characters, animals, other items, backgrounds) in the comic book to be adjusted, perform typesetting adjustments (e.g., the size, color, and position adjustment of each element, as well as the size, color, and position adjustment of subtitles) to generate a target comic book, and dub the target comic book based on the target dubbing style in the user preference style to obtain a first target audio comic. Among them, the multimodal large model can be a multimodal model constructed using a large language model, which can also include an image encoder and a bridging component in addition to the large language model. Among them, the image encoder is connected to the large language model through a bridging component. Here, the image encoder is pre-trained and has a general image encoding function, which is used to encode the input target image to obtain an image encoding result; the bridging component is used to perform feature conversion on the image encoding result to obtain a feature conversion result that can be understood by the large language model, that is, the bridging component is used to align the visual feature space of the image encoder to the text feature space of the large language model.

[0167] Please combine Fig. 9 For example, the second electronic device may select a childlike illustration as the target painting style from a plurality of candidate painting styles (e.g., fresh cartoon, childlike illustration, and 3D cartoon) in response to the painting style selection operation, and select a lyrical sweetness as the target dubbing style from a plurality of candidate dubbing styles (e.g., gentle sister, magnetic affection, warm commentary, and lyrical sweetness) in response to the dubbing style selection operation. Thereafter, the second electronic device may generate a comic generation request carrying a plurality of target storyboards and a user preferred style. The plurality of target storyboards include:

[0168] 1.On a sunny morning, the little rabbit jumped and played in the forest.

[0169] 2. Tiaotiao saw a fire in the distance and went over to it curiously.

[0170] 3. Tiaotiao thought, what is fire? It looks very interesting.

[0171] 4. It found a small stick and tried to get closer to the fire.

[0172] 5. Suddenly, the small wooden stick was lit, and Tiaotiao was so scared that he threw it away quickly.

[0173] 6. Tiao Tiao jumped up in panic, but the fire grew stronger and stronger.

[0174] 7. Tiaotiao was scared because he remembered what his mother had said: playing with fire is very dangerous.

[0175] 8. Tiaotiao asked the animals in the forest to help put out the fire.

[0176] …

[0177] 13. Tiaotiao also became more sensible, and he played happily with the other boys in the forest.

[0178] 14. They learned how to use fire safely and how to protect themselves.

[0179] 15. Every corner of the forest is filled with laughter and joy, and the little animals live a happy life.

[0180] After the second electronic device generates a comic generation request carrying multiple target storyboards and user preferred styles, it can trigger the comic generation request processing operation by clicking the "Generate Comics" button, and send the comic generation request to the first electronic device, so that the first electronic device uses the multimodal large model to generate a target comic picture book based on the multiple target storyboards carried in the comic generation request and the target painting style in the user preferred style, and dubs the target comic picture book based on the target dubbing style in the user preferred style to obtain a first target audio comic.

[0181] Through the above method, in the embodiment of the present disclosure, the second electronic device can determine the user's preferred style (including at least one of the target painting style and the target dubbing style), and generate a comic generation request carrying multiple target storyboards and the user's preferred style, and then respond to the comic generation request processing operation, send the comic generation request to the first electronic device, so that the first electronic device generates a target comic picture book based on the multiple target storyboards and the user's preferred style carried in the comic generation request, and dubs the target comic picture book to obtain the first target audio comic. In this way, it can be ensured that the first target audio comic is highly consistent with the user's preferred style, thereby improving the user experience.

[0182] In some optional implementations, the comic generation request includes a comic drawing request and a comic dubbing request, and the comic drawing request carries multiple target storyboards. Based on this, in the embodiment of the present disclosure, step S102, that is, "responding to the comic generation request processing operation, sending the comic generation request carrying multiple target storyboards to the first electronic device" may also include:

[0183] In response to the comic drawing operation, a comic drawing request is sent to the first electronic device; wherein the first electronic device is used to generate an initial comic book based on the multiple target storyboards carried in the comic generation request;

[0184] Receive and display the initial comic book;

[0185] When a confirmation operation for an initial comic picture book is detected, a comic dubbing request is sent to a first electronic device in response to the confirmation operation; wherein the first electronic device is used to respond to the comic dubbing request, use the initial comic picture book as a target comic picture book, dub the target comic picture book, and obtain a first target audio comic.

[0186] The comic drawing operation and confirmation operation may be a mouse click operation, a touch operation, a voice input operation, etc., which is not limited in the embodiments of the present disclosure.

[0187] In one example, the second electronic device may send a comic drawing request to the first electronic device in response to the comic drawing operation, so that the first electronic device generates an initial comic picture book based on multiple target storyboards carried in the comic generation request using a multimodal large model. In a specific example, the first electronic device may generate an initial comic picture book based on multiple target storyboards carried in the comic generation request and a target painting style in the user's preferred style using a multimodal large model. The target painting style may be any one of multiple candidate painting styles (e.g., fresh cartoons, childlike illustrations, and 3D cartoons).

[0188] In one example, after receiving and displaying the initial comic book and detecting a confirmation operation for the initial comic book, the second electronic device can send a comic dubbing request to the first electronic device in response to the confirmation operation, so that the first electronic device uses the multimodal large model, takes the initial comic book as the target comic book, and dubs the target comic book to obtain a first target audio comic. In a specific example, the first electronic device can use the multimodal large model, take the initial comic book as the target comic book, and call the text to speech (TTS) function to dub the target comic book based on the target dubbing style in the user's preferred style to obtain a first target audio comic. The target dubbing style can be any one of a plurality of candidate dubbing styles (e.g., gentle sister, magnetic affection, warm commentary, and lyrical sweetness).

[0189] In addition, it should be noted that in the disclosed embodiment, the second electronic device may also send an initial comic redrawing request to the first electronic device in response to a negative operation on the initial comic book, so that the first electronic device generates a new initial comic book based on the multiple target storyboards carried in the comic generation request in response to the initial comic redrawing request. Thereafter, the second electronic device may receive and display the new initial comic book, and in response to a confirmation operation on the new initial comic book, send a comic dubbing request to the first electronic device in response to the confirmation operation; wherein the first electronic device is used to respond to the comic dubbing request and use the new initial comic book as the target comic book to dub the target comic book to obtain the first target audio comic.

[0190] Through the above method, in the embodiment of the present disclosure, the second electronic device can respond to the comic drawing operation and send a comic drawing request to the first electronic device, so that the first electronic device generates an initial comic picture book based on the multiple target storyboards carried in the comic generation request. After that, the second electronic device can receive and display the initial comic picture book, and in the case of detecting a confirmation operation for the initial comic picture book, in response to the confirmation operation, send a comic dubbing request to the first electronic device, so that the first electronic device responds to the comic dubbing request and uses the initial comic picture book as the target comic picture book to dub the target comic picture book to obtain the first target audio comic. In this way, it can be ensured that the first target audio comic is obtained by using the initial comic user confirmed by the user as the target comic picture book and dubbing the target comic picture book. Therefore, the first target audio comic meets the user's expectations and can improve the user experience.

[0191] In some optional implementations, step S103, i.e., “receiving and playing the first target audio comic” may:

[0192] Polling the first electronic device to generate and display user prompt information when it is determined that the first electronic device has generated a target comic picture book based on the multiple target storyboards carried in the comic generation request, and dubbed the target comic picture book to obtain a first target audio comic;

[0193] In response to the first comic play operation, a first target audio comic is received and played.

[0194] Among them, displaying the user prompt information can be a displayed third virtual button. Here, the third virtual button can be a "play comic" button. Based on this, in the embodiment of the present disclosure, the first comic playback operation can be triggered by clicking the third virtual button. In addition, in one example, after the second electronic device generates and displays the user prompt information, if the first comic playback operation is detected, a server-sent event (SSE) request can be sent to the first electronic device in response to the first comic playback operation, and the first target audio comic is received and played page by page.

[0195] For example, please combine Fig.10 The second electronic device can poll the first electronic device to generate and display user prompt information, that is, a third virtual button (for example, a "play comic" button) after determining that the first electronic device has generated a target comic picture book based on multiple target storyboards carried in the comic generation request and dubbed the target comic picture book to obtain a first target audio comic. Thereafter, the first comic playback operation can be triggered by clicking the third virtual button to receive and play the first target audio comic.

[0196] In addition, it should be noted that in the disclosed embodiment, the first electronic device can also generate a target comic picture book based on the multiple target storyboards carried in the comic generation request, dub the target comic picture book, and after obtaining the first target audio comic, generate a text message prompt carrying a prompt URL (that is, a URL pointing to the playback page of the first target audio comic), and send the text message prompt to the user. In this way, the user can directly enter the playback page of the first target audio comic based on the prompt URL.

[0197] In the above manner, in the disclosed embodiment, the second electronic device can poll the first electronic device to generate and display user prompt information when it is determined that the first electronic device has generated a target comic book based on multiple target storyboards carried in the comic generation request, and dubbed the target comic book to obtain a first target audio comic, and in response to the first comic playback operation, receive and play the first target audio comic. On the one hand, since the comic generation process of "generating a target comic book based on multiple target storyboards carried in the comic generation request, and dubbing the target comic book to obtain a first target audio comic" takes several minutes (for example, 5 minutes), the user is informed through the user prompt information that the comic generation process has been completed, which can reduce the user's subjective waiting time for the first target audio comic; on the other hand, only when the first comic playback operation is triggered, will the first comic playback operation be responded to, and the first target audio comic be received and played, thereby avoiding the waste of communication resources.

[0198] In some optional implementations, the comic generation method may further include:

[0199] Sending a work sharing request for a first target audio comic to a first electronic device;

[0200] The first electronic device is used to store the first target audio comic in the shared comic library in response to the work sharing request. That is, in the embodiment of the present disclosure, the first electronic device can store the first target audio comic as a shareable comic in the shared comic library in response to the work sharing request. In one example, the first electronic device can classify and store the first target audio comic based on the comic type to which the first target audio comic belongs.

[0201] Based on this, in the embodiment of the present disclosure, the comic generation method may further include:

[0202] In response to the audio comic selection request processing operation, sending the audio comic selection request carrying the comic identification information to the first electronic device; wherein the first electronic device is used to select a second target audio comic from the shared comic library of the first electronic device based on the comic identification information carried in the audio comic selection request;

[0203] In response to the second comic play operation, a second target audio comic is received and played.

[0204] The comic identification information may be a comic serial number, a comic name, etc., which is not limited in the embodiments of the present disclosure.

[0205] In one example, after the second electronic device responds to the inventory viewing operation to display the comic identification information (e.g., comic name) of multiple sharable comics provided by the shared comic library, it can respond to the audio comic selection request processing operation to send an audio comic selection request carrying the comic identification information to the first electronic device, so that the first electronic device selects the second target audio comic from the shared comic library of the first electronic device based on the comic identification information carried in the audio comic selection request. Thereafter, the second electronic device can respond to the second comic playback operation to receive and play the second target audio comic. For example, in response to the second comic playback operation, an SSE request can be sent to the first electronic device to receive and play the second target audio comic page by page.

[0206] Among them, the inventory viewing operation and the audio comic selection request processing operation can be a mouse click operation, a touch operation, a voice input operation, etc., and the embodiment of the present disclosure does not limit this.

[0207] Please combine Fig.11, exemplarily, in addition to displaying the target comic type, the theme setting interface corresponding to the target comic type (e.g., safety education) can also display other candidate comic types (e.g., bedtime stories, poetry enlightenment, character development, emotions & relationships, and cognitive science) in addition to the target comic type. At the same time, the theme setting interface corresponding to the target comic type can also provide a theme editing window 1101 for displaying the target comic theme, a first virtual button 1102 for triggering a request processing operation, and a shared comic storage window 1103. Among them, the shared comic storage window 1103 displays some sharable comics in the shared comic library (e.g., comic identification information is a sharable comic of a kitten sleeping soundly, comic identification information is a sharable comic of a tiger paying homage to his teacher, etc.), and clicking on any sharable comic in this part of the sharable comics can trigger an inventory viewing operation and enter the shared comic library synchronization window 1104.

[0208] Thereafter, you can click on the second target audio comic under any comic type in the shared comic library synchronization window 1104 (for example, a sharable comic with comic identification information that says no to "bullying") to trigger an audio comic selection request processing operation, and send an audio comic selection request carrying comic identification information (here, the comic identification information of the second target audio comic) to the first electronic device, so that the first electronic device selects the second target audio comic from the shared comic library of the first electronic device based on the comic identification information carried in the audio comic selection request. Thereafter, the second electronic device can receive and play the second target audio comic in response to the second comic playback operation.

[0209] Through the above method, in the embodiment of the present disclosure, the second electronic device can send a work sharing request for the first target audio comic to the first electronic device, so that the first electronic device responds to the work sharing request and stores the first target audio comic in the shared comic library. Based on this, in the example of the present disclosure, the second electronic device can also respond to the audio comic selection request processing operation and send the audio comic selection request carrying comic identification information to the first electronic device, so that the first electronic device selects the second target audio comic from the shared comic library of the first electronic device based on the comic identification information carried in the audio comic selection request. After that, the second electronic device can respond to the second comic playback operation to receive and play the second target audio comic. In this way, the comic sharing mechanism can provide users with generated and rich shareable comics, thereby meeting users' more efficient and diversified comic playback needs.

[0210] The present disclosure also provides a comic book generation method, which can be applied to a first electronic device. The first electronic device can be a server. Fig.12The flowchart diagram shown is used to illustrate a comic book generation method provided by an embodiment of the present disclosure. It should be noted that although a logical sequence is shown in the flowchart diagram, in some cases, the steps shown or described may also be performed in other sequences.

[0211] Step S1201, receiving a comic generation request carrying multiple target storyboards.

[0212] Each of the target storyboards in the plurality of target storyboards is used to describe a target storyboard screen in the first target audio comic to be generated, and the target storyboard screen may include character images, character actions, character expressions, background details, etc. Here, the character images may be people, animals, other objects, etc.

[0213] Step S1202: Generate a target comic book based on multiple target storyboards carried in the comic generation request, and dub the target comic book to obtain a first target audio comic.

[0214] The target comic book may include multiple target storyboards corresponding to multiple target storyboard scripts. Based on this, in the disclosed embodiment, when dubbing the target comic book, each of the multiple target storyboards can be used as a picture to be dubbed, and the target storyboard script corresponding to the picture to be dubbed is used to dub the picture to be dubbed.

[0215] Step S1202: Send the first target audio comic to the second electronic device.

[0216] By adopting the comic generation method provided by the embodiment of the present disclosure, a first electronic device can receive a comic generation request carrying multiple target storyboards, and based on the multiple target storyboards carried in the comic generation request, generate a target comic picture book, and dub the target comic picture book to obtain a first target audio comic, and then send the first target audio comic to a second electronic device, so that the second electronic device receives and plays the first target audio comic. In this way, not only can the efficiency of comic creation be improved by replacing the traditional manual hand-drawing technology with an automated comic creation process, but also the comic expression form is enriched by incorporating sound elements, thus meeting the dual needs of users in the digital age for efficient creation and diversified experience.

[0217] In some optional implementations, the comic generation method may further include:

[0218] Receive a script acquisition request carrying a target comic theme;

[0219] Generate a comic story based on the target comic theme carried in the script acquisition request;

[0220] Split the comic story to obtain multiple initial storyboards;

[0221] Sending multiple initial storyboards to a second electronic device; wherein the second electronic device is used to receive and display the multiple initial storyboards, and obtain multiple target storyboards based on the multiple initial storyboards.

[0222] The target comic theme can be used to represent the theme information of the first target audio comic to be generated. For example, the target comic theme can be "The fairy's magic wand - facing difficulties and solving them actively"; for another example, the target comic theme can be "Ode to the Goose - Luo Binwang of the Tang Dynasty"; for another example, the target comic theme can be "The fairy's magic wand - facing difficulties and solving them actively".

[0223] Here, the target comic theme may be acquired by the second electronic device, and the second electronic device may acquire the target comic theme in the following manner:

[0224] In response to the comic type setting operation, displaying a theme setting interface corresponding to the target comic type;

[0225] In response to a comic theme setting operation triggered on a theme setting interface corresponding to a target comic type, a target comic theme is obtained.

[0226] In one example, “in response to the comic type setting operation, displaying a theme setting interface corresponding to the target comic type” may include:

[0227] In the case where the main interface of the comic generation webpage has been entered, in response to a comic type setting operation triggered on the main interface of the comic generation webpage, a target comic type is selected from a plurality of candidate comic types to enter a theme setting interface corresponding to the target comic type;

[0228] Alternatively, in response to the comic type setting operation, the original URL is modified to obtain a target URL, so as to enter a theme setting interface corresponding to the target comic type based on the target URL.

[0229] In one example, “obtaining a target comic theme in response to a comic theme setting operation triggered on a theme setting interface corresponding to a target comic type” may include:

[0230] In response to a comic theme setting operation triggered on a theme setting interface corresponding to a target comic type, obtaining a target comic theme input in a theme editing window;

[0231] Alternatively, in response to a comic theme setting operation triggered on a theme setting interface corresponding to the target comic type, a target comic theme is selected from a plurality of candidate comic themes under the target comic type.

[0232] Thereafter, the second electronic device may send a script acquisition request carrying a target comic theme to the first electronic device in response to the script acquisition request processing operation. Thereafter, the first electronic device may generate a comic story based on the target comic theme carried in the script acquisition request, and split the comic story to obtain multiple initial storyboards, and then send the multiple initial storyboards to the second electronic device, so that the second electronic device receives and displays the multiple initial storyboards, and obtains multiple target storyboards based on the multiple initial storyboards. In an example, the first electronic device may use a large language model to generate a comic story based on the target comic theme carried in the script acquisition request, and split the comic story to obtain multiple initial storyboards, and then send the multiple initial storyboards to the second electronic device, so that the second electronic device receives and displays multiple initial storyboards, and obtains multiple target storyboards based on the multiple initial storyboards. Wherein, the multiple initial storyboards may be text information in a lightweight markup language (e.g., Markdown format).

[0233] Through the above method, in the embodiment of the present disclosure, the first electronic device receives a script acquisition request carrying a target comic theme, and generates a comic story based on the target comic theme carried in the script acquisition request, and then splits the comic story to obtain multiple initial storyboard scripts, and sends the multiple initial storyboard scripts to the second electronic device, so that the second electronic device receives and displays the multiple initial storyboard scripts, and obtains multiple target storyboard scripts based on the multiple initial storyboard scripts. That is to say, in the embodiment of the present disclosure, multiple target comic scripts can be automatically generated through the interaction between the second electronic device and the first electronic device, thereby further improving the efficiency of comic creation.

[0234] Furthermore, in the disclosed embodiment, the script acquisition request also carries the target comic type. Based on this, in the disclosed embodiment, "generating a comic story based on the target comic theme carried in the script acquisition request" may include:

[0235] Generate a comic story based on the target comic type and target comic theme carried in the script acquisition request.

[0236] In one example, the first electronic device can use the large language model to generate a comic story based on the target comic type and the target comic theme carried in the script acquisition request. Thereafter, the first electronic device splits the comic story to obtain multiple initial storyboards. In this way, the user experience can be further improved by improving the fit between the generated comic story and the user's expectations and improving the fit between the multiple initial storyboards and the user's expectations.

[0237] In some optional implementations, the comic generation request also carries a user preferred style, and the user preferred style includes at least one of a target drawing style and a target dubbing style. Based on this, in the disclosed embodiment, step S1202, that is, "generating a target comic picture book based on multiple target storyboards carried in the comic generation request, and dubbing the target comic picture book to obtain a first target audio comic" may include:

[0238] Based on multiple target storyboards and user preferred styles carried in the comic generation request, a target comic picture book is generated, and the target comic picture book is dubbed to obtain a first target audio comic.

[0239] In one example, the first electronic device can use a multimodal large model to generate a target comic picture book based on multiple target storyboards and user preferred styles carried in a comic generation request, and dub the target comic picture book after Gaussian blur processing to obtain a first target audio comic. For example, the first electronic device can use a multimodal large model to understand multiple target storyboards and target painting styles in the user preferred style carried in the comic generation request, generate a comic picture book to be adjusted, and by understanding multiple target storyboards, user preferred styles, and the relationship between various elements (e.g., characters, animals, other objects, backgrounds) in the comic picture book to be adjusted, perform typesetting adjustments (e.g., size, color, position adjustment of each element, and subtitle size, subtitle color, and subtitle position adjustment) to generate a target comic picture book, and dub the target comic picture book based on the target dubbing style in the user preferred style to obtain a first target audio comic.

[0240] In the above manner, in the disclosed embodiment, the first electronic device can generate a target comic book based on the multiple target storyboards and the user's preferred style carried in the comic generation request, and dub the target comic book to obtain a first target audio comic. In this way, it can be ensured that the first target audio comic is highly consistent with the user's preferred style, thereby improving the user experience.

[0241] In some optional implementations, the comic generation request includes a comic drawing request and a comic dubbing request, and the comic drawing request carries the multiple target storyboards. Based on this, in the disclosed embodiment, step S1202, that is, "generating a target comic picture book based on the multiple target storyboards carried in the comic generation request, and dubbing the target comic picture book to obtain a first target audio comic" may also include:

[0242] Generate an initial comic book based on multiple target storyboards carried in the comic generation request;

[0243] Sending the initial comic book to a second electronic device; wherein the second electronic device is used to receive and display the initial comic book;

[0244] Upon receiving a comic dubbing request sent by the second electronic device to the first electronic device after detecting a confirmation operation for an initial comic picture book and responding to the confirmation operation, in response to the comic dubbing request, the initial comic picture book is used as a target comic picture book to dub the target comic picture book to obtain a first target audio comic.

[0245] In one example, the first electronic device can generate an initial comic book based on multiple target storyboards carried in the comic generation request using a multimodal macro model. In a specific example, the first electronic device can generate an initial comic book based on multiple target storyboards carried in the comic generation request and a target painting style in the user's preferred style using a multimodal macro model. The target painting style can be any one of multiple candidate painting styles (e.g., fresh cartoons, childlike illustrations, and 3D cartoons).

[0246] In one example, after the second electronic device receives and displays the initial comic book, detects a confirmation operation for the initial comic book, and sends a comic dubbing request to the first electronic device in response to the confirmation operation, the first electronic device can use the multimodal large model to take the initial comic book as the target comic book, dub the target comic book, and obtain a first target audio comic. In a specific example, the first electronic device can use the multimodal large model to take the initial comic book as the target comic book, and call the TTS function to dub the target comic book based on the target dubbing style in the user's preferred style, and obtain a first target audio comic. The target dubbing style can be any one of a plurality of candidate dubbing styles (e.g., gentle sister, magnetic affection, warm commentary, and lyrical sweetness).

[0247] In addition, it should be noted that in the embodiment of the present disclosure, the second electronic device may also send an initial comic redrawing request to the first electronic device upon detecting a negative operation on the initial comic picture book and in response to the negative operation. After the first electronic device receives the initial comic redrawing request, it may respond to the initial comic redrawing request and generate a new initial comic picture book based on the multiple target storyboards carried in the comic generation request. Thereafter, the second electronic device may receive and display the new initial comic picture book, and upon detecting a confirmation operation on the new initial comic picture book, send a comic dubbing request to the first electronic device in response to the confirmation operation. In this way, the first electronic device may respond to the comic dubbing request and use the new initial comic picture book as the target comic picture book to dub the target comic picture book to obtain the first target audio comic.

[0248] Through the above method, in the embodiment of the present disclosure, the first electronic device can generate an initial comic picture book based on multiple target storyboards carried in the comic generation request, and send the initial comic picture book to the second electronic device; wherein the second electronic device is used to receive and display the initial comic picture book, and then, when the second electronic device detects a confirmation operation for the initial comic picture book and responds to the confirmation operation, sends a comic dubbing request to the first electronic device, responds to the comic dubbing request, takes the initial comic picture book as the target comic picture book, and dubs the target comic picture book to obtain the first target audio comic. In this way, it can be ensured that the first target audio comic is obtained by taking the initial comic confirmed by the user as the target comic picture book and dubbing the target comic picture book, so that the first target audio comic meets the user's expectations and can improve the user experience.

[0249] In some optional implementations, the comic generation method may further include:

[0250] In case of receiving a work sharing request for the first target audio comic sent by the second electronic device, the first target audio comic is stored in a shared comic library in response to the work sharing request.

[0251] In one example, the first electronic device may classify and store the first target audio comics based on the comic genre to which the first target audio comics belong.

[0252] Based on this, in the embodiment of the present disclosure, the comic generation method may further include:

[0253] receiving a request for selecting an audio comic that carries comic identification information;

[0254] Selecting a second target audio comic from a shared comic library of the first electronic device based on the comic identification information carried in the audio comic selection request;

[0255] The second target audio comic is sent to the second electronic device.

[0256] The comic identification information may be a comic serial number, a comic name, etc., which is not limited in the embodiments of the present disclosure.

[0257] Through the above method, in the embodiment of the present disclosure, when the first electronic device receives a work sharing request for the first target audio comic sent by the second electronic device, it can respond to the work sharing request and store the first target audio comic in the shared comic library. Based on this, in the example of the present disclosure, the first electronic device can also receive an audio comic selection request carrying comic identification information, and select the second target audio comic from the shared comic library of the first electronic device based on the comic identification information carried in the audio comic selection request, and then send the second target audio comic to the second electronic device. In this way, the comic sharing mechanism can provide users with generated and rich shareable comics, thereby meeting users' more efficient and diversified comic playback needs.

[0258] The following will be combined Fig.13 , an interaction process involved in the second electronic device and the first electronic device executing the comic generation method in an embodiment of the present disclosure is introduced.

[0259] (1) The second electronic device obtains the comic theme.

[0260] (2) In response to the script acquisition request processing operation, the second electronic device sends a script acquisition request carrying the target comic type and the target comic theme to the first electronic device.

[0261] (3) The first electronic device generates a comic story based on the target comic type and the target comic theme carried in the script acquisition request, splits the comic story to obtain multiple initial storyboard scripts, and sends the multiple initial storyboard scripts to the second electronic device.

[0262] (4) The second electronic device edits the multiple initial storyboards in response to the storyboard editing operation to obtain multiple target storyboards.

[0263] (5) The second electronic device determines the user's preferred style and generates a comic generation request that carries multiple target storyboards and the user's preferred style, and then sends the comic generation request to the first electronic device in response to the comic generation request processing operation.

[0264] (6) The first electronic device generates a target comic picture book based on the multiple target storyboards and the user's preferred style carried in the comic generation request, and dubs the target comic picture book to obtain a first target audio comic.

[0265] (7) The second electronic device polls the first electronic device to generate and display user prompt information when it is determined that the first electronic device has generated a target comic picture book based on the multiple target storyboards carried in the comic generation request, and dubbed the target comic picture book to obtain the first target audio comic.

[0266] (8) The second electronic device receives and plays the first target audio comic in response to the first comic playing operation.

[0267] See also Fig.14 , which is a scene diagram of a comic generation method provided in an embodiment of the present disclosure.

[0268] As mentioned above, the comic generation method provided by the embodiment of the present disclosure is applied to an electronic device. The electronic device may be a second electronic device or a first electronic device. Here, the second electronic device may be a terminal device, for example, a conventional computer (desktop computer, laptop computer, etc.), a car computer, a tablet computer, a smart phone, a personal digital assistant or other similar computing device; the first electronic device may be a server.

[0269] When the electronic device is a second electronic device, it is used to:

[0270] Get multiple target storyboards;

[0271] In response to the comic generation request processing operation, a comic generation request carrying multiple target storyboards is sent to a first electronic device; wherein the first electronic device is used to generate a target comic picture book based on the multiple target storyboards carried in the comic generation request, and dub the target comic picture book to obtain a first target audio comic;

[0272] Receive and play the first target audio comic.

[0273] When the electronic device is a first electronic device, it is used to:

[0274] receiving a comic generation request carrying multiple target storyboards;

[0275] Based on the multiple target storyboards carried in the comic generation request, a target comic picture book is generated, and the target comic picture book is dubbed to obtain a first target audio comic;

[0276] The first target audio comic is sent to the second electronic device.

[0277] It should be noted that in the embodiments of the present disclosure, Fig.14 The scene diagram shown is only illustrative and not restrictive. Those skilled in the art can Fig.14 Various obvious changes and / or substitutions are made to the examples, and the obtained technical solutions still fall within the scope of the disclosure of the embodiments of the present disclosure.

[0278] In order to better implement the comic generation method applied to the second electronic device, the embodiment of the present disclosure also provides a comic generation device, which can be integrated in the second electronic device. The second electronic device can be a terminal device, for example, a conventional computer (desktop computer, laptop computer, etc.), a car computer, a tablet computer, a smart phone, a personal digital assistant or other similar computing devices. Fig.15 The schematic structural block diagram shown is used to illustrate a comic generation device 1500 provided in the disclosed embodiment.

[0279] The comic generation device 1500 includes:

[0280] The script acquisition unit 1501 is used to acquire multiple target storyboard scripts;

[0281] The comic generation request sending unit 1502 is used to send a comic generation request carrying multiple target storyboards to the first electronic device in response to the comic generation request processing operation; wherein the first electronic device is used to generate a target comic picture book based on the multiple target storyboards carried in the comic generation request, and dub the target comic picture book to obtain a first target audio comic;

[0282] The first audio comic receiving unit 1503 is used to receive and play the first target audio comic.

[0283] In some optional implementations, the script acquisition unit 1501 is used to:

[0284] Get the target comic theme;

[0285] In response to the script acquisition request processing operation, a script acquisition request carrying a target comic theme is sent to a first electronic device; wherein the first electronic device is used to generate a comic story based on the target comic theme carried in the script acquisition request, and split the comic story to obtain a plurality of initial storyboard scripts;

[0286] Receive and display multiple initial storyboards;

[0287] Based on the multiple initial storyboards, multiple target storyboards are obtained.

[0288] In some optional implementations, the script acquisition unit 1501 is used to:

[0289] In response to the comic type setting operation, displaying a theme setting interface corresponding to the target comic type;

[0290] In response to a comic theme setting operation triggered on a theme setting interface corresponding to a target comic type, a target comic theme is obtained.

[0291] In some optional implementations, the script acquisition unit 1501 is used to:

[0292] In the case where the main interface of the comic generation webpage has been entered, in response to a comic type setting operation triggered on the main interface of the comic generation webpage, a target comic type is selected from a plurality of candidate comic types to enter a theme setting interface corresponding to the target comic type;

[0293] Alternatively, in response to the comic type setting operation, the original URL is modified to obtain a target URL, so as to enter a theme setting interface corresponding to the target comic type based on the target URL; wherein the original URL points to the main interface of the comic generation webpage.

[0294] In some optional implementations, the script acquisition unit 1501 is used to:

[0295] In response to a comic theme setting operation triggered on a theme setting interface corresponding to a target comic type, obtaining a target comic theme input in a theme editing window;

[0296] Alternatively, in response to a comic theme setting operation triggered on a theme setting interface corresponding to the target comic type, a target comic theme is selected from a plurality of candidate comic themes under the target comic type.

[0297] In some optional implementations, the script acquisition unit 1501 is used to:

[0298] In response to a script acquisition request processing operation, a script acquisition request carrying a target comic type and a target comic theme is sent to a first electronic device; wherein the first electronic device is used to generate a comic story based on the target comic type and the target comic theme carried in the script acquisition request, and split the comic story to obtain multiple initial storyboard scripts.

[0299] In some optional implementations, the script acquisition unit 1501 is used to:

[0300] In response to the storyboard editing operation, multiple initial storyboards are edited to obtain multiple target storyboards.

[0301] In some optional implementations, the comic generation request sending unit 1502 is used to:

[0302] Determining a user preferred style; wherein the user preferred style includes at least one of a target painting style and a target dubbing style;

[0303] Generate a comic generation request carrying multiple target storyboards and user preferred styles;

[0304] In response to the comic generation request processing operation, the comic generation request is sent to a first electronic device; wherein the first electronic device is used to generate a target comic picture book based on multiple target storyboards and user preference styles carried in the comic generation request, and dub the target comic picture book to obtain a first target audio comic.

[0305] In some optional implementations, the comic generation request includes a comic drawing request and a comic dubbing request, and the comic drawing request carries multiple target storyboards; the comic generation request sending unit 1502 is used to:

[0306] In response to the comic drawing operation, a comic drawing request is sent to the first electronic device; wherein the first electronic device is used to generate an initial comic book based on the multiple target storyboards carried in the comic generation request;

[0307] Receive and display the initial comic book;

[0308] When a confirmation operation for an initial comic picture book is detected, a comic dubbing request is sent to a first electronic device in response to the confirmation operation; wherein the first electronic device is used to respond to the comic dubbing request, use the initial comic picture book as a target comic picture book, dub the target comic picture book, and obtain a first target audio comic.

[0309] In some optional implementations, the first audio comic receiving unit 1503 is used to:

[0310] Polling the first electronic device to generate and display user prompt information when it is determined that the first electronic device has generated a target comic picture book based on the multiple target storyboards carried in the comic generation request, and dubbed the target comic picture book to obtain a first target audio comic;

[0311] In response to the first comic play operation, a first target audio comic is received and played.

[0312] In some optional implementations, the comic generation device 1500 further includes a work sharing request server sending unit, which is used to:

[0313] A work sharing request for a first target audio comic is sent to a first electronic device; wherein the first electronic device is used to store the first target audio comic in a shared comic library in response to the work sharing request.

[0314] In some optional implementations, the comic generation device 1500 further includes:

[0315] The audio comic selection request sending unit is used to send the audio comic selection request carrying the comic identification information to the first electronic device in response to the audio comic selection request processing operation; wherein the first electronic device is used to select the second target audio comic from the shared comic library of the first electronic device based on the comic identification information carried in the audio comic selection request;

[0316] The second audio comic receiving unit is used to receive and play a second target audio comic in response to a second comic playing operation.

[0317] For the description of the specific functions and examples of each unit of the comic generation device 1500 of the embodiment of the present disclosure, reference can be made to the relevant description of the corresponding steps in the aforementioned comic generation method embodiment applied to the service device, and will not be repeated here.

[0318] In order to better implement the comic generation method applied to the first electronic device, the embodiment of the present disclosure also provides a comic generation device, which can be integrated in the first electronic device. The first electronic device can be a server. Fig.16 The schematic structural block diagram shown is used to illustrate a comic generation device 1600 provided in the disclosed embodiment.

[0319] The comic generation device 1600 includes:

[0320] A comic generation request receiving unit 1601 is used to receive a comic generation request carrying multiple target storyboards;

[0321] The comic generation unit 1602 is used to generate a target comic picture book based on multiple target storyboards carried in the comic generation request, and dub the target comic picture book to obtain a first target audio comic;

[0322] The first audio comic sending unit 1603 is used to send the first target audio comic to the second electronic device.

[0323] In some optional implementations, the comic generation device 1600 further includes:

[0324] A script acquisition request receiving unit, used to receive a script acquisition request carrying a target comic theme;

[0325] A comic story generating unit, used to generate a comic story based on a target comic theme carried in a script acquisition request;

[0326] An initial storyboard script acquisition unit is used to split the comic story to obtain multiple initial storyboard scripts;

[0327] The target storyboard script acquisition unit is used to send multiple initial storyboard scripts to the second electronic device; wherein the second electronic device is used to receive and display the multiple initial storyboard scripts, and obtain multiple target storyboard scripts based on the multiple initial storyboard scripts.

[0328] In some optional implementations, the script acquisition request further carries a target comic type; the comic story generation unit is used to:

[0329] Generate a comic story based on the target comic type and target comic theme carried in the script acquisition request.

[0330] In some optional implementations, the comic generation request further carries a user preferred style, and the user preferred style includes at least one of a target painting style and a target dubbing style; the comic generation unit 1602 is used to:

[0331] Based on multiple target storyboards and user preferred styles carried in the comic generation request, a target comic picture book is generated, and the target comic picture book is dubbed to obtain a first target audio comic.

[0332] In some optional implementations, the comic generation request includes a comic drawing request and a comic dubbing request, and the comic drawing request carries multiple target storyboards; the comic generation unit 1602 is used to:

[0333] Generate an initial comic book based on multiple target storyboards carried in the comic generation request;

[0334] Sending the initial comic book to a second electronic device; wherein the second electronic device is used to receive and display the initial comic book;

[0335] Upon receiving a comic dubbing request sent by the second electronic device to the first electronic device after detecting a confirmation operation for an initial comic picture book and responding to the confirmation operation, in response to the comic dubbing request, the initial comic picture book is used as a target comic picture book to dub the target comic picture book to obtain a first target audio comic.

[0336] In some optional implementations, the comic generation device 1600 further includes a shared comic library expansion unit, which is used to:

[0337] In case of receiving a work sharing request for the first target audio comic sent by the second electronic device, the first target audio comic is stored in a shared comic library in response to the work sharing request.

[0338] In some optional implementations, the comic generation device 1600 further includes:

[0339] An audio comic selection request receiving unit, used for receiving an audio comic selection request carrying comic identification information;

[0340] An audio comic selection unit, configured to select a second target audio comic from a shared comic library of the first electronic device based on the comic identification information carried in the audio comic selection request;

[0341] The second audio comic sending unit is used to send the second target audio comic to the second electronic device.

[0342] For the description of the specific functions and examples of each unit of the comic generation device 1600 of the embodiment of the present disclosure, reference can be made to the relevant description of the corresponding steps in the aforementioned embodiment of the comic generation method applied to the second electronic device, and will not be repeated here.

[0343] In the technical solution disclosed herein, the acquisition, storage and application of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0344] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.

[0345] Fig.17 A schematic block diagram of an example electronic device 1700 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0346] like Fig.17 As shown, the device 1700 includes a computing unit 1701, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 1702 or a computer program loaded from a storage unit 1708 to a random access memory (RAM) 1703. In RAM 1703, various programs and data required for the operation of the device 1700 can also be stored. The computing unit 1701, ROM 1702, and RAM 1703 are connected to each other via a bus 1704. An input / output (I / O) interface 1705 is also connected to the bus 1704.

[0347] A number of components in the device 1700 are connected to the I / O interface 1705, including: an input unit 1706, such as a keyboard, a mouse, etc.; an output unit 1707, such as various types of displays, speakers, etc.; a storage unit 1708, such as a disk, an optical disk, etc.; and a communication unit 1709, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 1709 allows the device 1700 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0348] The computing unit 1701 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 1701 include, but are not limited to, a CPU, a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The computing unit 1701 performs the various methods and processes described above, such as the comic generation method. For example, in some embodiments, the comic generation method may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 1708. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 1700 via the ROM 1702 and / or the communication unit 1709. When the computer program is loaded into the RAM 1703 and executed by the computing unit 1701, one or more steps in the comic generation method described above may be performed. Alternatively, in other embodiments, the computing unit 1701 may be configured as a comics generating method in any other appropriate manner (eg, by means of firmware).

[0349] Various embodiments of the systems and techniques described above herein may be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0350] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine as a stand-alone software package and partially on a remote machine, or entirely on a remote machine or server.

[0351] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a RAM, a ROM, an erasable programmable read-only memory (EPROM) or a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0352] To provide interaction with a user, the systems and techniques described herein may be implemented on a computer having: a display device (e.g., a cathode ray tube (CRT) display or a liquid crystal display (LCD)) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices are also used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0353] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: Local Area Network (LAN), Wide Area Network (WAN), and the Internet.

[0354] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server combined with a blockchain.

[0355] The embodiment of the present disclosure also provides a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to enable the computer to execute a comic generation method.

[0356] The embodiment of the present disclosure also provides a computer program product, including a computer program, which implements the comic generation method when executed by a processor.

[0357] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in the present disclosure can be executed in parallel, sequentially or in a different order, as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, and this document is not limited here. In addition, in the present disclosure, relational terms such as "first", "second", "third", etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply the existence of any such actual relationship or order between these entities or operations. In addition, "multiple" in the present disclosure can be understood as at least two.

[0358] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the principles of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A comic generation method, comprising: Get multiple target storyboards; In response to the comic generation request processing operation, a comic generation request carrying the multiple target storyboards is sent to a first electronic device; wherein the first electronic device is used to generate a target comic picture book based on the multiple target storyboards carried in the comic generation request, and dub the target comic picture book to obtain a first target audio comic; Receive and play the first target audio comic.

2. The method according to claim 1, wherein: The step of obtaining multiple target storyboards includes: Get the target comic theme; In response to the script acquisition request processing operation, a script acquisition request carrying the target comic theme is sent to the first electronic device; wherein the first electronic device is used to generate a comic story based on the target comic theme carried in the script acquisition request, and split the comic story to obtain a plurality of initial storyboard scripts; receiving and displaying the plurality of initial storyboards; Based on the multiple initial storyboards, the multiple target storyboards are obtained.

3. The method according to claim 2, wherein: The step of obtaining the target comic theme includes: In response to the comic type setting operation, displaying a theme setting interface corresponding to the target comic type; In response to a comic theme setting operation triggered on a theme setting interface corresponding to the target comic type, the target comic theme is obtained.

4. The method according to claim 3, wherein: The method of displaying a theme setting interface corresponding to a target comic type in response to the comic type setting operation includes: In the case where the main interface of the comic generation webpage has been entered, in response to the comic type setting operation triggered on the main interface of the comic generation webpage, the target comic type is selected from a plurality of candidate comic types to enter a theme setting interface corresponding to the target comic type; Alternatively, in response to the comic type setting operation, the original resource locator is modified to obtain a target resource locator, so as to enter a theme setting interface corresponding to the target comic type based on the target resource locator; wherein the original resource locator points to the main interface of the comic generation webpage.

5. The method according to claim 3, wherein: The step of obtaining the target comic theme in response to a comic theme setting operation triggered on a theme setting interface corresponding to the target comic type comprises: In response to the comic theme setting operation triggered on the theme setting interface corresponding to the target comic type, obtaining the target comic theme input in the theme editing window; Alternatively, in response to the comic theme setting operation being triggered on a theme setting interface corresponding to the target comic type, the target comic theme is selected from a plurality of candidate comic themes under the target comic type.

6. The method according to claim 3, wherein: The step of sending the script acquisition request carrying the target comic theme to the first electronic device in response to the script acquisition request processing operation includes: In response to the script acquisition request processing operation, a script acquisition request carrying the target comic type and the target comic theme is sent to the first electronic device; wherein the first electronic device is used to generate the comic story based on the target comic type and the target comic theme carried in the script acquisition request, and split the comic story to obtain the multiple initial storyboard scripts.

7. The method according to claim 2, wherein: The step of obtaining the plurality of target storyboards based on the plurality of initial storyboards comprises: In response to the storyboard editing operation, the multiple initial storyboards are edited to obtain the multiple target storyboards.

8. The method according to any one of claims 1 to 7, wherein: The step of sending the comic generation request carrying the plurality of target storyboards to the first electronic device in response to the comic generation request processing operation includes: Determining a user preferred style; wherein the user preferred style includes at least one of a target painting style and a target dubbing style; Generate the comic generation request carrying the multiple target storyboards and the user preferred style; In response to the comic generation request processing operation, the comic generation request is sent to the first electronic device; wherein the first electronic device is used to generate the target comic picture book based on the multiple target storyboards carried in the comic generation request and the user preferred style, and dub the target comic picture book to obtain the first target audio comic.

9. The method according to any one of claims 1 to 7, wherein: The comic generation request includes a comic drawing request and a comic dubbing request, and the comic drawing request carries the multiple target storyboards; and in response to the comic generation request processing operation, sending the comic generation request carrying the multiple target storyboards to the first electronic device includes: In response to the comic drawing operation, sending the comic drawing request to the first electronic device; wherein the first electronic device is used to generate an initial comic drawing book based on the multiple target storyboards carried in the comic drawing request; Receiving and displaying the initial comic book; When a confirmation operation for the initial comic picture book is detected, a comic dubbing request is sent to the first electronic device in response to the confirmation operation; wherein the first electronic device is used to respond to the comic dubbing request and use the initial comic picture book as the target comic picture book to dub the target comic picture book to obtain the first target audio comic.

10. The method according to any one of claims 1 to 7, wherein: The receiving and playing the first target audio comic comprises: polling the first electronic device to generate and display user prompt information if it is determined that the first electronic device has generated the target comic picture book based on the multiple target storyboards carried in the comic generation request, and dubbed the target comic picture book to obtain the first target audio comic; In response to the first comic play operation, the first target audio comic is received and played.

11. The method according to claim 1, further comprising: A work sharing request for the first target audio comic is sent to the first electronic device; wherein the first electronic device is used to store the first target audio comic in a shared comic library in response to the work sharing request.

12. The method according to claim 1 or 11, further comprising: In response to the audio comic selection request processing operation, sending the audio comic selection request carrying comic identification information to the first electronic device; wherein the first electronic device is used to select a second target audio comic from a shared comic library of the first electronic device based on the comic identification information carried in the audio comic selection request; In response to the second comic play operation, the second target audio comic is received and played.

13. A comic generation method, comprising: receiving a comic generation request carrying multiple target storyboards; Based on the multiple target storyboards carried in the comic generation request, generate a target comic picture book, and dub the target comic picture book to obtain a first target audio comic; The first target audio comic is sent to the second electronic device.

14. The method according to claim 13, further comprising: Receive a script acquisition request carrying a target comic theme; Generate a comic story based on the target comic theme carried in the script acquisition request; Splitting the comic story to obtain a plurality of initial storyboard scripts; The multiple initial storyboards are sent to the second electronic device; wherein the second electronic device is used to receive and display the multiple initial storyboards, and obtain the multiple target storyboards based on the multiple initial storyboards.

15. The method according to claim 14, wherein: The script acquisition request also carries a target comic type; and generating a comic story based on the target comic theme carried in the script acquisition request includes: The comic story is generated based on the target comic type and the target comic theme carried in the script acquisition request.

16. The method according to any one of claims 13 to 15, wherein: The comic generation request also carries a user preferred style, and the user preferred style includes at least one of a target painting style and a target dubbing style; generating a target comic picture book based on the multiple target storyboards carried in the comic generation request, and dubbing the target comic picture book to obtain a first target audio comic, including: Based on the multiple target storyboards carried in the comic generation request and the user preferred style, the target comic picture book is generated, and the target comic picture book is dubbed to obtain the first target audio comic.

17. The method according to any one of claims 13 to 15, wherein: The comic generation request includes a comic drawing request and a comic dubbing request, and the comic drawing request carries the multiple target storyboards; generating a target comic picture book based on the multiple target storyboards carried in the comic generation request, and dubbing the target comic picture book to obtain a first target audio comic, including: Generate an initial comic book based on the multiple target storyboards carried in the comic drawing request; Sending the initial comic book to the second electronic device; wherein the second electronic device is used to receive and display the initial comic book; Upon receiving a comic dubbing request sent by the second electronic device to the first electronic device upon detecting a confirmation operation for the initial comic picture book and in response to the confirmation operation, in response to the comic dubbing request, the initial comic picture book is used as the target comic picture book to dub the target comic picture book to obtain the first target audio comic.

18. The method according to claim 13, further comprising: In case of receiving a work sharing request for the first target audio comic sent by the second electronic device, the first target audio comic is stored in a shared comic library in response to the work sharing request.

19. The method according to claim 18, further comprising: receiving a request for selecting an audio comic that carries comic identification information; Selecting a second target audio comic from a shared comic library of the first electronic device based on the comic identification information carried in the audio comic selection request; The second target audio comic is sent to the second electronic device.

20. A comic generation device, comprising: A script acquisition unit, used for acquiring multiple target storyboard scripts; A comic generation request sending unit is used to send a comic generation request carrying the multiple target storyboards to a first electronic device in response to a comic generation request processing operation; wherein the first electronic device is used to generate a target comic picture book based on the multiple target storyboards carried in the comic generation request, and dub the target comic picture book to obtain a first target audio comic; The first audio comic receiving unit is used to receive and play the first target audio comic.

21. A comic generation device, comprising: A comic generation request receiving unit, used for receiving a comic generation request carrying a plurality of target storyboards; A comic generation unit, configured to generate a target comic picture book based on the multiple target storyboards carried in the comic generation request, and dub the target comic picture book to obtain a first target audio comic; The first audio comic sending unit is used to send the first target audio comic to the second electronic device.

22. An electronic device, comprising: at least one processor; a memory communicatively coupled to the at least one processor; The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can perform the method according to any one of claims 1 to 19.

23. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to cause the computer to execute the method according to any one of claims 1 to 19.

24. A computer program product, comprising a computer program, which, when executed by a processor, implements the method according to any one of claims 1 to 19.

Citation Information

Patent Citations

  • Cartoon synthesis method, device and apparatus and computer readable storage medium

    CN108320319A

  • Content generation method and device, computer equipment and storage medium

    CN117171369A

  • Scene create method for scenario production based on webtoon

    KR102473475B1

Cited By

  • Cross-modal cartoon content generation and personalized recommendation method and system based on AI

    CN120823278A