System

Abstract

A system is provided.SOLUTION: The system includes a means for inputting prompt information, a means for receiving and storing the prompt information in a database, an artificial intelligence means for generating a cartoon based on the stored prompt information, and a means for displaying the generated cartoon.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Traditionally, creating manga required advanced drawing skills and storytelling abilities. This made it difficult for people lacking these skills to create interesting manga and provide them to readers. Furthermore, there were still concerns about the reliability and quality of manga created using generative AI, resulting in few opportunities for it to be properly evaluated. Furthermore, if readers wanted to read a sequel to a story, the production process was time-consuming and costly, making it difficult to respond quickly. This invention aims to solve these problems and enable a diverse range of creators to easily create high-quality manga and provide it to readers. [Means for solving the problem]

[0005] The present invention is a system that includes a means for inputting prompt information, a means for receiving the prompt information and storing it in a database, an artificial intelligence means for generating a manga based on the stored prompt information, and a means for displaying the generated manga. This allows creators to input prompt information and have the artificial intelligence generate the manga based on that information, making it possible for creators to create interesting manga even without advanced drawing skills.

[0006] Furthermore, the system includes a means for the reader to request a sequel, a means for generating new prompt information based on the sequel request, and an artificial intelligence means for generating a sequel manga based on the new prompt information, thereby enabling the reader to quickly read the sequel to the story.

[0007] Furthermore, by including a means for checking the prompt information entered by the creator to check for errors and a means for notifying the creator of the presence or absence of errors, the accuracy and reliability of the prompt information can be ensured, and the quality of the generated manga can be improved.

[0008] "Prompt information" is information necessary for AI to generate manga, such as the manga's worldview, character settings, and story outline.

[0009] "Means for input" refers to an interface that allows a creator to input prompt information into the system.

[0010] "Means for receiving" refers to the function by which the system acquires the prompt information entered by the creator and processes the data.

[0011] "Means for saving in a database" is a function for systematically accumulating and storing received prompt information.

[0012] "Artificial intelligence means for generating manga" is a system that automatically generates manga using a computer program based on input prompt information.

[0013] "Means for displaying" refers to a function for displaying the generated manga on the user's device in a viewable form.

[0014] "Means for requesting sequels" refers to an interface through which readers can submit requests for sequels to a story.

[0015] "Means for generating new prompt information" is a function for constructing new stories and settings in response to requests for sequels.

[0016] The "means for checking for errors" is a function for checking whether the input prompt information is missing or has errors.

[0017] "Means for notifying" is a function for notifying creators whether or not there is an error in the prompt information. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0019] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0020] First, the terms used in the following description will be explained.

[0021] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0022] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0023] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0024] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0026] [First embodiment]

[0027] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0028] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0030] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0031] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0034] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0035] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0037] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0038] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0039] overview

[0040] This invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators. Creators register the prompt information, and readers can view the generated manga. If a reader requests a sequel, new prompt information can be generated and the sequel can be automatically generated.

[0041] Program processing

[0042] The program in this system performs a series of processes, from creators registering prompts to manga generation, reader viewing, and sequel generation. Each process is explained below in natural language.

[0043] Specific program behavior

[0044] 1. Enter prompt information and register

[0045] Device: Creators access the content generation platform and enter prompt information (e.g., worldview, character settings, story outline) into a dedicated form.

[0046] Device: Complete the prompt information and click the "Register" button.

[0047] Server: Receives prompt information sent from the creator's device and checks for missing data or errors.

[0048] Server: If there are no problems, save the prompt information to the database, generate a save completion message, and send it to the creator's device.

[0049] On your device: Display a registration success message to notify the creator that their prompt information was successfully saved.

[0050] 2. Readers' selection of AI manga artists and manga generation

[0051] Device: Readers log in to the platform and view a list of registered AI manga artists.

[0052] On your device: Select an AI manga artist based on the prompt you're interested in and click the "Start Generation" button.

[0053] Server: Sends the selected prompt information to the AI ​​and instructs it to generate a manga of about 20 pages.

[0054] AI model: Automatically generates storyboards, character designs, dialogue, and more based on given prompts.

[0055] Server: The generated manga data is stored in a database and sent to the reader's device.

[0056] Terminal: Displays the generated comic to the reader.

[0057] 3. Creating sequels and deepening characters

[0058] Device: After the reader finishes reading the manga, if they want to read the sequel, they can click the "Generate sequel" button.

[0059] Terminal: A sequel creation request is sent to the server.

[0060] Server: Generates new prompt information, taking into account previous scenes and reader feedback.

[0061] Server: Instructs the AI ​​to generate a sequel based on the new prompt information.

[0062] AI model: Generate sequel manga based on new prompt information, further digging into characters and storylines.

[0063] Server: The generated sequel manga data is stored in a database and sent to the reader's device.

[0064] Terminal: Display the sequel manga to the reader.

[0065] Specific examples

[0066] For example, a creator can input prompt information for the theme of "reincarnation in another world" and set the characters as "Hero" and "Demon King." Based on this prompt information stored in the database, the reader can select the "AI manga artist reincarnated in another world," and the first 20 pages of the manga will be generated. If the reader wants to continue reading the manga, they can click the "Generate sequel" button, and a sequel depicting new adventures and character growth will be automatically generated.

[0067] This allows creators to easily incorporate their ideas into their manga, and allows readers to enjoy the story without interruption. The system offers diverse storylines and deep character settings, ensuring a high-quality manga experience.

[0068] The processing flow will be explained below.

[0069] overview

[0070] This invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators. Creators register the prompt information, and readers can view the generated manga. If a reader requests a sequel, new prompt information can be generated and the sequel can be automatically generated.

[0071] Specific program behavior

[0072] 1. Enter prompt information and register

[0073] Step 1:

[0074] Device: Creators access the content generation platform and enter prompt information (e.g., worldview, character settings, story outline) into a dedicated form.

[0075] Step 2:

[0076] Device: Complete the prompt information and click the "Register" button.

[0077] Step 3:

[0078] Server: Receives prompt information sent from the creator's device and checks for missing data or errors.

[0079] Step 4:

[0080] Server: If there are no problems, save the prompt information to the database, generate a save completion message, and send it to the creator's device.

[0081] Step 5:

[0082] On your device: Display a registration success message to notify the creator that their prompt information was successfully saved.

[0083] 2. Readers' selection of AI manga artists and manga generation

[0084] Step 1:

[0085] Device: Readers log in to the platform and view a list of registered AI manga artists.

[0086] Step 2:

[0087] On your device: Select an AI manga artist based on the prompt you're interested in and click the "Start Generation" button.

[0088] Step 3:

[0089] Server: Sends the selected prompt information to the AI ​​and instructs it to generate a manga of about 20 pages.

[0090] Step 4:

[0091] AI model: Automatically generates storyboards, character designs, dialogue, and more based on given prompts.

[0092] Step 5:

[0093] Server: The generated manga data is stored in a database and sent to the reader's device.

[0094] Step 6:

[0095] Terminal: Displays the generated comic to the reader.

[0096] 3. Creating sequels and deepening characters

[0097] Step 1:

[0098] Device: After the reader finishes reading the manga, if they want to read the sequel, they can click the "Generate sequel" button.

[0099] Step 2:

[0100] Terminal: A sequel creation request is sent to the server.

[0101] Step 3:

[0102] Server: Generates new prompt information, taking into account previous scenes and reader feedback.

[0103] Step 4:

[0104] Server: Instructs the AI ​​to generate a sequel based on the new prompt information.

[0105] Step 5:

[0106] AI model: Generate sequel manga based on new prompt information, further digging into characters and storylines.

[0107] Step 6:

[0108] Server: The generated sequel manga data is stored in a database and sent to the reader's device.

[0109] Step 7:

[0110] Terminal: Display the sequel manga to the reader.

[0111] Specific examples

[0112] For example, a creator can input prompt information for the theme of "reincarnation in another world" and set the characters as "Hero" and "Demon King." Based on this prompt information stored in the database, the reader can select the "AI manga artist reincarnated in another world," and the first 20 pages of the manga will be generated. If the reader wants to continue reading the manga, they can click the "Generate sequel" button, and a sequel depicting new adventures and character growth will be automatically generated.

[0113] This allows creators to easily incorporate their ideas into their manga, and allows readers to enjoy the story without interruption. The system offers diverse storylines and deep character settings, ensuring a high-quality manga experience.

[0114] Example 1

[0115] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0116] On conventional manga creation platforms, the process for creators to create manga is complicated, especially the time-consuming process of inputting prompt information and checking for errors. Furthermore, when readers request sequels, the process must also be done manually, making it difficult to respond quickly. This places a heavy burden on creators and creates an unsmooth experience for readers.

[0117] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0118] In this invention, the server includes means for receiving prompt information, checking for missing data or errors, and saving the data in a database, artificial intelligence means for generating a manga based on the saved prompt information, and means for saving the generated manga data in a database and transmitting it to a terminal for display. This automates error checking of the prompt information, enabling manga to be generated quickly and efficiently, and enabling readers' requests for sequels to be responded to quickly, providing a smoother experience for both creators and readers.

[0119] "Prompt information" refers to data such as the worldview, character settings, and story outline that creators input to generate the manga.

[0120] "Check for missing or error data" means checking whether the received prompt information contains all the required data or whether there are any formatting errors.

[0121] "Saving in a database" means storing the received and confirmed prompt information in a predetermined database.

[0122] "Artificial intelligence means" refers to an artificial intelligence system or algorithm that automatically generates storyboards, character designs, dialogue, etc. for a manga based on input prompt information.

[0123] "Generated manga data" refers to various data related to manga (page layout, character design, dialogue, etc.) generated by artificial intelligence means.

[0124] A "means for requesting a sequel" is an interface that allows readers to request a sequel to a manga they have already read.

[0125] The "means for generating new prompt information" is a function for creating new prompt information required to generate a sequel.

[0126] "Creators" are users who input prompt information and provide content ideas and settings to generate comics.

[0127] MODE FOR CARRYING OUT THE INVENTION

[0128] overview

[0129] The present invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators. Creators register prompt information, and readers can view the generated manga. If a reader requests a sequel, new prompt information is generated, and the sequel is automatically generated. Specific embodiments of this system are described below.

[0130] Hardware and software used

[0131] Device: The device through which creators and readers access the platform, including computers, tablets, and smartphones.

[0132] Server: Receives prompt information, checks for errors, saves it to a database, runs the AI ​​model, and stores and distributes the generated manga data.

[0133] Generative AI model: An artificial intelligence system that generates manga based on prompt information. Specifically, it uses models that use deep learning and natural language processing.

[0134] Entering prompt information and registering

[0135] 1. Device: Creators log in to the platform and enter prompt information (world view, character settings, story outline, etc.) into a dedicated form. For example, for a theme of "reincarnation in another world," they enter "hero" and "demon king" as character settings.

[0136] 2. On the device: The creator enters the prompt information and clicks the "Register" button.

[0137] 3. Server: Receives the prompt information sent from the creator's device. The server checks for missing data or errors and saves the information in the database. Once saving is complete, the server sends a save completion message to the creator's device.

[0138] 4. Device: A Save Complete message will appear on the creator's device, notifying them that the prompt information has been successfully saved.

[0139] Readers' selection of AI manga artists and manga generation

[0140] 1. Device: The reader logs in to the platform and views the list of registered AI manga artists.

[0141] 2. On your device: Choose an AI manga artist based on the prompt you are interested in and click the "Start Generation" button. For example, choose "An AI Manga Artist Reincarnated in Another World."

[0142] 3. Server: Sends the selected prompt information to the generation AI model and instructs it to generate a manga of about 20 pages.

[0143] 4. Generative AI model: Automatically generates storyboards, character designs, dialogue, etc. based on given prompts.

[0144] 5. Server: Stores the generated manga data in a database and sends it to the reader's device.

[0145] 6. Terminal: The generated manga is displayed to the reader.

[0146] Creating sequels and deepening characters

[0147] 1. Device: After the reader finishes reading the manga, if they want to read the sequel, they can click the "Generate sequel" button.

[0148] 2. Terminal: A sequel creation request is sent to the server.

[0149] 3. Server: Generates new prompt information, taking into account previous scenes and reader feedback.

[0150] 4. Server: Instructs the generative AI model to generate a sequel based on the new prompt information.

[0151] 5. Generative AI model: Generate sequel manga based on new prompt information, further digging into characters and storylines.

[0152] 6. Server: The generated sequel manga data is stored in a database and sent to the reader's device.

[0153] 7. Terminal: The sequel manga will be displayed to the reader.

[0154] Specific examples

[0155] For example, a creator might enter prompt information on the theme of "reincarnation in another world" and set the characters as "Hero" and "Demon King." This prompt information is saved in the database. A reader selects "AI Manga Artist Reincarnated in Another World," and the first 20 pages of the manga are generated. If the reader wants to continue reading the manga, they can click the "Generate Sequel" button to generate new prompt information, and a sequel will be automatically generated based on that information.

[0156] This invention automates the process from inputting prompt information to generating manga and sequels, providing an efficient and smooth manga experience for both creators and readers.

[0157] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0158] Step 1: Enter prompt information

[0159] Device: Creators log in to the content generation platform and enter prompt information (world view, character settings, story outline, etc.) into a dedicated form.

[0160] Input: Prompt information entered by the creator.

[0161] Specific operation: The creator logs in by entering their username and password on the login screen, and then moves to the prompt information input form. With the theme of "reincarnation in another world," they enter "Hero" and "Demon King" as their character settings.

[0162] Step 2: Confirm prompt information and register

[0163] On your device: Creator completes the prompt information and clicks the "Register" button.

[0164] Input: The prompt information entered.

[0165] What happens: The creator fills in the fields on the form and clicks the "Register" button.

[0166] Step 3: Receive and check the prompt information

[0167] Server: Receives prompt information sent from the creator's device and checks for missing data or errors.

[0168] Input: Prompt information sent from the terminal.

[0169] Specific operation: The server analyzes the received prompt information, checks whether all required fields are filled in, whether the input format is correct, and if there is an error, generates an error message and sends it to the creator's device.

[0170] Step 4: Save the prompt information

[0171] Server: If there are no problems with the prompt information, it is saved in the database, and a save completion message is generated and sent to the creator's device.

[0172] Input: Prompt information that has passed the check.

[0173] Output: Save complete message.

[0174] Specific operation: Insert the normal prompt information into the database, check the save result, and then generate a save completion message.

[0175] Step 5: Displaying the registration completion message

[0176] On your device: Display a registration success message to notify the creator that their prompt information was successfully saved.

[0177] Input: Save complete message sent from the server.

[0178] Specific behavior: A save completion message will be displayed in a popup or in the notification bar.

[0179] Step 6: Display a list of AI manga artists

[0180] Device: Readers log in to the platform and view a list of registered AI manga artists.

[0181] Input: Reader login details.

[0182] Specific operation: After logging in, the reader clicks the "AI Manga Artist List" button to display a list of available AI Manga artists.

[0183] Step 7: Select prompt information and begin generation

[0184] On your device: Select an AI manga artist based on the prompt information you are interested in and click the "Start Generation" button.

[0185] Input: Reader selection information.

[0186] Specific operation: The reader goes to the details page of the AI ​​manga artist selected from the list and clicks the "Start generation" button.

[0187] Step 8: Manga Generation Instructions

[0188] Server: Sends the selected prompt information to the AI ​​and instructs it to generate a manga of about 20 pages.

[0189] Input: The selected prompt information.

[0190] Specific operation: Pass the selected prompt information to the AI ​​model, specify the number of pages to generate, and send a request to generate the manga.

[0191] Step 9: Generate manga data

[0192] Generative AI model: Automatically generates storyboards, character designs, dialogue, and more based on given prompts.

[0193] Input: The specified prompt information.

[0194] Output: The generated cartoon data.

[0195] How it works: The AI ​​model analyzes the received prompt information and applies a generative algorithm to generate each element of the manga (page layout, character design, dialogue).

[0196] Step 10: Save and send manga data

[0197] Server: The generated manga data is stored in a database and sent to the reader's device.

[0198] Input: Generated comic data.

[0199] Output: Manga data saving completion message and delivery.

[0200] Specific operation: The generated manga file is saved in the database, and the saved result is confirmed before being sent to the reader's device.

[0201] Step 11: Displaying the comic

[0202] Terminal: Displays the generated comic to the reader.

[0203] Input: Manga data sent from the server.

[0204] Specific operation: The manga data sent to the reader's device is displayed on the screen, and interactions such as page turning and zooming functions are provided.

[0205] Step 12: Sending a sequel generation request

[0206] Device: After the reader finishes reading the manga, if they want to read the sequel, they can click the "Generate sequel" button.

[0207] Input: Reader's sequel request.

[0208] Specific operation: The reader clicks the sequel generation button, and a sequel generation request is sent to the server.

[0209] Step 13: Generate new prompt information

[0210] Server: Generates new prompt information, taking into account previous scenes and reader feedback.

[0211] Input: Previous scene information and reader feedback.

[0212] Output: The new prompt information.

[0213] What happens: The server analyzes the previous prompt data and reader feedback and generates appropriate follow-up prompts.

[0214] Step 14: Instructions for generating sequels

[0215] Server: Instructs the generation AI model to generate a sequel based on the new prompt information.

[0216] Input: New prompt information.

[0217] Specific behavior: Sends new prompt information to the AI ​​model and sends a request to generate a sequel.

[0218] Step 15: Creating a sequel manga and digging deeper into the characters

[0219] Generative AI model: Generate sequel manga based on new prompt information, further developing characters and storylines.

[0220] Input: New prompt information.

[0221] Output: Sequel manga data.

[0222] What it does: The AI ​​model analyzes new prompts and generates continuing story and character progression based on previous prompts.

[0223] Step 16: Save and send the sequel manga data

[0224] Server: The generated sequel manga data is stored in a database and sent to the reader's device.

[0225] Input: Sequel manga data.

[0226] Output: Save completion message and delivery of sequel manga.

[0227] Specific operation: Save the sequel manga file in the database, check the saved result, and then send it to the reader's device.

[0228] Step 17: Displaying the sequel manga

[0229] Terminal: Display the sequel manga to the reader.

[0230] Input: Sequel manga data sent from the server.

[0231] Specific operation: Receive sequel manga data and display it on the screen.

[0232] (Application example 1)

[0233] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0234] With conventional manga generation platforms, even if creators input prompt information, it takes time for content based on that information to be generated, and when readers request a sequel, it is difficult to provide the sequel quickly. Furthermore, if the prompt information entered by the creator contains an error, checking and correcting the error requires a lot of effort, making efficient operation difficult. Furthermore, when generating a sequel, the characters and story are not explored in depth, which means readers' expectations cannot be met.

[0235] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0236] In this invention, the server includes a means for inputting prompt information, a means for receiving the prompt information and storing it in a database, an artificial intelligence means for generating a manga based on the stored prompt information, a means for displaying the generated manga, a means for a reader to request a sequel, a means for generating new prompt information based on the sequel request, and an artificial intelligence means for generating a sequel manga based on the new prompt information. This allows creators to easily register prompt information, and the artificial intelligence to instantly generate a manga based on that information, and also to generate and display sequels desired by readers in a timely manner. Furthermore, by generating more in-depth characters and stories based on the newly generated prompt information during the sequel generation process, it is possible to meet readers' expectations and provide continuous, high-quality content.

[0237] "Prompt information" is information entered by creators for content generation, including the theme, character settings, story outline, and the like.

[0238] The "database" is a system for storing and managing prompt information and generated comic data.

[0239] "Artificial intelligence means" refers to a program or system that has the function of generating a manga based on input prompt information.

[0240] "Generated comics" are comic content created by artificial intelligence means based on prompt information.

[0241] "Display means" refers to an interface that visually presents the generated manga to creators and readers.

[0242] The "sequel request means" is a function that allows readers to express their desire for a sequel to an existing manga.

[0243] The "means for generating new prompt information" is a function for creating new prompt information in response to a sequel request from a reader.

[0244] The "artificial intelligence means for generating a sequel manga" is a program or system that has the function of generating sequel manga content based on new prompt information.

[0245] The "error checking means" is a function that checks whether there are any omissions or errors in the prompt information entered by the creator.

[0246] The "notification means" is a function for notifying the creator if the prompt information contains an error.

[0247] "Deep dive" is a feature that develops characters and stories in more detail during the sequel generation process.

[0248] The present invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators. One embodiment of the present invention is a system that includes a server, a terminal, a database, an artificial intelligence model, and a display means.

[0249] 1. Enter prompt information and register

[0250] The user (creator) enters prompt information through their device. Specifically, the creator accesses the content generation platform and enters prompt information such as theme, character settings, and story outline into a dedicated form. This information includes topics such as "Reincarnation in Another World" and "The Hero and the Demon King." The creator then clicks the "Register" button and sends this information to the server.

[0251] The server checks the received prompt information for errors. If an error is found during this process, the creator's device is notified and they must correct it. If there are no problems, the prompt information is saved in the database.

[0252] 2. Manga Generation and Display

[0253] The reader logs in to the platform from their device and begins the process of generating a manga based on the registered prompt information. The reader selects the prompt they are interested in and clicks the "Start Generation" button. The server then sends the selected prompt information to the AI ​​model, instructing it to generate the manga.

[0254] The AI ​​model generates a manga according to the specified prompt information. During this process, storyboards, character designs, dialogue, etc. are automatically created. The generated manga data is stored in a database and then sent to the reader's device for display. For example, a first manga of about 20 pages on the theme of "reincarnation in another world" is generated.

[0255] 3. Creating sequels

[0256] If a reader wants a sequel after finishing a manga, they click the "Generate Sequel" button. The sequel request is sent to the server, and new prompt information is automatically generated. The server then instructs the AI ​​model to generate a sequel again based on the new prompt information. The newly generated sequel manga will include more in-depth characters and storylines.

[0257] The generated sequel manga data is also stored in a database and sent to the reader's device. For example, a sequel in which the hero obtains an important item on a new adventure may be generated.

[0258] Hardware and software used

[0259] The following hardware and software are used to implement this system:

[0260] Hardware:

[0261] Devices such as smartphones and tablets

[0262] Server (cloud-based)

[0263] software:

[0264] Programming language: Python

[0265] Web framework: Flask

[0266] Database: SQLite

[0267] AI Model: Custom generated AI model

[0268] Specific examples

[0269] For example, a creator enters the following prompt text for the "Isekai Tensei" theme:

[0270] plain text

[0271] Theme: Reincarnation in Another World

[0272] Characters: Hero and Demon King

[0273] Story summary: A hero is reincarnated into another world and begins his adventure to defeat the demon king.

[0274] The generated manga will have storyboards and character designs created by the AI ​​model, depicting an adventure in another world. If a reader wants a sequel, they can click the "Generate Sequel" button, and a sequel will be automatically generated in which the hero obtains an important item on a new adventure. This allows readers to enjoy the story without interruption.

[0275] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0276] Step 1:

[0277] The user (creator) accesses the content generation platform through their device and inputs prompt information. This prompt information includes the theme, character settings, and story outline. For example, information such as "Theme: Reincarnation in Another World," "Character Settings: Hero and Demon King," and "Story Outline: The hero is reincarnated in another world and begins an adventure to defeat the demon king" can be entered into the form. Once the input is complete, the creator clicks the "Register" button. The input prompt information is sent from the device to the server.

[0278] Step 2:

[0279] The server checks the prompt information received from the device and checks for missing data or errors. Specifically, it checks whether all required fields are included in the theme, character settings, and story summary, and whether the format is correct. If there are no errors, the prompt information is saved in the database. If an error is detected, the server generates an error message and notifies the creator's device. The creator then re-enters the prompt information to correct the error.

[0280] Step 3:

[0281] The user (reader) logs in to the platform from their device and requests the generation of a manga based on the registered prompt information. The reader selects the prompt that interests them and clicks the "Start Generation" button. This request is sent from the device to the server.

[0282] Step 4:

[0283] The server sends the selected prompt information to the AI ​​model, instructing it to generate the manga. The AI ​​model generates the manga content based on the prompt information. Specifically, it designs characters, creates storyboards, and arranges dialogue. Through these data processing and calculations, approximately 20 pages of manga are generated. The generated manga data is returned to the server and stored in a database.

[0284] Step 5:

[0285] After the manga data is saved in the database, the server sends it to the reader's device. The device displays the manga based on the received manga data. The reader can view the generated manga through their device.

[0286] Step 6:

[0287] If a reader wants a sequel after finishing a manga, they click the "Generate Sequel" button. This request is sent from the reader's device to the server. The server receives the sequel generation request and generates new prompt information, taking into account the previous prompt information and feedback from the reader.

[0288] Step 7:

[0289] Based on the newly generated prompt information, the server again instructs the AI ​​model to generate a manga. The AI ​​model generates sequel manga content based on the new prompt information. During the generation process, the characters and story are further developed. The generated sequel manga data is sent back to the server and stored in a database.

[0290] Step 8:

[0291] The saved sequel manga data is sent from the server to the reader's device. The device then displays the sequel manga to the reader based on the received sequel manga data. This allows the reader to enjoy the sequel to the story without interruption.

[0292] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0293] overview

[0294] This invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators. By combining it with an emotion engine that recognizes readers' emotions, the user experience is further improved. Creators can also register prompt information, allowing readers to view the generated manga. If a reader requests a sequel, new prompt information can be generated, and the sequel can be automatically generated.

[0295] Specific program behavior

[0296] 1. Enter prompt information and register

[0297] Creators access the content generation platform and enter prompt information (e.g., worldview, character settings, story outline) into a dedicated form. The entered prompt information is sent to the server and checked for missing data or errors. If there are no problems, the prompt information is saved in the database and a save completion message is sent to the creator.

[0298] 2. Readers' selection of AI manga artists and manga generation

[0299] Readers log in to the platform and browse a list of registered AI manga artists. They select an AI manga artist based on the prompt they are interested in and click the "Start Generation" button. The prompt information is sent to the AI, which generates a manga of about 20 pages. The generated manga data is stored in a database and sent to the reader's device, where it is displayed.

[0300] 3. Utilizing the Emotion Engine

[0301] While the reader is reading the manga, the emotion engine analyzes their facial expressions and reactions to collect emotional data. This emotional data is sent to a server, where the reader's emotions are analyzed. Based on the emotions recognized by the emotion engine, the story development of the generated manga is adjusted. For example, if the reader is smiling, the story will unfold in a brighter direction, and if the reader looks sad, a touching scene will be added.

[0302] 4. Creating sequels and deepening characters

[0303] After a reader finishes reading a manga, they click the "Generate sequel" button, which sends a sequel generation request to the server. The server generates new prompt information, taking into account the previous scene and the reader's feedback analyzed by the emotion engine. Based on the new prompt information, the AI ​​generates a sequel manga, digging deeper into the characters and story. The generated sequel manga data is saved in a database and sent to the reader's device, where it is displayed.

[0304] Specific examples

[0305] For example, a creator can enter prompt information on the theme of "reincarnation in another world" and set the characters as "Hero" and "Demon King." Based on this prompt information stored in the database, the reader can select the "Reincarnation in another world AI manga artist" and the first 20 pages of manga will be generated. As the reader continues to read this manga, the emotion engine will capture the reader's facial expressions, and if there are many smiles, the story will develop in an entertaining direction. If the reader wants to continue reading, they can click the "Generate sequel" button and a sequel depicting new adventures and character growth will be automatically generated.

[0306] This allows creators to easily incorporate their ideas into their manga, and readers can enjoy stories that suit their emotions at the time. This system provides diverse stories and in-depth character settings, ensuring a high-quality manga experience.

[0307] The processing flow will be explained below.

[0308] overview

[0309] This invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators, and improves the user experience by combining it with an emotion engine that recognizes readers' emotions. Creators can also register prompt information, and readers can view the generated manga, and sequels can also be created.

[0310] Specific program behavior

[0311] 1. Enter prompt information and register

[0312] Step 1:

[0313] Device: Creators access the content generation platform and enter prompt information (e.g., worldview, character settings, story outline) into a dedicated form.

[0314] Step 2:

[0315] Device: Creator enters the prompt information and clicks the "Register" button.

[0316] Step 3:

[0317] Server: Receives prompt information sent from the creator's device and checks for missing data or errors.

[0318] Step 4:

[0319] Server: If there are no problems, save the prompt information to the database, generate a save completion message, and send it to the creator's device.

[0320] Step 5:

[0321] On your device: A registration success message will appear, informing the creator that their prompt information was successfully saved.

[0322] 2. Readers' selection of AI manga artists and manga generation

[0323] Step 1:

[0324] Device: Readers log in to the platform and view a list of registered AI manga artists.

[0325] Step 2:

[0326] On your device: Select an AI manga artist based on the prompt you're interested in and click the "Start Generation" button.

[0327] Step 3:

[0328] Server: Sends the selected prompt information to the AI ​​and instructs it to generate a manga of about 20 pages.

[0329] Step 4:

[0330] AI model: Automatically generates storyboards, character designs, dialogue, and more based on given prompts.

[0331] Step 5:

[0332] Server: The generated manga data is stored in a database and sent to the reader's device.

[0333] Step 6:

[0334] Terminal: The generated comic is displayed to the reader.

[0335] 3. Utilizing the Emotion Engine

[0336] Step 1:

[0337] Device: While readers are viewing the manga, their expressions and reactions are captured using a device such as a camera.

[0338] Step 2:

[0339] Sentiment Engine: Analyzes readers' real-time sentiment data and sends the data to the server.

[0340] Step 3:

[0341] Server: Receives the emotion data and runs an algorithm that adjusts the storyline based on the reader's emotions.

[0342] Step 4:

[0343] Server: Generates new story prompts based on the adjusted storyline and sends them to the AI.

[0344] Step 5:

[0345] AI model: Adjusts manga scenes and character responses based on new story prompts.

[0346] 4. Creating sequels and deepening characters

[0347] Step 1:

[0348] Device: After the reader finishes reading the manga, they click the "Generate sequel" button.

[0349] Step 2:

[0350] Terminal: A sequel creation request is sent to the server.

[0351] Step 3:

[0352] Server: Generates new prompt information, taking into account previous scenes and reader feedback analyzed by the emotion engine.

[0353] Step 4:

[0354] Server: Instructs the AI ​​to generate a sequel based on the new prompt information.

[0355] Step 5:

[0356] AI model: Generate sequel manga based on new prompt information, further digging into characters and storylines.

[0357] Step 6:

[0358] Server: The generated sequel manga data is stored in a database and sent to the reader's device.

[0359] Step 7:

[0360] Device: The sequel manga will be displayed to the reader.

[0361] Specific examples

[0362] For example, a creator can enter prompt information on the theme of "reincarnation in another world" and set the characters as "Hero" and "Demon King." Based on this prompt information stored in the database, the reader can select the "Reincarnation in another world AI manga artist" and the first 20 pages of manga will be generated. As the reader continues to read this manga, the emotion engine will capture the reader's facial expressions, and if there are many smiles, the story will develop in an entertaining direction. If the reader wants to continue reading, they can click the "Generate sequel" button and a sequel depicting new adventures and character growth will be automatically generated.

[0363] This allows creators to easily incorporate their ideas into their manga, and readers can enjoy stories that suit their emotions at the time. This system provides diverse stories and in-depth character settings, ensuring a high-quality manga experience.

[0364] Example 2

[0365] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0366] Modern manga creation and viewing systems are required to meet the needs of creators and readers at a higher level. They require creators to easily input prompt information and generate high-quality manga using artificial intelligence. They also require the ability to dynamically adjust story development based on readers' expressions and reactions, personalizing each reader's experience. Furthermore, they require a mechanism that allows readers to easily request sequels and continue enjoying the manga.

[0367] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting prompt information, means for receiving prompt information and saving it in a database, artificial intelligence means for generating a manga based on the saved prompt information, means for displaying the generated manga, emotion engine means for analyzing readers' facial expressions and reactions and collecting emotional data, and means for adjusting the story development of the generated manga based on the collected emotional data. This allows creators to easily input prompt information and generate high-quality manga, while also allowing readers to enjoy a story development that suits their emotions. Furthermore, readers can easily request sequels, allowing for continuous enjoyment.

[0368] "Prompt information" is basic information entered by creators, such as the worldview of the manga, character settings, and story outline.

[0369] A "database" is an information storage device for storing prompt information and generated comic data.

[0370] The "artificial intelligence means" is an artificial intelligence system for generating a manga based on input prompt information.

[0371] The "emotion engine" is a system that analyzes readers' facial expressions and reactions and collects emotional data.

[0372] "Emotional data" is information about reader emotions collected by the emotion engine.

[0373] The "means for adjusting the story development" is a system for dynamically changing the story development of a manga based on emotional data.

[0374] A "sequel" is a subsequent episode of an already produced manga.

[0375] A "sequel request" is an act in which a reader requests that a sequel to a manga be created.

[0376] A "creator" is a user who inputs prompt information and requests the creation of a manga.

[0377] A "reader" is a user who views the generated manga and requests sequels.

[0378] The "Saving Completed Message" is a message that notifies the creator that the prompt information has been successfully saved in the database.

[0379] This invention is a platform for generating manga using artificial intelligence based on prompt information provided by creators, and a system for improving user experience by combining it with an emotion engine that recognizes readers' emotions. This system includes means for inputting prompt information, means for receiving and storing the prompt information in a database, artificial intelligence means for generating manga based on the stored prompt information, means for displaying the generated manga, emotion engine means for analyzing readers' facial expressions and reactions and collecting emotion data, and means for adjusting the story development of the generated manga based on the collected emotion data.

[0380] Hardware and Software Configuration

[0381] The server receives the prompt information and stores it in a database (e.g., MySQL). It also generates a manga based on the prompt information using a generative AI model (e.g., GPT-4). It also processes the emotional data collected by the emotion engine and adjusts the story development.

[0382] The terminals (readers' and creators' devices) are used to input prompt information, read manga, and collect emotional data. The reader's emotional data is acquired using a webcam and built-in sensors.

[0383] Users (creators and readers) enter prompt information and view generated comics through the content generation platform.

[0384] Specific program behavior

[0385] Entering prompt information and registering

[0386] 1. The user (creator) enters the prompt information

[0387] Creators open a browser, access the content generation platform, and enter prompt information such as "reincarnation in another world," "hero," or "demon king" into a dedicated form.

[0388] 2. The server receives the prompt information and checks the data.

[0389] The server receives this prompt information and checks for missing data or errors. If there are no errors, it saves the information to the database and notifies the creator that the prompt information has been successfully received.

[0390] Readers' selection of AI manga artists and manga generation

[0391] 1. The user (reader) logs in to the platform

[0392] Readers enter their username and password to log in to the platform and view a list of AI manga artists.

[0393] 2. The user (reader) selects an AI manga artist and instructs them to create the manga.

[0394] The reader selects the "AI Manga Artist Reincarnated in Another World" and clicks the "Start Generation" button. This action sends prompt information to the AI.

[0395] 3. The server sends the prompt information to the AI ​​and generates the manga.

[0396] The server sends the prompt information to a generative AI model (e.g., GPT-4) to generate a comic strip. The comic strip consists of approximately 20 pages. The generated comic strip data is stored in a database.

[0397] 4. The server sends the generated manga data to the reader's device.

[0398] The generated manga data is sent to the reader's device, and the manga is displayed. For example, the message "Manga has been generated" is displayed.

[0399] Utilizing the Emotion Engine

[0400] 1. The emotion engine analyzes facial expressions on the device (reader's device)

[0401] While the reader is reading the manga, the webcam and built-in sensors are used to record the reader's facial expressions and reactions, capturing the moment when the reader smiles, for example.

[0402] 2. The server receives the emotion data and performs emotion analysis.

[0403] The server receives the collected emotion data and performs emotion analysis, which classifies the emotion data into basic emotion categories.

[0404] 3. The server adjusts the comic story based on emotions.

[0405] Based on the emotional data, the server dynamically adjusts the storyline of the manga. For example, if there are many smiling faces, the story will develop in a more upbeat direction.

[0406] Creating sequels and deepening characters

[0407] 1. The user (reader) wants to create a sequel

[0408] After the reader finishes reading the manga, they click the "Generate sequel" button, and this request is sent to the server.

[0409] 2. The server generates new prompt information

[0410] The server generates new prompt information based on the analysis of the previous scene and the emotion engine, which determines the new storyline.

[0411] 3. The server uses AI to generate a sequel manga

[0412] Based on the new prompt information, the server generates a sequel manga, featuring new adventures and character development.

[0413] 4. The server sends the generated sequel manga data to the reader's device.

[0414] The generated sequel manga data is stored in a database and sent to the reader's device. The sequel manga is displayed and a message such as "A new adventure begins" is displayed to the reader.

[0415] This allows creators to easily input prompt information and generate high-quality manga, allowing readers to enjoy story developments that respond to their own emotions. Readers can also easily request sequels, allowing for continuous enjoyment.

[0416] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0417] Step 1:

[0418] Entering Prompt Information

[0419] The user (creator) opens a browser and accesses the content generation platform. They enter "prompt information" into a dedicated form. The information entered includes the world view, character settings, story outline, etc.

[0420] Input: Prompt information entered by the creator (e.g., "Reincarnation in Another World," "Hero," "Demon King")

[0421] Data processing: Check that the format of the entered information is correct.

[0422] Output: Send prompt information to the server

[0423] Step 2:

[0424] Receiving and checking prompt information

[0425] The server receives the prompt information entered and checks for missing data or errors.

[0426] Input: Prompt information sent by the user

[0427] Data calculations: Checking for missing data (e.g., required fields) and format validation

[0428] Output: If successful, go to next step; if not, generate an error message

[0429] Step 3:

[0430] Save prompt information

[0431] The server saves the prompt information after checking in a database (e.g. MySQL).

[0432] Input: Error-free prompt information

[0433] Data processing: Adding records to the database

[0434] Output: Generates a save completion message to notify the user

[0435] Step 4:

[0436] AI Manga Artist's Choice

[0437] The user (reader) logs in to the platform, browses the list of AI manga artists, and selects an AI manga artist based on the prompts they are interested in.

[0438] Input: User login information and browsing request

[0439] Data calculation: Get a list of registered AI manga artists

[0440] Output: Display a list of AI manga artists to the user

[0441] Step 5:

[0442] Manga generation instructions

[0443] The user (reader) clicks the "Start Generation" button. Prompt information is sent to the AI, which instructs it to generate the manga.

[0444] Input: User-selected AI manga artist and request to start generation

[0445] Data processing: Sending prompt information and generating instructions

[0446] Output: Input prompt information into the AI ​​model and start generating the manga

[0447] Step 6:

[0448] Manga generation

[0449] The server uses a generative AI model (e.g., GPT-4) to generate a manga based on the provided prompt information.

[0450] Input: Prompt Information

[0451] Data calculation: Story, character settings, scene generation

[0452] Output: Generated manga data (e.g. PDF format)

[0453] Step 7:

[0454] Saving and sending the generated manga data

[0455] The server stores the generated manga data in a database and sends it to the reader's device.

[0456] Input: Generated manga data

[0457] Data processing: Saving manga data to a database

[0458] Output: Notification of completion of saving to the database, sending of manga data to the terminal

[0459] Step 8:

[0460] Collecting reader reactions and emotions

[0461] While the terminal (reader's device) reads the manga, it uses the webcam and built-in sensors to analyze the reader's facial expressions and reactions.

[0462] Input: Reader's facial expressions and reactions

[0463] Data Computing: Collecting Emotional Data Using Facial Expression Recognition Algorithms

[0464] Output: Emotion data (e.g., smile, surprise, sadness counts)

[0465] Step 9:

[0466] Sentiment Data Analysis

[0467] The server receives the collected emotion data and performs classification and statistical analysis.

[0468] Input: Emotion data sent from the device

[0469] Data calculation: Classification and analysis of emotional data (e.g., categorization of joy, sadness, surprise)

[0470] Output: Analysis results (emotion parameters)

[0471] Step 10:

[0472] Story development adjustments

[0473] The server then adjusts the storyline of the next manga to be generated based on the results of the analysis of the emotional data.

[0474] Input: Emotion data analysis results

[0475] Data arithmetic: Adjustments made by storytelling algorithms

[0476] Output: Adjusted storyline

[0477] Step 11:

[0478] Sequel generation request

[0479] After the user (reader) finishes reading the manga, he / she clicks the "Generate sequel" button and sends a request to generate a sequel to the server.

[0480] Input: Sequel creation request

[0481] Data operation: Receiving request content and generating prompt information

[0482] Output: New prompt information

[0483] Step 12:

[0484] New prompt information generation and sequel manga generation

[0485] The server generates new prompt information and generates a sequel manga using AI.

[0486] Input: New prompt information, previous emotion data

[0487] Data calculation: Developing new storylines and generating character growth scenarios

[0488] Output: Sequel manga data

[0489] Step 13:

[0490] Saving and sending sequel manga

[0491] The server stores the generated sequel manga data in a database and sends it to the reader's device.

[0492] Input: Sequel manga data

[0493] Data processing: saving to database, sending to reader terminal

[0494] Output: Display and notify the sequel (e.g. "A new adventure begins")

[0495] In this way, the overall system processing is divided into a series of steps, with specific actions being performed at each step, enabling a high-quality manga experience to be provided to both creators and readers.

[0496] (Application example 2)

[0497] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0498] Conventional manga generation platforms simply generate manga with fixed content based on prompt information provided by creators, and are unable to provide a personalized experience that reflects the user's emotions. Furthermore, there is no way to reflect the reader's real-time reactions in the manga storyline, making it difficult to increase reader satisfaction.

[0499] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for inputting prompt information, means for receiving the prompt information and saving it in a database, artificial intelligence means for generating a manga based on the saved prompt information, means for displaying the generated manga, emotion recognition means for capturing the reader's facial expressions and reactions in real time and recognizing their emotions, and means for adjusting the story development of the manga based on the recognized emotion data. This makes it possible to generate a personalized manga that reflects the reader's real-time emotions.

[0500] "Prompt information" is information provided by creators such as the worldview of the manga, character settings, and story outline.

[0501] "Input means" is an interface through which the creator provides prompt information to the system.

[0502] The "means for receiving and storing in a database" is the mechanism that receives the entered prompt information, checks it for errors, and stores it in a database.

[0503] "Artificial intelligence means" refers to an AI model and related technologies for generating manga based on stored prompt information.

[0504] "Display means" refers to the mechanism by which the generated manga is displayed on the reader's terminal or a device such as smart glasses.

[0505] "Emotion recognition means" is a technology that captures readers' facial expressions and reactions in real time and recognizes their emotions.

[0506] The "means for adjusting the story development" is a method for dynamically changing the story content of a manga based on the emotional data recognized by the emotional recognition means.

[0507] A "means for requesting a sequel" is an interface that allows a reader to send a request for a sequel to a manga to the system.

[0508] The "means for generating new prompt information" is a technique for generating new prompt information based on a sequel request.

[0509] "Means for checking and ensuring there are no errors" refers to a mechanism that verifies that the prompt information entered by the creator is complete and correct.

[0510] "Means of notification" refers to a system that notifies creators whether or not there are any errors.

[0511] "Reader" refers to an individual who views the generated manga.

[0512] "Creator" refers to the individual or entity that provides prompt information and directs the creation of the manga.

[0513] System Overview

[0514] The present invention is a system that generates a comic based on prompt information and dynamically adjusts the story development according to the user's emotions. This system includes the following elements:

[0515] 1. Means for inputting prompt information: An interface (e.g., a dedicated form) for creators to input prompt information into the system.

[0516] 2. Means of saving to a database: A mechanism to receive the entered prompt information and save it to a database (e.g., a server and database).

[0517] 3. Artificial intelligence means: AI models and related technologies that generate manga based on stored prompt information (e.g., generative AI models).

[0518] 4. Display method: A mechanism for displaying the generated manga on the reader's terminal or a device such as smart glasses.

[0519] 5. Emotion recognition: Technology that captures readers' facial expressions and reactions in real time and recognizes their emotions (e.g., emotion recognition API).

[0520] 6. A method for adjusting the storyline: A method for dynamically changing the story content of a manga based on recognized emotion data.

[0521] Program operation overview

[0522] Enter and save prompt information

[0523] The server receives prompt information provided by the creator through the means of input. This information is stored in a database. Once saved, the creator is notified. During this process, the data is checked for missing or errors.

[0524] Manga generation and display

[0525] The user's device accesses the platform and selects an AI means for generating comics based on the registered prompt information. The generated comics are displayed on the user's device or smart glasses through a display means.

[0526] Emotion recognition and storyline adjustment

[0527] While the user is reading the manga, the device's built-in camera captures their facial expressions, which are then analyzed by the emotion recognition system. Based on the recognized emotional data, the story development adjustment system changes the content of the manga. This operation is performed in real time, providing a personalized reading experience according to the user's emotions.

[0528] Specific examples

[0529] For example, a creator enters the following prompt information for the "Isekai Tensei" theme:

[0530] "World: Another World"

[0531] "Characters: Hero, Demon King"

[0532] "Story: A Journey to Defeat the Demon King"

[0533] Based on this prompt information, the generative AI model generates the first comic. The user then views this comic while wearing the smart glasses. If the user's facial expression is smiling, the story unfolds in a fun direction. Conversely, if the user's facial expression is sad, a touching scene is added.

[0534] Specific processing of the program

[0535] Each of the above methods is realized using specific hardware and software. For example, a web interface and database (e.g., MySQL) are used to input and store prompt information, a camera and an emotion recognition API (e.g., Microsoft Azure's facial recognition API) are used for emotion recognition, and a generative AI model (e.g., a natural language processing model such as GPT-3) is used for the AI ​​model.

[0536] This system allows creators to easily incorporate their ideas into manga, and users can enjoy stories that reflect their emotions at the time, resulting in a high-quality manga experience.

[0537] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0538] Step 1:

[0539] The server receives prompt information from the creator through a means for entering prompt information. Input is done through a dedicated form, with the creator providing information such as the world view, character settings, and story outline. The entered prompt information is saved in a database. When saved to the database, the data is checked for missing or errors. Examples of input data include "World: Another world," "Characters: Hero, Demon King," and "Story: Journey to defeat the Demon King." Once the error check is complete, a save completion message is sent to the creator. The input here is the prompt information, and the output is saving to the database and notification.

[0540] Step 2:

[0541] The user's device accesses the platform and uses a generative AI model to generate a manga based on the prompt information. The reader selects an AI cartoonist based on the prompt information they are interested in and clicks the "Start Generation" button. The prompt information is sent to the AI, which generates a manga of about 20 pages. The generated manga data is saved in a database and sent to the user's device, where the manga is displayed. The input is the saved prompt information, and the output is the generated manga.

[0542] Step 3:

[0543] The user wears the smart glasses and views the generated manga. The camera built into the smart glasses captures the user's facial expressions in real time. The video frames are sent to the emotion recognition API, which analyzes the user's emotions. The analysis results are "smiling" or "sad," etc. This emotion data is sent to the server and stored in a database. The input is the user's real-time facial expressions, and the output is emotion data generated by the emotion recognition API.

[0544] Step 4:

[0545] The server adjusts the storyline of the comic based on the emotional data received from the emotion recognition API. For example, if the user is smiling, it adds a fun event or humor to the scene. Conversely, if the user has a sad expression, it adds a touching scene or encouraging content. In this process, the next prompt information is automatically generated based on the emotional data, and is sent again to the generative AI model to generate a new comic. The input is the emotional data, and the output is the adjusted storyline and a new comic.

[0546] Step 5:

[0547] When a user clicks the "Generate Sequel" button, the server generates new prompt information based on the previous scene and feedback from the emotion engine. Based on this new prompt information, the AI ​​generates a sequel manga and sends it to the user's device. The input here is the previous scene, emotional feedback, and the generation of new prompt information, and the output is the generated sequel manga.

[0548] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0549] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0550] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0551] [Second embodiment]

[0552] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0553] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0554] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0555] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0556] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0557] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0558] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0559] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0560] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0561] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0562] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0563] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0564] overview

[0565] This invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators. Creators register the prompt information, and readers can view the generated manga. If a reader requests a sequel, new prompt information can be generated and the sequel can be automatically generated.

[0566] Program processing

[0567] The program in this system performs a series of processes, from creators registering prompts to manga generation, reader viewing, and sequel generation. Each process is explained below in natural language.

[0568] Specific program behavior

[0569] 1. Enter prompt information and register

[0570] Device: Creators access the content generation platform and enter prompt information (e.g., worldview, character settings, story outline) into a dedicated form.

[0571] Device: Complete the prompt information and click the "Register" button.

[0572] Server: Receives prompt information sent from the creator's device and checks for missing data or errors.

[0573] Server: If there are no problems, save the prompt information to the database, generate a save completion message, and send it to the creator's device.

[0574] On your device: Display a registration success message to notify the creator that their prompt information was successfully saved.

[0575] 2. Readers' selection of AI manga artists and manga generation

[0576] Device: Readers log in to the platform and view a list of registered AI manga artists.

[0577] On your device: Select an AI manga artist based on the prompt you're interested in and click the "Start Generation" button.

[0578] Server: Sends the selected prompt information to the AI ​​and instructs it to generate a manga of about 20 pages.

[0579] AI model: Automatically generates storyboards, character designs, dialogue, and more based on given prompts.

[0580] Server: The generated manga data is stored in a database and sent to the reader's device.

[0581] Terminal: Displays the generated comic to the reader.

[0582] 3. Creating sequels and deepening characters

[0583] Device: After the reader finishes reading the manga, if they want to read the sequel, they can click the "Generate sequel" button.

[0584] Terminal: A sequel creation request is sent to the server.

[0585] Server: Generates new prompt information, taking into account previous scenes and reader feedback.

[0586] Server: Instructs the AI ​​to generate a sequel based on the new prompt information.

[0587] AI model: Generate sequel manga based on new prompt information, further digging into characters and storylines.

[0588] Server: The generated sequel manga data is stored in a database and sent to the reader's device.

[0589] Terminal: Display the sequel manga to the reader.

[0590] Specific examples

[0591] For example, a creator can input prompt information for the theme of "reincarnation in another world" and set the characters as "Hero" and "Demon King." Based on this prompt information stored in the database, the reader can select the "AI manga artist reincarnated in another world," and the first 20 pages of the manga will be generated. If the reader wants to continue reading the manga, they can click the "Generate sequel" button, and a sequel depicting new adventures and character growth will be automatically generated.

[0592] This allows creators to easily incorporate their ideas into their manga, and allows readers to enjoy the story without interruption. The system offers diverse storylines and deep character settings, ensuring a high-quality manga experience.

[0593] The processing flow will be explained below.

[0594] overview

[0595] This invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators. Creators register the prompt information, and readers can view the generated manga. If a reader requests a sequel, new prompt information can be generated and the sequel can be automatically generated.

[0596] Specific program behavior

[0597] 1. Enter prompt information and register

[0598] Step 1:

[0599] Device: Creators access the content generation platform and enter prompt information (e.g., worldview, character settings, story outline) into a dedicated form.

[0600] Step 2:

[0601] Device: Complete the prompt information and click the "Register" button.

[0602] Step 3:

[0603] Server: Receives prompt information sent from the creator's device and checks for missing data or errors.

[0604] Step 4:

[0605] Server: If there are no problems, save the prompt information to the database, generate a save completion message, and send it to the creator's device.

[0606] Step 5:

[0607] On your device: Display a registration success message to notify the creator that their prompt information was successfully saved.

[0608] 2. Readers' selection of AI manga artists and manga generation

[0609] Step 1:

[0610] Device: Readers log in to the platform and view a list of registered AI manga artists.

[0611] Step 2:

[0612] On your device: Select an AI manga artist based on the prompt you're interested in and click the "Start Generation" button.

[0613] Step 3:

[0614] Server: Sends the selected prompt information to the AI ​​and instructs it to generate a manga of about 20 pages.

[0615] Step 4:

[0616] AI model: Automatically generates storyboards, character designs, dialogue, and more based on given prompts.

[0617] Step 5:

[0618] Server: The generated manga data is stored in a database and sent to the reader's device.

[0619] Step 6:

[0620] Terminal: Displays the generated comic to the reader.

[0621] 3. Creating sequels and deepening characters

[0622] Step 1:

[0623] Device: After the reader finishes reading the manga, if they want to read the sequel, they can click the "Generate sequel" button.

[0624] Step 2:

[0625] Terminal: A sequel creation request is sent to the server.

[0626] Step 3:

[0627] Server: Generates new prompt information, taking into account previous scenes and reader feedback.

[0628] Step 4:

[0629] Server: Instructs the AI ​​to generate a sequel based on the new prompt information.

[0630] Step 5:

[0631] AI model: Generate sequel manga based on new prompt information, further digging into characters and storylines.

[0632] Step 6:

[0633] Server: The generated sequel manga data is stored in a database and sent to the reader's device.

[0634] Step 7:

[0635] Terminal: Display the sequel manga to the reader.

[0636] Specific examples

[0637] For example, a creator can input prompt information for the theme of "reincarnation in another world" and set the characters as "Hero" and "Demon King." Based on this prompt information stored in the database, the reader can select the "AI manga artist reincarnated in another world," and the first 20 pages of the manga will be generated. If the reader wants to continue reading the manga, they can click the "Generate sequel" button, and a sequel depicting new adventures and character growth will be automatically generated.

[0638] This allows creators to easily incorporate their ideas into their manga, and allows readers to enjoy the story without interruption. The system offers diverse storylines and deep character settings, ensuring a high-quality manga experience.

[0639] Example 1

[0640] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0641] On conventional manga creation platforms, the process for creators to create manga is complicated, especially the time-consuming process of inputting prompt information and checking for errors. Furthermore, when readers request sequels, the process must also be done manually, making it difficult to respond quickly. This places a heavy burden on creators and creates an unsmooth experience for readers.

[0642] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0643] In this invention, the server includes means for receiving prompt information, checking for missing data or errors, and saving the data in a database, artificial intelligence means for generating a manga based on the saved prompt information, and means for saving the generated manga data in a database and transmitting it to a terminal for display. This automates error checking of the prompt information, enabling manga to be generated quickly and efficiently, and enabling readers' requests for sequels to be responded to quickly, providing a smoother experience for both creators and readers.

[0644] "Prompt information" refers to data such as the worldview, character settings, and story outline that creators input to generate the manga.

[0645] "Check for missing or error data" means checking whether the received prompt information contains all the required data or whether there are any formatting errors.

[0646] "Saving in a database" means storing the received and confirmed prompt information in a predetermined database.

[0647] "Artificial intelligence means" refers to an artificial intelligence system or algorithm that automatically generates storyboards, character designs, dialogue, etc. for a manga based on input prompt information.

[0648] "Generated manga data" refers to various data related to manga (page layout, character design, dialogue, etc.) generated by artificial intelligence means.

[0649] A "means for requesting a sequel" is an interface that allows readers to request a sequel to a manga they have already read.

[0650] The "means for generating new prompt information" is a function for creating new prompt information required to generate a sequel.

[0651] "Creators" are users who input prompt information and provide content ideas and settings to generate comics.

[0652] MODE FOR CARRYING OUT THE INVENTION

[0653] overview

[0654] The present invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators. Creators register prompt information, and readers can view the generated manga. If a reader requests a sequel, new prompt information is generated, and the sequel is automatically generated. Specific embodiments of this system are described below.

[0655] Hardware and software used

[0656] Device: The device through which creators and readers access the platform, including computers, tablets, and smartphones.

[0657] Server: Receives prompt information, checks for errors, saves it to a database, runs the AI ​​model, and stores and distributes the generated manga data.

[0658] Generative AI model: An artificial intelligence system that generates manga based on prompt information. Specifically, it uses models that use deep learning and natural language processing.

[0659] Entering prompt information and registering

[0660] 1. Device: Creators log in to the platform and enter prompt information (world view, character settings, story outline, etc.) into a dedicated form. For example, for a theme of "reincarnation in another world," they enter "hero" and "demon king" as character settings.

[0661] 2. On the device: The creator enters the prompt information and clicks the "Register" button.

[0662] 3. Server: Receives the prompt information sent from the creator's device. The server checks for missing data or errors and saves the information in the database. Once saving is complete, the server sends a save completion message to the creator's device.

[0663] 4. Device: A Save Complete message will appear on the creator's device, notifying them that the prompt information has been successfully saved.

[0664] Readers' selection of AI manga artists and manga generation

[0665] 1. Device: The reader logs in to the platform and views the list of registered AI manga artists.

[0666] 2. On your device: Choose an AI manga artist based on the prompt you are interested in and click the "Start Generation" button. For example, choose "An AI Manga Artist Reincarnated in Another World."

[0667] 3. Server: Sends the selected prompt information to the generation AI model and instructs it to generate a manga of about 20 pages.

[0668] 4. Generative AI model: Automatically generates storyboards, character designs, dialogue, etc. based on given prompts.

[0669] 5. Server: Stores the generated manga data in a database and sends it to the reader's device.

[0670] 6. Terminal: The generated manga is displayed to the reader.

[0671] Creating sequels and deepening characters

[0672] 1. Device: After the reader finishes reading the manga, if they want to read the sequel, they can click the "Generate sequel" button.

[0673] 2. Terminal: A sequel creation request is sent to the server.

[0674] 3. Server: Generates new prompt information, taking into account previous scenes and reader feedback.

[0675] 4. Server: Instructs the generative AI model to generate a sequel based on the new prompt information.

[0676] 5. Generative AI model: Generate sequel manga based on new prompt information, further digging into characters and storylines.

[0677] 6. Server: The generated sequel manga data is stored in a database and sent to the reader's device.

[0678] 7. Terminal: The sequel manga will be displayed to the reader.

[0679] Specific examples

[0680] For example, a creator might enter prompt information on the theme of "reincarnation in another world" and set the characters as "Hero" and "Demon King." This prompt information is saved in the database. A reader selects "AI Manga Artist Reincarnated in Another World," and the first 20 pages of the manga are generated. If the reader wants to continue reading the manga, they can click the "Generate Sequel" button to generate new prompt information, and a sequel will be automatically generated based on that information.

[0681] This invention automates the process from inputting prompt information to generating manga and sequels, providing an efficient and smooth manga experience for both creators and readers.

[0682] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0683] Step 1: Enter prompt information

[0684] Device: Creators log in to the content generation platform and enter prompt information (world view, character settings, story outline, etc.) into a dedicated form.

[0685] Input: Prompt information entered by the creator.

[0686] Specific operation: The creator logs in by entering their username and password on the login screen, and then moves to the prompt information input form. With the theme of "reincarnation in another world," they enter "Hero" and "Demon King" as their character settings.

[0687] Step 2: Confirm prompt information and register

[0688] On your device: Creator completes the prompt information and clicks the "Register" button.

[0689] Input: The prompt information entered.

[0690] What happens: The creator fills in the fields on the form and clicks the "Register" button.

[0691] Step 3: Receive and check the prompt information

[0692] Server: Receives prompt information sent from the creator's device and checks for missing data or errors.

[0693] Input: Prompt information sent from the terminal.

[0694] Specific operation: The server analyzes the received prompt information, checks whether all required fields are filled in, whether the input format is correct, and if there is an error, generates an error message and sends it to the creator's device.

[0695] Step 4: Save the prompt information

[0696] Server: If there are no problems with the prompt information, it is saved in the database, and a save completion message is generated and sent to the creator's device.

[0697] Input: Prompt information that has passed the check.

[0698] Output: Save complete message.

[0699] Specific operation: Insert the normal prompt information into the database, check the save result, and then generate a save completion message.

[0700] Step 5: Displaying the registration completion message

[0701] On your device: Display a registration success message to notify the creator that their prompt information was successfully saved.

[0702] Input: Save complete message sent from the server.

[0703] Specific behavior: A save completion message will be displayed in a popup or in the notification bar.

[0704] Step 6: Display a list of AI manga artists

[0705] Device: Readers log in to the platform and view a list of registered AI manga artists.

[0706] Input: Reader login details.

[0707] Specific operation: After logging in, the reader clicks the "AI Manga Artist List" button to display a list of available AI Manga artists.

[0708] Step 7: Select prompt information and begin generation

[0709] On your device: Select an AI manga artist based on the prompt information you are interested in and click the "Start Generation" button.

[0710] Input: Reader selection information.

[0711] Specific operation: The reader goes to the details page of the AI ​​manga artist selected from the list and clicks the "Start generation" button.

[0712] Step 8: Manga Generation Instructions

[0713] Server: Sends the selected prompt information to the AI ​​and instructs it to generate a manga of about 20 pages.

[0714] Input: The selected prompt information.

[0715] Specific operation: Pass the selected prompt information to the AI ​​model, specify the number of pages to generate, and send a request to generate the manga.

[0716] Step 9: Generate manga data

[0717] Generative AI model: Automatically generates storyboards, character designs, dialogue, and more based on given prompts.

[0718] Input: The specified prompt information.

[0719] Output: The generated cartoon data.

[0720] How it works: The AI ​​model analyzes the received prompt information and applies a generative algorithm to generate each element of the manga (page layout, character design, dialogue).

[0721] Step 10: Save and send manga data

[0722] Server: The generated manga data is stored in a database and sent to the reader's device.

[0723] Input: Generated comic data.

[0724] Output: Manga data saving completion message and delivery.

[0725] Specific operation: The generated manga file is saved in the database, and the saved result is confirmed before being sent to the reader's device.

[0726] Step 11: Displaying the comic

[0727] Terminal: Displays the generated comic to the reader.

[0728] Input: Manga data sent from the server.

[0729] Specific operation: The manga data sent to the reader's device is displayed on the screen, and interactions such as page turning and zooming functions are provided.

[0730] Step 12: Sending a sequel generation request

[0731] Device: After the reader finishes reading the manga, if they want to read the sequel, they can click the "Generate sequel" button.

[0732] Input: Reader's sequel request.

[0733] Specific operation: The reader clicks the sequel generation button, and a sequel generation request is sent to the server.

[0734] Step 13: Generate new prompt information

[0735] Server: Generates new prompt information, taking into account previous scenes and reader feedback.

[0736] Input: Previous scene information and reader feedback.

[0737] Output: The new prompt information.

[0738] What happens: The server analyzes the previous prompt data and reader feedback and generates appropriate follow-up prompts.

[0739] Step 14: Instructions for generating sequels

[0740] Server: Instructs the generation AI model to generate a sequel based on the new prompt information.

[0741] Input: New prompt information.

[0742] Specific behavior: Sends new prompt information to the AI ​​model and sends a request to generate a sequel.

[0743] Step 15: Creating a sequel manga and digging deeper into the characters

[0744] Generative AI model: Generate sequel manga based on new prompt information, further developing characters and storylines.

[0745] Input: New prompt information.

[0746] Output: Sequel manga data.

[0747] What it does: The AI ​​model analyzes new prompts and generates continuing story and character progression based on previous prompts.

[0748] Step 16: Save and send the sequel manga data

[0749] Server: The generated sequel manga data is stored in a database and sent to the reader's device.

[0750] Input: Sequel manga data.

[0751] Output: Save completion message and delivery of sequel manga.

[0752] Specific operation: Save the sequel manga file in the database, check the saved result, and then send it to the reader's device.

[0753] Step 17: Displaying the sequel manga

[0754] Terminal: Display the sequel manga to the reader.

[0755] Input: Sequel manga data sent from the server.

[0756] Specific operation: Receive sequel manga data and display it on the screen.

[0757] (Application example 1)

[0758] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0759] With conventional manga generation platforms, even if creators input prompt information, it takes time for content based on that information to be generated, and when readers request a sequel, it is difficult to provide the sequel quickly. Furthermore, if the prompt information entered by the creator contains an error, checking and correcting the error requires a lot of effort, making efficient operation difficult. Furthermore, when generating a sequel, the characters and story are not explored in depth, which means readers' expectations cannot be met.

[0760] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0761] In this invention, the server includes a means for inputting prompt information, a means for receiving the prompt information and storing it in a database, an artificial intelligence means for generating a manga based on the stored prompt information, a means for displaying the generated manga, a means for a reader to request a sequel, a means for generating new prompt information based on the sequel request, and an artificial intelligence means for generating a sequel manga based on the new prompt information. This allows creators to easily register prompt information, and the artificial intelligence to instantly generate a manga based on that information, and also to generate and display sequels desired by readers in a timely manner. Furthermore, by generating more in-depth characters and stories based on the newly generated prompt information during the sequel generation process, it is possible to meet readers' expectations and provide continuous, high-quality content.

[0762] "Prompt information" is information entered by creators for content generation, including the theme, character settings, story outline, and the like.

[0763] The "database" is a system for storing and managing prompt information and generated comic data.

[0764] "Artificial intelligence means" refers to a program or system that has the function of generating a manga based on input prompt information.

[0765] "Generated comics" are comic content created by artificial intelligence means based on prompt information.

[0766] "Display means" refers to an interface that visually presents the generated manga to creators and readers.

[0767] The "sequel request means" is a function that allows readers to express their desire for a sequel to an existing manga.

[0768] The "means for generating new prompt information" is a function for creating new prompt information in response to a reader's request for a sequel.

[0769] The "artificial intelligence means for generating a sequel manga" is a program or system that has the function of generating sequel manga content based on new prompt information.

[0770] The "error checking means" is a function that checks whether there are any omissions or errors in the prompt information entered by the creator.

[0771] The "notification means" is a function for notifying the creator if the prompt information contains an error.

[0772] "Deep dive" is a feature that develops characters and stories in more detail during the sequel generation process.

[0773] The present invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators. One embodiment of the present invention is a system that includes a server, a terminal, a database, an artificial intelligence model, and a display means.

[0774] 1. Enter prompt information and register

[0775] The user (creator) enters prompt information through their device. Specifically, the creator accesses the content generation platform and enters prompt information such as theme, character settings, and story outline into a dedicated form. This information includes topics such as "Reincarnation in Another World" and "The Hero and the Demon King." The creator then clicks the "Register" button and sends this information to the server.

[0776] The server checks the received prompt information for errors. If an error is found during this process, the creator's device is notified and they must correct it. If there are no problems, the prompt information is saved in the database.

[0777] 2. Manga Generation and Display

[0778] The reader logs in to the platform from their device and begins the process of generating a manga based on the registered prompt information. The reader selects the prompt they are interested in and clicks the "Start Generation" button. The server then sends the selected prompt information to the AI ​​model, instructing it to generate the manga.

[0779] The AI ​​model generates a manga according to the specified prompt information. During this process, storyboards, character designs, dialogue, etc. are automatically created. The generated manga data is stored in a database and then sent to the reader's device for display. For example, a first manga of about 20 pages on the theme of "reincarnation in another world" is generated.

[0780] 3. Creating sequels

[0781] If a reader wants a sequel after finishing a manga, they click the "Generate Sequel" button. The sequel request is sent to the server, and new prompt information is automatically generated. The server then instructs the AI ​​model to generate a sequel again based on the new prompt information. The newly generated sequel manga will include more in-depth characters and storylines.

[0782] The generated sequel manga data is also stored in a database and sent to the reader's device. For example, a sequel in which the hero obtains an important item on a new adventure may be generated.

[0783] Hardware and software used

[0784] The following hardware and software are used to implement this system:

[0785] Hardware:

[0786] Devices such as smartphones and tablets

[0787] Server (cloud-based)

[0788] software:

[0789] Programming language: Python

[0790] Web framework: Flask

[0791] Database: SQLite

[0792] AI Model: Custom generated AI model

[0793] Specific examples

[0794] For example, a creator enters the following prompt text for the "Isekai Tensei" theme:

[0795] plain text

[0796] Theme: Reincarnation in Another World

[0797] Characters: Hero and Demon King

[0798] Story summary: A hero is reincarnated into another world and begins his adventure to defeat the demon king.

[0799] The generated manga will have storyboards and character designs created by the AI ​​model, depicting an adventure in another world. If a reader wants a sequel, they can click the "Generate Sequel" button, and a sequel will be automatically generated in which the hero obtains an important item on a new adventure. This allows readers to enjoy the story without interruption.

[0800] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0801] Step 1:

[0802] The user (creator) accesses the content generation platform through their device and inputs prompt information. This prompt information includes the theme, character settings, and story outline. For example, information such as "Theme: Reincarnation in Another World," "Character Settings: Hero and Demon King," and "Story Outline: The hero is reincarnated in another world and begins an adventure to defeat the demon king" can be entered into the form. Once the input is complete, the creator clicks the "Register" button. The input prompt information is sent from the device to the server.

[0803] Step 2:

[0804] The server checks the prompt information received from the device and checks for missing data or errors. Specifically, it checks whether all required fields are included in the theme, character settings, and story summary, and whether the format is correct. If there are no errors, the prompt information is saved in the database. If an error is detected, the server generates an error message and notifies the creator's device. The creator then re-enters the prompt information to correct the error.

[0805] Step 3:

[0806] The user (reader) logs in to the platform from their device and requests the generation of a manga based on the registered prompt information. The reader selects the prompt that interests them and clicks the "Start Generation" button. This request is sent from the device to the server.

[0807] Step 4:

[0808] The server sends the selected prompt information to the AI ​​model, instructing it to generate the manga. The AI ​​model generates the manga content based on the prompt information. Specifically, it designs characters, creates storyboards, and arranges dialogue. Through these data processing and calculations, approximately 20 pages of manga are generated. The generated manga data is returned to the server and stored in a database.

[0809] Step 5:

[0810] After the manga data is saved in the database, the server sends it to the reader's device. The device displays the manga based on the received manga data. The reader can view the generated manga through their device.

[0811] Step 6:

[0812] If a reader wants a sequel after finishing a manga, they click the "Generate Sequel" button. This request is sent from the reader's device to the server. The server receives the sequel generation request and generates new prompt information, taking into account the previous prompt information and feedback from the reader.

[0813] Step 7:

[0814] Based on the newly generated prompt information, the server again instructs the AI ​​model to generate a manga. The AI ​​model generates sequel manga content based on the new prompt information. During the generation process, the characters and story are further developed. The generated sequel manga data is sent back to the server and stored in a database.

[0815] Step 8:

[0816] The saved sequel manga data is sent from the server to the reader's device. The device then displays the sequel manga to the reader based on the received sequel manga data. This allows the reader to enjoy the sequel to the story without interruption.

[0817] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0818] overview

[0819] This invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators. By combining it with an emotion engine that recognizes readers' emotions, the user experience is further improved. Creators can also register prompt information, allowing readers to view the generated manga. If a reader requests a sequel, new prompt information can be generated, and the sequel can be automatically generated.

[0820] Specific program behavior

[0821] 1. Enter prompt information and register

[0822] Creators access the content generation platform and enter prompt information (e.g., worldview, character settings, story outline) into a dedicated form. The entered prompt information is sent to the server and checked for missing data or errors. If there are no problems, the prompt information is saved in the database and a save completion message is sent to the creator.

[0823] 2. Readers' selection of AI manga artists and manga generation

[0824] Readers log in to the platform and browse a list of registered AI manga artists. They select an AI manga artist based on the prompt they are interested in and click the "Start Generation" button. The prompt information is sent to the AI, which generates a manga of about 20 pages. The generated manga data is stored in a database and sent to the reader's device, where it is displayed.

[0825] 3. Utilizing the Emotion Engine

[0826] While the reader is reading the manga, the emotion engine analyzes their facial expressions and reactions to collect emotional data. This emotional data is sent to a server, where the reader's emotions are analyzed. Based on the emotions recognized by the emotion engine, the story development of the generated manga is adjusted. For example, if the reader is smiling, the story will unfold in a brighter direction, and if the reader looks sad, a touching scene will be added.

[0827] 4. Creating sequels and deepening characters

[0828] After a reader finishes reading a manga, they click the "Generate sequel" button, which sends a sequel generation request to the server. The server generates new prompt information, taking into account the previous scene and the reader's feedback analyzed by the emotion engine. Based on the new prompt information, the AI ​​generates a sequel manga, digging deeper into the characters and story. The generated sequel manga data is saved in a database and sent to the reader's device, where it is displayed.

[0829] Specific examples

[0830] For example, a creator can enter prompt information on the theme of "reincarnation in another world" and set the characters as "Hero" and "Demon King." Based on this prompt information stored in the database, the reader can select the "Reincarnation in another world AI manga artist" and the first 20 pages of manga will be generated. As the reader continues to read this manga, the emotion engine will capture the reader's facial expressions, and if there are many smiles, the story will develop in an entertaining direction. If the reader wants to continue reading, they can click the "Generate sequel" button and a sequel depicting new adventures and character growth will be automatically generated.

[0831] This allows creators to easily incorporate their ideas into their manga, and readers can enjoy stories that suit their emotions at the time. This system provides diverse stories and in-depth character settings, ensuring a high-quality manga experience.

[0832] The processing flow will be explained below.

[0833] overview

[0834] This invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators, and improves the user experience by combining it with an emotion engine that recognizes readers' emotions. Creators can also register prompt information, and readers can view the generated manga, and sequels can also be created.

[0835] Specific program behavior

[0836] 1. Enter prompt information and register

[0837] Step 1:

[0838] Device: Creators access the content generation platform and enter prompt information (e.g., worldview, character settings, story outline) into a dedicated form.

[0839] Step 2:

[0840] Device: Creator enters the prompt information and clicks the "Register" button.

[0841] Step 3:

[0842] Server: Receives prompt information sent from the creator's device and checks for missing data or errors.

[0843] Step 4:

[0844] Server: If there are no problems, save the prompt information to the database, generate a save completion message, and send it to the creator's device.

[0845] Step 5:

[0846] On your device: A registration success message will appear, informing the creator that their prompt information was successfully saved.

[0847] 2. Readers' selection of AI manga artists and manga generation

[0848] Step 1:

[0849] Device: Readers log in to the platform and view a list of registered AI manga artists.

[0850] Step 2:

[0851] On your device: Select an AI manga artist based on the prompt you're interested in and click the "Start Generation" button.

[0852] Step 3:

[0853] Server: Sends the selected prompt information to the AI ​​and instructs it to generate a manga of about 20 pages.

[0854] Step 4:

[0855] AI model: Automatically generates storyboards, character designs, dialogue, and more based on given prompts.

[0856] Step 5:

[0857] Server: The generated manga data is stored in a database and sent to the reader's device.

[0858] Step 6:

[0859] Terminal: The generated comic is displayed to the reader.

[0860] 3. Utilizing the Emotion Engine

[0861] Step 1:

[0862] Device: While readers are viewing the manga, their expressions and reactions are captured using a device such as a camera.

[0863] Step 2:

[0864] Sentiment Engine: Analyzes readers' real-time sentiment data and sends the data to the server.

[0865] Step 3:

[0866] Server: Receives the emotion data and runs an algorithm that adjusts the storyline based on the reader's emotions.

[0867] Step 4:

[0868] Server: Generates new story prompts based on the adjusted storyline and sends them to the AI.

[0869] Step 5:

[0870] AI model: Adjusts manga scenes and character responses based on new story prompts.

[0871] 4. Creating sequels and deepening characters

[0872] Step 1:

[0873] Device: After the reader finishes reading the manga, they click the "Generate sequel" button.

[0874] Step 2:

[0875] Terminal: A sequel creation request is sent to the server.

[0876] Step 3:

[0877] Server: Generates new prompt information, taking into account previous scenes and reader feedback analyzed by the emotion engine.

[0878] Step 4:

[0879] Server: Instructs the AI ​​to generate a sequel based on the new prompt information.

[0880] Step 5:

[0881] AI model: Generate sequel manga based on new prompt information, further digging into characters and storylines.

[0882] Step 6:

[0883] Server: The generated sequel manga data is stored in a database and sent to the reader's device.

[0884] Step 7:

[0885] Device: The sequel manga will be displayed to the reader.

[0886] Specific examples

[0887] For example, a creator can enter prompt information on the theme of "reincarnation in another world" and set the characters as "Hero" and "Demon King." Based on this prompt information stored in the database, the reader can select the "Reincarnation in another world AI manga artist" and the first 20 pages of manga will be generated. As the reader continues to read this manga, the emotion engine will capture the reader's facial expressions, and if there are many smiles, the story will develop in an entertaining direction. If the reader wants to continue reading, they can click the "Generate sequel" button and a sequel depicting new adventures and character growth will be automatically generated.

[0888] This allows creators to easily incorporate their ideas into their manga, and readers can enjoy stories that suit their emotions at the time. This system provides diverse stories and in-depth character settings, ensuring a high-quality manga experience.

[0889] Example 2

[0890] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0891] Modern manga creation and viewing systems are required to meet the needs of creators and readers at a higher level. They require creators to easily input prompt information and generate high-quality manga using artificial intelligence. They also require the ability to dynamically adjust story development based on readers' expressions and reactions, personalizing each reader's experience. Furthermore, they require a mechanism that allows readers to easily request sequels and continue enjoying the manga.

[0892] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting prompt information, means for receiving prompt information and saving it in a database, artificial intelligence means for generating a manga based on the saved prompt information, means for displaying the generated manga, emotion engine means for analyzing readers' facial expressions and reactions and collecting emotional data, and means for adjusting the story development of the generated manga based on the collected emotional data. This allows creators to easily input prompt information and generate high-quality manga, while also allowing readers to enjoy a story development that suits their emotions. Furthermore, readers can easily request sequels, allowing for continuous enjoyment.

[0893] "Prompt information" is basic information entered by creators, such as the worldview of the manga, character settings, and story outline.

[0894] A "database" is an information storage device for storing prompt information and generated comic data.

[0895] The "artificial intelligence means" is an artificial intelligence system for generating a manga based on input prompt information.

[0896] The "emotion engine" is a system that analyzes readers' facial expressions and reactions and collects emotional data.

[0897] "Emotional data" is information about reader emotions collected by the emotion engine.

[0898] The "means for adjusting the story development" is a system for dynamically changing the story development of a manga based on emotional data.

[0899] A "sequel" is a subsequent episode of an already produced manga.

[0900] A "sequel request" is an act in which a reader requests that a sequel to a manga be created.

[0901] A "creator" is a user who inputs prompt information and requests the creation of a manga.

[0902] A "reader" is a user who views the generated manga and requests sequels.

[0903] The "Saving Completed Message" is a message that notifies the creator that the prompt information has been successfully saved in the database.

[0904] This invention is a platform for generating manga using artificial intelligence based on prompt information provided by creators, and a system for improving user experience by combining it with an emotion engine that recognizes readers' emotions. This system includes means for inputting prompt information, means for receiving and storing the prompt information in a database, artificial intelligence means for generating manga based on the stored prompt information, means for displaying the generated manga, emotion engine means for analyzing readers' facial expressions and reactions and collecting emotion data, and means for adjusting the story development of the generated manga based on the collected emotion data.

[0905] Hardware and Software Configuration

[0906] The server receives the prompt information and stores it in a database (e.g., MySQL). It also generates a manga based on the prompt information using a generative AI model (e.g., GPT-4). It also processes the emotional data collected by the emotion engine and adjusts the story development.

[0907] The terminals (readers' and creators' devices) are used to input prompt information, read manga, and collect emotional data. The reader's emotional data is acquired using a webcam and built-in sensors.

[0908] Users (creators and readers) enter prompt information and view generated comics through the content generation platform.

[0909] Specific program behavior

[0910] Entering prompt information and registering

[0911] 1. The user (creator) enters the prompt information

[0912] Creators open a browser, access the content generation platform, and enter prompt information such as "reincarnation in another world," "hero," or "demon king" into a dedicated form.

[0913] 2. The server receives the prompt information and checks the data.

[0914] The server receives this prompt information and checks for missing data or errors. If there are no errors, it saves the information to the database and notifies the creator that the prompt information has been successfully received.

[0915] Readers' selection of AI manga artists and manga generation

[0916] 1. The user (reader) logs in to the platform

[0917] Readers enter their username and password to log in to the platform and view a list of AI manga artists.

[0918] 2. The user (reader) selects an AI manga artist and instructs them to create the manga.

[0919] The reader selects the "AI Manga Artist Reincarnated in Another World" and clicks the "Start Generation" button. This action sends prompt information to the AI.

[0920] 3. The server sends the prompt information to the AI ​​and generates the manga.

[0921] The server sends the prompt information to a generative AI model (e.g., GPT-4) to generate a comic strip. The comic strip consists of approximately 20 pages. The generated comic strip data is stored in a database.

[0922] 4. The server sends the generated manga data to the reader's device.

[0923] The generated manga data is sent to the reader's device, and the manga is displayed. For example, the message "Manga has been generated" is displayed.

[0924] Utilizing the Emotion Engine

[0925] 1. The emotion engine analyzes facial expressions on the device (reader's device)

[0926] While the reader is reading the manga, the webcam and built-in sensors are used to record the reader's facial expressions and reactions, capturing the moment when the reader smiles, for example.

[0927] 2. The server receives the emotion data and performs emotion analysis.

[0928] The server receives the collected emotion data and performs emotion analysis, which classifies the emotion data into basic emotion categories.

[0929] 3. The server adjusts the comic story based on emotions.

[0930] Based on the emotional data, the server dynamically adjusts the storyline of the manga. For example, if there are many smiling faces, the story will develop in a more upbeat direction.

[0931] Creating sequels and deepening characters

[0932] 1. The user (reader) wants to create a sequel

[0933] After the reader finishes reading the manga, they click the "Generate sequel" button, and this request is sent to the server.

[0934] 2. The server generates new prompt information

[0935] The server generates new prompt information based on the analysis of the previous scene and the emotion engine, which determines the new storyline.

[0936] 3. The server uses AI to generate a sequel manga

[0937] Based on the new prompt information, the server generates a sequel manga, featuring new adventures and character development.

[0938] 4. The server sends the generated sequel manga data to the reader's device.

[0939] The generated sequel manga data is stored in a database and sent to the reader's device. The sequel manga is displayed and a message such as "A new adventure begins" is displayed to the reader.

[0940] This allows creators to easily input prompt information and generate high-quality manga, allowing readers to enjoy story developments that respond to their own emotions. Readers can also easily request sequels, allowing for continuous enjoyment.

[0941] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0942] Step 1:

[0943] Entering Prompt Information

[0944] The user (creator) opens a browser and accesses the content generation platform. They enter "prompt information" into a dedicated form. The information entered includes the world view, character settings, story outline, etc.

[0945] Input: Prompt information entered by the creator (e.g., "Reincarnation in Another World," "Hero," "Demon King")

[0946] Data processing: Check that the format of the entered information is correct.

[0947] Output: Send prompt information to the server

[0948] Step 2:

[0949] Receiving and checking prompt information

[0950] The server receives the prompt information entered and checks for missing data or errors.

[0951] Input: Prompt information sent by the user

[0952] Data calculations: Checking for missing data (e.g., required fields) and format validation

[0953] Output: If successful, go to next step; if not, generate an error message

[0954] Step 3:

[0955] Save prompt information

[0956] The server saves the prompt information after checking in a database (e.g. MySQL).

[0957] Input: Error-free prompt information

[0958] Data processing: Adding records to the database

[0959] Output: Generates a save completion message to notify the user

[0960] Step 4:

[0961] AI Manga Artist's Choice

[0962] The user (reader) logs in to the platform, browses the list of AI manga artists, and selects an AI manga artist based on the prompts they are interested in.

[0963] Input: User login information and browsing request

[0964] Data calculation: Get a list of registered AI manga artists

[0965] Output: Display a list of AI manga artists to the user

[0966] Step 5:

[0967] Manga generation instructions

[0968] The user (reader) clicks the "Start Generation" button. Prompt information is sent to the AI, which instructs it to generate the manga.

[0969] Input: User-selected AI manga artist and request to start generation

[0970] Data processing: Sending prompt information and generating instructions

[0971] Output: Input prompt information into the AI ​​model and start generating the manga

[0972] Step 6:

[0973] Manga generation

[0974] The server uses a generative AI model (e.g., GPT-4) to generate a manga based on the provided prompt information.

[0975] Input: Prompt Information

[0976] Data calculation: Story, character settings, scene generation

[0977] Output: Generated manga data (e.g. PDF format)

[0978] Step 7:

[0979] Saving and sending the generated manga data

[0980] The server stores the generated manga data in a database and sends it to the reader's device.

[0981] Input: Generated manga data

[0982] Data processing: Saving manga data to a database

[0983] Output: Notification of completion of saving to the database, sending of manga data to the terminal

[0984] Step 8:

[0985] Collecting reader reactions and emotions

[0986] While the terminal (reader's device) reads the manga, it uses the webcam and built-in sensors to analyze the reader's facial expressions and reactions.

[0987] Input: Reader's facial expressions and reactions

[0988] Data Computing: Collecting Emotional Data Using Facial Expression Recognition Algorithms

[0989] Output: Emotion data (e.g., smile, surprise, sadness counts)

[0990] Step 9:

[0991] Sentiment Data Analysis

[0992] The server receives the collected emotion data and performs classification and statistical analysis.

[0993] Input: Emotion data sent from the device

[0994] Data calculation: Classification and analysis of emotional data (e.g., categorization of joy, sadness, surprise)

[0995] Output: Analysis results (emotion parameters)

[0996] Step 10:

[0997] Story development adjustments

[0998] The server then adjusts the storyline of the next manga to be generated based on the results of the analysis of the emotional data.

[0999] Input: Emotion data analysis results

[1000] Data arithmetic: Adjustments made by storytelling algorithms

[1001] Output: Adjusted storyline

[1002] Step 11:

[1003] Sequel generation request

[1004] After the user (reader) finishes reading the manga, he / she clicks the "Generate sequel" button and sends a request to generate a sequel to the server.

[1005] Input: Sequel creation request

[1006] Data operation: Receiving request content and generating prompt information

[1007] Output: New prompt information

[1008] Step 12:

[1009] New prompt information generation and sequel manga generation

[1010] The server generates new prompt information and generates a sequel manga using AI.

[1011] Input: New prompt information, previous emotion data

[1012] Data calculation: Developing new storylines and generating character growth scenarios

[1013] Output: Sequel manga data

[1014] Step 13:

[1015] Saving and sending sequel manga

[1016] The server stores the generated sequel manga data in a database and sends it to the reader's device.

[1017] Input: Sequel manga data

[1018] Data processing: saving to database, sending to reader terminal

[1019] Output: Display and notify the sequel (e.g. "A new adventure begins")

[1020] In this way, the overall system processing is divided into a series of steps, with specific actions being performed at each step, enabling a high-quality manga experience to be provided to both creators and readers.

[1021] (Application example 2)

[1022] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1023] Conventional manga generation platforms simply generate manga with fixed content based on prompt information provided by creators, and are unable to provide a personalized experience that reflects the user's emotions. Furthermore, there is no way to reflect the reader's real-time reactions in the manga storyline, making it difficult to increase reader satisfaction.

[1024] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for inputting prompt information, means for receiving the prompt information and saving it in a database, artificial intelligence means for generating a manga based on the saved prompt information, means for displaying the generated manga, emotion recognition means for capturing the reader's facial expressions and reactions in real time and recognizing their emotions, and means for adjusting the story development of the manga based on the recognized emotion data. This makes it possible to generate a personalized manga that reflects the reader's real-time emotions.

[1025] "Prompt information" is information provided by creators such as the worldview of the manga, character settings, and story outline.

[1026] "Input means" is an interface through which the creator provides prompt information to the system.

[1027] The "means for receiving and storing in a database" is the mechanism that receives the entered prompt information, checks it for errors, and stores it in a database.

[1028] "Artificial intelligence means" refers to an AI model and related technologies for generating manga based on stored prompt information.

[1029] "Display means" refers to the mechanism by which the generated manga is displayed on the reader's terminal or a device such as smart glasses.

[1030] "Emotion recognition means" is a technology that captures readers' facial expressions and reactions in real time and recognizes their emotions.

[1031] The "means for adjusting the story development" is a method for dynamically changing the story content of a manga based on the emotional data recognized by the emotional recognition means.

[1032] A "means for requesting a sequel" is an interface that allows a reader to send a request for a sequel to a manga to the system.

[1033] The "means for generating new prompt information" is a technique for generating new prompt information based on a sequel request.

[1034] "Means for checking and ensuring there are no errors" refers to a mechanism that verifies that the prompt information entered by the creator is complete and correct.

[1035] "Means of notification" refers to a system that notifies creators whether or not there are any errors.

[1036] "Reader" refers to an individual who views the generated manga.

[1037] "Creator" refers to the individual or entity that provides prompt information and directs the creation of the manga.

[1038] System Overview

[1039] The present invention is a system that generates a comic based on prompt information and dynamically adjusts the story development according to the user's emotions. This system includes the following elements:

[1040] 1. Means for inputting prompt information: An interface (e.g., a dedicated form) for creators to input prompt information into the system.

[1041] 2. Means of saving to a database: A mechanism to receive the entered prompt information and save it to a database (e.g., a server and database).

[1042] 3. Artificial intelligence means: AI models and related technologies that generate manga based on stored prompt information (e.g., generative AI models).

[1043] 4. Display method: A mechanism for displaying the generated manga on the reader's terminal or a device such as smart glasses.

[1044] 5. Emotion recognition: Technology that captures readers' facial expressions and reactions in real time and recognizes their emotions (e.g., emotion recognition API).

[1045] 6. A method for adjusting the storyline: A method for dynamically changing the story content of a manga based on recognized emotion data.

[1046] Program operation overview

[1047] Enter and save prompt information

[1048] The server receives prompt information provided by the creator through the means of input. This information is stored in a database. Once saved, the creator is notified. During this process, the data is checked for missing or errors.

[1049] Manga generation and display

[1050] The user's device accesses the platform and selects an AI means for generating comics based on the registered prompt information. The generated comics are displayed on the user's device or smart glasses through a display means.

[1051] Emotion recognition and storyline adjustment

[1052] While the user is reading the manga, the device's built-in camera captures their facial expressions, which are then analyzed by the emotion recognition system. Based on the recognized emotional data, the story development adjustment system changes the content of the manga. This operation is performed in real time, providing a personalized reading experience according to the user's emotions.

[1053] Specific examples

[1054] For example, a creator enters the following prompt information for the "Isekai Tensei" theme:

[1055] "World: Another World"

[1056] "Characters: Hero, Demon King"

[1057] "Story: A Journey to Defeat the Demon King"

[1058] Based on this prompt information, the generative AI model generates the first comic. The user then views this comic while wearing the smart glasses. If the user's facial expression is smiling, the story unfolds in a fun direction. Conversely, if the user's facial expression is sad, a touching scene is added.

[1059] Specific processing of the program

[1060] Each of the above methods is realized using specific hardware and software. For example, a web interface and database (e.g., MySQL) are used to input and store prompt information, a camera and an emotion recognition API (e.g., Microsoft Azure's facial recognition API) are used for emotion recognition, and a generative AI model (e.g., a natural language processing model such as GPT-3) is used for the AI ​​model.

[1061] This system allows creators to easily incorporate their ideas into manga, and users can enjoy stories that reflect their emotions at the time, resulting in a high-quality manga experience.

[1062] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1063] Step 1:

[1064] The server receives prompt information from the creator through a means for entering prompt information. Input is done through a dedicated form, with the creator providing information such as the world view, character settings, and story outline. The entered prompt information is saved in a database. When saved to the database, the data is checked for missing or errors. Examples of input data include "World: Another world," "Characters: Hero, Demon King," and "Story: Journey to defeat the Demon King." Once the error check is complete, a save completion message is sent to the creator. The input here is the prompt information, and the output is saving to the database and notification.

[1065] Step 2:

[1066] The user's device accesses the platform and uses a generative AI model to generate a manga based on the prompt information. The reader selects an AI cartoonist based on the prompt information they are interested in and clicks the "Start Generation" button. The prompt information is sent to the AI, which generates a manga of about 20 pages. The generated manga data is saved in a database and sent to the user's device, where the manga is displayed. The input is the saved prompt information, and the output is the generated manga.

[1067] Step 3:

[1068] The user wears the smart glasses and views the generated manga. The camera built into the smart glasses captures the user's facial expressions in real time. The video frames are sent to the emotion recognition API, which analyzes the user's emotions. The analysis results are "smiling" or "sad," etc. This emotion data is sent to the server and stored in a database. The input is the user's real-time facial expressions, and the output is emotion data generated by the emotion recognition API.

[1069] Step 4:

[1070] The server adjusts the storyline of the comic based on the emotional data received from the emotion recognition API. For example, if the user is smiling, it adds a fun event or humor to the scene. Conversely, if the user has a sad expression, it adds a touching scene or encouraging content. In this process, the next prompt information is automatically generated based on the emotional data, and is sent again to the generative AI model to generate a new comic. The input is the emotional data, and the output is the adjusted storyline and a new comic.

[1071] Step 5:

[1072] When a user clicks the "Generate Sequel" button, the server generates new prompt information based on the previous scene and feedback from the emotion engine. Based on this new prompt information, the AI ​​generates a sequel manga and sends it to the user's device. The input here is the previous scene, emotional feedback, and the generation of new prompt information, and the output is the generated sequel manga.

[1073] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1074] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1075] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1076] [Third embodiment]

[1077] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1078] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1079] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1080] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1081] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1082] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1083] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1084] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1085] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1086] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1087] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1088] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1089] overview

[1090] This invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators. Creators register the prompt information, and readers can view the generated manga. If a reader requests a sequel, new prompt information can be generated and the sequel can be automatically generated.

[1091] Program processing

[1092] The program in this system performs a series of processes, from creators registering prompts to manga generation, reader viewing, and sequel generation. Each process is explained below in natural language.

[1093] Specific program behavior

[1094] 1. Enter prompt information and register

[1095] Device: Creators access the content generation platform and enter prompt information (e.g., worldview, character settings, story outline) into a dedicated form.

[1096] Device: Complete the prompt information and click the "Register" button.

[1097] Server: Receives prompt information sent from the creator's device and checks for missing data or errors.

[1098] Server: If there are no problems, save the prompt information to the database, generate a save completion message, and send it to the creator's device.

[1099] On your device: Display a registration success message to notify the creator that their prompt information was successfully saved.

[1100] 2. Readers' selection of AI manga artists and manga generation

[1101] Device: Readers log in to the platform and view a list of registered AI manga artists.

[1102] On your device: Select an AI manga artist based on the prompt you're interested in and click the "Start Generation" button.

[1103] Server: Sends the selected prompt information to the AI ​​and instructs it to generate a manga of about 20 pages.

[1104] AI model: Automatically generates storyboards, character designs, dialogue, and more based on given prompts.

[1105] Server: The generated manga data is stored in a database and sent to the reader's device.

[1106] Terminal: Displays the generated comic to the reader.

[1107] 3. Creating sequels and deepening characters

[1108] Device: After the reader finishes reading the manga, if they want to read the sequel, they can click the "Generate sequel" button.

[1109] Terminal: A sequel creation request is sent to the server.

[1110] Server: Generates new prompt information, taking into account previous scenes and reader feedback.

[1111] Server: Instructs the AI ​​to generate a sequel based on the new prompt information.

[1112] AI model: Generate sequel manga based on new prompt information, further digging into characters and storylines.

[1113] Server: The generated sequel manga data is stored in a database and sent to the reader's device.

[1114] Terminal: Display the sequel manga to the reader.

[1115] Specific examples

[1116] For example, a creator can input prompt information for the theme of "reincarnation in another world" and set the characters as "Hero" and "Demon King." Based on this prompt information stored in the database, the reader can select the "AI manga artist reincarnated in another world," and the first 20 pages of the manga will be generated. If the reader wants to continue reading the manga, they can click the "Generate sequel" button, and a sequel depicting new adventures and character growth will be automatically generated.

[1117] This allows creators to easily incorporate their ideas into their manga, and allows readers to enjoy the story without interruption. The system offers diverse storylines and deep character settings, ensuring a high-quality manga experience.

[1118] The processing flow will be explained below.

[1119] overview

[1120] This invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators. Creators register the prompt information, and readers can view the generated manga. If a reader requests a sequel, new prompt information can be generated and the sequel can be automatically generated.

[1121] Specific program behavior

[1122] 1. Enter prompt information and register

[1123] Step 1:

[1124] Device: Creators access the content generation platform and enter prompt information (e.g., worldview, character settings, story outline) into a dedicated form.

[1125] Step 2:

[1126] Device: Complete the prompt information and click the "Register" button.

[1127] Step 3:

[1128] Server: Receives prompt information sent from the creator's device and checks for missing data or errors.

[1129] Step 4:

[1130] Server: If there are no problems, save the prompt information to the database, generate a save completion message, and send it to the creator's device.

[1131] Step 5:

[1132] On your device: Display a registration success message to notify the creator that their prompt information was successfully saved.

[1133] 2. Readers' selection of AI manga artists and manga generation

[1134] Step 1:

[1135] Device: Readers log in to the platform and view a list of registered AI manga artists.

[1136] Step 2:

[1137] On your device: Select an AI manga artist based on the prompt you're interested in and click the "Start Generation" button.

[1138] Step 3:

[1139] Server: Sends the selected prompt information to the AI ​​and instructs it to generate a manga of about 20 pages.

[1140] Step 4:

[1141] AI model: Automatically generates storyboards, character designs, dialogue, and more based on given prompts.

[1142] Step 5:

[1143] Server: The generated manga data is stored in a database and sent to the reader's device.

[1144] Step 6:

[1145] Terminal: Displays the generated comic to the reader.

[1146] 3. Creating sequels and deepening characters

[1147] Step 1:

[1148] Device: After the reader finishes reading the manga, if they want to read the sequel, they can click the "Generate sequel" button.

[1149] Step 2:

[1150] Terminal: A sequel creation request is sent to the server.

[1151] Step 3:

[1152] Server: Generates new prompt information, taking into account previous scenes and reader feedback.

[1153] Step 4:

[1154] Server: Instructs the AI ​​to generate a sequel based on the new prompt information.

[1155] Step 5:

[1156] AI model: Generate sequel manga based on new prompt information, further digging into characters and storylines.

[1157] Step 6:

[1158] Server: The generated sequel manga data is stored in a database and sent to the reader's device.

[1159] Step 7:

[1160] Terminal: Display the sequel manga to the reader.

[1161] Specific examples

[1162] For example, a creator can input prompt information for the theme of "reincarnation in another world" and set the characters as "Hero" and "Demon King." Based on this prompt information stored in the database, the reader can select the "AI manga artist reincarnated in another world," and the first 20 pages of the manga will be generated. If the reader wants to continue reading the manga, they can click the "Generate sequel" button, and a sequel depicting new adventures and character growth will be automatically generated.

[1163] This allows creators to easily incorporate their ideas into their manga, and allows readers to enjoy the story without interruption. The system offers diverse storylines and deep character settings, ensuring a high-quality manga experience.

[1164] Example 1

[1165] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1166] On conventional manga creation platforms, the process for creators to create manga is complicated, especially the time-consuming process of inputting prompt information and checking for errors. Furthermore, when readers request sequels, the process must also be done manually, making it difficult to respond quickly. This places a heavy burden on creators and creates an unsmooth experience for readers.

[1167] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1168] In this invention, the server includes means for receiving prompt information, checking for missing data or errors, and saving the data in a database, artificial intelligence means for generating a manga based on the saved prompt information, and means for saving the generated manga data in a database and transmitting it to a terminal for display. This automates error checking of the prompt information, enabling manga to be generated quickly and efficiently, and enabling readers' requests for sequels to be responded to quickly, providing a smoother experience for both creators and readers.

[1169] "Prompt information" refers to data such as the worldview, character settings, and story outline that creators input to generate the manga.

[1170] "Check for missing or error data" means checking whether the received prompt information contains all the required data or whether there are any formatting errors.

[1171] "Saving in a database" means storing the received and confirmed prompt information in a predetermined database.

[1172] "Artificial intelligence means" refers to an artificial intelligence system or algorithm that automatically generates storyboards, character designs, dialogue, etc. for a manga based on input prompt information.

[1173] "Generated manga data" refers to various data related to manga (page layout, character design, dialogue, etc.) generated by artificial intelligence means.

[1174] A "means for requesting a sequel" is an interface that allows readers to request a sequel to a manga they have already read.

[1175] The "means for generating new prompt information" is a function for creating new prompt information required to generate a sequel.

[1176] "Creators" are users who input prompt information and provide content ideas and settings to generate comics.

[1177] MODE FOR CARRYING OUT THE INVENTION

[1178] overview

[1179] The present invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators. Creators register prompt information, and readers can view the generated manga. If a reader requests a sequel, new prompt information is generated, and the sequel is automatically generated. Specific embodiments of this system are described below.

[1180] Hardware and software used

[1181] Device: The device through which creators and readers access the platform, including computers, tablets, and smartphones.

[1182] Server: Receives prompt information, checks for errors, saves it to a database, runs the AI ​​model, and stores and distributes the generated manga data.

[1183] Generative AI model: An artificial intelligence system that generates manga based on prompt information. Specifically, it uses models that use deep learning and natural language processing.

[1184] Entering prompt information and registering

[1185] 1. Device: Creators log in to the platform and enter prompt information (world view, character settings, story outline, etc.) into a dedicated form. For example, for a "reincarnation in another world" theme, they enter "hero" and "demon king" as character settings.

[1186] 2. On the device: The creator enters the prompt information and clicks the "Register" button.

[1187] 3. Server: Receives the prompt information sent from the creator's device. The server checks for missing data or errors and saves the information in the database. Once saving is complete, the server sends a save completion message to the creator's device.

[1188] 4. Device: A Save Complete message will appear on the creator's device, notifying them that the prompt information has been successfully saved.

[1189] Readers' selection of AI manga artists and manga generation

[1190] 1. Device: The reader logs in to the platform and views the list of registered AI manga artists.

[1191] 2. On your device: Select the AI ​​manga artist based on the prompt you are interested in and click the "Start Generation" button. For example, select "Another World Reborn AI Manga Artist."

[1192] 3. Server: Sends the selected prompt information to the generation AI model and instructs it to generate a manga of about 20 pages.

[1193] 4. Generative AI model: Automatically generates storyboards, character designs, dialogue, etc. based on given prompts.

[1194] 5. Server: Stores the generated manga data in a database and sends it to the reader's device.

[1195] 6. Terminal: The generated manga is displayed to the reader.

[1196] Creating sequels and deepening characters

[1197] 1. Device: After the reader finishes reading the manga, if they want to read the sequel, they can click the "Generate sequel" button.

[1198] 2. Terminal: A sequel creation request is sent to the server.

[1199] 3. Server: Generates new prompt information, taking into account previous scenes and reader feedback.

[1200] 4. Server: Instructs the generative AI model to generate a sequel based on the new prompt information.

[1201] 5. Generative AI model: Generate sequel manga based on new prompt information, further digging into characters and storylines.

[1202] 6. Server: The generated sequel manga data is stored in a database and sent to the reader's device.

[1203] 7. Terminal: The sequel manga will be displayed to the reader.

[1204] Specific examples

[1205] For example, a creator might enter prompt information on the theme of "reincarnation in another world" and set the characters as "Hero" and "Demon King." This prompt information is saved in the database. A reader selects "AI Manga Artist Reincarnated in Another World," and the first 20 pages of the manga are generated. If the reader wants to continue reading the manga, they can click the "Generate Sequel" button to generate new prompt information, and a sequel will be automatically generated based on that information.

[1206] This invention automates the process from inputting prompt information to generating manga and sequels, providing an efficient and smooth manga experience for both creators and readers.

[1207] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1208] Step 1: Enter prompt information

[1209] Device: Creators log in to the content generation platform and enter prompt information (world view, character settings, story outline, etc.) into a dedicated form.

[1210] Input: Prompt information entered by the creator.

[1211] Specific operation: The creator logs in by entering their username and password on the login screen, and then moves to the prompt information input form. With the theme of "reincarnation in another world," they enter "Hero" and "Demon King" as their character settings.

[1212] Step 2: Confirm prompt information and register

[1213] On your device: Creator completes the prompt information and clicks the "Register" button.

[1214] Input: The prompt information entered.

[1215] What happens: The creator fills in the fields on the form and clicks the "Register" button.

[1216] Step 3: Receive and check the prompt information

[1217] Server: Receives prompt information sent from the creator's device and checks for missing data or errors.

[1218] Input: Prompt information sent from the terminal.

[1219] Specific operation: The server analyzes the received prompt information, checks whether all required fields are filled in, whether the input format is correct, and if there is an error, generates an error message and sends it to the creator's device.

[1220] Step 4: Save the prompt information

[1221] Server: If there are no problems with the prompt information, it is saved in the database, and a save completion message is generated and sent to the creator's device.

[1222] Input: Prompt information that has passed the check.

[1223] Output: Save complete message.

[1224] Specific operation: Insert the normal prompt information into the database, check the save result, and then generate a save completion message.

[1225] Step 5: Displaying the registration completion message

[1226] On your device: Display a registration success message to notify the creator that their prompt information was successfully saved.

[1227] Input: Save complete message sent from the server.

[1228] Specific behavior: A save completion message will be displayed in a popup or in the notification bar.

[1229] Step 6: Display a list of AI manga artists

[1230] Device: Readers log in to the platform and view a list of registered AI manga artists.

[1231] Input: Reader login details.

[1232] Specific operation: After logging in, the reader clicks the "AI Manga Artist List" button to display a list of available AI Manga artists.

[1233] Step 7: Select prompt information and begin generation

[1234] On your device: Select an AI manga artist based on the prompt information you are interested in and click the "Start Generation" button.

[1235] Input: Reader selection information.

[1236] Specific operation: The reader goes to the details page of the AI ​​manga artist selected from the list and clicks the "Start generation" button.

[1237] Step 8: Manga Generation Instructions

[1238] Server: Sends the selected prompt information to the AI ​​and instructs it to generate a manga of about 20 pages.

[1239] Input: The selected prompt information.

[1240] Specific operation: Pass the selected prompt information to the AI ​​model, specify the number of pages to generate, and send a request to generate the manga.

[1241] Step 9: Generate manga data

[1242] Generative AI model: Automatically generates storyboards, character designs, dialogue, and more based on given prompts.

[1243] Input: The specified prompt information.

[1244] Output: The generated cartoon data.

[1245] How it works: The AI ​​model analyzes the received prompt information and applies a generative algorithm to generate each element of the manga (page layout, character design, dialogue).

[1246] Step 10: Save and send manga data

[1247] Server: The generated manga data is stored in a database and sent to the reader's device.

[1248] Input: Generated comic data.

[1249] Output: Manga data saving completion message and delivery.

[1250] Specific operation: The generated manga file is saved in the database, and the saved result is confirmed before being sent to the reader's device.

[1251] Step 11: Displaying the comic

[1252] Terminal: Displays the generated comic to the reader.

[1253] Input: Manga data sent from the server.

[1254] Specific operation: The manga data sent to the reader's device is displayed on the screen, and interactions such as page turning and zooming functions are provided.

[1255] Step 12: Sending a sequel generation request

[1256] Device: After the reader finishes reading the manga, if they want to read the sequel, they can click the "Generate sequel" button.

[1257] Input: Reader's sequel request.

[1258] Specific operation: The reader clicks the sequel generation button, and a sequel generation request is sent to the server.

[1259] Step 13: Generate new prompt information

[1260] Server: Generates new prompt information, taking into account previous scenes and reader feedback.

[1261] Input: Previous scene information and reader feedback.

[1262] Output: The new prompt information.

[1263] What happens: The server analyzes the previous prompt data and reader feedback and generates appropriate follow-up prompts.

[1264] Step 14: Instructions for generating sequels

[1265] Server: Instructs the generation AI model to generate a sequel based on the new prompt information.

[1266] Input: New prompt information.

[1267] Specific behavior: Sends new prompt information to the AI ​​model and sends a request to generate a sequel.

[1268] Step 15: Creating a sequel manga and digging deeper into the characters

[1269] Generative AI model: Generate sequel manga based on new prompt information, further developing characters and storylines.

[1270] Input: New prompt information.

[1271] Output: Sequel manga data.

[1272] What it does: The AI ​​model analyzes new prompts and generates continuing story and character progression based on previous prompts.

[1273] Step 16: Save and send the sequel manga data

[1274] Server: The generated sequel manga data is stored in a database and sent to the reader's device.

[1275] Input: Sequel manga data.

[1276] Output: Save completion message and delivery of sequel manga.

[1277] Specific operation: Save the sequel manga file in the database, check the saved result, and then send it to the reader's device.

[1278] Step 17: Displaying the sequel manga

[1279] Terminal: Display the sequel manga to the reader.

[1280] Input: Sequel manga data sent from the server.

[1281] Specific operation: Receive sequel manga data and display it on the screen.

[1282] (Application example 1)

[1283] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1284] With conventional manga generation platforms, even if creators input prompt information, it takes time for content based on that information to be generated, and when readers request a sequel, it is difficult to provide the sequel quickly. Furthermore, if the prompt information entered by the creator contains an error, checking and correcting the error requires a lot of effort, making efficient operation difficult. Furthermore, when generating a sequel, the characters and story are not explored in depth, which means readers' expectations cannot be met.

[1285] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1286] In this invention, the server includes a means for inputting prompt information, a means for receiving the prompt information and storing it in a database, an artificial intelligence means for generating a manga based on the stored prompt information, a means for displaying the generated manga, a means for a reader to request a sequel, a means for generating new prompt information based on the sequel request, and an artificial intelligence means for generating a sequel manga based on the new prompt information. This allows creators to easily register prompt information, and the artificial intelligence to instantly generate a manga based on that information, and also to generate and display sequels desired by readers in a timely manner. Furthermore, by generating more in-depth characters and stories based on the newly generated prompt information during the sequel generation process, it is possible to meet readers' expectations and provide continuous, high-quality content.

[1287] "Prompt information" is information entered by creators for content generation, including the theme, character settings, story outline, and the like.

[1288] The "database" is a system for storing and managing prompt information and generated comic data.

[1289] "Artificial intelligence means" refers to a program or system that has the function of generating a manga based on input prompt information.

[1290] "Generated comics" are comic content created by artificial intelligence means based on prompt information.

[1291] "Display means" refers to an interface that visually presents the generated manga to creators and readers.

[1292] The "sequel request means" is a function that allows readers to express their desire for a sequel to an existing manga.

[1293] The "means for generating new prompt information" is a function for creating new prompt information in response to a sequel request from a reader.

[1294] The "artificial intelligence means for generating a sequel manga" is a program or system that has the function of generating sequel manga content based on new prompt information.

[1295] The "error checking means" is a function that checks whether there are any omissions or errors in the prompt information entered by the creator.

[1296] The "notification means" is a function for notifying the creator if the prompt information contains an error.

[1297] "Deep dive" is a feature that develops characters and stories in more detail during the sequel generation process.

[1298] The present invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators. One embodiment of the present invention is a system that includes a server, a terminal, a database, an artificial intelligence model, and a display means.

[1299] 1. Enter prompt information and register

[1300] The user (creator) enters prompt information through their device. Specifically, the creator accesses the content generation platform and enters prompt information such as theme, character settings, and story outline into a dedicated form. This information includes topics such as "Reincarnation in Another World" and "The Hero and the Demon King." The creator then clicks the "Register" button and sends this information to the server.

[1301] The server checks the received prompt information for errors. If an error is found during this process, the creator's device is notified and they must correct it. If there are no problems, the prompt information is saved in the database.

[1302] 2. Manga Generation and Display

[1303] The reader logs in to the platform from their device and begins the process of generating a manga based on the registered prompt information. The reader selects the prompt they are interested in and clicks the "Start Generation" button. The server then sends the selected prompt information to the AI ​​model, instructing it to generate the manga.

[1304] The AI ​​model generates a manga according to the specified prompt information. During this process, storyboards, character designs, dialogue, etc. are automatically created. The generated manga data is stored in a database and then sent to the reader's device for display. For example, a first manga of about 20 pages on the theme of "reincarnation in another world" is generated.

[1305] 3. Creating sequels

[1306] If a reader wants a sequel after finishing a manga, they click the "Generate Sequel" button. The sequel request is sent to the server, and new prompt information is automatically generated. The server then instructs the AI ​​model to generate a sequel again based on the new prompt information. The newly generated sequel manga will include more in-depth characters and storylines.

[1307] The generated sequel manga data is also stored in a database and sent to the reader's device. For example, a sequel in which the hero obtains an important item on a new adventure may be generated.

[1308] Hardware and software used

[1309] The following hardware and software are used to implement this system:

[1310] Hardware:

[1311] Devices such as smartphones and tablets

[1312] Server (cloud-based)

[1313] software:

[1314] Programming language: Python

[1315] Web framework: Flask

[1316] Database: SQLite

[1317] AI Model: Custom generated AI model

[1318] Specific examples

[1319] For example, a creator enters the following prompt text for the "Isekai Tensei" theme:

[1320] plain text

[1321] Theme: Reincarnation in Another World

[1322] Characters: Hero and Demon King

[1323] Story summary: A hero is reincarnated into another world and begins his adventure to defeat the demon king.

[1324] The generated manga will have storyboards and character designs created by the AI ​​model, depicting an adventure in another world. If a reader wants a sequel, they can click the "Generate Sequel" button, and a sequel will be automatically generated in which the hero obtains an important item on a new adventure. This allows readers to enjoy the story without interruption.

[1325] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1326] Step 1:

[1327] The user (creator) accesses the content generation platform through their device and inputs prompt information. This prompt information includes the theme, character settings, and story outline. For example, information such as "Theme: Reincarnation in Another World," "Character Settings: Hero and Demon King," and "Story Outline: The hero is reincarnated in another world and begins an adventure to defeat the demon king" can be entered into the form. Once the input is complete, the creator clicks the "Register" button. The input prompt information is sent from the device to the server.

[1328] Step 2:

[1329] The server checks the prompt information received from the device and checks for missing data or errors. Specifically, it checks whether all required fields are included in the theme, character settings, and story summary, and whether the format is correct. If there are no errors, the prompt information is saved in the database. If an error is detected, the server generates an error message and notifies the creator's device. The creator then re-enters the prompt information to correct the error.

[1330] Step 3:

[1331] The user (reader) logs in to the platform from their device and requests the generation of a manga based on the registered prompt information. The reader selects the prompt that interests them and clicks the "Start Generation" button. This request is sent from the device to the server.

[1332] Step 4:

[1333] The server sends the selected prompt information to the AI ​​model, instructing it to generate the manga. The AI ​​model generates the manga content based on the prompt information. Specifically, it designs characters, creates storyboards, and arranges dialogue. Through these data processing and calculations, approximately 20 pages of manga are generated. The generated manga data is returned to the server and stored in a database.

[1334] Step 5:

[1335] After the manga data is saved in the database, the server sends it to the reader's device. The device displays the manga based on the received manga data. The reader can view the generated manga through their device.

[1336] Step 6:

[1337] If a reader wants a sequel after finishing a manga, they click the "Generate Sequel" button. This request is sent from the reader's device to the server. The server receives the sequel generation request and generates new prompt information, taking into account the previous prompt information and feedback from the reader.

[1338] Step 7:

[1339] Based on the newly generated prompt information, the server again instructs the AI ​​model to generate a manga. The AI ​​model generates sequel manga content based on the new prompt information. During the generation process, the characters and story are further developed. The generated sequel manga data is sent back to the server and stored in a database.

[1340] Step 8:

[1341] The saved sequel manga data is sent from the server to the reader's device. The device then displays the sequel manga to the reader based on the received sequel manga data. This allows the reader to enjoy the sequel to the story without interruption.

[1342] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1343] overview

[1344] This invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators. By combining it with an emotion engine that recognizes readers' emotions, the user experience is further improved. Creators can also register prompt information, allowing readers to view the generated manga. If a reader requests a sequel, new prompt information can be generated, and the sequel can be automatically generated.

[1345] Specific program behavior

[1346] 1. Enter prompt information and register

[1347] Creators access the content generation platform and enter prompt information (e.g., worldview, character settings, story outline) into a dedicated form. The entered prompt information is sent to the server and checked for missing data or errors. If there are no problems, the prompt information is saved in the database and a save completion message is sent to the creator.

[1348] 2. Readers' selection of AI manga artists and manga generation

[1349] Readers log in to the platform and browse a list of registered AI manga artists. They select an AI manga artist based on the prompt they are interested in and click the "Start Generation" button. The prompt information is sent to the AI, which generates a manga of about 20 pages. The generated manga data is stored in a database and sent to the reader's device, where it is displayed.

[1350] 3. Utilizing the Emotion Engine

[1351] While the reader is reading the manga, the emotion engine analyzes their facial expressions and reactions to collect emotional data. This emotional data is sent to a server, where the reader's emotions are analyzed. Based on the emotions recognized by the emotion engine, the story development of the generated manga is adjusted. For example, if the reader is smiling, the story will unfold in a brighter direction, and if the reader looks sad, a touching scene will be added.

[1352] 4. Creating sequels and deepening characters

[1353] After a reader finishes reading a manga, they click the "Generate sequel" button, which sends a sequel generation request to the server. The server generates new prompt information, taking into account the previous scene and the reader's feedback analyzed by the emotion engine. Based on the new prompt information, the AI ​​generates a sequel manga, digging deeper into the characters and story. The generated sequel manga data is saved in a database and sent to the reader's device, where it is displayed.

[1354] Specific examples

[1355] For example, a creator can enter prompt information on the theme of "reincarnation in another world" and set the characters as "Hero" and "Demon King." Based on this prompt information stored in the database, the reader can select the "Reincarnation in another world AI manga artist" and the first 20 pages of manga will be generated. As the reader continues to read this manga, the emotion engine will capture the reader's facial expressions, and if there are many smiles, the story will develop in an entertaining direction. If the reader wants to continue reading, they can click the "Generate sequel" button and a sequel depicting new adventures and character growth will be automatically generated.

[1356] This allows creators to easily incorporate their ideas into their manga, and readers can enjoy stories that suit their emotions at the time. This system provides diverse stories and in-depth character settings, ensuring a high-quality manga experience.

[1357] The processing flow will be explained below.

[1358] overview

[1359] This invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators, and improves the user experience by combining it with an emotion engine that recognizes readers' emotions. Creators can also register prompt information, and readers can view the generated manga, and sequels can also be created.

[1360] Specific program behavior

[1361] 1. Enter prompt information and register

[1362] Step 1:

[1363] Device: Creators access the content generation platform and enter prompt information (e.g., worldview, character settings, story outline) into a dedicated form.

[1364] Step 2:

[1365] Device: Creator enters the prompt information and clicks the "Register" button.

[1366] Step 3:

[1367] Server: Receives prompt information sent from the creator's device and checks for missing data or errors.

[1368] Step 4:

[1369] Server: If there are no problems, save the prompt information to the database, generate a save completion message, and send it to the creator's device.

[1370] Step 5:

[1371] On your device: A registration success message will appear, informing the creator that their prompt information was successfully saved.

[1372] 2. Readers' selection of AI manga artists and manga generation

[1373] Step 1:

[1374] Device: Readers log in to the platform and view a list of registered AI manga artists.

[1375] Step 2:

[1376] On your device: Select an AI manga artist based on the prompt you're interested in and click the "Start Generation" button.

[1377] Step 3:

[1378] Server: Sends the selected prompt information to the AI ​​and instructs it to generate a manga of about 20 pages.

[1379] Step 4:

[1380] AI model: Automatically generates storyboards, character designs, dialogue, and more based on given prompts.

[1381] Step 5:

[1382] Server: The generated manga data is stored in a database and sent to the reader's device.

[1383] Step 6:

[1384] Terminal: The generated comic is displayed to the reader.

[1385] 3. Utilizing the Emotion Engine

[1386] Step 1:

[1387] Device: While readers are viewing the manga, their expressions and reactions are captured using a device such as a camera.

[1388] Step 2:

[1389] Sentiment Engine: Analyzes readers' real-time sentiment data and sends the data to the server.

[1390] Step 3:

[1391] Server: Receives the emotion data and runs an algorithm that adjusts the storyline based on the reader's emotions.

[1392] Step 4:

[1393] Server: Generates new story prompts based on the adjusted storyline and sends them to the AI.

[1394] Step 5:

[1395] AI model: Adjusts manga scenes and character responses based on new story prompts.

[1396] 4. Creating sequels and deepening characters

[1397] Step 1:

[1398] Device: After the reader finishes reading the manga, they click the "Generate sequel" button.

[1399] Step 2:

[1400] Terminal: A sequel creation request is sent to the server.

[1401] Step 3:

[1402] Server: Generates new prompt information, taking into account previous scenes and reader feedback analyzed by the emotion engine.

[1403] Step 4:

[1404] Server: Instructs the AI ​​to generate a sequel based on the new prompt information.

[1405] Step 5:

[1406] AI model: Generate sequel manga based on new prompt information, further digging into characters and storylines.

[1407] Step 6:

[1408] Server: The generated sequel manga data is stored in a database and sent to the reader's device.

[1409] Step 7:

[1410] Device: The sequel manga will be displayed to the reader.

[1411] Specific examples

[1412] For example, a creator can enter prompt information on the theme of "reincarnation in another world" and set the characters as "Hero" and "Demon King." Based on this prompt information stored in the database, the reader can select the "Reincarnation in another world AI manga artist" and the first 20 pages of manga will be generated. As the reader continues to read this manga, the emotion engine will capture the reader's facial expressions, and if there are many smiles, the story will develop in an entertaining direction. If the reader wants to continue reading, they can click the "Generate sequel" button and a sequel depicting new adventures and character growth will be automatically generated.

[1413] This allows creators to easily incorporate their ideas into their manga, and readers can enjoy stories that suit their emotions at the time. This system provides diverse stories and in-depth character settings, ensuring a high-quality manga experience.

[1414] Example 2

[1415] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1416] Modern manga creation and viewing systems are required to meet the needs of creators and readers at a higher level. They require creators to easily input prompt information and generate high-quality manga using artificial intelligence. They also require the ability to dynamically adjust story development based on readers' expressions and reactions, personalizing each reader's experience. Furthermore, they require a mechanism that allows readers to easily request sequels and continue enjoying the manga.

[1417] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting prompt information, means for receiving prompt information and saving it in a database, artificial intelligence means for generating a manga based on the saved prompt information, means for displaying the generated manga, emotion engine means for analyzing readers' facial expressions and reactions and collecting emotional data, and means for adjusting the story development of the generated manga based on the collected emotional data. This allows creators to easily input prompt information and generate high-quality manga, while also allowing readers to enjoy a story development that suits their emotions. Furthermore, readers can easily request sequels, allowing for continuous enjoyment.

[1418] "Prompt information" is basic information entered by creators, such as the worldview of the manga, character settings, and story outline.

[1419] A "database" is an information storage device for storing prompt information and generated comic data.

[1420] The "artificial intelligence means" is an artificial intelligence system for generating a manga based on input prompt information.

[1421] The "emotion engine" is a system that analyzes readers' facial expressions and reactions and collects emotional data.

[1422] "Emotional data" is information about reader emotions collected by the emotion engine.

[1423] The "means for adjusting the story development" is a system for dynamically changing the story development of a manga based on emotional data.

[1424] A "sequel" is a subsequent episode of an already produced manga.

[1425] A "sequel request" is an act in which a reader requests that a sequel to a manga be created.

[1426] A "creator" is a user who inputs prompt information and requests the creation of a manga.

[1427] A "reader" is a user who views the generated manga and requests sequels.

[1428] The "Saving Completed Message" is a message that notifies the creator that the prompt information has been successfully saved in the database.

[1429] This invention is a platform for generating manga using artificial intelligence based on prompt information provided by creators, and a system for improving user experience by combining it with an emotion engine that recognizes readers' emotions. This system includes means for inputting prompt information, means for receiving and storing the prompt information in a database, artificial intelligence means for generating manga based on the stored prompt information, means for displaying the generated manga, emotion engine means for analyzing readers' facial expressions and reactions and collecting emotion data, and means for adjusting the story development of the generated manga based on the collected emotion data.

[1430] Hardware and Software Configuration

[1431] The server receives the prompt information and stores it in a database (e.g., MySQL). It also generates a manga based on the prompt information using a generative AI model (e.g., GPT-4). It also processes the emotional data collected by the emotion engine and adjusts the story development.

[1432] The terminals (readers' and creators' devices) are used to input prompt information, read manga, and collect emotional data. The reader's emotional data is acquired using a webcam and built-in sensors.

[1433] Users (creators and readers) enter prompt information and view generated comics through the content generation platform.

[1434] Specific program behavior

[1435] Entering prompt information and registering

[1436] 1. The user (creator) enters the prompt information

[1437] Creators open a browser, access the content generation platform, and enter prompt information such as "reincarnation in another world," "hero," or "demon king" into a dedicated form.

[1438] 2. The server receives the prompt information and checks the data.

[1439] The server receives this prompt information and checks for missing data or errors. If there are no errors, it saves the information to the database and notifies the creator that the prompt information has been successfully received.

[1440] Readers' selection of AI manga artists and manga generation

[1441] 1. The user (reader) logs in to the platform

[1442] Readers enter their username and password to log in to the platform and view a list of AI manga artists.

[1443] 2. The user (reader) selects an AI manga artist and instructs them to create the manga.

[1444] The reader selects the "AI Manga Artist Reincarnated in Another World" and clicks the "Start Generation" button. This action sends prompt information to the AI.

[1445] 3. The server sends the prompt information to the AI ​​and generates the manga.

[1446] The server sends the prompt information to a generative AI model (e.g., GPT-4) to generate a comic strip. The comic strip consists of approximately 20 pages. The generated comic strip data is stored in a database.

[1447] 4. The server sends the generated manga data to the reader's device.

[1448] The generated manga data is sent to the reader's device, and the manga is displayed. For example, the message "Manga has been generated" is displayed.

[1449] Utilizing the Emotion Engine

[1450] 1. The emotion engine analyzes facial expressions on the device (reader's device)

[1451] While the reader is reading the manga, the webcam and built-in sensors are used to record the reader's facial expressions and reactions, capturing the moment when the reader smiles, for example.

[1452] 2. The server receives the emotion data and performs emotion analysis.

[1453] The server receives the collected emotion data and performs emotion analysis, which classifies the emotion data into basic emotion categories.

[1454] 3. The server adjusts the comic story based on emotions.

[1455] Based on the emotional data, the server dynamically adjusts the storyline of the manga. For example, if there are many smiling faces, the story will develop in a more upbeat direction.

[1456] Creating sequels and deepening characters

[1457] 1. The user (reader) wants to create a sequel

[1458] After the reader finishes reading the manga, they click the "Generate sequel" button, and this request is sent to the server.

[1459] 2. The server generates new prompt information

[1460] The server generates new prompt information based on the analysis of the previous scene and the emotion engine, which determines the new storyline.

[1461] 3. The server uses AI to generate a sequel manga

[1462] Based on the new prompt information, the server generates a sequel manga, featuring new adventures and character development.

[1463] 4. The server sends the generated sequel manga data to the reader's device.

[1464] The generated sequel manga data is stored in a database and sent to the reader's device. The sequel manga is displayed and a message such as "A new adventure begins" is displayed to the reader.

[1465] This allows creators to easily input prompt information and generate high-quality manga, allowing readers to enjoy story developments that respond to their own emotions. Readers can also easily request sequels, allowing for continuous enjoyment.

[1466] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1467] Step 1:

[1468] Entering Prompt Information

[1469] The user (creator) opens a browser and accesses the content generation platform. They enter "prompt information" into a dedicated form. The information entered includes the world view, character settings, story outline, etc.

[1470] Input: Prompt information entered by the creator (e.g., "Reincarnation in Another World," "Hero," "Demon King")

[1471] Data processing: Check that the format of the entered information is correct.

[1472] Output: Send prompt information to the server

[1473] Step 2:

[1474] Receiving and checking prompt information

[1475] The server receives the prompt information entered and checks for missing data or errors.

[1476] Input: Prompt information sent by the user

[1477] Data calculations: Checking for missing data (e.g., required fields) and format validation

[1478] Output: If successful, go to next step; if not, generate an error message

[1479] Step 3:

[1480] Save prompt information

[1481] The server saves the prompt information after checking in a database (e.g. MySQL).

[1482] Input: Error-free prompt information

[1483] Data processing: Adding records to the database

[1484] Output: Generates a save completion message to notify the user

[1485] Step 4:

[1486] AI Manga Artist's Choice

[1487] The user (reader) logs in to the platform, browses the list of AI manga artists, and selects an AI manga artist based on the prompts they are interested in.

[1488] Input: User login information and browsing request

[1489] Data calculation: Get a list of registered AI manga artists

[1490] Output: Display a list of AI manga artists to the user

[1491] Step 5:

[1492] Manga generation instructions

[1493] The user (reader) clicks the "Start Generation" button. Prompt information is sent to the AI, which instructs it to generate the manga.

[1494] Input: User-selected AI manga artist and request to start generation

[1495] Data processing: Sending prompt information and generating instructions

[1496] Output: Input prompt information into the AI ​​model and start generating the manga

[1497] Step 6:

[1498] Manga generation

[1499] The server uses a generative AI model (e.g., GPT-4) to generate a manga based on the provided prompt information.

[1500] Input: Prompt Information

[1501] Data calculation: Story, character settings, scene generation

[1502] Output: Generated manga data (e.g. PDF format)

[1503] Step 7:

[1504] Saving and sending the generated manga data

[1505] The server stores the generated manga data in a database and sends it to the reader's device.

[1506] Input: Generated manga data

[1507] Data processing: Saving manga data to a database

[1508] Output: Notification of completion of saving to the database, sending of manga data to the terminal

[1509] Step 8:

[1510] Collecting reader reactions and emotions

[1511] While the terminal (reader's device) reads the manga, it uses the webcam and built-in sensors to analyze the reader's facial expressions and reactions.

[1512] Input: Reader's facial expressions and reactions

[1513] Data Computing: Collecting Emotional Data Using Facial Expression Recognition Algorithms

[1514] Output: Emotion data (e.g., smile, surprise, sadness counts)

[1515] Step 9:

[1516] Sentiment Data Analysis

[1517] The server receives the collected emotion data and performs classification and statistical analysis.

[1518] Input: Emotion data sent from the device

[1519] Data calculation: Classification and analysis of emotional data (e.g., categorization of joy, sadness, surprise)

[1520] Output: Analysis results (emotion parameters)

[1521] Step 10:

[1522] Story development adjustments

[1523] The server then adjusts the storyline of the next manga to be generated based on the results of the analysis of the emotional data.

[1524] Input: Emotion data analysis results

[1525] Data arithmetic: Adjustments made by storytelling algorithms

[1526] Output: Adjusted storyline

[1527] Step 11:

[1528] Sequel generation request

[1529] After the user (reader) finishes reading the manga, he / she clicks the "Generate sequel" button and sends a request to generate a sequel to the server.

[1530] Input: Sequel creation request

[1531] Data operation: Receiving request content and generating prompt information

[1532] Output: New prompt information

[1533] Step 12:

[1534] New prompt information generation and sequel manga generation

[1535] The server generates new prompt information and generates a sequel manga using AI.

[1536] Input: New prompt information, previous emotion data

[1537] Data calculation: Developing new storylines and generating character growth scenarios

[1538] Output: Sequel manga data

[1539] Step 13:

[1540] Saving and sending sequel manga

[1541] The server stores the generated sequel manga data in a database and sends it to the reader's device.

[1542] Input: Sequel manga data

[1543] Data processing: saving to database, sending to reader terminal

[1544] Output: Display and notify the sequel (e.g. "A new adventure begins")

[1545] In this way, the overall system processing is divided into a series of steps, with specific actions being performed at each step, enabling a high-quality manga experience to be provided to both creators and readers.

[1546] (Application example 2)

[1547] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1548] Conventional manga generation platforms simply generate manga with fixed content based on prompt information provided by creators, and are unable to provide a personalized experience that reflects the user's emotions. Furthermore, there is no way to reflect the reader's real-time reactions in the manga storyline, making it difficult to increase reader satisfaction.

[1549] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for inputting prompt information, means for receiving the prompt information and saving it in a database, artificial intelligence means for generating a manga based on the saved prompt information, means for displaying the generated manga, emotion recognition means for capturing the reader's facial expressions and reactions in real time and recognizing their emotions, and means for adjusting the story development of the manga based on the recognized emotion data. This makes it possible to generate a personalized manga that reflects the reader's real-time emotions.

[1550] "Prompt information" is information provided by creators such as the worldview of the manga, character settings, and story outline.

[1551] "Input means" is an interface through which the creator provides prompt information to the system.

[1552] The "means for receiving and storing in a database" is the mechanism that receives the entered prompt information, checks it for errors, and stores it in a database.

[1553] "Artificial intelligence means" refers to an AI model and related technologies for generating manga based on stored prompt information.

[1554] "Display means" refers to the mechanism by which the generated manga is displayed on the reader's terminal or a device such as smart glasses.

[1555] "Emotion recognition means" is a technology that captures readers' facial expressions and reactions in real time and recognizes their emotions.

[1556] The "means for adjusting the story development" is a method for dynamically changing the story content of a manga based on the emotional data recognized by the emotional recognition means.

[1557] A "means for requesting a sequel" is an interface that allows a reader to send a request for a sequel to a manga to the system.

[1558] The "means for generating new prompt information" is a technique for generating new prompt information based on a sequel request.

[1559] "Means for checking and ensuring there are no errors" refers to a mechanism that verifies that the prompt information entered by the creator is complete and correct.

[1560] "Means of notification" refers to a system that notifies creators whether or not there are any errors.

[1561] "Reader" refers to an individual who views the generated manga.

[1562] "Creator" refers to the individual or entity that provides prompt information and directs the creation of the manga.

[1563] System Overview

[1564] The present invention is a system that generates a comic based on prompt information and dynamically adjusts the story development according to the user's emotions. This system includes the following elements:

[1565] 1. Means for inputting prompt information: An interface (e.g., a dedicated form) for creators to input prompt information into the system.

[1566] 2. Means of saving to a database: A mechanism to receive the entered prompt information and save it to a database (e.g., a server and database).

[1567] 3. Artificial intelligence means: AI models and related technologies that generate manga based on stored prompt information (e.g., generative AI models).

[1568] 4. Display method: A mechanism for displaying the generated manga on the reader's terminal or a device such as smart glasses.

[1569] 5. Emotion recognition: Technology that captures readers' facial expressions and reactions in real time and recognizes their emotions (e.g., emotion recognition API).

[1570] 6. A method for adjusting the storyline: A method for dynamically changing the story content of a manga based on recognized emotion data.

[1571] Program operation overview

[1572] Enter and save prompt information

[1573] The server receives prompt information provided by the creator through the means of input. This information is stored in a database. Once saved, the creator is notified. During this process, the data is checked for missing or errors.

[1574] Manga generation and display

[1575] The user's device accesses the platform and selects an AI means for generating comics based on the registered prompt information. The generated comics are displayed on the user's device or smart glasses through a display means.

[1576] Emotion recognition and storyline adjustment

[1577] While the user is reading the manga, the device's built-in camera captures their facial expressions, which are then analyzed by the emotion recognition system. Based on the recognized emotional data, the story development adjustment system changes the content of the manga. This operation is performed in real time, providing a personalized reading experience according to the user's emotions.

[1578] Specific examples

[1579] For example, a creator enters the following prompt information for the "Isekai Tensei" theme:

[1580] "World: Another World"

[1581] "Characters: Hero, Demon King"

[1582] "Story: A Journey to Defeat the Demon King"

[1583] Based on this prompt information, the generative AI model generates the first comic. The user then views this comic while wearing the smart glasses. If the user's facial expression is smiling, the story unfolds in a fun direction. Conversely, if the user's facial expression is sad, a touching scene is added.

[1584] Specific processing of the program

[1585] Each of the above methods is realized using specific hardware and software. For example, a web interface and database (e.g., MySQL) are used to input and store prompt information, a camera and an emotion recognition API (e.g., Microsoft Azure's facial recognition API) are used for emotion recognition, and a generative AI model (e.g., a natural language processing model such as GPT-3) is used for the AI ​​model.

[1586] This system allows creators to easily incorporate their ideas into manga, and users can enjoy stories that reflect their emotions at the time, resulting in a high-quality manga experience.

[1587] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1588] Step 1:

[1589] The server receives prompt information from the creator through a means for entering prompt information. Input is done through a dedicated form, with the creator providing information such as the world view, character settings, and story outline. The entered prompt information is saved in a database. When saved to the database, the data is checked for missing or errors. Examples of input data include "World: Another world," "Characters: Hero, Demon King," and "Story: Journey to defeat the Demon King." Once the error check is complete, a save completion message is sent to the creator. The input here is the prompt information, and the output is saving to the database and notification.

[1590] Step 2:

[1591] The user's device accesses the platform and uses a generative AI model to generate a manga based on the prompt information. The reader selects an AI cartoonist based on the prompt information they are interested in and clicks the "Start Generation" button. The prompt information is sent to the AI, which generates a manga of about 20 pages. The generated manga data is saved in a database and sent to the user's device, where the manga is displayed. The input is the saved prompt information, and the output is the generated manga.

[1592] Step 3:

[1593] The user wears the smart glasses and views the generated manga. The camera built into the smart glasses captures the user's facial expressions in real time. The video frames are sent to the emotion recognition API, which analyzes the user's emotions. The analysis results are "smiling" or "sad," etc. This emotion data is sent to the server and stored in a database. The input is the user's real-time facial expressions, and the output is emotion data generated by the emotion recognition API.

[1594] Step 4:

[1595] The server adjusts the storyline of the comic based on the emotional data received from the emotion recognition API. For example, if the user is smiling, it adds a fun event or humor to the scene. Conversely, if the user has a sad expression, it adds a touching scene or encouraging content. In this process, the next prompt information is automatically generated based on the emotional data, and is sent again to the generative AI model to generate a new comic. The input is the emotional data, and the output is the adjusted storyline and a new comic.

[1596] Step 5:

[1597] When a user clicks the "Generate Sequel" button, the server generates new prompt information based on the previous scene and feedback from the emotion engine. Based on this new prompt information, the AI ​​generates a sequel manga and sends it to the user's device. The input here is the previous scene, emotional feedback, and the generation of new prompt information, and the output is the generated sequel manga.

[1598] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1599] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1600] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1601] [Fourth embodiment]

[1602] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1603] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1604] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1605] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1606] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1607] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1608] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1609] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1610] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1611] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1612] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1613] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1614] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1615] overview

[1616] This invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators. Creators register the prompt information, and readers can view the generated manga. If a reader requests a sequel, new prompt information can be generated and the sequel can be automatically generated.

[1617] Program processing

[1618] The program in this system performs a series of processes, from creators registering prompts to manga generation, reader viewing, and sequel generation. Each process is explained below in natural language.

[1619] Specific program behavior

[1620] 1. Enter prompt information and register

[1621] Device: Creators access the content generation platform and enter prompt information (e.g., worldview, character settings, story outline) into a dedicated form.

[1622] Device: Complete the prompt information and click the "Register" button.

[1623] Server: Receives prompt information sent from the creator's device and checks for missing data or errors.

[1624] Server: If there are no problems, save the prompt information to the database, generate a save completion message, and send it to the creator's device.

[1625] On your device: Display a registration success message to notify the creator that their prompt information was successfully saved.

[1626] 2. Readers' selection of AI manga artists and manga generation

[1627] Device: Readers log in to the platform and view a list of registered AI manga artists.

[1628] On your device: Select an AI manga artist based on the prompt you're interested in and click the "Start Generation" button.

[1629] Server: Sends the selected prompt information to the AI ​​and instructs it to generate a manga of about 20 pages.

[1630] AI model: Automatically generates storyboards, character designs, dialogue, and more based on given prompts.

[1631] Server: The generated manga data is stored in a database and sent to the reader's device.

[1632] Terminal: Displays the generated comic to the reader.

[1633] 3. Creating sequels and deepening characters

[1634] Device: After the reader finishes reading the manga, if they want to read the sequel, they can click the "Generate sequel" button.

[1635] Terminal: A sequel creation request is sent to the server.

[1636] Server: Generates new prompt information, taking into account previous scenes and reader feedback.

[1637] Server: Instructs the AI ​​to generate a sequel based on the new prompt information.

[1638] AI model: Generate sequel manga based on new prompt information, further digging into characters and storylines.

[1639] Server: The generated sequel manga data is stored in a database and sent to the reader's device.

[1640] Terminal: Display the sequel manga to the reader.

[1641] Specific examples

[1642] For example, a creator can input prompt information for the theme of "reincarnation in another world" and set the characters as "Hero" and "Demon King." Based on this prompt information stored in the database, the reader can select the "AI manga artist reincarnated in another world," and the first 20 pages of the manga will be generated. If the reader wants to continue reading the manga, they can click the "Generate sequel" button, and a sequel depicting new adventures and character growth will be automatically generated.

[1643] This allows creators to easily incorporate their ideas into their manga, and allows readers to enjoy the story without interruption. The system offers diverse storylines and deep character settings, ensuring a high-quality manga experience.

[1644] The processing flow will be explained below.

[1645] overview

[1646] This invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators. Creators register the prompt information, and readers can view the generated manga. If a reader requests a sequel, new prompt information can be generated and the sequel can be automatically generated.

[1647] Specific program behavior

[1648] 1. Enter prompt information and register

[1649] Step 1:

[1650] Device: Creators access the content generation platform and enter prompt information (e.g., worldview, character settings, story outline) into a dedicated form.

[1651] Step 2:

[1652] Device: Complete the prompt information and click the "Register" button.

[1653] Step 3:

[1654] Server: Receives prompt information sent from the creator's device and checks for missing data or errors.

[1655] Step 4:

[1656] Server: If there are no problems, save the prompt information to the database, generate a save completion message, and send it to the creator's device.

[1657] Step 5:

[1658] On your device: Display a registration success message to notify the creator that their prompt information was successfully saved.

[1659] 2. Readers' selection of AI manga artists and manga generation

[1660] Step 1:

[1661] Device: Readers log in to the platform and view a list of registered AI manga artists.

[1662] Step 2:

[1663] On your device: Select an AI manga artist based on the prompt you're interested in and click the "Start Generation" button.

[1664] Step 3:

[1665] Server: Sends the selected prompt information to the AI ​​and instructs it to generate a manga of about 20 pages.

[1666] Step 4:

[1667] AI model: Automatically generates storyboards, character designs, dialogue, and more based on given prompts.

[1668] Step 5:

[1669] Server: The generated manga data is stored in a database and sent to the reader's device.

[1670] Step 6:

[1671] Terminal: Displays the generated comic to the reader.

[1672] 3. Creating sequels and deepening characters

[1673] Step 1:

[1674] Device: After the reader finishes reading the manga, if they want to read the sequel, they can click the "Generate sequel" button.

[1675] Step 2:

[1676] Terminal: A sequel creation request is sent to the server.

[1677] Step 3:

[1678] Server: Generates new prompt information, taking into account previous scenes and reader feedback.

[1679] Step 4:

[1680] Server: Instructs the AI ​​to generate a sequel based on the new prompt information.

[1681] Step 5:

[1682] AI model: Generate sequel manga based on new prompt information, further digging into characters and storylines.

[1683] Step 6:

[1684] Server: The generated sequel manga data is stored in a database and sent to the reader's device.

[1685] Step 7:

[1686] Terminal: Display the sequel manga to the reader.

[1687] Specific examples

[1688] For example, a creator can input prompt information for the theme of "reincarnation in another world" and set the characters as "Hero" and "Demon King." Based on this prompt information stored in the database, the reader can select the "AI manga artist reincarnated in another world," and the first 20 pages of the manga will be generated. If the reader wants to continue reading the manga, they can click the "Generate sequel" button, and a sequel depicting new adventures and character growth will be automatically generated.

[1689] This allows creators to easily incorporate their ideas into their manga, and allows readers to enjoy the story without interruption. The system offers diverse storylines and deep character settings, ensuring a high-quality manga experience.

[1690] Example 1

[1691] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1692] On conventional manga creation platforms, the process for creators to create manga is complicated, especially the time-consuming process of inputting prompt information and checking for errors. Furthermore, when readers request sequels, the process must also be done manually, making it difficult to respond quickly. This places a heavy burden on creators and creates an unsmooth experience for readers.

[1693] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1694] In this invention, the server includes means for receiving prompt information, checking for missing data or errors, and saving the data in a database, artificial intelligence means for generating a manga based on the saved prompt information, and means for saving the generated manga data in a database and transmitting it to a terminal for display. This automates error checking of the prompt information, enabling manga to be generated quickly and efficiently, and enabling readers' requests for sequels to be responded to quickly, providing a smoother experience for both creators and readers.

[1695] "Prompt information" refers to data such as the worldview, character settings, and story outline that creators input to generate the manga.

[1696] "Check for missing or error data" means checking whether the received prompt information contains all the required data or whether there are any formatting errors.

[1697] "Saving in a database" means storing the received and confirmed prompt information in a predetermined database.

[1698] "Artificial intelligence means" refers to an artificial intelligence system or algorithm that automatically generates storyboards, character designs, dialogue, etc. for a manga based on input prompt information.

[1699] "Generated manga data" refers to various data related to manga (page layout, character design, dialogue, etc.) generated by artificial intelligence means.

[1700] A "means for requesting a sequel" is an interface that allows readers to request a sequel to a manga they have already read.

[1701] The "means for generating new prompt information" is a function for creating new prompt information required to generate a sequel.

[1702] "Creators" are users who input prompt information and provide content ideas and settings to generate comics.

[1703] MODE FOR CARRYING OUT THE INVENTION

[1704] overview

[1705] The present invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators. Creators register prompt information, and readers can view the generated manga. If a reader requests a sequel, new prompt information is generated, and the sequel is automatically generated. Specific embodiments of this system are described below.

[1706] Hardware and software used

[1707] Device: The device through which creators and readers access the platform, including computers, tablets, and smartphones.

[1708] Server: Receives prompt information, checks for errors, saves it to a database, runs the AI ​​model, and stores and distributes the generated manga data.

[1709] Generative AI model: An artificial intelligence system that generates manga based on prompt information. Specifically, it uses models that use deep learning and natural language processing.

[1710] Entering prompt information and registering

[1711] 1. Device: Creators log in to the platform and enter prompt information (world view, character settings, story outline, etc.) into a dedicated form. For example, for a theme of "reincarnation in another world," they enter "hero" and "demon king" as character settings.

[1712] 2. On the device: The creator enters the prompt information and clicks the "Register" button.

[1713] 3. Server: Receives the prompt information sent from the creator's device. The server checks for missing data or errors and saves the information in the database. Once saving is complete, the server sends a save completion message to the creator's device.

[1714] 4. Device: A Save Complete message will appear on the creator's device, notifying them that the prompt information has been successfully saved.

[1715] Readers' selection of AI manga artists and manga generation

[1716] 1. Device: The reader logs in to the platform and views the list of registered AI manga artists.

[1717] 2. On your device: Choose an AI manga artist based on the prompt you are interested in and click the "Start Generation" button. For example, choose "An AI Manga Artist Reincarnated in Another World."

[1718] 3. Server: Sends the selected prompt information to the generation AI model and instructs it to generate a manga of about 20 pages.

[1719] 4. Generative AI model: Automatically generates storyboards, character designs, dialogue, etc. based on given prompts.

[1720] 5. Server: Stores the generated manga data in a database and sends it to the reader's device.

[1721] 6. Terminal: The generated manga is displayed to the reader.

[1722] Creating sequels and deepening characters

[1723] 1. Device: After the reader finishes reading the manga, if they want to read the sequel, they can click the "Generate sequel" button.

[1724] 2. Terminal: A sequel creation request is sent to the server.

[1725] 3. Server: Generates new prompt information, taking into account previous scenes and reader feedback.

[1726] 4. Server: Instructs the generative AI model to generate a sequel based on the new prompt information.

[1727] 5. Generative AI model: Generate sequel manga based on new prompt information, further digging into characters and storylines.

[1728] 6. Server: The generated sequel manga data is stored in a database and sent to the reader's device.

[1729] 7. Terminal: The sequel manga will be displayed to the reader.

[1730] Specific examples

[1731] For example, a creator might enter prompt information on the theme of "reincarnation in another world" and set the characters as "Hero" and "Demon King." This prompt information is saved in the database. A reader selects "AI Manga Artist Reincarnated in Another World," and the first 20 pages of the manga are generated. If the reader wants to continue reading the manga, they can click the "Generate Sequel" button to generate new prompt information, and a sequel will be automatically generated based on that information.

[1732] This invention automates the process from inputting prompt information to generating manga and sequels, providing an efficient and smooth manga experience for both creators and readers.

[1733] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1734] Step 1: Enter prompt information

[1735] Device: Creators log in to the content generation platform and enter prompt information (world view, character settings, story outline, etc.) into a dedicated form.

[1736] Input: Prompt information entered by the creator.

[1737] Specific operation: The creator logs in by entering their username and password on the login screen, and then moves to the prompt information input form. With the theme of "reincarnation in another world," they enter "Hero" and "Demon King" as their character settings.

[1738] Step 2: Confirm prompt information and register

[1739] On your device: Creator completes the prompt information and clicks the "Register" button.

[1740] Input: The prompt information entered.

[1741] What happens: The creator fills in the fields on the form and clicks the "Register" button.

[1742] Step 3: Receive and check the prompt information

[1743] Server: Receives prompt information sent from the creator's device and checks for missing data or errors.

[1744] Input: Prompt information sent from the terminal.

[1745] Specific operation: The server analyzes the received prompt information, checks whether all required fields are filled in, whether the input format is correct, and if there is an error, generates an error message and sends it to the creator's device.

[1746] Step 4: Save the prompt information

[1747] Server: If there are no problems with the prompt information, it is saved in the database, and a save completion message is generated and sent to the creator's device.

[1748] Input: Prompt information that has passed the check.

[1749] Output: Save complete message.

[1750] Specific operation: Insert the normal prompt information into the database, check the save result, and then generate a save completion message.

[1751] Step 5: Displaying the registration completion message

[1752] On your device: Display a registration success message to notify the creator that their prompt information was successfully saved.

[1753] Input: Save complete message sent from the server.

[1754] Specific behavior: A save completion message will be displayed in a popup or in the notification bar.

[1755] Step 6: Display a list of AI manga artists

[1756] Device: Readers log in to the platform and view a list of registered AI manga artists.

[1757] Input: Reader login details.

[1758] Specific operation: After logging in, the reader clicks the "AI Manga Artist List" button to display a list of available AI Manga artists.

[1759] Step 7: Select prompt information and begin generation

[1760] On your device: Select an AI manga artist based on the prompt information you are interested in and click the "Start Generation" button.

[1761] Input: Reader selection information.

[1762] Specific operation: The reader goes to the details page of the AI ​​manga artist selected from the list and clicks the "Start generation" button.

[1763] Step 8: Manga Generation Instructions

[1764] Server: Sends the selected prompt information to the AI ​​and instructs it to generate a manga of about 20 pages.

[1765] Input: The selected prompt information.

[1766] Specific operation: Pass the selected prompt information to the AI ​​model, specify the number of pages to generate, and send a request to generate the manga.

[1767] Step 9: Generate manga data

[1768] Generative AI model: Automatically generates storyboards, character designs, dialogue, and more based on given prompts.

[1769] Input: The specified prompt information.

[1770] Output: The generated cartoon data.

[1771] How it works: The AI ​​model analyzes the received prompt information and applies a generative algorithm to generate each element of the manga (page layout, character design, dialogue).

[1772] Step 10: Save and send manga data

[1773] Server: The generated manga data is stored in a database and sent to the reader's device.

[1774] Input: Generated comic data.

[1775] Output: Manga data saving completion message and delivery.

[1776] Specific operation: The generated manga file is saved in the database, and the saved result is confirmed before being sent to the reader's device.

[1777] Step 11: Displaying the comic

[1778] Terminal: Displays the generated comic to the reader.

[1779] Input: Manga data sent from the server.

[1780] Specific operation: The manga data sent to the reader's device is displayed on the screen, and interactions such as page turning and zooming functions are provided.

[1781] Step 12: Sending a sequel generation request

[1782] Device: After the reader finishes reading the manga, if they want to read the sequel, they can click the "Generate sequel" button.

[1783] Input: Reader's sequel request.

[1784] Specific operation: The reader clicks the sequel generation button, and a sequel generation request is sent to the server.

[1785] Step 13: Generate new prompt information

[1786] Server: Generates new prompt information, taking into account previous scenes and reader feedback.

[1787] Input: Previous scene information and reader feedback.

[1788] Output: The new prompt information.

[1789] What happens: The server analyzes the previous prompt data and reader feedback and generates appropriate follow-up prompts.

[1790] Step 14: Instructions for generating sequels

[1791] Server: Instructs the generation AI model to generate a sequel based on the new prompt information.

[1792] Input: New prompt information.

[1793] Specific behavior: Sends new prompt information to the AI ​​model and sends a request to generate a sequel.

[1794] Step 15: Creating a sequel manga and digging deeper into the characters

[1795] Generative AI model: Generate sequel manga based on new prompt information, further developing characters and storylines.

[1796] Input: New prompt information.

[1797] Output: Sequel manga data.

[1798] What it does: The AI ​​model analyzes new prompts and generates continuing story and character progression based on previous prompts.

[1799] Step 16: Save and send the sequel manga data

[1800] Server: The generated sequel manga data is stored in a database and sent to the reader's device.

[1801] Input: Sequel manga data.

[1802] Output: Save completion message and delivery of sequel manga.

[1803] Specific operation: Save the sequel manga file in the database, check the saved result, and then send it to the reader's device.

[1804] Step 17: Displaying the sequel manga

[1805] Terminal: Display the sequel manga to the reader.

[1806] Input: Sequel manga data sent from the server.

[1807] Specific operation: Receive sequel manga data and display it on the screen.

[1808] (Application example 1)

[1809] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1810] With conventional manga generation platforms, even if creators input prompt information, it takes time for content based on that information to be generated, and when readers request a sequel, it is difficult to provide the sequel quickly. Furthermore, if the prompt information entered by the creator contains an error, checking and correcting the error requires a lot of effort, making efficient operation difficult. Furthermore, when generating a sequel, the characters and story are not explored in depth, which means readers' expectations cannot be met.

[1811] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1812] In this invention, the server includes a means for inputting prompt information, a means for receiving the prompt information and storing it in a database, an artificial intelligence means for generating a manga based on the stored prompt information, a means for displaying the generated manga, a means for a reader to request a sequel, a means for generating new prompt information based on the sequel request, and an artificial intelligence means for generating a sequel manga based on the new prompt information. This allows creators to easily register prompt information, and the artificial intelligence to instantly generate a manga based on that information, and also to generate and display sequels desired by readers in a timely manner. Furthermore, by generating more in-depth characters and stories based on the newly generated prompt information during the sequel generation process, it is possible to meet readers' expectations and provide continuous, high-quality content.

[1813] "Prompt information" is information entered by creators for content generation, including the theme, character settings, story outline, and the like.

[1814] The "database" is a system for storing and managing prompt information and generated comic data.

[1815] "Artificial intelligence means" refers to a program or system that has the function of generating a manga based on input prompt information.

[1816] "Generated comics" are comic content created by artificial intelligence means based on prompt information.

[1817] "Display means" refers to an interface that visually presents the generated manga to creators and readers.

[1818] The "sequel request means" is a function that allows readers to express their desire for a sequel to an existing manga.

[1819] The "means for generating new prompt information" is a function for creating new prompt information in response to a sequel request from a reader.

[1820] The "artificial intelligence means for generating a sequel manga" is a program or system that has the function of generating sequel manga content based on new prompt information.

[1821] The "error checking means" is a function that checks whether there are any omissions or errors in the prompt information entered by the creator.

[1822] The "notification means" is a function for notifying the creator if the prompt information contains an error.

[1823] "Deep dive" is a feature that develops characters and stories in more detail during the sequel generation process.

[1824] The present invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators. One embodiment of the present invention is a system that includes a server, a terminal, a database, an artificial intelligence model, and a display means.

[1825] 1. Enter prompt information and register

[1826] The user (creator) enters prompt information through their device. Specifically, the creator accesses the content generation platform and enters prompt information such as theme, character settings, and story outline into a dedicated form. This information includes topics such as "Reincarnation in Another World" and "The Hero and the Demon King." The creator then clicks the "Register" button and sends this information to the server.

[1827] The server checks the received prompt information for errors. If an error is found during this process, the creator's device is notified and they must correct it. If there are no problems, the prompt information is saved in the database.

[1828] 2. Manga Generation and Display

[1829] The reader logs in to the platform from their device and begins the process of generating a manga based on the registered prompt information. The reader selects the prompt they are interested in and clicks the "Start Generation" button. The server then sends the selected prompt information to the AI ​​model, instructing it to generate the manga.

[1830] The AI ​​model generates a manga according to the specified prompt information. During this process, storyboards, character designs, dialogue, etc. are automatically created. The generated manga data is stored in a database and then sent to the reader's device for display. For example, a first manga of about 20 pages on the theme of "reincarnation in another world" is generated.

[1831] 3. Creating sequels

[1832] If a reader wants a sequel after finishing a manga, they click the "Generate Sequel" button. The sequel request is sent to the server, and new prompt information is automatically generated. The server then instructs the AI ​​model to generate a sequel again based on the new prompt information. The newly generated sequel manga will include more in-depth characters and storylines.

[1833] The generated sequel manga data is also stored in a database and sent to the reader's device. For example, a sequel in which the hero obtains an important item on a new adventure may be generated.

[1834] Hardware and software used

[1835] The following hardware and software are used to implement this system:

[1836] Hardware:

[1837] Devices such as smartphones and tablets

[1838] Server (cloud-based)

[1839] software:

[1840] Programming language: Python

[1841] Web framework: Flask

[1842] Database: SQLite

[1843] AI Model: Custom generated AI model

[1844] Specific examples

[1845] For example, a creator enters the following prompt text for the "Isekai Tensei" theme:

[1846] plain text

[1847] Theme: Reincarnation in Another World

[1848] Characters: Hero and Demon King

[1849] Story summary: A hero is reincarnated into another world and begins his adventure to defeat the demon king.

[1850] The generated manga will have storyboards and character designs created by the AI ​​model, depicting an adventure in another world. If a reader wants a sequel, they can click the "Generate Sequel" button, and a sequel will be automatically generated in which the hero obtains an important item on a new adventure. This allows readers to enjoy the story without interruption.

[1851] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1852] Step 1:

[1853] The user (creator) accesses the content generation platform through their device and inputs prompt information. This prompt information includes the theme, character settings, and story outline. For example, information such as "Theme: Reincarnation in Another World," "Character Settings: Hero and Demon King," and "Story Outline: The hero is reincarnated in another world and begins an adventure to defeat the demon king" can be entered into the form. Once the input is complete, the creator clicks the "Register" button. The input prompt information is sent from the device to the server.

[1854] Step 2:

[1855] The server checks the prompt information received from the device and checks for missing data or errors. Specifically, it checks whether all required fields are included in the theme, character settings, and story summary, and whether the format is correct. If there are no errors, the prompt information is saved in the database. If an error is detected, the server generates an error message and notifies the creator's device. The creator then re-enters the prompt information to correct the error.

[1856] Step 3:

[1857] The user (reader) logs in to the platform from their device and requests the generation of a manga based on the registered prompt information. The reader selects the prompt that interests them and clicks the "Start Generation" button. This request is sent from the device to the server.

[1858] Step 4:

[1859] The server sends the selected prompt information to the AI ​​model, instructing it to generate the manga. The AI ​​model generates the manga content based on the prompt information. Specifically, it designs characters, creates storyboards, and arranges dialogue. Through these data processing and calculations, approximately 20 pages of manga are generated. The generated manga data is returned to the server and stored in a database.

[1860] Step 5:

[1861] After the manga data is saved in the database, the server sends it to the reader's device. The device displays the manga based on the received manga data. The reader can view the generated manga through their device.

[1862] Step 6:

[1863] If a reader wants a sequel after finishing a manga, they click the "Generate Sequel" button. This request is sent from the reader's device to the server. The server receives the sequel generation request and generates new prompt information, taking into account the previous prompt information and feedback from the reader.

[1864] Step 7:

[1865] Based on the newly generated prompt information, the server again instructs the AI ​​model to generate a manga. The AI ​​model generates sequel manga content based on the new prompt information. During the generation process, the characters and story are further developed. The generated sequel manga data is sent back to the server and stored in a database.

[1866] Step 8:

[1867] The saved sequel manga data is sent from the server to the reader's device. The device then displays the sequel manga to the reader based on the received sequel manga data. This allows the reader to enjoy the sequel to the story without interruption.

[1868] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1869] overview

[1870] This invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators. By combining it with an emotion engine that recognizes readers' emotions, the user experience is further improved. Creators can also register prompt information, allowing readers to view the generated manga. If a reader requests a sequel, new prompt information can be generated, and the sequel can be automatically generated.

[1871] Specific program behavior

[1872] 1. Enter prompt information and register

[1873] Creators access the content generation platform and enter prompt information (e.g., worldview, character settings, story outline) into a dedicated form. The entered prompt information is sent to the server and checked for missing data or errors. If there are no problems, the prompt information is saved in the database and a save completion message is sent to the creator.

[1874] 2. Readers' selection of AI manga artists and manga generation

[1875] Readers log in to the platform and browse a list of registered AI manga artists. They select an AI manga artist based on the prompt they are interested in and click the "Start Generation" button. The prompt information is sent to the AI, which generates a manga of about 20 pages. The generated manga data is stored in a database and sent to the reader's device, where it is displayed.

[1876] 3. Utilizing the Emotion Engine

[1877] While the reader is reading the manga, the emotion engine analyzes their facial expressions and reactions to collect emotional data. This emotional data is sent to a server, where the reader's emotions are analyzed. Based on the emotions recognized by the emotion engine, the story development of the generated manga is adjusted. For example, if the reader is smiling, the story will unfold in a brighter direction, and if the reader looks sad, a touching scene will be added.

[1878] 4. Creating sequels and deepening characters

[1879] After a reader finishes reading a manga, they click the "Generate sequel" button, which sends a sequel generation request to the server. The server generates new prompt information, taking into account the previous scene and the reader's feedback analyzed by the emotion engine. Based on the new prompt information, the AI ​​generates a sequel manga, digging deeper into the characters and story. The generated sequel manga data is saved in a database and sent to the reader's device, where it is displayed.

[1880] Specific examples

[1881] For example, a creator can enter prompt information on the theme of "reincarnation in another world" and set the characters as "Hero" and "Demon King." Based on this prompt information stored in the database, the reader can select the "Reincarnation in another world AI manga artist" and the first 20 pages of manga will be generated. As the reader continues to read this manga, the emotion engine will capture the reader's facial expressions, and if there are many smiles, the story will develop in an entertaining direction. If the reader wants to continue reading, they can click the "Generate sequel" button and a sequel depicting new adventures and character growth will be automatically generated.

[1882] This allows creators to easily incorporate their ideas into their manga, and readers can enjoy stories that suit their emotions at the time. This system provides diverse stories and in-depth character settings, ensuring a high-quality manga experience.

[1883] The processing flow will be explained below.

[1884] overview

[1885] This invention is a platform that uses artificial intelligence to generate manga based on prompt information provided by creators, and improves the user experience by combining it with an emotion engine that recognizes readers' emotions. Creators can also register prompt information, and readers can view the generated manga, and sequels can also be created.

[1886] Specific program behavior

[1887] 1. Enter prompt information and register

[1888] Step 1:

[1889] Device: Creators access the content generation platform and enter prompt information (e.g., worldview, character settings, story outline) into a dedicated form.

[1890] Step 2:

[1891] Device: Creator enters the prompt information and clicks the "Register" button.

[1892] Step 3:

[1893] Server: Receives prompt information sent from the creator's device and checks for missing data or errors.

[1894] Step 4:

[1895] Server: If there are no problems, save the prompt information to the database, generate a save completion message, and send it to the creator's device.

[1896] Step 5:

[1897] On your device: A registration success message will appear, informing the creator that their prompt information was successfully saved.

[1898] 2. Readers' selection of AI manga artists and manga generation

[1899] Step 1:

[1900] Device: Readers log in to the platform and view a list of registered AI manga artists.

[1901] Step 2:

[1902] On your device: Select an AI manga artist based on the prompt you're interested in and click the "Start Generation" button.

[1903] Step 3:

[1904] Server: Sends the selected prompt information to the AI ​​and instructs it to generate a manga of about 20 pages.

[1905] Step 4:

[1906] AI model: Automatically generates storyboards, character designs, dialogue, and more based on given prompts.

[1907] Step 5:

[1908] Server: The generated manga data is stored in a database and sent to the reader's device.

[1909] Step 6:

[1910] Terminal: The generated comic is displayed to the reader.

[1911] 3. Utilizing the Emotion Engine

[1912] Step 1:

[1913] Device: While readers are viewing the manga, their expressions and reactions are captured using a device such as a camera.

[1914] Step 2:

[1915] Sentiment Engine: Analyzes readers' real-time sentiment data and sends the data to the server.

[1916] Step 3:

[1917] Server: Receives the emotion data and runs an algorithm that adjusts the storyline based on the reader's emotions.

[1918] Step 4:

[1919] Server: Generates new story prompts based on the adjusted storyline and sends them to the AI.

[1920] Step 5:

[1921] AI model: Adjusts manga scenes and character responses based on new story prompts.

[1922] 4. Creating sequels and deepening characters

[1923] Step 1:

[1924] Device: After the reader finishes reading the manga, they click the "Generate sequel" button.

[1925] Step 2:

[1926] Terminal: A sequel creation request is sent to the server.

[1927] Step 3:

[1928] Server: Generates new prompt information, taking into account previous scenes and reader feedback analyzed by the emotion engine.

[1929] Step 4:

[1930] Server: Instructs the AI ​​to generate a sequel based on the new prompt information.

[1931] Step 5:

[1932] AI model: Generate sequel manga based on new prompt information, further digging into characters and storylines.

[1933] Step 6:

[1934] Server: The generated sequel manga data is stored in a database and sent to the reader's device.

[1935] Step 7:

[1936] Device: The sequel manga will be displayed to the reader.

[1937] Specific examples

[1938] For example, a creator can enter prompt information on the theme of "reincarnation in another world" and set the characters as "Hero" and "Demon King." Based on this prompt information stored in the database, the reader can select the "Reincarnation in another world AI manga artist" and the first 20 pages of manga will be generated. As the reader continues to read this manga, the emotion engine will capture the reader's facial expressions, and if there are many smiles, the story will develop in an entertaining direction. If the reader wants to continue reading, they can click the "Generate sequel" button and a sequel depicting new adventures and character growth will be automatically generated.

[1939] This allows creators to easily incorporate their ideas into their manga, and readers can enjoy stories that suit their emotions at the time. This system provides diverse stories and in-depth character settings, ensuring a high-quality manga experience.

[1940] Example 2

[1941] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1942] Modern manga creation and viewing systems are required to meet the needs of creators and readers at a higher level. They require creators to easily input prompt information and generate high-quality manga using artificial intelligence. They also require the ability to dynamically adjust story development based on readers' expressions and reactions, personalizing each reader's experience. Furthermore, they require a mechanism that allows readers to easily request sequels and continue enjoying the manga.

[1943] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting prompt information, means for receiving prompt information and saving it in a database, artificial intelligence means for generating a manga based on the saved prompt information, means for displaying the generated manga, emotion engine means for analyzing readers' facial expressions and reactions and collecting emotional data, and means for adjusting the story development of the generated manga based on the collected emotional data. This allows creators to easily input prompt information and generate high-quality manga, while also allowing readers to enjoy a story development that suits their emotions. Furthermore, readers can easily request sequels, allowing for continuous enjoyment.

[1944] "Prompt information" is basic information entered by creators, such as the worldview of the manga, character settings, and story outline.

[1945] A "database" is an information storage device for storing prompt information and generated comic data.

[1946] The "artificial intelligence means" is an artificial intelligence system for generating a manga based on input prompt information.

[1947] The "emotion engine" is a system that analyzes readers' facial expressions and reactions and collects emotional data.

[1948] "Emotional data" is information about reader emotions collected by the emotion engine.

[1949] The "means for adjusting the story development" is a system for dynamically changing the story development of a manga based on emotional data.

[1950] A "sequel" is a subsequent episode of an already produced manga.

[1951] A "sequel request" is an act in which a reader requests that a sequel to a manga be created.

[1952] A "creator" is a user who inputs prompt information and requests the creation of a manga.

[1953] A "reader" is a user who views the generated manga and requests sequels.

[1954] The "Saving Completed Message" is a message that notifies the creator that the prompt information has been successfully saved in the database.

[1955] This invention is a platform for generating manga using artificial intelligence based on prompt information provided by creators, and a system for improving user experience by combining it with an emotion engine that recognizes readers' emotions. This system includes means for inputting prompt information, means for receiving and storing the prompt information in a database, artificial intelligence means for generating manga based on the stored prompt information, means for displaying the generated manga, emotion engine means for analyzing readers' facial expressions and reactions and collecting emotion data, and means for adjusting the story development of the generated manga based on the collected emotion data.

[1956] Hardware and Software Configuration

[1957] The server receives the prompt information and stores it in a database (e.g., MySQL). It also generates a manga based on the prompt information using a generative AI model (e.g., GPT-4). It also processes the emotional data collected by the emotion engine and adjusts the story development.

[1958] The terminals (readers' and creators' devices) are used to input prompt information, read manga, and collect emotional data. The reader's emotional data is acquired using a webcam and built-in sensors.

[1959] Users (creators and readers) enter prompt information and view generated comics through the content generation platform.

[1960] Specific program behavior

[1961] Entering prompt information and registering

[1962] 1. The user (creator) enters the prompt information

[1963] Creators open a browser, access the content generation platform, and enter prompt information such as "reincarnation in another world," "hero," or "demon king" into a dedicated form.

[1964] 2. The server receives the prompt information and checks the data.

[1965] The server receives this prompt information and checks for missing data or errors. If there are no errors, it saves the information to the database and notifies the creator that the prompt information has been successfully received.

[1966] Readers' selection of AI manga artists and manga generation

[1967] 1. The user (reader) logs in to the platform

[1968] Readers enter their username and password to log in to the platform and view a list of AI manga artists.

[1969] 2. The user (reader) selects an AI manga artist and instructs them to create the manga.

[1970] The reader selects the "AI Manga Artist Reincarnated in Another World" and clicks the "Start Generation" button. This action sends prompt information to the AI.

[1971] 3. The server sends the prompt information to the AI ​​and generates the manga.

[1972] The server sends the prompt information to a generative AI model (e.g., GPT-4) to generate a comic strip. The comic strip consists of approximately 20 pages. The generated comic strip data is stored in a database.

[1973] 4. The server sends the generated manga data to the reader's device.

[1974] The generated manga data is sent to the reader's device, and the manga is displayed. For example, the message "Manga has been generated" is displayed.

[1975] Utilizing the Emotion Engine

[1976] 1. The emotion engine analyzes facial expressions on the device (reader's device)

[1977] While the reader is reading the manga, the webcam and built-in sensors are used to record the reader's facial expressions and reactions, capturing the moment when the reader smiles, for example.

[1978] 2. The server receives the emotion data and performs emotion analysis.

[1979] The server receives the collected emotion data and performs emotion analysis, which classifies the emotion data into basic emotion categories.

[1980] 3. The server adjusts the comic story based on emotions.

[1981] Based on the emotional data, the server dynamically adjusts the storyline of the manga. For example, if there are many smiling faces, the story will develop in a more upbeat direction.

[1982] Creating sequels and deepening characters

[1983] 1. The user (reader) wants to create a sequel

[1984] After the reader finishes reading the manga, they click the "Generate sequel" button, and this request is sent to the server.

[1985] 2. The server generates new prompt information

[1986] The server generates new prompt information based on the analysis of the previous scene and the emotion engine, which determines the new storyline.

[1987] 3. The server uses AI to generate a sequel manga

[1988] Based on the new prompt information, the server generates a sequel manga, featuring new adventures and character development.

[1989] 4. The server sends the generated sequel manga data to the reader's device.

[1990] The generated sequel manga data is stored in a database and sent to the reader's device. The sequel manga is displayed and a message such as "A new adventure begins" is displayed to the reader.

[1991] This allows creators to easily input prompt information and generate high-quality manga, allowing readers to enjoy story developments that respond to their own emotions. Readers can also easily request sequels, allowing for continuous enjoyment.

[1992] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1993] Step 1:

[1994] Entering Prompt Information

[1995] The user (creator) opens a browser and accesses the content generation platform. They enter "prompt information" into a dedicated form. The information entered includes the world view, character settings, story outline, etc.

[1996] Input: Prompt information entered by the creator (e.g., "Reincarnation in Another World," "Hero," "Demon King")

[1997] Data processing: Check that the format of the entered information is correct.

[1998] Output: Send prompt information to the server

[1999] Step 2:

[2000] Receiving and checking prompt information

[2001] The server receives the prompt information entered and checks for missing data or errors.

[2002] Input: Prompt information sent by the user

[2003] Data calculations: Checking for missing data (e.g., required fields) and format validation

[2004] Output: If successful, go to next step; if not, generate an error message

[2005] Step 3:

[2006] Save prompt information

[2007] The server saves the prompt information after checking in a database (e.g. MySQL).

[2008] Input: Error-free prompt information

[2009] Data processing: Adding records to the database

[2010] Output: Generates a save completion message to notify the user

[2011] Step 4:

[2012] AI Manga Artist's Choice

[2013] The user (reader) logs in to the platform, browses the list of AI manga artists, and selects an AI manga artist based on the prompts they are interested in.

[2014] Input: User login information and browsing request

[2015] Data calculation: Get a list of registered AI manga artists

[2016] Output: Display a list of AI manga artists to the user

[2017] Step 5:

[2018] Manga generation instructions

[2019] The user (reader) clicks the "Start Generation" button. Prompt information is sent to the AI, which instructs it to generate the manga.

[2020] Input: User-selected AI manga artist and request to start generation

[2021] Data processing: Sending prompt information and generating instructions

[2022] Output: Input prompt information into the AI ​​model and start generating the manga

[2023] Step 6:

[2024] Manga generation

[2025] The server uses a generative AI model (e.g., GPT-4) to generate a manga based on the provided prompt information.

[2026] Input: Prompt Information

[2027] Data calculation: Story, character settings, scene generation

[2028] Output: Generated manga data (e.g. PDF format)

[2029] Step 7:

[2030] Saving and sending the generated manga data

[2031] The server stores the generated manga data in a database and sends it to the reader's device.

[2032] Input: Generated manga data

[2033] Data processing: Saving manga data to a database

[2034] Output: Notification of completion of saving to the database, sending of manga data to the terminal

[2035] Step 8:

[2036] Collecting reader reactions and emotions

[2037] While the terminal (reader's device) reads the manga, it uses the webcam and built-in sensors to analyze the reader's facial expressions and reactions.

[2038] Input: Reader's facial expressions and reactions

[2039] Data Computing: Collecting Emotional Data Using Facial Expression Recognition Algorithms

[2040] Output: Emotion data (e.g., smile, surprise, sadness counts)

[2041] Step 9:

[2042] Sentiment Data Analysis

[2043] The server receives the collected emotion data and performs classification and statistical analysis.

[2044] Input: Emotion data sent from the device

[2045] Data calculation: Classification and analysis of emotional data (e.g., categorization of joy, sadness, surprise)

[2046] Output: Analysis results (emotion parameters)

[2047] Step 10:

[2048] Story development adjustments

[2049] The server then adjusts the storyline of the next manga to be generated based on the results of the analysis of the emotional data.

[2050] Input: Emotion data analysis results

[2051] Data arithmetic: Adjustments made by storytelling algorithms

[2052] Output: Adjusted storyline

[2053] Step 11:

[2054] Sequel generation request

[2055] After the user (reader) finishes reading the manga, he / she clicks the "Generate sequel" button and sends a request to generate a sequel to the server.

[2056] Input: Sequel creation request

[2057] Data operation: Receiving request content and generating prompt information

[2058] Output: New prompt information

[2059] Step 12:

[2060] New prompt information generation and sequel manga generation

[2061] The server generates new prompt information and generates a sequel manga using AI.

[2062] Input: New prompt information, previous emotion data

[2063] Data calculation: Developing new storylines and generating character growth scenarios

[2064] Output: Sequel manga data

[2065] Step 13:

[2066] Saving and sending sequel manga

[2067] The server stores the generated sequel manga data in a database and sends it to the reader's device.

[2068] Input: Sequel manga data

[2069] Data processing: saving to database, sending to reader terminal

[2070] Output: Display and notify the sequel (e.g. "A new adventure begins")

[2071] In this way, the overall system processing is divided into a series of steps, with specific actions being performed at each step, enabling a high-quality manga experience to be provided to both creators and readers.

[2072] (Application example 2)

[2073] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2074] Conventional manga generation platforms simply generate manga with fixed content based on prompt information provided by creators, and are unable to provide a personalized experience that reflects the user's emotions. Furthermore, there is no way to reflect the reader's real-time reactions in the manga storyline, making it difficult to increase reader satisfaction.

[2075] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for inputting prompt information, means for receiving the prompt information and saving it in a database, artificial intelligence means for generating a manga based on the saved prompt information, means for displaying the generated manga, emotion recognition means for capturing the reader's facial expressions and reactions in real time and recognizing their emotions, and means for adjusting the story development of the manga based on the recognized emotion data. This makes it possible to generate a personalized manga that reflects the reader's real-time emotions.

[2076] "Prompt information" is information provided by creators such as the worldview of the manga, character settings, and story outline.

[2077] "Input means" is an interface through which the creator provides prompt information to the system.

[2078] The "means for receiving and storing in a database" is the mechanism that receives the entered prompt information, checks it for errors, and stores it in a database.

[2079] "Artificial intelligence means" refers to an AI model and related technologies for generating manga based on stored prompt information.

[2080] "Display means" refers to the mechanism by which the generated manga is displayed on the reader's terminal or a device such as smart glasses.

[2081] "Emotion recognition means" is a technology that captures readers' facial expressions and reactions in real time and recognizes their emotions.

[2082] The "means for adjusting the story development" is a method for dynamically changing the story content of a manga based on the emotional data recognized by the emotional recognition means.

[2083] A "means for requesting a sequel" is an interface that allows a reader to send a request for a sequel to a manga to the system.

[2084] The "means for generating new prompt information" is a technique for generating new prompt information based on a sequel request.

[2085] "Means for checking and ensuring there are no errors" refers to a mechanism that verifies that the prompt information entered by the creator is complete and correct.

[2086] "Means of notification" refers to a system that notifies creators whether or not there are any errors.

[2087] "Reader" refers to an individual who views the generated manga.

[2088] "Creator" refers to the individual or entity that provides prompt information and directs the creation of the manga.

[2089] System Overview

[2090] The present invention is a system that generates a comic based on prompt information and dynamically adjusts the story development according to the user's emotions. This system includes the following elements:

[2091] 1. Means for inputting prompt information: An interface (e.g., a dedicated form) for creators to input prompt information into the system.

[2092] 2. Means of saving to a database: A mechanism to receive the entered prompt information and save it to a database (e.g., a server and database).

[2093] 3. Artificial intelligence means: AI models and related technologies that generate manga based on stored prompt information (e.g., generative AI models).

[2094] 4. Display method: A mechanism for displaying the generated manga on the reader's terminal or a device such as smart glasses.

[2095] 5. Emotion recognition: Technology that captures readers' facial expressions and reactions in real time and recognizes their emotions (e.g., emotion recognition API).

[2096] 6. A method for adjusting the storyline: A method for dynamically changing the story content of a manga based on recognized emotion data.

[2097] Program operation overview

[2098] Enter and save prompt information

[2099] The server receives prompt information provided by the creator through the means of input. This information is stored in a database. Once saved, the creator is notified. During this process, the data is checked for missing or errors.

[2100] Manga generation and display

[2101] The user's device accesses the platform and selects an AI means for generating comics based on the registered prompt information. The generated comics are displayed on the user's device or smart glasses through a display means.

[2102] Emotion recognition and storyline adjustment

[2103] While the user is reading the manga, the device's built-in camera captures their facial expressions, which are then analyzed by the emotion recognition system. Based on the recognized emotional data, the story development adjustment system changes the content of the manga. This operation is performed in real time, providing a personalized reading experience according to the user's emotions.

[2104] Specific examples

[2105] For example, a creator enters the following prompt information for the "Isekai Tensei" theme:

[2106] "World: Another World"

[2107] "Characters: Hero, Demon King"

[2108] "Story: A Journey to Defeat the Demon King"

[2109] Based on this prompt information, the generative AI model generates the first comic. The user then views this comic while wearing the smart glasses. If the user's facial expression is smiling, the story unfolds in a fun direction. Conversely, if the user's facial expression is sad, a touching scene is added.

[2110] Specific processing of the program

[2111] Each of the above methods is realized using specific hardware and software. For example, a web interface and database (e.g., MySQL) are used to input and store prompt information, a camera and an emotion recognition API (e.g., Microsoft Azure's facial recognition API) are used for emotion recognition, and a generative AI model (e.g., a natural language processing model such as GPT-3) is used for the AI ​​model.

[2112] This system allows creators to easily incorporate their ideas into manga, and users can enjoy stories that reflect their emotions at the time, resulting in a high-quality manga experience.

[2113] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2114] Step 1:

[2115] The server receives prompt information from the creator through a means for entering prompt information. Input is done through a dedicated form, with the creator providing information such as the world view, character settings, and story outline. The entered prompt information is saved in a database. When saved to the database, the data is checked for missing or errors. Examples of input data include "World: Another world," "Characters: Hero, Demon King," and "Story: Journey to defeat the Demon King." Once the error check is complete, a save completion message is sent to the creator. The input here is the prompt information, and the output is saving to the database and notification.

[2116] Step 2:

[2117] The user's device accesses the platform and uses a generative AI model to generate a manga based on the prompt information. The reader selects an AI cartoonist based on the prompt information they are interested in and clicks the "Start Generation" button. The prompt information is sent to the AI, which generates a manga of about 20 pages. The generated manga data is saved in a database and sent to the user's device, where the manga is displayed. The input is the saved prompt information, and the output is the generated manga.

[2118] Step 3:

[2119] The user wears the smart glasses and views the generated manga. The camera built into the smart glasses captures the user's facial expressions in real time. The video frames are sent to the emotion recognition API, which analyzes the user's emotions. The analysis results are "smiling" or "sad," etc. This emotion data is sent to the server and stored in a database. The input is the user's real-time facial expressions, and the output is emotion data generated by the emotion recognition API.

[2120] Step 4:

[2121] The server adjusts the storyline of the comic based on the emotional data received from the emotion recognition API. For example, if the user is smiling, it adds a fun event or humor to the scene. Conversely, if the user has a sad expression, it adds a touching scene or encouraging content. In this process, the next prompt information is automatically generated based on the emotional data, and is sent again to the generative AI model to generate a new comic. The input is the emotional data, and the output is the adjusted storyline and a new comic.

[2122] Step 5:

[2123] When a user clicks the "Generate Sequel" button, the server generates new prompt information based on the previous scene and feedback from the emotion engine. Based on this new prompt information, the AI ​​generates a sequel manga and sends it to the user's device. The input here is the previous scene, emotional feedback, and the generation of new prompt information, and the output is the generated sequel manga.

[2124] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2125] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2126] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2127] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2128] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2129] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2130] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2131] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2132] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2133] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the ...

Claims

1. a means for inputting prompt information; means for receiving the prompt information and storing it in a database; an artificial intelligence means for generating a comic based on the stored prompt information; a means for displaying the generated comic; A system including:

2. A way for readers to request a sequel, means for generating new prompt information based on the sequel request; an artificial intelligence means for generating a sequel manga based on the new prompt information; The system of claim 1 , comprising:

3. A means to check the prompt information entered by the creator for errors; a means for notifying the creator of the presence or absence of the error; The system of claim 1 , comprising:

Images