System
A collaborative manga creation system using AI to generate content based on user inputs addresses the limitations of traditional manga creation by enabling multiple users to collaborate, ensuring fair participation, and effectively displaying user engagement.
Patent Information
- Application Number
- JP2024166029
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-09-26
- Filing Date
- 2024-09-25
- Publication Date
- 2025-04-08
- Estimated Expiration
- 2044-09-25
AI Technical Summary
Traditional manga and novel creation are typically done by individual creators, limiting collaboration and participation from a large number of users. Additionally, there is a need for systems that allow fair participation, resolve copyright issues, and effectively display popularity and attention.
A system that enables multiple users to collaborate on manga creation through a web-based interface, utilizing AI to generate content based on user inputs. The system includes features for setting characters, settings, and stages, generating manga stories, reflecting user opinions through voting, and displaying popularity and attention levels.
The system facilitates collaborative manga creation, ensures fair participation, addresses copyright issues, and effectively displays user engagement, thereby enhancing user experience and creativity.
Smart Images

Figure 2025056780000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] Traditionally, manga and novels have been created by individual creators. However, there is a growing demand for a new format in which many people collaborate to create works. In particular, a format in which a large number of users participate using AI and the results are decided by voting is attracting attention as a fresh form of entertainment. However, to realize such a system, a mechanism is needed that allows a large number of users to participate, determines the results fairly, and resolves copyright issues. [Means for solving the problem]
[0005] The system of the present invention includes a setting providing means for providing an interface for a specific first user to set the characters, setting, and stage of a manga; a creation providing means for providing an interface for a specific second user other than the first user to create a manga that includes the set characters, setting, and stage on a specific page; a generation means for generating a manga story that includes the set characters, setting, and stage on a specific page by inputting a specific prompt sentence generated based on information input by the second user into a generative AI model; a reflection means for accepting opinions contained in votes from an unspecified number of users within a certain period of time and reflecting the opinions in the subsequent development of the created manga story; an emotion engine that recognizes the emotions of users who have read the manga; and a means for adjusting the development based on the emotions. [Brief explanation of the drawings]
[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a flow of processing in the data processing system according to the first embodiment of the first form example. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Embodiment 1. [Figure 13] FIG. 10 is a sequence diagram showing a processing flow of a data processing system in a second embodiment of the second form example. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Embodiment Example 2. [Figure 15] FIG. 10 is a sequence diagram showing the flow of processing in a data processing system according to a third embodiment of the third embodiment. [Figure 16] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Embodiment 3. [Figure 17] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when an emotion engine is combined. [Figure 19] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the second embodiment of the second form example when an emotion engine is combined. [Figure 20] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when an emotion engine is combined. [Figure 21] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the third embodiment of the third form example when an emotion engine is combined. [Figure 22] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0007] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0008] First, the terms used in the following description will be explained.
[0009] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).
[0010] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0012] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0014] [First embodiment]
[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0019] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0021] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0022] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0023] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0024] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0025] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0026] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.
[0027] "Example 1"
[0028] In one embodiment of the present invention, a website is provided that operates on the Internet and provides an interface for users to create characters, settings, and settings, including a form for inputting information such as the character's name, personality, and appearance, and options for setting the setting's location, time, and situation.
[0029] "Example 2"
[0030] Subsequent users use an interface to generate a one- or two-page manga. This interface uses AI technology to automatically generate a manga based on the information entered by the user. For example, if a user enters a scenario in which the protagonist fights an enemy, a manga based on that scenario will be generated.
[0031] "Example 3"
[0032] The next page of the generated manga is decided by voting from an unspecified number of users. Voting takes place on the website, and the manga that receives the most votes within a certain period of time (for example, one hour) is adopted as the next page. The voting results are displayed in real time on the website, and users generate the next page based on the voting results.
[0033] "Example 4"
[0034] The app also provides a function that displays the popularity and attention of the created manga in a ranking format. The ranking is calculated based on indicators such as the number of votes and views, and users can use the ranking as a reference when creating new manga.
[0035] "Example 5"
[0036] Furthermore, it also provides a function to prevent fraudulent voting by organized votes. For example, it prevents fraudulent voting by limiting the number of votes from the same IP address within a certain period of time. It also sets out terms for users to waive copyright on the manga they create, and requires users to agree to these terms when creating manga.
[0037] The processing flow of each embodiment will be described below.
[0038] "Example 1"
[0039] Step 1: The user visits the provided website.
[0040] Step 2: On the website, the user uses an interface to generate characters, settings, and settings, including a form to input information such as the character's name, personality, and appearance, and options to set the setting's location, time, and situation.
[0041] Step 3: Once the user has finished entering the information, it is sent to the server and stored in a database.
[0042] "Example 2"
[0043] Step 1: Subsequent users use the interface to generate a 1-2 page comic.
[0044] Step 2: The user inputs a scenario, and the AI automatically generates a manga based on that scenario.
[0045] Step 3: The resulting comic is then made publicly available to other users on the website and is subject to voting.
[0046] "Example 3"
[0047] Step 1: The next page of the generated manga is decided by voting from an unspecified number of users.
[0048] Step 2: Voting takes place on the website, and the cartoon that receives the most votes within a certain time period (for example, one hour) is selected as the next page.
[0049] Step 3: The voting results are displayed in real time on the website, and the user generates the next page based on the voting results.
[0050] "Example 4"
[0051] Step 1: We also provide a function to display the popularity and attention of the generated manga in a ranking format.
[0052] Step 2: Rankings are calculated based on indicators such as the number of votes and views, and users can use the rankings as a reference to create new manga.
[0053] "Example 5"
[0054] Step 1: We also provide functions to prevent fraudulent voting through organized voting.
[0055] Step 2: Prevent fraudulent voting by limiting the number of votes from the same IP address within a certain period of time.
[0056] Step 3: Establish terms and conditions for waiving copyright on user-generated comics, and require users to agree to these terms when generating comics.
[0057] Example 1
[0058] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0059] Previous character and setting generation systems required users to manually configure detailed settings, which was time-consuming and labor-intensive. Furthermore, there were limited ways to incorporate user input into decisions about the next development of generated content. Furthermore, there was a lack of effective ways to display the popularity and attention of generated content.
[0060] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0061] In this invention, the server includes a means for users to generate characters, settings, and settings; a means for generating prompt sentences based on the generated characters and settings; a means for sending prompt sentences to a generative AI model and receiving responses; a means for displaying the received responses to the user; a means for a second or subsequent user to generate one or two pages of manga; a means for determining the next page of the generated manga through an unspecified number of votes; and a means for generating the next page based on the voting results. This allows users to easily generate characters and settings and enjoy stories and manga based on them. Furthermore, the server can determine the next development based on user opinions, and effectively display the popularity and attention of the generated content.
[0062] "User" means an individual or group that uses the system to generate characters, settings, and stages, and to view or operate the generated content.
[0063] "Character" refers to setting information such as people, animals, and fictional beings that appear in stories and manga.
[0064] "Setting" refers to detailed information such as the character's personality and appearance, background information, the setting, time, and situation of the story.
[0065] "Setting" refers to the setting, such as the place, environment, and time period in which a story or manga unfolds.
[0066] A "prompt sentence" refers to a sentence that is sent to a generative AI model based on character and setting information entered by the user.
[0067] A "generative AI model" refers to an artificial intelligence model that generates a response based on a prompt entered by a user.
[0068] A "response" refers to a sentence or part of a story that a generative AI model generates based on a prompt.
[0069] "Voting" refers to the act of a user expressing their opinion to determine the development of the next page of the generated comic.
[0070] "Unspecified majority" refers to many users who are not limited to specific individuals or organizations.
[0071] "Popularity" refers to an index showing how many users support the generated content.
[0072] "Attention" refers to an index showing how many users are interested in the generated content.
[0073] "Ranking format" refers to a format in which generated content is ranked and displayed based on popularity or attention.
[0074] "Organized voting" refers to voting behavior carried out by a specific group or organization in order to intentionally manipulate the voting results.
[0075] "Voting fraud" refers to fraudulent voting practices that undermine the fairness of the system.
[0076] "Copyright" refers to the legal rights you have in your User Generated Content.
[0077] "Abandonment" refers to the act of a user voluntarily abandoning copyright and making the work freely available to others.
[0078] This invention is a system that provides a website that users can access over the Internet, through which they can create characters, settings, and locations and enjoy stories and comics based on them.
[0079] Servers host websites and process user requests. Specifically, servers use the following hardware and software:
[0080] Hardware: Use a server machine with a high-performance processor, sufficient memory, and fast storage. For example, use a server with an Intel Xeon processor, 32GB or more of RAM, and SSD storage.
[0081] Software: The server uses web server software (e.g., Apache® or Nginx), a database management system (e.g., MySQL® or MongoDB), and a generative AI model (e.g., OpenAI®'s GPT-3®).
[0082] When a user accesses a website, the server returns a web page created using HTML, CSS, and JavaScript. This web page contains a form for entering information about the character and the setting. The user fills in the provided form with information such as the character's name, personality, appearance, location, time, and situation.
[0083] When the user submits the form, the server receives the data and stores it in a database. The server checks the data for integrity and converts the data if necessary. The server then generates a prompt based on the information the user entered. For example, it might generate a prompt like this:
[0084] Example prompt sentence:
[0085] The character's name is Alice. She is a brave, blonde girl. The setting is a magical forest, the time is night, and the situation is the beginning of an adventure. Generate a story of Alice's adventure based on this setting.
[0086] The server sends this prompt to the generative AI model, which then generates a response based on the prompt, such as "Alice went deep into the enchanted forest and found a mysterious light in the silence of the night."
[0087] The server receives the response from the generative AI model and displays it to the user, who can then view the generated story on a web page.
[0088] Furthermore, a means is provided for subsequent users to generate one or two pages of a manga. The next page of the generated manga is decided by a vote of an unspecified number of users. Voting takes place within a certain time period (for example, one hour), and the next page is generated based on the results.
[0089] The popularity and attention of the generated manga are displayed in a ranking format, and measures are included to prevent fraudulent voting by organized votes. Users are also provided with a means to waive copyright on the manga they generate.
[0090] In this way, users can easily create characters and settings and enjoy stories and comics based on them. Furthermore, the next development of the story can be determined based on the user's opinions, and the popularity and attention of the created content can be effectively displayed.
[0091] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0092] Step 1:
[0093] A user visits a website.
[0094] Input: The user accesses the specified URL using a browser.
[0095] Output: The server returns a web page.
[0096] How it works: A user uses a browser such as Google Chrome (registered trademark) or Mozilla Firefox to enter the URL of a website and access it. The server receives the request and returns a web page created using HTML, CSS, and JavaScript to the user's browser.
[0097] Step 2:
[0098] The server provides the interface.
[0099] Input: The access request from the user.
[0100] Output: A web page containing a form for entering character and setting information.
[0101] Specific operation: When accessed by a user, the server provides a web page containing a form for entering information such as the character's name, personality, appearance, setting location, time, situation, etc. To do this, the form is created using HTML and CSS, and user input is validated in real time using JavaScript.
[0102] Step 3:
[0103] The user inputs character and setting information.
[0104] Input: Information entered by the user into a form, such as the character's name, personality, appearance, location, time, and situation.
[0105] Output: The data entered into the form.
[0106] Specific actions: In the provided form, the user enters "Alice" as the character's name, "Brave" as the personality, "Blonde Girl" as the appearance, "Enchanted Forest" as the setting, "Night" as the time, and "The Beginning of the Adventure" as the situation.
[0107] Step 4:
[0108] The server receives and stores the input data.
[0109] Input: The form data submitted by the user.
[0110] Output: Data stored in a database.
[0111] What happens: When a user submits a form, the server receives the data and stores it in a database (e.g., MySQL or MongoDB). The server verifies the integrity of the data and converts it if necessary.
[0112] Step 5:
[0113] The server sends a prompt to the generative AI model.
[0114] Input: Character and setting information entered by the user.
[0115] Output: The prompt sent to the generative AI model.
[0116] Specific operation: The server generates a prompt based on the information entered by the user. For example, it creates a prompt like, "The character's name is Alice. She is a brave, blonde girl. The setting is a magical forest, the time is night, and the situation is the beginning of the adventure. Please generate a story about Alice's adventure based on this setting." The server then sends this prompt to the generative AI model.
[0117] Step 6:
[0118] A generative AI model generates a response.
[0119] Input: The prompt text sent by the server.
[0120] Output: The generated response (part of the story).
[0121] How it works: The generative AI model generates a response based on a prompt sent from the server, such as a part of a story like "Alice went deep into the enchanted forest and found a mysterious light in the silence of the night."
[0122] Step 7:
[0123] The server displays the generated response to the user.
[0124] Input: The response returned by the generative AI model.
[0125] Output: The story that is displayed in the user's browser.
[0126] Specific operation: The server receives the response from the generative AI model and displays it to the user, who can then view the generated story on a web page.
[0127] Step 8:
[0128] The second and subsequent users will generate one or two pages of comics.
[0129] Input: Manga content entered by the second and subsequent users.
[0130] Output: A generated 1-2 page comic.
[0131] Specific operation: The second and subsequent users use the interface to generate a one- to two-page manga based on the generated story. The user sets the character movements, dialogue, background, etc., and generates the manga.
[0132] Step 9:
[0133] The next page of the generated manga will be decided by an unspecified number of votes.
[0134] Input: Votes from a random number of users.
[0135] Output: The content of the next page, determined based on the voting results.
[0136] Specific operation: The server accepts votes from an unspecified number of users to decide the development of the next page of the generated manga. Voting takes place within a certain time period (for example, one hour), and the next page is generated based on the results.
[0137] Step 10:
[0138] The server displays the popularity and attention of the generated manga in a ranking format.
[0139] Input: Data about the popularity and attention of the generated manga.
[0140] Output: Popularity and attention displayed in ranking format.
[0141] Specific operation: The server collects data such as user ratings and number of views to generate rankings and display the popularity and attention of the generated manga in a ranking format. Users can check which manga are popular or attracting attention by viewing the rankings.
[0142] Step 11:
[0143] The server prevents fraudulent voting through organized voting.
[0144] Input: Voting data.
[0145] Output: Voting results with fraud prevented.
[0146] Specific operation: The server analyzes the voting data and uses an algorithm to detect fraudulent voting by organized voting. If fraudulent voting is detected, the server invalidates the vote to maintain fair voting results.
[0147] Step 12:
[0148] You waive copyright on user-generated comics.
[0149] Input: User's copyright waiver.
[0150] Output: A copyright-free manga.
[0151] Specific operation: The user selects an option to waive the copyright of the manga they have created. The server receives the user's consent and records that the copyright has been waived. This allows other users to freely use the manga.
[0152] (Application example 1)
[0153] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0154] Conventional character and setting generation systems lacked the means to effectively utilize user-generated content and share it with a wide range of users. Furthermore, there was insufficient means to visualize the popularity and attention of generated content, making it difficult to maximize user creativity. Furthermore, there was a lack of a mechanism to reflect the opinions of an unspecified number of users in the generated content and progress it, making interactive content generation difficult.
[0155] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0156] In this invention, the server includes: a means for users to generate characters, settings, and settings; a means for second and subsequent users to generate one or two pages of manga; a means for determining the next page of the generated manga through an unspecified number of votes; a means for automatically generating a short story based on information entered by the user using a generative AI model; a means for sharing the generated story to a content distribution platform; a means for displaying the popularity and attention of the generated manga in a ranking format; a means for preventing fraudulent voting through organized voting; a means for relinquishing copyright to the manga generated by the user; and a means for sharing the generated story on a social networking site. This enables effective utilization of user-generated content and sharing it with a wide range of users. Furthermore, by visualizing the popularity and attention of the generated content, user creativity can be maximized. Furthermore, by providing a mechanism for progressing content by reflecting the opinions of an unspecified number of users, interactive content generation becomes possible. The server may include: a setting providing means for providing an interface for a specific first user to set characters, settings, and settings for a manga; a creation providing means for providing an interface for a specific second user (excluding the first user) to create a manga including the set characters, settings, and settings on specific pages; a generation means for generating a manga story including the set characters, settings, and settings on specific pages by inputting specific prompt sentences generated based on information input by the second user into a generative AI model; a reflection means for accepting opinions contained in votes from an unspecified number of users within a certain period of time and reflecting the opinions in the subsequent development of the created manga story; an emotion engine for recognizing the emotions of users who have read the manga; and a means for adjusting the development based on the emotions. The server may also include a means for limiting the votes from the same IP address within a certain period of time. The server may also include a means for calculating a ranking of the manga based on the number of votes and views of users who have read the manga and for displaying the ranking on the user's terminal.
[0157] "User" means an individual or group that uses the system to generate characters, settings, and locations, and to create content.
[0158] A "character" is a character created by a user, and has attributes such as a name, personality, and appearance.
[0159] "Setting" refers to the environment or situation in which a character exists, and includes elements such as place, time, and situation.
[0160] "Setting" refers to the specific place and time background in which the characters act.
[0161] A "generative AI model" is an artificial intelligence algorithm that automatically generates short stories based on information entered by the user.
[0162] A "prompt" is an instruction to be input into a generative AI model, and includes information about the characters and setting set by the user.
[0163] A "content distribution platform" is an online service that allows users to share created stories and comics with a wide range of users.
[0164] A "vote" is an expression of opinion made by an unspecified number of users to decide the next page of the generated manga.
[0165] "Ranking format" is a method of displaying the generated manga in order of popularity and attention.
[0166] "Fraudulent voting" is the act of manipulating voting results using fraudulent means such as organizing votes.
[0167] "Means for Relinquishing Copyright" refers to the methods for relinquishing copyright to user-generated comics and stories.
[0168] "SNS" stands for Social Networking Service, an online platform for sharing user-generated stories.
[0169] The system for implementing this invention allows a user to create characters, settings, and locations, and then create short stories or comics based on those settings. A specific embodiment of this system will be described below.
[0170] System Configuration
[0171] The system consists of the following main components:
[0172] 1. User terminal: A device (e.g., smartphone, tablet, PC) through which a user inputs characters, settings, and settings.
[0173] 2. Server: A central processing unit that receives input from users, generates short stories using generative AI models, and shares them on content distribution platforms.
[0174] 3. Generative AI model: An artificial intelligence algorithm that automatically generates short stories based on user-entered information (e.g., OpenAI's GPT-3).
[0175] 4. Content distribution platform: Online services (e.g., social networking sites, blogging platforms) for sharing generated stories and comics with a wide range of users.
[0176] Program processing
[0177] User terminal
[0178] The user terminal provides an interface for the user to input information about the characters, settings, and stage, such as the character's name, personality, appearance, stage location, time, and situation.
[0179] server
[0180] The server receives the information sent by the user and sends it as a prompt to the generative AI model. The generative AI model generates a short story based on the prompt and returns the result to the server. The server then sends the generated story to the user's device and displays it to the user. The server also has the function of sharing the generated story on a content distribution platform.
[0181] Generative AI Models
[0182] The generative AI model automatically generates a short story based on user-entered information, specifically using prompts like the following:
[0183] Example prompt sentence:
[0184] Character's Name: Alice
[0185] Personality: Brave and curious
[0186] Setting: Future city
[0187] Plot: Alice discovers new technology and goes on adventures with it.
[0188] Use this information to generate a short story.
[0189] The generative AI model generates a short story based on this prompt and returns the result to the server.
[0190] Specific examples
[0191] For example, if a user creates a character named "Alice" and sets her personality as "brave and curious," the setting as "a futuristic city," and the plot as "Alice discovers new technology and uses it to go on an adventure," the generative AI model will use this information to generate a short story that can be displayed on the user's device and shared on social media or blog platforms.
[0192] In this way, users can easily set up characters and settings, use generative AI models to generate short stories, and share them with a wide audience.
[0193] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0194] Step 1:
[0195] The user uses a terminal to input information about the characters, setting, and location.
[0196] Input: Information such as the character's name, personality, appearance, location, time, and situation.
[0197] Data processing: Convert the information entered by the user into the format of a prompt statement.
[0198] Output: The prompt statement.
[0199] Specific operation: The user inputs the character's name "Alice," personality "brave and curious," setting "future city," and plot "Alice discovers new technology and uses it to go on an adventure" through the terminal interface.
[0200] Step 2:
[0201] Sends the terminal generated prompt to the server.
[0202] Input: Prompt statement.
[0203] Data processing: Convert the prompt text into a data format to be sent to the server.
[0204] Output: The prompt text sent to the server.
[0205] Specific operation: The terminal sends a prompt message generated based on the information entered by the user to the server.
[0206] Step 3:
[0207] The server receives the prompt sentence and sends it to the generative AI model.
[0208] Input: prompt statement.
[0209] Data processing: Converting the prompt sentence into a format suitable for the generative AI model.
[0210] Output: The prompt sent to the generative AI model.
[0211] Specific operation: The server sends the received prompt sentence to a generative AI model (e.g., OpenAI's GPT-3).
[0212] Step 4:
[0213] A generative AI model generates a short story based on a prompt.
[0214] Input: prompt statement.
[0215] Data computation: A generative AI model analyzes the prompt and generates a short story.
[0216] Output: A generated short story.
[0217] Specific behavior: The generative AI model generates a short story based on the prompt: "Character's name: Alice, Personality: Brave and curious, Setting: Future city, Plot: Alice discovers new technology and uses it to go on an adventure."
[0218] Step 5:
[0219] The generated short story is sent back to the server.
[0220] Input: A generated short story.
[0221] Data processing: The server receives the short stories returned by the generative AI model.
[0222] Output: The short story received by the server.
[0223] Specific operation: The generative AI model sends the generated short story back to the server.
[0224] Step 6:
[0225] The server transmits the generated short story to the user terminal.
[0226] Input: A generated short story.
[0227] Data processing: The short story is converted into a data format for transmission to the user's terminal.
[0228] Output: A short story sent to the user's device.
[0229] Specific operation: The server sends the generated short story to the user terminal.
[0230] Step 7:
[0231] The user terminal displays the generated short story.
[0232] Input: A generated short story.
[0233] Data processing: Converting short stories into a display format.
[0234] Output: A short story displayed to the user.
[0235] Specific operation: The user terminal displays the generated short story on the screen.
[0236] Step 8:
[0237] Share user-generated short stories to a content distribution platform.
[0238] Input: A generated short story.
[0239] Data processing: Converting short stories into a format suitable for content distribution platforms.
[0240] Output: A short story shared to a content distribution platform.
[0241] Specific operation: The user shares the generated short story on social media or blog platforms.
[0242] Example 2
[0243] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0244] Conventional manga generation systems require users to manually draw characters and scenarios, which is time-consuming and labor-intensive. Furthermore, there was a lack of a way to reflect users' opinions when deciding the next page of the generated manga, which led to a decline in users' motivation to participate. Furthermore, there was no way to effectively display the popularity or attention of the generated manga, making it difficult to maintain users' interest.
[0245] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0246] In this invention, the server includes: a means for a user to generate characters, settings, and a setting; a means for a second or subsequent user to generate one or two pages of a manga; a means for a user to input a scenario; a means for the server to generate a prompt; a means for the server to send the prompt to a generation AI model; a means for the generation AI model to generate a manga; a means for returning the generated manga to the user; a means for determining the next page of the generated manga through an unspecified number of votes; and a means for generating the next page based on the voting results. This allows users to easily generate manga based on their own scenario, and by having users vote to determine the next page, it is possible to increase users' motivation to participate. Furthermore, by displaying the popularity and attention of the generated manga in a ranking format, it is possible to continue to attract users' attention.
[0247] A "user" is an individual or group that uses the system to generate characters, settings, and locations, and input scenarios.
[0248] A "character" is an element that plays a role in a story, such as a comic book character, an animal, or a fictional being.
[0249] "Setting" refers to the information that forms the basis of a manga story, such as the background and situation of the story and the relationships between the characters.
[0250] "Setting" refers to the place or environment in which the story of a manga unfolds.
[0251] A "scenario" is the plot and development of a story entered by the user.
[0252] A "prompt sentence" is an instruction sentence for a generative AI model that is generated based on a scenario entered by the user.
[0253] A "generative AI model" is an artificial intelligence technology that analyzes prompt text and generates a manga story and images based on a scenario.
[0254] A "vote" is an expression of intent made by an unspecified number of users to determine the content of the next page of the generated manga.
[0255] The "ranking format" is a format in which the generated manga are ranked and displayed according to their popularity and attention.
[0256] "Fraudulent voting" is the act of manipulating voting results using fraudulent means such as organizing votes.
[0257] "Relinquishing copyright" means giving up the copyright to the comic created by the user, making it freely available to others.
[0258] This invention is a system that allows users to easily create manga and decide the content of the next page through an unspecified number of votes. The system provides an interface for users to create characters, settings, and locations, and input a scenario. A specific embodiment of this system is described below.
[0259] System configuration
[0260] The system consists of the following main components:
[0261] 1. User Device
[0262] 2. Server
[0263] 3. Generative AI Models
[0264] User terminal
[0265] A user terminal is a device that uses a web browser to access the system interface and can be any device that can connect to the Internet, such as a PC, smartphone, or tablet.
[0266] server
[0267] The server is responsible for receiving input from the user, generating prompts, and sending them to the generative AI model. The server performs the following tasks:
[0268] Receives a scenario entered by the user
[0269] Generate prompts based on a scenario
[0270] Sending prompts to the generative AI model
[0271] Return the manga generated by the generative AI model to the user
[0272] Generative AI Models
[0273] The generative AI model analyzes the prompt text sent from the server and generates a manga story and images based on the scenario. This model combines natural language processing technology and image generation technology. Specifically, OpenAI's GPT-4 (registered trademark) and DALL-E are used.
[0274] Specific examples
[0275] For example, if the user inputs a scenario such as "The protagonist fights the enemy," the server will generate a prompt like this:
[0276] Prompt: "Draw a scene where the protagonist fights the enemy. The protagonist is brave and the enemy is a giant dragon."
[0277] Based on this prompt, the generative AI model generates a one- to two-page comic that includes a scene in which the main character fights a giant dragon. The generated comic is then displayed to the user via the server.
[0278] Voting function
[0279] The content of the next page of the generated manga is decided by a vote of an unspecified number of users. Voting takes place within a certain time period (for example, one hour), and the next page is generated based on the results. This voting function can increase users' motivation to participate.
[0280] Popularity and attention display
[0281] The popularity and attention of the generated manga are displayed in a ranking format, allowing users to see which manga other users are interested in. It also includes measures to prevent fraudulent voting by organized votes.
[0282] In this way, a system is realized that allows users to easily create a manga based on their own scenario and decide the content of the next page by voting.
[0283] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0284] Step 1:
[0285] The user accesses the interface
[0286] A user accesses the system interface using a web browser. The user accesses the system's URL from their terminal and the interface is displayed. Input: User's access request. Output: Interface display.
[0287] Step 2:
[0288] The user inputs a scenario
[0289] The user inputs a scenario into an input form on the interface. For example, the scenario is "The protagonist fights the enemy." Input: User's scenario. Output: Transmission of scenario data.
[0290] Step 3:
[0291] The server generates a prompt
[0292] The server receives the scenario entered by the user and generates a prompt based on it. For example, it generates a prompt such as, "Draw a scene where the main character fights the enemy. The main character is brave, and the enemy is a giant dragon." Input: Scenario data. Output: Prompt.
[0293] Step 4:
[0294] The server sends a prompt to the generative AI model
[0295] The server sends the generated prompt sentence to the generative AI model. The generative AI model is accessed, for example, through an API. Input: Prompt sentence. Output: Sending a request to the generative AI model.
[0296] Step 5:
[0297] Generative AI model generates manga
[0298] The generative AI model analyzes the received prompt and generates a manga story and images based on the scenario. For example, it generates a one- to two-page manga including a scene in which the main character fights a giant dragon. Input: Prompt. Output: Generated manga data.
[0299] Step 6:
[0300] The server returns the generated comic to the user
[0301] The server receives the manga returned by the generative AI model and displays it to the user. The user can view the generated manga on the interface. Input: Generated manga data. Output: Manga displayed on the user's device.
[0302] Step 7:
[0303] Users vote for the next page
[0304] Users vote to decide the content of the next page of the generated manga. Voting takes place within a certain time period (for example, one hour). Input: User votes. Output: Voting data tallied.
[0305] Step 8:
[0306] The server generates the next page based on the vote results.
[0307] The server tally the voting results, generate the prompt for the next page based on the results, and send it back to the generative AI model. Input: Voting data. Output: The prompt for the next page and the generated comic.
[0308] Step 9:
[0309] The server returns the next generated page to the user
[0310] The server receives the next page of the manga returned by the generative AI model and displays it to the user. The user can view the next page on the interface. Input: Manga data for the next page. Output: Display of the next page of the manga on the user's device.
[0311] In this way, a system is realized that allows users to easily create a manga based on their own scenario and decide the content of the next page by voting.
[0312] (Application example 2)
[0313] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0314] Conventional manga generation systems require users to manually draw characters and scenarios, which is time-consuming and labor-intensive. Furthermore, there were limited ways to reflect users' opinions when deciding the next page of the generated manga, making it difficult to motivate users to participate. Furthermore, there was a lack of easy ways to share the generated manga, making it difficult to promote interaction between users.
[0315] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for a user to generate characters, settings, and a setting; means for a second or subsequent user to generate one to two pages of manga; means for determining the next page of the generated manga by an unspecified number of votes; means for generating the next page based on the voting results; means for automatically generating a manga using a generative AI model when a user inputs a scenario; means for saving and displaying the generated manga as an image; and means for sharing the generated manga. This enables users to easily generate manga, determine the content of the next page by voting, and share the generated manga with other users.
[0316] "Character" refers to people, animals, fictional beings, etc. that appear in a story.
[0317] "Setting" refers to the elements that determine the background and situation of a story, the relationships between characters, etc.
[0318] "Setting" refers to the place or environment in which the story unfolds.
[0319] A "generative AI model" refers to an artificial intelligence algorithm that automatically generates manga based on information entered by the user.
[0320] A "scenario" refers to the text or plot that shows the plot and development of a story.
[0321] "Voting" refers to the act of an unspecified number of users expressing their opinions and tallying the results.
[0322] "Image" refers to digital data containing visual information.
[0323] "Storage" refers to the act of recording the generated data in a storage device.
[0324] "Display" refers to the act of visually presenting the generated data to the user.
[0325] "Sharing" refers to the act of sharing generated data with other users.
[0326] A system for implementing this invention includes means for a user to generate characters, settings, and a setting; means for a second or subsequent user to generate one to two pages of manga; means for determining the next page of the generated manga through an unspecified number of votes; means for generating the next page based on the voting results; means for automatically generating manga using a generative AI model when a user inputs a scenario; means for saving and displaying the generated manga as an image; and means for sharing the generated manga.
[0327] System Program
[0328] The server receives scenario input from the user and automatically generates a manga using a generative AI model. The generated manga is saved as an image and displayed on the user's device. Furthermore, the generated manga can be shared with other users.
[0329] Hardware and software used
[0330] Hardware: Smartphones, servers
[0331] Software: Python, OpenAI API, PIL (Python Imaging Library)
[0332] Data processing and calculation
[0333] 1. Receiving user input:
[0334] Users input scenarios through a smartphone application.
[0335] 2. Generate prompt sentence:
[0336] The server generates a prompt sentence based on the input scenario.
[0337] Example: "Scenario: Generate a 1-2 page manga in which the protagonist fights the enemy."
[0338] 3. Invoke the generative AI model:
[0339] The server uses the OpenAI API to send prompts to the generative AI model to generate the comic text.
[0340] 4. Image generation:
[0341] The server uses PIL to draw the generated text onto an image, generating a cartoon image.
[0342] 5. Saving and viewing images:
[0343] The generated manga images are stored on a server and displayed on the user's smartphone.
[0344] 6. Share images:
[0345] The generated cartoon image can be shared with other users if the user wishes.
[0346] Specific examples
[0347] If the user inputs a scenario in which the protagonist fights the enemy, the server generates the following prompt:
[0348] "Scenario: Generate a 1-2 page manga in which the protagonist fights the enemy."
[0349] This prompt is sent to a generative AI model, which then generates an image based on the text of the manga. The generated manga image is displayed on the user's smartphone and can be shared with other users.
[0350] This allows users to easily create comics, vote to decide the content of the next page, and share the created comics with other users.
[0351] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0352] Step 1:
[0353] The user inputs a scenario through a smartphone application. The input scenario is sent to the server. The input data is a text-based scenario, such as "The protagonist fights the enemy."
[0354] Step 2:
[0355] The server generates a prompt based on the received scenario. Specifically, it converts the scenario text into a format like "Scenario: Please generate a 1-2 page manga in which the protagonist fights the enemy." The input is the scenario text entered by the user, and the output is the generated prompt.
[0356] Step 3:
[0357] The server sends the generated prompt to the OpenAI API and invokes the generative AI model, which generates the comic text based on the prompt. The input is the prompt, and the output is the generated comic text.
[0358] Step 4:
[0359] The server receives the generated comic text and draws it on an image using PIL (Python Imaging Library). Specifically, it places the text at a specific position on the image and creates a comic page. The input is the generated comic text, and the output is the comic image data.
[0360] Step 5:
[0361] The server stores the image data of the generated manga and sends it to the user's smartphone. The user's device displays the received image data. The input is the image data of the manga, and the output is the manga image displayed on the user's smartphone.
[0362] Step 6:
[0363] Users can share the generated manga images with other users. Specifically, they can use the sharing function in the application to send the images via social media or messaging apps. The input is the image data of the manga to be shared, and the output is the image sent to other users.
[0364] Example 3
[0365] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0366] Conventional manga generation systems have the problem that it is difficult to reflect the user's opinion when deciding the next page of the manga they have generated. In addition, there is a lack of a means to effectively display the popularity and attention of the generated manga, and there is also an insufficient mechanism to prevent fraudulent voting by organized votes. Furthermore, there is a need for a means to properly manage the copyright of the manga generated by users.
[0367] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.
[0368] In this invention, the server includes: means for users to generate characters, settings, and settings; means for second and subsequent users to generate one or two pages of manga; means for determining the next page of the generated manga through an unspecified number of votes; means for generating the next page based on the voting results; means for tallying the voting data in real time; means for displaying the voting results in real time on a website; means for displaying the popularity and attention of the generated manga in a ranking format; means for preventing fraudulent voting through organized voting; means for relinquishing copyright to the manga generated by users; and means for limiting the number of votes from the same IP address within a certain period of time. This makes it possible to generate the next page that reflects user opinions, effectively display the popularity and attention of the generated manga, prevent fraudulent voting, and enable appropriate copyright management.
[0369] A "user" is an individual or group that uses the system to generate characters, settings, and locations, and create manga pages.
[0370] "Characters" refers to people, animals, fictional beings, and other characters that appear in manga.
[0371] "Setting" refers to the elements that make up a manga's story, background, world view, etc.
[0372] "Setting" refers to the place or environment in which the story of a manga unfolds.
[0373] "Voting" refers to the act of expressing a user's opinion to decide the next page of the generated manga.
[0374] "Voting data" is data generated when a user casts a vote, and includes information such as the selected manga, voting time, and IP address.
[0375] "Real-time tallying" refers to the process of instantly processing voting data and calculating the number of votes each manga received.
[0376] "Ranking" refers to the results of ranking the popularity and attention of the generated manga based on indicators such as the number of votes and views.
[0377] "Fraudulent voting" refers to voting practices that undermine the fairness of the system, such as organized voting or excessive voting from the same IP address.
[0378] "Copyright waiver" means that the user waives the copyright to the manga they have created, allowing other users and system operators to freely use the manga.
[0379] "Within a certain period of time" refers to a specific time frame set by the system (for example, one hour) during which votes and operations made within that period are considered valid.
[0380] An "IP address" refers to a unique number used to identify a device connected to the Internet.
[0381] This invention is a system that determines the next page of a comic created by a user through voting by an unspecified number of people, and generates the next page based on the results. A specific embodiment of this system will be described below.
[0382] System configuration
[0383] The system consists of the following main components:
[0384] 1. User Interface
[0385] 2. Server
[0386] 3. Database
[0387] 4. Real-time Data Processing Framework
[0388] 5. Front-end Frameworks
[0389] User Interface
[0390] Users use the interface provided on the website to create characters, settings, and locations, and to create manga pages. The user interface is built using web technologies such as HTML, CSS, and JavaScript.
[0391] server
[0392] The server receives user requests, stores them in a database, and tallys up the voting data in real time and displays the results on a website. The server uses standard web server software (e.g., Apache, Nginx).
[0393] Database
[0394] The database stores user-generated characters, settings, locations, voting data, etc. A relational database (e.g., MySQL, PostgreSQL) is used for the database.
[0395] Real-time Data Processing Framework
[0396] The real-time data processing framework processes the voting data in real time and calculates the number of votes for each cartoon, using frameworks such as Apache Kafka and Apache Spark.
[0397] Front-end frameworks
[0398] Front-end frameworks such as React.js and Vue.js are used to display voting results and rankings in real time.
[0399] Specific examples
[0400] Consider a scenario where users vote for whether "Manga A" or "Manga B" should be selected as the next page. The voting period is one hour, and if "Manga A" receives the most votes at the end, "Manga A" will be selected as the next page.
[0401] Example prompt sentence:
[0402] Please choose your manga for the next page:
[0403] 1. Manga A
[0404] 2. Manga B
[0405] Voting will last for one hour. The comic with the most votes will be selected as the next page.
[0406] Viewing voting results
[0407] The server displays the voting results tallied in real time on the website, allowing users to check the current voting status in real time.
[0408] Calculation and display of rankings
[0409] The server displays the popularity and attention of the created manga in a ranking format based on indicators such as the number of votes and views, allowing users to refer to the rankings to create new manga.
[0410] Preventing Voter Fraud
[0411] The server limits the number of votes from the same IP address within a certain period of time to prevent fraudulent voting by organized votes, and also requires users to agree to terms and conditions to waive copyright to the manga they create.
[0412] In this way, it is possible to generate the next page that reflects the user's opinion, effectively display the popularity and attention of the generated manga, prevent fraudulent voting, and enable appropriate management of copyright. The flow of the identification process in Example 3 will be described with reference to Figure 15.
[0413] Step 1: User voting
[0414] Users use an interface provided on the website to vote for the comic to be featured on the next page by selecting one of the comics presented as options and clicking the voting button.
[0415] Input: User's selected comic, voting time, IP address
[0416] Output: Voting data (selected manga, voting time, IP address)
[0417] Specific operation: The user accesses a web page, displays a voting form, selects one manga from the options, and clicks the voting button.
[0418] Step 2: Collecting polling data
[0419] The server receives the voting data sent by the users and stores it in a database.
[0420] Input: Voting data (selected manga, voting time, IP address)
[0421] Output: Voting data stored in a database
[0422] Specific operation: The server receives a voting request from a user. The server stores the voting data in a database (e.g., MySQL).
[0423] Step 3: Real-time counting of voting data
[0424] The server aggregates the voting data stored in the database in real time and calculates the number of votes for each cartoon. This process uses a real-time data processing framework (e.g., Apache Kafka).
[0425] Input: Voting data stored in a database
[0426] Output: Number of votes for each manga
[0427] Specific operation: The server retrieves the voting data from the database. The server uses a real-time data processing framework to tally the number of votes for each comic.
[0428] Step 4: View the poll results
[0429] The server displays the voting results tallied in real time on the website, allowing users to check the current voting status in real time.
[0430] Input: Number of votes for each manga
[0431] Output: Poll results displayed on the website
[0432] Specific operation: The server sends the tally results to a web page, and the terminal displays the voting results on the web page in real time.
[0433] Step 5: Generate the next page
[0434] When the voting period ends, the server selects the manga with the most votes as the next page. Users generate the next page based on the voting results.
[0435] Input: End of voting period, number of votes for each manga
[0436] Output: Manga to be adopted as the next page
[0437] Specific operation: The server detects the end of the voting period. The server determines the manga with the most votes as the next page. The user inputs a prompt to generate the next page.
[0438] Step 6: Calculating and displaying rankings
[0439] The server displays the popularity and attention of the generated manga in a ranking format based on indicators such as the number of votes and views.
[0440] Input: Number of votes, number of views data
[0441] Output: Ranking results
[0442] Specific operation: The server retrieves data on the number of votes and views from the database. The server calculates the rankings using a data analysis tool (e.g., Apache Spark). The server sends the ranking results to a web page. The device displays the rankings on the web page.
[0443] Step 7: Prevent voter fraud
[0444] The server limits the number of votes from the same IP address within a certain period of time to prevent fraudulent voting by organized votes, and also requires users to agree to terms and conditions to waive copyright to the manga they create.
[0445] Input: Voting data (including IP address)
[0446] Output: Detecting and limiting voter fraud
[0447] Specific operation: The server monitors the IP addresses included in the voting data. The server limits the number of votes from the same IP address within a certain period of time. The server verifies that users agree to the copyright waiver when creating manga.
[0448] (Application example 3)
[0449] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0450] Conventional manga generation systems do not adequately display voting results in real time when determining the next page based on user votes, nor do they adequately prevent fraudulent voting. Furthermore, they lack a function to display the popularity and attention of user-generated manga in a ranking format, making it difficult to keep users interested. Furthermore, the lack of an interactive voting system using smartphones poses a challenge in improving the user experience.
[0451] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.
[0452] In this invention, the server includes means for users to generate characters, settings, and settings, means for second and subsequent users to generate one or two pages of manga, means for determining the next page of the generated manga through voting by an unspecified number of people, means for generating the next page based on the voting results, means for voting through an application installed on a smartphone, and means for displaying the voting results in real time. This allows users to interactively determine the next page of the manga using their smartphone, and realizes real-time display of voting results, prevention of fraudulent voting, and display of popularity and attention rankings.
[0453] "Users" are individuals or groups who use the system to generate characters, settings, and locations, and vote to decide the next page of the manga.
[0454] "Characters" refers to people, animals, fictional beings, and other characters that appear in manga.
[0455] "Setting" refers to basic information such as the story, background, and world view of a manga.
[0456] "Setting" refers to the place or environment in which the story of a manga unfolds.
[0457] "Manga" is a form of content that expresses a story by combining pictures and text.
[0458] "Voting" is an act of expressing a user's intention to decide the next page.
[0459] "Unspecified majority" refers to many users who are not limited to specific individuals or organizations.
[0460] "Voting results" refers to the results of tallying votes by users.
[0461] "Real-time" refers to information being updated on the same timeline as real time.
[0462] "Ranking" refers to a format in which the generated manga are ranked and displayed according to their popularity and attention.
[0463] "Voting fraud" refers to fraudulent voting practices intended to undermine the fairness of the system.
[0464] A "smartphone" refers to a portable information terminal that can connect to the Internet and install applications.
[0465] "Application" refers to software that is installed on a smartphone and provides specific functions.
[0466] "Interactive" refers to a state in which a user can interact with a system.
[0467] As an embodiment of the present invention, a system is provided that allows a user to interactively determine the next page of a manga using a smartphone. A specific embodiment of this system will be described below.
[0468] System configuration
[0469] The system consists of the following major components:
[0470] 1. User device: A mobile information terminal such as a smartphone.
[0471] 2. Server: Provides functions for tallying voting data, displaying it in real time, calculating rankings, and preventing fraudulent voting.
[0472] 3. Application: Software installed on smartphones that allows users to cast their votes.
[0473] Hardware and software used
[0474] Hardware: Smartphone (e.g. iPhone, Android)
[0475] Software: Flask (a Python web framework), requests (a library for sending HTTP requests)
[0476] Data processing and calculation
[0477] The server receives the voting data from the user and performs the following processes.
[0478] 1. Counting voting data: Counting voting results in real time and determining the next page.
[0479] 2. Real-time display: Show voting results to users in real time.
[0480] 3. Ranking calculation: The popularity and attention of the generated manga are displayed in ranking form.
[0481] 4. Preventing fraudulent voting: Prevent fraudulent voting by limiting the number of votes from the same IP address within a certain period of time.
[0482] Specific examples
[0483] User A opens the smartphone app, chooses one of the three options displayed as next page candidates, and votes for option 2. The server receives this vote, tallies the results in real time, and displays them to User A. Other users also vote in the same way, and the option with the most votes is generated as the next page.
[0484] Prompt Sentence Examples
[0485] "Vote for the option you would most like to read from Option 1, Option 2, or Option 3, which will be displayed as candidates on the next page. The voting results will be displayed in real time."
[0486] In this way, users can interactively decide the next page of the manga, voting results are displayed in real time, fraudulent voting is prevented, and rankings of popularity and attention are displayed.
[0487] The flow of the specific processing in Application Example 3 will be described with reference to FIG.
[0488] Step 1:
[0489] A user launches a smartphone app and checks the options displayed as next page suggestions.
[0490] Input: Launching a smartphone app, data for next page suggestions
[0491] Output: The next page suggestions are displayed on the user's screen.
[0492] Specific behavior: The app retrieves the next page candidate data from the server and displays it on the user's screen.
[0493] Step 2:
[0494] The user selects one of the next page candidates and casts a vote.
[0495] Input: User's vote selection
[0496] Output: Voting data is sent to the server
[0497] What happens: The app sends the user's selected option to the server.
[0498] Step 3:
[0499] The server tallies the received votes.
[0500] Input: Voting data submitted by the user
[0501] Output: Counted votes
[0502] Specific operation: The server stores the voting data in a database and tally the votes in real time.
[0503] Step 4:
[0504] The server displays the voting results to the user in real time.
[0505] Input: Counted vote results
[0506] Output: Voting results displayed in real time on the user's screen
[0507] Specific operation: The server sends the aggregated results to the app, which displays them on the user's screen in real time.
[0508] Step 5:
[0509] The server limits the number of votes from the same IP address within a certain period of time.
[0510] Input: Voting data timestamp and IP address
[0511] Output: Preventing voter fraud
[0512] Specific operation: The server checks the timestamp and IP address of the voting data and rejects multiple votes from the same IP address within a certain period of time.
[0513] Step 6:
[0514] The server displays the popularity and attention of the generated manga in a ranking format.
[0515] Input: Metrics such as votes and views
[0516] Output: Popularity and attention displayed in ranking format
[0517] Specific operation: The server calculates the ranking based on the number of votes and views and displays it on the user's screen.
[0518] Step 7:
[0519] The user enters a prompt to generate the next page.
[0520] Input: The prompt text entered by the user
[0521] Output: The prompt statement used to generate the next page
[0522] Specific behavior: The user enters a prompt through the app and sends it to the server.
[0523] Step 8:
[0524] The server generates the next page using the generative AI model.
[0525] Input: The prompt text entered by the user
[0526] Output: The following page is generated:
[0527] Specific operation: The server inputs a prompt sentence into the generative AI model and generates the next page.
[0528] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0529] "Example 1"
[0530] One embodiment of the invention incorporating an emotion engine is a system that recognizes a user's emotions and adjusts the generation of comics and voting results based on those emotions. Specifically, when a user generates a comic, an emotion engine is used to recognize the user's emotions. This emotion engine can recognize emotions using various means, such as the user's facial expressions, tone of voice, and emotion analysis of input text. For example, if a user expresses joy, a comic with a cheerful scenario that matches that emotion is generated. On the other hand, if a user expresses sadness, a comic with a sad scenario that matches that emotion is generated. Furthermore, voting results are also adjusted based on the user's emotions. For example, if many users express joy, a comic with a cheerful scenario that matches that emotion is more likely to be selected as the next page. In this way, the invention incorporating an emotion engine enables more personalized comic generation and voting results adjustment that reflect the user's emotions.
[0531] "Example 2"
[0532] One embodiment of the invention incorporating an emotion engine is a system that recognizes a user's emotions and adjusts the generation of comics and voting results based on those emotions. Specifically, when a user generates a comic, an emotion engine is used to recognize the user's emotions. This emotion engine can recognize emotions using various means, such as the user's facial expressions, tone of voice, and emotion analysis of input text. For example, if a user expresses joy, a comic with a cheerful scenario that matches that emotion is generated. On the other hand, if a user expresses sadness, a comic with a sad scenario that matches that emotion is generated. Furthermore, voting results are also adjusted based on the user's emotions. For example, if many users express joy, a comic with a cheerful scenario that matches that emotion is more likely to be selected as the next page. In this way, the invention incorporating an emotion engine enables more personalized comic generation and voting results adjustment that reflect the user's emotions.
[0533] "Example 3"
[0534] One embodiment of the invention incorporating an emotion engine is a system that recognizes a user's emotions and adjusts the generation of comics and voting results based on those emotions. Specifically, when a user generates a comic, an emotion engine is used to recognize the user's emotions. This emotion engine can recognize emotions using various means, such as the user's facial expressions, tone of voice, and emotion analysis of input text. For example, if a user expresses joy, a comic with a cheerful scenario that matches that emotion is generated. On the other hand, if a user expresses sadness, a comic with a sad scenario that matches that emotion is generated. Furthermore, voting results are also adjusted based on the user's emotions. For example, if many users express joy, a comic with a cheerful scenario that matches that emotion is more likely to be selected as the next page. In this way, the invention incorporating an emotion engine enables more personalized comic generation and voting results adjustment that reflect the user's emotions.
[0535] The processing flow of each embodiment will be described below.
[0536] "Example 1"
[0537] Step 1: A user logs into the system and starts generating a comic.
[0538] Step 2: As the user creates characters, settings, and stages, the emotion engine recognizes the user's emotions. The emotion engine recognizes emotions using the user's facial expressions, tone of voice, and sentiment analysis of the input text.
[0539] Step 3: The generation of the cartoon is adjusted based on the user's emotion recognized by the emotion engine. For example, if the user is expressing joy, a cartoon with a bright scenario that matches that emotion is generated. On the other hand, if the user is expressing sadness, a cartoon with a dark scenario that matches that emotion is generated.
[0540] Step 4: The generated comic is made public to other users and voting begins.
[0541] Step 5: The emotion engine also recognizes the emotions of users participating in the vote and adjusts the voting results based on those emotions. For example, if many users express joy, a comic with a cheerful scenario that matches that emotion will likely be selected as the next page.
[0542] Step 6: The next page is decided based on the voting results, and the comic is updated. This process is repeated until a new page is generated.
[0543] Example 1
[0544] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0545] Conventional manga generation systems have difficulty generating personalized content that reflects the user's emotions. Furthermore, they are unable to consider the user's emotions when deciding the next page of the generated manga, limiting the user experience. Furthermore, there is a lack of a way to prevent fraudulent voting by organized voting when deciding the next page through an unspecified number of votes.
[0546] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0547] In this invention, the server includes means for users to generate characters, settings, and settings, means for recognizing the user's emotions, means for generating a manga scenario based on the recognized emotions, means for determining the next page of the generated manga through voting by an unspecified number of people, and means for generating the next page based on the voting results. This enables personalized manga generation that reflects the user's emotions and fair determination of voting results.
[0548] A "user" is an individual or group that uses the system to generate characters, settings, and locations, and create manga.
[0549] A "character" is a person, animal, fictional being, etc. created by a user, and includes information such as their name, personality, and appearance.
[0550] "Setting" refers to the world or environment in which a character exists, and includes information such as location, time, and situation.
[0551] A "setting" is a specific location or scene in which characters act, and is treated as part of the setting.
[0552] "Means for recognizing emotions" refers to technology or devices that analyze a user's facial expressions, tone of voice, input text, etc. to identify their emotions.
[0553] A "scenario" refers to the story and development of a manga, including the actions and lines of characters, changes in the setting, etc.
[0554] "Voting by an unspecified number of users" refers to voting that is not limited to specific users, but is conducted by many users.
[0555] "Voting results" are aggregated data obtained from an unspecified number of votes and are used to generate the next page.
[0556] A "database" is a system for storing information entered by users, generated characters, settings, stage, emotional data, etc.
[0557] "Personalization" means customizing content according to the characteristics and feelings of each individual user.
[0558] "Organized voting" refers to intentional voting by a group with a specific purpose, and is a type of fraudulent voting.
[0559] This invention provides a system that provides a website that operates on the Internet, allowing users to create characters, settings, and settings, and then uses an emotion engine to recognize the user's emotions and generate a manga scenario based on those emotions. This system enables personalized manga generation that reflects the user's emotions and fair determination of voting results.
[0560] Hardware and software used
[0561] Server: Hosts the website, manages the database, runs the emotion engine, generates scenarios, and tally vote results.
[0562] Device: The device (e.g., PC, smartphone, tablet) through which a user accesses the website and enters character, setting, and location information.
[0563] Emotion engine: Software that recognizes emotions by analyzing a user's facial expressions, tone of voice, and input text.
[0564] Program processing
[0565] Character, setting, and location generation
[0566] 1. A user accesses a website and uses a form to enter information such as the character's name, personality, and appearance, as well as options to set the setting's location, time, and situation.
[0567] 2. The server receives the information entered by the user and stores it in a database.
[0568] 3. The server generates character and setting data based on the stored information and displays it to the user.
[0569] Use of emotion engine
[0570] 1. When a user creates a manga, the emotion engine recognizes the user's emotions.
[0571] The emotion engine uses the user's facial expressions, tone of voice, and sentiment analysis of the input text.
[0572] 2. The server generates a manga with a scenario that matches the user's emotions based on the emotional data obtained from the emotion engine.
[0573] For example, if the user is expressing an emotion of joy, a cartoon with a cheerful scenario is generated.
[0574] If the user is showing sadness, a cartoon of a dark scenario is generated.
[0575] 3. The server aggregates the emotion data obtained from multiple users and adjusts the voting results.
[0576] For example, if many users are expressing emotions of joy, a comic with a cheerful scenario that matches those emotions is more likely to be selected as the next page.
[0577] Specific examples
[0578] A user visits the website and enters the character's name as "Taro," its personality as "brave," and its appearance as "blue hair."
[0579] The server generates a character called "Taro" based on this information and displays it to the user.
[0580] When a user creates a manga, the emotion engine recognizes the emotion of "joy" from the user's facial expression.
[0581] The server generates a cartoon with a cheerful scenario that matches the emotion of "joy" and displays it to the user.
[0582] Prompt Sentence Examples
[0583] Provide a form where the user can enter the character's name, personality, and appearance. Then, add functionality to recognize the user's emotions and generate a scenario based on that emotion. For example, if the user expresses joy, generate a cartoon with a cheerful scenario.
[0584] Thus, the present invention is a system that generates personalized comics and adjusts voting results based on user input and emotions.
[0585] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0586] Step 1:
[0587] A user visits a website.
[0588] Input: A user opens a browser and types in a website URL.
[0589] What happens: Your device displays the website's homepage.
[0590] Output: The website homepage is displayed on the user's device.
[0591] Step 2:
[0592] The user inputs information about the characters, setting, and location.
[0593] Input: The user enters information about the character, such as their name, personality, and appearance, into a form, and selects from options the setting, time, situation, etc.
[0594] How it works: The device displays a form and the user enters information.
[0595] Output: The entered information is sent to the server.
[0596] Step 3:
[0597] The server receives the input information and stores it in a database.
[0598] Input: Character, setting, and location information submitted by the user.
[0599] What it does: The server stores the information it receives in a database.
[0600] Output: Character, setting, and locale information stored in a database.
[0601] Step 4:
[0602] The server generates character and setting data based on the stored information and displays it to the user.
[0603] Input: Character, setting, and locale information stored in a database.
[0604] How it works: The server generates character and setting data based on the saved information.
[0605] Output: The generated character and setting data is sent to the user's device and displayed.
[0606] Step 5:
[0607] When a user creates a cartoon, the emotion engine recognizes the user's emotions.
[0608] Input: The user clicks the cartoon generation button and inputs data such as facial expressions, tone of voice, and input text.
[0609] How it works: The device captures the user's facial expressions and tone of voice through the camera and microphone and sends them to the emotion engine.
[0610] Output: The emotion engine analyzes the user's emotions and sends the results to the server.
[0611] Step 6:
[0612] The server generates a scenario based on the emotion data and displays it to the user.
[0613] Input: Emotion data sent from the emotion engine.
[0614] How it works: The server generates a scenario based on emotion data.
[0615] For example, if the user expresses the emotion "joy," a cartoon with a cheerful scenario is generated.
[0616] If the user indicates the emotion "sad", generate a cartoon with a dark scenario.
[0617] Output: The generated scenario is sent to the user's terminal and displayed.
[0618] Step 7:
[0619] The server aggregates the emotion data obtained from multiple users and adjusts the voting results.
[0620] Input: Emotion data from multiple users.
[0621] How it works: The server aggregates the emotion data and adjusts the voting results.
[0622] For example, if many users are expressing the emotion of "joy," a comic with a cheerful scenario that matches that emotion is more likely to be selected as the next page.
[0623] Output: The adjusted voting results are displayed to the user.
[0624] (Application example 1)
[0625] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0626] Conventional manga generation systems have difficulty generating personalized content that reflects the user's emotions. They also lack the ability to adjust the scenario based on the user's emotions, which prevents them from increasing user satisfaction. Furthermore, the user's emotions cannot be taken into account when determining the next page of the generated manga, limiting the user experience.
[0627] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0628] In this invention, the server includes: means for users to generate characters, settings, and settings; means for second and subsequent users to generate one or two pages of manga; means for determining the next page of the generated manga through an unspecified number of votes; means for generating the next page based on the voting results; means for adjusting the manga scenario based on the user's emotions using an emotion engine that recognizes the user's emotions; means for performing emotion analysis of the user's facial expressions, tone of voice, and input text; and means for generating the manga based on the emotions recognized by the emotion engine. This enables the generation of personalized manga that reflects the user's emotions, improving the user experience.
[0629] A "user" is an individual or group that uses the system to generate characters, settings, and locations, and create manga.
[0630] A "character" is an element that plays a role in a story, such as a comic book character, an animal, or a fictional being.
[0631] "Setting" refers to elements such as the background, situation, and environment in which the story of a manga unfolds.
[0632] A "setting" is an element such as a specific place, time, or scene in which the story of a manga unfolds.
[0633] An "emotion engine" is software or hardware that recognizes a user's emotions and adjusts scenarios and content based on those emotions.
[0634] "Facial expression" refers to the emotional state that can be read from the user's facial movements and expressions.
[0635] "Voice tone" refers to the emotional state of the user that can be read from the pitch, strength, rhythm, etc. of the user's voice.
[0636] "Sentiment analysis of input text" is the process of analyzing emotions from the content of text entered by a user.
[0637] "Voting" is a means by which multiple users express their opinions to decide the scenario for the next page.
[0638] "Personalization" refers to tailoring content to the characteristics and preferences of individual users.
[0639] A "scenario" is a plan or plot that shows the progression and development of a manga's story.
[0640] The following system configuration and processing procedure will be described as an embodiment of the present invention.
[0641] System Configuration
[0642] This system includes a server that provides an interface for users to create characters, settings, and settings, and an emotion engine that recognizes the user's emotions. The emotion engine is software that performs emotion analysis of the user's facial expressions, tone of voice, and input text. Specifically, the system uses the following hardware and software:
[0643] Hardware: Smartphone camera, microphone
[0644] Software: OpenCV, DeepFace, TextBlob
[0645] Processing flow
[0646] The server provides an interface for users to create characters, settings, and settings. Once the user inputs the characters, settings, and settings, the emotion engine analyzes the user's facial expressions, tone of voice, and input text to recognize the user's emotions. Based on the recognized emotions, the system selects an appropriate scenario and generates a manga.
[0647] Specific examples
[0648] For example, if a user takes a photo of themselves with their smartphone camera and enters the text "Today was such a fun day!", the emotion engine will recognize the emotion of "joy" from the user's facial expression and text. Based on this emotion, the system will generate a cartoon with a cheerful scenario.
[0649] Prompt Sentence Examples
[0650] An example of a prompt sentence that the user enters into the system is as follows:
[0651] Input the user's image and text. The image is user_image.jpg, and the text is "Today was a really fun day!". Analyze the user's emotions based on this and generate a cartoon with the appropriate scenario.
[0652] In this way, personalized comics that reflect the user's emotions can be generated, improving the user experience.
[0653] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0654] Step 1:
[0655] The user takes a photo of their face with their smartphone camera and enters text.
[0656] Input: User's face image and text (e.g., "Today was such a fun day!")
[0657] What happens: A user takes a picture of their face using their smartphone camera and enters text into an application input field.
[0658] Step 2:
[0659] The terminal sends the user's facial image to the emotion engine, which analyzes the emotion of the facial expression.
[0660] Input: User's face image
[0661] Output: Emotion recognized from facial expression (e.g., happiness)
[0662] Specific operation: The device uses OpenCV and DeepFace to analyze facial images and recognize emotions from facial expressions.
[0663] Step 3:
[0664] The terminal transmits the user's input text to the emotion engine, which performs emotion analysis on the text.
[0665] Input: User-entered text
[0666] Output: The sentiment recognized from the text (e.g., positive)
[0667] What happens: The device uses TextBlob to parse the input text and recognize the sentiment of the text.
[0668] Step 4:
[0669] The server comprehensively evaluates the facial expressions and the emotions in the text to determine the user's overall emotions.
[0670] Input: Emotions from facial expressions, emotions from text
[0671] Output: Overall emotion (e.g., joy)
[0672] Specific operation: The server integrates facial expressions and textual emotions to determine the user's overall emotion.
[0673] Step 5:
[0674] The server selects an appropriate scenario based on the overall emotion and generates a comic.
[0675] Input: Overall Sentiment
[0676] Output: A cartoon with a suitable scenario (e.g., a cartoon with a bright scenario)
[0677] Specific operation: The server selects a scenario based on emotions and generates a manga by combining characters, settings, and locations.
[0678] Step 6:
[0679] The server provides the generated comic to the user and provides an interface for sharing it with other users.
[0680] Input: Generated comic
[0681] Output: Comic book provided to user, sharing interface
[0682] Specific behavior: The server displays the generated comic to the user and provides a link or button to share it with other users.
[0683] Step 7:
[0684] The server accepts votes from an unspecified number of users and determines the scenario for the next page.
[0685] Input: User votes
[0686] Output: Scenario on next page
[0687] Specific operation: The server tally the votes received within a certain time period and decide the scenario for the next page.
[0688] Step 8:
[0689] The server generates the next page based on the voting results and serves it to the user.
[0690] Input: Voting results
[0691] Output: Comic on the next page
[0692] Specific operation: The server selects the scenario for the next page based on the voting results, generates the manga, and provides it to the user.
[0693] Example 2
[0694] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0695] Conventional manga generation systems have difficulty generating personalized content that reflects user emotions, and have been unable to increase user satisfaction. Furthermore, voting results are determined without taking user emotions into consideration, which can result in results that do not meet user expectations. This leads to issues such as a decline in user engagement and a decrease in the frequency of system use.
[0696] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[0697] In this invention, the server includes means for users to generate characters, settings, and settings, means for second and subsequent users to generate one to two pages of manga, means for determining the next page of the generated manga through an unspecified number of votes, means for generating the next page based on the voting results, means for recognizing user emotions, means for adjusting the content of the manga based on the recognized emotions, and means for adjusting the voting results based on the recognized emotions. This makes it possible to generate personalized manga that reflects user emotions and adjust the voting results based on emotions.
[0698] A "user" is an individual or group that uses the system to generate characters, settings, and locations, and create manga.
[0699] "Characters" refers to people, animals, fictional beings, and other characters that appear in manga.
[0700] "Setting" refers to the background information and circumstances of a manga's story or scenario.
[0701] "Setting" refers to the place or environment in which the story of a manga unfolds.
[0702] "Interface" refers to the screen and input means through which a user interacts with a system.
[0703] "Emotion engine" refers to a software or hardware system for recognizing a user's emotions.
[0704] "Emotion" refers to the user's psychological state as recognized from facial expressions, tone of voice, input text, etc.
[0705] A "generative AI model" refers to an artificial intelligence model that automatically generates manga based on user input information.
[0706] "Voting" refers to the act of expressing one's opinion by multiple users to decide the content of the next page.
[0707] "Voting results" refers to the content of the next page determined by users' votes.
[0708] "Personalization" refers to tailoring content based on the characteristics and emotions of individual users.
[0709] "Unspecified large number" refers to a large number of users who are not limited to specific individuals or organizations.
[0710] "Ranking" refers to a format in which the generated manga are ranked and displayed according to their popularity and attention.
[0711] An "organized vote" refers to a group of people with a specific purpose voting all at once.
[0712] "Fraudulent voting" refers to voting that is conducted in a fraudulent manner that undermines the fairness of the system.
[0713] "Copyright" refers to the legal rights in user-generated comics.
[0714] MODE FOR CARRYING OUT THE INVENTION
[0715] This invention is a system that automatically generates a one to two page comic based on information entered by the user, and by combining it with an emotion engine, recognizes the user's emotions and adjusts the content of the comic and voting results based on those emotions.
[0716] Hardware and software used
[0717] Hardware: Servers, user devices (PCs, smartphones, tablets)
[0718] Software: Generative AI models (e.g., OpenAI's GPT-4), emotion engines (e.g., Affectiva's emotion recognition API)
[0719] Specific operation of the system
[0720] 1. Obtaining user input information
[0721] A user accesses the interface using a terminal and inputs a scenario.
[0722] Example: A user enters "The protagonist fights the villain" in the text box and clicks the submit button.
[0723] 2. Emotional Recognition
[0724] The device captures the user's facial expressions and tone of voice through a camera and microphone.
[0725] The device sends the data to an emotion engine for sentiment analysis of the input text.
[0726] The emotion engine analyzes the user's emotions and returns the results to the device.
[0727] Example: The device captures the user's smile and the emotion engine recognizes it as "joy."
[0728] 3. Manga Generation
[0729] The terminal transmits the user's input scenario and emotion data to the server.
[0730] The server uses a generative AI model to generate a manga based on the received scenario and emotion data.
[0731] Example: The server generates a comic with a cheerful scenario based on the scenario "the protagonist fights the enemy" and the emotion data of "joy."
[0732] 4. Adjustment of voting results
[0733] The server aggregates the emotion data of other users.
[0734] The server adjusts the manga scenario to be selected as the next page based on the results of the calculation.
[0735] Example: The server sees that many users are expressing the emotion "joy" and selects a comic with a happy scenario as the next page.
[0736] Examples and prompts
[0737] Examples:
[0738] User A enters "The protagonist fights the enemy" into the terminal and clicks the send button.
[0739] The device captures User A's smile, and the emotion engine recognizes it as "joy."
[0740] The device sends the scenario and emotion data to the server, which then uses a generative AI model to generate a comic with a cheerful scenario.
[0741] The server aggregates the emotion data of other users, and since many users indicate the emotion "joy," a comic with a cheerful scenario is selected as the next page.
[0742] Example prompt sentence:
[0743] "If the user is expressing joy in a scenario where the protagonist is fighting an enemy, generate a cartoon with a cheerful scenario."
[0744] The system enables personalized cartoon generation that reflects user emotions and adjusts voting results based on emotions.
[0745] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0746] Step 1:
[0747] A user accesses the interface using a terminal and inputs a scenario.
[0748] Input: The user enters a scenario into the text box.
[0749] Specific action: The user enters "The protagonist fights the enemy" and clicks the submit button.
[0750] Output: The input scenario is saved to the device.
[0751] Step 2:
[0752] The device captures the user's facial expressions and tone of voice through a camera and microphone.
[0753] Input: The user's facial expressions and tone of voice.
[0754] What it does: The device uses the camera to capture the user's smile and the microphone to record the tone of their voice.
[0755] Output: Captured facial expression and tone of voice data is saved on the device.
[0756] Step 3:
[0757] The device sends the data to an emotion engine for sentiment analysis of the input text.
[0758] Input: User's facial expressions, tone of voice, input text.
[0759] What it does: The device sends facial expressions, tone of voice, and input text to the emotion engine.
[0760] Output: The emotion engine returns the analysis results to the device.
[0761] Step 4:
[0762] The emotion engine analyzes the user's emotions and returns the results to the device.
[0763] Input: Facial expressions, tone of voice, input text.
[0764] Specific behavior: The emotion engine recognizes emotions such as "joy."
[0765] Output: The recognized emotion data is returned to the device.
[0766] Step 5:
[0767] The terminal transmits the user's input scenario and emotion data to the server.
[0768] Input: Scenario, emotion data.
[0769] Specific operation: The device sends the scenario and emotion data to the server.
[0770] Output: The scenario and emotion data are stored on the server.
[0771] Step 6:
[0772] The server uses a generative AI model to generate a manga based on the received scenario and emotion data.
[0773] Input: Scenario, emotion data.
[0774] Specific operation: The server inputs scenario and emotional data into the generative AI model and generates a manga.
[0775] Output: The generated comic is saved on the server.
[0776] Step 7:
[0777] The server aggregates the emotion data of other users.
[0778] Input: Emotion data from other users.
[0779] Specific operation: The server aggregates the emotion data and compiles statistics.
[0780] Output: The aggregated results are saved on the server.
[0781] Step 8:
[0782] The server adjusts the manga scenario to be selected as the next page based on the results of the calculation.
[0783] Input: Aggregation results.
[0784] Specific operation: The server selects the scenario for the next page based on the aggregation results.
[0785] Output: The selected scenario is saved on the server.
[0786] (Application example 2)
[0787] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0788] Conventional manga generation systems have difficulty providing personalized content that reflects the user's emotions. Furthermore, they cannot consider the user's emotions when determining the next page of the generated manga, which hinders the user experience. Furthermore, when sharing the generated manga with other users, the sharing experience is limited because the sharing cannot be based on emotions. These issues need to be resolved.
[0789] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0790] In this invention, the server includes: a means for users to generate characters, settings, and settings; a means for second and subsequent users to generate one or two pages of manga; a means for determining the next page of the generated manga through an unspecified number of votes; a means for generating the next page based on the voting results; and a means for adjusting the generation of the manga and the voting results based on the emotions using an emotion engine that recognizes the user's emotions. This enables personalized manga generation that reflects the user's emotions and adjustment of the voting results based on the emotions. Furthermore, when the generated manga is shared with other users, sharing based on emotions is possible, improving the enjoyment of sharing.
[0791] "Character" refers to people, animals, and fictional beings that appear in stories such as manga and animation.
[0792] "Setting" refers to the information that forms the basis of a story, such as the background and situation of the story, and the relationships between the characters.
[0793] "Setting" refers to the place or environment in which the story unfolds.
[0794] "Manga" refers to a form of media that combines pictures and text to tell a story.
[0795] "Voting" refers to the act of an unspecified number of people expressing their opinion to choose one option from among several options.
[0796] An "emotion engine" refers to technology that recognizes a user's emotions through facial expressions, tone of voice, and emotional analysis of input text.
[0797] "Personalization" refers to customizing content and services to suit the characteristics and preferences of individual users.
[0798] "Sharing" refers to the act of providing information or data to other users in order to enjoy the generated content together.
[0799] A system for implementing this invention includes means for a user to generate characters, settings, and a setting; means for a second or subsequent user to generate a 1-2 page manga; means for determining the next page of the generated manga through an unspecified number of votes; means for generating the next page based on the voting results; and means for adjusting the generation of the manga and the voting results based on the user's emotions using an emotion engine that recognizes their emotions.
[0800] Hardware and software used
[0801] Hardware: Smartphone, head-mounted display
[0802] Software: OpenCV (facial expression recognition), Transformers (sentiment analysis), TextBlob (text sentiment analysis), virtual MangaGenerator library
[0803] Data processing and calculation
[0804] 1. User Emotion Recognition
[0805] The server acquires the user's facial image and recognizes facial expressions using OpenCV. It then analyzes the text entered by the user using the Transformers sentiment analysis model and analyzes the sentiment of the text using TextBlob. These results are then combined to determine the final sentiment.
[0806] 2. Manga Generation
[0807] The server generates a manga using the virtual MangaGenerator library based on the determined emotion and the scenario entered by the user. The manga will have content that matches the user's emotion.
[0808] 3. Adjustment of voting results
[0809] The server collects votes from an unspecified number of users and adjusts the votes based on their emotions. For example, if many users express joy, a comic with a happy story will likely be selected as the next page.
[0810] 4. Sharing the created manga
[0811] The server provides a means for users to share the created comic with other users, allowing users to share and enjoy the comic created based on their own emotions with other users.
[0812] Specific examples
[0813] For example, if a user inputs a scenario in which the protagonist fights the enemy and provides a facial image, the server will recognize the facial expression and emotion in the text and determine that the user is expressing joy. Based on this result, a manga with a cheerful scenario will be generated.
[0814] Prompt Sentence Examples
[0815] Analyze the user's facial image and recognize emotions based on the text input "The hero fights the villain." Generate a comic with a cheerful scenario based on the recognized emotions.
[0816] In this way, personalized cartoons that reflect the user's emotions can be generated, and voting results can be adjusted based on emotions. Furthermore, when the generated cartoons are shared with other users, sharing based on emotions becomes possible, improving the enjoyment of sharing.
[0817] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0818] Step 1:
[0819] The user generates the characters, setting, and setting.
[0820] Users input information about the characters, settings, and stage using a smartphone or head-mounted display. This information is sent to the server. The input data includes the character's appearance, details of the setting, and background information about the stage. The server receives this data and stores it in a database.
[0821] Step 2:
[0822] The second and subsequent users will generate one or two pages of comics.
[0823] Subsequent users generate one to two pages of manga based on the characters, setting, and location created by the previous user. The user inputs a scenario and sends it to the server. The server receives the input scenario and automatically generates a manga using a generative AI model. The generated manga is saved on the server.
[0824] Step 3:
[0825] Recognize user emotions.
[0826] A user uploads a facial image and inputs text. The server uses OpenCV to recognize facial expressions from the facial image and analyzes the sentiment of the text using a Transformers sentiment analysis model. These results are combined to determine the user's sentiment. The input data are the facial image and text, and the output data is the user's sentiment (e.g., happy, sad).
[0827] Step 4:
[0828] Generate cartoons based on emotions.
[0829] The server generates a manga using a virtual MangaGenerator library based on the user's emotions recognized in step 3 and the scenario input in step 2. The input data are the user's emotions and scenario, and the output data is the generated manga. The generated manga is saved on the server.
[0830] Step 5:
[0831] The next page of the generated manga will be decided by an unspecified number of votes.
[0832] The server publishes the generated manga and accepts votes from an unspecified number of users. Voting takes place within a certain time period (for example, one hour). The input data are votes from users, and the output data are the voting results.
[0833] Step 6:
[0834] Generate the next page based on the voting results.
[0835] The server tally the voting results and generate the next page. Based on the voting results, the generative AI model is used to automatically generate the next page of manga. The input data is the voting results, and the output data is the next page of manga. The generated manga is saved on the server.
[0836] Step 7:
[0837] Share the generated comic with other users.
[0838] The server provides a means for users to share the generated comic with other users. Users can share and enjoy the generated comic with other users. The input data is the generated comic, and the output data is the shared comic.
[0839] Example 3
[0840] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0841] Conventional manga generation systems lacked features such as determining the next page based on user votes, displaying voting results in real time, displaying rankings, preventing fraudulent votes, and generating manga based on user emotions, limiting the user experience. Furthermore, copyright issues regarding user-generated manga remained unresolved. This made it difficult for users to actively participate and generate personalized content.
[0842] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.
[0843] In this invention, the server includes: a means for users to generate characters, settings, and settings; a means for second and subsequent users to generate one or two pages of manga; a means for determining the next page of the generated manga through an unspecified number of votes; a means for generating the next page based on the voting results; a means for tallying and displaying the voting results in real time; a means for displaying the popularity and attention of the generated manga in a ranking format; a means for preventing fraudulent voting through organized voting; a means for recognizing user emotions and adjusting manga generation and voting results based on the emotions; and a means for relinquishing copyright to manga generated by users. This allows users to generate the next page while checking the voting results in real time, and to create new manga based on the rankings. It also prevents fraudulent voting and enables personalized manga generation based on user emotions.
[0844] "Characters" refers to people, animals, and fictional beings that appear in manga and animation.
[0845] "Setting" refers to the elements that determine the background and situation of a story, the relationships between characters, etc.
[0846] "Setting" refers to the place or environment in which the story unfolds.
[0847] "Manga" refers to a form of media that combines pictures and text to tell a story.
[0848] "Voting" refers to the act of a user selecting one of the options and submitting that selection to the system.
[0849] "Unspecified majority" refers to a large number of people who are not limited to a specific individual or group.
[0850] "Real-time" means that data and information are processed immediately and displayed without delay.
[0851] "Ranking" refers to ranking items based on specific criteria.
[0852] "Fraudulent voting" refers to voting that goes against the rules of the system.
[0853] "Emotions" refer to human psychological reactions and feelings.
[0854] "Copyright" refers to the right of an author in a creative work.
[0855] "Personalization" refers to customizing something to suit the characteristics and preferences of each individual user.
[0856] This invention is a system in which a user creates characters, settings, and a stage, and the next page is decided by an unspecified number of votes. A specific embodiment for implementing this system is described below.
[0857] The server provides an interface for users to create characters, settings, and locales. This interface is accessible through a web browser, and users can freely customize the appearance and personality of their characters, as well as the setting and locale of their stories.
[0858] Next, we provide a means for subsequent users to create one or two pages of manga. Users can create new pages based on existing characters and settings. In this case, users can position characters and enter text using simple drag-and-drop operations.
[0859] The next page of the generated manga is decided by a vote of an unspecified number of users. Users choose one of several scenario options on the website and vote. Voting takes place within a certain time period (for example, one hour), and the next page is generated based on the results.
[0860] The server tallies the voting results in real time and displays them on the website, allowing users to check the current voting status in real time. The voting results are updated in real time using WebSocket and displayed using React.
[0861] The server then displays the popularity and attention of the generated manga in a ranking format. The ranking is calculated based on data such as the number of votes and views, and the data is searched using ElasticSearch (registered trademark) and visualized using D3.js.
[0862] To prevent fraudulent voting, the server limits the number of votes from the same IP address within a certain period of time, and uses a Python script to detect abnormal voting patterns and prevent fraudulent voting.
[0863] Furthermore, the server uses an emotion engine to recognize the user's emotions and adjusts the cartoon generation and voting results accordingly. The emotion engine uses OpenCV to analyze the user's facial expressions and TENSORFLOW (registered trademark) to recognize emotions. It also uses NLTK to perform sentiment analysis of the input text. If the user expresses joy, a cartoon with a cheerful scenario is generated.
[0864] As a concrete example, a user accesses a website and votes for scenarios A, B, and C for the next page. When the voting time is over, the server selects the scenario with the most votes as the next page. The voting results are displayed in real time, and the user can view them to generate the next page. Furthermore, a ranking function displays the currently most popular comics. An emotion engine recognizes the user's emotion of joy, and generates a comic with a cheerful scenario.
[0865] An example of a prompt is as follows:
[0866] "Please choose a scenario on the next page. Scenario A: The protagonist encounters a new enemy. Scenario B: The protagonist reunites with friends. Scenario C: The protagonist discovers a new ability."
[0867] In this way, the user can create a more personalized manga based on his or her own feelings and voting results. The flow of the specification process in the third embodiment will be described with reference to FIG.
[0868] Step 1:
[0869] A user visits a website.
[0870] A user uses a browser to enter a website URL, and the homepage is displayed. The input is the website URL, and the output is the homepage display. Specifically, a user opens a browser such as Google® Chrome or Firefox and enters the website URL (e.g., www.mangavote.com). The homepage is displayed, and the user can check the current voting status and rankings.
[0871] Step 2:
[0872] The user generates the characters, setting, and setting.
[0873] Users use a website interface to customize their character's appearance, personality, and story setting and setting. The input is the user's selections and input data, and the output is the generated character, setting, and setting. Specifically, users use drag-and-drop operations and text input to customize their character's appearance and personality.
[0874] Step 3:
[0875] The second and subsequent users will generate one or two pages of comics.
[0876] The user creates a new page based on existing characters and settings. The input is the existing characters, settings, and user operation data, and the output is the generated manga page. Specifically, the user places the characters using drag-and-drop operations and enters text.
[0877] Step 4:
[0878] Users vote for the scenario on the next page of the manga.
[0879] A user goes to a voting page on a website, selects one of several scenario options, and clicks the "Vote" button. The input is the user's scenario selection data, and the output is a voting completion message. Specifically, the user selects one of Scenario A, Scenario B, or Scenario C, and clicks the "Vote" button.
[0880] Step 5:
[0881] The server tally and display the voting results in real time.
[0882] The server receives voting data from users and stores it in a database. It uses WebSocket to tally the voting results in real time and display them on the website. The input is the user's voting data, and the output is the voting results, which are updated in real time. Specifically, the server stores the voting data in a MySQL database and displays the voting results using React.
[0883] Step 6:
[0884] The server closes the voting after a certain time, and the scenario with the most votes is adopted as the next page.
[0885] The server will automatically close voting when the voting time has ended. The scenario with the most votes will be adopted as the next page, and the results will be displayed on the website. The input is the voting data at the time voting ended, and the output is a display of the scenario that was adopted as the next page. In concrete terms, the server will automatically close voting when the voting time has ended, and the scenario with the most votes will be adopted as the next page.
[0886] Step 7:
[0887] The server calculates and displays the rankings.
[0888] The server calculates rankings based on data such as the number of votes and views. It uses Elasticsearch to search the data and D3.js to visualize the rankings. The input is the number of votes and views data, and the output is the display of the rankings. Specifically, the server uses Elasticsearch to search the data and D3.js to visualize the rankings.
[0889] Step 8:
[0890] The server detects and prevents voter fraud.
[0891] The server limits the number of votes from the same IP address within a certain period of time. It also uses a Python script to detect abnormal voting patterns and prevent fraudulent voting. The input is voting data, and the output is the detection and prevention of fraudulent voting. Specifically, the server uses Nginx to limit the number of votes from the same IP address and a Python script to detect abnormal voting patterns.
[0892] Step 9:
[0893] The server uses an emotion engine to recognize the user's emotions and adjusts the manga generation and voting results.
[0894] The server uses OpenCV to analyze the user's facial expression and TensorFlow to recognize emotions. It also uses NLTK to perform sentiment analysis on the input text. The input is the user's facial expression data and input text, and the output is generating a cartoon based on the emotion and adjusting the voting results. Specifically, the server captures the user's facial expression with a camera, analyzes it with OpenCV, and recognizes emotions with TensorFlow. It also performs sentiment analysis on the text entered by the user with NLTK.
[0895] (Application example 3)
[0896] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0897] Conventional manga generation systems have difficulty generating personalized content that reflects user emotions, and they are prone to distortion of results due to voting fraud and have difficulty displaying voting results in real time. Furthermore, they lack a means to effectively display the popularity and attention of the generated manga, making it difficult to maintain user interest.
[0898] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.
[0899] In this invention, the server includes means for users to generate characters, settings, and settings, means for second and subsequent users to generate one or two pages of manga, means for determining the next page of the generated manga through an unspecified number of votes, means for generating the next page based on the voting results, means for recognizing users' emotions, means for generating manga based on the recognized emotions, means for displaying voting results in real time, means for displaying popularity and attention in a ranking format, means for preventing fraudulent voting through organized voting, and means for relinquishing copyright of manga generated by users. This enables the generation of personalized manga that reflects users' emotions, the display of voting results in real time, the prevention of fraudulent voting, and the effective display of popularity and attention.
[0900] "Characters" refers to people, animals, and fictional beings that appear in manga and animation.
[0901] "Setting" refers to the elements that determine the background and situation of a story, the relationships between characters, etc.
[0902] "Setting" refers to the place or environment in which the story unfolds.
[0903] "Manga" refers to a form of media that combines pictures and text to tell a story.
[0904] "Voting" refers to the act of a user selecting one of the options and having the results tallied.
[0905] "Emotion recognition" refers to technology that determines emotions from a user's facial expressions, tone of voice, text input, etc.
[0906] "Real time" refers to processing and display occurring immediately in the current running time.
[0907] "Ranking" refers to placing things in a certain order based on certain criteria.
[0908] "Fraudulent voting" refers to voting that is conducted in a fraudulent manner that undermines the fairness of the system.
[0909] "Copyright" refers to the legal right that protects an author's rights in a creative work.
[0910] A system for implementing this invention allows a user to create characters, settings, and a setting, and then a second or subsequent user can create one or two pages of manga. The next page of the generated manga is determined by an unspecified number of votes, and the next page is generated based on the voting results. Furthermore, emotion recognition means can be used to recognize the emotions of users, and manga can be generated based on the recognized emotions. Furthermore, voting results can be displayed in real time, and popularity and attention can be displayed in a ranking format. The system also includes means for preventing fraudulent voting and means for users to waive copyright on manga they have created.
[0911] Hardware and software used
[0912] Hardware: Smartphone (camera, microphone, internet connection)
[0913] Software: Flask (Python web framework), EmotionEngine (emotion recognition engine), MangaGenerator (manga generation engine), VoteSystem (voting system)
[0914] Data processing and calculation
[0915] 1. Emotion recognition:
[0916] The user provides a facial image and audio clip using the smartphone's camera and microphone.
[0917] The server uses the EmotionEngine to recognize emotions from the user's facial expressions, voice tone, and text input.
[0918] Model used: EmotionEngine (facial expression recognition, speech tone analysis, text sentiment analysis)
[0919] 2. Manga generation:
[0920] Based on the recognized emotion, the server generates the next manga page using MangaGenerator.
[0921] Model used: MangaGenerator (generative AI model)
[0922] 3. Voting System:
[0923] Users can vote for the generated comic pages.
[0924] The server uses VoteSystem to manage the votes and display the results in real time.
[0925] Model used: VoteSystem (voting management system)
[0926] 4. Ranking display:
[0927] The server calculates the ranking based on the number of votes and views and displays it to the user.
[0928] Specific examples
[0929] Users open the app on their smartphones and provide a facial image and audio clip to generate the next page of the comic. The emotion engine recognizes the user's emotion as "joy" and generates a comic page with a brighter scenario. Users can vote for the generated page and see the results in real time.
[0930] Prompt Sentence Examples
[0931] Recognize emotions using the user's facial image, audio clip, and text input, and generate the next manga page based on that emotion. Allow users to vote on the generated pages and display the voting results in real time. Also, add a function to display rankings based on the number of votes and views, and prevent voter fraud.
[0932] The above is an embodiment of the present invention.
[0933] The flow of the specific processing in Application Example 3 will be described with reference to FIG.
[0934] Step 1:
[0935] The user launches the app on their smartphone and generates characters, settings, and a stage.
[0936] Input: User selection (character, setting, location)
[0937] Output: Generated character, setting, and locale data
[0938] How it works: The user selects the character, setting, and location through the app interface, then presses the generate button. The device then sends this data to the server.
[0939] Step 2:
[0940] The second and subsequent users will generate one or two pages of comics.
[0941] Input: Generated character, setting, and location data
[0942] Output: Generated comic page data
[0943] Specific operation: The server provides an interface that allows users to generate manga pages based on the received character, setting, and stage data. The user uses this interface to create manga pages and send them to the server.
[0944] Step 3:
[0945] The next page of the generated manga will be decided by an unspecified number of votes.
[0946] Input: Manga page candidates generated by multiple users
[0947] Output: Next page of data selected based on voting results
[0948] Specific operation: The server displays manga page candidates generated by multiple users and provides a voting interface. Users cast their votes, and the server tally the results.
[0949] Step 4:
[0950] Generate the next page based on the voting results.
[0951] Input: Voting results
[0952] Output: Next page of manga data
[0953] Specific operation: Based on the voting results, the server determines the manga page with the most votes as the next page and displays it to the user.
[0954] Step 5:
[0955] An emotion recognition means is used to recognize the emotions of the user.
[0956] Input: User's face image, audio clip, text input
[0957] Output: Recognized emotion data
[0958] How it works: Users use their smartphone's camera and microphone to provide facial images and audio clips, and input text. The server uses the EmotionEngine to recognize emotions from these data.
[0959] Step 6:
[0960] Generate cartoons based on recognized emotions.
[0961] Input: Recognized emotion data
[0962] Output: Manga page data based on emotions
[0963] Specific operation: Based on the recognized emotion data, the server uses MangaGenerator to generate a manga page that matches the emotion.
[0964] Step 7:
[0965] View voting results in real time.
[0966] Input: Voting result data
[0967] Output: Real-time voting results
[0968] Specific operation: The server updates the voting results in real time and displays them on the user's device.
[0969] Step 8:
[0970] Popularity and attention are displayed in ranking format.
[0971] Input: Votes, views data
[0972] Output: Ranking display data
[0973] Specific operation: The server calculates the ranking based on the number of votes and views and displays it on the user's device.
[0974] Step 9:
[0975] Prevent fraudulent voting through organized voting.
[0976] Input: Voting data, IP address data
[0977] Output: Restricted data to prevent voter fraud
[0978] Specific operation: The server limits the number of votes from the same IP address within a certain period of time to prevent fraudulent voting.
[0979] Step 10:
[0980] You waive copyright on user-generated comics.
[0981] Input: User consent data
[0982] Output: Copyright disclaimer confirmation data
[0983] Specific behavior: When creating a manga, the user selects a checkbox agreeing to the copyright waiver, and the server records that agreement.
[0984] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing.
[0985] The microphone 38B acquires a voice indicating a user input for the result of the specific processing. The control unit 46A transmits the voice data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.
[0986] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0987] Another example of generative AI is Gemini (registered trademark) (Internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.
[0988] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0989] [Second embodiment]
[0990] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0991] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0992] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0993] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0994] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0995] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0996] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0997] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0998] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0999] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1000] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1001] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.
[1002] "Example 1"
[1003] In one embodiment of the present invention, a website is provided that operates on the Internet and provides an interface for users to create characters, settings, and settings, including a form for inputting information such as the character's name, personality, and appearance, and options for setting the setting's location, time, and situation.
[1004] "Example 2"
[1005] Subsequent users use an interface to generate a one- or two-page manga. This interface uses AI technology to automatically generate a manga based on the information entered by the user. For example, if a user enters a scenario in which the protagonist fights an enemy, a manga based on that scenario will be generated.
[1006] "Example 3"
[1007] The next page of the generated manga is decided by voting from an unspecified number of users. Voting takes place on the website, and the manga that receives the most votes within a certain period of time (for example, one hour) is adopted as the next page. The voting results are displayed in real time on the website, and users generate the next page based on the voting results.
[1008] "Example 4"
[1009] The app also provides a function that displays the popularity and attention of the created manga in a ranking format. The ranking is calculated based on indicators such as the number of votes and views, and users can use the ranking as a reference when creating new manga.
[1010] "Example 5"
[1011] Furthermore, it also provides a function to prevent fraudulent voting by organized votes. For example, it prevents fraudulent voting by limiting the number of votes from the same IP address within a certain period of time. It also sets out terms for users to waive copyright on the manga they create, and requires users to agree to these terms when creating manga.
[1012] The processing flow of each embodiment will be described below.
[1013] "Example 1"
[1014] Step 1: The user visits the provided website.
[1015] Step 2: On the website, the user uses an interface to generate characters, settings, and settings, including a form to input information such as the character's name, personality, and appearance, and options to set the setting's location, time, and situation.
[1016] Step 3: Once the user has finished entering the information, it is sent to the server and stored in a database.
[1017] "Example 2"
[1018] Step 1: Subsequent users use the interface to generate a 1-2 page comic.
[1019] Step 2: The user inputs a scenario, and the AI automatically generates a manga based on that scenario.
[1020] Step 3: The resulting comic is then made publicly available to other users on the website and is subject to voting.
[1021] "Example 3"
[1022] Step 1: The next page of the generated manga is decided by voting from an unspecified number of users.
[1023] Step 2: Voting takes place on the website, and the cartoon that receives the most votes within a certain time period (for example, one hour) is selected as the next page.
[1024] Step 3: The voting results are displayed in real time on the website, and the user generates the next page based on the voting results.
[1025] "Example 4"
[1026] Step 1: We also provide a function to display the popularity and attention of the generated manga in a ranking format.
[1027] Step 2: Rankings are calculated based on indicators such as the number of votes and views, and users can use the rankings as a reference to create new manga.
[1028] "Example 5"
[1029] Step 1: We also provide functions to prevent fraudulent voting through organized voting.
[1030] Step 2: Prevent fraudulent voting by limiting the number of votes from the same IP address within a certain period of time.
[1031] Step 3: Establish terms and conditions for waiving copyright on user-generated comics, and require users to agree to these terms when generating comics.
[1032] Example 1
[1033] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1034] Previous character and setting generation systems required users to manually configure detailed settings, which was time-consuming and labor-intensive. Furthermore, there were limited ways to incorporate user input into decisions about the next development of generated content. Furthermore, there was a lack of effective ways to display the popularity and attention of generated content.
[1035] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1036] In this invention, the server includes a means for users to generate characters, settings, and settings; a means for generating prompt sentences based on the generated characters and settings; a means for sending prompt sentences to a generative AI model and receiving responses; a means for displaying the received responses to the user; a means for a second or subsequent user to generate one or two pages of manga; a means for determining the next page of the generated manga through an unspecified number of votes; and a means for generating the next page based on the voting results. This allows users to easily generate characters and settings and enjoy stories and manga based on them. Furthermore, the server can determine the next development based on user opinions, and effectively display the popularity and attention of the generated content.
[1037] "User" means an individual or group that uses the system to generate characters, settings, and locations, and to view or operate the generated content.
[1038] "Character" refers to setting information such as people, animals, and fictional beings that appear in stories and manga.
[1039] "Setting" refers to detailed information such as the character's personality and appearance, background information, the setting, time, and situation of the story.
[1040] "Setting" refers to the setting, such as the place, environment, and time period in which a story or manga unfolds.
[1041] A "prompt sentence" refers to a sentence that is sent to a generative AI model based on character and setting information entered by the user.
[1042] A "generative AI model" refers to an artificial intelligence model that generates a response based on a prompt entered by a user.
[1043] A "response" refers to a sentence or part of a story that a generative AI model generates based on a prompt.
[1044] "Voting" refers to the act of a user expressing their opinion to determine the development of the next page of the generated comic.
[1045] "Unspecified majority" refers to many users who are not limited to specific individuals or organizations.
[1046] "Popularity" refers to an index showing how many users support the generated content.
[1047] "Attention" refers to an index showing how many users are interested in the generated content.
[1048] "Ranking format" refers to a format in which generated content is ranked and displayed based on popularity or attention.
[1049] "Organized voting" refers to voting behavior carried out by a specific group or organization in order to intentionally manipulate the voting results.
[1050] "Voting fraud" refers to fraudulent voting practices that undermine the fairness of the system.
[1051] "Copyright" refers to the legal rights you have in your User Generated Content.
[1052] "Abandonment" refers to the act of a user voluntarily abandoning copyright and making the work freely available to others.
[1053] This invention is a system that provides a website that users can access over the Internet, through which they can create characters, settings, and locations and enjoy stories and comics based on them.
[1054] Servers host websites and process user requests. Specifically, servers use the following hardware and software:
[1055] Hardware: Use a server machine with a high-performance processor, sufficient memory, and fast storage. For example, use a server with an Intel Xeon processor, 32GB or more of RAM, and SSD storage.
[1056] Software: The server uses web server software (e.g., Apache or Nginx), a database management system (e.g., MySQL or MongoDB), and a generative AI model (e.g., OpenAI's GPT-3).
[1057] When a user accesses a website, the server returns a webpage created using HTML, CSS, and JavaScript. This webpage contains a form for entering character and setting information. The user fills in the provided form with information such as the character's name, personality, appearance, setting location, time, and situation.
[1058] When the user submits the form, the server receives the data and stores it in a database. The server checks the data for integrity and converts the data if necessary. The server then generates a prompt based on the information the user entered. For example, it might generate a prompt like this:
[1059] Example prompt sentence:
[1060] The character's name is Alice. She is a brave, blonde girl. The setting is a magical forest, the time is night, and the situation is the beginning of an adventure. Generate a story of Alice's adventure based on this setting.
[1061] The server sends this prompt to the generative AI model, which then generates a response based on the prompt, such as "Alice went deep into the enchanted forest and found a mysterious light in the silence of the night."
[1062] The server receives the response from the generative AI model and displays it to the user, who can then view the generated story on a web page.
[1063] Furthermore, a means is provided for subsequent users to generate one or two pages of a manga. The next page of the generated manga is decided by a vote of an unspecified number of users. Voting takes place within a certain time period (for example, one hour), and the next page is generated based on the results.
[1064] The popularity and attention of the generated manga are displayed in a ranking format, and measures are included to prevent fraudulent voting by organized votes. Users are also provided with a means to waive copyright on the manga they generate.
[1065] In this way, users can easily create characters and settings and enjoy stories and comics based on them. Furthermore, the next development of the story can be determined based on the user's opinions, and the popularity and attention of the created content can be effectively displayed.
[1066] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1067] Step 1:
[1068] A user visits a website.
[1069] Input: The user accesses the specified URL using a browser.
[1070] Output: The server returns a web page.
[1071] How it works: A user enters the URL of a website using a browser such as Google Chrome or Mozilla Firefox, and accesses it. The server receives the request and returns a web page created using HTML, CSS, and JavaScript to the user's browser.
[1072] Step 2:
[1073] The server provides the interface.
[1074] Input: The access request from the user.
[1075] Output: A web page containing a form for entering character and setting information.
[1076] Specific operation: When accessed by a user, the server provides a web page containing a form for entering information such as the character's name, personality, appearance, setting location, time, situation, etc. To do this, the form is created using HTML and CSS, and user input is validated in real time using JavaScript.
[1077] Step 3:
[1078] The user inputs character and setting information.
[1079] Input: Information entered by the user into a form, such as the character's name, personality, appearance, location, time, and situation.
[1080] Output: The data entered into the form.
[1081] Specific actions: In the provided form, the user enters "Alice" as the character's name, "Brave" as the personality, "Blonde Girl" as the appearance, "Enchanted Forest" as the setting, "Night" as the time, and "The Beginning of the Adventure" as the situation.
[1082] Step 4:
[1083] The server receives and stores the input data.
[1084] Input: The form data submitted by the user.
[1085] Output: Data stored in a database.
[1086] What happens: When a user submits a form, the server receives the data and stores it in a database (e.g., MySQL or MongoDB). The server verifies the integrity of the data and converts it if necessary.
[1087] Step 5:
[1088] The server sends a prompt to the generative AI model.
[1089] Input: Character and setting information entered by the user.
[1090] Output: The prompt sent to the generative AI model.
[1091] Specific operation: The server generates a prompt based on the information entered by the user. For example, it creates a prompt like, "The character's name is Alice. She is a brave, blonde girl. The setting is a magical forest, the time is night, and the situation is the beginning of the adventure. Please generate a story about Alice's adventure based on this setting." The server then sends this prompt to the generative AI model.
[1092] Step 6:
[1093] A generative AI model generates a response.
[1094] Input: The prompt text sent by the server.
[1095] Output: The generated response (part of the story).
[1096] How it works: The generative AI model generates a response based on a prompt sent from the server, such as a part of a story like "Alice went deep into the enchanted forest and found a mysterious light in the silence of the night."
[1097] Step 7:
[1098] The server displays the generated response to the user.
[1099] Input: The response returned by the generative AI model.
[1100] Output: The story that is displayed in the user's browser.
[1101] Specific operation: The server receives the response from the generative AI model and displays it to the user, who can then view the generated story on a web page.
[1102] Step 8:
[1103] The second and subsequent users will generate one or two pages of comics.
[1104] Input: Manga content entered by the second and subsequent users.
[1105] Output: A generated 1-2 page comic.
[1106] Specific operation: The second and subsequent users use the interface to generate a one- to two-page manga based on the generated story. The user sets the character movements, dialogue, background, etc., and generates the manga.
[1107] Step 9:
[1108] The next page of the generated manga will be decided by an unspecified number of votes.
[1109] Input: Votes from a random number of users.
[1110] Output: The content of the next page, determined based on the voting results.
[1111] Specific operation: The server accepts votes from an unspecified number of users to decide the development of the next page of the generated manga. Voting takes place within a certain time period (for example, one hour), and the next page is generated based on the results.
[1112] Step 10:
[1113] The server displays the popularity and attention of the generated manga in a ranking format.
[1114] Input: Data about the popularity and attention of the generated manga.
[1115] Output: Popularity and attention displayed in ranking format.
[1116] Specific operation: The server collects data such as user ratings and number of views to generate rankings and display the popularity and attention of the generated manga in a ranking format. Users can check which manga are popular or attracting attention by viewing the rankings.
[1117] Step 11:
[1118] The server prevents fraudulent voting through organized voting.
[1119] Input: Voting data.
[1120] Output: Voting results with fraud prevented.
[1121] Specific operation: The server analyzes the voting data and uses an algorithm to detect fraudulent voting by organized voting. If fraudulent voting is detected, the server invalidates the vote to maintain fair voting results.
[1122] Step 12:
[1123] You waive copyright on user-generated comics.
[1124] Input: User's copyright waiver.
[1125] Output: A copyright-free manga.
[1126] Specific operation: The user selects an option to waive the copyright of the manga they have created. The server receives the user's consent and records that the copyright has been waived. This allows other users to freely use the manga.
[1127] (Application example 1)
[1128] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1129] Conventional character and setting generation systems lacked the means to effectively utilize user-generated content and share it with a wide range of users. Furthermore, there was insufficient means to visualize the popularity and attention of generated content, making it difficult to maximize user creativity. Furthermore, there was a lack of a mechanism to reflect the opinions of an unspecified number of users in the generated content and progress it, making interactive content generation difficult.
[1130] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1131] In this invention, the server includes: a means for users to generate characters, settings, and settings; a means for second and subsequent users to generate one or two pages of manga; a means for determining the next page of the generated manga through an unspecified number of votes; a means for automatically generating a short story based on information entered by the user using a generative AI model; a means for sharing the generated story to a content distribution platform; a means for displaying the popularity and attention of the generated manga in a ranking format; a means for preventing fraudulent voting through organized voting; a means for relinquishing copyright to the manga generated by the user; and a means for sharing the generated story on a social networking site. This enables effective utilization of user-generated content and sharing it with a wide range of users. Furthermore, by visualizing the popularity and attention of the generated content, user creativity can be maximized. Furthermore, by providing a mechanism for progressing content by reflecting the opinions of an unspecified number of users, interactive content generation becomes possible.
[1132] "User" means an individual or group that uses the system to generate characters, settings, and locations, and to create content.
[1133] A "character" is a character created by a user, and has attributes such as a name, personality, and appearance.
[1134] "Setting" refers to the environment or situation in which a character exists, and includes elements such as place, time, and situation.
[1135] "Setting" refers to the specific place and time background in which the characters act.
[1136] A "generative AI model" is an artificial intelligence algorithm that automatically generates short stories based on information entered by the user.
[1137] A "prompt" is an instruction to be input into a generative AI model, and includes information about the characters and setting set by the user.
[1138] A "content distribution platform" is an online service that allows users to share created stories and comics with a wide range of users.
[1139] A "vote" is an expression of opinion made by an unspecified number of users to decide the next page of the generated manga.
[1140] "Ranking format" is a method of displaying the generated manga in order of popularity and attention.
[1141] "Fraudulent voting" is the act of manipulating voting results using fraudulent means such as organizing votes.
[1142] "Means for Relinquishing Copyright" refers to the methods for relinquishing copyright to user-generated comics and stories.
[1143] "SNS" stands for Social Networking Service, an online platform for sharing user-generated stories.
[1144] The system for implementing this invention allows a user to create characters, settings, and locations, and then create short stories or comics based on those settings. A specific embodiment of this system will be described below.
[1145] System Configuration
[1146] The system consists of the following main components:
[1147] 1. User terminal: A device (e.g., smartphone, tablet, PC) through which a user inputs characters, settings, and settings.
[1148] 2. Server: A central processing unit that receives input from users, generates short stories using generative AI models, and shares them on content distribution platforms.
[1149] 3. Generative AI model: An artificial intelligence algorithm that automatically generates short stories based on user-entered information (e.g., OpenAI's GPT-3).
[1150] 4. Content distribution platform: Online services (e.g., social networking sites, blogging platforms) for sharing generated stories and comics with a wide range of users.
[1151] Program processing
[1152] User terminal
[1153] The user terminal provides an interface for the user to input information about the characters, settings, and stage, such as the character's name, personality, appearance, stage location, time, and situation.
[1154] server
[1155] The server receives the information sent by the user and sends it as a prompt to the generative AI model. The generative AI model generates a short story based on the prompt and returns the result to the server. The server then sends the generated story to the user's device and displays it to the user. The server also has the function of sharing the generated story on a content distribution platform.
[1156] Generative AI Models
[1157] The generative AI model automatically generates a short story based on user-entered information, specifically using prompts like the following:
[1158] Example prompt sentence:
[1159] Character's Name: Alice
[1160] Personality: Brave and curious
[1161] Setting: Future city
[1162] Plot: Alice discovers new technology and goes on adventures with it.
[1163] Use this information to generate a short story.
[1164] The generative AI model generates a short story based on this prompt and returns the result to the server.
[1165] Specific examples
[1166] For example, if a user creates a character named "Alice" and sets her personality as "brave and curious," the setting as "a futuristic city," and the plot as "Alice discovers new technology and uses it to go on an adventure," the generative AI model will use this information to generate a short story that can be displayed on the user's device and shared on social media or blog platforms.
[1167] In this way, users can easily set up characters and settings, use generative AI models to generate short stories, and share them with a wide audience.
[1168] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1169] Step 1:
[1170] The user uses a terminal to input information about the characters, setting, and location.
[1171] Input: Information such as the character's name, personality, appearance, location, time, and situation.
[1172] Data processing: Convert the information entered by the user into the format of a prompt statement.
[1173] Output: The prompt statement.
[1174] Specific operation: The user inputs the character's name "Alice," personality "brave and curious," setting "future city," and plot "Alice discovers new technology and uses it to go on an adventure" through the terminal interface.
[1175] Step 2:
[1176] Sends the terminal generated prompt to the server.
[1177] Input: prompt statement.
[1178] Data processing: Convert the prompt text into a data format to be sent to the server.
[1179] Output: The prompt text sent to the server.
[1180] Specific operation: The terminal sends a prompt message generated based on the information entered by the user to the server.
[1181] Step 3:
[1182] The server receives the prompt sentence and sends it to the generative AI model.
[1183] Input: Prompt statement.
[1184] Data processing: Converting the prompt sentence into a format suitable for the generative AI model.
[1185] Output: The prompt sent to the generative AI model.
[1186] Specific operation: The server sends the received prompt sentence to a generative AI model (e.g., OpenAI's GPT-3).
[1187] Step 4:
[1188] A generative AI model generates a short story based on a prompt.
[1189] Input: Prompt statement.
[1190] Data computation: A generative AI model analyzes the prompt and generates a short story.
[1191] Output: A generated short story.
[1192] Specific behavior: The generative AI model generates a short story based on the prompt: "Character's name: Alice, Personality: Brave and curious, Setting: Future city, Plot: Alice discovers new technology and uses it to go on an adventure."
[1193] Step 5:
[1194] The generated short story is sent back to the server.
[1195] Input: A generated short story.
[1196] Data processing: The server receives the short stories returned by the generative AI model.
[1197] Output: The short story received by the server.
[1198] Specific operation: The generative AI model sends the generated short story back to the server.
[1199] Step 6:
[1200] The server transmits the generated short story to the user terminal.
[1201] Input: A generated short story.
[1202] Data processing: The short story is converted into a data format for transmission to the user's terminal.
[1203] Output: A short story sent to the user's device.
[1204] Specific operation: The server sends the generated short story to the user terminal.
[1205] Step 7:
[1206] The user terminal displays the generated short story.
[1207] Input: A generated short story.
[1208] Data processing: Converting short stories into a display format.
[1209] Output: A short story displayed to the user.
[1210] Specific operation: The user terminal displays the generated short story on the screen.
[1211] Step 8:
[1212] Share user-generated short stories to a content distribution platform.
[1213] Input: A generated short story.
[1214] Data processing: Converting short stories into a format suitable for content distribution platforms.
[1215] Output: A short story shared to a content distribution platform.
[1216] Specific operation: The user shares the generated short story on social media or blog platforms.
[1217] Example 2
[1218] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1219] Conventional manga generation systems require users to manually draw characters and scenarios, which is time-consuming and labor-intensive. Furthermore, there was a lack of a way to reflect users' opinions when deciding the next page of the generated manga, which led to a decline in users' motivation to participate. Furthermore, there was no way to effectively display the popularity or attention of the generated manga, making it difficult to maintain users' interest.
[1220] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1221] In this invention, the server includes: a means for a user to generate characters, settings, and a setting; a means for a second or subsequent user to generate one or two pages of a manga; a means for a user to input a scenario; a means for the server to generate a prompt; a means for the server to send the prompt to a generation AI model; a means for the generation AI model to generate a manga; a means for returning the generated manga to the user; a means for determining the next page of the generated manga through an unspecified number of votes; and a means for generating the next page based on the voting results. This allows users to easily generate manga based on their own scenario, and by having users vote to determine the next page, it is possible to increase users' motivation to participate. Furthermore, by displaying the popularity and attention of the generated manga in a ranking format, it is possible to continue to attract users' attention.
[1222] A "user" is an individual or group that uses the system to generate characters, settings, and locations, and input scenarios.
[1223] A "character" is an element that plays a role in a story, such as a comic book character, an animal, or a fictional being.
[1224] "Setting" refers to the information that forms the basis of a manga story, such as the background and situation of the story and the relationships between the characters.
[1225] "Setting" refers to the place or environment in which the story of a manga unfolds.
[1226] A "scenario" is the plot and development of a story entered by the user.
[1227] A "prompt sentence" is an instruction sentence for a generative AI model that is generated based on a scenario entered by the user.
[1228] A "generative AI model" is an artificial intelligence technology that analyzes prompt text and generates a manga story and images based on a scenario.
[1229] A "vote" is an expression of intent made by an unspecified number of users to determine the content of the next page of the generated manga.
[1230] The "ranking format" is a format in which the generated manga are ranked and displayed according to their popularity and attention.
[1231] "Fraudulent voting" is the act of manipulating voting results using fraudulent means such as organizing votes.
[1232] "Relinquishing copyright" means giving up the copyright to the comic created by the user, making it freely available to others.
[1233] This invention is a system that allows users to easily create manga and decide the content of the next page through an unspecified number of votes. The system provides an interface for users to create characters, settings, and locations, and input a scenario. A specific embodiment of this system is described below.
[1234] System configuration
[1235] The system consists of the following main components:
[1236] 1. User Device
[1237] 2. Server
[1238] 3. Generative AI Models
[1239] User terminal
[1240] A user terminal is a device that uses a web browser to access the system interface and can be any device that can connect to the Internet, such as a PC, smartphone, or tablet.
[1241] server
[1242] The server is responsible for receiving input from the user, generating prompts, and sending them to the generative AI model. The server performs the following tasks:
[1243] Receives a scenario entered by the user
[1244] Generate prompts based on a scenario
[1245] Sending prompts to the generative AI model
[1246] Return the manga generated by the generative AI model to the user
[1247] Generative AI Models
[1248] The generative AI model analyzes the prompt text sent from the server and generates a manga story and images based on the scenario. This model combines natural language processing technology and image generation technology. Specifically, OpenAI's GPT-4 and DALL-E are used.
[1249] Specific examples
[1250] For example, if the user inputs a scenario such as "The protagonist fights the enemy," the server will generate a prompt like this:
[1251] Prompt: "Draw a scene where the protagonist fights the enemy. The protagonist is brave and the enemy is a giant dragon."
[1252] Based on this prompt, the generative AI model generates a one- to two-page comic that includes a scene in which the main character fights a giant dragon. The generated comic is then displayed to the user via the server.
[1253] Voting function
[1254] The content of the next page of the generated manga is decided by a vote of an unspecified number of users. Voting takes place within a certain time period (for example, one hour), and the next page is generated based on the results. This voting function can increase users' motivation to participate.
[1255] Popularity and attention display
[1256] The popularity and attention of the generated manga are displayed in a ranking format, allowing users to see which manga other users are interested in. It also includes measures to prevent fraudulent voting by organized votes.
[1257] In this way, a system is realized that allows users to easily create a manga based on their own scenario and decide the content of the next page by voting.
[1258] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1259] Step 1:
[1260] The user accesses the interface
[1261] A user accesses the system interface using a web browser. The user accesses the system's URL from their terminal and the interface is displayed. Input: User's access request. Output: Interface display.
[1262] Step 2:
[1263] The user inputs a scenario
[1264] The user inputs a scenario into an input form on the interface. For example, the scenario is "The protagonist fights the enemy." Input: User's scenario. Output: Transmission of scenario data.
[1265] Step 3:
[1266] The server generates a prompt
[1267] The server receives the scenario entered by the user and generates a prompt based on it. For example, it generates a prompt such as, "Draw a scene where the main character fights the enemy. The main character is brave, and the enemy is a giant dragon." Input: Scenario data. Output: Prompt.
[1268] Step 4:
[1269] The server sends a prompt to the generative AI model
[1270] The server sends the generated prompt sentence to the generative AI model. The generative AI model is accessed, for example, through an API. Input: Prompt sentence. Output: Sending a request to the generative AI model.
[1271] Step 5:
[1272] Generative AI model generates manga
[1273] The generative AI model analyzes the received prompt and generates a manga story and images based on the scenario. For example, it generates a one- to two-page manga including a scene in which the main character fights a giant dragon. Input: Prompt. Output: Generated manga data.
[1274] Step 6:
[1275] The server returns the generated comic to the user
[1276] The server receives the manga returned by the generative AI model and displays it to the user. The user can view the generated manga on the interface. Input: Generated manga data. Output: Manga displayed on the user's device.
[1277] Step 7:
[1278] Users vote for the next page
[1279] Users vote to decide the content of the next page of the generated manga. Voting takes place within a certain time period (for example, one hour). Input: User votes. Output: Voting data tallied.
[1280] Step 8:
[1281] The server generates the next page based on the vote results.
[1282] The server tally the voting results, generate the prompt for the next page based on the results, and send it back to the generative AI model. Input: Voting data. Output: The prompt for the next page and the generated comic.
[1283] Step 9:
[1284] The server returns the next generated page to the user
[1285] The server receives the next page of the manga returned by the generative AI model and displays it to the user. The user can view the next page on the interface. Input: Manga data for the next page. Output: Display of the next page of the manga on the user's device.
[1286] In this way, a system is realized that allows users to easily create a manga based on their own scenario and decide the content of the next page by voting.
[1287] (Application example 2)
[1288] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1289] Conventional manga generation systems require users to manually draw characters and scenarios, which is time-consuming and labor-intensive. Furthermore, there were limited ways to reflect users' opinions when deciding the next page of the generated manga, making it difficult to motivate users to participate. Furthermore, there was a lack of easy ways to share the generated manga, making it difficult to promote interaction between users.
[1290] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for a user to generate characters, settings, and a setting; means for a second or subsequent user to generate one to two pages of manga; means for determining the next page of the generated manga by an unspecified number of votes; means for generating the next page based on the voting results; means for automatically generating a manga using a generative AI model when a user inputs a scenario; means for saving and displaying the generated manga as an image; and means for sharing the generated manga. This enables users to easily generate manga, determine the content of the next page by voting, and share the generated manga with other users.
[1291] "Character" refers to people, animals, fictional beings, etc. that appear in a story.
[1292] "Setting" refers to the elements that determine the background and situation of a story, the relationships between characters, etc.
[1293] "Setting" refers to the place or environment in which the story unfolds.
[1294] A "generative AI model" refers to an artificial intelligence algorithm that automatically generates manga based on information entered by the user.
[1295] A "scenario" refers to the text or plot that shows the plot and development of a story.
[1296] "Voting" refers to the act of an unspecified number of users expressing their opinions and tallying the results.
[1297] "Image" refers to digital data containing visual information.
[1298] "Storage" refers to the act of recording the generated data in a storage device.
[1299] "Display" refers to the act of visually presenting the generated data to the user.
[1300] "Sharing" refers to the act of sharing generated data with other users.
[1301] A system for implementing this invention includes means for a user to generate characters, settings, and a setting; means for a second or subsequent user to generate one to two pages of manga; means for determining the next page of the generated manga through an unspecified number of votes; means for generating the next page based on the voting results; means for automatically generating manga using a generative AI model when a user inputs a scenario; means for saving and displaying the generated manga as an image; and means for sharing the generated manga.
[1302] System Program
[1303] The server receives scenario input from the user and automatically generates a manga using a generative AI model. The generated manga is saved as an image and displayed on the user's device. Furthermore, the generated manga can be shared with other users.
[1304] Hardware and software used
[1305] Hardware: Smartphones, servers
[1306] Software: Python, OpenAI API, PIL (Python Imaging Library)
[1307] Data processing and calculation
[1308] 1. Receiving user input:
[1309] Users input scenarios through a smartphone application.
[1310] 2. Generate prompt sentence:
[1311] The server generates a prompt sentence based on the input scenario.
[1312] Example: "Scenario: Generate a 1-2 page manga in which the protagonist fights the enemy."
[1313] 3. Invoke the generative AI model:
[1314] The server uses the OpenAI API to send prompts to the generative AI model to generate the comic text.
[1315] 4. Image generation:
[1316] The server uses PIL to draw the generated text onto an image, generating a cartoon image.
[1317] 5. Saving and viewing images:
[1318] The generated manga images are stored on a server and displayed on the user's smartphone.
[1319] 6. Share images:
[1320] The generated cartoon image can be shared with other users if the user wishes.
[1321] Specific examples
[1322] If the user inputs a scenario in which the protagonist fights the enemy, the server generates the following prompt:
[1323] "Scenario: Generate a 1-2 page manga in which the protagonist fights the enemy."
[1324] This prompt is sent to a generative AI model, which then generates an image based on the text of the manga. The generated manga image is displayed on the user's smartphone and can be shared with other users.
[1325] This allows users to easily create comics, vote to decide the content of the next page, and share the created comics with other users.
[1326] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1327] Step 1:
[1328] The user inputs a scenario through a smartphone application. The input scenario is sent to the server. The input data is a text-based scenario, such as "The protagonist fights the enemy."
[1329] Step 2:
[1330] The server generates a prompt based on the received scenario. Specifically, it converts the scenario text into a format like "Scenario: Please generate a 1-2 page manga in which the protagonist fights the enemy." The input is the scenario text entered by the user, and the output is the generated prompt.
[1331] Step 3:
[1332] The server sends the generated prompt to the OpenAI API and invokes the generative AI model, which generates the comic text based on the prompt. The input is the prompt, and the output is the generated comic text.
[1333] Step 4:
[1334] The server receives the generated comic text and draws it on an image using PIL (Python Imaging Library). Specifically, it places the text at a specific position on the image and creates a comic page. The input is the generated comic text, and the output is the comic image data.
[1335] Step 5:
[1336] The server stores the image data of the generated manga and sends it to the user's smartphone. The user's device displays the received image data. The input is the image data of the manga, and the output is the manga image displayed on the user's smartphone.
[1337] Step 6:
[1338] Users can share the generated manga images with other users. Specifically, they can use the sharing function in the application to send the images via social media or messaging apps. The input is the image data of the manga to be shared, and the output is the image sent to other users.
[1339] Example 3
[1340] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1341] Conventional manga generation systems have the problem that it is difficult to reflect the user's opinion when deciding the next page of the manga they have generated. In addition, there is a lack of a means to effectively display the popularity and attention of the generated manga, and there is also an insufficient mechanism to prevent fraudulent voting by organized votes. Furthermore, there is a need for a means to properly manage the copyright of the manga generated by users.
[1342] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.
[1343] In this invention, the server includes: means for users to generate characters, settings, and settings; means for second and subsequent users to generate one or two pages of manga; means for determining the next page of the generated manga through an unspecified number of votes; means for generating the next page based on the voting results; means for tallying the voting data in real time; means for displaying the voting results in real time on a website; means for displaying the popularity and attention of the generated manga in a ranking format; means for preventing fraudulent voting through organized voting; means for relinquishing copyright to the manga generated by users; and means for limiting the number of votes from the same IP address within a certain period of time. This makes it possible to generate the next page that reflects user opinions, effectively display the popularity and attention of the generated manga, prevent fraudulent voting, and enable appropriate copyright management.
[1344] A "user" is an individual or group that uses the system to generate characters, settings, and locations, and create manga pages.
[1345] "Characters" refers to people, animals, fictional beings, and other characters that appear in manga.
[1346] "Setting" refers to the elements that make up a manga's story, background, world view, etc.
[1347] "Setting" refers to the place or environment in which the story of a manga unfolds.
[1348] "Voting" refers to the act of expressing a user's opinion to decide the next page of the generated manga.
[1349] "Voting data" is data generated when a user casts a vote, and includes information such as the selected manga, voting time, and IP address.
[1350] "Real-time tallying" refers to the process of instantly processing voting data and calculating the number of votes each manga received.
[1351] "Ranking" refers to the results of ranking the popularity and attention of the generated manga based on indicators such as the number of votes and views.
[1352] "Fraudulent voting" refers to voting practices that undermine the fairness of the system, such as organized voting or excessive voting from the same IP address.
[1353] "Copyright waiver" means that the user waives the copyright to the manga they have created, allowing other users and system operators to freely use the manga.
[1354] "Within a certain period of time" refers to a specific time frame set by the system (for example, one hour) during which votes and operations made within that period are considered valid.
[1355] An "IP address" refers to a unique number used to identify a device connected to the Internet.
[1356] This invention is a system that determines the next page of a comic created by a user through voting by an unspecified number of people, and generates the next page based on the results. A specific embodiment of this system will be described below.
[1357] System configuration
[1358] The system consists of the following main components:
[1359] 1. User Interface
[1360] 2. Server
[1361] 3. Database
[1362] 4. Real-time Data Processing Framework
[1363] 5. Front-end Frameworks
[1364] User Interface
[1365] Users use the interface provided on the website to create characters, settings, and locations, and to create manga pages. The user interface is built using web technologies such as HTML, CSS, and JavaScript.
[1366] server
[1367] The server receives user requests, stores them in a database, and tallys up the voting data in real time and displays the results on a website. The server uses standard web server software (e.g., Apache, Nginx).
[1368] Database
[1369] The database stores user-generated characters, settings, locations, voting data, etc. A relational database (e.g., MySQL, PostgreSQL) is used for the database.
[1370] Real-time Data Processing Framework
[1371] The real-time data processing framework processes the voting data in real time and calculates the number of votes for each cartoon, using frameworks such as Apache Kafka and Apache Spark.
[1372] Front-end frameworks
[1373] Front-end frameworks such as React.js and Vue.js are used to display voting results and rankings in real time.
[1374] Specific examples
[1375] Consider a scenario where users vote for whether "Manga A" or "Manga B" should be selected as the next page. The voting period is one hour, and if "Manga A" receives the most votes at the end, "Manga A" will be selected as the next page.
[1376] Example prompt sentence:
[1377] Please choose your manga for the next page:
[1378] 1. Manga A
[1379] 2. Manga B
[1380] Voting will last for one hour. The comic with the most votes will be selected as the next page.
[1381] Viewing voting results
[1382] The server displays the voting results tallied in real time on the website, allowing users to check the current voting status in real time.
[1383] Calculation and display of rankings
[1384] The server displays the popularity and attention of the created manga in a ranking format based on indicators such as the number of votes and views, allowing users to refer to the rankings to create new manga.
[1385] Preventing Voter Fraud
[1386] The server limits the number of votes from the same IP address within a certain period of time to prevent fraudulent voting by organized votes, and also requires users to agree to terms and conditions to waive copyright to the manga they create.
[1387] In this way, it is possible to generate the next page that reflects the user's opinion, effectively display the popularity and attention of the generated manga, prevent fraudulent voting, and enable appropriate management of copyright. The flow of the identification process in Example 3 will be described with reference to Figure 15.
[1388] Step 1: User voting
[1389] Users use an interface provided on the website to vote for the comic to be featured on the next page by selecting one of the comics presented as options and clicking the voting button.
[1390] Input: User's selected comic, voting time, IP address
[1391] Output: Voting data (selected manga, voting time, IP address)
[1392] Specific operation: The user accesses a web page, displays a voting form, selects one manga from the options, and clicks the voting button.
[1393] Step 2: Collecting polling data
[1394] The server receives the voting data sent by the users and stores it in a database.
[1395] Input: Voting data (selected manga, voting time, IP address)
[1396] Output: Voting data stored in a database
[1397] Specific operation: The server receives a voting request from a user. The server stores the voting data in a database (e.g., MySQL).
[1398] Step 3: Real-time counting of voting data
[1399] The server aggregates the voting data stored in the database in real time and calculates the number of votes for each cartoon. This process uses a real-time data processing framework (e.g., Apache Kafka).
[1400] Input: Voting data stored in a database
[1401] Output: Number of votes for each manga
[1402] Specific operation: The server retrieves the voting data from the database. The server uses a real-time data processing framework to tally the number of votes for each cartoon.
[1403] Step 4: View the poll results
[1404] The server displays the voting results tallied in real time on the website, allowing users to check the current voting status in real time.
[1405] Input: Number of votes for each manga
[1406] Output: Poll results displayed on the website
[1407] Specific operation: The server sends the tally results to a web page, and the terminal displays the voting results on the web page in real time.
[1408] Step 5: Generate the next page
[1409] When the voting period ends, the server selects the manga with the most votes as the next page. Users generate the next page based on the voting results.
[1410] Input: End of voting period, number of votes for each manga
[1411] Output: Manga to be adopted as the next page
[1412] Specific operation: The server detects the end of the voting period. The server determines the manga with the most votes as the next page. The user inputs a prompt to generate the next page.
[1413] Step 6: Calculating and displaying rankings
[1414] The server displays the popularity and attention of the generated manga in a ranking format based on indicators such as the number of votes and views.
[1415] Input: Number of votes, number of views data
[1416] Output: Ranking results
[1417] Specific operation: The server retrieves data on the number of votes and views from the database. The server calculates the rankings using a data analysis tool (e.g., Apache Spark). The server sends the ranking results to a web page. The device displays the rankings on the web page.
[1418] Step 7: Prevent voter fraud
[1419] The server limits the number of votes from the same IP address within a certain period of time to prevent fraudulent voting by organized votes, and also requires users to agree to terms and conditions to waive copyright to the manga they create.
[1420] Input: Voting data (including IP address)
[1421] Output: Detecting and limiting voter fraud
[1422] Specific operation: The server monitors the IP addresses included in the voting data. The server limits the number of votes from the same IP address within a certain period of time. The server verifies that users agree to the copyright waiver terms when creating manga.
[1423] (Application example 3)
[1424] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1425] Conventional manga generation systems do not adequately display voting results in real time when determining the next page based on user votes, nor do they adequately prevent fraudulent voting. Furthermore, they lack a function to display the popularity and attention of user-generated manga in a ranking format, making it difficult to keep users interested. Furthermore, the lack of an interactive voting system using smartphones poses a challenge in improving the user experience.
[1426] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.
[1427] In this invention, the server includes: means for users to generate characters, settings, and settings; means for second and subsequent users to generate one or two pages of manga; means for determining the next page of the generated manga through an unspecified number of votes; means for generating the next page based on the voting results; means for voting through an application installed on a smartphone; and means for displaying the voting results in real time. This allows users to interactively determine the next page of the manga using their smartphones, and realizes real-time display of voting results, prevention of fraudulent voting, and display of popularity and attention rankings.
[1428] "Users" are individuals or groups who use the system to generate characters, settings, and locations, and vote to decide the next page of the manga.
[1429] "Characters" refers to people, animals, fictional beings, and other characters that appear in manga.
[1430] "Setting" refers to basic information such as the story, background, and world view of a manga.
[1431] "Setting" refers to the place or environment in which the story of a manga unfolds.
[1432] "Manga" is a form of content that expresses a story by combining pictures and text.
[1433] "Voting" is an act of expressing a user's intention to decide the next page.
[1434] "Unspecified majority" refers to many users who are not limited to specific individuals or organizations.
[1435] "Voting results" refers to the results of tallying votes by users.
[1436] "Real-time" refers to information being updated on the same timeline as real time.
[1437] "Ranking" refers to a format in which the generated manga are ranked and displayed according to their popularity and attention.
[1438] "Voting fraud" refers to fraudulent voting practices intended to undermine the fairness of the system.
[1439] A "smartphone" refers to a portable information terminal that can connect to the Internet and install applications.
[1440] "Application" refers to software that is installed on a smartphone and provides specific functions.
[1441] "Interactive" refers to a state in which a user can interact with a system.
[1442] As an embodiment of the present invention, a system is provided that allows a user to interactively determine the next page of a manga using a smartphone. A specific embodiment of this system will be described below.
[1443] System configuration
[1444] The system consists of the following major components:
[1445] 1. User device: A mobile information terminal such as a smartphone.
[1446] 2. Server: Provides functions for tallying voting data, displaying it in real time, calculating rankings, and preventing fraudulent voting.
[1447] 3. Application: Software installed on smartphones that allows users to cast their votes.
[1448] Hardware and software used
[1449] Hardware: Smartphone (e.g. iPhone, Android device)
[1450] Software: Flask (a Python web framework), requests (a library for sending HTTP requests)
[1451] Data processing and calculation
[1452] The server receives the voting data from the user and performs the following processes.
[1453] 1. Counting voting data: Counting voting results in real time and determining the next page.
[1454] 2. Real-time display: Show voting results to users in real time.
[1455] 3. Ranking calculation: The popularity and attention of the generated manga are displayed in ranking form.
[1456] 4. Preventing fraudulent voting: Prevent fraudulent voting by limiting the number of votes from the same IP address within a certain period of time.
[1457] Specific examples
[1458] User A opens the smartphone app, chooses one of the three options displayed as next page candidates, and votes for option 2. The server receives this vote, tallies the results in real time, and displays them to User A. Other users also vote in the same way, and the option with the most votes is generated as the next page.
[1459] Prompt Sentence Examples
[1460] "Vote for the option you would most like to read from Option 1, Option 2, or Option 3, which will be displayed as candidates on the next page. The voting results will be displayed in real time."
[1461] In this way, users can interactively decide the next page of the manga, voting results are displayed in real time, fraudulent voting is prevented, and rankings of popularity and attention are displayed.
[1462] The flow of the specific processing in Application Example 3 will be described with reference to FIG.
[1463] Step 1:
[1464] A user launches a smartphone app and checks the options displayed as next page suggestions.
[1465] Input: Launching a smartphone app, data for next page suggestions
[1466] Output: The next page suggestions are displayed on the user's screen.
[1467] Specific behavior: The app retrieves the next page candidate data from the server and displays it on the user's screen.
[1468] Step 2:
[1469] The user selects one of the next page candidates and casts a vote.
[1470] Input: User's vote selection
[1471] Output: Voting data is sent to the server
[1472] What happens: The app sends the user's selected option to the server.
[1473] Step 3:
[1474] The server tallies the received votes.
[1475] Input: Voting data submitted by the user
[1476] Output: Counted votes
[1477] Specific operation: The server stores the voting data in a database and tally the votes in real time.
[1478] Step 4:
[1479] The server displays the voting results to the user in real time.
[1480] Input: Counted vote results
[1481] Output: Voting results displayed in real time on the user's screen
[1482] Specific operation: The server sends the aggregated results to the app, which displays them on the user's screen in real time.
[1483] Step 5:
[1484] The server limits the number of votes from the same IP address within a certain period of time.
[1485] Input: Voting data timestamp and IP address
[1486] Output: Preventing voter fraud
[1487] Specific operation: The server checks the timestamp and IP address of the voting data and rejects multiple votes from the same IP address within a certain period of time.
[1488] Step 6:
[1489] The server displays the popularity and attention of the generated manga in a ranking format.
[1490] Input: Metrics such as votes and views
[1491] Output: Popularity and attention displayed in ranking format
[1492] Specific operation: The server calculates the ranking based on the number of votes and views and displays it on the user's screen.
[1493] Step 7:
[1494] The user enters a prompt to generate the next page.
[1495] Input: The prompt text entered by the user
[1496] Output: The prompt statement used to generate the next page
[1497] Specific behavior: The user enters a prompt through the app and sends it to the server.
[1498] Step 8:
[1499] The server generates the next page using the generative AI model.
[1500] Input: The prompt text entered by the user
[1501] Output: The following page is generated:
[1502] Specific operation: The server inputs a prompt sentence into the generative AI model and generates the next page.
[1503] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1504] "Example 1"
[1505] One embodiment of the invention incorporating an emotion engine is a system that recognizes a user's emotions and adjusts the generation of comics and voting results based on those emotions. Specifically, when a user generates a comic, an emotion engine is used to recognize the user's emotions. This emotion engine can recognize emotions using various means, such as the user's facial expressions, tone of voice, and emotion analysis of input text. For example, if a user expresses joy, a comic with a cheerful scenario that matches that emotion is generated. On the other hand, if a user expresses sadness, a comic with a sad scenario that matches that emotion is generated. Furthermore, voting results are also adjusted based on the user's emotions. For example, if many users express joy, a comic with a cheerful scenario that matches that emotion is more likely to be selected as the next page. In this way, the invention incorporating an emotion engine enables more personalized comic generation and voting results adjustment that reflect the user's emotions.
[1506] "Example 2"
[1507] One embodiment of the invention incorporating an emotion engine is a system that recognizes a user's emotions and adjusts the generation of comics and voting results based on those emotions. Specifically, when a user generates a comic, an emotion engine is used to recognize the user's emotions. This emotion engine can recognize emotions using various means, such as the user's facial expressions, tone of voice, and emotion analysis of input text. For example, if a user expresses joy, a comic with a cheerful scenario that matches that emotion is generated. On the other hand, if a user expresses sadness, a comic with a sad scenario that matches that emotion is generated. Furthermore, voting results are also adjusted based on the user's emotions. For example, if many users express joy, a comic with a cheerful scenario that matches that emotion is more likely to be selected as the next page. In this way, the invention incorporating an emotion engine enables more personalized comic generation and voting results adjustment that reflect the user's emotions.
[1508] "Example 3"
[1509] One embodiment of the invention incorporating an emotion engine is a system that recognizes a user's emotions and adjusts the generation of comics and voting results based on those emotions. Specifically, when a user generates a comic, an emotion engine is used to recognize the user's emotions. This emotion engine can recognize emotions using various means, such as the user's facial expressions, tone of voice, and emotion analysis of input text. For example, if a user expresses joy, a comic with a cheerful scenario that matches that emotion is generated. On the other hand, if a user expresses sadness, a comic with a sad scenario that matches that emotion is generated. Furthermore, voting results are also adjusted based on the user's emotions. For example, if many users express joy, a comic with a cheerful scenario that matches that emotion is more likely to be selected as the next page. In this way, the invention incorporating an emotion engine enables more personalized comic generation and voting results adjustment that reflect the user's emotions.
[1510] The processing flow of each embodiment will be described below.
[1511] "Example 1"
[1512] Step 1: A user logs into the system and starts generating a comic.
[1513] Step 2: As the user creates characters, settings, and stages, the emotion engine recognizes the user's emotions. The emotion engine recognizes emotions using the user's facial expressions, tone of voice, and sentiment analysis of the input text.
[1514] Step 3: The generation of the cartoon is adjusted based on the user's emotion recognized by the emotion engine. For example, if the user is expressing joy, a cartoon with a bright scenario that matches that emotion is generated. On the other hand, if the user is expressing sadness, a cartoon with a dark scenario that matches that emotion is generated.
[1515] Step 4: The generated comic is made public to other users and voting begins.
[1516] Step 5: The emotion engine also recognizes the emotions of users participating in the vote and adjusts the voting results based on those emotions. For example, if many users express joy, a comic with a cheerful scenario that matches that emotion will likely be selected as the next page.
[1517] Step 6: The next page is decided based on the voting results, and the comic is updated. This process is repeated until a new page is generated.
[1518] Example 1
[1519] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1520] Conventional manga generation systems have difficulty generating personalized content that reflects the user's emotions. Furthermore, they are unable to consider the user's emotions when deciding the next page of the generated manga, limiting the user experience. Furthermore, there is a lack of a way to prevent fraudulent voting by organized voting when deciding the next page through an unspecified number of votes.
[1521] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1522] In this invention, the server includes means for users to generate characters, settings, and settings, means for recognizing the user's emotions, means for generating a manga scenario based on the recognized emotions, means for determining the next page of the generated manga through voting by an unspecified number of people, and means for generating the next page based on the voting results. This enables personalized manga generation that reflects the user's emotions and fair determination of voting results.
[1523] A "user" is an individual or group that uses the system to generate characters, settings, and locations, and create manga.
[1524] A "character" is a person, animal, fictional being, etc. created by a user, and includes information such as their name, personality, and appearance.
[1525] "Setting" refers to the world or environment in which a character exists, and includes information such as location, time, and situation.
[1526] A "setting" is a specific location or scene in which characters act, and is treated as part of the setting.
[1527] "Means for recognizing emotions" refers to technology or devices that analyze a user's facial expressions, tone of voice, input text, etc. to identify their emotions.
[1528] A "scenario" refers to the story and development of a manga, including the actions and lines of characters, changes in the setting, etc.
[1529] "Voting by an unspecified number of users" refers to voting that is not limited to specific users, but is conducted by many users.
[1530] "Voting results" are aggregated data obtained from an unspecified number of votes and are used to generate the next page.
[1531] A "database" is a system for storing information entered by users, generated characters, settings, stage, emotional data, etc.
[1532] "Personalization" means customizing content according to the characteristics and feelings of each individual user.
[1533] "Organized voting" refers to intentional voting by a group with a specific purpose, and is a type of fraudulent voting.
[1534] This invention provides a system that provides a website that operates on the Internet, allowing users to create characters, settings, and settings, and then uses an emotion engine to recognize the user's emotions and generate a manga scenario based on those emotions. This system enables personalized manga generation that reflects the user's emotions and fair determination of voting results.
[1535] Hardware and software used
[1536] Server: Hosts the website, manages the database, runs the emotion engine, generates scenarios, and tally vote results.
[1537] Device: The device (e.g., PC, smartphone, tablet) through which a user accesses the website and enters character, setting, and location information.
[1538] Emotion engine: Software that recognizes emotions by analyzing a user's facial expressions, tone of voice, and input text.
[1539] Program processing
[1540] Character, setting, and location generation
[1541] 1. A user accesses a website and uses a form to enter information such as the character's name, personality, and appearance, as well as options to set the setting's location, time, and situation.
[1542] 2. The server receives the information entered by the user and stores it in a database.
[1543] 3. The server generates character and setting data based on the stored information and displays it to the user.
[1544] Use of emotion engine
[1545] 1. When a user creates a manga, the emotion engine recognizes the user's emotions.
[1546] The emotion engine uses the user's facial expressions, tone of voice, and sentiment analysis of the input text.
[1547] 2. The server generates a manga with a scenario that matches the user's emotions based on the emotional data obtained from the emotion engine.
[1548] For example, if the user is expressing an emotion of joy, a cartoon with a cheerful scenario is generated.
[1549] If the user is showing sadness, a cartoon of a dark scenario is generated.
[1550] 3. The server aggregates the emotion data obtained from multiple users and adjusts the voting results.
[1551] For example, if many users are expressing emotions of joy, a comic with a cheerful scenario that matches those emotions is more likely to be selected as the next page.
[1552] Specific examples
[1553] A user visits the website and enters the character's name as "Taro," its personality as "brave," and its appearance as "blue hair."
[1554] The server generates a character called "Taro" based on this information and displays it to the user.
[1555] When a user creates a manga, the emotion engine recognizes the emotion of "joy" from the user's facial expression.
[1556] The server generates a cartoon with a cheerful scenario that matches the emotion of "joy" and displays it to the user.
[1557] Prompt Sentence Examples
[1558] Provide a form where the user can enter the character's name, personality, and appearance. Then, add functionality to recognize the user's emotions and generate a scenario based on that emotion. For example, if the user expresses joy, generate a cartoon with a cheerful scenario.
[1559] Thus, the present invention is a system that generates personalized comics and adjusts voting results based on user input and emotions.
[1560] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1561] Step 1:
[1562] A user visits a website.
[1563] Input: A user opens a browser and types in a website URL.
[1564] What happens: Your device displays the website's homepage.
[1565] Output: The website homepage is displayed on the user's device.
[1566] Step 2:
[1567] The user inputs information about the characters, setting, and location.
[1568] Input: The user enters information about the character, such as their name, personality, and appearance, into a form, and selects from options the setting, time, situation, etc.
[1569] How it works: The device displays a form and the user enters information.
[1570] Output: The entered information is sent to the server.
[1571] Step 3:
[1572] The server receives the input information and stores it in a database.
[1573] Input: Character, setting, and location information submitted by the user.
[1574] What it does: The server stores the information it receives in a database.
[1575] Output: Character, setting, and locale information stored in a database.
[1576] Step 4:
[1577] The server generates character and setting data based on the stored information and displays it to the user.
[1578] Input: Character, setting, and locale information stored in a database.
[1579] How it works: The server generates character and setting data based on the saved information.
[1580] Output: The generated character and setting data is sent to the user's device and displayed.
[1581] Step 5:
[1582] When a user creates a cartoon, the emotion engine recognizes the user's emotions.
[1583] Input: The user clicks the cartoon generation button and inputs data such as facial expressions, tone of voice, and input text.
[1584] How it works: The device captures the user's facial expressions and tone of voice through the camera and microphone and sends them to the emotion engine.
[1585] Output: The emotion engine analyzes the user's emotions and sends the results to the server.
[1586] Step 6:
[1587] The server generates a scenario based on the emotion data and displays it to the user.
[1588] Input: Emotion data sent from the emotion engine.
[1589] How it works: The server generates a scenario based on emotion data.
[1590] For example, if the user expresses the emotion "joy," a cartoon with a cheerful scenario is generated.
[1591] If the user indicates the emotion "sad", generate a cartoon with a dark scenario.
[1592] Output: The generated scenario is sent to the user's terminal and displayed.
[1593] Step 7:
[1594] The server aggregates the emotion data obtained from multiple users and adjusts the voting results.
[1595] Input: Emotion data from multiple users.
[1596] How it works: The server aggregates the emotion data and adjusts the voting results.
[1597] For example, if many users are expressing the emotion of "joy," a comic with a cheerful scenario that matches that emotion is more likely to be selected as the next page.
[1598] Output: The adjusted voting results are displayed to the user.
[1599] (Application example 1)
[1600] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1601] Conventional manga generation systems have difficulty generating personalized content that reflects the user's emotions. They also lack the ability to adjust the scenario based on the user's emotions, which prevents them from increasing user satisfaction. Furthermore, the user's emotions cannot be taken into account when determining the next page of the generated manga, limiting the user experience.
[1602] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1603] In this invention, the server includes: means for users to generate characters, settings, and settings; means for second and subsequent users to generate one or two pages of manga; means for determining the next page of the generated manga through an unspecified number of votes; means for generating the next page based on the voting results; means for adjusting the manga scenario based on the user's emotions using an emotion engine that recognizes the user's emotions; means for performing emotion analysis of the user's facial expressions, tone of voice, and input text; and means for generating the manga based on the emotions recognized by the emotion engine. This enables the generation of personalized manga that reflects the user's emotions, improving the user experience.
[1604] A "user" is an individual or group that uses the system to generate characters, settings, and locations, and create manga.
[1605] A "character" is an element that plays a role in a story, such as a comic book character, an animal, or a fictional being.
[1606] "Setting" refers to elements such as the background, situation, and environment in which the story of a manga unfolds.
[1607] A "setting" is an element such as a specific place, time, or scene in which the story of a manga unfolds.
[1608] An "emotion engine" is software or hardware that recognizes a user's emotions and adjusts scenarios and content based on those emotions.
[1609] "Facial expression" refers to the emotional state that can be read from the user's facial movements and expressions.
[1610] "Voice tone" refers to the emotional state of the user that can be read from the pitch, strength, rhythm, etc. of the user's voice.
[1611] "Sentiment analysis of input text" is the process of analyzing emotions from the content of text entered by a user.
[1612] "Voting" is a means by which multiple users express their opinions to decide the scenario for the next page.
[1613] "Personalization" refers to tailoring content to the characteristics and preferences of individual users.
[1614] A "scenario" is a plan or plot that shows the progression and development of a manga's story.
[1615] The following system configuration and processing procedure will be described as an embodiment of the present invention.
[1616] System Configuration
[1617] This system includes a server that provides an interface for users to create characters, settings, and settings, and an emotion engine that recognizes the user's emotions. The emotion engine is software that performs emotion analysis of the user's facial expressions, tone of voice, and input text. Specifically, the system uses the following hardware and software:
[1618] Hardware: Smartphone camera, microphone
[1619] Software: OpenCV, DeepFace, TextBlob
[1620] Processing flow
[1621] The server provides an interface for users to create characters, settings, and settings. Once the user inputs the characters, settings, and settings, the emotion engine analyzes the user's facial expressions, tone of voice, and input text to recognize the user's emotions. Based on the recognized emotions, the system selects an appropriate scenario and generates a manga.
[1622] Specific examples
[1623] For example, if a user takes a photo of themselves with their smartphone camera and enters the text "Today was such a fun day!", the emotion engine will recognize the emotion of "joy" from the user's facial expression and text. Based on this emotion, the system will generate a cartoon with a cheerful scenario.
[1624] Prompt Sentence Examples
[1625] An example of a prompt sentence that the user enters into the system is as follows:
[1626] Input the user's image and text. The image is user_image.jpg, and the text is "Today was a really fun day!". Analyze the user's emotions based on this and generate a cartoon with the appropriate scenario.
[1627] In this way, personalized comics that reflect the user's emotions can be generated, improving the user experience.
[1628] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1629] Step 1:
[1630] The user takes a photo of their face with their smartphone camera and enters text.
[1631] Input: User's face image and text (e.g., "Today was such a fun day!")
[1632] What happens: A user takes a picture of their face using their smartphone camera and enters text into an application input field.
[1633] Step 2:
[1634] The terminal sends the user's facial image to the emotion engine, which analyzes the emotion of the facial expression.
[1635] Input: User's face image
[1636] Output: Emotion recognized from facial expression (e.g., happiness)
[1637] Specific operation: The device uses OpenCV and DeepFace to analyze facial images and recognize emotions from facial expressions.
[1638] Step 3:
[1639] The terminal transmits the user's input text to the emotion engine, which performs emotion analysis on the text.
[1640] Input: User-entered text
[1641] Output: The sentiment recognized from the text (e.g., positive)
[1642] What happens: The device uses TextBlob to parse the input text and recognize the sentiment of the text.
[1643] Step 4:
[1644] The server comprehensively evaluates the facial expressions and the emotions in the text to determine the user's overall emotions.
[1645] Input: Emotions from facial expressions, emotions from text
[1646] Output: Overall emotion (e.g., joy)
[1647] Specific operation: The server integrates facial expressions and textual emotions to determine the user's overall emotion.
[1648] Step 5:
[1649] The server selects an appropriate scenario based on the overall emotion and generates a comic.
[1650] Input: Overall Sentiment
[1651] Output: A cartoon with a suitable scenario (e.g., a cartoon with a bright scenario)
[1652] Specific operation: The server selects a scenario based on emotions and generates a manga by combining characters, settings, and locations.
[1653] Step 6:
[1654] The server provides the generated comic to the user and provides an interface for sharing it with other users.
[1655] Input: Generated comic
[1656] Output: Comic book provided to user, sharing interface
[1657] Specific behavior: The server displays the generated comic to the user and provides a link or button to share it with other users.
[1658] Step 7:
[1659] The server accepts votes from an unspecified number of users and determines the scenario for the next page.
[1660] Input: User votes
[1661] Output: Scenario on next page
[1662] Specific operation: The server tally the votes received within a certain time period and decide the scenario for the next page.
[1663] Step 8:
[1664] The server generates the next page based on the voting results and serves it to the user.
[1665] Input: Voting results
[1666] Output: Comic on the next page
[1667] Specific operation: The server selects the scenario for the next page based on the voting results, generates the manga, and provides it to the user.
[1668] Example 2
[1669] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1670] Conventional manga generation systems have difficulty generating personalized content that reflects user emotions, and have been unable to increase user satisfaction. Furthermore, voting results are determined without taking user emotions into consideration, which can result in results that do not meet user expectations. This leads to issues such as a decline in user engagement and a decrease in the frequency of system use.
[1671] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.
[1672] In this invention, the server includes means for users to generate characters, settings, and settings, means for second and subsequent users to generate one to two pages of manga, means for determining the next page of the generated manga through an unspecified number of votes, means for generating the next page based on the voting results, means for recognizing user emotions, means for adjusting the content of the manga based on the recognized emotions, and means for adjusting the voting results based on the recognized emotions. This makes it possible to generate personalized manga that reflects user emotions and adjust the voting results based on emotions.
[1673] A "user" is an individual or group that uses the system to generate characters, settings, and locations, and create manga.
[1674] "Characters" refers to people, animals, fictional beings, and other characters that appear in manga.
[1675] "Setting" refers to the background information and circumstances of a manga's story or scenario.
[1676] "Setting" refers to the place or environment in which the story of a manga unfolds.
[1677] "Interface" refers to the screen and input means through which a user interacts with a system.
[1678] "Emotion engine" refers to a software or hardware system for recognizing a user's emotions.
[1679] "Emotion" refers to the user's psychological state as recognized from facial expressions, tone of voice, input text, etc.
[1680] A "generative AI model" refers to an artificial intelligence model that automatically generates manga based on user input information.
[1681] "Voting" refers to the act of expressing one's opinion by multiple users to decide the content of the next page.
[1682] "Voting results" refers to the content of the next page determined by users' votes.
[1683] "Personalization" refers to tailoring content based on the characteristics and emotions of individual users.
[1684] "Unspecified large number" refers to a large number of users who are not limited to specific individuals or organizations.
[1685] "Ranking" refers to a format in which the generated manga are ranked and displayed according to their popularity and attention.
[1686] An "organized vote" refers to a group of people with a specific purpose voting all at once.
[1687] "Fraudulent voting" refers to voting that is conducted in a fraudulent manner that undermines the fairness of the system.
[1688] "Copyright" refers to the legal rights in user-generated comics.
[1689] MODE FOR CARRYING OUT THE INVENTION
[1690] This invention is a system that automatically generates a one to two page comic based on information entered by the user, and by combining it with an emotion engine, recognizes the user's emotions and adjusts the content of the comic and voting results based on those emotions.
[1691] Hardware and software used
[1692] Hardware: Servers, user devices (PCs, smartphones, tablets)
[1693] Software: Generative AI models (e.g., OpenAI's GPT-4), emotion engines (e.g., Affectiva's emotion recognition API)
[1694] Specific operation of the system
[1695] 1. Obtaining user input information
[1696] A user accesses the interface using a terminal and inputs a scenario.
[1697] Example: A user enters "The protagonist fights the villain" in the text box and clicks the submit button.
[1698] 2. Emotional Recognition
[1699] The device captures the user's facial expressions and tone of voice through a camera and microphone.
[1700] The device sends the data to an emotion engine for sentiment analysis of the input text.
[1701] The emotion engine analyzes the user's emotions and returns the results to the device.
[1702] Example: The device captures the user's smile and the emotion engine recognizes it as "joy."
[1703] 3. Manga Generation
[1704] The terminal transmits the user's input scenario and emotion data to the server.
[1705] The server uses a generative AI model to generate a manga based on the received scenario and emotion data.
[1706] Example: The server generates a comic with a cheerful scenario based on the scenario "the protagonist fights the enemy" and the emotion data of "joy."
[1707] 4. Adjustment of voting results
[1708] The server aggregates the emotion data of other users.
[1709] The server adjusts the manga scenario to be selected as the next page based on the results of the calculation.
[1710] Example: The server sees that many users are expressing the emotion "joy" and selects a comic with a happy scenario as the next page.
[1711] Examples and prompts
[1712] Examples:
[1713] User A enters "The protagonist fights the enemy" into the terminal and clicks the send button.
[1714] The device captures User A's smile, and the emotion engine recognizes it as "joy."
[1715] The device sends the scenario and emotion data to the server, which then uses a generative AI model to generate a comic with a cheerful scenario.
[1716] The server aggregates the emotion data of other users, and since many users indicate the emotion "joy," a comic with a cheerful scenario is selected as the next page.
[1717] Example prompt sentence:
[1718] "If the user is expressing joy in a scenario where the protagonist is fighting an enemy, generate a cartoon with a cheerful scenario."
[1719] The system enables personalized cartoon generation that reflects user emotions and adjusts voting results based on emotions.
[1720] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1721] Step 1:
[1722] A user accesses the interface using a terminal and inputs a scenario.
[1723] Input: The user enters a scenario into the text box.
[1724] Specific action: The user enters "The protagonist fights the enemy" and clicks the submit button.
[1725] Output: The input scenario is saved to the device.
[1726] Step 2:
[1727] The device captures the user's facial expressions and tone of voice through a camera and microphone.
[1728] Input: The user's facial expressions and tone of voice.
[1729] What it does: The device uses the camera to capture the user's smile and the microphone to record the tone of their voice.
[1730] Output: Captured facial expression and tone of voice data is saved on the device.
[1731] Step 3:
[1732] The device sends the data to an emotion engine for sentiment analysis of the input text.
[1733] Input: User's facial expressions, tone of voice, input text.
[1734] What it does: The device sends facial expressions, tone of voice, and input text to the emotion engine.
[1735] Output: The emotion engine returns the analysis results to the device.
[1736] Step 4:
[1737] The emotion engine analyzes the user's emotions and returns the results to the device.
[1738] Input: Facial expressions, tone of voice, input text.
[1739] Specific behavior: The emotion engine recognizes emotions such as "joy."
[1740] Output: The recognized emotion data is returned to the device.
[1741] Step 5:
[1742] The terminal transmits the user's input scenario and emotion data to the server.
[1743] Input: Scenario, emotion data.
[1744] Specific operation: The device sends the scenario and emotion data to the server.
[1745] Output: The scenario and emotion data are stored on the server.
[1746] Step 6:
[1747] The server uses a generative AI model to generate a manga based on the received scenario and emotion data.
[1748] Input: Scenario, emotion data.
[1749] Specific operation: The server inputs scenario and emotional data into the generative AI model and generates a manga.
[1750] Output: The generated comic is saved on the server.
[1751] Step 7:
[1752] The server aggregates the emotion data of other users.
[1753] Input: Emotion data from other users.
[1754] Specific operation: The server aggregates the emotion data and compiles statistics.
[1755] Output: The aggregated results are saved on the server.
[1756] Step 8:
[1757] The server adjusts the manga scenario to be selected as the next page based on the results of the calculation.
[1758] Input: Aggregation results.
[1759] Specific operation: The server selects the scenario for the next page based on the aggregation results.
[1760] Output: The selected scenario is saved on the server.
[1761] (Application example 2)
[1762] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1763] Conventional manga generation systems have difficulty providing personalized content that reflects the user's emotions. Furthermore, they cannot consider the user's emotions when determining the next page of the generated manga, which hinders the user experience. Furthermore, when sharing the generated manga with other users, the sharing experience is limited because the sharing cannot be based on emotions. These issues need to be resolved.
[1764] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1765] In this invention, the server includes: a means for users to generate characters, settings, and settings; a means for second and subsequent users to generate one or two pages of manga; a means for determining the next page of the generated manga through an unspecified number of votes; a means for generating the next page based on the voting results; and a means for adjusting the generation of the manga and the voting results based on the emotions using an emotion engine that recognizes the user's emotions. This enables personalized manga generation that reflects the user's emotions and adjustment of the voting results based on the emotions. Furthermore, when the generated manga is shared with other users, sharing based on emotions is possible, improving the enjoyment of sharing.
[1766] "Character" refers to people, animals, and fictional beings that appear in stories such as manga and animation.
[1767] "Setting" refers to the information that forms the basis of a story, such as the background and situation of the story, and the relationships between the characters.
[1768] "Setting" refers to the place or environment in which the story unfolds.
[1769] "Manga" refers to a form of media that combines pictures and text to tell a story.
[1770] "Voting" refers to the act of an unspecified number of people expressing their opinion to choose one option from among several options.
[1771] An "emotion engine" refers to technology that recognizes a user's emotions through facial expressions, tone of voice, and emotional analysis of input text.
[1772] "Personalization" refers to customizing content and services to suit the characteristics and preferences of individual users.
[1773] "Sharing" refers to the act of providing information or data to other users in order to enjoy the generated content together.
[1774] A system for implementing this invention includes means for a user to generate characters, settings, and a setting; means for a second or subsequent user to generate a 1-2 page manga; means for determining the next page of the generated manga through an unspecified number of votes; means for generating the next page based on the voting results; and means for adjusting the generation of the manga and the voting results based on the user's emotions using an emotion engine that recognizes their emotions.
[1775] Hardware and software used
[1776] Hardware: Smartphone, head-mounted display
[1777] Software: OpenCV (facial expression recognition), Transformers (sentiment analysis), TextBlob (text sentiment analysis), virtual MangaGenerator library
[1778] Data processing and calculation
[1779] 1. User Emotion Recognition
[1780] The server acquires the user's facial image and recognizes facial expressions using OpenCV. It then analyzes the text entered by the user using the Transformers sentiment analysis model and analyzes the sentiment of the text using TextBlob. These results are then combined to determine the final sentiment.
[1781] 2. Manga Generation
[1782] The server generates a manga using the virtual MangaGenerator library based on the determined emotion and the scenario entered by the user. The manga will have content that matches the user's emotion.
[1783] 3. Adjustment of voting results
[1784] The server collects votes from an unspecified number of users and adjusts the votes based on their emotions. For example, if many users express joy, a comic with a happy story will likely be selected as the next page.
[1785] 4. Sharing the created manga
[1786] The server provides a means for users to share the created comic with other users, allowing users to share and enjoy the comic created based on their own emotions with other users.
[1787] Specific examples
[1788] For example, if a user inputs a scenario in which the protagonist fights the enemy and provides a facial image, the server will recognize the facial expression and emotion in the text and determine that the user is expressing joy. Based on this result, a manga with a cheerful scenario will be generated.
[1789] Prompt Sentence Examples
[1790] Analyze the user's facial image and recognize emotions based on the text input "The hero fights the villain." Generate a comic with a cheerful scenario based on the recognized emotions.
[1791] In this way, personalized cartoons that reflect the user's emotions can be generated, and voting results can be adjusted based on emotions. Furthermore, when the generated cartoons are shared with other users, sharing based on emotions becomes possible, improving the enjoyment of sharing.
[1792] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1793] Step 1:
[1794] The user generates the characters, setting, and setting.
[1795] Users input information about the characters, settings, and stage using a smartphone or head-mounted display. This information is sent to the server. The input data includes the character's appearance, details of the setting, and background information about the stage. The server receives this data and stores it in a database.
[1796] Step 2:
[1797] The second and subsequent users will generate one or two pages of comics.
[1798] Subsequent users generate one to two pages of manga based on the characters, setting, and location created by the previous user. The user inputs a scenario and sends it to the server. The server receives the input scenario and automatically generates a manga using a generative AI model. The generated manga is saved on the server.
[1799] Step 3:
[1800] Recognize user emotions.
[1801] A user uploads a facial image and inputs text. The server uses OpenCV to recognize facial expressions from the facial image and analyzes the sentiment of the text using a Transformers sentiment analysis model. These results are combined to determine the user's sentiment. The input data are the facial image and text, and the output data is the user's sentiment (e.g., happy, sad).
[1802] Step 4:
[1803] Generate cartoons based on emotions.
[1804] The server generates a manga using a virtual MangaGenerator library based on the user's emotions recognized in step 3 and the scenario input in step 2. The input data are the user's emotions and scenario, and the output data is the generated manga. The generated manga is saved on the server.
[1805] Step 5:
[1806] The next page of the generated manga will be decided by an unspecified number of votes.
[1807] The server publishes the generated manga and accepts votes from an unspecified number of users. Voting takes place within a certain time period (for example, one hour). The input data are votes from users, and the output data are the voting results.
[1808] Step 6:
[1809] Generate the next page based on the voting results.
[1810] The server tally the voting results and generate the next page. Based on the voting results, the generative AI model is used to automatically generate the next page of manga. The input data is the voting results, and the output data is the next page of manga. The generated manga is saved on the server.
[1811] Step 7:
[1812] Share the generated comic with other users.
[1813] The server provides a means for users to share the generated comics with other users. Users can share and enjoy the generated comics with other users. The input data is the generated comics, and the output data is the shared comics.
[1814] Example 3
[1815] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1816] Conventional manga generation systems lacked features such as determining the next page based on user votes, displaying voting results in real time, displaying rankings, preventing fraudulent voting, and generating manga based on user sentiment, limiting the user experience. Furthermore, copyright issues regarding user-generated manga remained unresolved. This made it difficult for users to actively participate and generate personalized content.
[1817] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.
[1818] In this invention, the server includes: a means for users to generate characters, settings, and settings; a means for second and subsequent users to generate one or two pages of manga; a means for determining the next page of the generated manga through an unspecified number of votes; a means for generating the next page based on the voting results; a means for tallying and displaying the voting results in real time; a means for displaying the popularity and attention of the generated manga in a ranking format; a means for preventing fraudulent voting through organized voting; a means for recognizing user emotions and adjusting manga generation and voting results based on the emotions; and a means for relinquishing copyright to manga generated by users. This allows users to generate the next page while checking the voting results in real time, and to create new manga based on the rankings. It also prevents fraudulent voting and enables personalized manga generation based on user emotions.
[1819] "Characters" refers to people, animals, and fictional beings that appear in manga and animation.
[1820] "Setting" refers to the elements that determine the background and situation of a story, the relationships between characters, etc.
[1821] "Setting" refers to the place or environment in which the story unfolds.
[1822] "Manga" refers to a form of media that combines pictures and text to tell a story.
[1823] "Voting" refers to the act of a user selecting one of the options and submitting that selection to the system.
[1824] "Unspecified majority" refers to a large number of people who are not limited to a specific individual or group.
[1825] "Real-time" means that data and information are processed immediately and displayed without delay.
[1826] "Ranking" refers to the ranking of items based on specific criteria.
[1827] "Fraudulent voting" refers to voting that goes against the rules of the system.
[1828] "Emotions" refer to human psychological reactions and feelings.
[1829] "Copyright" refers to the right of an author in a creative work.
[1830] "Personalization" refers to customizing to suit the characteristics and preferences of individual users.
[1831] This invention is a system in which a user creates characters, settings, and a stage, and the next page is decided by an unspecified number of votes. A specific embodiment for implementing this system is described below.
[1832] The server provides an interface for users to create characters, settings, and locales. This interface is accessible through a web browser, and users can freely customize the appearance and personality of their characters, as well as the setting and locale of their stories.
[1833] Next, we provide a means for subsequent users to create one or two pages of manga. Users can create new pages based on existing characters and settings. In this case, users can position characters and enter text using simple drag-and-drop operations.
[1834] The next page of the generated manga is decided by a vote of an unspecified number of users. Users choose one of several scenario options on the website and vote. Voting takes place within a certain time period (for example, one hour), and the next page is generated based on the results.
[1835] The server tallies the voting results in real time and displays them on the website, allowing users to check the current voting status in real time. The voting results are updated in real time using WebSocket and displayed using React.
[1836] The server then displays the popularity and attention of the generated manga in a ranking format. The ranking is calculated based on data such as the number of votes and views, and the data is searched using Elasticsearch and visualized using D3.js.
[1837] To prevent fraudulent voting, the server limits the number of votes from the same IP address within a certain period of time, and uses a Python script to detect abnormal voting patterns and prevent fraudulent voting.
[1838] Furthermore, the server uses an emotion engine to recognize the user's emotions and adjusts the cartoon generation and voting results accordingly. The emotion engine uses OpenCV to analyze the user's facial expressions and TensorFlow to recognize emotions. It also uses NLTK to perform sentiment analysis of the input text. If the user expresses joy, a cartoon with a cheerful scenario is generated.
[1839] As a concrete example, a user accesses a website and votes for scenarios A, B, and C for the next page. When the voting time is over, the server selects the scenario with the most votes as the next page. The voting results are displayed in real time, and the user can view them to generate the next page. Furthermore, a ranking function displays the currently most popular comics. An emotion engine recognizes the user's emotion of joy, and generates a comic with a cheerful scenario.
[1840] An example of a prompt is as follows:
[1841] "Please choose a scenario on the next page. Scenario A: The protagonist encounters a new enemy. Scenario B: The protagonist reunites with friends. Scenario C: The protagonist discovers a new ability."
[1842] In this way, the user can create a more personalized manga based on his or her own feelings and voting results. The flow of the specification process in the third embodiment will be described with reference to FIG.
[1843] Step 1:
[1844] A user visits a website.
[1845] A user uses a browser to enter a website URL and the homepage is displayed. The input is the website URL, and the output is the display of the homepage. Specifically, a user opens a browser such as Google Chrome or Firefox and enters the website URL (e.g., www.mangavote.com). The homepage is displayed, and the user can check the current voting status and rankings.
[1846] Step 2:
[1847] The user generates the characters, setting, and setting.
[1848] Users use a website interface to customize their character's appearance, personality, and story setting and setting. The input is the user's selections and input data, and the output is the generated character, setting, and setting. Specifically, users use drag-and-drop operations and text input to customize their character's appearance and personality.
[1849] Step 3:
[1850] The second and subsequent users will generate one or two pages of comics.
[1851] The user creates a new page based on existing characters and settings. The input is the existing characters, settings, and user operation data, and the output is the generated manga page. Specifically, the user places the characters using drag-and-drop operations and enters text.
[1852] Step 4:
[1853] Users vote for the scenario on the next page of the manga.
[1854] A user goes to a voting page on a website, selects one of several scenario options, and clicks the "Vote" button. The input is the user's scenario selection data, and the output is a voting completion message. Specifically, the user selects one of Scenario A, Scenario B, or Scenario C, and clicks the "Vote" button.
[1855] Step 5:
[1856] The server tally and display the voting results in real time.
[1857] The server receives voting data from users and stores it in a database. It uses WebSocket to tally the voting results in real time and display them on the website. The input is the user's voting data, and the output is the voting results, which are updated in real time. Specifically, the server stores the voting data in a MySQL database and displays the voting results using React.
[1858] Step 6:
[1859] The server closes the voting after a certain time, and the scenario with the most votes is adopted as the next page.
[1860] The server will automatically close voting when the voting time has ended. The scenario with the most votes will be adopted as the next page, and the results will be displayed on the website. The input is the voting data at the time voting ended, and the output is a display of the scenario that was adopted as the next page. In concrete terms, the server will automatically close voting when the voting time has ended, and the scenario with the most votes will be adopted as the next page.
[1861] Step 7:
[1862] The server calculates and displays the rankings.
[1863] The server calculates rankings based on data such as the number of votes and views. It uses Elasticsearch to search the data and D3.js to visualize the rankings. The input is the number of votes and views data, and the output is the display of the rankings. Specifically, the server uses Elasticsearch to search the data and D3.js to visualize the rankings.
[1864] Step 8:
[1865] The server detects and prevents voter fraud.
[1866] The server limits the number of votes from the same IP address within a certain period of time. It also uses a Python script to detect abnormal voting patterns and prevent fraudulent voting. The input is voting data, and the output is the detection and prevention of fraudulent voting. Specifically, the server uses Nginx to limit the number of votes from the same IP address and a Python script to detect abnormal voting patterns.
[1867] Step 9:
[1868] The server uses an emotion engine to recognize the user's emotions and adjusts the manga generation and voting results.
[1869] The server uses OpenCV to analyze the user's facial expression and TensorFlow to recognize emotions. It also uses NLTK to perform sentiment analysis on the input text. The input is the user's facial expression data and input text, and the output is generating a cartoon based on the emotion and adjusting the voting results. Specifically, the server captures the user's facial expression with a camera, analyzes it with OpenCV, and recognizes emotions with TensorFlow. It also performs sentiment analysis on the text entered by the user with NLTK.
[1870] (Application example 3)
[1871] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1872] Conventional manga generation systems have difficulty generating personalized content that reflects user emotions, and they are prone to distortion of results due to voting fraud and have difficulty displaying voting results in real time. Furthermore, they lack a means to effectively display the popularity and attention of the generated manga, making it difficult to maintain user interest.
[1873] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.
[1874] In this invention, the server includes means for users to generate characters, settings, and settings, means for second and subsequent users to generate one or two pages of manga, means for determining the next page of the generated manga through an unspecified number of votes, means for generating the next page based on the voting results, means for recognizing users' emotions, means for generating manga based on the recognized emotions, means for displaying voting results in real time, means for displaying popularity and attention in a ranking format, means for preventing fraudulent voting through organized voting, and means for relinquishing copyright of manga generated by users. This enables the generation of personalized manga that reflects users' emotions, the display of voting results in real time, the prevention of fraudulent voting, and the effective display of popularity and attention.
[1875] "Characters" refers to people, animals, and fictional beings that appear in manga and animation.
[1876] "Setting" refers to the elements that determine the background and situation of a story, the relationships between characters, etc.
[1877] "Setting" refers to the place or environment in which the story unfolds.
[1878] "Manga" refers to a form of media that combines pictures and text to tell a story.
[1879] "Voting" refers to the act of a user selecting one of the options and having the results tallied.
[1880] "Emotion recognition" refers to technology that determines emotions from a user's facial expressions, tone of voice, text input, etc.
[1881] "Real time" refers to processing and display occurring immediately in the current running time.
[1882] "Ranking" refers to placing things in a certain order based on certain criteria.
[1883] "Fraudulent voting" refers to voting that is conducted in a fraudulent manner that undermines the fairness of the system.
[1884] "Copyright" refers to the legal right that protects an author's rights in a creative work.
[1885] A system for implementing this invention allows a user to create characters, settings, and a setting, and then a second or subsequent user can create one or two pages of manga. The next page of the generated manga is determined by an unspecified number of votes, and the next page is generated based on the voting results. Furthermore, emotion recognition means can be used to recognize the emotions of users, and manga can be generated based on the recognized emotions. Furthermore, voting results can be displayed in real time, and popularity and attention can be displayed in a ranking format. The system also includes means for preventing fraudulent voting and means for users to waive copyright on manga they have created.
[1886] Hardware and software used
[1887] Hardware: Smartphone (camera, microphone, internet connection)
[1888] Software: Flask (Python web framework), EmotionEngine (emotion recognition engine), MangaGenerator (manga generation engine), VoteSystem (voting system)
[1889] Data processing and calculation
[1890] 1. Emotion recognition:
[1891] The user provides a facial image and audio clip using the smartphone's camera and microphone.
[1892] The server uses the EmotionEngine to recognize emotions from the user's facial expressions, voice tone, and text input.
[1893] Model used: EmotionEngine (facial expression recognition, speech tone analysis, text sentiment analysis)
[1894] 2. Manga generation:
[1895] Based on the recognized emotion, the server generates the next manga page using MangaGenerator.
[1896] Model used: MangaGenerator (generative AI model)
[1897] 3. Voting System:
[1898] Users can vote for the generated comic pages.
[1899] The server uses VoteSystem to manage the votes and display the results in real time.
[1900] Model used: VoteSystem (voting management system)
[1901] 4. Ranking display:
[1902] The server calculates the ranking based on the number of votes and views and displays it to the user.
[1903] Specific examples
[1904] Users open the app on their smartphones and provide a facial image and audio clip to generate the next page of the comic. The emotion engine recognizes the user's emotion as "joy" and generates a comic page with a brighter scenario. Users can vote for the generated page and see the results in real time.
[1905] Prompt Sentence Examples
[1906] Recognize emotions using the user's facial image, audio clip, and text input, and generate the next manga page based on that emotion. Allow users to vote on the generated pages and display the voting results in real time. Also, add a function to display rankings based on the number of votes and views, and prevent voter fraud.
[1907] The above is an embodiment of the present invention.
[1908] The flow of the specific processing in Application Example 3 will be described with reference to FIG.
[1909] Step 1:
[1910] The user launches the app on their smartphone and generates characters, settings, and a stage.
[1911] Input: User selection (character, setting, location)
[1912] Output: Generated character, setting, and locale data
[1913] How it works: The user selects the character, setting, and location through the app interface, then presses the generate button. The device then sends this data to the server.
[1914] Step 2:
[1915] The second and subsequent users will generate one or two pages of comics.
[1916] Input: Generated character, setting, and location data
[1917] Output: Generated comic page data
[1918] Specific operation: The server provides an interface that allows users to generate manga pages based on the received character, setting, and stage data. The user uses this interface to create manga pages and send them to the server.
[1919] Step 3:
[1920] The next page of the generated manga will be decided by an unspecified number of votes.
[1921] Input: Manga page candidates generated by multiple users
[1922] Output: Next page of data selected based on voting results
[1923] Specific operation: The server displays manga page candidates generated by multiple users and provides a voting interface. Users cast their votes, and the server tally the results.
[1924] Step 4:
[1925] Generate the next page based on the voting results.
[1926] Input: Voting results
[1927] Output: Next page of manga data
[1928] Specific operation: Based on the voting results, the server determines the manga page with the most votes as the next page and displays it to the user.
[1929] Step 5:
[1930] An emotion recognition means is used to recognize the emotions of the user.
[1931] Input: User's face image, audio clip, text input
[1932] Output: Recognized emotion data
[1933] How it works: Users use their smartphone's camera and microphone to provide facial images and audio clips, and input text. The server uses the EmotionEngine to recognize emotions from these data.
[1934] Step 6:
[1935] Generate cartoons based on recognized emotions.
[1936] Input: Recognized emotion data
[1937] Output: Manga page data based on emotions
[1938] Specific operation: Based on the recognized emotion data, the server uses MangaGenerator to generate a manga page that matches the emotion.
[1939] Step 7:
[1940] View voting results in real time.
[1941] Input: Voting result data
[1942] Output: Real-time voting results
[1943] Specific operation: The server updates the voting results in real time and displays them on the user's device.
[1944] Step 8:
[1945] Popularity and attention are displayed in ranking format.
[1946] Input: Votes, views data
[1947] Output: Ranking display data
[1948] Specific operation: The server calculates the ranking based on the number of votes and views and displays it on the user's device.
[1949] Step 9:
[1950] Prevent fraudulent voting through organized voting.
[1951] Input: Voting data, IP address data
[1952] Output: Restricted data to prevent voter fraud
[1953] Specific operation: The server limits the number of votes from the same IP address within a certain period of time to prevent fraudulent voting.
[1954] Step 10:
[1955] You waive copyright on user-generated comics.
[1956] Input: User consent data
[1957] Output: Copyright disclaimer confirmation data
[1958] Specific behavior: When creating a manga, the user selects a checkbox agreeing to the copyright waiver, and the server records that agreement.
[1959] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1960] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1961] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.
[1962] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1963] [Third embodiment]
[1964] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1965] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[1966] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1967] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1968] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1969] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1970] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1971] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1972] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1973] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1974] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1975] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.
[1976] "Example 1"
[1977] In one embodiment of the present invention, a website is provided that operates on the Internet and provides an interface for users to create characters, settings, and settings, including a form for inputting information such as the character's name, personality, and appearance, and options for setting the setting's location, time, and situation.
[1978] "Example 2"
[1979] Subsequent users use an interface to generate a one- or two-page manga. This interface uses AI technology to automatically generate a manga based on the information entered by the user. For example, if a user enters a scenario in which the protagonist fights an enemy, a manga based on that scenario will be generated.
[1980] "Example 3"
[1981] The next page of the generated manga is decided by voting from an unspecified number of users. Voting takes place on the website, and the manga that receives the most votes within a certain period of time (for example, one hour) is adopted as the next page. The voting results are displayed in real time on the website, and users generate the next page based on the voting results.
[1982] "Example 4"
[1983] The app also provides a function that displays the popularity and attention of the created manga in a ranking format. The ranking is calculated based on indicators such as the number of votes and views, and users can use the ranking as a reference when creating new manga.
[1984] "Example 5"
[1985] Furthermore, it also provides a function to prevent fraudulent voting by organized votes. For example, it prevents fraudulent voting by limiting the number of votes from the same IP address within a certain period of time. It also sets out terms for users to waive copyright on the manga they create, and requires users to agree to these terms when creating manga.
[1986] The processing flow of each embodiment will be described below.
[1987] "Example 1"
[1988] Step 1: The user visits the provided website.
[1989] Step 2: On the website, the user uses an interface to generate characters, settings, and settings, including a form to input information such as the character's name, personality, and appearance, and options to set the setting's location, time, and situation.
[1990] Step 3: Once the user has finished entering the information, it is sent to the server and stored in a database.
[1991] "Example 2"
[1992] Step 1: Subsequent users use the interface to generate a 1-2 page comic.
[1993] Step 2: The user inputs a scenario, and the AI automatically generates a manga based on that scenario.
[1994] Step 3: The resulting comic is then made publicly available to other users on the website and is subject to voting.
[1995] "Example 3"
[1996] Step 1: The next page of the generated manga is decided by voting from an unspecified number of users.
[1997] Step 2: Voting takes place on the website, and the cartoon that receives the most votes within a certain time period (for example, one hour) is selected as the next page.
[1998] Step 3: The voting results are displayed in real time on the website, and the user generates the next page based on the voting results.
[1999] "Example 4"
[2000] Step 1: We also provide a function to display the popularity and attention of the generated manga in a ranking format.
[2001] Step 2: Rankings are calculated based on indicators such as the number of votes and views, and users can use the rankings as a reference to create new manga.
[2002] "Example 5"
[2003] Step 1: We also provide functions to prevent fraudulent voting through organized voting.
[2004] Step 2: Prevent fraudulent voting by limiting the number of votes from the same IP address within a certain period of time.
[2005] Step 3: Establish terms and conditions for waiving copyright on user-generated comics, and require users to agree to these terms when generating comics.
[2006] Example 1
[2007] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[2008] Previous character and setting generation systems required users to manually configure detailed settings, which was time-consuming and labor-intensive. Furthermore, there were limited ways to incorporate user input into decisions about the next development of generated content. Furthermore, there was a lack of effective ways to display the popularity and attention of generated content.
[2009] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[2010] In this invention, the server includes a means for users to generate characters, settings, and settings; a means for generating prompt sentences based on the generated characters and settings; a means for sending prompt sentences to a generative AI model and receiving responses; a means for displaying the received responses to the user; a means for a second or subsequent user to generate one or two pages of manga; a means for determining the next page of the generated manga through an unspecified number of votes; and a means for generating the next page based on the voting results. This allows users to easily generate characters and settings and enjoy stories and manga based on them. Furthermore, the server can determine the next development based on user opinions, and effectively display the popularity and attention of the generated content.
[2011] "User" means an individual or group that uses the system to generate characters, settings, and stages, and to view or operate the generated content.
[2012] "Character" refers to setting information such as people, animals, and fictional beings that appear in stories and manga.
[2013] "Setting" refers to detailed information such as the character's personality and appearance, background information, the setting, time, and situation of the story.
[2014] "Setting" refers to the setting, such as the place, environment, and time period in which a story or manga unfolds.
[2015] A "prompt sentence" refers to a sentence that is sent to a generative AI model based on character and setting information entered by the user.
[2016] A "generative AI model" refers to an artificial intelligence model that generates a response based on a prompt entered by a user.
[2017] A "response" refers to a sentence or part of a story that a generative AI model generates based on a prompt.
[2018] "Voting" refers to the act of a user expressing their opinion to determine the development of the next page of the generated comic.
[2019] "Unspecified majority" refers to many users who are not limited to specific individuals or organizations.
[2020] "Popularity" refers to an index showing how many users support the generated content.
[2021] "Attention" refers to an index showing how many users are interested in the generated content.
[2022] "Ranking format" refers to a format in which generated content is ranked and displayed based on popularity or attention.
[2023] "Organized voting" refers to voting behavior carried out by a specific group or organization in order to intentionally manipulate the voting results.
[2024] "Voting fraud" refers to fraudulent voting practices that undermine the fairness of the system.
[2025] "Copyright" refers to the legal rights you have in your User Generated Content.
[2026] "Abandonment" refers to the act of a user voluntarily abandoning copyright and making the work freely available to others.
[2027] This invention is a system that provides a website that users can access over the Internet, through which they can create characters, settings, and locations and enjoy stories and comics based on them.
[2028] Servers host websites and process user requests. Specifically, servers use the following hardware and software:
[2029] Hardware: Use a server machine with a high-performance processor, sufficient memory, and fast storage. For example, use a server with an Intel Xeon processor, 32GB or more of RAM, and SSD storage.
[2030] Software: The server uses web server software (e.g., Apache or Nginx), a database management system (e.g., MySQL or MongoDB), and a generative AI model (e.g., OpenAI's GPT-3).
[2031] When a user accesses a website, the server returns a webpage created using HTML, CSS, and JavaScript. This webpage contains a form for entering character and setting information. The user fills in the provided form with information such as the character's name, personality, appearance, setting location, time, and situation.
[2032] When the user submits the form, the server receives the data and stores it in a database. The server checks the data for integrity and converts the data if necessary. The server then generates a prompt based on the information the user entered. For example, it might generate a prompt like this:
[2033] Example prompt sentence:
[2034] The character's name is Alice. She is a brave, blonde girl. The setting is a magical forest, the time is night, and the situation is the beginning of an adventure. Generate a story of Alice's adventure based on this setting.
[2035] The server sends this prompt to the generative AI model, which then generates a response based on the prompt, such as "Alice went deep into the enchanted forest and found a mysterious light in the silence of the night."
[2036] The server receives the response from the generative AI model and displays it to the user, who can then view the generated story on a web page.
[2037] Furthermore, a means is provided for subsequent users to generate one or two pages of a manga. The next page of the generated manga is decided by a vote of an unspecified number of users. Voting takes place within a certain time period (for example, one hour), and the next page is generated based on the results.
[2038] The popularity and attention of the generated manga are displayed in a ranking format, and measures are included to prevent fraudulent voting by organized votes. Users are also provided with a means to waive copyright on the manga they generate.
[2039] In this way, users can easily create characters and settings and enjoy stories and comics based on them. Furthermore, the next development of the story can be determined based on the user's opinions, and the popularity and attention of the created content can be effectively displayed.
[2040] The flow of the identification process in the first embodiment will be described with reference to FIG.
[2041] Step 1:
[2042] A user visits a website.
[2043] Input: The user accesses the specified URL using a browser.
[2044] Output: The server returns a web page.
[2045] How it works: A user enters the URL of a website using a browser such as Google Chrome or Mozilla Firefox, and accesses it. The server receives the request and returns a web page created using HTML, CSS, and JavaScript to the user's browser.
[2046] Step 2:
[2047] The server provides the interface.
[2048] Input: The access request from the user.
[2049] Output: A web page containing a form for entering character and setting information.
[2050] Specific operation: When accessed by a user, the server provides a web page containing a form for entering information such as the character's name, personality, appearance, setting location, time, situation, etc. To do this, the form is created using HTML and CSS, and user input is validated in real time using JavaScript.
[2051] Step 3:
[2052] The user inputs character and setting information.
[2053] Input: Information entered by the user into a form, such as the character's name, personality, appearance, location, time, and situation.
[2054] Output: The data entered into the form.
[2055] Specific actions: In the provided form, the user enters "Alice" as the character's name, "Brave" as the personality, "Blonde Girl" as the appearance, "Enchanted Forest" as the setting, "Night" as the time, and "The Beginning of the Adventure" as the situation.
[2056] Step 4:
[2057] The server receives and stores the input data.
[2058] Input: The form data submitted by the user.
[2059] Output: Data stored in a database.
[2060] What happens: When a user submits a form, the server receives the data and stores it in a database (e.g., MySQL or MongoDB). The server verifies the integrity of the data and converts it if necessary.
[2061] Step 5:
[2062] The server sends a prompt to the generative AI model.
[2063] Input: Character and setting information entered by the user.
[2064] Output: The prompt sent to the generative AI model.
[2065] Specific operation: The server generates a prompt based on the information entered by the user. For example, it creates a prompt like, "The character's name is Alice. She is a brave, blonde girl. The setting is a magical forest, the time is night, and the situation is the beginning of the adventure. Please generate a story about Alice's adventure based on this setting." The server then sends this prompt to the generative AI model.
[2066] Step 6:
[2067] A generative AI model generates a response.
[2068] Input: The prompt text sent by the server.
[2069] Output: The generated response (part of the story).
[2070] How it works: The generative AI model generates a response based on a prompt sent from the server, such as a part of a story like "Alice went deep into the enchanted forest and found a mysterious light in the silence of the night."
[2071] Step 7:
[2072] The server displays the generated response to the user.
[2073] Input: The response returned by the generative AI model.
[2074] Output: The story that is displayed in the user's browser.
[2075] Specific operation: The server receives the response from the generative AI model and displays it to the user, who can then view the generated story on a web page.
[2076] Step 8:
[2077] The second and subsequent users will generate one or two pages of comics.
[2078] Input: Manga content entered by the second and subsequent users.
[2079] Output: A generated 1-2 page comic.
[2080] Specific operation: The second and subsequent users use the interface to generate a one- to two-page manga based on the generated story. The user sets the character movements, dialogue, background, etc., and generates the manga.
[2081] Step 9:
[2082] The next page of the generated manga will be decided by an unspecified number of votes.
[2083] Input: Votes from a random number of users.
[2084] Output: The content of the next page, determined based on the voting results.
[2085] Specific operation: The server accepts votes from an unspecified number of users to decide the development of the next page of the generated manga. Voting takes place within a certain time period (for example, one hour), and the next page is generated based on the results.
[2086] Step 10:
[2087] The server displays the popularity and attention of the generated manga in a ranking format.
[2088] Input: Data about the popularity and attention of the generated manga.
[2089] Output: Popularity and attention displayed in ranking format.
[2090] Specific operation: The server collects data such as user ratings and number of views to generate rankings and display the popularity and attention of the generated manga in a ranking format. Users can check which manga are popular or attracting attention by viewing the rankings.
[2091] Step 11:
[2092] The server prevents fraudulent voting through organized voting.
[2093] Input: Voting data.
[2094] Output: Voting results with fraud prevented.
[2095] Specific operation: The server analyzes the voting data and uses an algorithm to detect fraudulent voting by organized voting. If fraudulent voting is detected, the server invalidates the vote to maintain fair voting results.
[2096] Step 12:
[2097] You waive copyright on user-generated comics.
[2098] Input: User's copyright waiver.
[2099] Output: A copyright-free manga.
[2100] Specific operation: The user selects an option to waive the copyright of the manga they have created. The server receives the user's consent and records that the copyright has been waived. This allows other users to freely use the manga.
[2101] (Application example 1)
[2102] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[2103] Conventional character and setting generation systems lacked the means to effectively utilize user-generated content and share it with a wide range of users. Furthermore, there was insufficient means to visualize the popularity and attention of generated content, making it difficult to maximize user creativity. Furthermore, there was a lack of a mechanism to reflect the opinions of an unspecified number of users in the generated content and progress it, making interactive content generation difficult.
[2104] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[2105] In this invention, the server includes: a means for users to generate characters, settings, and settings; a means for second and subsequent users to generate one or two pages of manga; a means for determining the next page of the generated manga through an unspecified number of votes; a means for automatically generating a short story based on information entered by the user using a generative AI model; a means for sharing the generated story to a content distribution platform; a means for displaying the popularity and attention of the generated manga in a ranking format; a means for preventing fraudulent voting through organized voting; a means for relinquishing copyright to the manga generated by the user; and a means for sharing the generated story on a social networking site. This enables effective utilization of user-generated content and sharing it with a wide range of users. Furthermore, by visualizing the popularity and attention of the generated content, user creativity can be maximized. Furthermore, by providing a mechanism for progressing content by reflecting the opinions of an unspecified number of users, interactive content generation becomes possible.
[2106] "User" means an individual or group that uses the system to generate characters, settings, and locations, and to create content.
[2107] A "character" is a character created by a user, and has attributes such as a name, personality, and appearance.
[2108] "Setting" refers to the environment or situation in which a character exists, and includes elements such as place, time, and situation.
[2109] "Setting" refers to the specific place and time background in which the characters act.
[2110] A "generative AI model" is an artificial intelligence algorithm that automatically generates short stories based on information entered by the user.
[2111] A "prompt" is an instruction to be input into a generative AI model, and includes information about the characters and setting set by the user.
[2112] A "content distribution platform" is an online service that allows users to share created stories and comics with a wide range of users.
[2113] A "vote" is an expression of opinion made by an unspecified number of users to decide the next page of the generated manga.
[2114] "Ranking format" is a method of displaying the generated manga in order of popularity and attention.
[2115] "Fraudulent voting" is the act of manipulating voting results using fraudulent means such as organizing votes.
[2116] "Means for Relinquishing Copyright" refers to the methods for relinquishing copyright to user-generated comics and stories.
[2117] "SNS" stands for Social Networking Service, an online platform for sharing user-generated stories.
[2118] The system for implementing this invention allows a user to create characters, settings, and locations, and then create short stories or comics based on those settings. A specific embodiment of this system will be described below.
[2119] System Configuration
[2120] The system consists of the following main components:
[2121] 1. User terminal: A device (e.g., smartphone, tablet, PC) through which a user inputs characters, settings, and settings.
[2122] 2. Server: A central processing unit that receives input from users, generates short stories using generative AI models, and shares them on content distribution platforms.
[2123] 3. Generative AI model: An artificial intelligence algorithm that automatically generates short stories based on user-entered information (e.g., OpenAI's GPT-3).
[2124] 4. Content distribution platform: Online services (e.g., social networking sites, blogging platforms) for sharing generated stories and comics with a wide range of users.
[2125] Program processing
[2126] User terminal
[2127] The user terminal provides an interface for the user to input information about the characters, settings, and stage, such as the character's name, personality, appearance, stage location, time, and situation.
[2128] server
[2129] The server receives the information sent by the user and sends it as a prompt to the generative AI model. The generative AI model generates a short story based on the prompt and returns the result to the server. The server then sends the generated story to the user's device and displays it to the user. The server also has the function of sharing the generated story on a content distribution platform.
[2130] Generative AI Models
[2131] The generative AI model automatically generates a short story based on user-entered information, specifically using prompts like the following:
[2132] Example prompt sentence:
[2133] Character's Name: Alice
[2134] Personality: Brave and curious
[2135] Setting: Future city
[2136] Plot: Alice discovers new technology and goes on adventures with it.
[2137] Use this information to generate a short story.
[2138] The generative AI model generates a short story based on this prompt and returns the result to the server.
[2139] Specific examples
[2140] For example, if a user creates a character named "Alice" and sets her personality as "brave and curious," the setting as "a futuristic city," and the plot as "Alice discovers new technology and uses it to go on an adventure," the generative AI model will use this information to generate a short story that can be displayed on the user's device and shared on social media or blog platforms.
[2141] In this way, users can easily set up characters and settings, use generative AI models to generate short stories, and share them with a wide audience.
[2142] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[2143] Step 1:
[2144] The user uses a terminal to input information about the characters, setting, and location.
[2145] In...
Claims
1. A setting providing means for providing an interface for a specific first user to set characters, settings, and a stage of a comic; A creating and providing means for providing an interface for a specific second user, other than the first user, to create a manga including the set characters, setting, and stage in a specific page; A generating means for generating a manga story including the set characters, setting, and stage on a specific page by inputting a specific prompt sentence generated based on information input by a second user into a generating AI model; A reflection means for receiving opinions contained in votes from an unspecified number of users within a certain period of time and reflecting said opinions in the subsequent development of the story of the created manga; An emotion engine that recognizes the emotion of a user who has read the comic; means for adjusting the deployment based on the emotion; A system including:
2. 2. The system of claim 1, further comprising means for restricting said voting from the same IP address within a certain period of time.
3. The system according to claim 1 , further comprising a means for calculating a ranking of the manga based on the number of votes and views of users who have read the manga, and displaying the ranking on a terminal of the user.
Citation Information
Patent Citations
System and program for evaluating work
JP2002183375A
Server device and program
JP2015060365A
Providing device, providing method, and providing program
JP2018195086A
Cartoon image automatic generation device based on input sentence and method
JP2022041990A
Device and method for automatically creating cartoon image based on input sentence
US20220067996A1