System

Abstract

A system is provided.SOLUTION: The system includes means for inputting information, means for transmitting the input information to a server, means for generating a plot based on the information received by the server, means for automatically generating an illustration based on the generated plot, means for storing the illustration in a cloud storage, means for browsing the stored illustration via a dedicated application, and means for preventing the dedicated application from copying or screenshotting the illustration.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Many users are eager to create doujinshi, but the process requires specialized knowledge, time, and effort. For users who lack confidence in their illustration skills, the process can be a major hurdle. For this reason, a system is needed that allows anyone to easily create high-quality doujinshi. Furthermore, because there is a risk of copyright infringement when publishing doujinshi, a system with appropriate preventative measures is needed. [Means for solving the problem]

[0005] To solve the above problems, the present invention provides the following means. A means is provided for users to input information about the original work and their preferred situations, and the input information is sent to a server. The server generates a plot based on the received information and automatically generates illustrations based on that plot. The generated illustrations are stored in cloud storage and can only be viewed via a dedicated app. The dedicated app also has a means for preventing the illustrations from being copied or screenshotted. The present invention also provides a means for users to upload their own drawings, and the style of the uploaded drawings is analyzed and reflected in illustrations on other pages. Furthermore, the present invention includes an access control means for sending information to the server using a secure communication protocol and allowing only specific user IDs to access the illustrations.

[0006] "Means for inputting information" refers to a device or software that provides an interface for users to input information such as the title of the original work or their preferred situation.

[0007] The "means for transmitting input information to the server" refers to the communication protocol and network connection system that allows the terminal to pass the user's input information to the server.

[0008] "Means for generating a plot based on information received by the server" refers to a system that uses an AI engine and database within the server to automatically construct the content of a story based on the information received from the user.

[0009] The "means for automatically generating illustrations based on a generated plot" is a digital drawing system that uses AI technology to automatically create character and background illustrations that fit the content of the generated story.

[0010] "Means for saving illustrations in cloud storage" refers to a system for saving generated digital illustrations in a database or storage on the cloud.

[0011] "Means for viewing saved illustrations via a dedicated application" refers to an interface that allows users to access and view illustrations in cloud storage using a dedicated application.

[0012] "Measures by the dedicated application to prevent the duplication or taking of screenshots of illustrations" refers to a security function that prevents the unauthorized duplication or taking of screenshots of illustrations within the dedicated application.

[0013] "Means for uploading drawings by users" refers to an upload function that allows users to send illustrations they have drawn from their own devices to the server.

[0014] The "means for analyzing the style of uploaded artwork" is a system that uses AI technology to analyze the characteristics and style of artwork uploaded by users.

[0015] "Means for reflecting the artistic style in illustrations on other pages" is an adjustment function that applies the same style when generating illustrations on other pages based on the analyzed characteristics of the artistic style.

[0016] "Means of sending to a server using a secure communication protocol" refers to a means of communication that uses an encryption protocol such as TLS or HTTPS so that information is securely sent to the server.

[0017] "Access control means that allows only specific user IDs to access illustrations" is a security function that allows only specific users to access illustrations in cloud storage through user authentication and authority management. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2]1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0019] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0020] First, the terms used in the following description will be explained.

[0021] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0022] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0023] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0024] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0026] [First embodiment]

[0027] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0028] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0030] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0031] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0034] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0035] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0037] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0038] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0039] The present invention is a system that can automatically generate high-quality doujinshi by users by inputting the title of the original work and their preferred situation. This system operates in cooperation with a server, terminals, and users.

[0040] The system of the present invention is configured as follows:

[0041] 1. The stage where the user inputs information about the original work and the situation

[0042] The user launches a dedicated application and selects to create a new doujinshi.

[0043] The user inputs the "original title" and "preferred situation" and confirms it.

[0044] The device sends the entered information to the server, using a secure communication protocol (e.g., HTTPS) to ensure the safety of the data.

[0045] 2. The server analyzes the input and generates the plot.

[0046] The server receives input data from the user and the AI ​​engine analyzes the information.

[0047] The AI ​​engine references the database based on the "original title" and generates a plot for the "situation" specified by the user.

[0048] For example, if a user inputs "magical girl anime, school festival episode," the server's AI will create a storyline that suits this.

[0049] 3. Automatically generate illustrations

[0050] The server's AI automatically draws characters and backgrounds based on the generated plot.

[0051] For example, this includes the background and stage of the school festival scene, and the costumes of specific characters.

[0052] 4. Uploading user's artwork and analyzing its style

[0053] Users upload their own drawings using a dedicated app.

[0054] The device sends the uploaded data to the server.

[0055] Based on the image received by the server, the AI ​​analyzes the style of the artwork and reflects this style in the illustrations on other pages.

[0056] 5. Preserving Doujinshi and Restricting Access

[0057] The server stores the generated doujinshi in cloud storage.

[0058] At the same time, doujinshi will only be viewable using a dedicated app, and the app will be equipped with security features to prevent screenshots and duplication.

[0059] For example, if a user enters the information "Original work: magical girl anime, Situation: battle scene," the following process takes place. When the user enters the information and sends it from their device to the server, the server's AI generates a plot for the battle scene based on that information. Next, the AI ​​automatically generates character and background illustrations based on this plot. Furthermore, if the user uploads a character drawing they have drawn themselves, the AI ​​analyzes the style of that drawing and reflects it in other illustrations. Finally, the generated doujinshi is stored in the cloud and can only be viewed using a dedicated app. This dedicated app is equipped with features to prevent screenshots and duplication, reducing the risk of copyright infringement.

[0060] The processing flow will be explained below.

[0061] Step 1:

[0062] The user launches the dedicated app. The user clicks the "Create a new doujinshi" button. The user then enters the "original title" and "preferred situation" and confirms it.

[0063] Step 2:

[0064] The device sends the entered data ("original title" and "preferred situation") to the server. This communication uses a secure protocol (e.g., HTTPS), ensuring the safety of the data.

[0065] Step 3:

[0066] The server analyzes the data received from the user, and the AI ​​engine inside the server uses this information to refer to a pre-trained database and generate a plot appropriate for the situation specified by the user.

[0067] Step 4:

[0068] The server's AI engine automatically generates character and background illustrations based on the generated plot. The AI ​​draws scenes and characters according to the situation.

[0069] Step 5:

[0070] Users can upload their own drawings using a dedicated app, allowing them to provide the system with their own artistic style.

[0071] Step 6:

[0072] The device sends the image data uploaded by the user to the server, and this communication is also carried out using a secure protocol.

[0073] Step 7:

[0074] The server analyzes the received image data. The AI ​​engine learns the style of the user-provided image and applies that style to the illustrations on other pages.

[0075] Step 8:

[0076] The server stores the generated doujinshi in cloud storage. The stored doujinshi data is subject to access control so that only users with specific user IDs can access it.

[0077] Step 9:

[0078] Users access the cloud storage through a dedicated app and view the created doujinshi. The app has security features to prevent screenshots and duplication, reducing the risk of copyright infringement.

[0079] As a concrete example, consider the case where a user inputs the information "magical girl anime, battle scene." The server receives this information, and the AI ​​engine generates a plot for the battle scene and draws appropriate character and background illustrations based on that plot. When the user uploads a picture of a magical girl they have drawn, the AI ​​analyzes the style of this drawing and applies a consistent style to other pages. Finally, the generated doujinshi is stored in the cloud and can only be viewed using a dedicated app.

[0080] Example 1

[0081] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0082] Conventional doujinshi generation systems require users to manually create illustrations and stories, which requires a great deal of time and effort. It is also difficult to ensure a consistent style for the generated content, and from the perspective of copyright protection, the prevention of screenshots and duplication is insufficient. There is a need to provide an efficient, high-quality doujinshi generation system that solves these issues.

[0083] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0084] In this invention, the server includes a means for receiving information and generating a plot, a means for automatically generating illustrations based on the generated plot, and a means for saving the illustrations in cloud storage. This allows users to efficiently generate high-quality fanzines and create illustrations with a consistent style, while also enabling them to view the illustrations through a dedicated program equipped with security features to prevent screenshots and duplication.

[0085] "Means for inputting information" refers to a means by which a user can input specific information (e.g., the title of an original work or a preferred situation) using a dedicated application or interface.

[0086] The "means for transmitting input information to a server" refers to a means for transmitting information input by a user to a server via a communication network such as the Internet using a secure protocol.

[0087] "Means for generating a plot based on information received by the server" refers to means for the server to use an AI engine or algorithm to generate a specific story development or plot based on information sent by the user.

[0088] "Means for automatically generating illustrations based on the generated plot" refers to means for automatically drawing illustrations of characters and backgrounds corresponding to the generated plot using the server's AI engine or graphics generation tool.

[0089] "Means for saving in cloud storage" refers to a means for saving the created illustrations and fanzines in cloud storage on the Internet, making them easy to access and manage.

[0090] "Means for viewing illustrations stored via a dedicated program" refers to means for a user to view illustrations stored in cloud storage via a dedicated application or program.

[0091] "Means for preventing the duplication or screenshotting of illustrations by a dedicated program" refers to a program equipped with security features to prevent illustrations from being illegally duplicated or stolen by screenshotting.

[0092] "Means for uploading content drawn by users" refers to means for users to upload illustrations or pictures they have drawn to a server via a dedicated application.

[0093] "Means for analyzing the style of uploaded content" refers to the means by which the server analyzes the style of illustrations uploaded by users using an AI engine or image analysis technology.

[0094] The "means for reflecting the analyzed style in illustrations on other pages" refers to a means for applying the same style to other automatically generated illustrations based on the analyzed style.

[0095] "Means of transmitting to a server using a secure communication protocol" refers to the use of encryption technology or a secure communication protocol (e.g., HTTPS) to ensure the security of data when a user transmits data from a terminal to a server.

[0096] "Access control measures that allow only specific identification information to access illustrations" are measures to prevent unauthorized access by controlling the viewing rights of illustrations and doujinshi based on each user's identification information or ID.

[0097] This invention is a system that can automatically generate high-quality doujinshi by users by inputting the title of the original work and their preferred situation. This system operates in cooperation with a server, terminals, and users.

[0098] Hardware and software used:

[0099] Server: A server equipped with a high-performance AI engine and database (e.g., machine learning models, image generation models).

[0100] Device: A user's device (e.g., smartphone, tablet, PC) on which the dedicated application is installed.

[0101] Secure communication protocol: A protocol that uses encryption technology, such as HTTPS.

[0102] Examples of data processing and data calculation

[0103] 1. The stage where the user inputs information about the original work and the situation

[0104] The user launches a dedicated application and selects to create a new doujinshi. The user enters the "original title" and "preferred situation" and confirms it, after which the device sends the entered information to the server. At this time, a secure communication protocol (e.g., HTTPS) is used to ensure the safety of the data.

[0105] As a specific example, the user inputs "Magical girl anime, school festival episode" and presses the send button.

[0106] 2. The server analyzes the input and generates the plot.

[0107] The server receives input data from the user, and the AI ​​engine analyzes the information. The server's AI then references the database and generates a plot for the "situation" specified by the user.

[0108] As a concrete example, the server's AI analyzes "magical girl anime, school festival episode" and combines related story elements from the database to generate a plot for the school festival episode.

[0109] 3. Automatically generate illustrations

[0110] The server's AI automatically draws characters and backgrounds based on the generated plot.

[0111] As a concrete example, the server's AI draws the background, stage, and costumes of specific characters at a school festival, and generates the illustrations that make up each scene.

[0112] 4. Uploading user's artwork and analyzing its style

[0113] Users upload their own character drawings using a dedicated app. The device then sends the uploaded data to the server. The AI ​​analyzes the style of the illustrations received by the server and applies this style to the illustrations on other pages.

[0114] For example, when a user selects an image of a character they have drawn and presses the upload button, the device encrypts the data and sends it to the server, where the server's AI analyzes the image and applies the same style to other illustrations.

[0115] 5. Preserving Doujinshi and Restricting Access

[0116] The server stores the generated doujinshi in cloud storage. The doujinshi can only be viewed using a dedicated app, which has security features to prevent screenshots and duplication.

[0117] For example, the created doujinshi are stored in cloud storage. At the same time, they are set up so that they can only be accessed via a dedicated app. The app is equipped with a function to disable screenshots and technology to prevent duplication, reducing the risk of copyright infringement.

[0118] Prompt Sentence Examples

[0119] Original: Magical Girl Anime

[0120] Situation: School Festival Episode

[0121] Input prompt for the generative AI model:

[0122] "Write a new episode about magical girls at a school festival. The festival will be themed around school activities and feature a magical show."

[0123] This invention allows users to efficiently create high-quality fanzines, and also provides functions for unifying the style of illustrations and protecting copyrights.

[0124] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0125] Step 1:

[0126] The user inputs information about the original work and the situation.

[0127] Input: The user launches the dedicated application and enters the "original title" and "preferred situation."

[0128] Specific operation: The user selects the creation of a new doujinshi in a dedicated application and enters specific information such as "magical girl anime, school festival episode."

[0129] Output: The terminal sends the entered information to the server.

[0130] Step 2:

[0131] The device sends the entered information to the server.

[0132] Input: The user enters the "original title" and "preferred situation" using a dedicated application.

[0133] Specific operation: The device encrypts the entered information using HTTPS and sends it to the server via a secure communication protocol.

[0134] Output: The server receives the information from the user.

[0135] Step 3:

[0136] The server analyzes the input information and generates the plot

[0137] Input: "Original title" and "Favorite situation" received by the server.

[0138] Specific operation: The server's AI engine analyzes the received information, references the database to obtain relevant information, and generates a plot based on the specified situation.

[0139] Output: The generated plot.

[0140] Step 4:

[0141] The server automatically generates illustrations based on the generated plots.

[0142] Input: The generated plot.

[0143] Specific operation: The server's AI engine draws characters and backgrounds based on the plot. For example, it automatically generates the background, stage, and character costumes for a school festival.

[0144] Output: The generated illustration.

[0145] Step 5:

[0146] Users can upload their own drawings

[0147] Input: A character drawing drawn by the user.

[0148] Specific operation: The user performs operations to upload a picture drawn using a dedicated application.

[0149] Output: The device sends the image it draws to the server.

[0150] Step 6:

[0151] The device sends the uploaded data to the server

[0152] Input: A character drawing drawn by the user.

[0153] What it does: The device encrypts the uploaded data using a secure communication protocol such as HTTPS and sends it to the server.

[0154] Output: The server receives the uploaded image.

[0155] Step 7:

[0156] The server analyzes the style of the image received and applies this style to the illustrations on other pages.

[0157] Input: User-uploaded character illustration.

[0158] How it works: The server's AI engine analyzes the received image and applies its artistic style to other illustrations, for example by identifying a specific style or color palette and matching it to other automatically generated illustrations.

[0159] Output: Illustrations with a consistent style.

[0160] Step 8:

[0161] The server saves the generated doujinshi to cloud storage.

[0162] Input: A doujinshi that combines automatically generated illustrations and a plot.

[0163] Specific operation: The server uploads the completed doujinshi to cloud storage and saves it.

[0164] Output: A fanzine saved in cloud storage.

[0165] Step 9:

[0166] Doujinshi can only be viewed using a dedicated application, and security features are implemented.

[0167] Input: Doujinshi saved in cloud storage.

[0168] Specific operation: The server sets access permissions for the doujinshi so that it can only be viewed using a dedicated application. It also implements security features to prevent screenshots and duplication.

[0169] Output: The doujinshi can be viewed through a dedicated application with security features enabled.

[0170] (Application example 1)

[0171] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0172] Conventional content generation systems require users to manually create and edit plots and illustrations, which is time-consuming and labor-intensive. They also lack sufficient security features to limit the distribution of generated content to specific users, posing a risk of copyright infringement. Furthermore, they lack effective means to prevent users from applying the same style of their drawings to other illustrations or from copying or taking screenshots of generated content.

[0173] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0174] In this invention, the server includes means for inputting information, means for transmitting the input information to the server, means for generating a plot based on the information received by the server, means for automatically generating illustrations based on the generated plot, means for saving the illustrations in cloud storage, means for viewing the saved illustrations and generated content via a dedicated application, means for preventing copying and screenshots of the illustrations and generated content by the dedicated application, and access control means for distributing content only to specified users. This makes it possible to automatically generate high-quality doujinshi and distribute them with enhanced security.

[0175] The "means for inputting information" refers to a device or software that allows the user to input information such as the title of the original work and a preferred situation.

[0176] The "means for transmitting information to a server" is a device or software that transfers the information entered by the user to the server using a secure communication protocol.

[0177] A "plot generation means" is a device or software that uses an AI engine to automatically create story developments and situations based on received information.

[0178] A "means for automatically generating illustrations" is a device or software that automatically depicts images of characters and backgrounds based on a generated plot.

[0179] "Cloud storage means" refers to devices or software that securely store generated illustrations and content in online data storage.

[0180] "Specialized application" means software for a specific device for viewing generated illustrations and content.

[0181] "Measures to prevent copying and screenshots" refers to technologies that prevent the generated content from being illegally copied or saved as a screenshot.

[0182] "Access control means" is a technology that authenticates a specific user ID and allows only that user to access the generated illustrations and content.

[0183] "Means for uploading user-drawn illustrations" refers to a device or software that allows users to upload hand-drawn illustrations to the cloud.

[0184] "Means for analyzing art style" refers to a technology that uses AI to analyze the style of art uploaded by users.

[0185] "Means of reflecting on illustrations on other pages" refers to a technique for applying the analyzed style and art style to other automatically generated illustrations.

[0186] The present invention is a system that automatically generates high-quality doujinshi and content by allowing users to input the title of the original work and their preferred situation, and distributes them exclusively to specific users. Specific implementation methods of this system are described in detail below.

[0187] The present invention is configured using the following hardware and software: The hardware includes a server and a smartphone, and the software uses Python, TENSORFLOW (registered trademark) (AI model), Google (registered trademark) Cloud Storage (cloud storage), Firebase (real-time database and authentication), and HTTPS (secure communication).

[0188] 1. Enter user information

[0189] First, users launch the dedicated application on their smartphone and input the title of the original work and their preferred situation. This information is then sent to the server via the application using a secure communication protocol (HTTPS).

[0190] 2. Receiving data from the server and generating plots

[0191] The server receives the data sent by the user and generates a plot using an AI engine (TensorFlow) based on that information. For example, if a user inputs "magical girl anime, school festival episode," the server's AI analyzes this and creates an appropriate storyline.

[0192] 3. Automatic generation of illustrations

[0193] Based on the generated plot, the server's AI automatically creates illustrations of characters and backgrounds. For example, the background of a school festival scene and the costumes of specific characters are automatically generated.

[0194] 4. Uploading user drawings and reflecting their own style

[0195] Users can upload their own drawings using a dedicated application. The uploaded drawing is sent to a server, where the AI ​​analyzes the drawing style. The analyzed drawing style is then reflected in other generated illustrations.

[0196] 5. Content Storage and Distribution

[0197] The generated doujin content is stored in Google Cloud Storage. Firebase is used to control access so that only specific users can view the content. A dedicated application provides the ability to prevent duplication and screenshots of the created content.

[0198] Examples of concrete examples and prompts

[0199] For example, consider the case where the user inputs "Original story: Super Sentai anime, Situation: Everyday life." In this case, the following prompt is passed to the server's AI:

[0200] Original: Sentai hero anime

[0201] Situation: Everyday life

[0202] User's picture: user_uploaded_image.png

[0203] This allows the server's AI to generate a plot, which is then used to automatically generate character and background illustrations, ultimately resulting in high-quality doujin content that reflects the user's designated art style. The generated content is stored in cloud storage and can only be viewed by specific users via a dedicated application with access control.

[0204] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0205] Step 1:

[0206] The user launches the dedicated application on their smartphone and inputs the original title and their preferred situation. The original title and situation are obtained as input data. The application then sends this data to the server using a secure communication protocol (HTTPS).

[0207] Input: User input of original title and situation

[0208] Output: Original title and situation data sent to the server

[0209] Step 2:

[0210] The server receives the data sent by the user. The received data is passed to an AI engine (TensorFlow) to generate a plot. For example, if the input original title is "Magical Girl Anime" and the situation is "School Festival Episode," the AI ​​will generate a plot.

[0211] Input: Original title and situation data received by the server

[0212] Output: The generated plot

[0213] Step 3:

[0214] Based on the generated plot, the server's AI automatically creates illustrations of characters and backgrounds according to the scenes and situations of the generated plot.

[0215] Input: Generated plot

[0216] Output: Auto-generated illustration

[0217] Step 4:

[0218] Users upload their own drawings via a dedicated application. The uploaded image is sent to a server, which analyzes the image's style. The analyzed style is then reflected in the illustrations on other pages.

[0219] Input: User-uploaded picture (image file)

[0220] Output: Other illustrations that reflect the same style

[0221] Step 5:

[0222] The generated content (plots and illustrations based on them) is stored in Google Cloud Storage, with access control using Firebase to ensure that only specific users can view this content.

[0223] Input: Generated content (plot and illustrations)

[0224] Output: Content and access control information stored in cloud storage

[0225] Step 6:

[0226] Users can view content stored in the cloud through a dedicated application, which is equipped with features to prevent content from being copied or taken screenshots, preventing unauthorized use of the content.

[0227] Input: Content in cloud storage

[0228] Output: Content displayed in a dedicated application

[0229] Through the above steps, a system will be completed that automatically generates high-quality doujinshi and content based on information entered by users, and can then be safely distributed and viewed.

[0230] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0231] This invention is a system that can automatically generate high-quality doujinshi by having users input the title of the original work and their favorite situations. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to generate more personalized doujinshi. This system operates in cooperation with the server, terminals, emotion engine, and users.

[0232] The system of the present invention is configured as follows:

[0233] 1. The stage where the user inputs information about the original work and the situation

[0234] The user launches a dedicated application and selects to create a new doujinshi.

[0235] The user inputs the "original title" and "preferred situation" and confirms it.

[0236] The device sends the entered information to the server, using a secure communication protocol (e.g., HTTPS) to ensure the safety of the data.

[0237] 2. Acquiring emotional data using the emotion engine

[0238] The emotion engine analyzes the user's facial expressions and tone of voice to obtain emotional data.

[0239] The terminal transmits the acquired emotion data to the server.

[0240] 3. The server analyzes the input information and emotion data and generates a plot.

[0241] The server receives original information and the situation from the user, and the AI ​​engine generates a plot based on that information.

[0242] Additionally, the server adjusts the plot content based on the emotion data it generates, for example, adding a happy ending to the story if the user expresses positive emotions.

[0243] 4. Automatically generate illustrations

[0244] The server's AI engine automatically generates character and background illustrations based on the generated plot.

[0245] For example, scenes and characters are drawn according to the situation.

[0246] 5. Uploading user's artwork and analyzing its style

[0247] Users upload their own drawings using a dedicated app.

[0248] The device sends the uploaded data to the server.

[0249] The server analyzes the received image data, and the AI ​​engine learns the style and reflects it in the illustrations on other pages.

[0250] 6. Preserving Doujinshi and Restricting Access

[0251] The server stores the generated doujinshi in cloud storage.

[0252] Access control is applied to the saved doujinshi data so that only users with specific user IDs can access it.

[0253] 7. Viewing with a dedicated app

[0254] Users access the cloud storage through a dedicated app and view the generated doujinshi.

[0255] The dedicated app has security features that prevent screenshots and duplication, reducing the risk of copyright infringement.

[0256] As a concrete example, consider the case where a user inputs the information "magical girl anime, battle scene" and the emotion engine recognizes that the user is excited. The server receives this information and emotion data, and the AI ​​engine generates a more dynamic battle scene plot. Next, the AI ​​draws character and background illustrations based on that plot. When a user uploads a drawing of a magical girl they have drawn, the AI ​​analyzes the style of this drawing and applies a consistent style to other illustrations. Finally, the generated doujinshi is stored in the cloud and can only be viewed using a dedicated app.

[0257] The processing flow will be explained below.

[0258] Step 1:

[0259] The user launches the dedicated app, clicks the "Create a new doujinshi" button, enters the "original title" and "preferred situation," and confirms.

[0260] Step 2:

[0261] The device sends the input data ("original title" and "preferred situation") to the server. At this time, a secure communication protocol (e.g., HTTPS) is used to ensure the safety of the data.

[0262] Step 3:

[0263] The emotion engine analyzes the user's facial expressions and tone of voice to obtain the user's emotional data (e.g., collected in real time via a camera or microphone).

[0264] Step 4:

[0265] The device transmits the acquired emotion data to the server, which is also transmitted using a secure protocol.

[0266] Step 5:

[0267] The server receives information about the original work, the situation, and emotional data from the user. The AI ​​engine inside the server comprehensively analyzes this information.

[0268] Step 6:

[0269] The server's AI engine generates a plot based on the received information, and adjusts the plot content according to the user's emotional data (e.g., adding a happy ending if the emotion is positive).

[0270] Step 7:

[0271] The server's AI engine automatically generates character and background illustrations based on the generated plot, drawing scenes and characters according to the situation.

[0272] Step 8:

[0273] Users upload their own drawings using a dedicated app, providing the system with their own character illustrations.

[0274] Step 9:

[0275] The device sends the image data uploaded by the user to the server, and this communication is also carried out using a secure protocol.

[0276] Step 10:

[0277] The server analyzes the received image data. The AI ​​engine analyzes the user's style and reflects that style in the illustrations on other pages.

[0278] Step 11:

[0279] The server stores the generated doujinshi in cloud storage, where access control is applied so that only users with specific user IDs can access the stored doujinshi.

[0280] Step 12:

[0281] Users access the cloud storage and view the created doujinshi through a dedicated app, which has security features to prevent screenshots and duplication, thereby reducing the risk of copyright infringement.

[0282] Examples:

[0283] For example, if a user inputs information like "magical girl anime, battle scene" and the emotion engine recognizes the user's state of excitement, the server will generate a plot based on this information. The plot generated by the AI ​​engine will be a dynamic battle scene that reflects the user's excited emotions. The AI ​​will then automatically generate illustrations based on this plot, featuring intense action scenes and flashy effects. When a user uploads a drawing of a magical girl character they created, the AI ​​analyzes the drawing style and applies a consistent style to other pages. Finally, the generated doujinshi is stored in the cloud and can only be viewed through a dedicated app.

[0284] Example 2

[0285] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0286] Creating modern fanzines requires a lot of time and effort, and requires technical knowledge and skills. This makes it difficult for beginners and busy users to create high-quality content. Furthermore, there is no method for automatically creating personalized content that reflects user emotions, making it difficult to increase user satisfaction. The present invention aims to provide a system that solves these problems.

[0287] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for a user to input information, means for transmitting the input information to the server, means for generating a plot based on the information received by the server, means for automatically generating an illustration based on the generated plot, means for saving the illustration in cloud storage, means for viewing the saved illustration via a dedicated app, means for preventing duplication and screenshots of the illustration by the dedicated app, an emotion engine for acquiring user emotion data, means for transmitting the acquired emotion data to the server, and means for adjusting the plot based on the emotion data. This enables users to easily create high-quality doujinshi and further makes it possible to provide personalized content that reflects the user's emotions.

[0288] "User" refers to an individual who uses a dedicated application to input information and generate and view doujinshi.

[0289] "Server" refers to a computer system that receives information and emotional data entered by users, generates plots and illustrations based on this information, and stores them in cloud storage.

[0290] "Terminal" refers to the device (e.g., smartphone, tablet, or PC) used by a user to enter information and transmit data to a server.

[0291] "Specialized application" refers to the software that users use to enter information and view the generated doujinshi.

[0292] An "emotion engine" refers to a device or software that analyzes a user's facial expressions and tone of voice to obtain emotional data.

[0293] "Plot" refers to the narrative storyline that is generated by the server based on the information and emotional data received.

[0294] "Illustrations" refer to paintings of characters and backgrounds that are automatically created by an AI engine based on the generated plot.

[0295] "Cloud storage" refers to an online storage service that stores created illustrations and doujinshi on the Internet and makes them accessible to specific users.

[0296] "Secure communication protocol" refers to a communication protocol (e.g., HTTPS) that ensures data security when sending and receiving information.

[0297] "Access control measures" refers to security features that allow only specific user IDs to access doujinshi stored in cloud storage.

[0298] "Art style" refers to the unique style or technique of the picture uploaded by the user.

[0299] "Analysis" refers to the process of conducting a detailed analysis of the input information, emotional data, and style of the uploaded artwork, and generating plots and illustrations that reflect these.

[0300] "Personalized content" refers to stories and illustrations tailored to individual preferences, reflecting user input and emotional data.

[0301] The present invention is a system that automatically generates high-quality fanzines by allowing a user to input the title of an original work and a preferred situation. An embodiment of the system will be described below in detail.

[0302] This system mainly consists of a server, a terminal, an emotion engine, and a user, all of which work together. The server operates in a cloud environment and processes and stores data. The terminal is a device used by the user to input information and send the data to the server. The emotion engine is software or hardware that analyzes the user's facial expressions and tone of voice to obtain emotion data.

[0303] First, the user installs the dedicated application on their device and launches it. The user selects the "Create a new doujinshi" option and enters the title of the original work and their preferred situation. This information is then sent from the device to the server using a secure communication protocol (e.g., HTTPS).

[0304] Next, the emotion engine analyzes the user's facial expressions and tone of voice in real time to obtain emotional data. This emotional data is also sent from the device to the server. The server receives this information, and the AI ​​engine generates a story plot based on it. The emotional data also adjusts the plot to match the user's emotions. For example, if the user is expressing positive emotions, a plot that includes elements of a happy ending is generated.

[0305] Based on the generated plot, the server's AI engine automatically generates illustrations of characters and backgrounds. This allows scenes and characters to be drawn according to the situation. Users can also upload their own drawings using a dedicated app. The user's device sends this uploaded data to the server, which analyzes it. The analyzed art style is then applied to the illustrations on other pages.

[0306] The generated doujinshi data is stored in cloud storage by a server. Access control measures are implemented to ensure that only users with specific user IDs can access this stored doujinshi. Users can access the cloud storage and view the generated doujinshi through a dedicated app. The dedicated app also has security features that prevent screenshots and duplication, reducing the risk of copyright infringement.

[0307] As a concrete example, consider the case where a user inputs the information "magical girl anime, battle scene" and the emotion engine recognizes that the user is excited. The server receives this information and emotion data, and the AI ​​engine generates a more dynamic battle scene plot. Next, the AI ​​engine draws illustrations of the characters and background based on the plot. The user uploads a drawing of a magical girl they have drawn, and the AI ​​analyzes the style of this drawing and applies a consistent style to other illustrations. Finally, the generated doujinshi is stored in the cloud and can only be viewed using a dedicated app.

[0308] Example prompt sentence:

[0309] "Based on the battle scenes of magical girl anime, please generate a dynamic plot that reflects the excitement of the characters. Please also automatically generate illustrations of the characters and backgrounds."

[0310] This allows users to easily create high-quality fanzines, and also makes it possible to provide personalized content that reflects the user's emotions.

[0311] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0312] Step 1:

[0313] The user launches the dedicated application and selects the "Create a new doujinshi" option. The user enters the "original title" and "preferred situation" and presses the send button. The input data may include, for example, "magical girl anime" and "battle scene." The device then sends the entered information to the server using a secure communication protocol (e.g., HTTPS).

[0314] Input: Original title, situation

[0315] Output: Data sent to the server

[0316] How it works: Using a device such as a smartphone or PC, the user inputs the title of the original work and their preferred situation into the application and presses the data transmission button. The device then sends this information to the server using HTTPS.

[0317] Step 2:

[0318] The emotion engine analyzes the user's facial expressions and tone of voice in real time to obtain emotional data. This analysis is performed using input devices such as a camera and microphone. The obtained emotional data is then sent from the device to a server.

[0319] Input: User's facial expression data, tone of voice

[0320] Output: Data sent to the server (emotion data)

[0321] How it works: The user provides facial expressions and tone of voice to the emotion engine in real time via the device's camera and microphone. The emotion engine analyzes these and generates emotion data such as positive, negative, and excited, which is then sent to the server via the device.

[0322] Step 3:

[0323] The server analyzes the original information, situation, and emotional data it receives. The AI ​​engine generates a story plot based on this information. If the user expresses positive emotions, the plot is adjusted based on the emotional data, such as adding a happy ending to the story.

[0324] Input: Original story information, situation, emotional data

[0325] Output: Story plot

[0326] Specific operation: The server passes the received data to an AI engine, which then analyzes the data and generates a story plot. For example, based on the emotional data "magical girl anime, battle scene" and "excitement," it generates a plot including a dynamic battle scene.

[0327] Step 4:

[0328] The server's AI engine automatically generates character and background illustrations based on the generated plot, drawing scenes and characters according to the situation.

[0329] Input: Story plot

[0330] Output: Illustration data

[0331] Specific operation: Based on the story plot generated by the AI ​​engine, character and background illustrations are drawn. For example, the actions of magical girls in battle scenes and the set background (such as a ruined city) are automatically generated.

[0332] Step 5:

[0333] Users upload their own drawings using a dedicated app. The device then sends the uploaded image data to the server. The server analyzes the image, and an AI engine learns the artist's style and applies it to illustrations on other pages.

[0334] Input: A picture drawn by the user

[0335] Output: Analyzed art style data

[0336] How it works: Users take a photo of a hand-drawn character drawing with their smartphone camera and upload it through the app. The device then sends the data to the server, which uses an AI engine to analyze the drawing style and apply it to illustrations on other pages.

[0337] Step 6:

[0338] The server stores the created doujinshi in cloud storage, and access control measures are applied to the stored doujinshi so that only users with specific user IDs can access them.

[0339] Input: Generated fanzine data

[0340] Output: Doujinshi data stored in cloud storage

[0341] Specific operation: The server stores the generated doujinshi data in cloud storage and sets a unique access key for each page so that only specific users can view it.

[0342] Step 7:

[0343] Users access the cloud storage through a dedicated app and view the created doujinshi. The app has security features to prevent screenshots and duplication.

[0344] Input: Doujinshi data stored in cloud storage

[0345] Output: The fanzine that the user views

[0346] Specific operation: When a user opens a doujinshi within the app and views a page, controls such as disabling screen capture and duplication are implemented.

[0347] (Application example 2)

[0348] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0349] Conventional automatic doujinshi generation systems have difficulty generating personalized content that takes user emotions into account. They also lack the functionality to reflect user-drawn illustrations, making it difficult to generate doujinshi that incorporate individual artistic styles. Furthermore, information security and access control were insufficient, raising the risk of copyright infringement.

[0350] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for inputting information, means for transmitting the input information to the server, means for generating a plot based on the information received by the server, means for automatically generating an illustration based on the generated plot, means for recognizing the user's emotion, means for reflecting the recognized emotion in the generated plot, means for saving the illustration in cloud storage, means for viewing the saved illustration via a dedicated app, and means for the dedicated app to prevent copying or screenshotting of the illustration. This makes it possible to automatically generate individual plots and illustrations that reflect the user's emotion and to save and view them in a secure environment.

[0351] "Information" refers to data entered by the user, such as the title of the original work and preferred situations.

[0352] A "plot" is an outline that shows the structure and development of a story.

[0353] An "illustration" is an image that visually represents a story, character, landscape, etc.

[0354] A "server" is a computer system that receives and processes information sent by users.

[0355] "Emotion" refers to the user's feelings and mood, and is a psychological state that can be analyzed from facial expressions, tone of voice, etc.

[0356] "Cloud storage" refers to remote servers where data can be stored and accessed over the internet.

[0357] A "dedicated app" is a specific application for displaying and manipulating content generated by the system of the present invention.

[0358] A "secure communication protocol" is a communication method that encrypts communication data to prevent it from being read by third parties.

[0359] "Access control" refers to security measures that ensure that only users with specific privileges can access data.

[0360] This embodiment of the present invention describes a system for automatically generating personalized fanzines that reflect a user's emotions. This system allows the user to input the title of the original work and their preferred situations, and then generates a plot based on that information and automatically generates illustrations. In particular, emotion recognition is performed and reflected in the plot generation, generating content that reflects the user's emotions.

[0361] 1. System Configuration

[0362] The system consists of the following major hardware and software components:

[0363] User device: A device (such as a smartphone or tablet) through which a user enters information.

[0364] Server: A central processing unit that receives information and generates plots and illustrations.

[0365] Emotion engine: A system for analyzing emotions from the user's facial expressions, tone of voice, etc.

[0366] Cloud storage: A data storage system that stores the generated doujinshi and controls access.

[0367] Dedicated app: An application for users to view doujinshi.

[0368] 2. Data processing and calculation

[0369] User device:

[0370] The user launches the application and enters the original title and their preferred situation.

[0371] To recognize emotions, a camera and microphone record the user's facial expressions and tone of voice.

[0372] The input information and emotional data are sent to the server using a secure communication protocol (e.g., HTTPS).

[0373] server:

[0374] The received original information and situation information are analyzed, and a plot is generated using a generative AI model.

[0375] Based on emotional data, the plot content reflects the user's emotions.

[0376] Based on the plot, AI is used to automatically generate illustrations of characters and backgrounds.

[0377] When a user uploads a drawing they have drawn, the AI ​​analyzes the style and applies a consistent style to the illustrations on other pages.

[0378] Cloud Storage:

[0379] The completed doujinshi will be stored in cloud storage.

[0380] Access control is implemented so that only specific user IDs can access it.

[0381] Dedicated app:

[0382] Users access cloud storage through a dedicated app.

[0383] The app has security features to prevent screenshots and duplication.

[0384] 3. Examples and prompts

[0385] For example, if a user inputs an "adventure fantasy story plot" and a "moving scene" and the camera detects that the user is smiling, the system generates a happy-ending adventure fantasy story and character illustrations, resulting in a high-quality doujinshi that reflects the user's emotions.

[0386] Example prompt sentence:

[0387] "Adventure fantasy, moving scenes"

[0388] "A world of magic and adventure, an episode of a brave warrior"

[0389] This makes it possible to create a personalized doujinshi that meets the needs and emotions of the user.

[0390] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0391] Step 1:

[0392] The user launches the dedicated app. They input the title of the original work and their preferred situation, then press the send button. The input information is sent from the device to the server. The input data is configured as a prompt message and sent using a secure communication protocol (HTTPS).

[0393] Input: Original title and situation

[0394] Output: Input data sent to the server

[0395] Step 2:

[0396] The emotion engine uses the camera and microphone to analyze the user's facial expressions and tone of voice, and the emotional data obtained by the emotion engine is sent from the device to the server.

[0397] Input: User's facial expression and tone of voice data

[0398] Output: Emotion data sent to the server

[0399] Step 3:

[0400] The server analyzes the original story information, situation information, and emotional data it receives. It then uses a generative AI model to generate a plot that reflects the user's emotions. Based on the emotional data in particular, the plot content is adjusted to a tone that matches the user's emotions.

[0401] Input: Original title, situation, emotional data

[0402] Output: The generated plot

[0403] Step 4:

[0404] The server automatically generates illustrations based on the generated plot. Specifically, AI is used to draw character designs, backgrounds, and scene illustrations.

[0405] Input: Generated plot

[0406] Output: Automatically generated illustrations

[0407] Step 5:

[0408] Users upload their own drawings using a dedicated app, and the device sends the uploaded image data to the server.

[0409] Input: A picture drawn by the user

[0410] Output: Picture data sent to the server

[0411] Step 6:

[0412] The server analyzes the received image data, and the AI ​​engine learns the artist's style. This style is then reflected in the illustrations on other pages, maintaining a consistent design.

[0413] Input: User's drawing data

[0414] Output: Illustrations of other pages that reflect the same style

[0415] Step 7:

[0416] The server stores the generated doujinshi in cloud storage. The stored data is subject to access control so that only users with specific user IDs can access it.

[0417] Input: Finished doujinshi

[0418] Output: Doujinshi data saved in cloud storage

[0419] Step 8:

[0420] Users access the cloud storage through a dedicated app and view the created doujinshi. The app is equipped with security features to prevent screenshots and duplication, reducing the risk of copyright infringement.

[0421] Input: Access to doujinshi data in cloud storage

[0422] Output: Doujinshi that can be viewed using a dedicated app

[0423] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0424] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0425] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0426] [Second embodiment]

[0427] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0428] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0429] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0430] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0431] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0432] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0433] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0434] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0435] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0436] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0437] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0438] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0439] The present invention is a system that can automatically generate high-quality doujinshi by users by inputting the title of the original work and their preferred situation. This system operates in cooperation with a server, terminals, and users.

[0440] The system of the present invention is configured as follows:

[0441] 1. The stage where the user inputs information about the original work and the situation

[0442] The user launches a dedicated application and selects to create a new doujinshi.

[0443] The user inputs the "original title" and "preferred situation" and confirms it.

[0444] The device sends the entered information to the server, using a secure communication protocol (e.g., HTTPS) to ensure the safety of the data.

[0445] 2. The server analyzes the input and generates the plot.

[0446] The server receives input data from the user and the AI ​​engine analyzes the information.

[0447] The AI ​​engine references the database based on the "original title" and generates a plot for the "situation" specified by the user.

[0448] For example, if a user inputs "magical girl anime, school festival episode," the server's AI will create a storyline that suits this.

[0449] 3. Automatically generate illustrations

[0450] The server's AI automatically draws characters and backgrounds based on the generated plot.

[0451] For example, this includes the background and stage of the school festival scene, and the costumes of specific characters.

[0452] 4. Uploading user's artwork and analyzing its style

[0453] Users upload their own drawings using a dedicated app.

[0454] The device sends the uploaded data to the server.

[0455] Based on the image received by the server, the AI ​​analyzes the style of the artwork and reflects this style in the illustrations on other pages.

[0456] 5. Preserving Doujinshi and Restricting Access

[0457] The server stores the generated doujinshi in cloud storage.

[0458] At the same time, doujinshi will only be viewable using a dedicated app, and the app will be equipped with security features to prevent screenshots and duplication.

[0459] For example, if a user enters the information "Original work: magical girl anime, Situation: battle scene," the following process takes place. When the user enters the information and sends it from their device to the server, the server's AI generates a plot for the battle scene based on that information. Next, the AI ​​automatically generates character and background illustrations based on this plot. Furthermore, if the user uploads a character drawing they have drawn themselves, the AI ​​analyzes the style of that drawing and reflects it in other illustrations. Finally, the generated doujinshi is stored in the cloud and can only be viewed using a dedicated app. This dedicated app is equipped with features to prevent screenshots and duplication, reducing the risk of copyright infringement.

[0460] The processing flow will be explained below.

[0461] Step 1:

[0462] The user launches the dedicated app. The user clicks the "Create a new doujinshi" button. The user then enters the "original title" and "preferred situation" and confirms it.

[0463] Step 2:

[0464] The device sends the entered data ("original title" and "preferred situation") to the server. This communication uses a secure protocol (e.g., HTTPS), ensuring the safety of the data.

[0465] Step 3:

[0466] The server analyzes the data received from the user, and the AI ​​engine inside the server uses this information to refer to a pre-trained database and generate a plot appropriate for the situation specified by the user.

[0467] Step 4:

[0468] The server's AI engine automatically generates character and background illustrations based on the generated plot. The AI ​​draws scenes and characters according to the situation.

[0469] Step 5:

[0470] Users can upload their own drawings using a dedicated app, allowing them to provide the system with their own artistic style.

[0471] Step 6:

[0472] The device sends the image data uploaded by the user to the server, and this communication is also carried out using a secure protocol.

[0473] Step 7:

[0474] The server analyzes the received image data. The AI ​​engine learns the style of the user-provided image and applies that style to the illustrations on other pages.

[0475] Step 8:

[0476] The server stores the generated doujinshi in cloud storage. The stored doujinshi data is subject to access control so that only users with specific user IDs can access it.

[0477] Step 9:

[0478] Users access the cloud storage through a dedicated app and view the created doujinshi. The app has security features to prevent screenshots and duplication, reducing the risk of copyright infringement.

[0479] As a concrete example, consider the case where a user inputs the information "magical girl anime, battle scene." The server receives this information, and the AI ​​engine generates a plot for the battle scene and draws appropriate character and background illustrations based on that plot. When the user uploads a picture of a magical girl they have drawn, the AI ​​analyzes the style of this drawing and applies a consistent style to other pages. Finally, the generated doujinshi is stored in the cloud and can only be viewed using a dedicated app.

[0480] Example 1

[0481] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0482] Conventional doujinshi generation systems require users to manually create illustrations and stories, which requires a great deal of time and effort. It is also difficult to ensure a consistent style for the generated content, and from the perspective of copyright protection, the prevention of screenshots and duplication is insufficient. There is a need to provide an efficient, high-quality doujinshi generation system that solves these issues.

[0483] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0484] In this invention, the server includes a means for receiving information and generating a plot, a means for automatically generating illustrations based on the generated plot, and a means for saving the illustrations in cloud storage. This allows users to efficiently generate high-quality fanzines and create illustrations with a consistent style, while also enabling them to view the illustrations through a dedicated program equipped with security features to prevent screenshots and duplication.

[0485] "Means for inputting information" refers to a means by which a user can input specific information (e.g., the title of an original work or a preferred situation) using a dedicated application or interface.

[0486] The "means for transmitting input information to a server" refers to a means for transmitting information input by a user to a server via a communication network such as the Internet using a secure protocol.

[0487] "Means for generating a plot based on information received by the server" refers to means for the server to use an AI engine or algorithm to generate a specific story development or plot based on information sent by the user.

[0488] "Means for automatically generating illustrations based on the generated plot" refers to means for automatically drawing illustrations of characters and backgrounds corresponding to the generated plot using the server's AI engine or graphics generation tool.

[0489] "Means for saving in cloud storage" refers to a means for saving the created illustrations and fanzines in cloud storage on the Internet, making them easy to access and manage.

[0490] "Means for viewing illustrations stored via a dedicated program" refers to means for a user to view illustrations stored in cloud storage via a dedicated application or program.

[0491] "Means for preventing the duplication or screenshotting of illustrations by a dedicated program" refers to a program equipped with security features to prevent illustrations from being illegally duplicated or stolen by screenshotting.

[0492] "Means for uploading content drawn by users" refers to means for users to upload illustrations or pictures they have drawn to a server via a dedicated application.

[0493] "Means for analyzing the style of uploaded content" refers to the means by which the server analyzes the style of illustrations uploaded by users using an AI engine or image analysis technology.

[0494] The "means for reflecting the analyzed style in illustrations on other pages" refers to a means for applying the same style to other automatically generated illustrations based on the analyzed style.

[0495] "Means of transmitting to a server using a secure communication protocol" refers to the use of encryption technology or a secure communication protocol (e.g., HTTPS) to ensure the security of data when a user transmits data from a terminal to a server.

[0496] "Access control measures that allow only specific identification information to access illustrations" are measures to prevent unauthorized access by controlling the viewing rights of illustrations and doujinshi based on each user's identification information or ID.

[0497] This invention is a system that can automatically generate high-quality doujinshi by users by inputting the title of the original work and their preferred situation. This system operates in cooperation with a server, terminals, and users.

[0498] Hardware and software used:

[0499] Server: A server equipped with a high-performance AI engine and database (e.g., machine learning models, image generation models).

[0500] Device: A user's device (e.g., smartphone, tablet, PC) on which the dedicated application is installed.

[0501] Secure communication protocol: A protocol that uses encryption technology, such as HTTPS.

[0502] Examples of data processing and data calculation

[0503] 1. The stage where the user inputs information about the original work and the situation

[0504] The user launches a dedicated application and selects to create a new doujinshi. The user enters the "original title" and "preferred situation" and confirms it, after which the device sends the entered information to the server. At this time, a secure communication protocol (e.g., HTTPS) is used to ensure the safety of the data.

[0505] As a specific example, the user inputs "Magical girl anime, school festival episode" and presses the send button.

[0506] 2. The server analyzes the input and generates the plot.

[0507] The server receives input data from the user, and the AI ​​engine analyzes the information. The server's AI then references the database and generates a plot for the "situation" specified by the user.

[0508] As a concrete example, the server's AI analyzes "magical girl anime, school festival episode" and combines related story elements from the database to generate a plot for the school festival episode.

[0509] 3. Automatically generate illustrations

[0510] The server's AI automatically draws characters and backgrounds based on the generated plot.

[0511] As a concrete example, the server's AI draws the background, stage, and costumes of specific characters at a school festival, and generates the illustrations that make up each scene.

[0512] 4. Uploading user's artwork and analyzing its style

[0513] Users upload their own character drawings using a dedicated app. The device then sends the uploaded data to the server. The AI ​​analyzes the style of the illustrations received by the server and applies this style to the illustrations on other pages.

[0514] For example, when a user selects an image of a character they have drawn and presses the upload button, the device encrypts the data and sends it to the server, where the server's AI analyzes the image and applies the same style to other illustrations.

[0515] 5. Preserving Doujinshi and Restricting Access

[0516] The server stores the generated doujinshi in cloud storage. The doujinshi can only be viewed using a dedicated app, which has security features to prevent screenshots and duplication.

[0517] For example, the created doujinshi are stored in cloud storage. At the same time, they are set up so that they can only be accessed via a dedicated app. The app is equipped with a function to disable screenshots and technology to prevent duplication, reducing the risk of copyright infringement.

[0518] Prompt Sentence Examples

[0519] Original: Magical Girl Anime

[0520] Situation: School Festival Episode

[0521] Input prompt for the generative AI model:

[0522] "Write a new episode about magical girls at a school festival. The festival will be themed around school activities and feature a magical show."

[0523] This invention allows users to efficiently create high-quality fanzines, and also provides functions for unifying the style of illustrations and protecting copyrights.

[0524] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0525] Step 1:

[0526] The user inputs information about the original work and the situation.

[0527] Input: The user launches the dedicated application and enters the "original title" and "preferred situation."

[0528] Specific operation: The user selects the creation of a new doujinshi in a dedicated application and enters specific information such as "magical girl anime, school festival episode."

[0529] Output: The terminal sends the entered information to the server.

[0530] Step 2:

[0531] The device sends the entered information to the server.

[0532] Input: The user enters the "original title" and "preferred situation" using a dedicated application.

[0533] Specific operation: The device encrypts the entered information using HTTPS and sends it to the server via a secure communication protocol.

[0534] Output: The server receives the information from the user.

[0535] Step 3:

[0536] The server analyzes the input information and generates the plot

[0537] Input: "Original title" and "Favorite situation" received by the server.

[0538] Specific operation: The server's AI engine analyzes the received information, references the database to obtain relevant information, and generates a plot based on the specified situation.

[0539] Output: The generated plot.

[0540] Step 4:

[0541] The server automatically generates illustrations based on the generated plots.

[0542] Input: The generated plot.

[0543] Specific operation: The server's AI engine draws characters and backgrounds based on the plot. For example, it automatically generates the background, stage, and character costumes for a school festival.

[0544] Output: The generated illustration.

[0545] Step 5:

[0546] Users can upload their own drawings

[0547] Input: A character drawing drawn by the user.

[0548] Specific operation: The user performs operations to upload a picture drawn using a dedicated application.

[0549] Output: The device sends the image it draws to the server.

[0550] Step 6:

[0551] The device sends the uploaded data to the server

[0552] Input: A character drawing drawn by the user.

[0553] What it does: The device encrypts the uploaded data using a secure communication protocol such as HTTPS and sends it to the server.

[0554] Output: The server receives the uploaded image.

[0555] Step 7:

[0556] The server analyzes the style of the image received and applies this style to the illustrations on other pages.

[0557] Input: User-uploaded character illustration.

[0558] How it works: The server's AI engine analyzes the received image and applies its artistic style to other illustrations, for example by identifying a specific style or color palette and matching it to other automatically generated illustrations.

[0559] Output: Illustrations with a consistent style.

[0560] Step 8:

[0561] The server saves the generated doujinshi to cloud storage.

[0562] Input: A doujinshi that combines automatically generated illustrations and a plot.

[0563] Specific operation: The server uploads the completed doujinshi to cloud storage and saves it.

[0564] Output: A fanzine saved in cloud storage.

[0565] Step 9:

[0566] Doujinshi can only be viewed using a dedicated application, and security features are implemented.

[0567] Input: Doujinshi saved in cloud storage.

[0568] Specific operation: The server sets access permissions for the doujinshi so that it can only be viewed using a dedicated application. It also implements security features to prevent screenshots and duplication.

[0569] Output: The doujinshi can be viewed through a dedicated application with security features enabled.

[0570] (Application example 1)

[0571] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0572] Conventional content generation systems require users to manually create and edit plots and illustrations, which is time-consuming and labor-intensive. They also lack sufficient security features to limit the distribution of generated content to specific users, posing a risk of copyright infringement. Furthermore, they lack effective means to prevent users from applying the same style of their drawings to other illustrations or from copying or taking screenshots of generated content.

[0573] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0574] In this invention, the server includes means for inputting information, means for transmitting the input information to the server, means for generating a plot based on the information received by the server, means for automatically generating illustrations based on the generated plot, means for saving the illustrations in cloud storage, means for viewing the saved illustrations and generated content via a dedicated application, means for preventing copying and screenshots of the illustrations and generated content by the dedicated application, and access control means for distributing content only to specified users. This makes it possible to automatically generate high-quality doujinshi and distribute them with enhanced security.

[0575] The "means for inputting information" refers to a device or software that allows the user to input information such as the title of the original work and a preferred situation.

[0576] The "means for transmitting information to a server" is a device or software that transfers the information entered by the user to the server using a secure communication protocol.

[0577] A "plot generation means" is a device or software that uses an AI engine to automatically create story developments and situations based on received information.

[0578] A "means for automatically generating illustrations" is a device or software that automatically depicts images of characters and backgrounds based on a generated plot.

[0579] "Cloud storage means" refers to devices or software that securely store generated illustrations and content in online data storage.

[0580] "Specialized application" means software for a specific device for viewing generated illustrations and content.

[0581] "Measures to prevent copying and screenshots" refers to technologies that prevent the generated content from being illegally copied or saved as a screenshot.

[0582] "Access control means" is a technology that authenticates a specific user ID and allows only that user to access the generated illustrations and content.

[0583] "Means for uploading user-drawn illustrations" refers to a device or software that allows users to upload hand-drawn illustrations to the cloud.

[0584] "Means for analyzing art style" refers to a technology that uses AI to analyze the style of art uploaded by users.

[0585] "Means of reflecting on illustrations on other pages" refers to a technique for applying the analyzed style and art style to other automatically generated illustrations.

[0586] The present invention is a system that automatically generates high-quality doujinshi and content by allowing users to input the title of the original work and their preferred situation, and distributes them exclusively to specific users. Specific implementation methods of this system are described in detail below.

[0587] The present invention is configured using the following hardware and software: The hardware includes a server and a smartphone, and the software uses Python, TensorFlow (AI model), Google Cloud Storage (cloud storage), Firebase (real-time database and authentication), and HTTPS (secure communication).

[0588] 1. Enter user information

[0589] First, users launch the dedicated application on their smartphone and input the title of the original work and their preferred situation. This information is then sent to the server via the application using a secure communication protocol (HTTPS).

[0590] 2. Receiving data from the server and generating plots

[0591] The server receives the data sent by the user and generates a plot using an AI engine (TensorFlow) based on that information. For example, if a user inputs "magical girl anime, school festival episode," the server's AI analyzes this and creates an appropriate storyline.

[0592] 3. Automatic generation of illustrations

[0593] Based on the generated plot, the server's AI automatically creates illustrations of characters and backgrounds. For example, the background of a school festival scene and the costumes of specific characters are automatically generated.

[0594] 4. Uploading user drawings and reflecting their own style

[0595] Users can upload their own drawings using a dedicated application. The uploaded drawing is sent to a server, where the AI ​​analyzes the drawing style. The analyzed drawing style is then reflected in other generated illustrations.

[0596] 5. Content Storage and Distribution

[0597] The generated doujin content is stored in Google Cloud Storage. Firebase is used to control access so that only specific users can view the content. A dedicated application provides the ability to prevent duplication and screenshots of the created content.

[0598] Examples of concrete examples and prompts

[0599] For example, consider the case where the user inputs "Original story: Super Sentai anime, Situation: Everyday life." In this case, the following prompt is passed to the server's AI:

[0600] Original: Sentai hero anime

[0601] Situation: Everyday life

[0602] User's picture: user_uploaded_image.png

[0603] This allows the server's AI to generate a plot, which is then used to automatically generate character and background illustrations, ultimately resulting in high-quality doujin content that reflects the user's designated art style. The generated content is stored in cloud storage and can only be viewed by specific users via a dedicated application with access control.

[0604] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0605] Step 1:

[0606] The user launches the dedicated application on their smartphone and inputs the original title and their preferred situation. The original title and situation are obtained as input data. The application then sends this data to the server using a secure communication protocol (HTTPS).

[0607] Input: User input of original title and situation

[0608] Output: Original title and situation data sent to the server

[0609] Step 2:

[0610] The server receives the data sent by the user. The received data is passed to an AI engine (TensorFlow) to generate a plot. For example, if the input original title is "Magical Girl Anime" and the situation is "School Festival Episode," the AI ​​will generate a plot.

[0611] Input: Original title and situation data received by the server

[0612] Output: The generated plot

[0613] Step 3:

[0614] Based on the generated plot, the server's AI automatically creates illustrations of characters and backgrounds according to the scenes and situations of the generated plot.

[0615] Input: Generated plot

[0616] Output: Auto-generated illustration

[0617] Step 4:

[0618] Users upload their own drawings via a dedicated application. The uploaded image is sent to a server, which analyzes the image's style. The analyzed style is then reflected in the illustrations on other pages.

[0619] Input: User-uploaded picture (image file)

[0620] Output: Other illustrations that reflect the same style

[0621] Step 5:

[0622] The generated content (plots and illustrations based on them) is stored in Google Cloud Storage, with access control using Firebase to ensure that only specific users can view this content.

[0623] Input: Generated content (plot and illustrations)

[0624] Output: Content and access control information stored in cloud storage

[0625] Step 6:

[0626] Users can view content stored in the cloud through a dedicated application, which is equipped with features to prevent content from being copied or taken screenshots, preventing unauthorized use of the content.

[0627] Input: Content in cloud storage

[0628] Output: Content displayed in a dedicated application

[0629] Through the above steps, a system will be completed that automatically generates high-quality doujinshi and content based on information entered by users, and can then be safely distributed and viewed.

[0630] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0631] This invention is a system that can automatically generate high-quality doujinshi by having users input the title of the original work and their favorite situations. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to generate more personalized doujinshi. This system operates in cooperation with the server, terminals, emotion engine, and users.

[0632] The system of the present invention is configured as follows:

[0633] 1. The stage where the user inputs information about the original work and the situation

[0634] The user launches a dedicated application and selects to create a new doujinshi.

[0635] The user inputs the "original title" and "preferred situation" and confirms it.

[0636] The device sends the entered information to the server, using a secure communication protocol (e.g., HTTPS) to ensure the safety of the data.

[0637] 2. Acquiring emotional data using the emotion engine

[0638] The emotion engine analyzes the user's facial expressions and tone of voice to obtain emotional data.

[0639] The terminal transmits the acquired emotion data to the server.

[0640] 3. The server analyzes the input information and emotion data and generates a plot.

[0641] The server receives original information and the situation from the user, and the AI ​​engine generates a plot based on that information.

[0642] Additionally, the server adjusts the plot content based on the emotion data it generates, for example, adding a happy ending to the story if the user expresses positive emotions.

[0643] 4. Automatically generate illustrations

[0644] The server's AI engine automatically generates character and background illustrations based on the generated plot.

[0645] For example, scenes and characters are drawn according to the situation.

[0646] 5. Uploading user's artwork and analyzing its style

[0647] Users upload their own drawings using a dedicated app.

[0648] The device sends the uploaded data to the server.

[0649] The server analyzes the received image data, and the AI ​​engine learns the style and reflects it in the illustrations on other pages.

[0650] 6. Preserving Doujinshi and Restricting Access

[0651] The server stores the generated doujinshi in cloud storage.

[0652] Access control is applied to the saved doujinshi data so that only users with specific user IDs can access it.

[0653] 7. Viewing with a dedicated app

[0654] Users access the cloud storage through a dedicated app and view the generated doujinshi.

[0655] The dedicated app has security features that prevent screenshots and duplication, reducing the risk of copyright infringement.

[0656] As a concrete example, consider the case where a user inputs the information "magical girl anime, battle scene" and the emotion engine recognizes that the user is excited. The server receives this information and emotion data, and the AI ​​engine generates a more dynamic battle scene plot. Next, the AI ​​draws character and background illustrations based on that plot. When a user uploads a drawing of a magical girl they have drawn, the AI ​​analyzes the style of this drawing and applies a consistent style to other illustrations. Finally, the generated doujinshi is stored in the cloud and can only be viewed using a dedicated app.

[0657] The processing flow will be explained below.

[0658] Step 1:

[0659] The user launches the dedicated app, clicks the "Create a new doujinshi" button, enters the "original title" and "preferred situation," and confirms.

[0660] Step 2:

[0661] The device sends the input data ("original title" and "preferred situation") to the server. At this time, a secure communication protocol (e.g., HTTPS) is used to ensure the safety of the data.

[0662] Step 3:

[0663] The emotion engine analyzes the user's facial expressions and tone of voice to obtain the user's emotional data (e.g., collected in real time via a camera or microphone).

[0664] Step 4:

[0665] The device transmits the acquired emotion data to the server, which is also transmitted using a secure protocol.

[0666] Step 5:

[0667] The server receives information about the original work, the situation, and emotional data from the user. The AI ​​engine inside the server comprehensively analyzes this information.

[0668] Step 6:

[0669] The server's AI engine generates a plot based on the received information, and adjusts the plot content according to the user's emotional data (e.g., adding a happy ending if the emotion is positive).

[0670] Step 7:

[0671] The server's AI engine automatically generates character and background illustrations based on the generated plot, drawing scenes and characters according to the situation.

[0672] Step 8:

[0673] Users upload their own drawings using a dedicated app, providing the system with their own character illustrations.

[0674] Step 9:

[0675] The device sends the image data uploaded by the user to the server, and this communication is also carried out using a secure protocol.

[0676] Step 10:

[0677] The server analyzes the received image data. The AI ​​engine analyzes the user's style and reflects that style in the illustrations on other pages.

[0678] Step 11:

[0679] The server stores the generated doujinshi in cloud storage, where access control is applied so that only users with specific user IDs can access the stored doujinshi.

[0680] Step 12:

[0681] Users access the cloud storage and view the created doujinshi through a dedicated app, which has security features to prevent screenshots and duplication, thereby reducing the risk of copyright infringement.

[0682] Examples:

[0683] For example, if a user inputs information like "magical girl anime, battle scene" and the emotion engine recognizes the user's state of excitement, the server will generate a plot based on this information. The plot generated by the AI ​​engine will be a dynamic battle scene that reflects the user's excited emotions. The AI ​​will then automatically generate illustrations based on this plot, featuring intense action scenes and flashy effects. When a user uploads a drawing of a magical girl character they created, the AI ​​analyzes the drawing style and applies a consistent style to other pages. Finally, the generated doujinshi is stored in the cloud and can only be viewed through a dedicated app.

[0684] Example 2

[0685] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0686] Creating modern fanzines requires a lot of time and effort, and requires technical knowledge and skills. This makes it difficult for beginners and busy users to create high-quality content. Furthermore, there is no method for automatically creating personalized content that reflects user emotions, making it difficult to increase user satisfaction. The present invention aims to provide a system that solves these problems.

[0687] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for a user to input information, means for transmitting the input information to the server, means for generating a plot based on the information received by the server, means for automatically generating an illustration based on the generated plot, means for saving the illustration in cloud storage, means for viewing the saved illustration via a dedicated app, means for preventing duplication and screenshots of the illustration by the dedicated app, an emotion engine for acquiring user emotion data, means for transmitting the acquired emotion data to the server, and means for adjusting the plot based on the emotion data. This enables users to easily create high-quality doujinshi and further makes it possible to provide personalized content that reflects the user's emotions.

[0688] "User" refers to an individual who uses a dedicated application to input information and generate and view doujinshi.

[0689] "Server" refers to a computer system that receives information and emotional data entered by users, generates plots and illustrations based on this information, and stores them in cloud storage.

[0690] "Terminal" refers to the device (e.g., smartphone, tablet, or PC) used by a user to enter information and transmit data to a server.

[0691] "Specialized application" refers to the software that users use to enter information and view the generated doujinshi.

[0692] An "emotion engine" refers to a device or software that analyzes a user's facial expressions and tone of voice to obtain emotional data.

[0693] "Plot" refers to the narrative storyline that is generated by the server based on the information and emotional data received.

[0694] "Illustrations" refer to paintings of characters and backgrounds that are automatically created by an AI engine based on the generated plot.

[0695] "Cloud storage" refers to an online storage service that stores created illustrations and doujinshi on the Internet and makes them accessible to specific users.

[0696] "Secure communication protocol" refers to a communication protocol (e.g., HTTPS) that ensures data security when sending and receiving information.

[0697] "Access control measures" refers to security features that allow only specific user IDs to access doujinshi stored in cloud storage.

[0698] "Art style" refers to the unique style or technique of the picture uploaded by the user.

[0699] "Analysis" refers to the process of conducting a detailed analysis of the input information, emotional data, and style of the uploaded artwork, and generating plots and illustrations that reflect these.

[0700] "Personalized content" refers to stories and illustrations tailored to individual preferences, reflecting user input and emotional data.

[0701] The present invention is a system that automatically generates high-quality fanzines by allowing a user to input the title of an original work and a preferred situation. An embodiment of the system will be described below in detail.

[0702] This system mainly consists of a server, a terminal, an emotion engine, and a user, all of which work together. The server operates in a cloud environment and processes and stores data. The terminal is a device used by the user to input information and send the data to the server. The emotion engine is software or hardware that analyzes the user's facial expressions and tone of voice to obtain emotion data.

[0703] First, the user installs the dedicated application on their device and launches it. The user selects the "Create a new doujinshi" option and enters the title of the original work and their preferred situation. This information is then sent from the device to the server using a secure communication protocol (e.g., HTTPS).

[0704] Next, the emotion engine analyzes the user's facial expressions and tone of voice in real time to obtain emotional data. This emotional data is also sent from the device to the server. The server receives this information, and the AI ​​engine generates a story plot based on it. The emotional data also adjusts the plot to match the user's emotions. For example, if the user is expressing positive emotions, a plot that includes elements of a happy ending is generated.

[0705] Based on the generated plot, the server's AI engine automatically generates illustrations of characters and backgrounds. This allows scenes and characters to be drawn according to the situation. Users can also upload their own drawings using a dedicated app. The user's device sends this uploaded data to the server, which analyzes it. The analyzed art style is then applied to the illustrations on other pages.

[0706] The generated doujinshi data is stored in cloud storage by a server. Access control measures are implemented to ensure that only users with specific user IDs can access this stored doujinshi. Users can access the cloud storage and view the generated doujinshi through a dedicated app. The dedicated app also has security features that prevent screenshots and duplication, reducing the risk of copyright infringement.

[0707] As a concrete example, consider the case where a user inputs the information "magical girl anime, battle scene" and the emotion engine recognizes that the user is excited. The server receives this information and emotion data, and the AI ​​engine generates a more dynamic battle scene plot. Next, the AI ​​engine draws illustrations of the characters and background based on the plot. The user uploads a drawing of a magical girl they have drawn, and the AI ​​analyzes the style of this drawing and applies a consistent style to other illustrations. Finally, the generated doujinshi is stored in the cloud and can only be viewed using a dedicated app.

[0708] Example prompt sentence:

[0709] "Based on the battle scenes of magical girl anime, please generate a dynamic plot that reflects the excitement of the characters. Please also automatically generate illustrations of the characters and backgrounds."

[0710] This allows users to easily create high-quality fanzines, and also makes it possible to provide personalized content that reflects the user's emotions.

[0711] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0712] Step 1:

[0713] The user launches the dedicated application and selects the "Create a new doujinshi" option. The user enters the "original title" and "preferred situation" and presses the send button. The input data may include, for example, "magical girl anime" and "battle scene." The device then sends the entered information to the server using a secure communication protocol (e.g., HTTPS).

[0714] Input: Original title, situation

[0715] Output: Data sent to the server

[0716] How it works: Using a device such as a smartphone or PC, the user inputs the title of the original work and their preferred situation into the application and presses the data transmission button. The device then sends this information to the server using HTTPS.

[0717] Step 2:

[0718] The emotion engine analyzes the user's facial expressions and tone of voice in real time to obtain emotional data. This analysis is performed using input devices such as a camera and microphone. The obtained emotional data is then sent from the device to a server.

[0719] Input: User's facial expression data, tone of voice

[0720] Output: Data sent to the server (emotion data)

[0721] How it works: The user provides facial expressions and tone of voice to the emotion engine in real time via the device's camera and microphone. The emotion engine analyzes these and generates emotion data such as positive, negative, and excited, which is then sent to the server via the device.

[0722] Step 3:

[0723] The server analyzes the original information, situation, and emotional data it receives. The AI ​​engine generates a story plot based on this information. If the user expresses positive emotions, the plot is adjusted based on the emotional data, such as adding a happy ending to the story.

[0724] Input: Original story information, situation, emotional data

[0725] Output: Story plot

[0726] Specific operation: The server passes the received data to an AI engine, which then analyzes the data and generates a story plot. For example, based on the emotional data "magical girl anime, battle scene" and "excitement," it generates a plot including a dynamic battle scene.

[0727] Step 4:

[0728] The server's AI engine automatically generates character and background illustrations based on the generated plot, drawing scenes and characters according to the situation.

[0729] Input: Story plot

[0730] Output: Illustration data

[0731] Specific operation: Based on the story plot generated by the AI ​​engine, character and background illustrations are drawn. For example, the actions of magical girls in battle scenes and the set background (such as a ruined city) are automatically generated.

[0732] Step 5:

[0733] Users upload their own drawings using a dedicated app. The device then sends the uploaded image data to the server. The server analyzes the image, and an AI engine learns the artist's style and applies it to illustrations on other pages.

[0734] Input: A picture drawn by the user

[0735] Output: Analyzed art style data

[0736] How it works: Users take a photo of a hand-drawn character drawing with their smartphone camera and upload it through the app. The device then sends the data to the server, which uses an AI engine to analyze the drawing style and apply it to illustrations on other pages.

[0737] Step 6:

[0738] The server stores the created doujinshi in cloud storage, and access control measures are applied to the stored doujinshi so that only users with specific user IDs can access them.

[0739] Input: Generated fanzine data

[0740] Output: Doujinshi data stored in cloud storage

[0741] Specific operation: The server stores the generated doujinshi data in cloud storage and sets a unique access key for each page so that only specific users can view it.

[0742] Step 7:

[0743] Users access the cloud storage through a dedicated app and view the created doujinshi. The app has security features to prevent screenshots and duplication.

[0744] Input: Doujinshi data stored in cloud storage

[0745] Output: The fanzine that the user views

[0746] Specific operation: When a user opens a doujinshi within the app and views a page, controls such as disabling screen capture and duplication are implemented.

[0747] (Application example 2)

[0748] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0749] Conventional automatic doujinshi generation systems have difficulty generating personalized content that takes user emotions into account. They also lack the functionality to reflect user-drawn illustrations, making it difficult to generate doujinshi that incorporate individual artistic styles. Furthermore, information security and access control were insufficient, raising the risk of copyright infringement.

[0750] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for inputting information, means for transmitting the input information to the server, means for generating a plot based on the information received by the server, means for automatically generating an illustration based on the generated plot, means for recognizing the user's emotion, means for reflecting the recognized emotion in the generated plot, means for saving the illustration in cloud storage, means for viewing the saved illustration via a dedicated app, and means for the dedicated app to prevent copying or screenshotting of the illustration. This makes it possible to automatically generate individual plots and illustrations that reflect the user's emotion and to save and view them in a secure environment.

[0751] "Information" refers to data entered by the user, such as the title of the original work and preferred situations.

[0752] A "plot" is an outline that shows the structure and development of a story.

[0753] An "illustration" is an image that visually represents a story, character, landscape, etc.

[0754] A "server" is a computer system that receives and processes information sent by users.

[0755] "Emotion" refers to the user's feelings and mood, and is a psychological state that can be analyzed from facial expressions, tone of voice, etc.

[0756] "Cloud storage" refers to remote servers where data can be stored and accessed over the internet.

[0757] A "dedicated app" is a specific application for displaying and manipulating content generated by the system of the present invention.

[0758] A "secure communication protocol" is a communication method that encrypts communication data to prevent it from being read by third parties.

[0759] "Access control" refers to security measures that ensure that only users with specific privileges can access data.

[0760] This embodiment of the present invention describes a system for automatically generating personalized fanzines that reflect a user's emotions. This system allows the user to input the title of the original work and their preferred situations, and then generates a plot based on that information and automatically generates illustrations. In particular, emotion recognition is performed and reflected in the plot generation, generating content that reflects the user's emotions.

[0761] 1. System Configuration

[0762] The system consists of the following major hardware and software components:

[0763] User device: A device (such as a smartphone or tablet) through which a user enters information.

[0764] Server: A central processing unit that receives information and generates plots and illustrations.

[0765] Emotion engine: A system for analyzing emotions from the user's facial expressions, tone of voice, etc.

[0766] Cloud storage: A data storage system that stores the generated doujinshi and controls access.

[0767] Dedicated app: An application for users to view doujinshi.

[0768] 2. Data processing and calculation

[0769] User device:

[0770] The user launches the application and enters the original title and their preferred situation.

[0771] To recognize emotions, a camera and microphone record the user's facial expressions and tone of voice.

[0772] The input information and emotional data are sent to the server using a secure communication protocol (e.g., HTTPS).

[0773] server:

[0774] The received original information and situation information are analyzed, and a plot is generated using a generative AI model.

[0775] Based on emotional data, the plot content reflects the user's emotions.

[0776] Based on the plot, AI is used to automatically generate illustrations of characters and backgrounds.

[0777] When a user uploads a drawing they have drawn, the AI ​​analyzes the style and applies a consistent style to the illustrations on other pages.

[0778] Cloud Storage:

[0779] The completed doujinshi will be stored in cloud storage.

[0780] Access control is implemented so that only specific user IDs can access it.

[0781] Dedicated app:

[0782] Users access cloud storage through a dedicated app.

[0783] The app has security features to prevent screenshots and duplication.

[0784] 3. Examples and prompts

[0785] For example, if a user inputs an "adventure fantasy story plot" and a "moving scene" and the camera detects that the user is smiling, the system generates a happy-ending adventure fantasy story and character illustrations, resulting in a high-quality doujinshi that reflects the user's emotions.

[0786] Example prompt sentence:

[0787] "Adventure fantasy, moving scenes"

[0788] "A world of magic and adventure, an episode of a brave warrior"

[0789] This makes it possible to create a personalized doujinshi that meets the needs and emotions of the user.

[0790] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0791] Step 1:

[0792] The user launches the dedicated app. They input the title of the original work and their preferred situation, then press the send button. The input information is sent from the device to the server. The input data is configured as a prompt message and sent using a secure communication protocol (HTTPS).

[0793] Input: Original title and situation

[0794] Output: Input data sent to the server

[0795] Step 2:

[0796] The emotion engine uses the camera and microphone to analyze the user's facial expressions and tone of voice, and the emotional data obtained by the emotion engine is sent from the device to the server.

[0797] Input: User's facial expression and tone of voice data

[0798] Output: Emotion data sent to the server

[0799] Step 3:

[0800] The server analyzes the original story information, situation information, and emotional data it receives. It then uses a generative AI model to generate a plot that reflects the user's emotions. Based on the emotional data in particular, the plot content is adjusted to a tone that matches the user's emotions.

[0801] Input: Original title, situation, emotional data

[0802] Output: The generated plot

[0803] Step 4:

[0804] The server automatically generates illustrations based on the generated plot. Specifically, AI is used to draw character designs, backgrounds, and scene illustrations.

[0805] Input: Generated plot

[0806] Output: Automatically generated illustrations

[0807] Step 5:

[0808] Users upload their own drawings using a dedicated app, and the device sends the uploaded image data to the server.

[0809] Input: A picture drawn by the user

[0810] Output: Picture data sent to the server

[0811] Step 6:

[0812] The server analyzes the received image data, and the AI ​​engine learns the artist's style. This style is then reflected in the illustrations on other pages, maintaining a consistent design.

[0813] Input: User's drawing data

[0814] Output: Illustrations of other pages that reflect the same style

[0815] Step 7:

[0816] The server stores the generated doujinshi in cloud storage. The stored data is subject to access control so that only users with specific user IDs can access it.

[0817] Input: Finished doujinshi

[0818] Output: Doujinshi data saved in cloud storage

[0819] Step 8:

[0820] Users access the cloud storage through a dedicated app and view the created doujinshi. The app is equipped with security features to prevent screenshots and duplication, reducing the risk of copyright infringement.

[0821] Input: Access to doujinshi data in cloud storage

[0822] Output: Doujinshi that can be viewed using a dedicated app

[0823] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0824] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0825] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0826] [Third embodiment]

[0827] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0828] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0829] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0830] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0831] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0832] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0833] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0834] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0835] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0836] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0837] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0838] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0839] The present invention is a system that can automatically generate high-quality doujinshi by users by inputting the title of the original work and their preferred situation. This system operates in cooperation with a server, terminals, and users.

[0840] The system of the present invention is configured as follows:

[0841] 1. The stage where the user inputs information about the original work and the situation

[0842] The user launches a dedicated application and selects to create a new doujinshi.

[0843] The user inputs the "original title" and "preferred situation" and confirms it.

[0844] The device sends the entered information to the server, using a secure communication protocol (e.g., HTTPS) to ensure the safety of the data.

[0845] 2. The server analyzes the input and generates the plot.

[0846] The server receives input data from the user and the AI ​​engine analyzes the information.

[0847] The AI ​​engine references the database based on the "original title" and generates a plot for the "situation" specified by the user.

[0848] For example, if a user inputs "magical girl anime, school festival episode," the server's AI will create a storyline that suits this.

[0849] 3. Automatically generate illustrations

[0850] The server's AI automatically draws characters and backgrounds based on the generated plot.

[0851] For example, this includes the background and stage of the school festival scene, and the costumes of specific characters.

[0852] 4. Uploading user's artwork and analyzing its style

[0853] Users upload their own drawings using a dedicated app.

[0854] The device sends the uploaded data to the server.

[0855] Based on the image received by the server, the AI ​​analyzes the style of the artwork and reflects this style in the illustrations on other pages.

[0856] 5. Preserving Doujinshi and Restricting Access

[0857] The server stores the generated doujinshi in cloud storage.

[0858] At the same time, doujinshi will only be viewable using a dedicated app, and the app will be equipped with security features to prevent screenshots and duplication.

[0859] For example, if a user enters the information "Original work: magical girl anime, Situation: battle scene," the following process takes place. When the user enters the information and sends it from their device to the server, the server's AI generates a plot for the battle scene based on that information. Next, the AI ​​automatically generates character and background illustrations based on this plot. Furthermore, if the user uploads a character drawing they have drawn themselves, the AI ​​analyzes the style of that drawing and reflects it in other illustrations. Finally, the generated doujinshi is stored in the cloud and can only be viewed using a dedicated app. This dedicated app is equipped with features to prevent screenshots and duplication, reducing the risk of copyright infringement.

[0860] The processing flow will be explained below.

[0861] Step 1:

[0862] The user launches the dedicated app. The user clicks the "Create a new doujinshi" button. The user then enters the "original title" and "preferred situation" and confirms it.

[0863] Step 2:

[0864] The device sends the entered data ("original title" and "preferred situation") to the server. This communication uses a secure protocol (e.g., HTTPS), ensuring the safety of the data.

[0865] Step 3:

[0866] The server analyzes the data received from the user, and the AI ​​engine inside the server uses this information to refer to a pre-trained database and generate a plot appropriate for the situation specified by the user.

[0867] Step 4:

[0868] The server's AI engine automatically generates character and background illustrations based on the generated plot. The AI ​​draws scenes and characters according to the situation.

[0869] Step 5:

[0870] Users can upload their own drawings using a dedicated app, allowing them to provide the system with their own artistic style.

[0871] Step 6:

[0872] The device sends the image data uploaded by the user to the server, and this communication is also carried out using a secure protocol.

[0873] Step 7:

[0874] The server analyzes the received image data. The AI ​​engine learns the style of the user-provided image and applies that style to the illustrations on other pages.

[0875] Step 8:

[0876] The server stores the generated doujinshi in cloud storage. The stored doujinshi data is subject to access control so that only users with specific user IDs can access it.

[0877] Step 9:

[0878] Users access the cloud storage through a dedicated app and view the created doujinshi. The app has security features to prevent screenshots and duplication, reducing the risk of copyright infringement.

[0879] As a concrete example, consider the case where a user inputs the information "magical girl anime, battle scene." The server receives this information, and the AI ​​engine generates a plot for the battle scene and draws appropriate character and background illustrations based on that plot. When the user uploads a picture of a magical girl they have drawn, the AI ​​analyzes the style of this drawing and applies a consistent style to other pages. Finally, the generated doujinshi is stored in the cloud and can only be viewed using a dedicated app.

[0880] Example 1

[0881] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0882] Conventional doujinshi generation systems require users to manually create illustrations and stories, which requires a great deal of time and effort. It is also difficult to ensure a consistent style for the generated content, and from the perspective of copyright protection, the prevention of screenshots and duplication is insufficient. There is a need to provide an efficient, high-quality doujinshi generation system that solves these issues.

[0883] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0884] In this invention, the server includes a means for receiving information and generating a plot, a means for automatically generating illustrations based on the generated plot, and a means for saving the illustrations in cloud storage. This allows users to efficiently generate high-quality fanzines and create illustrations with a consistent style, while also enabling them to view the illustrations through a dedicated program equipped with security features to prevent screenshots and duplication.

[0885] "Means for inputting information" refers to a means by which a user can input specific information (e.g., the title of an original work or a preferred situation) using a dedicated application or interface.

[0886] The "means for transmitting input information to a server" refers to a means for transmitting information input by a user to a server via a communication network such as the Internet using a secure protocol.

[0887] "Means for generating a plot based on information received by the server" refers to means for the server to use an AI engine or algorithm to generate a specific story development or plot based on information sent by the user.

[0888] "Means for automatically generating illustrations based on the generated plot" refers to means for automatically drawing illustrations of characters and backgrounds corresponding to the generated plot using the server's AI engine or graphics generation tool.

[0889] "Means for saving in cloud storage" refers to a means for saving the created illustrations and fanzines in cloud storage on the Internet, making them easy to access and manage.

[0890] "Means for viewing illustrations stored via a dedicated program" refers to means for a user to view illustrations stored in cloud storage via a dedicated application or program.

[0891] "Means for preventing the duplication or screenshotting of illustrations by a dedicated program" refers to a program equipped with security features to prevent illustrations from being illegally duplicated or stolen by screenshotting.

[0892] "Means for uploading content drawn by users" refers to means for users to upload illustrations or pictures they have drawn to a server via a dedicated application.

[0893] "Means for analyzing the style of uploaded content" refers to the means by which the server analyzes the style of illustrations uploaded by users using an AI engine or image analysis technology.

[0894] The "means for reflecting the analyzed style in illustrations on other pages" refers to a means for applying the same style to other automatically generated illustrations based on the analyzed style.

[0895] "Means of transmitting to a server using a secure communication protocol" refers to the use of encryption technology or a secure communication protocol (e.g., HTTPS) to ensure the security of data when a user transmits data from a terminal to a server.

[0896] "Access control measures that allow only specific identification information to access illustrations" are measures to prevent unauthorized access by controlling the viewing rights of illustrations and doujinshi based on each user's identification information or ID.

[0897] This invention is a system that can automatically generate high-quality doujinshi by users by inputting the title of the original work and their preferred situation. This system operates in cooperation with a server, terminals, and users.

[0898] Hardware and software used:

[0899] Server: A server equipped with a high-performance AI engine and database (e.g., machine learning models, image generation models).

[0900] Device: A user's device (e.g., smartphone, tablet, PC) on which the dedicated application is installed.

[0901] Secure communication protocol: A protocol that uses encryption technology, such as HTTPS.

[0902] Examples of data processing and data calculation

[0903] 1. The stage where the user inputs information about the original work and the situation

[0904] The user launches a dedicated application and selects to create a new doujinshi. The user enters the "original title" and "preferred situation" and confirms it, after which the device sends the entered information to the server. At this time, a secure communication protocol (e.g., HTTPS) is used to ensure the safety of the data.

[0905] As a specific example, the user inputs "Magical girl anime, school festival episode" and presses the send button.

[0906] 2. The server analyzes the input and generates the plot.

[0907] The server receives input data from the user, and the AI ​​engine analyzes the information. The server's AI then references the database and generates a plot for the "situation" specified by the user.

[0908] As a concrete example, the server's AI analyzes "magical girl anime, school festival episode" and combines related story elements from the database to generate a plot for the school festival episode.

[0909] 3. Automatically generate illustrations

[0910] The server's AI automatically draws characters and backgrounds based on the generated plot.

[0911] As a concrete example, the server's AI draws the background, stage, and costumes of specific characters at a school festival, and generates the illustrations that make up each scene.

[0912] 4. Uploading user's artwork and analyzing its style

[0913] Users upload their own character drawings using a dedicated app. The device then sends the uploaded data to the server. The AI ​​analyzes the style of the illustrations received by the server and applies this style to the illustrations on other pages.

[0914] For example, when a user selects an image of a character they have drawn and presses the upload button, the device encrypts the data and sends it to the server, where the server's AI analyzes the image and applies the same style to other illustrations.

[0915] 5. Preserving Doujinshi and Restricting Access

[0916] The server stores the generated doujinshi in cloud storage. The doujinshi can only be viewed using a dedicated app, which has security features to prevent screenshots and duplication.

[0917] For example, the created doujinshi are stored in cloud storage. At the same time, they are set up so that they can only be accessed via a dedicated app. The app is equipped with a function to disable screenshots and technology to prevent duplication, reducing the risk of copyright infringement.

[0918] Prompt Sentence Examples

[0919] Original: Magical Girl Anime

[0920] Situation: School Festival Episode

[0921] Input prompt for the generative AI model:

[0922] "Write a new episode about magical girls at a school festival. The festival will be themed around school activities and feature a magical show."

[0923] This invention allows users to efficiently create high-quality fanzines, and also provides functions for unifying the style of illustrations and protecting copyrights.

[0924] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0925] Step 1:

[0926] The user inputs information about the original work and the situation.

[0927] Input: The user launches the dedicated application and enters the "original title" and "preferred situation."

[0928] Specific operation: The user selects the creation of a new doujinshi in a dedicated application and enters specific information such as "magical girl anime, school festival episode."

[0929] Output: The terminal sends the entered information to the server.

[0930] Step 2:

[0931] The device sends the entered information to the server.

[0932] Input: The user enters the "original title" and "preferred situation" using a dedicated application.

[0933] Specific operation: The device encrypts the entered information using HTTPS and sends it to the server via a secure communication protocol.

[0934] Output: The server receives the information from the user.

[0935] Step 3:

[0936] The server analyzes the input information and generates the plot

[0937] Input: "Original title" and "Favorite situation" received by the server.

[0938] Specific operation: The server's AI engine analyzes the received information, references the database to obtain relevant information, and generates a plot based on the specified situation.

[0939] Output: The generated plot.

[0940] Step 4:

[0941] The server automatically generates illustrations based on the generated plots.

[0942] Input: The generated plot.

[0943] Specific operation: The server's AI engine draws characters and backgrounds based on the plot. For example, it automatically generates the background, stage, and character costumes for a school festival.

[0944] Output: The generated illustration.

[0945] Step 5:

[0946] Users can upload their own drawings

[0947] Input: A character drawing drawn by the user.

[0948] Specific operation: The user performs operations to upload a picture drawn using a dedicated application.

[0949] Output: The device sends the image it draws to the server.

[0950] Step 6:

[0951] The device sends the uploaded data to the server

[0952] Input: A character drawing drawn by the user.

[0953] What it does: The device encrypts the uploaded data using a secure communication protocol such as HTTPS and sends it to the server.

[0954] Output: The server receives the uploaded image.

[0955] Step 7:

[0956] The server analyzes the style of the image received and applies this style to the illustrations on other pages.

[0957] Input: User-uploaded character illustration.

[0958] How it works: The server's AI engine analyzes the received image and applies its artistic style to other illustrations, for example by identifying a specific style or color palette and matching it to other automatically generated illustrations.

[0959] Output: Illustrations with a consistent style.

[0960] Step 8:

[0961] The server saves the generated doujinshi to cloud storage.

[0962] Input: A doujinshi that combines automatically generated illustrations and a plot.

[0963] Specific operation: The server uploads the completed doujinshi to cloud storage and saves it.

[0964] Output: A fanzine saved in cloud storage.

[0965] Step 9:

[0966] Doujinshi can only be viewed using a dedicated application, and security features are implemented.

[0967] Input: Doujinshi saved in cloud storage.

[0968] Specific operation: The server sets access permissions for the doujinshi so that it can only be viewed using a dedicated application. It also implements security features to prevent screenshots and duplication.

[0969] Output: The doujinshi can be viewed through a dedicated application with security features enabled.

[0970] (Application example 1)

[0971] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0972] Conventional content generation systems require users to manually create and edit plots and illustrations, which is time-consuming and labor-intensive. They also lack sufficient security features to limit the distribution of generated content to specific users, posing a risk of copyright infringement. Furthermore, they lack effective means to prevent users from applying the same style of their drawings to other illustrations or from copying or taking screenshots of generated content.

[0973] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0974] In this invention, the server includes means for inputting information, means for transmitting the input information to the server, means for generating a plot based on the information received by the server, means for automatically generating illustrations based on the generated plot, means for saving the illustrations in cloud storage, means for viewing the saved illustrations and generated content via a dedicated application, means for preventing copying and screenshots of the illustrations and generated content by the dedicated application, and access control means for distributing content only to specified users. This makes it possible to automatically generate high-quality doujinshi and distribute them with enhanced security.

[0975] The "means for inputting information" refers to a device or software that allows the user to input information such as the title of the original work and a preferred situation.

[0976] The "means for transmitting information to a server" is a device or software that transfers the information entered by the user to the server using a secure communication protocol.

[0977] A "plot generation means" is a device or software that uses an AI engine to automatically create story developments and situations based on received information.

[0978] A "means for automatically generating illustrations" is a device or software that automatically depicts images of characters and backgrounds based on a generated plot.

[0979] "Cloud storage means" refers to devices or software that securely store generated illustrations and content in online data storage.

[0980] "Specialized application" means software for a specific device for viewing generated illustrations and content.

[0981] "Measures to prevent copying and screenshots" refers to technologies that prevent the generated content from being illegally copied or saved as a screenshot.

[0982] "Access control means" is a technology that authenticates a specific user ID and allows only that user to access the generated illustrations and content.

[0983] "Means for uploading user-drawn illustrations" refers to a device or software that allows users to upload hand-drawn illustrations to the cloud.

[0984] "Means for analyzing art style" refers to a technology that uses AI to analyze the style of art uploaded by users.

[0985] "Means of reflecting on illustrations on other pages" refers to a technique for applying the analyzed style and art style to other automatically generated illustrations.

[0986] The present invention is a system that automatically generates high-quality doujinshi and content by allowing users to input the title of the original work and their preferred situation, and distributes them exclusively to specific users. Specific implementation methods of this system are described in detail below.

[0987] The present invention is configured using the following hardware and software: The hardware includes a server and a smartphone, and the software uses Python, TensorFlow (AI model), Google Cloud Storage (cloud storage), Firebase (real-time database and authentication), and HTTPS (secure communication).

[0988] 1. Enter user information

[0989] First, users launch the dedicated application on their smartphone and input the title of the original work and their preferred situation. This information is then sent to the server via the application using a secure communication protocol (HTTPS).

[0990] 2. Receiving data from the server and generating plots

[0991] The server receives the data sent by the user and generates a plot using an AI engine (TensorFlow) based on that information. For example, if a user inputs "magical girl anime, school festival episode," the server's AI analyzes this and creates an appropriate storyline.

[0992] 3. Automatic generation of illustrations

[0993] Based on the generated plot, the server's AI automatically creates illustrations of characters and backgrounds. For example, the background of a school festival scene and the costumes of specific characters are automatically generated.

[0994] 4. Uploading user drawings and reflecting their own style

[0995] Users can upload their own drawings using a dedicated application. The uploaded drawing is sent to a server, where the AI ​​analyzes the drawing style. The analyzed drawing style is then reflected in other generated illustrations.

[0996] 5. Content Storage and Distribution

[0997] The generated doujin content is stored in Google Cloud Storage. Firebase is used to control access so that only specific users can view the content. A dedicated application provides the ability to prevent duplication and screenshots of the created content.

[0998] Examples of concrete examples and prompts

[0999] For example, consider the case where the user inputs "Original story: Super Sentai anime, Situation: Everyday life." In this case, the following prompt is passed to the server's AI:

[1000] Original: Sentai hero anime

[1001] Situation: Everyday life

[1002] User's picture: user_uploaded_image.png

[1003] This allows the server's AI to generate a plot, which is then used to automatically generate character and background illustrations, ultimately resulting in high-quality doujin content that reflects the user's designated art style. The generated content is stored in cloud storage and can only be viewed by specific users via a dedicated application with access control.

[1004] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1005] Step 1:

[1006] The user launches the dedicated application on their smartphone and inputs the original title and their preferred situation. The original title and situation are obtained as input data. The application then sends this data to the server using a secure communication protocol (HTTPS).

[1007] Input: User input of original title and situation

[1008] Output: Original title and situation data sent to the server

[1009] Step 2:

[1010] The server receives the data sent by the user. The received data is passed to an AI engine (TensorFlow) to generate a plot. For example, if the input original title is "Magical Girl Anime" and the situation is "School Festival Episode," the AI ​​will generate a plot.

[1011] Input: Original title and situation data received by the server

[1012] Output: The generated plot

[1013] Step 3:

[1014] Based on the generated plot, the server's AI automatically creates illustrations of characters and backgrounds according to the scenes and situations of the generated plot.

[1015] Input: Generated plot

[1016] Output: Auto-generated illustration

[1017] Step 4:

[1018] Users upload their own drawings via a dedicated application. The uploaded image is sent to a server, which analyzes the image's style. The analyzed style is then reflected in the illustrations on other pages.

[1019] Input: User-uploaded picture (image file)

[1020] Output: Other illustrations that reflect the same style

[1021] Step 5:

[1022] The generated content (plots and illustrations based on them) is stored in Google Cloud Storage, with access control using Firebase to ensure that only specific users can view this content.

[1023] Input: Generated content (plot and illustrations)

[1024] Output: Content and access control information stored in cloud storage

[1025] Step 6:

[1026] Users can view content stored in the cloud through a dedicated application, which is equipped with features to prevent content from being copied or taken screenshots, preventing unauthorized use of the content.

[1027] Input: Content in cloud storage

[1028] Output: Content displayed in a dedicated application

[1029] Through the above steps, a system will be completed that automatically generates high-quality doujinshi and content based on information entered by users, and can then be safely distributed and viewed.

[1030] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1031] This invention is a system that can automatically generate high-quality doujinshi by having users input the title of the original work and their favorite situations. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to generate more personalized doujinshi. This system operates in cooperation with the server, terminals, emotion engine, and users.

[1032] The system of the present invention is configured as follows:

[1033] 1. The stage where the user inputs information about the original work and the situation

[1034] The user launches a dedicated application and selects to create a new doujinshi.

[1035] The user inputs the "original title" and "preferred situation" and confirms it.

[1036] The device sends the entered information to the server, using a secure communication protocol (e.g., HTTPS) to ensure the safety of the data.

[1037] 2. Acquiring emotional data using the emotion engine

[1038] The emotion engine analyzes the user's facial expressions and tone of voice to obtain emotional data.

[1039] The terminal transmits the acquired emotion data to the server.

[1040] 3. The server analyzes the input information and emotion data and generates a plot.

[1041] The server receives original information and the situation from the user, and the AI ​​engine generates a plot based on that information.

[1042] Additionally, the server adjusts the plot content based on the emotion data it generates, for example, adding a happy ending to the story if the user expresses positive emotions.

[1043] 4. Automatically generate illustrations

[1044] The server's AI engine automatically generates character and background illustrations based on the generated plot.

[1045] For example, scenes and characters are drawn according to the situation.

[1046] 5. Uploading user's artwork and analyzing its style

[1047] Users upload their own drawings using a dedicated app.

[1048] The device sends the uploaded data to the server.

[1049] The server analyzes the received image data, and the AI ​​engine learns the style and reflects it in the illustrations on other pages.

[1050] 6. Preserving Doujinshi and Restricting Access

[1051] The server stores the generated doujinshi in cloud storage.

[1052] Access control is applied to the saved doujinshi data so that only users with specific user IDs can access it.

[1053] 7. Viewing with a dedicated app

[1054] Users access the cloud storage through a dedicated app and view the generated doujinshi.

[1055] The dedicated app has security features that prevent screenshots and duplication, reducing the risk of copyright infringement.

[1056] As a concrete example, consider the case where a user inputs the information "magical girl anime, battle scene" and the emotion engine recognizes that the user is excited. The server receives this information and emotion data, and the AI ​​engine generates a more dynamic battle scene plot. Next, the AI ​​draws character and background illustrations based on that plot. When a user uploads a drawing of a magical girl they have drawn, the AI ​​analyzes the style of this drawing and applies a consistent style to other illustrations. Finally, the generated doujinshi is stored in the cloud and can only be viewed using a dedicated app.

[1057] The processing flow will be explained below.

[1058] Step 1:

[1059] The user launches the dedicated app, clicks the "Create a new doujinshi" button, enters the "original title" and "preferred situation," and confirms.

[1060] Step 2:

[1061] The device sends the input data ("original title" and "preferred situation") to the server. At this time, a secure communication protocol (e.g., HTTPS) is used to ensure the safety of the data.

[1062] Step 3:

[1063] The emotion engine analyzes the user's facial expressions and tone of voice to obtain the user's emotional data (e.g., collected in real time via a camera or microphone).

[1064] Step 4:

[1065] The device transmits the acquired emotion data to the server, which is also transmitted using a secure protocol.

[1066] Step 5:

[1067] The server receives information about the original work, the situation, and emotional data from the user. The AI ​​engine inside the server comprehensively analyzes this information.

[1068] Step 6:

[1069] The server's AI engine generates a plot based on the received information, and adjusts the plot content according to the user's emotional data (e.g., adding a happy ending if the emotion is positive).

[1070] Step 7:

[1071] The server's AI engine automatically generates character and background illustrations based on the generated plot, drawing scenes and characters according to the situation.

[1072] Step 8:

[1073] Users upload their own drawings using a dedicated app, providing the system with their own character illustrations.

[1074] Step 9:

[1075] The device sends the image data uploaded by the user to the server, and this communication is also carried out using a secure protocol.

[1076] Step 10:

[1077] The server analyzes the received image data. The AI ​​engine analyzes the user's style and reflects that style in the illustrations on other pages.

[1078] Step 11:

[1079] The server stores the generated doujinshi in cloud storage, where access control is applied so that only users with specific user IDs can access the stored doujinshi.

[1080] Step 12:

[1081] Users access the cloud storage and view the created doujinshi through a dedicated app, which has security features to prevent screenshots and duplication, thereby reducing the risk of copyright infringement.

[1082] Examples:

[1083] For example, if a user inputs information like "magical girl anime, battle scene" and the emotion engine recognizes the user's state of excitement, the server will generate a plot based on this information. The plot generated by the AI ​​engine will be a dynamic battle scene that reflects the user's excited emotions. The AI ​​will then automatically generate illustrations based on this plot, featuring intense action scenes and flashy effects. When a user uploads a drawing of a magical girl character they created, the AI ​​analyzes the drawing style and applies a consistent style to other pages. Finally, the generated doujinshi is stored in the cloud and can only be viewed through a dedicated app.

[1084] Example 2

[1085] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1086] Creating modern fanzines requires a lot of time and effort, and requires technical knowledge and skills. This makes it difficult for beginners and busy users to create high-quality content. Furthermore, there is no method for automatically creating personalized content that reflects user emotions, making it difficult to increase user satisfaction. The present invention aims to provide a system that solves these problems.

[1087] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for a user to input information, means for transmitting the input information to the server, means for generating a plot based on the information received by the server, means for automatically generating an illustration based on the generated plot, means for saving the illustration in cloud storage, means for viewing the saved illustration via a dedicated app, means for preventing duplication and screenshots of the illustration by the dedicated app, an emotion engine for acquiring user emotion data, means for transmitting the acquired emotion data to the server, and means for adjusting the plot based on the emotion data. This enables users to easily create high-quality doujinshi and further makes it possible to provide personalized content that reflects the user's emotions.

[1088] "User" refers to an individual who uses a dedicated application to input information and generate and view doujinshi.

[1089] "Server" refers to a computer system that receives information and emotional data entered by users, generates plots and illustrations based on this information, and stores them in cloud storage.

[1090] "Terminal" refers to the device (e.g., smartphone, tablet, or PC) used by a user to enter information and transmit data to a server.

[1091] "Specialized application" refers to the software that users use to enter information and view the generated doujinshi.

[1092] An "emotion engine" refers to a device or software that analyzes a user's facial expressions and tone of voice to obtain emotional data.

[1093] "Plot" refers to the narrative storyline that is generated by the server based on the information and emotional data received.

[1094] "Illustrations" refer to paintings of characters and backgrounds that are automatically created by an AI engine based on the generated plot.

[1095] "Cloud storage" refers to an online storage service that stores created illustrations and doujinshi on the Internet and makes them accessible to specific users.

[1096] "Secure communication protocol" refers to a communication protocol (e.g., HTTPS) that ensures data security when sending and receiving information.

[1097] "Access control measures" refers to security features that allow only specific user IDs to access doujinshi stored in cloud storage.

[1098] "Art style" refers to the unique style or technique of the picture uploaded by the user.

[1099] "Analysis" refers to the process of conducting a detailed analysis of the input information, emotional data, and style of the uploaded artwork, and generating plots and illustrations that reflect these.

[1100] "Personalized content" refers to stories and illustrations tailored to individual preferences, reflecting user input and emotional data.

[1101] The present invention is a system that automatically generates high-quality fanzines by allowing a user to input the title of an original work and a preferred situation. An embodiment of the system will be described below in detail.

[1102] This system mainly consists of a server, a terminal, an emotion engine, and a user, all of which work together. The server operates in a cloud environment and processes and stores data. The terminal is a device used by the user to input information and send the data to the server. The emotion engine is software or hardware that analyzes the user's facial expressions and tone of voice to obtain emotion data.

[1103] First, the user installs the dedicated application on their device and launches it. The user selects the "Create a new doujinshi" option and enters the title of the original work and their preferred situation. This information is then sent from the device to the server using a secure communication protocol (e.g., HTTPS).

[1104] Next, the emotion engine analyzes the user's facial expressions and tone of voice in real time to obtain emotional data. This emotional data is also sent from the device to the server. The server receives this information, and the AI ​​engine generates a story plot based on it. The emotional data also adjusts the plot to match the user's emotions. For example, if the user is expressing positive emotions, a plot that includes elements of a happy ending is generated.

[1105] Based on the generated plot, the server's AI engine automatically generates illustrations of characters and backgrounds. This allows scenes and characters to be drawn according to the situation. Users can also upload their own drawings using a dedicated app. The user's device sends this uploaded data to the server, which analyzes it. The analyzed art style is then applied to the illustrations on other pages.

[1106] The generated doujinshi data is stored in cloud storage by a server. Access control measures are implemented to ensure that only users with specific user IDs can access this stored doujinshi. Users can access the cloud storage and view the generated doujinshi through a dedicated app. The dedicated app also has security features that prevent screenshots and duplication, reducing the risk of copyright infringement.

[1107] As a concrete example, consider the case where a user inputs the information "magical girl anime, battle scene" and the emotion engine recognizes that the user is excited. The server receives this information and emotion data, and the AI ​​engine generates a more dynamic battle scene plot. Next, the AI ​​engine draws illustrations of the characters and background based on the plot. The user uploads a drawing of a magical girl they have drawn, and the AI ​​analyzes the style of this drawing and applies a consistent style to other illustrations. Finally, the generated doujinshi is stored in the cloud and can only be viewed using a dedicated app.

[1108] Example prompt sentence:

[1109] "Based on the battle scenes of magical girl anime, please generate a dynamic plot that reflects the excitement of the characters. Please also automatically generate illustrations of the characters and backgrounds."

[1110] This allows users to easily create high-quality fanzines, and also makes it possible to provide personalized content that reflects the user's emotions.

[1111] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1112] Step 1:

[1113] The user launches the dedicated application and selects the "Create a new doujinshi" option. The user enters the "original title" and "preferred situation" and presses the send button. The input data may include, for example, "magical girl anime" and "battle scene." The device then sends the entered information to the server using a secure communication protocol (e.g., HTTPS).

[1114] Input: Original title, situation

[1115] Output: Data sent to the server

[1116] How it works: Using a device such as a smartphone or PC, the user inputs the title of the original work and their preferred situation into the application and presses the data transmission button. The device then sends this information to the server using HTTPS.

[1117] Step 2:

[1118] The emotion engine analyzes the user's facial expressions and tone of voice in real time to obtain emotional data. This analysis is performed using input devices such as a camera and microphone. The obtained emotional data is then sent from the device to a server.

[1119] Input: User's facial expression data, tone of voice

[1120] Output: Data sent to the server (emotion data)

[1121] How it works: The user provides facial expressions and tone of voice to the emotion engine in real time via the device's camera and microphone. The emotion engine analyzes these and generates emotion data such as positive, negative, and excited, which is then sent to the server via the device.

[1122] Step 3:

[1123] The server analyzes the original information, situation, and emotional data it receives. The AI ​​engine generates a story plot based on this information. If the user expresses positive emotions, the plot is adjusted based on the emotional data, such as adding a happy ending to the story.

[1124] Input: Original story information, situation, emotional data

[1125] Output: Story plot

[1126] Specific operation: The server passes the received data to an AI engine, which then analyzes the data and generates a story plot. For example, based on the emotional data "magical girl anime, battle scene" and "excitement," it generates a plot including a dynamic battle scene.

[1127] Step 4:

[1128] The server's AI engine automatically generates character and background illustrations based on the generated plot, drawing scenes and characters according to the situation.

[1129] Input: Story plot

[1130] Output: Illustration data

[1131] Specific operation: Based on the story plot generated by the AI ​​engine, character and background illustrations are drawn. For example, the actions of magical girls in battle scenes and the set background (such as a ruined city) are automatically generated.

[1132] Step 5:

[1133] Users upload their own drawings using a dedicated app. The device then sends the uploaded image data to the server. The server analyzes the image, and an AI engine learns the artist's style and applies it to illustrations on other pages.

[1134] Input: A picture drawn by the user

[1135] Output: Analyzed art style data

[1136] How it works: Users take a photo of a hand-drawn character drawing with their smartphone camera and upload it through the app. The device then sends the data to the server, which uses an AI engine to analyze the drawing style and apply it to illustrations on other pages.

[1137] Step 6:

[1138] The server stores the created doujinshi in cloud storage, and access control measures are applied to the stored doujinshi so that only users with specific user IDs can access them.

[1139] Input: Generated fanzine data

[1140] Output: Doujinshi data stored in cloud storage

[1141] Specific operation: The server stores the generated doujinshi data in cloud storage and sets a unique access key for each page so that only specific users can view it.

[1142] Step 7:

[1143] Users access the cloud storage through a dedicated app and view the created doujinshi. The app has security features to prevent screenshots and duplication.

[1144] Input: Doujinshi data stored in cloud storage

[1145] Output: The fanzine that the user views

[1146] Specific operation: When a user opens a doujinshi within the app and views a page, controls such as disabling screen capture and duplication are implemented.

[1147] (Application example 2)

[1148] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1149] Conventional automatic doujinshi generation systems have difficulty generating personalized content that takes user emotions into account. They also lack the functionality to reflect user-drawn illustrations, making it difficult to generate doujinshi that incorporate individual artistic styles. Furthermore, information security and access control were insufficient, raising the risk of copyright infringement.

[1150] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for inputting information, means for transmitting the input information to the server, means for generating a plot based on the information received by the server, means for automatically generating an illustration based on the generated plot, means for recognizing the user's emotion, means for reflecting the recognized emotion in the generated plot, means for saving the illustration in cloud storage, means for viewing the saved illustration via a dedicated app, and means for the dedicated app to prevent copying or screenshotting of the illustration. This makes it possible to automatically generate individual plots and illustrations that reflect the user's emotion and to save and view them in a secure environment.

[1151] "Information" refers to data entered by the user, such as the title of the original work and preferred situations.

[1152] A "plot" is an outline that shows the structure and development of a story.

[1153] An "illustration" is an image that visually represents a story, character, landscape, etc.

[1154] A "server" is a computer system that receives and processes information sent by users.

[1155] "Emotion" refers to the user's feelings and mood, and is a psychological state that can be analyzed from facial expressions, tone of voice, etc.

[1156] "Cloud storage" refers to remote servers where data can be stored and accessed over the internet.

[1157] A "dedicated app" is a specific application for displaying and manipulating content generated by the system of the present invention.

[1158] A "secure communication protocol" is a communication method that encrypts communication data to prevent it from being read by third parties.

[1159] "Access control" refers to security measures that ensure that only users with specific privileges can access data.

[1160] This embodiment of the present invention describes a system for automatically generating personalized fanzines that reflect a user's emotions. This system allows the user to input the title of the original work and their preferred situations, and then generates a plot based on that information and automatically generates illustrations. In particular, emotion recognition is performed and reflected in the plot generation, generating content that reflects the user's emotions.

[1161] 1. System Configuration

[1162] The system consists of the following major hardware and software components:

[1163] User device: A device (such as a smartphone or tablet) through which a user enters information.

[1164] Server: A central processing unit that receives information and generates plots and illustrations.

[1165] Emotion engine: A system for analyzing emotions from the user's facial expressions, tone of voice, etc.

[1166] Cloud storage: A data storage system that stores the generated doujinshi and controls access.

[1167] Dedicated app: An application for users to view doujinshi.

[1168] 2. Data processing and calculation

[1169] User device:

[1170] The user launches the application and enters the original title and their preferred situation.

[1171] To recognize emotions, a camera and microphone record the user's facial expressions and tone of voice.

[1172] The input information and emotional data are sent to the server using a secure communication protocol (e.g., HTTPS).

[1173] server:

[1174] The received original information and situation information are analyzed, and a plot is generated using a generative AI model.

[1175] Based on emotional data, the plot content reflects the user's emotions.

[1176] Based on the plot, AI is used to automatically generate illustrations of characters and backgrounds.

[1177] When a user uploads a drawing they have drawn, the AI ​​analyzes the style and applies a consistent style to the illustrations on other pages.

[1178] Cloud Storage:

[1179] The completed doujinshi will be stored in cloud storage.

[1180] Access control is implemented so that only specific user IDs can access it.

[1181] Dedicated app:

[1182] Users access cloud storage through a dedicated app.

[1183] The app has security features to prevent screenshots and duplication.

[1184] 3. Examples and prompts

[1185] For example, if a user inputs an "adventure fantasy story plot" and a "moving scene" and the camera detects that the user is smiling, the system generates a happy-ending adventure fantasy story and character illustrations, resulting in a high-quality doujinshi that reflects the user's emotions.

[1186] Example prompt sentence:

[1187] "Adventure fantasy, moving scenes"

[1188] "A world of magic and adventure, an episode of a brave warrior"

[1189] This makes it possible to create a personalized doujinshi that meets the needs and emotions of the user.

[1190] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1191] Step 1:

[1192] The user launches the dedicated app. They input the title of the original work and their preferred situation, then press the send button. The input information is sent from the device to the server. The input data is configured as a prompt message and sent using a secure communication protocol (HTTPS).

[1193] Input: Original title and situation

[1194] Output: Input data sent to the server

[1195] Step 2:

[1196] The emotion engine uses the camera and microphone to analyze the user's facial expressions and tone of voice, and the emotional data obtained by the emotion engine is sent from the device to the server.

[1197] Input: User's facial expression and tone of voice data

[1198] Output: Emotion data sent to the server

[1199] Step 3:

[1200] The server analyzes the original story information, situation information, and emotional data it receives. It then uses a generative AI model to generate a plot that reflects the user's emotions. Based on the emotional data in particular, the plot content is adjusted to a tone that matches the user's emotions.

[1201] Input: Original title, situation, emotional data

[1202] Output: The generated plot

[1203] Step 4:

[1204] The server automatically generates illustrations based on the generated plot. Specifically, AI is used to draw character designs, backgrounds, and scene illustrations.

[1205] Input: Generated plot

[1206] Output: Automatically generated illustrations

[1207] Step 5:

[1208] Users upload their own drawings using a dedicated app, and the device sends the uploaded image data to the server.

[1209] Input: A picture drawn by the user

[1210] Output: Picture data sent to the server

[1211] Step 6:

[1212] The server analyzes the received image data, and the AI ​​engine learns the artist's style. This style is then reflected in the illustrations on other pages, maintaining a consistent design.

[1213] Input: User's drawing data

[1214] Output: Illustrations of other pages that reflect the same style

[1215] Step 7:

[1216] The server stores the generated doujinshi in cloud storage. The stored data is subject to access control so that only users with specific user IDs can access it.

[1217] Input: Finished doujinshi

[1218] Output: Doujinshi data saved in cloud storage

[1219] Step 8:

[1220] Users access the cloud storage through a dedicated app and view the created doujinshi. The app is equipped with security features to prevent screenshots and duplication, reducing the risk of copyright infringement.

[1221] Input: Access to doujinshi data in cloud storage

[1222] Output: Doujinshi that can be viewed using a dedicated app

[1223] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1224] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1225] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1226] [Fourth embodiment]

[1227] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1228] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1229] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1230] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1231] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1232] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1233] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1234] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1235] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1236] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1237] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1238] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1239] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1240] The present invention is a system that can automatically generate high-quality doujinshi by users by inputting the title of the original work and their preferred situation. This system operates in cooperation with a server, terminals, and users.

[1241] The system of the present invention is configured as follows:

[1242] 1. The stage where the user inputs information about the original work and the situation

[1243] The user launches a dedicated application and selects to create a new doujinshi.

[1244] The user inputs the "original title" and "preferred situation" and confirms it.

[1245] The device sends the entered information to the server, using a secure communication protocol (e.g., HTTPS) to ensure the safety of the data.

[1246] 2. The server analyzes the input and generates the plot.

[1247] The server receives input data from the user and the AI ​​engine analyzes the information.

[1248] The AI ​​engine references the database based on the "original title" and generates a plot for the "situation" specified by the user.

[1249] For example, if a user inputs "magical girl anime, school festival episode," the server's AI will create a storyline that suits this.

[1250] 3. Automatically generate illustrations

[1251] The server's AI automatically draws characters and backgrounds based on the generated plot.

[1252] For example, this includes the background and stage of the school festival scene, and the costumes of specific characters.

[1253] 4. Uploading user's artwork and analyzing its style

[1254] Users upload their own drawings using a dedicated app.

[1255] The device sends the uploaded data to the server.

[1256] Based on the image received by the server, the AI ​​analyzes the style of the artwork and reflects this style in the illustrations on other pages.

[1257] 5. Preserving Doujinshi and Restricting Access

[1258] The server stores the generated doujinshi in cloud storage.

[1259] At the same time, doujinshi will only be viewable using a dedicated app, and the app will be equipped with security features to prevent screenshots and duplication.

[1260] For example, if a user enters the information "Original work: magical girl anime, Situation: battle scene," the following process takes place. When the user enters the information and sends it from their device to the server, the server's AI generates a plot for the battle scene based on that information. Next, the AI ​​automatically generates character and background illustrations based on this plot. Furthermore, if the user uploads a character drawing they have drawn themselves, the AI ​​analyzes the style of that drawing and reflects it in other illustrations. Finally, the generated doujinshi is stored in the cloud and can only be viewed using a dedicated app. This dedicated app is equipped with features to prevent screenshots and duplication, reducing the risk of copyright infringement.

[1261] The processing flow will be explained below.

[1262] Step 1:

[1263] The user launches the dedicated app. The user clicks the "Create a new doujinshi" button. The user then enters the "original title" and "preferred situation" and confirms it.

[1264] Step 2:

[1265] The device sends the entered data ("original title" and "preferred situation") to the server. This communication uses a secure protocol (e.g., HTTPS), ensuring the safety of the data.

[1266] Step 3:

[1267] The server analyzes the data received from the user, and the AI ​​engine inside the server uses this information to refer to a pre-trained database and generate a plot appropriate for the situation specified by the user.

[1268] Step 4:

[1269] The server's AI engine automatically generates character and background illustrations based on the generated plot. The AI ​​draws scenes and characters according to the situation.

[1270] Step 5:

[1271] Users can upload their own drawings using a dedicated app, allowing them to provide the system with their own artistic style.

[1272] Step 6:

[1273] The device sends the image data uploaded by the user to the server, and this communication is also carried out using a secure protocol.

[1274] Step 7:

[1275] The server analyzes the received image data. The AI ​​engine learns the style of the user-provided image and applies that style to the illustrations on other pages.

[1276] Step 8:

[1277] The server stores the generated doujinshi in cloud storage. The stored doujinshi data is subject to access control so that only users with specific user IDs can access it.

[1278] Step 9:

[1279] Users access the cloud storage through a dedicated app and view the created doujinshi. The app has security features to prevent screenshots and duplication, reducing the risk of copyright infringement.

[1280] As a concrete example, consider the case where a user inputs the information "magical girl anime, battle scene." The server receives this information, and the AI ​​engine generates a plot for the battle scene and draws appropriate character and background illustrations based on that plot. When the user uploads a picture of a magical girl they have drawn, the AI ​​analyzes the style of this drawing and applies a consistent style to other pages. Finally, the generated doujinshi is stored in the cloud and can only be viewed using a dedicated app.

[1281] Example 1

[1282] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1283] Conventional doujinshi generation systems require users to manually create illustrations and stories, which requires a great deal of time and effort. It is also difficult to ensure a consistent style for the generated content, and from the perspective of copyright protection, the prevention of screenshots and duplication is insufficient. There is a need to provide an efficient, high-quality doujinshi generation system that solves these issues.

[1284] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1285] In this invention, the server includes a means for receiving information and generating a plot, a means for automatically generating illustrations based on the generated plot, and a means for saving the illustrations in cloud storage. This allows users to efficiently generate high-quality fanzines and create illustrations with a consistent style, while also enabling them to view the illustrations through a dedicated program equipped with security features to prevent screenshots and duplication.

[1286] "Means for inputting information" refers to a means by which a user can input specific information (e.g., the title of an original work or a preferred situation) using a dedicated application or interface.

[1287] The "means for transmitting input information to a server" refers to a means for transmitting information input by a user to a server via a communication network such as the Internet using a secure protocol.

[1288] "Means for generating a plot based on information received by the server" refers to means for the server to use an AI engine or algorithm to generate a specific story development or plot based on information sent by the user.

[1289] "Means for automatically generating illustrations based on the generated plot" refers to means for automatically drawing illustrations of characters and backgrounds corresponding to the generated plot using the server's AI engine or graphics generation tool.

[1290] "Means for saving in cloud storage" refers to a means for saving the created illustrations and fanzines in cloud storage on the Internet, making them easy to access and manage.

[1291] "Means for viewing illustrations stored via a dedicated program" refers to means for a user to view illustrations stored in cloud storage via a dedicated application or program.

[1292] "Means for preventing the duplication or screenshotting of illustrations by a dedicated program" refers to a program equipped with security features to prevent illustrations from being illegally duplicated or stolen by screenshotting.

[1293] "Means for uploading content drawn by users" refers to means for users to upload illustrations or pictures they have drawn to a server via a dedicated application.

[1294] "Means for analyzing the style of uploaded content" refers to the means by which the server analyzes the style of illustrations uploaded by users using an AI engine or image analysis technology.

[1295] The "means for reflecting the analyzed style in illustrations on other pages" refers to a means for applying the same style to other automatically generated illustrations based on the analyzed style.

[1296] "Means of transmitting to a server using a secure communication protocol" refers to the use of encryption technology or a secure communication protocol (e.g., HTTPS) to ensure the security of data when a user transmits data from a terminal to a server.

[1297] "Access control measures that allow only specific identification information to access illustrations" are measures to prevent unauthorized access by controlling the viewing rights of illustrations and doujinshi based on each user's identification information or ID.

[1298] This invention is a system that can automatically generate high-quality doujinshi by users by inputting the title of the original work and their preferred situation. This system operates in cooperation with a server, terminals, and users.

[1299] Hardware and software used:

[1300] Server: A server equipped with a high-performance AI engine and database (e.g., machine learning models, image generation models).

[1301] Device: A user's device (e.g., smartphone, tablet, PC) on which the dedicated application is installed.

[1302] Secure communication protocol: A protocol that uses encryption technology, such as HTTPS.

[1303] Examples of data processing and data calculation

[1304] 1. The stage where the user inputs information about the original work and the situation

[1305] The user launches a dedicated application and selects to create a new doujinshi. The user enters the "original title" and "preferred situation" and confirms it, after which the device sends the entered information to the server. At this time, a secure communication protocol (e.g., HTTPS) is used to ensure the safety of the data.

[1306] As a specific example, the user inputs "Magical girl anime, school festival episode" and presses the send button.

[1307] 2. The server analyzes the input and generates the plot.

[1308] The server receives input data from the user, and the AI ​​engine analyzes the information. The server's AI then references the database and generates a plot for the "situation" specified by the user.

[1309] As a concrete example, the server's AI analyzes "magical girl anime, school festival episode" and combines related story elements from the database to generate a plot for the school festival episode.

[1310] 3. Automatically generate illustrations

[1311] The server's AI automatically draws characters and backgrounds based on the generated plot.

[1312] As a concrete example, the server's AI draws the background, stage, and costumes of specific characters at a school festival, and generates the illustrations that make up each scene.

[1313] 4. Uploading user's artwork and analyzing its style

[1314] Users upload their own character drawings using a dedicated app. The device then sends the uploaded data to the server. The AI ​​analyzes the style of the illustrations received by the server and applies this style to the illustrations on other pages.

[1315] For example, when a user selects an image of a character they have drawn and presses the upload button, the device encrypts the data and sends it to the server, where the server's AI analyzes the image and applies the same style to other illustrations.

[1316] 5. Preserving Doujinshi and Restricting Access

[1317] The server stores the generated doujinshi in cloud storage. The doujinshi can only be viewed using a dedicated app, which has security features to prevent screenshots and duplication.

[1318] For example, the created doujinshi are stored in cloud storage. At the same time, they are set up so that they can only be accessed via a dedicated app. The app is equipped with a function to disable screenshots and technology to prevent duplication, reducing the risk of copyright infringement.

[1319] Prompt Sentence Examples

[1320] Original: Magical Girl Anime

[1321] Situation: School Festival Episode

[1322] Input prompt for the generative AI model:

[1323] "Write a new episode about magical girls at a school festival. The festival will be themed around school activities and feature a magical show."

[1324] This invention allows users to efficiently create high-quality fanzines, and also provides functions for unifying the style of illustrations and protecting copyrights.

[1325] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1326] Step 1:

[1327] The user inputs information about the original work and the situation.

[1328] Input: The user launches the dedicated application and enters the "original title" and "preferred situation."

[1329] Specific operation: The user selects the creation of a new doujinshi in a dedicated application and enters specific information such as "magical girl anime, school festival episode."

[1330] Output: The terminal sends the entered information to the server.

[1331] Step 2:

[1332] The device sends the entered information to the server.

[1333] Input: The user enters the "original title" and "preferred situation" using a dedicated application.

[1334] Specific operation: The device encrypts the entered information using HTTPS and sends it to the server via a secure communication protocol.

[1335] Output: The server receives the information from the user.

[1336] Step 3:

[1337] The server analyzes the input information and generates the plot

[1338] Input: "Original title" and "Favorite situation" received by the server.

[1339] Specific operation: The server's AI engine analyzes the received information, references the database to obtain relevant information, and generates a plot based on the specified situation.

[1340] Output: The generated plot.

[1341] Step 4:

[1342] The server automatically generates illustrations based on the generated plots.

[1343] Input: The generated plot.

[1344] Specific operation: The server's AI engine draws characters and backgrounds based on the plot. For example, it automatically generates the background, stage, and character costumes for a school festival.

[1345] Output: The generated illustration.

[1346] Step 5:

[1347] Users can upload their own drawings

[1348] Input: A character drawing drawn by the user.

[1349] Specific operation: The user performs operations to upload a picture drawn using a dedicated application.

[1350] Output: The device sends the image it draws to the server.

[1351] Step 6:

[1352] The device sends the uploaded data to the server

[1353] Input: A character drawing drawn by the user.

[1354] What it does: The device encrypts the uploaded data using a secure communication protocol such as HTTPS and sends it to the server.

[1355] Output: The server receives the uploaded image.

[1356] Step 7:

[1357] The server analyzes the style of the image received and applies this style to the illustrations on other pages.

[1358] Input: User-uploaded character illustration.

[1359] How it works: The server's AI engine analyzes the received image and applies its artistic style to other illustrations, for example by identifying a specific style or color palette and matching it to other automatically generated illustrations.

[1360] Output: Illustrations with a consistent style.

[1361] Step 8:

[1362] The server saves the generated doujinshi to cloud storage.

[1363] Input: A doujinshi that combines automatically generated illustrations and a plot.

[1364] Specific operation: The server uploads the completed doujinshi to cloud storage and saves it.

[1365] Output: A fanzine saved in cloud storage.

[1366] Step 9:

[1367] Doujinshi can only be viewed using a dedicated application, and security features are implemented.

[1368] Input: Doujinshi saved in cloud storage.

[1369] Specific operation: The server sets access permissions for the doujinshi so that it can only be viewed using a dedicated application. It also implements security features to prevent screenshots and duplication.

[1370] Output: The doujinshi can be viewed through a dedicated application with security features enabled.

[1371] (Application example 1)

[1372] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1373] Conventional content generation systems require users to manually create and edit plots and illustrations, which is time-consuming and labor-intensive. They also lack sufficient security features to limit the distribution of generated content to specific users, posing a risk of copyright infringement. Furthermore, they lack effective means to prevent users from applying the same style of their drawings to other illustrations or from copying or taking screenshots of generated content.

[1374] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1375] In this invention, the server includes means for inputting information, means for transmitting the input information to the server, means for generating a plot based on the information received by the server, means for automatically generating illustrations based on the generated plot, means for saving the illustrations in cloud storage, means for viewing the saved illustrations and generated content via a dedicated application, means for preventing copying and screenshots of the illustrations and generated content by the dedicated application, and access control means for distributing content only to specified users. This makes it possible to automatically generate high-quality doujinshi and distribute them with enhanced security.

[1376] The "means for inputting information" refers to a device or software that allows the user to input information such as the title of the original work and a preferred situation.

[1377] The "means for transmitting information to a server" is a device or software that transfers the information entered by the user to the server using a secure communication protocol.

[1378] A "plot generation means" is a device or software that uses an AI engine to automatically create story developments and situations based on received information.

[1379] A "means for automatically generating illustrations" is a device or software that automatically depicts images of characters and backgrounds based on a generated plot.

[1380] "Cloud storage means" refers to devices or software that securely store generated illustrations and content in online data storage.

[1381] "Specialized application" means software for a specific device for viewing generated illustrations and content.

[1382] "Measures to prevent copying and screenshots" refers to technologies that prevent the generated content from being illegally copied or saved as a screenshot.

[1383] "Access control means" is a technology that authenticates a specific user ID and allows only that user to access the generated illustrations and content.

[1384] "Means for uploading user-drawn illustrations" refers to a device or software that allows users to upload hand-drawn illustrations to the cloud.

[1385] "Means for analyzing art style" refers to a technology that uses AI to analyze the style of art uploaded by users.

[1386] "Means of reflecting on illustrations on other pages" refers to a technique for applying the analyzed style and art style to other automatically generated illustrations.

[1387] The present invention is a system that automatically generates high-quality doujinshi and content by allowing users to input the title of the original work and their preferred situation, and distributes them exclusively to specific users. Specific implementation methods of this system are described in detail below.

[1388] The present invention is configured using the following hardware and software: The hardware includes a server and a smartphone, and the software uses Python, TensorFlow (AI model), Google Cloud Storage (cloud storage), Firebase (real-time database and authentication), and HTTPS (secure communication).

[1389] 1. Enter user information

[1390] First, users launch the dedicated application on their smartphone and input the title of the original work and their preferred situation. This information is then sent to the server via the application using a secure communication protocol (HTTPS).

[1391] 2. Receiving data from the server and generating plots

[1392] The server receives the data sent by the user and generates a plot using an AI engine (TensorFlow) based on that information. For example, if a user inputs "magical girl anime, school festival episode," the server's AI analyzes this and creates an appropriate storyline.

[1393] 3. Automatic generation of illustrations

[1394] Based on the generated plot, the server's AI automatically creates illustrations of characters and backgrounds. For example, the background of a school festival scene and the costumes of specific characters are automatically generated.

[1395] 4. Uploading user drawings and reflecting their own style

[1396] Users can upload their own drawings using a dedicated application. The uploaded drawing is sent to a server, where the AI ​​analyzes the drawing style. The analyzed drawing style is then reflected in other generated illustrations.

[1397] 5. Content Storage and Distribution

[1398] The generated doujin content is stored in Google Cloud Storage. Firebase is used to control access so that only specific users can view the content. A dedicated application provides the ability to prevent duplication and screenshots of the created content.

[1399] Examples of concrete examples and prompts

[1400] For example, consider the case where the user inputs "Original story: Super Sentai anime, Situation: Everyday life." In this case, the following prompt is passed to the server's AI:

[1401] Original: Sentai hero anime

[1402] Situation: Everyday life

[1403] User's picture: user_uploaded_image.png

[1404] This allows the server's AI to generate a plot, which is then used to automatically generate character and background illustrations, ultimately resulting in high-quality doujin content that reflects the user's designated art style. The generated content is stored in cloud storage and can only be viewed by specific users via a dedicated application with access control.

[1405] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1406] Step 1:

[1407] The user launches the dedicated application on their smartphone and inputs the original title and their preferred situation. The original title and situation are obtained as input data. The application then sends this data to the server using a secure communication protocol (HTTPS).

[1408] Input: User input of original title and situation

[1409] Output: Original title and situation data sent to the server

[1410] Step 2:

[1411] The server receives the data sent by the user. The received data is passed to an AI engine (TensorFlow) to generate a plot. For example, if the input original title is "Magical Girl Anime" and the situation is "School Festival Episode," the AI ​​will generate a plot.

[1412] Input: Original title and situation data received by the server

[1413] Output: The generated plot

[1414] Step 3:

[1415] Based on the generated plot, the server's AI automatically creates illustrations of characters and backgrounds according to the scenes and situations of the generated plot.

[1416] Input: Generated plot

[1417] Output: Auto-generated illustration

[1418] Step 4:

[1419] Users upload their own drawings via a dedicated application. The uploaded image is sent to a server, which analyzes the image's style. The analyzed style is then reflected in the illustrations on other pages.

[1420] Input: User-uploaded picture (image file)

[1421] Output: Other illustrations that reflect the same style

[1422] Step 5:

[1423] The generated content (plots and illustrations based on them) is stored in Google Cloud Storage, with access control using Firebase to ensure that only specific users can view this content.

[1424] Input: Generated content (plot and illustrations)

[1425] Output: Content and access control information stored in cloud storage

[1426] Step 6:

[1427] Users can view content stored in the cloud through a dedicated application, which is equipped with features to prevent content from being copied or taken screenshots, preventing unauthorized use of the content.

[1428] Input: Content in cloud storage

[1429] Output: Content displayed in a dedicated application

[1430] Through the above steps, a system will be completed that automatically generates high-quality doujinshi and content based on information entered by users, and can then be safely distributed and viewed.

[1431] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1432] This invention is a system that can automatically generate high-quality doujinshi by having users input the title of the original work and their favorite situations. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to generate more personalized doujinshi. This system operates in cooperation with the server, terminals, emotion engine, and users.

[1433] The system of the present invention is configured as follows:

[1434] 1. The stage where the user inputs information about the original work and the situation

[1435] The user launches a dedicated application and selects to create a new doujinshi.

[1436] The user inputs the "original title" and "preferred situation" and confirms it.

[1437] The device sends the entered information to the server, using a secure communication protocol (e.g., HTTPS) to ensure the safety of the data.

[1438] 2. Acquiring emotional data using the emotion engine

[1439] The emotion engine analyzes the user's facial expressions and tone of voice to obtain emotional data.

[1440] The terminal transmits the acquired emotion data to the server.

[1441] 3. The server analyzes the input information and emotion data and generates a plot.

[1442] The server receives original information and the situation from the user, and the AI ​​engine generates a plot based on that information.

[1443] Additionally, the server adjusts the plot content based on the emotion data it generates, for example, adding a happy ending to the story if the user expresses positive emotions.

[1444] 4. Automatically generate illustrations

[1445] The server's AI engine automatically generates character and background illustrations based on the generated plot.

[1446] For example, scenes and characters are drawn according to the situation.

[1447] 5. Uploading user's artwork and analyzing its style

[1448] Users upload their own drawings using a dedicated app.

[1449] The device sends the uploaded data to the server.

[1450] The server analyzes the received image data, and the AI ​​engine learns the style and reflects it in the illustrations on other pages.

[1451] 6. Preserving Doujinshi and Restricting Access

[1452] The server stores the generated doujinshi in cloud storage.

[1453] Access control is applied to the saved doujinshi data so that only users with specific user IDs can access it.

[1454] 7. Viewing with a dedicated app

[1455] Users access the cloud storage through a dedicated app and view the generated doujinshi.

[1456] The dedicated app has security features that prevent screenshots and duplication, reducing the risk of copyright infringement.

[1457] As a concrete example, consider the case where a user inputs the information "magical girl anime, battle scene" and the emotion engine recognizes that the user is excited. The server receives this information and emotion data, and the AI ​​engine generates a more dynamic battle scene plot. Next, the AI ​​draws character and background illustrations based on that plot. When a user uploads a drawing of a magical girl they have drawn, the AI ​​analyzes the style of this drawing and applies a consistent style to other illustrations. Finally, the generated doujinshi is stored in the cloud and can only be viewed using a dedicated app.

[1458] The processing flow will be explained below.

[1459] Step 1:

[1460] The user launches the dedicated app, clicks the "Create a new doujinshi" button, enters the "original title" and "preferred situation," and confirms.

[1461] Step 2:

[1462] The device sends the input data ("original title" and "preferred situation") to the server. At this time, a secure communication protocol (e.g., HTTPS) is used to ensure the safety of the data.

[1463] Step 3:

[1464] The emotion engine analyzes the user's facial expressions and tone of voice to obtain the user's emotional data (e.g., collected in real time via a camera or microphone).

[1465] Step 4:

[1466] The device transmits the acquired emotion data to the server, which is also transmitted using a secure protocol.

[1467] Step 5:

[1468] The server receives information about the original work, the situation, and emotional data from the user. The AI ​​engine inside the server comprehensively analyzes this information.

[1469] Step 6:

[1470] The server's AI engine generates a plot based on the received information, and adjusts the plot content according to the user's emotional data (e.g., adding a happy ending if the emotion is positive).

[1471] Step 7:

[1472] The server's AI engine automatically generates character and background illustrations based on the generated plot, drawing scenes and characters according to the situation.

[1473] Step 8:

[1474] Users upload their own drawings using a dedicated app, providing the system with their own character illustrations.

[1475] Step 9:

[1476] The device sends the image data uploaded by the user to the server, and this communication is also carried out using a secure protocol.

[1477] Step 10:

[1478] The server analyzes the received image data. The AI ​​engine analyzes the user's style and reflects that style in the illustrations on other pages.

[1479] Step 11:

[1480] The server stores the generated doujinshi in cloud storage, where access control is applied so that only users with specific user IDs can access the stored doujinshi.

[1481] Step 12:

[1482] Users access the cloud storage and view the created doujinshi through a dedicated app, which has security features to prevent screenshots and duplication, thereby reducing the risk of copyright infringement.

[1483] Examples:

[1484] For example, if a user inputs information like "magical girl anime, battle scene" and the emotion engine recognizes the user's state of excitement, the server will generate a plot based on this information. The plot generated by the AI ​​engine will be a dynamic battle scene that reflects the user's excited emotions. The AI ​​will then automatically generate illustrations based on this plot, featuring intense action scenes and flashy effects. When a user uploads a drawing of a magical girl character they created, the AI ​​analyzes the drawing style and applies a consistent style to other pages. Finally, the generated doujinshi is stored in the cloud and can only be viewed through a dedicated app.

[1485] Example 2

[1486] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1487] Creating modern fanzines requires a lot of time and effort, and requires technical knowledge and skills. This makes it difficult for beginners and busy users to create high-quality content. Furthermore, there is no method for automatically creating personalized content that reflects user emotions, making it difficult to increase user satisfaction. The present invention aims to provide a system that solves these problems.

[1488] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for a user to input information, means for transmitting the input information to the server, means for generating a plot based on the information received by the server, means for automatically generating an illustration based on the generated plot, means for saving the illustration in cloud storage, means for viewing the saved illustration via a dedicated app, means for preventing duplication and screenshots of the illustration by the dedicated app, an emotion engine for acquiring user emotion data, means for transmitting the acquired emotion data to the server, and means for adjusting the plot based on the emotion data. This enables users to easily create high-quality doujinshi and further makes it possible to provide personalized content that reflects the user's emotions.

[1489] "User" refers to an individual who uses a dedicated application to input information and generate and view doujinshi.

[1490] "Server" refers to a computer system that receives information and emotional data entered by users, generates plots and illustrations based on this information, and stores them in cloud storage.

[1491] "Terminal" refers to the device (e.g., smartphone, tablet, or PC) used by a user to enter information and transmit data to a server.

[1492] "Specialized application" refers to the software that users use to enter information and view the generated doujinshi.

[1493] An "emotion engine" refers to a device or software that analyzes a user's facial expressions and tone of voice to obtain emotional data.

[1494] "Plot" refers to the narrative storyline that is generated by the server based on the information and emotional data received.

[1495] "Illustrations" refer to paintings of characters and backgrounds that are automatically created by an AI engine based on the generated plot.

[1496] "Cloud storage" refers to an online storage service that stores created illustrations and doujinshi on the Internet and makes them accessible to specific users.

[1497] "Secure communication protocol" refers to a communication protocol (e.g., HTTPS) that ensures data security when sending and receiving information.

[1498] "Access control measures" refers to security features that allow only specific user IDs to access doujinshi stored in cloud storage.

[1499] "Art style" refers to the unique style or technique of the picture uploaded by the user.

[1500] "Analysis" refers to the process of conducting a detailed analysis of the input information, emotional data, and style of the uploaded artwork, and generating plots and illustrations that reflect these.

[1501] "Personalized content" refers to stories and illustrations tailored to individual preferences, reflecting user input and emotional data.

[1502] The present invention is a system that automatically generates high-quality fanzines by allowing a user to input the title of an original work and a preferred situation. An embodiment of the system will be described below in detail.

[1503] This system mainly consists of a server, a terminal, an emotion engine, and a user, all of which work together. The server operates in a cloud environment and processes and stores data. The terminal is a device used by the user to input information and send the data to the server. The emotion engine is software or hardware that analyzes the user's facial expressions and tone of voice to obtain emotion data.

[1504] First, the user installs the dedicated application on their device and launches it. The user selects the "Create a new doujinshi" option and enters the title of the original work and their preferred situation. This information is then sent from the device to the server using a secure communication protocol (e.g., HTTPS).

[1505] Next, the emotion engine analyzes the user's facial expressions and tone of voice in real time to obtain emotional data. This emotional data is also sent from the device to the server. The server receives this information, and the AI ​​engine generates a story plot based on it. The emotional data also adjusts the plot to match the user's emotions. For example, if the user is expressing positive emotions, a plot that includes elements of a happy ending is generated.

[1506] Based on the generated plot, the server's AI engine automatically generates illustrations of characters and backgrounds. This allows scenes and characters to be drawn according to the situation. Users can also upload their own drawings using a dedicated app. The user's device sends this uploaded data to the server, which analyzes it. The analyzed art style is then applied to the illustrations on other pages.

[1507] The generated doujinshi data is stored in cloud storage by a server. Access control measures are implemented to ensure that only users with specific user IDs can access this stored doujinshi. Users can access the cloud storage and view the generated doujinshi through a dedicated app. The dedicated app also has security features that prevent screenshots and duplication, reducing the risk of copyright infringement.

[1508] As a concrete example, consider the case where a user inputs the information "magical girl anime, battle scene" and the emotion engine recognizes that the user is excited. The server receives this information and emotion data, and the AI ​​engine generates a more dynamic battle scene plot. Next, the AI ​​engine draws illustrations of the characters and background based on the plot. The user uploads a drawing of a magical girl they have drawn, and the AI ​​analyzes the style of this drawing and applies a consistent style to other illustrations. Finally, the generated doujinshi is stored in the cloud and can only be viewed using a dedicated app.

[1509] Example prompt sentence:

[1510] "Based on the battle scenes of magical girl anime, please generate a dynamic plot that reflects the excitement of the characters. Please also automatically generate illustrations of the characters and backgrounds."

[1511] This allows users to easily create high-quality fanzines, and also makes it possible to provide personalized content that reflects the user's emotions.

[1512] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1513] Step 1:

[1514] The user launches the dedicated application and selects the "Create a new doujinshi" option. The user enters the "original title" and "preferred situation" and presses the send button. The input data may include, for example, "magical girl anime" and "battle scene." The device then sends the entered information to the server using a secure communication protocol (e.g., HTTPS).

[1515] Input: Original title, situation

[1516] Output: Data sent to the server

[1517] How it works: Using a device such as a smartphone or PC, the user inputs the title of the original work and their preferred situation into the application and presses the data transmission button. The device then sends this information to the server using HTTPS.

[1518] Step 2:

[1519] The emotion engine analyzes the user's facial expressions and tone of voice in real time to obtain emotional data. This analysis is performed using input devices such as a camera and microphone. The obtained emotional data is then sent from the device to a server.

[1520] Input: User's facial expression data, tone of voice

[1521] Output: Data sent to the server (emotion data)

[1522] How it works: The user provides facial expressions and tone of voice to the emotion engine in real time via the device's camera and microphone. The emotion engine analyzes these and generates emotion data such as positive, negative, and excited, which is then sent to the server via the device.

[1523] Step 3:

[1524] The server analyzes the original information, situation, and emotional data it receives. The AI ​​engine generates a story plot based on this information. If the user expresses positive emotions, the plot is adjusted based on the emotional data, such as adding a happy ending to the story.

[1525] Input: Original story information, situation, emotional data

[1526] Output: Story plot

[1527] Specific operation: The server passes the received data to an AI engine, which then analyzes the data and generates a story plot. For example, based on the emotional data "magical girl anime, battle scene" and "excitement," it generates a plot including a dynamic battle scene.

[1528] Step 4:

[1529] The server's AI engine automatically generates character and background illustrations based on the generated plot, drawing scenes and characters according to the situation.

[1530] Input: Story plot

[1531] Output: Illustration data

[1532] Specific operation: Based on the story plot generated by the AI ​​engine, character and background illustrations are drawn. For example, the actions of magical girls in battle scenes and the set background (such as a ruined city) are automatically generated.

[1533] Step 5:

[1534] Users upload their own drawings using a dedicated app. The device then sends the uploaded image data to the server. The server analyzes the image, and an AI engine learns the artist's style and applies it to illustrations on other pages.

[1535] Input: A picture drawn by the user

[1536] Output: Analyzed art style data

[1537] How it works: Users take a photo of a hand-drawn character drawing with their smartphone camera and upload it through the app. The device then sends the data to the server, which uses an AI engine to analyze the drawing style and apply it to illustrations on other pages.

[1538] Step 6:

[1539] The server stores the created doujinshi in cloud storage, and access control measures are applied to the stored doujinshi so that only users with specific user IDs can access them.

[1540] Input: Generated fanzine data

[1541] Output: Doujinshi data stored in cloud storage

[1542] Specific operation: The server stores the generated doujinshi data in cloud storage and sets a unique access key for each page so that only specific users can view it.

[1543] Step 7:

[1544] Users access the cloud storage through a dedicated app and view the created doujinshi. The app has security features to prevent screenshots and duplication.

[1545] Input: Doujinshi data stored in cloud storage

[1546] Output: The fanzine that the user views

[1547] Specific operation: When a user opens a doujinshi within the app and views a page, controls such as disabling screen capture and duplication are implemented.

[1548] (Application example 2)

[1549] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1550] Conventional automatic doujinshi generation systems have difficulty generating personalized content that takes user emotions into account. They also lack the functionality to reflect user-drawn illustrations, making it difficult to generate doujinshi that incorporate individual artistic styles. Furthermore, information security and access control were insufficient, raising the risk of copyright infringement.

[1551] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for inputting information, means for transmitting the input information to the server, means for generating a plot based on the information received by the server, means for automatically generating an illustration based on the generated plot, means for recognizing the user's emotion, means for reflecting the recognized emotion in the generated plot, means for saving the illustration in cloud storage, means for viewing the saved illustration via a dedicated app, and means for the dedicated app to prevent copying or screenshotting of the illustration. This makes it possible to automatically generate individual plots and illustrations that reflect the user's emotion and to save and view them in a secure environment.

[1552] "Information" refers to data entered by the user, such as the title of the original work and preferred situations.

[1553] A "plot" is an outline that shows the structure and development of a story.

[1554] An "illustration" is an image that visually represents a story, character, landscape, etc.

[1555] A "server" is a computer system that receives and processes information sent by users.

[1556] "Emotion" refers to the user's feelings and mood, and is a psychological state that can be analyzed from facial expressions, tone of voice, etc.

[1557] "Cloud storage" refers to remote servers where data can be stored and accessed over the internet.

[1558] A "dedicated app" is a specific application for displaying and manipulating content generated by the system of the present invention.

[1559] A "secure communication protocol" is a communication method that encrypts communication data to prevent it from being read by third parties.

[1560] "Access control" refers to security measures that ensure that only users with specific privileges can access data.

[1561] This embodiment of the present invention describes a system for automatically generating personalized fanzines that reflect a user's emotions. This system allows the user to input the title of the original work and their preferred situations, and then generates a plot based on that information and automatically generates illustrations. In particular, emotion recognition is performed and reflected in the plot generation, generating content that reflects the user's emotions.

[1562] 1. System Configuration

[1563] The system consists of the following major hardware and software components:

[1564] User device: A device (such as a smartphone or tablet) through which a user enters information.

[1565] Server: A central processing unit that receives information and generates plots and illustrations.

[1566] Emotion engine: A system for analyzing emotions from the user's facial expressions, tone of voice, etc.

[1567] Cloud storage: A data storage system that stores the generated doujinshi and controls access.

[1568] Dedicated app: An application for users to view doujinshi.

[1569] 2. Data processing and calculation

[1570] User device:

[1571] The user launches the application and enters the original title and their preferred situation.

[1572] To recognize emotions, a camera and microphone record the user's facial expressions and tone of voice.

[1573] The input information and emotional data are sent to the server using a secure communication protocol (e.g., HTTPS).

[1574] server:

[1575] The received original information and situation information are analyzed, and a plot is generated using a generative AI model.

[1576] Based on emotional data, the plot content reflects the user's emotions.

[1577] Based on the plot, AI is used to automatically generate illustrations of characters and backgrounds.

[1578] When a user uploads a drawing they have drawn, the AI ​​analyzes the style and applies a consistent style to the illustrations on other pages.

[1579] Cloud Storage:

[1580] The completed doujinshi will be stored in cloud storage.

[1581] Access control is implemented so that only specific user IDs can access it.

[1582] Dedicated app:

[1583] Users access cloud storage through a dedicated app.

[1584] The app has security features to prevent screenshots and duplication.

[1585] 3. Examples and prompts

[1586] For example, if a user inputs an "adventure fantasy story plot" and a "moving scene" and the camera detects that the user is smiling, the system generates a happy-ending adventure fantasy story and character illustrations, resulting in a high-quality doujinshi that reflects the user's emotions.

[1587] Example prompt sentence:

[1588] "Adventure fantasy, moving scenes"

[1589] "A world of magic and adventure, an episode of a brave warrior"

[1590] This makes it possible to create a personalized doujinshi that meets the needs and emotions of the user.

[1591] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1592] Step 1:

[1593] The user launches the dedicated app. They input the title of the original work and their preferred situation, then press the send button. The input information is sent from the device to the server. The input data is configured as a prompt message and sent using a secure communication protocol (HTTPS).

[1594] Input: Original title and situation

[1595] Output: Input data sent to the server

[1596] Step 2:

[1597] The emotion engine uses the camera and microphone to analyze the user's facial expressions and tone of voice, and the emotional data obtained by the emotion engine is sent from the device to the server.

[1598] Input: User's facial expression and tone of voice data

[1599] Output: Emotion data sent to the server

[1600] Step 3:

[1601] The server analyzes the original story information, situation information, and emotional data it receives. It then uses a generative AI model to generate a plot that reflects the user's emotions. Based on the emotional data in particular, the plot content is adjusted to a tone that matches the user's emotions.

[1602] Input: Original title, situation, emotional data

[1603] Output: The generated plot

[1604] Step 4:

[1605] The server automatically generates illustrations based on the generated plot. Specifically, AI is used to draw character designs, backgrounds, and scene illustrations.

[1606] Input: Generated plot

[1607] Output: Automatically generated illustrations

[1608] Step 5:

[1609] Users upload their own drawings using a dedicated app, and the device sends the uploaded image data to the server.

[1610] Input: A picture drawn by the user

[1611] Output: Picture data sent to the server

[1612] Step 6:

[1613] The server analyzes the received image data, and the AI ​​engine learns the artist's style. This style is then reflected in the illustrations on other pages, maintaining a consistent design.

[1614] Input: User's drawing data

[1615] Output: Illustrations of other pages that reflect the same style

[1616] Step 7:

[1617] The server stores the generated doujinshi in cloud storage. The stored data is subject to access control so that only users with specific user IDs can access it.

[1618] Input: Finished doujinshi

[1619] Output: Doujinshi data saved in cloud storage

[1620] Step 8:

[1621] Users access the cloud storage through a dedicated app and view the created doujinshi. The app is equipped with security features to prevent screenshots and duplication, reducing the risk of copyright infringement.

[1622] Input: Access to doujinshi data in cloud storage

[1623] Output: Doujinshi that can be viewed using a dedicated app

[1624] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1625] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1626] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1627] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1628] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1629] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1630] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1631] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1632] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1633] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1634] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1635] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1636] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1637] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1638] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1639] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1640] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1641] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1642] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1643] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1644] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1645] The following is further disclosed regarding the above embodiment.

[1646] (Claim 1)

[1647] a means for inputting information;

[1648] means for transmitting the input information to a server;

[1649] means for generating a plot based on the information received by the server;

[1650] A means for automatically generating illustrations based on the generated plot;

[1651] A way to save illustrations to cloud storage,

[1652] A way to view saved illustrations via a dedicated app,

[1653] A dedicated app prevents illustrations from being copied or taken screenshots,

[1654] A system including:

[1655] (Claim 2)

[1656] A means for users to upload their drawings;

[1657] A means of analyzing the style of uploaded pictures,

[1658] A way to reflect the analyzed style in illustrations on other pages,

[1659] 10. The system of claim 1, further comprising:

[1660] (Claim 3)

[1661] means for transmitting the information to a server using a secure communications protocol;

[1662] Access control measures that allow only specific user IDs to access illustrations;

[1663] 10. The system of claim 1, further comprising:

[1664] "Example 1"

[1665] (Claim 1)

[1666] a means for inputting information;

[1667] means for transmitting the input information to a server;

[1668] means for generating a plot based on the information received by the server;

[1669] A means for automatically generating illustrations based on the generated plot;

[1670] A means of storing it in cloud storage;

[1671] A means to view saved illustrations through a dedicated program,

[1672] A dedicated program prevents the illustrations from being copied or taken screenshots.

[1673] A system including:

[1674] (Claim 2)

[1675] a means for uploading user-drawn content;

[1676] means for analyzing the style of uploaded content;

[1677] A way to reflect the analyzed style in illustrations on other pages,

[1678] 10. The system of claim 1, further comprising:

[1679] (Claim 3)

[1680] means for transmitting the information to a server using a secure communications protocol;

[1681] access control means to ensure that only certain identities have access to the illustrations;

[1682] 10. The system of claim 1, further comprising:

[1683] "Application Example 1"

[1684] (Claim 1)

[1685] a means for inputting information;

[1686] means for transmitting the input information to a server;

[1687] means for generating a plot based on the information received by the server;

[1688] A means for automatically generating illustrations based on the generated plot;

[1689] A way to save illustrations to cloud storage,

[1690] A means of viewing saved illustrations and generated content via a dedicated application;

[1691] A dedicated application prevents copying and screenshots of illustrations and generated content;

[1692] access control means for delivering content only to specific users;

[1693] A system including:

[1694] (Claim 2)

[1695] A means for users to upload their drawings;

[1696] A means of analyzing the style of uploaded pictures,

[1697] A way to reflect the analyzed style in illustrations on other pages,

[1698] 10. The system of claim 1, further comprising:

[1699] (Claim 3)

[1700] means for transmitting the information to a server using a secure communications protocol;

[1701] access control measures to ensure that only specific user IDs have access to the illustrations and generated content;

[1702] 10. The system of claim 1, further comprising:

[1703] "Example 2: Combining Emotion Engines"

[1704] (Claim 1)

[1705] a means for a user to input information;

[1706] means for transmitting the input information to a server;

[1707] means for generating a plot based on the information received by the server;

[1708] A means for automatically generating illustrations based on the generated plot;

[1709] A way to save illustrations to cloud storage,

[1710] A way to view saved illustrations via a dedicated app,

[1711] A dedicated app prevents illustrations from being copied or taken screenshots,

[1712] an emotion engine that acquires emotion data of a user;

[1713] means for transmitting the acquired emotion data to a server;

[1714] a means for adjusting the plot based on the emotion data;

[1715] A system including:

[1716] (Claim 2)

[1717] A means for users to upload their drawings;

[1718] A means of analyzing the style of uploaded pictures,

[1719] A way to reflect the analyzed style in illustrations on other pages,

[1720] 10. The system of claim 1, further comprising:

[1721] (Claim 3)

[1722] means for transmitting the information to a server using a secure communications protocol;

[1723] Access control measures that allow only specific user IDs to access illustrations;

[1724] 10. The system of claim 1, further comprising:

[1725] "Application example 2 when combining emotion engines"

[1726] (Claim 1)

[1727] a means for inputting information;

[1728] means for transmitting the input information to a server;

[1729] means for generating a plot based on the information received by the server;

[1730] A means for automatically generating illustrations based on the generated plot;

[1731] means for recognizing a user's emotion;

[1732] A means for reflecting the recognized emotion in plot generation;

[1733] A way to save illustrations to cloud storage,

[1734] A way to view saved illustrations via a dedicated app,

[1735] A dedicated app prevents illustrations from being copied or taken screenshots,

[1736] A system including:

[1737] (Claim 2)

[1738] A means for users to upload their drawings;

[1739] A means of analyzing the style of uploaded pictures,

[1740] A way to reflect the analyzed style in illustrations on other pages,

[1741] a means for generating a personalized comic;

[1742] 10. The system of claim 1, further comprising:

[1743] (Claim 3)

[1744] means for transmitting the information to a server using a secure communications protocol;

[1745] Access control measures that allow only specific user IDs to access illustrations;

[1746] 10. The system of claim 1, further comprising: [Explanation of symbols]

[1747] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. a means for inputting information; means for transmitting the input information to a server; means for generating a plot based on the information received by the server; A means for automatically generating illustrations based on the generated plot; A way to save illustrations to cloud storage, A way to view saved illustrations via a dedicated app, A dedicated app prevents illustrations from being copied or taken screenshots, A system including:

2. A means for users to upload their drawings; A means of analyzing the style of uploaded pictures, A way to reflect the analyzed style in illustrations on other pages, The system of claim 1 further comprising:

3. means for transmitting the information to a server using a secure communications protocol; Access control measures that allow only specific user IDs to access illustrations; The system of claim 1 further comprising:

Images