System

Abstract

A system is provided.SOLUTION: A system comprising: input means for inputting an original work title and a preferred situation designated by a user; data collection means for acquiring original work data from an electronic book supply source; situation matching means for analyzing the acquired original work data and learning a scene matching the situation designated by the user; generation means for automatically generating a personal magazine based on the learned scene; storage means for storing the generated personal magazine in a cloud and limiting the personal magazine to personal use by taking security measures; and providing means for allowing the user to access the personal magazine stored on the cloud.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] The problems that this invention aims to solve are the time and skill required to create doujinshi and the copyright issues that arise from using original characters. Traditionally, doujinshi have been created by individual creators, spending a lot of time and effort by hand, requiring a great deal of labor and specialized skills. Furthermore, there has always been a concern about copyright infringement when using original characters, which has been an obstacle to creators' freedom in their creative activities. [Means for solving the problem]

[0005] The system of the present invention solves these problems by including an input means for inputting the original title and preferred situation specified by the user, a data collection means for acquiring original data from an e-book supply source, a situation matching means for analyzing the acquired original data and learning scenes that match the situation specified by the user, a generation means for automatically generating doujinshi based on the learned scenes, a storage means for storing the generated doujinshi in the cloud and taking security measures to limit it to personal use, and a provision means for allowing the user to access the doujinshi stored on the cloud.

[0006] Specifically, users can automatically generate high-quality doujinshi by simply specifying the original title and setting through simple input operations. Furthermore, the generated doujinshi are stored in the cloud, and users can access them only for personal use, thereby reducing the risk of copyright infringement. Security measures are also in place to prevent screenshots from being taken on the cloud, reducing the risk of unauthorized secondary use of the generated doujinshi. In this way, creators can easily enjoy creating doujinshi, and at the same time, by providing an infrastructure that respects copyright, it supports healthy creative activities.

[0007] "User" refers to any individual or entity that uses the System.

[0008] "Input means" refers to an interface through which a user inputs information into a system.

[0009] "Data collection methods" refers to the processes and tools used to obtain required data from external data sources.

[0010] "E-book Source" refers to the source of an e-book that the System uses to obtain original data.

[0011] "Original data" refers to information and content about the original work that the system uses as the production base.

[0012] "Situation matching means" refers to the technology or process for identifying a corresponding scene from the original data based on a situation entered by the user.

[0013] "Generation means" refers to the technology or process for generating new content based on the information identified by the situation matching means.

[0014] "Storage" refers to the technology and processes used to store generated content in the cloud and implement necessary security measures.

[0015] "Security measures" refers to measures to prevent content on the cloud from being illegally obtained.

[0016] "Means of delivery" refers to the interface or process by which users access content on the cloud. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] The present invention is a system that automatically generates doujinshi based on the original title and preferred situations specified by the user, and stores the doujinshi on the cloud for personal use only. This system includes an input means, a data collection means, a situation matching means, a generation means, a storage means, and a provision means.

[0039] System program processing description

[0040] User-specified input processing

[0041] The user enters the title of the original work and their preferred situation into the input form on their device, which then conveys their intended content to the system.

[0042] Data collection

[0043] The server retrieves data based on the original title from the e-book source. At this stage, it sends an API request to receive the required original data, including character information and scene details.

[0044] Situation Matching

[0045] The server analyzes the original data it has acquired and identifies scenes that match the situation specified by the user. To do this, the server uses a proprietary algorithm to extract specific elements from the data. For example, if a user specifies "a scene where Character A and Character B face off," the server will extract only data related to that scene.

[0046] Creating fanzines

[0047] The server generates high-quality doujinshi based on the data extracted by the situation matching method. The generation algorithm rearranges scenes, generates new dialogue, and assembles artwork, resulting in a unique work based on the user's requirements.

[0048] Cloud storage and security measures

[0049] The server stores the created doujinshi in the cloud, and security measures are implemented. Specifically, the server makes it impossible to take screenshots of the content on the cloud, and technology is introduced to prevent users from illegally taking out the content.

[0050] Provision to users

[0051] The device provides the user with a link to access the doujinshi stored in the cloud. The user can use the link to view the content on the cloud, but local storage and screenshots are restricted. In this way, the user can enjoy the doujinshi in a secure environment.

[0052] Specific examples

[0053] Suppose a user specifies the original title, "Manga Title," and inputs "a dialogue scene between Character A and Character B" as their preferred situation. The server retrieves "Manga Title" data from an e-book supply source, extracts and learns "a dialogue scene between Character A and Character B" from it. A generative algorithm then creates a new storyline and artwork based on that scene, and stores it in the cloud as a doujinshi. The user can view the generated doujinshi via a link on the cloud, but cannot save it locally or take screenshots to prevent unauthorized use.

[0054] In this way, the present invention provides a mechanism that allows users to easily create and view high-quality doujinshi while protecting the copyright of the original work.

[0055] The processing flow will be explained below.

[0056] Step 1:

[0057] The user uses the input form on the device to input the title of the original work and the situation of their choice. For example, they can specify the "manga title" and the "conversation scene between Character A and Character B."

[0058] Step 2:

[0059] The device sends the original title and situation entered by the user to the server, and the user's request reaches the server.

[0060] Step 3:

[0061] The server sends an API request to retrieve data about the original title from the e-book source, specifically requesting content about "ManagaTitle."

[0062] Step 4:

[0063] The server receives the original data returned from the e-book source and parses the data, which includes the storyline, character information, and scene details.

[0064] Step 5:

[0065] The server analyzes the original data and identifies scenes that match the situation specified by the user. For example, it extracts scenes that include a conversation between Character A and Character B.

[0066] Step 6:

[0067] The server further analyzes the extracted scenes using situation matching techniques to learn data suitable for doujinshi generation. This learning process includes detailed analysis of dialogue content and scene settings.

[0068] Step 7:

[0069] The server uses the generation means to generate a new doujinshi based on the extracted and learned data, specifically by reconstructing the storyline, generating new dialogue, and assembling the artwork.

[0070] Step 8:

[0071] The server stores the created doujinshi in the cloud, and takes security measures to prevent screenshots from being taken on the cloud.

[0072] Step 9:

[0073] The server generates an access link to the doujinshi stored on the cloud and sends it to the terminal.

[0074] Step 10:

[0075] The device provides the user with an access link, and the user accesses the doujinshi on the cloud. Access is limited to viewing, with local storage and screenshot taking restricted.

[0076] Example 1

[0077] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0078] Conventional doujinshi creation methods require a great deal of time and effort to obtain original data, identify scenes, and generate works, and the quality of the works is inconsistent. Furthermore, security measures to limit use to personal use are insufficient, raising the risk of unauthorized use. To address these issues, a system is needed that allows users to easily create high-quality doujinshi and safely view them.

[0079] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0080] In this invention, the server includes an input means for inputting the original title and preferred situation specified by the user, a data collection means for acquiring original data from an electronic book supply source, a situation matching means for analyzing the acquired original data and learning scenes that match the situation specified by the user, a generation means for automatically generating a work based on the learned scenes, a storage means for saving the generated work in the cloud and taking security measures to limit it to personal use, and a provision means for users to access the work saved on the cloud. This allows users to easily create high-quality doujinshi and safely view them.

[0081] "Input means" refers to a device or software that allows a user to input the original title and preferred situation designated by the user into the system.

[0082] "Data Collection Implements" means devices or software for obtaining necessary original data from electronic book sources.

[0083] The "situation matching means" is a device or software for analyzing the acquired original data and identifying scenes that match the situation specified by the user.

[0084] "Generation means" refers to a device or software for automatically generating a work based on a learned scene.

[0085] "Storage" means a device or software that stores the created work in the cloud, secures it, and limits it to personal use.

[0086] "Delivery means" means any device or software that allows users to access works stored on the cloud.

[0087] The present invention is a system that automatically generates doujinshi based on the original title and preferred situations specified by the user, and stores the doujinshi on the cloud for personal use only. The system includes an input means, a data collection means, a situation matching means, a generation means, a storage means, and a provision means.

[0088] The input means is a device or software for inputting the original title and preferred situation designated by the user, and is realized by an input form on the terminal. This form has a validation function to check the accuracy of the input.

[0089] The data collection means is a device or software for acquiring original data from e-book providers. In this system, data is acquired from e-book providers, such as Amazon Kindle or Kobo, through an API. The server sends an API request to acquire the necessary original data. The acquired data includes character information and scene details.

[0090] The situation matching means is a device or software that analyzes the acquired original data and identifies scenes that match the situation specified by the user. The server uses a natural language processing (NLP) algorithm, such as Python's NLTK library or SpaCy, to analyze the data and extract specific scenes.

[0091] The generator is a device or software that automatically generates works based on the learned scenes. Here, a generative AI model (e.g., GPT-4 or DALL-E) is used to rearrange the scenes, generate new dialogue, and assemble artwork. This results in a high-quality doujinshi.

[0092] The storage means is a device or software that stores the created doujinshi in the cloud and implements security measures to limit its use to personal use. The server stores the doujinshi in a cloud storage service (e.g., Amazon S3 or Google Cloud Storage) and applies technology to restrict access and prevent screenshots.

[0093] The means of provision is a device or software that allows users to access works stored on the cloud. The device provides users with a link to access the doujinshi on the cloud, and users can view the content on the cloud through that link, but local storage and screenshot capture are restricted.

[0094] Examples:

[0095] Let's consider the case where a user inputs the original title, "Manga Title," and a preferred situation, "A conversation scene between Character A and Character B." The server retrieves the "Manga Title" data from the e-book source and extracts the "Conversation scene between Character A and Character B" from it. The generative AI model then creates a new storyline and artwork based on that scene, and saves it in the cloud as a doujinshi. The user can view the generated doujinshi through the provided link, but cannot save it locally or take screenshots.

[0096] Example prompt sentence:

[0097] "Original title: Manga title

[0098] Favorite situation: A conversation scene between Character A and Character B

[0099] In this way, the present invention provides a mechanism that allows users to easily create and view high-quality doujinshi while protecting the copyright of the original work.

[0100] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0101] Step 1: User-specified input processing

[0102] The user enters the "original title" and "preferred situation" into the input form on their device. At this stage, a validation function is activated to check whether the input is accurate. Specifically, it checks whether the string entered into the form is blank and in the correct format.

[0103] Input: "Original title" and "Favorite situation"

[0104] Output: User-specified input data

[0105] Specific operation: The user enters the "manga title" and "conversation scene between Character A and Character B" and clicks the input button.

[0106] Step 2: Data collection

[0107] The server receives the user's input data and sends a request to the e-book source to retrieve the corresponding original data. The API request uses the HTTPS protocol, and the retrieved data is received in JSON format.

[0108] Input: User-specified input data

[0109] Output: Original data (character information, scene details, etc.)

[0110] Specific behavior:

[0111] Request URL: https: / / api.electronicbookservice.com / getBookData

[0112] Parameters: {"title": "Manga Title"}

[0113] The server sends this request and receives the corresponding data.

[0114] Step 3: Situation matching

[0115] The server analyzes the original data and identifies scenes that match the user's specified situation. It uses natural language processing (NLP) algorithms, such as Python's NLTK library, to analyze the data. Scenes are identified based on specific keywords and character names.

[0116] Input: Original data

[0117] Output: Scene data that matches the specified situation

[0118] Specific behavior:

[0119] import nltk

[0120] nltk.download('punkt')

[0121] text = "Text of the original data"

[0122] tokens = nltk.word_tokenize(text)

[0123] if "Character A" in tokens and "Character B" in tokens:

[0124] Extract the corresponding scene

[0125] scene_data = extract_scene(tokens)

[0126] The server performs this operation and extracts the matched scene data.

[0127] Step 4: Generate the fanzine

[0128] The server generates the fanzine using a generative AI model (e.g., GPT-4 or DALL-E) based on the scene data extracted in the context matching step. The generative algorithm rearranges the scene, generates new dialogue, and assembles the artwork.

[0129] Input: Scene data

[0130] Output: Automatically generated fanzine data

[0131] Specific behavior:

[0132] from transformers import GPT4ForTextGeneration

[0133] model = GPT4ForTextGeneration.from_pretrained('gpt4')

[0134] prompt = "Generate a new dialogue based on the dialogue scene between Character A and Character B."

[0135] generated_text = model.generate_text(prompt)

[0136] The server performs this operation and creates a fanzine file incorporating the generated text and artwork.

[0137] Step 5: Cloud storage and security measures

[0138] The server stores the generated doujinshi in the cloud and configures security settings. It uses cloud storage services (e.g., Amazon S3 and Google Cloud Storage) and applies technologies to restrict access and prevent screenshots.

[0139] Input: Auto-generated fanzine data

[0140] Output: Doujinshi saved in the cloud

[0141] Specific behavior:

[0142] import boto3

[0143] s3 = boto3.client('s3')

[0144] bucket_name = 'Doujinshi storage bucket'

[0145] file_data = "Generated fanzine binary data"

[0146] s3.put_object(Bucket=bucket_name, Key='user_doujinshi.pdf', Body=file_data)

[0147] Access permission settings

[0148] s3.put_bucket_policy(...)

[0149] The server performs this operation, stores the doujinshi on the cloud, and implements security measures.

[0150] Step 6: Deliver to users

[0151] The device provides users with an access link to the doujinshi stored on the cloud. Users can use this link to view the doujinshi on the cloud, but local storage and screenshots are restricted to prevent unauthorized use.

[0152] Input: Doujinshi stored in the cloud

[0153] Output: Access link provided to user

[0154] Specific behavior:

[0155] Users click on the provided link (e.g. https: / / cloudstorage.com / user_doujinshi.pdf) and view the doujinshi in their web browser.

[0156] (Application example 1)

[0157] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0158] Conventional doujinshi creation systems required users to create content manually, requiring a great deal of time and effort. Furthermore, there was a lack of means to safely store the generated content or to appropriately restrict access, exposing it to the risk of copyright infringement and unauthorized use. Furthermore, while there is an increasing need to view content via smart devices, there are few systems that can accommodate this. There is a need for a system that solves these problems, reduces the burden on users, and allows users to safely create and use high-quality doujinshi.

[0159] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0160] In this invention, the server includes an input means for inputting the original work title and preferred situation specified by the user, a data collection means for acquiring original work data from an e-book supply source, a situation matching means for analyzing the acquired original work data and learning scenes that match the situation specified by the user, a generation means for automatically generating a doujinshi based on the learned scenes, a storage means for storing the generated doujinshi in the cloud and limiting its use to personal use with security measures, a provision means for the user to access the doujinshi stored in the cloud, an access means for the user to access the generated doujinshi via a smart device, and a generation AI means for generating the doujinshi using a generative AI model based on the input content specified by the user. This allows the user to automatically generate a high-quality doujinshi based on the original work title and situation specified by the user, safely store it on the cloud, and easily access it via a smart device.

[0161] "User-specified original title" is the name of an existing work specified by the system user via input means.

[0162] A "preferred situation" is a specific situation or setting that a user desires for a scene or setting in a doujinshi.

[0163] "Input means" refers to a device or software that provides an interface for users to input the original title and their preferred situation into the system.

[0164] "Data collection means" refers to a function for collecting necessary content data based on a designated original title from an e-book supply source.

[0165] "Situation matching means" refers to the algorithms and processes used to analyze the original data acquired, identify scenes that fit the situation specified by the user, and learn from them.

[0166] The "generation means" has a function of automatically generating a new fanzine based on the scene identified by the situation matching means.

[0167] The "storage means" has the function of storing the created doujinshi in the cloud and taking security measures to prevent unauthorized use of the content.

[0168] "Means of provision" refers to the function of providing links and a viewing environment for users to access doujinshi stored on the cloud.

[0169] "Means of access" refers to the function that allows users to access doujinshi stored on the cloud using a smart device.

[0170] "Generative AI means" refers to the technical means for automatically generating doujinshi using a generative AI model based on user input.

[0171] A "generative AI model" is a type of artificial intelligence, an algorithm or learning model that generates new content based on input text and conditions.

[0172] A "prompt" is a text-based instruction that indicates input data and conditions specified for a generative AI model.

[0173] The present invention is a system that automatically generates doujinshi based on a user's preferred situations and provides them on the cloud together with security measures. This system includes an input means, a data collection means, a situation matching means, a generation means, a storage means, and a provision means.

[0174] System Program Processing

[0175] User-specified input processing

[0176] Users use an input form on their smart device to input the title of the original work they have chosen and their preferred situation, and this information is sent to the server for further processing.

[0177] Data collection

[0178] The server retrieves data based on the specified original title from the e-book source via an API request. This data includes character information and scene details, and serves as the basis for subsequent situation matching.

[0179] Situation Matching

[0180] The server analyzes the original data it has acquired and identifies scenes that fit the situation specified by the user. This analysis uses a proprietary algorithm to extract and learn specific scenes and situations.

[0181] Creating fanzines

[0182] A generative AI model automatically generates high-quality doujinshi based on the data identified by the situation matching method, including scene reconstruction, new dialogue generation, and artwork assembly.

[0183] Cloud storage and serving

[0184] The created doujinshi is stored in the cloud, and as a security measure, technology is implemented to prevent screenshots from being taken. A link is generated on the cloud for viewing only, and users can view the content via that link using their smart device.

[0185] Specific examples

[0186] Let's say a user specifies the original title, "Manga Title," and inputs "a dialogue scene between Character A and Character B" as their preferred situation. The server retrieves "Manga Title" data from an e-book supply source, and extracts and learns "a dialogue scene between Character A and Character B" from it. The generative AI model then creates a new storyline and artwork based on that scene, which is then saved to the cloud as a doujinshi. The user can view the generated doujinshi via a link on the cloud, but cannot save it locally or take screenshots to prevent unauthorized use.

[0187] Prompt Sentence Examples

[0188] "Original data: 'A scene in which Character A and Character B fight. A uses a powerful technique, and B successfully defends.' Situation: 'A friendship blossoms.'"

[0189] In this way, the system of the present invention allows users to easily create high-quality doujinshi and enjoy them on the cloud while ensuring security.

[0190] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0191] Step 1: User Input

[0192] Users use their smart devices to enter the original title and their preferred situation into an input form. This input data is the basis for the entire system's processing. The input data (original title, situation) is sent to the server, which then uses this input to collect and analyze subsequent data.

[0193] Step 2: Data collection

[0194] The server uses the API of the e-book source to obtain data based on the original title specified by the user. The obtained data (details of the original, character information, scene information) is used for subsequent analysis. The results of the data collection are stored on the server as JSON format data.

[0195] Step 3: Situation matching

[0196] The server analyzes the original data it has acquired and identifies scenes that match the situation specified by the user. Based on the input data (acquired data, situation), it extracts specific scenes and character actions. The situation matching algorithm generates filtered scene data at this stage.

[0197] Step 4: Prompt generation

[0198] The server generates a prompt based on the data that matches the situation. The input data (filtered scene data, situation) is assembled into a specific format. This prompt is passed to a generative AI model and composed in text format.

[0199] Step 5: Generate the fanzine

[0200] The server inputs the generated prompt text into a generative AI model to generate a new story and artwork. The input data (prompt text) is processed by the generative AI model and output as a doujinshi. The content generated at this stage is in the form of a high-quality doujinshi that combines text and images.

[0201] Step 6: Cloud Saving

[0202] The server stores the generated doujinshi in cloud storage. The input data (the generated doujinshi) is uploaded to the cloud and security measures are applied. The stored data can be accessed through a specific link.

[0203] Step 7: Offer

[0204] The server provides users with an access link to the doujinshi stored on the cloud. The input data (cloud storage path and generated link) is notified to the user, and the user can use the link to view the content.

[0205] Step 8: Security measures

[0206] This technology makes it impossible to take screenshots of doujinshi stored in the cloud. Security settings are added to the input data (doujinshi data on the cloud), and the output is doujinshi data with restrictions on taking screenshots. This prevents unauthorized use.

[0207] In this way, the user, server, and cloud elements work together to perform processing, allowing users to safely and easily generate and view high-quality doujinshi.

[0208] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0209] The present invention combines a system that automatically generates doujinshi based on the original title and preferred situations specified by the user, stores the doujinshi on the cloud for personal use, and further combines it with an emotion engine that recognizes the user's emotions and reflects them in the content. The system includes input means, data collection means, situation matching means, generation means, storage means, provision means, and the emotion engine.

[0210] System program processing description

[0211] User-specified input processing

[0212] Users input the title of the manga and their preferred situation into an input form on their device. The emotion engine then recognizes the user's facial expressions and voice to identify their emotional state. For example, they can specify the "manga title," "a conversation scene between Character A and Character B," and the emotion "fun."

[0213] Data collection

[0214] The server sends an API request to retrieve data based on the original title from the e-book source. Specifically, it requests content related to "manga title."

[0215] Situation Matching

[0216] The server analyzes the original data and identifies scenes that match the situation specified by the user. It also adjusts the operation of the situation matching means based on the user's emotion identified by the emotion engine, and prioritizes extracting scenes that match the emotion. For example, it extracts data that includes dialogue scenes that match the emotion of "fun."

[0217] Creating fanzines

[0218] The server generates high-quality doujinshi based on the data extracted and learned by the scenario matching method and the user's emotions. The generation algorithm reconstructs the storyline, generates new dialogue content, and assembles artwork that reflects the user's emotions. For example, cheerful and fun dialogue and scenes are inserted to reflect the "fun" emotion.

[0219] Cloud storage and security measures

[0220] The server stores the created doujinshi in the cloud. Security measures are taken to prevent screenshots from being taken on the cloud. Cloud storage also uses encryption technology to strengthen data protection.

[0221] Provision to users

[0222] The device generates a link to access the doujinshi stored in the cloud and provides it to the user. The user can use the link to view the doujinshi on the cloud. Access is limited to viewing, and local storage and screenshot capture are restricted.

[0223] Specific examples

[0224] Suppose a user specifies the original title, "Manga Title," and inputs "Dialogue Scene Between Character A and Character B" and the emotion "Fun." The server retrieves "Manga Title" data from an e-book supply source, and extracts and learns from it "Dialogue Scenes" that are appropriate for the emotion "Fun." The generative algorithm then creates a new storyline and artwork that reflects the emotion "Fun," and stores it in the cloud as a doujinshi. The user can view the generated doujinshi via a link on the cloud, but cannot save it locally or take screenshots to prevent unauthorized use.

[0225] In this way, the present invention allows users to easily create and view high-quality doujinshi, while providing more personalized works that reflect the user's feelings, and also provides a mechanism for protecting the copyright of the original work.

[0226] The processing flow will be explained below.

[0227] Step 1:

[0228] Users input the title of the original manga and their preferred situation in the input form on their device. For example, they can specify the "manga title" and "a conversation scene between Character A and Character B."

[0229] Step 2:

[0230] The device captures the user's facial expressions with a camera or recognizes emotions through voice, which are then analyzed by an emotion engine to identify emotions such as "happy" or "excited."

[0231] Step 3:

[0232] The device sends the original title, situation, and identified emotion entered by the user to the server, so that the user's request and emotion information are delivered to the server.

[0233] Step 4:

[0234] The server sends an API request to retrieve data based on the original title from the e-book source. Specifically, it requests content related to "manga title."

[0235] Step 5:

[0236] The server receives the original data returned from the e-book source and parses the data, which includes the storyline, character information, and scene details.

[0237] Step 6:

[0238] The server analyzes the original data and identifies scenes that match the situation specified by the user. Based on the user's emotions identified by the emotion engine, the server adjusts the operation of the situation matching means and prioritizes the extraction of scenes that match the emotions.

[0239] Step 7:

[0240] The server further analyzes the scenes extracted by the situation matching method and learns data suitable for doujinshi generation. This learning process includes detailed analysis of the dialogue content and scene settings.

[0241] Step 8:

[0242] The server uses a generation method to generate a new doujinshi based on the extracted and learned data. Specifically, it reconstructs the storyline that reflects the user's emotions, generates new dialogue content, and assembles the artwork.

[0243] Step 9:

[0244] The server stores the created doujinshi in the cloud. At this time, security measures are taken to prevent screenshots from being taken on the cloud. In addition, encryption technology is used for cloud storage to strengthen data protection.

[0245] Step 10:

[0246] The server generates an access link to the doujinshi stored on the cloud and sends it to the terminal.

[0247] Step 11:

[0248] The device provides the user with an access link, and the user accesses the doujinshi on the cloud. Access is limited to viewing, with local storage and screenshot taking restricted.

[0249] Example 2

[0250] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0251] In recent years, there has been a growing need for many users to easily generate content that matches their preferences and emotions. However, existing systems have difficulty automatically generating high-quality doujinshi that reflect the situations and emotions specified by the user. Issues also remain regarding the security and copyright protection of the generated doujinshi. Furthermore, there is a lack of systems that can recognize and reflect user emotions in real time.

[0252] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: an input means for inputting the original work title and preferred situation and emotion specified by the user; a data collection means for acquiring original work data from a digital content source; a situation matching means for analyzing the acquired original work data and learning scenes that match the user's specified situation and emotion; a generation means for automatically generating a doujinshi based on the learned scenes and recognized emotions; a storage means for storing the generated doujinshi in the cloud and limiting its use to personal use with security measures; a provision means for allowing the user to access the doujinshi stored in the cloud; and an emotion recognition means for analyzing the user's facial expressions and voice to identify emotions. This allows users to easily automatically generate high-quality doujinshi tailored to their emotions and preferences and safely view them.

[0253] A "user" refers to an individual who uses the system to input information such as the original title, situation, and emotion, and then views the generated doujinshi.

[0254] "Original title" refers to the title of the original work entered by the user.

[0255] "Situation" refers to the scene or situation specified by the user.

[0256] "Emotion" refers to the feelings and psychological state that a user is experiencing.

[0257] "Input means" refers to the interface that allows users to input the original title, situation, and emotions.

[0258] "Digital content source" refers to the database or API from which the original data is provided.

[0259] "Data collection means" refers to a means for obtaining data from a digital content source based on an input original title.

[0260] "Situation matching means" refers to a means for analyzing the acquired original data and identifying scenes that match the situation and emotions specified by the user.

[0261] "Generation means" refers to algorithms and programs for automatically generating doujinshi based on learned scenes and user emotions.

[0262] "Storage means" refers to the means of storing the generated doujinshi in the cloud and taking appropriate security measures to limit its use to personal use.

[0263] "Means of provision" refers to the means of providing users with a method or link to access doujinshi stored on the cloud.

[0264] "Emotion recognition means" refers to systems or technologies that analyze a user's facial expressions and voice to identify emotions.

[0265] "Cloud" refers to network storage for storing generated data and providing it to users.

[0266] "Security Measures" means the technical and organizational measures to prevent unauthorized use of data.

[0267] This invention is a system that automatically generates doujinshi based on the original title, preferred situation, and emotion specified by the user. The system stores the generated doujinshi on the cloud and incorporates security measures to limit its use to personal use. It also uses an emotion recognition engine that recognizes the user's emotions in real time and reflects them in the generated content.

[0268] Specifically, the following hardware and software are used:

[0269] User's device: A computer or smartphone is used as the interface. An input form is displayed, and the user inputs the original title, situation, and emotion.

[0270] Camera and microphone: Captures the user's facial expressions and voice and provides input to the emotion recognition engine.

[0271] Server: The core hardware for processing data collection, situation matching, fanzine generation, cloud storage and delivery, including the generative AI models and cloud storage infrastructure.

[0272] Emotion recognition engine: Software that analyzes a user's facial expressions and voice in real time to identify emotions. For example, a facial recognition library (e.g., OpenCV) is used for facial expression recognition, and a speech processing library (e.g., Google Speech-to-Text API) is used for speech recognition.

[0273] Cloud storage: Online storage (e.g. AWS S3) to store the generated doujinshi and implement security measures.

[0274] 1. User-specified input processing

[0275] Users input the manga title, situation, and emotion using the device interface. The emotion recognition engine analyzes the user's facial expressions and voice to identify the actual emotion. For example, a user can input the "manga title," "a conversation scene between Character A and Character B," and the emotion "fun" into the form.

[0276] 2. Data Collection

[0277] The server sends an API request to retrieve data from an e-book source based on the input original title. For example, it retrieves "manga title" data using the API of a digital content provider (e.g., Google Books API).

[0278] 3. Situation matching

[0279] The server analyzes the acquired data and identifies scenes that match the situation and emotion specified by the user. It uses a generative AI model (e.g., GPT-4) to analyze the text and extract scenes based on the emotion data provided by the emotion recognition engine.

[0280] 4. Creating a fanzine

[0281] The server generates high-quality doujinshi that reflect the specified situation and emotion. It uses image generation models (e.g., DALL-E) and text generation models (e.g., OpenAI GPT-4) to generate the doujinshi. For example, it constructs a storyline that reflects the emotion of "fun" and generates dialogue scenes.

[0282] 5. Cloud storage and security measures

[0283] The server stores the generated doujinshi in cloud storage (e.g., AWS S3). At this time, security measures (e.g., embedding JavaScript code) are implemented to prevent screenshots from being taken. The stored data is protected using encryption technology (e.g., AES-256).

[0284] 6. Provision to Users

[0285] The device generates an access link to the doujinshi stored on the cloud and provides it to the user. The user can use the link to view the doujinshi on the cloud, but this is limited to viewing only; local storage and screenshots are restricted.

[0286] Specific examples

[0287] If the user specifies the original title "Manga Title", inputs "Dialogue scene between Character A and Character B", and the emotion "Fun", the following prompt can be used:

[0288] Original title: Manga title

[0289] Favorite Situation: A conversation scene between Character A and Character B

[0290] Emotion: Fun

[0291] Based on this prompt, the generative AI model generates a doujinshi according to the user's requirements and saves it in cloud storage, where the user can safely view it using the provided link.

[0292] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0293] Step 1: User Input

[0294] The user uses an input form on the device to input the original work title, preferred situation, and emotion. Input is done using a keyboard or touch screen. For example, the user inputs data such as "manga title," "a dialogue scene between Character A and Character B," and "fun." The emotion recognition engine uses a camera and microphone to analyze the user's facial expressions and voice in real time and checks whether they match the input emotion. The output of this step is the original work title, situation, and emotion data specified by the user.

[0295] Step 2: Data collection

[0296] The server collects related data from digital content sources based on the original title entered by the user. Specifically, the server sends a request to a digital book API (e.g., Google Books API) to obtain original data. For example, metadata and content related to "manga title" are downloaded to the server. The input is the original title provided by the user, and the output is the obtained original data.

[0297] Step 3: Situation matching

[0298] The server analyzes the original data it has acquired. It uses a generative AI model (e.g., GPT-4) to analyze scenes in the original data and identify and extract scenes that match the situation and emotion specified by the user. It also takes into account the emotion data provided by the emotion recognition engine to select the most appropriate scene. For example, it extracts dialogue scenes that match the emotion "fun." The input in this step is the acquired original data and emotion data, and the output is the identified and extracted scene data.

[0299] Step 4: Generate the fanzine

[0300] The server generates a doujinshi based on the scene data obtained from the situation matching method. The generation method uses a text generation model (e.g., GPT-4) or an image generation model (e.g., DALL-E). This constructs a storyline and artwork that matches the user's emotions and the specified situation. For example, a new story containing a "fun" dialogue scene is automatically generated. The input in this step is the identified and extracted scene data and emotion data, and the output is the generated doujinshi data.

[0301] Step 5: Cloud storage and security measures

[0302] The server stores the generated doujinshi in cloud storage. For example, it uploads the data to AWS S3. When saving, security measures (e.g., embedding JavaScript code) are implemented to prevent screenshots from being taken, and the data is protected using AES-256 encryption technology. The input is the generated doujinshi data, and the output is doujinshi data safely stored on the cloud.

[0303] Step 6: Deliver to users

[0304] The device generates an access link to the doujinshi stored on the cloud and provides it to the user. The user can use the link to access and view the doujinshi, but local storage and screenshot capture are restricted. The input is the doujinshi data stored on the cloud, and the output is the access link provided to the user.

[0305] (Application example 2)

[0306] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0307] Existing doujinshi generation systems only automatically generate works based on situations specified by the user, and lack the ability to provide more personalized works by reflecting the user's emotions. Furthermore, there is a need to provide a more immersive experience by providing a viewing environment in a virtual space.

[0308] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0309] In this invention, the server includes an input means for inputting the title of an original work and a preferred situation specified by the user, a data collection means for acquiring original work data from an electronic book supply source, a situation matching means for analyzing the acquired original work data and learning scenes that match the situation specified by the user, a generation means for automatically generating a doujinshi based on the learned scenes, a storage means for storing the generated doujinshi in a cloud and limiting its use to personal use with security measures, a provision means for allowing the user to access the doujinshi stored in the cloud, an emotion recognition means for recognizing emotions from the user's facial expressions and voice and adjusting the content of the doujinshi based on the emotions, and a display means for making the generated doujinshi available for viewing in a store in a virtual space via smart glasses. This makes it possible to generate a personalized doujinshi that reflects the user's emotions and provide a realistic viewing experience in the virtual space.

[0310] A "user" is someone who uses the system to specify the original title and situation, and generates and reads personalized doujinshi based on their emotions.

[0311] "Original title" refers to the title of the original work that the user enters into the system, and is the data that serves as the basis for generating the doujinshi.

[0312] "Situation" refers to the scenes or scenes that users like, and is a factor that specifically determines the content of a doujinshi.

[0313] "Input means" refers to the device or interface that allows the user to input the original title and situation into the system.

[0314] "Data collection means" refers to a method or device for acquiring original data from an e-book source.

[0315] "Situation matching means" refers to an algorithm or device that analyzes the original data acquired and identifies and learns scenes that match the situation specified by the user.

[0316] "Generation means" refers to a system or device for automatically constructing and generating doujinshi based on learned scenes.

[0317] "Storage means" refers to a method or device for storing the generated doujinshi in the cloud and limiting it to personal use by taking specific security measures.

[0318] "Means of provision" refers to an interface or link suitable for users to access doujinshi stored on the cloud.

[0319] "Emotion recognition means" refers to a system or algorithm that recognizes emotions from the user's facial expressions and voice and adjusts the content of the doujinshi based on those emotions.

[0320] "Display means" refers to the display and software that allows the doujinshi generated via smart glasses to be viewed in a store within the virtual space.

[0321] This invention combines a system that automatically generates doujinshi based on the original title and preferred situation specified by the user, stores the doujinshi on the cloud for personal use, and an emotion engine that recognizes the user's emotions and reflects them in the content. Furthermore, by making the doujinshi available for viewing in a virtual store through smart glasses, users are provided with a realistic experience.

[0322] The system configuration includes the following elements:

[0323] 1. Input Method

[0324] Users enter the title of the original work and their preferred situation using an input form on their device, typically a smartphone or tablet.

[0325] Example: Enter "Manga Title" and "Dialogue scene between Character A and Character B."

[0326] 2. Data Collection Methods

[0327] The server sends an API request to acquire original data from the e-book source, using the API of the e-book source via the Internet.

[0328] Example: Get content related to "manga title".

[0329] 3. Situation matching method

[0330] The server analyzes the acquired original data, identifies scenes that match the situation specified by the user, and adjusts the operation of the situation matching means based on the user's emotion identified by the emotion recognition means.

[0331] Example: Extract data containing dialogue scenes that match the emotion "fun."

[0332] 4. Emotion recognition means

[0333] The emotion recognition engine recognizes the user's facial expressions and voice to identify their emotional state. Emotion recognition is performed using Microsoft's Emotion API, among other tools. This allows the creation of doujinshi tailored to the user's preferences.

[0334] Example: Recognizing the emotion "fun" from the user's facial expression.

[0335] 5. Generation means

[0336] The server generates high-quality doujinshi based on data extracted and learned through situation matching and user emotions. The generative algorithm reconstructs the storyline reflecting the user's emotions, generates new dialogue, and assembles the artwork. These generation processes are automated using a generative AI model.

[0337] Example: Construct a storyline and artwork that reflects the emotion "fun."

[0338] 6. Preservation means

[0339] The server stores the created doujinshi in the cloud. Security measures are taken to prevent screenshots from being taken on the cloud. Cloud storage also uses encryption technology.

[0340] Example: Using cloud storage such as AWS (Amazon Web Services).

[0341] 7. Means of provision

[0342] A link is generated and provided to users to access the doujinshi stored on the cloud. Users can view the doujinshi on the cloud through the link, but local storage and screenshot capture are restricted to prevent unauthorized use.

[0343] For example, send an access link to the user's email address.

[0344] 8. Display means

[0345] We provide displays and software that allow the created doujinshi to be viewed in a store in a virtual space via smart glasses.

[0346] For example, using a head-mounted display such as Oculus Quest.

[0347] Specific examples

[0348] When a user specifies the original manga title, "Manga Title," and inputs the dialogue scene between Character A and Character B and the emotion "fun," the server retrieves the manga title data from the e-book source and extracts and learns dialogue scenes that fit the emotion "fun." The generative AI model then creates a new storyline and artwork that reflects the emotion "fun," and stores it in the cloud as a doujinshi. The user can view the generated doujinshi through a link in the virtual space via smart glasses, but cannot save it locally or take screenshots to prevent unauthorized use.

[0349] Example prompt sentence:

[0350] Original title: Spider-Man

[0351] Situation: A scene where Spider-Man and a villain are having a conversation

[0352] Emotion: excitement

[0353] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0354] Step 1:

[0355] The user uses the input form on the device to input the original title and their preferred situation. This input also includes a function to capture the user's facial expressions and voice to reflect their emotions. Specifically, the user uses a smartphone or tablet to input the "original title," "situation," and "emotion." The input data and the captured user's emotional data are sent to the next process.

[0356] Input: Original title, situation, user's facial expression and voice

[0357] Output: Original title, situation, emotion data

[0358] Step 2:

[0359] The server sends an API request to retrieve original data from the e-book source. Specifically, based on the specified original title, the server retrieves related content from the e-book source. Based on the API request, the e-book source returns the corresponding data.

[0360] Input: Original title

[0361] Output: Original data

[0362] Step 3:

[0363] The server analyzes the original data and identifies scenes that match the situations specified by the user. The server uses a situation matching algorithm to identify the scenes. The server also adjusts the importance of situation matching based on the user's emotion data identified by the emotion recognition means.

[0364] Input: original data, situation, emotional data

[0365] Output: Scenes that match the situation

[0366] Step 4:

[0367] The server automatically generates a doujinshi based on the identified scene data and the user's emotional data. The generation means reconstructs the storyline corresponding to the emotions, generates new dialogue content, and assembles the artwork. This is done using a generative AI model.

[0368] Input: Scenes and emotion data that match the situation

[0369] Output: The generated fanzine

[0370] Step 5:

[0371] The server stores the generated doujinshi in the cloud, and takes security measures to limit its use to personal use. The cloud storage uses encryption technology, and measures are taken to prevent unauthorized access by disabling screenshots.

[0372] Input: Generated fanzine

[0373] Output: Doujinshi saved on the cloud

[0374] Step 6:

[0375] The server generates a link to access the doujinshi stored on the cloud and provides it to the user. The user accesses the doujinshi via the link, but is only allowed to view it; local storage and screenshots are restricted.

[0376] Input: Doujinshi saved on the cloud

[0377] Output: Access link

[0378] Step 7:

[0379] The user wears smart glasses and browses the created doujinshi in a store in a virtual space. The smart glasses display the created doujinshi on a display unit. Browsing in the virtual space provides the user with a realistic experience.

[0380] Input: Access link

[0381] Output: A doujinshi displayed in a virtual space

[0382] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0383] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0384] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0385] [Second embodiment]

[0386] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0387] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0388] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0389] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0390] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0391] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0392] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0393] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0394] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0395] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0396] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0397] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0398] The present invention is a system that automatically generates doujinshi based on the original title and preferred situations specified by the user, and stores the doujinshi on the cloud for personal use only. This system includes an input means, a data collection means, a situation matching means, a generation means, a storage means, and a provision means.

[0399] System program processing description

[0400] User-specified input processing

[0401] The user enters the title of the original work and their preferred situation into the input form on their device, which then conveys their intended content to the system.

[0402] Data collection

[0403] The server retrieves data based on the original title from the e-book source. At this stage, it sends an API request to receive the required original data, including character information and scene details.

[0404] Situation Matching

[0405] The server analyzes the original data it has acquired and identifies scenes that match the situation specified by the user. To do this, the server uses a proprietary algorithm to extract specific elements from the data. For example, if a user specifies "a scene where Character A and Character B face off," the server will extract only data related to that scene.

[0406] Creating fanzines

[0407] The server generates high-quality doujinshi based on the data extracted by the situation matching method. The generation algorithm rearranges scenes, generates new dialogue, and assembles artwork, resulting in a unique work based on the user's requirements.

[0408] Cloud storage and security measures

[0409] The server stores the created doujinshi in the cloud, and security measures are implemented. Specifically, the server makes it impossible to take screenshots of the content on the cloud, and technology is introduced to prevent users from illegally taking out the content.

[0410] Provision to users

[0411] The device provides the user with a link to access the doujinshi stored in the cloud. The user can use the link to view the content on the cloud, but local storage and screenshots are restricted. In this way, the user can enjoy the doujinshi in a secure environment.

[0412] Specific examples

[0413] Suppose a user specifies the original title, "Manga Title," and inputs "a dialogue scene between Character A and Character B" as their preferred situation. The server retrieves "Manga Title" data from an e-book supply source, extracts and learns "a dialogue scene between Character A and Character B" from it. A generative algorithm then creates a new storyline and artwork based on that scene, and stores it in the cloud as a doujinshi. The user can view the generated doujinshi via a link on the cloud, but cannot save it locally or take screenshots to prevent unauthorized use.

[0414] In this way, the present invention provides a mechanism that allows users to easily create and view high-quality doujinshi while protecting the copyright of the original work.

[0415] The processing flow will be explained below.

[0416] Step 1:

[0417] The user uses the input form on the device to input the title of the original work and the situation of their choice. For example, they can specify the "manga title" and the "conversation scene between Character A and Character B."

[0418] Step 2:

[0419] The device sends the original title and situation entered by the user to the server, and the user's request reaches the server.

[0420] Step 3:

[0421] The server sends an API request to retrieve data about the original title from the e-book source, specifically requesting content about "ManagaTitle."

[0422] Step 4:

[0423] The server receives the original data returned from the e-book source and parses the data, which includes the storyline, character information, and scene details.

[0424] Step 5:

[0425] The server analyzes the original data and identifies scenes that match the situation specified by the user. For example, it extracts scenes that include a conversation between Character A and Character B.

[0426] Step 6:

[0427] The server further analyzes the extracted scenes using situation matching techniques to learn data suitable for doujinshi generation. This learning process includes detailed analysis of dialogue content and scene settings.

[0428] Step 7:

[0429] The server uses the generation means to generate a new doujinshi based on the extracted and learned data, specifically by reconstructing the storyline, generating new dialogue, and assembling the artwork.

[0430] Step 8:

[0431] The server stores the created doujinshi in the cloud, and takes security measures to prevent screenshots from being taken on the cloud.

[0432] Step 9:

[0433] The server generates an access link to the doujinshi stored on the cloud and sends it to the terminal.

[0434] Step 10:

[0435] The device provides the user with an access link, and the user accesses the doujinshi on the cloud. Access is limited to viewing, with local storage and screenshot taking restricted.

[0436] Example 1

[0437] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0438] Conventional doujinshi creation methods require a great deal of time and effort to obtain original data, identify scenes, and generate works, and the quality of the works is inconsistent. Furthermore, security measures to limit use to personal use are insufficient, raising the risk of unauthorized use. To address these issues, a system is needed that allows users to easily create high-quality doujinshi and safely view them.

[0439] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0440] In this invention, the server includes an input means for inputting the original title and preferred situation specified by the user, a data collection means for acquiring original data from an electronic book supply source, a situation matching means for analyzing the acquired original data and learning scenes that match the situation specified by the user, a generation means for automatically generating a work based on the learned scenes, a storage means for saving the generated work in the cloud and taking security measures to limit it to personal use, and a provision means for users to access the work saved on the cloud. This allows users to easily create high-quality doujinshi and safely view them.

[0441] "Input means" refers to a device or software that allows a user to input the original title and preferred situation designated by the user into the system.

[0442] "Data Collection Implements" means devices or software for obtaining necessary original data from electronic book sources.

[0443] The "situation matching means" is a device or software for analyzing the acquired original data and identifying scenes that match the situation specified by the user.

[0444] "Generation means" refers to a device or software for automatically generating a work based on a learned scene.

[0445] "Storage" means a device or software that stores the created work in the cloud, secures it, and limits it to personal use.

[0446] "Delivery means" means any device or software that allows users to access works stored on the cloud.

[0447] The present invention is a system that automatically generates doujinshi based on the original title and preferred situations specified by the user, and stores the doujinshi on the cloud for personal use only. The system includes an input means, a data collection means, a situation matching means, a generation means, a storage means, and a provision means.

[0448] The input means is a device or software for inputting the original title and preferred situation designated by the user, and is realized by an input form on the terminal. This form has a validation function to check the accuracy of the input.

[0449] The data collection means is a device or software for acquiring original data from e-book providers. In this system, data is acquired from e-book providers, such as Amazon Kindle or Kobo, through an API. The server sends an API request to acquire the necessary original data. The acquired data includes character information and scene details.

[0450] The situation matching means is a device or software that analyzes the acquired original data and identifies scenes that match the situation specified by the user. The server uses a natural language processing (NLP) algorithm, such as Python's NLTK library or SpaCy, to analyze the data and extract specific scenes.

[0451] The generator is a device or software that automatically generates works based on the learned scenes. Here, a generative AI model (e.g., GPT-4 or DALL-E) is used to rearrange the scenes, generate new dialogue, and assemble artwork. This results in a high-quality doujinshi.

[0452] The storage means is a device or software that stores the created doujinshi in the cloud and implements security measures to limit its use to personal use. The server stores the doujinshi in a cloud storage service (e.g., Amazon S3 or Google Cloud Storage) and applies technology to restrict access and prevent screenshots.

[0453] The means of provision is a device or software that allows users to access works stored on the cloud. The device provides users with a link to access the doujinshi on the cloud, and users can view the content on the cloud through that link, but local storage and screenshot capture are restricted.

[0454] Examples:

[0455] Let's consider the case where a user inputs the original title, "Manga Title," and a preferred situation, "A conversation scene between Character A and Character B." The server retrieves the "Manga Title" data from the e-book source and extracts the "Conversation scene between Character A and Character B" from it. The generative AI model then creates a new storyline and artwork based on that scene, and saves it in the cloud as a doujinshi. The user can view the generated doujinshi through the provided link, but cannot save it locally or take screenshots.

[0456] Example prompt sentence:

[0457] "Original title: Manga title

[0458] Favorite situation: A conversation scene between Character A and Character B

[0459] In this way, the present invention provides a mechanism that allows users to easily create and view high-quality doujinshi while protecting the copyright of the original work.

[0460] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0461] Step 1: User-specified input processing

[0462] The user enters the "original title" and "preferred situation" into the input form on their device. At this stage, a validation function is activated to check whether the input is accurate. Specifically, it checks whether the string entered into the form is blank and in the correct format.

[0463] Input: "Original title" and "Favorite situation"

[0464] Output: User-specified input data

[0465] Specific operation: The user enters the "manga title" and "conversation scene between Character A and Character B" and clicks the input button.

[0466] Step 2: Data collection

[0467] The server receives the user's input data and sends a request to the e-book source to retrieve the corresponding original data. The API request uses the HTTPS protocol, and the retrieved data is received in JSON format.

[0468] Input: User-specified input data

[0469] Output: Original data (character information, scene details, etc.)

[0470] Specific behavior:

[0471] Request URL: https: / / api.electronicbookservice.com / getBookData

[0472] Parameters: {"title": "Manga Title"}

[0473] The server sends this request and receives the corresponding data.

[0474] Step 3: Situation matching

[0475] The server analyzes the original data and identifies scenes that match the user's specified situation. It uses natural language processing (NLP) algorithms, such as Python's NLTK library, to analyze the data. Scenes are identified based on specific keywords and character names.

[0476] Input: Original data

[0477] Output: Scene data that matches the specified situation

[0478] Specific behavior:

[0479] import nltk

[0480] nltk.download('punkt')

[0481] text = "Text of the original data"

[0482] tokens = nltk.word_tokenize(text)

[0483] if "Character A" in tokens and "Character B" in tokens:

[0484] Extract the corresponding scene

[0485] scene_data = extract_scene(tokens)

[0486] The server performs this operation and extracts the matched scene data.

[0487] Step 4: Generate the fanzine

[0488] The server generates the fanzine using a generative AI model (e.g., GPT-4 or DALL-E) based on the scene data extracted in the context matching step. The generative algorithm rearranges the scene, generates new dialogue, and assembles the artwork.

[0489] Input: Scene data

[0490] Output: Automatically generated fanzine data

[0491] Specific behavior:

[0492] from transformers import GPT4ForTextGeneration

[0493] model = GPT4ForTextGeneration.from_pretrained('gpt4')

[0494] prompt = "Generate a new dialogue based on the dialogue scene between Character A and Character B."

[0495] generated_text = model.generate_text(prompt)

[0496] The server performs this operation and creates a fanzine file incorporating the generated text and artwork.

[0497] Step 5: Cloud storage and security measures

[0498] The server stores the generated doujinshi in the cloud and configures security settings. It uses cloud storage services (e.g., Amazon S3 and Google Cloud Storage) and applies technologies to restrict access and prevent screenshots.

[0499] Input: Auto-generated fanzine data

[0500] Output: Doujinshi saved in the cloud

[0501] Specific behavior:

[0502] import boto3

[0503] s3 = boto3.client('s3')

[0504] bucket_name = 'Doujinshi storage bucket'

[0505] file_data = "Generated fanzine binary data"

[0506] s3.put_object(Bucket=bucket_name, Key='user_doujinshi.pdf', Body=file_data)

[0507] Access permission settings

[0508] s3.put_bucket_policy(...)

[0509] The server performs this operation, stores the doujinshi on the cloud, and implements security measures.

[0510] Step 6: Deliver to users

[0511] The device provides users with an access link to the doujinshi stored on the cloud. Users can use this link to view the doujinshi on the cloud, but local storage and screenshots are restricted to prevent unauthorized use.

[0512] Input: Doujinshi stored in the cloud

[0513] Output: Access link provided to user

[0514] Specific behavior:

[0515] Users click on the provided link (e.g. https: / / cloudstorage.com / user_doujinshi.pdf) and view the doujinshi in their web browser.

[0516] (Application example 1)

[0517] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0518] Conventional doujinshi creation systems required users to create content manually, requiring a great deal of time and effort. Furthermore, there was a lack of means to safely store the generated content or to appropriately restrict access, exposing it to the risk of copyright infringement and unauthorized use. Furthermore, while there is an increasing need to view content via smart devices, there are few systems that can accommodate this. There is a need for a system that solves these problems, reduces the burden on users, and allows users to safely create and use high-quality doujinshi.

[0519] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0520] In this invention, the server includes an input means for inputting the original work title and preferred situation specified by the user, a data collection means for acquiring original work data from an e-book supply source, a situation matching means for analyzing the acquired original work data and learning scenes that match the situation specified by the user, a generation means for automatically generating a doujinshi based on the learned scenes, a storage means for storing the generated doujinshi in the cloud and limiting its use to personal use with security measures, a provision means for the user to access the doujinshi stored in the cloud, an access means for the user to access the generated doujinshi via a smart device, and a generation AI means for generating the doujinshi using a generative AI model based on the input content specified by the user. This allows the user to automatically generate a high-quality doujinshi based on the original work title and situation specified by the user, safely store it on the cloud, and easily access it via a smart device.

[0521] "User-specified original title" is the name of an existing work specified by the system user via input means.

[0522] A "preferred situation" is a specific situation or setting that a user desires for a scene or setting in a doujinshi.

[0523] "Input means" refers to a device or software that provides an interface for users to input the original title and their preferred situation into the system.

[0524] "Data collection means" refers to a function for collecting necessary content data based on a designated original title from an e-book supply source.

[0525] "Situation matching means" refers to the algorithms and processes used to analyze the original data acquired, identify scenes that fit the situation specified by the user, and learn from them.

[0526] The "generation means" has a function of automatically generating a new fanzine based on the scene identified by the situation matching means.

[0527] The "storage means" has the function of storing the created doujinshi in the cloud and taking security measures to prevent unauthorized use of the content.

[0528] "Means of provision" refers to the function of providing links and a viewing environment for users to access doujinshi stored on the cloud.

[0529] "Means of access" refers to the function that allows users to access doujinshi stored on the cloud using a smart device.

[0530] "Generative AI means" refers to the technical means for automatically generating doujinshi using a generative AI model based on user input.

[0531] A "generative AI model" is a type of artificial intelligence, an algorithm or learning model that generates new content based on input text and conditions.

[0532] A "prompt" is a text-based instruction that indicates input data and conditions specified for a generative AI model.

[0533] The present invention is a system that automatically generates doujinshi based on a user's preferred situations and provides them on the cloud together with security measures. This system includes an input means, a data collection means, a situation matching means, a generation means, a storage means, and a provision means.

[0534] System Program Processing

[0535] User-specified input processing

[0536] Users use an input form on their smart device to input the title of the original work they have chosen and their preferred situation, and this information is sent to the server for further processing.

[0537] Data collection

[0538] The server retrieves data based on the specified original title from the e-book source via an API request. This data includes character information and scene details, and serves as the basis for subsequent situation matching.

[0539] Situation Matching

[0540] The server analyzes the original data it has acquired and identifies scenes that fit the situation specified by the user. This analysis uses a proprietary algorithm to extract and learn specific scenes and situations.

[0541] Creating fanzines

[0542] A generative AI model automatically generates high-quality doujinshi based on the data identified by the situation matching method, including scene reconstruction, new dialogue generation, and artwork assembly.

[0543] Cloud storage and serving

[0544] The created doujinshi is stored in the cloud, and as a security measure, technology is implemented to prevent screenshots from being taken. A link is generated on the cloud for viewing only, and users can view the content via that link using their smart device.

[0545] Specific examples

[0546] Let's say a user specifies the original title, "Manga Title," and inputs "a dialogue scene between Character A and Character B" as their preferred situation. The server retrieves "Manga Title" data from an e-book supply source, and extracts and learns "a dialogue scene between Character A and Character B" from it. The generative AI model then creates a new storyline and artwork based on that scene, which is then saved to the cloud as a doujinshi. The user can view the generated doujinshi via a link on the cloud, but cannot save it locally or take screenshots to prevent unauthorized use.

[0547] Prompt Sentence Examples

[0548] "Original data: 'A scene in which Character A and Character B fight. A uses a powerful technique, and B successfully defends.' Situation: 'A friendship blossoms.'"

[0549] In this way, the system of the present invention allows users to easily create high-quality doujinshi and enjoy them on the cloud while ensuring security.

[0550] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0551] Step 1: User Input

[0552] Users use their smart devices to enter the original title and their preferred situation into an input form. This input data is the basis for the entire system's processing. The input data (original title, situation) is sent to the server, which then uses this input to collect and analyze subsequent data.

[0553] Step 2: Data collection

[0554] The server uses the API of the e-book source to obtain data based on the original title specified by the user. The obtained data (details of the original, character information, scene information) is used for subsequent analysis. The results of the data collection are stored on the server as JSON format data.

[0555] Step 3: Situation matching

[0556] The server analyzes the original data it has acquired and identifies scenes that match the situation specified by the user. Based on the input data (acquired data, situation), it extracts specific scenes and character actions. The situation matching algorithm generates filtered scene data at this stage.

[0557] Step 4: Prompt generation

[0558] The server generates a prompt based on the data that matches the situation. The input data (filtered scene data, situation) is assembled into a specific format. This prompt is passed to a generative AI model and composed in text format.

[0559] Step 5: Generate the fanzine

[0560] The server inputs the generated prompt text into a generative AI model to generate a new story and artwork. The input data (prompt text) is processed by the generative AI model and output as a doujinshi. The content generated at this stage is in the form of a high-quality doujinshi that combines text and images.

[0561] Step 6: Cloud Saving

[0562] The server stores the generated doujinshi in cloud storage. The input data (the generated doujinshi) is uploaded to the cloud and security measures are applied. The stored data can be accessed through a specific link.

[0563] Step 7: Offer

[0564] The server provides users with an access link to the doujinshi stored on the cloud. The input data (cloud storage path and generated link) is notified to the user, and the user can use the link to view the content.

[0565] Step 8: Security measures

[0566] This technology makes it impossible to take screenshots of doujinshi stored in the cloud. Security settings are added to the input data (doujinshi data on the cloud), and the output is doujinshi data with restrictions on taking screenshots. This prevents unauthorized use.

[0567] In this way, the user, server, and cloud elements work together to perform processing, allowing users to safely and easily generate and view high-quality doujinshi.

[0568] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0569] The present invention combines a system that automatically generates doujinshi based on the original title and preferred situations specified by the user, stores the doujinshi on the cloud for personal use, and further combines it with an emotion engine that recognizes the user's emotions and reflects them in the content. The system includes input means, data collection means, situation matching means, generation means, storage means, provision means, and the emotion engine.

[0570] System program processing description

[0571] User-specified input processing

[0572] Users input the title of the manga and their preferred situation into an input form on their device. The emotion engine then recognizes the user's facial expressions and voice to identify their emotional state. For example, they can specify the "manga title," "a conversation scene between Character A and Character B," and the emotion "fun."

[0573] Data collection

[0574] The server sends an API request to retrieve data based on the original title from the e-book source. Specifically, it requests content related to "manga title."

[0575] Situation Matching

[0576] The server analyzes the original data and identifies scenes that match the situation specified by the user. It also adjusts the operation of the situation matching means based on the user's emotion identified by the emotion engine, and prioritizes extracting scenes that match the emotion. For example, it extracts data that includes dialogue scenes that match the emotion of "fun."

[0577] Creating fanzines

[0578] The server generates high-quality doujinshi based on the data extracted and learned by the scenario matching method and the user's emotions. The generation algorithm reconstructs the storyline, generates new dialogue content, and assembles artwork that reflects the user's emotions. For example, cheerful and fun dialogue and scenes are inserted to reflect the "fun" emotion.

[0579] Cloud storage and security measures

[0580] The server stores the created doujinshi in the cloud. Security measures are taken to prevent screenshots from being taken on the cloud. Cloud storage also uses encryption technology to strengthen data protection.

[0581] Provision to users

[0582] The device generates a link to access the doujinshi stored in the cloud and provides it to the user. The user can use the link to view the doujinshi on the cloud. Access is limited to viewing, and local storage and screenshot capture are restricted.

[0583] Specific examples

[0584] Suppose a user specifies the original title, "Manga Title," and inputs "Dialogue Scene Between Character A and Character B" and the emotion "Fun." The server retrieves "Manga Title" data from an e-book supply source, and extracts and learns from it "Dialogue Scenes" that are appropriate for the emotion "Fun." The generative algorithm then creates a new storyline and artwork that reflects the emotion "Fun," and stores it in the cloud as a doujinshi. The user can view the generated doujinshi via a link on the cloud, but cannot save it locally or take screenshots to prevent unauthorized use.

[0585] In this way, the present invention allows users to easily create and view high-quality doujinshi, while providing more personalized works that reflect the user's feelings, and also provides a mechanism for protecting the copyright of the original work.

[0586] The processing flow will be explained below.

[0587] Step 1:

[0588] Users input the title of the original manga and their preferred situation in the input form on their device. For example, they can specify the "manga title" and "a conversation scene between Character A and Character B."

[0589] Step 2:

[0590] The device captures the user's facial expressions with a camera or recognizes emotions through voice, which are then analyzed by an emotion engine to identify emotions such as "happy" or "excited."

[0591] Step 3:

[0592] The device sends the original title, situation, and identified emotion entered by the user to the server, so that the user's request and emotion information are delivered to the server.

[0593] Step 4:

[0594] The server sends an API request to retrieve data based on the original title from the e-book source. Specifically, it requests content related to "manga title."

[0595] Step 5:

[0596] The server receives the original data returned from the e-book source and parses the data, which includes the storyline, character information, and scene details.

[0597] Step 6:

[0598] The server analyzes the original data and identifies scenes that match the situation specified by the user. Based on the user's emotions identified by the emotion engine, the server adjusts the operation of the situation matching means and prioritizes the extraction of scenes that match the emotions.

[0599] Step 7:

[0600] The server further analyzes the scenes extracted by the situation matching method and learns data suitable for doujinshi generation. This learning process includes detailed analysis of the dialogue content and scene settings.

[0601] Step 8:

[0602] The server uses a generation method to generate a new doujinshi based on the extracted and learned data. Specifically, it reconstructs the storyline that reflects the user's emotions, generates new dialogue content, and assembles the artwork.

[0603] Step 9:

[0604] The server stores the created doujinshi in the cloud. At this time, security measures are taken to prevent screenshots from being taken on the cloud. In addition, encryption technology is used for cloud storage to strengthen data protection.

[0605] Step 10:

[0606] The server generates an access link to the doujinshi stored on the cloud and sends it to the terminal.

[0607] Step 11:

[0608] The device provides the user with an access link, and the user accesses the doujinshi on the cloud. Access is limited to viewing, with local storage and screenshot taking restricted.

[0609] Example 2

[0610] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0611] In recent years, there has been a growing need for many users to easily generate content that matches their preferences and emotions. However, existing systems have difficulty automatically generating high-quality doujinshi that reflect the situations and emotions specified by the user. Issues also remain regarding the security and copyright protection of the generated doujinshi. Furthermore, there is a lack of systems that can recognize and reflect user emotions in real time.

[0612] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: an input means for inputting the original work title and preferred situation and emotion specified by the user; a data collection means for acquiring original work data from a digital content source; a situation matching means for analyzing the acquired original work data and learning scenes that match the user's specified situation and emotion; a generation means for automatically generating a doujinshi based on the learned scenes and recognized emotions; a storage means for storing the generated doujinshi in the cloud and limiting its use to personal use with security measures; a provision means for allowing the user to access the doujinshi stored in the cloud; and an emotion recognition means for analyzing the user's facial expressions and voice to identify emotions. This allows users to easily automatically generate high-quality doujinshi tailored to their emotions and preferences and safely view them.

[0613] A "user" refers to an individual who uses the system to input information such as the original title, situation, and emotion, and then views the generated doujinshi.

[0614] "Original title" refers to the title of the original work entered by the user.

[0615] "Situation" refers to the scene or situation specified by the user.

[0616] "Emotion" refers to the feelings and psychological state that a user is experiencing.

[0617] "Input means" refers to the interface that allows users to input the original title, situation, and emotions.

[0618] "Digital content source" refers to the database or API from which the original data is provided.

[0619] "Data collection means" refers to a means for obtaining data from a digital content source based on an input original title.

[0620] "Situation matching means" refers to a means for analyzing the acquired original data and identifying scenes that match the situation and emotions specified by the user.

[0621] "Generation means" refers to algorithms and programs for automatically generating doujinshi based on learned scenes and user emotions.

[0622] "Storage means" refers to the means of storing the generated doujinshi in the cloud and taking appropriate security measures to limit its use to personal use.

[0623] "Means of provision" refers to the means of providing users with a method or link to access doujinshi stored on the cloud.

[0624] "Emotion recognition means" refers to systems or technologies that analyze a user's facial expressions and voice to identify emotions.

[0625] "Cloud" refers to network storage for storing generated data and providing it to users.

[0626] "Security Measures" means the technical and organizational measures to prevent unauthorized use of data.

[0627] This invention is a system that automatically generates doujinshi based on the original title, preferred situation, and emotion specified by the user. The system stores the generated doujinshi on the cloud and incorporates security measures to limit its use to personal use. It also uses an emotion recognition engine that recognizes the user's emotions in real time and reflects them in the generated content.

[0628] Specifically, the following hardware and software are used:

[0629] User's device: A computer or smartphone is used as the interface. An input form is displayed, and the user inputs the original title, situation, and emotion.

[0630] Camera and microphone: Captures the user's facial expressions and voice and provides input to the emotion recognition engine.

[0631] Server: The core hardware for processing data collection, situation matching, fanzine generation, cloud storage and delivery, including the generative AI models and cloud storage infrastructure.

[0632] Emotion recognition engine: Software that analyzes a user's facial expressions and voice in real time to identify emotions. For example, a facial recognition library (e.g., OpenCV) is used for facial expression recognition, and a speech processing library (e.g., Google Speech-to-Text API) is used for speech recognition.

[0633] Cloud storage: Online storage (e.g. AWS S3) to store the generated doujinshi and implement security measures.

[0634] 1. User-specified input processing

[0635] Users input the manga title, situation, and emotion using the device interface. The emotion recognition engine analyzes the user's facial expressions and voice to identify the actual emotion. For example, a user can input the "manga title," "a conversation scene between Character A and Character B," and the emotion "fun" into the form.

[0636] 2. Data Collection

[0637] The server sends an API request to retrieve data from an e-book source based on the input original title. For example, it retrieves "manga title" data using the API of a digital content provider (e.g., Google Books API).

[0638] 3. Situation matching

[0639] The server analyzes the acquired data and identifies scenes that match the situation and emotion specified by the user. It uses a generative AI model (e.g., GPT-4) to analyze the text and extract scenes based on the emotion data provided by the emotion recognition engine.

[0640] 4. Creating a fanzine

[0641] The server generates high-quality doujinshi that reflect the specified situation and emotion. It uses image generation models (e.g., DALL-E) and text generation models (e.g., OpenAI GPT-4) to generate the doujinshi. For example, it constructs a storyline that reflects the emotion of "fun" and generates dialogue scenes.

[0642] 5. Cloud storage and security measures

[0643] The server stores the generated doujinshi in cloud storage (e.g., AWS S3). At this time, security measures (e.g., embedding JavaScript code) are implemented to prevent screenshots from being taken. The stored data is protected using encryption technology (e.g., AES-256).

[0644] 6. Provision to Users

[0645] The device generates an access link to the doujinshi stored on the cloud and provides it to the user. The user can use the link to view the doujinshi on the cloud, but this is limited to viewing only; local storage and screenshots are restricted.

[0646] Specific examples

[0647] If the user specifies the original title "Manga Title", inputs "Dialogue scene between Character A and Character B", and the emotion "Fun", the following prompt can be used:

[0648] Original title: Manga title

[0649] Favorite Situation: A conversation scene between Character A and Character B

[0650] Emotion: Fun

[0651] Based on this prompt, the generative AI model generates a doujinshi according to the user's requirements and saves it in cloud storage, where the user can safely view it using the provided link.

[0652] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0653] Step 1: User Input

[0654] The user uses an input form on the device to input the original work title, preferred situation, and emotion. Input is done using a keyboard or touch screen. For example, the user inputs data such as "manga title," "a dialogue scene between Character A and Character B," and "fun." The emotion recognition engine uses a camera and microphone to analyze the user's facial expressions and voice in real time and checks whether they match the input emotion. The output of this step is the original work title, situation, and emotion data specified by the user.

[0655] Step 2: Data collection

[0656] The server collects related data from digital content sources based on the original title entered by the user. Specifically, the server sends a request to a digital book API (e.g., Google Books API) to obtain original data. For example, metadata and content related to "manga title" are downloaded to the server. The input is the original title provided by the user, and the output is the obtained original data.

[0657] Step 3: Situation matching

[0658] The server analyzes the original data it has acquired. It uses a generative AI model (e.g., GPT-4) to analyze scenes in the original data and identify and extract scenes that match the situation and emotion specified by the user. It also takes into account the emotion data provided by the emotion recognition engine to select the most appropriate scene. For example, it extracts dialogue scenes that match the emotion "fun." The input in this step is the acquired original data and emotion data, and the output is the identified and extracted scene data.

[0659] Step 4: Generate the fanzine

[0660] The server generates a doujinshi based on the scene data obtained from the situation matching method. The generation method uses a text generation model (e.g., GPT-4) or an image generation model (e.g., DALL-E). This constructs a storyline and artwork that matches the user's emotions and the specified situation. For example, a new story containing a "fun" dialogue scene is automatically generated. The input in this step is the identified and extracted scene data and emotion data, and the output is the generated doujinshi data.

[0661] Step 5: Cloud storage and security measures

[0662] The server stores the generated doujinshi in cloud storage. For example, it uploads the data to AWS S3. When saving, security measures (e.g., embedding JavaScript code) are implemented to prevent screenshots from being taken, and the data is protected using AES-256 encryption technology. The input is the generated doujinshi data, and the output is doujinshi data safely stored on the cloud.

[0663] Step 6: Deliver to users

[0664] The device generates an access link to the doujinshi stored on the cloud and provides it to the user. The user can use the link to access and view the doujinshi, but local storage and screenshot capture are restricted. The input is the doujinshi data stored on the cloud, and the output is the access link provided to the user.

[0665] (Application example 2)

[0666] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0667] Existing doujinshi generation systems only automatically generate works based on situations specified by the user, and lack the ability to provide more personalized works by reflecting the user's emotions. Furthermore, there is a need to provide a more immersive experience by providing a viewing environment in a virtual space.

[0668] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0669] In this invention, the server includes an input means for inputting the title of an original work and a preferred situation specified by the user, a data collection means for acquiring original work data from an electronic book supply source, a situation matching means for analyzing the acquired original work data and learning scenes that match the situation specified by the user, a generation means for automatically generating a doujinshi based on the learned scenes, a storage means for storing the generated doujinshi in a cloud and limiting its use to personal use with security measures, a provision means for allowing the user to access the doujinshi stored in the cloud, an emotion recognition means for recognizing emotions from the user's facial expressions and voice and adjusting the content of the doujinshi based on the emotions, and a display means for making the generated doujinshi available for viewing in a store in a virtual space via smart glasses. This makes it possible to generate a personalized doujinshi that reflects the user's emotions and provide a realistic viewing experience in the virtual space.

[0670] A "user" is someone who uses the system to specify the original title and situation, and generates and reads personalized doujinshi based on their emotions.

[0671] "Original title" refers to the title of the original work that the user enters into the system, and is the data that serves as the basis for generating the doujinshi.

[0672] "Situation" refers to the scenes or scenes that users like, and is a factor that specifically determines the content of a doujinshi.

[0673] "Input means" refers to the device or interface that allows the user to input the original title and situation into the system.

[0674] "Data collection means" refers to a method or device for acquiring original data from an e-book source.

[0675] "Situation matching means" refers to an algorithm or device that analyzes the original data acquired and identifies and learns scenes that match the situation specified by the user.

[0676] "Generation means" refers to a system or device for automatically constructing and generating doujinshi based on learned scenes.

[0677] "Storage means" refers to a method or device for storing the generated doujinshi in the cloud and limiting it to personal use by taking specific security measures.

[0678] "Means of provision" refers to an interface or link suitable for users to access doujinshi stored on the cloud.

[0679] "Emotion recognition means" refers to a system or algorithm that recognizes emotions from the user's facial expressions and voice and adjusts the content of the doujinshi based on those emotions.

[0680] "Display means" refers to the display and software that allows the doujinshi generated via smart glasses to be viewed in a store within the virtual space.

[0681] This invention combines a system that automatically generates doujinshi based on the original title and preferred situation specified by the user, stores the doujinshi on the cloud for personal use, and an emotion engine that recognizes the user's emotions and reflects them in the content. Furthermore, by making the doujinshi available for viewing in a virtual store through smart glasses, users are provided with a realistic experience.

[0682] The system configuration includes the following elements:

[0683] 1. Input Method

[0684] Users enter the title of the original work and their preferred situation using an input form on their device, typically a smartphone or tablet.

[0685] Example: Enter "Manga Title" and "Dialogue scene between Character A and Character B."

[0686] 2. Data Collection Methods

[0687] The server sends an API request to acquire original data from the e-book source, using the API of the e-book source via the Internet.

[0688] Example: Get content related to "manga title".

[0689] 3. Situation matching method

[0690] The server analyzes the acquired original data, identifies scenes that match the situation specified by the user, and adjusts the operation of the situation matching means based on the user's emotion identified by the emotion recognition means.

[0691] Example: Extract data containing dialogue scenes that match the emotion "fun."

[0692] 4. Emotion recognition means

[0693] The emotion recognition engine recognizes the user's facial expressions and voice to identify their emotional state. Emotion recognition is performed using Microsoft's Emotion API, among other tools. This allows the creation of doujinshi tailored to the user's preferences.

[0694] Example: Recognizing the emotion "fun" from the user's facial expression.

[0695] 5. Generation means

[0696] The server generates high-quality doujinshi based on data extracted and learned through situation matching and user emotions. The generative algorithm reconstructs the storyline reflecting the user's emotions, generates new dialogue, and assembles the artwork. These generation processes are automated using a generative AI model.

[0697] Example: Construct a storyline and artwork that reflects the emotion "fun."

[0698] 6. Preservation means

[0699] The server stores the created doujinshi in the cloud. Security measures are taken to prevent screenshots from being taken on the cloud. Cloud storage also uses encryption technology.

[0700] Example: Using cloud storage such as AWS (Amazon Web Services).

[0701] 7. Means of provision

[0702] A link is generated and provided to users to access the doujinshi stored on the cloud. Users can view the doujinshi on the cloud through the link, but local storage and screenshot capture are restricted to prevent unauthorized use.

[0703] For example, send an access link to the user's email address.

[0704] 8. Display means

[0705] We provide displays and software that allow the created doujinshi to be viewed in a store in a virtual space via smart glasses.

[0706] For example, using a head-mounted display such as Oculus Quest.

[0707] Specific examples

[0708] When a user specifies the original manga title, "Manga Title," and inputs the dialogue scene between Character A and Character B and the emotion "fun," the server retrieves the manga title data from the e-book source and extracts and learns dialogue scenes that fit the emotion "fun." The generative AI model then creates a new storyline and artwork that reflects the emotion "fun," and stores it in the cloud as a doujinshi. The user can view the generated doujinshi through a link in the virtual space via smart glasses, but cannot save it locally or take screenshots to prevent unauthorized use.

[0709] Example prompt sentence:

[0710] Original title: Spider-Man

[0711] Situation: A scene where Spider-Man and a villain are having a conversation

[0712] Emotion: excitement

[0713] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0714] Step 1:

[0715] The user uses the input form on the device to input the original title and their preferred situation. This input also includes a function to capture the user's facial expressions and voice to reflect their emotions. Specifically, the user uses a smartphone or tablet to input the "original title," "situation," and "emotion." The input data and the captured user's emotional data are sent to the next process.

[0716] Input: Original title, situation, user's facial expression and voice

[0717] Output: Original title, situation, emotion data

[0718] Step 2:

[0719] The server sends an API request to retrieve original data from the e-book source. Specifically, based on the specified original title, the server retrieves related content from the e-book source. Based on the API request, the e-book source returns the corresponding data.

[0720] Input: Original title

[0721] Output: Original data

[0722] Step 3:

[0723] The server analyzes the original data and identifies scenes that match the situations specified by the user. The server uses a situation matching algorithm to identify the scenes. The server also adjusts the importance of situation matching based on the user's emotion data identified by the emotion recognition means.

[0724] Input: original data, situation, emotional data

[0725] Output: Scenes that match the situation

[0726] Step 4:

[0727] The server automatically generates a doujinshi based on the identified scene data and the user's emotional data. The generation means reconstructs the storyline corresponding to the emotions, generates new dialogue content, and assembles the artwork. This is done using a generative AI model.

[0728] Input: Scenes and emotion data that match the situation

[0729] Output: The generated fanzine

[0730] Step 5:

[0731] The server stores the generated doujinshi in the cloud, and takes security measures to limit its use to personal use. The cloud storage uses encryption technology, and measures are taken to prevent unauthorized access by disabling screenshots.

[0732] Input: Generated fanzine

[0733] Output: Doujinshi saved on the cloud

[0734] Step 6:

[0735] The server generates a link to access the doujinshi stored on the cloud and provides it to the user. The user accesses the doujinshi via the link, but is only allowed to view it; local storage and screenshots are restricted.

[0736] Input: Doujinshi saved on the cloud

[0737] Output: Access link

[0738] Step 7:

[0739] The user wears smart glasses and browses the created doujinshi in a store in a virtual space. The smart glasses display the created doujinshi on a display unit. Browsing in the virtual space provides the user with a realistic experience.

[0740] Input: Access link

[0741] Output: A doujinshi displayed in a virtual space

[0742] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0743] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0744] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0745] [Third embodiment]

[0746] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0747] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0748] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0749] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0750] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0751] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0752] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0753] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0754] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0755] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0756] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0757] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0758] The present invention is a system that automatically generates doujinshi based on the original title and preferred situations specified by the user, and stores the doujinshi on the cloud for personal use only. This system includes an input means, a data collection means, a situation matching means, a generation means, a storage means, and a provision means.

[0759] System program processing description

[0760] User-specified input processing

[0761] The user enters the title of the original work and their preferred situation into the input form on their device, which then conveys their intended content to the system.

[0762] Data collection

[0763] The server retrieves data based on the original title from the e-book source. At this stage, it sends an API request to receive the required original data, including character information and scene details.

[0764] Situation Matching

[0765] The server analyzes the original data it has acquired and identifies scenes that match the situation specified by the user. To do this, the server uses a proprietary algorithm to extract specific elements from the data. For example, if a user specifies "a scene where Character A and Character B face off," the server will extract only data related to that scene.

[0766] Creating fanzines

[0767] The server generates high-quality doujinshi based on the data extracted by the situation matching method. The generation algorithm rearranges scenes, generates new dialogue, and assembles artwork, resulting in a unique work based on the user's requirements.

[0768] Cloud storage and security measures

[0769] The server stores the created doujinshi in the cloud, and security measures are implemented. Specifically, the server makes it impossible to take screenshots of the content on the cloud, and technology is introduced to prevent users from illegally taking out the content.

[0770] Provision to users

[0771] The device provides the user with a link to access the doujinshi stored in the cloud. The user can use the link to view the content on the cloud, but local storage and screenshots are restricted. In this way, the user can enjoy the doujinshi in a secure environment.

[0772] Specific examples

[0773] Suppose a user specifies the original title, "Manga Title," and inputs "a dialogue scene between Character A and Character B" as their preferred situation. The server retrieves "Manga Title" data from an e-book supply source, extracts and learns "a dialogue scene between Character A and Character B" from it. A generative algorithm then creates a new storyline and artwork based on that scene, and stores it in the cloud as a doujinshi. The user can view the generated doujinshi via a link on the cloud, but cannot save it locally or take screenshots to prevent unauthorized use.

[0774] In this way, the present invention provides a mechanism that allows users to easily create and view high-quality doujinshi while protecting the copyright of the original work.

[0775] The processing flow will be explained below.

[0776] Step 1:

[0777] The user uses the input form on the device to input the title of the original work and the situation of their choice. For example, they can specify the "manga title" and the "conversation scene between Character A and Character B."

[0778] Step 2:

[0779] The device sends the original title and situation entered by the user to the server, and the user's request reaches the server.

[0780] Step 3:

[0781] The server sends an API request to retrieve data about the original title from the e-book source, specifically requesting content about "ManagaTitle."

[0782] Step 4:

[0783] The server receives the original data returned from the e-book source and parses the data, which includes the storyline, character information, and scene details.

[0784] Step 5:

[0785] The server analyzes the original data and identifies scenes that match the situation specified by the user. For example, it extracts scenes that include a conversation between Character A and Character B.

[0786] Step 6:

[0787] The server further analyzes the extracted scenes using situation matching techniques to learn data suitable for doujinshi generation. This learning process includes detailed analysis of dialogue content and scene settings.

[0788] Step 7:

[0789] The server uses the generation means to generate a new doujinshi based on the extracted and learned data, specifically by reconstructing the storyline, generating new dialogue, and assembling the artwork.

[0790] Step 8:

[0791] The server stores the created doujinshi in the cloud, and takes security measures to prevent screenshots from being taken on the cloud.

[0792] Step 9:

[0793] The server generates an access link to the doujinshi stored on the cloud and sends it to the terminal.

[0794] Step 10:

[0795] The device provides the user with an access link, and the user accesses the doujinshi on the cloud. Access is limited to viewing, with local storage and screenshot taking restricted.

[0796] Example 1

[0797] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0798] Conventional doujinshi creation methods require a great deal of time and effort to obtain original data, identify scenes, and generate works, and the quality of the works is inconsistent. Furthermore, security measures to limit use to personal use are insufficient, raising the risk of unauthorized use. To address these issues, a system is needed that allows users to easily create high-quality doujinshi and safely view them.

[0799] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0800] In this invention, the server includes an input means for inputting the original title and preferred situation specified by the user, a data collection means for acquiring original data from an electronic book supply source, a situation matching means for analyzing the acquired original data and learning scenes that match the situation specified by the user, a generation means for automatically generating a work based on the learned scenes, a storage means for saving the generated work in the cloud and taking security measures to limit it to personal use, and a provision means for users to access the work saved on the cloud. This allows users to easily create high-quality doujinshi and safely view them.

[0801] "Input means" refers to a device or software that allows a user to input the original title and preferred situation designated by the user into the system.

[0802] "Data Collection Implements" means devices or software for obtaining necessary original data from electronic book sources.

[0803] The "situation matching means" is a device or software for analyzing the acquired original data and identifying scenes that match the situation specified by the user.

[0804] "Generation means" refers to a device or software for automatically generating a work based on a learned scene.

[0805] "Storage" means a device or software that stores the created work in the cloud, secures it, and limits it to personal use.

[0806] "Delivery means" means any device or software that allows users to access works stored on the cloud.

[0807] The present invention is a system that automatically generates doujinshi based on the original title and preferred situations specified by the user, and stores the doujinshi on the cloud for personal use only. The system includes an input means, a data collection means, a situation matching means, a generation means, a storage means, and a provision means.

[0808] The input means is a device or software for inputting the original title and preferred situation designated by the user, and is realized by an input form on the terminal. This form has a validation function to check the accuracy of the input.

[0809] The data collection means is a device or software for acquiring original data from e-book providers. In this system, data is acquired from e-book providers, such as Amazon Kindle or Kobo, through an API. The server sends an API request to acquire the necessary original data. The acquired data includes character information and scene details.

[0810] The situation matching means is a device or software that analyzes the acquired original data and identifies scenes that match the situation specified by the user. The server uses a natural language processing (NLP) algorithm, such as Python's NLTK library or SpaCy, to analyze the data and extract specific scenes.

[0811] The generator is a device or software that automatically generates works based on the learned scenes. Here, a generative AI model (e.g., GPT-4 or DALL-E) is used to rearrange the scenes, generate new dialogue, and assemble artwork. This results in a high-quality doujinshi.

[0812] The storage means is a device or software that stores the created doujinshi in the cloud and implements security measures to limit its use to personal use. The server stores the doujinshi in a cloud storage service (e.g., Amazon S3 or Google Cloud Storage) and applies technology to restrict access and prevent screenshots.

[0813] The means of provision is a device or software that allows users to access works stored on the cloud. The device provides users with a link to access the doujinshi on the cloud, and users can view the content on the cloud through that link, but local storage and screenshot capture are restricted.

[0814] Examples:

[0815] Let's consider the case where a user inputs the original title, "Manga Title," and a preferred situation, "A conversation scene between Character A and Character B." The server retrieves the "Manga Title" data from the e-book source and extracts the "Conversation scene between Character A and Character B" from it. The generative AI model then creates a new storyline and artwork based on that scene, and saves it in the cloud as a doujinshi. The user can view the generated doujinshi through the provided link, but cannot save it locally or take screenshots.

[0816] Example prompt sentence:

[0817] "Original title: Manga title

[0818] Favorite situation: A conversation scene between Character A and Character B

[0819] In this way, the present invention provides a mechanism that allows users to easily create and view high-quality doujinshi while protecting the copyright of the original work.

[0820] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0821] Step 1: User-specified input processing

[0822] The user enters the "original title" and "preferred situation" into the input form on their device. At this stage, a validation function is activated to check whether the input is accurate. Specifically, it checks whether the string entered into the form is blank and in the correct format.

[0823] Input: "Original title" and "Favorite situation"

[0824] Output: User-specified input data

[0825] Specific operation: The user enters the "manga title" and "conversation scene between Character A and Character B" and clicks the input button.

[0826] Step 2: Data collection

[0827] The server receives the user's input data and sends a request to the e-book source to retrieve the corresponding original data. The API request uses the HTTPS protocol, and the retrieved data is received in JSON format.

[0828] Input: User-specified input data

[0829] Output: Original data (character information, scene details, etc.)

[0830] Specific behavior:

[0831] Request URL: https: / / api.electronicbookservice.com / getBookData

[0832] Parameters: {"title": "Manga Title"}

[0833] The server sends this request and receives the corresponding data.

[0834] Step 3: Situation matching

[0835] The server analyzes the original data and identifies scenes that match the user's specified situation. It uses natural language processing (NLP) algorithms, such as Python's NLTK library, to analyze the data. Scenes are identified based on specific keywords and character names.

[0836] Input: Original data

[0837] Output: Scene data that matches the specified situation

[0838] Specific behavior:

[0839] import nltk

[0840] nltk.download('punkt')

[0841] text = "Text of the original data"

[0842] tokens = nltk.word_tokenize(text)

[0843] if "Character A" in tokens and "Character B" in tokens:

[0844] Extract the corresponding scene

[0845] scene_data = extract_scene(tokens)

[0846] The server performs this operation and extracts the matched scene data.

[0847] Step 4: Generate the fanzine

[0848] The server generates the fanzine using a generative AI model (e.g., GPT-4 or DALL-E) based on the scene data extracted in the context matching step. The generative algorithm rearranges the scene, generates new dialogue, and assembles the artwork.

[0849] Input: Scene data

[0850] Output: Automatically generated fanzine data

[0851] Specific behavior:

[0852] from transformers import GPT4ForTextGeneration

[0853] model = GPT4ForTextGeneration.from_pretrained('gpt4')

[0854] prompt = "Generate a new dialogue based on the dialogue scene between Character A and Character B."

[0855] generated_text = model.generate_text(prompt)

[0856] The server performs this operation and creates a fanzine file incorporating the generated text and artwork.

[0857] Step 5: Cloud storage and security measures

[0858] The server stores the generated doujinshi in the cloud and configures security settings. It uses cloud storage services (e.g., Amazon S3 and Google Cloud Storage) and applies technologies to restrict access and prevent screenshots.

[0859] Input: Auto-generated fanzine data

[0860] Output: Doujinshi saved in the cloud

[0861] Specific behavior:

[0862] import boto3

[0863] s3 = boto3.client('s3')

[0864] bucket_name = 'Doujinshi storage bucket'

[0865] file_data = "Generated fanzine binary data"

[0866] s3.put_object(Bucket=bucket_name, Key='user_doujinshi.pdf', Body=file_data)

[0867] Access permission settings

[0868] s3.put_bucket_policy(...)

[0869] The server performs this operation, stores the doujinshi on the cloud, and implements security measures.

[0870] Step 6: Deliver to users

[0871] The device provides users with an access link to the doujinshi stored on the cloud. Users can use this link to view the doujinshi on the cloud, but local storage and screenshots are restricted to prevent unauthorized use.

[0872] Input: Doujinshi stored in the cloud

[0873] Output: Access link provided to user

[0874] Specific behavior:

[0875] Users click on the provided link (e.g. https: / / cloudstorage.com / user_doujinshi.pdf) and view the doujinshi in their web browser.

[0876] (Application example 1)

[0877] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0878] Conventional doujinshi creation systems required users to create content manually, requiring a great deal of time and effort. Furthermore, there was a lack of means to safely store the generated content or to appropriately restrict access, exposing it to the risk of copyright infringement and unauthorized use. Furthermore, while there is an increasing need to view content via smart devices, there are few systems that can accommodate this. There is a need for a system that solves these problems, reduces the burden on users, and allows users to safely create and use high-quality doujinshi.

[0879] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0880] In this invention, the server includes an input means for inputting the original work title and preferred situation specified by the user, a data collection means for acquiring original work data from an e-book supply source, a situation matching means for analyzing the acquired original work data and learning scenes that match the situation specified by the user, a generation means for automatically generating a doujinshi based on the learned scenes, a storage means for storing the generated doujinshi in the cloud and limiting its use to personal use with security measures, a provision means for the user to access the doujinshi stored in the cloud, an access means for the user to access the generated doujinshi via a smart device, and a generation AI means for generating the doujinshi using a generative AI model based on the input content specified by the user. This allows the user to automatically generate a high-quality doujinshi based on the original work title and situation specified by the user, safely store it on the cloud, and easily access it via a smart device.

[0881] "User-specified original title" is the name of an existing work specified by the system user via input means.

[0882] A "preferred situation" is a specific situation or setting that a user desires for a scene or setting in a doujinshi.

[0883] "Input means" refers to a device or software that provides an interface for users to input the original title and their preferred situation into the system.

[0884] "Data collection means" refers to a function for collecting necessary content data based on a designated original title from an e-book supply source.

[0885] "Situation matching means" refers to the algorithms and processes used to analyze the original data acquired, identify scenes that fit the situation specified by the user, and learn from them.

[0886] The "generation means" has a function of automatically generating a new fanzine based on the scene identified by the situation matching means.

[0887] The "storage means" has the function of storing the created doujinshi in the cloud and taking security measures to prevent unauthorized use of the content.

[0888] "Means of provision" refers to the function of providing links and a viewing environment for users to access doujinshi stored on the cloud.

[0889] "Means of access" refers to the function that allows users to access doujinshi stored on the cloud using a smart device.

[0890] "Generative AI means" refers to the technical means for automatically generating doujinshi using a generative AI model based on user input.

[0891] A "generative AI model" is a type of artificial intelligence, an algorithm or learning model that generates new content based on input text and conditions.

[0892] A "prompt" is a text-based instruction that indicates input data and conditions specified for a generative AI model.

[0893] The present invention is a system that automatically generates doujinshi based on a user's preferred situations and provides them on the cloud together with security measures. This system includes an input means, a data collection means, a situation matching means, a generation means, a storage means, and a provision means.

[0894] System Program Processing

[0895] User-specified input processing

[0896] Users use an input form on their smart device to input the title of the original work they have chosen and their preferred situation, and this information is sent to the server for further processing.

[0897] Data collection

[0898] The server retrieves data based on the specified original title from the e-book source via an API request. This data includes character information and scene details, and serves as the basis for subsequent situation matching.

[0899] Situation Matching

[0900] The server analyzes the original data it has acquired and identifies scenes that fit the situation specified by the user. This analysis uses a proprietary algorithm to extract and learn specific scenes and situations.

[0901] Creating fanzines

[0902] A generative AI model automatically generates high-quality doujinshi based on the data identified by the situation matching method, including scene reconstruction, new dialogue generation, and artwork assembly.

[0903] Cloud storage and serving

[0904] The created doujinshi is stored in the cloud, and as a security measure, technology is implemented to prevent screenshots from being taken. A link is generated on the cloud for viewing only, and users can view the content via that link using their smart device.

[0905] Specific examples

[0906] Let's say a user specifies the original title, "Manga Title," and inputs "a dialogue scene between Character A and Character B" as their preferred situation. The server retrieves "Manga Title" data from an e-book supply source, and extracts and learns "a dialogue scene between Character A and Character B" from it. The generative AI model then creates a new storyline and artwork based on that scene, which is then saved to the cloud as a doujinshi. The user can view the generated doujinshi via a link on the cloud, but cannot save it locally or take screenshots to prevent unauthorized use.

[0907] Prompt Sentence Examples

[0908] "Original data: 'A scene in which Character A and Character B fight. A uses a powerful technique, and B successfully defends.' Situation: 'A friendship blossoms.'"

[0909] In this way, the system of the present invention allows users to easily create high-quality doujinshi and enjoy them on the cloud while ensuring security.

[0910] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0911] Step 1: User Input

[0912] Users use their smart devices to enter the original title and their preferred situation into an input form. This input data is the basis for the entire system's processing. The input data (original title, situation) is sent to the server, which then uses this input to collect and analyze subsequent data.

[0913] Step 2: Data collection

[0914] The server uses the API of the e-book source to obtain data based on the original title specified by the user. The obtained data (details of the original, character information, scene information) is used for subsequent analysis. The results of the data collection are stored on the server as JSON format data.

[0915] Step 3: Situation matching

[0916] The server analyzes the original data it has acquired and identifies scenes that match the situation specified by the user. Based on the input data (acquired data, situation), it extracts specific scenes and character actions. The situation matching algorithm generates filtered scene data at this stage.

[0917] Step 4: Prompt generation

[0918] The server generates a prompt based on the data that matches the situation. The input data (filtered scene data, situation) is assembled into a specific format. This prompt is passed to a generative AI model and composed in text format.

[0919] Step 5: Generate the fanzine

[0920] The server inputs the generated prompt text into a generative AI model to generate a new story and artwork. The input data (prompt text) is processed by the generative AI model and output as a doujinshi. The content generated at this stage is in the form of a high-quality doujinshi that combines text and images.

[0921] Step 6: Cloud Saving

[0922] The server stores the generated doujinshi in cloud storage. The input data (the generated doujinshi) is uploaded to the cloud and security measures are applied. The stored data can be accessed through a specific link.

[0923] Step 7: Offer

[0924] The server provides users with an access link to the doujinshi stored on the cloud. The input data (cloud storage path and generated link) is notified to the user, and the user can use the link to view the content.

[0925] Step 8: Security measures

[0926] This technology makes it impossible to take screenshots of doujinshi stored in the cloud. Security settings are added to the input data (doujinshi data on the cloud), and the output is doujinshi data with restrictions on taking screenshots. This prevents unauthorized use.

[0927] In this way, the user, server, and cloud elements work together to perform processing, allowing users to safely and easily generate and view high-quality doujinshi.

[0928] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0929] The present invention combines a system that automatically generates doujinshi based on the original title and preferred situations specified by the user, stores the doujinshi on the cloud for personal use, and further combines it with an emotion engine that recognizes the user's emotions and reflects them in the content. The system includes input means, data collection means, situation matching means, generation means, storage means, provision means, and the emotion engine.

[0930] System program processing description

[0931] User-specified input processing

[0932] Users input the title of the manga and their preferred situation into an input form on their device. The emotion engine then recognizes the user's facial expressions and voice to identify their emotional state. For example, they can specify the "manga title," "a conversation scene between Character A and Character B," and the emotion "fun."

[0933] Data collection

[0934] The server sends an API request to retrieve data based on the original title from the e-book source. Specifically, it requests content related to "manga title."

[0935] Situation Matching

[0936] The server analyzes the original data and identifies scenes that match the situation specified by the user. It also adjusts the operation of the situation matching means based on the user's emotion identified by the emotion engine, and prioritizes extracting scenes that match the emotion. For example, it extracts data that includes dialogue scenes that match the emotion of "fun."

[0937] Creating fanzines

[0938] The server generates high-quality doujinshi based on the data extracted and learned by the scenario matching method and the user's emotions. The generation algorithm reconstructs the storyline, generates new dialogue content, and assembles artwork that reflects the user's emotions. For example, cheerful and fun dialogue and scenes are inserted to reflect the "fun" emotion.

[0939] Cloud storage and security measures

[0940] The server stores the created doujinshi in the cloud. Security measures are taken to prevent screenshots from being taken on the cloud. Cloud storage also uses encryption technology to strengthen data protection.

[0941] Provision to users

[0942] The device generates a link to access the doujinshi stored in the cloud and provides it to the user. The user can use the link to view the doujinshi on the cloud. Access is limited to viewing, and local storage and screenshot capture are restricted.

[0943] Specific examples

[0944] Suppose a user specifies the original title, "Manga Title," and inputs "Dialogue Scene Between Character A and Character B" and the emotion "Fun." The server retrieves "Manga Title" data from an e-book supply source, and extracts and learns from it "Dialogue Scenes" that are appropriate for the emotion "Fun." The generative algorithm then creates a new storyline and artwork that reflects the emotion "Fun," and stores it in the cloud as a doujinshi. The user can view the generated doujinshi via a link on the cloud, but cannot save it locally or take screenshots to prevent unauthorized use.

[0945] In this way, the present invention allows users to easily create and view high-quality doujinshi, while providing more personalized works that reflect the user's feelings, and also provides a mechanism for protecting the copyright of the original work.

[0946] The processing flow will be explained below.

[0947] Step 1:

[0948] Users input the title of the original manga and their preferred situation in the input form on their device. For example, they can specify the "manga title" and "a conversation scene between Character A and Character B."

[0949] Step 2:

[0950] The device captures the user's facial expressions with a camera or recognizes emotions through voice, which are then analyzed by an emotion engine to identify emotions such as "happy" or "excited."

[0951] Step 3:

[0952] The device sends the original title, situation, and identified emotion entered by the user to the server, so that the user's request and emotion information are delivered to the server.

[0953] Step 4:

[0954] The server sends an API request to retrieve data based on the original title from the e-book source. Specifically, it requests content related to "manga title."

[0955] Step 5:

[0956] The server receives the original data returned from the e-book source and parses the data, which includes the storyline, character information, and scene details.

[0957] Step 6:

[0958] The server analyzes the original data and identifies scenes that match the situation specified by the user. Based on the user's emotions identified by the emotion engine, the server adjusts the operation of the situation matching means and prioritizes the extraction of scenes that match the emotions.

[0959] Step 7:

[0960] The server further analyzes the scenes extracted by the situation matching method and learns data suitable for doujinshi generation. This learning process includes detailed analysis of the dialogue content and scene settings.

[0961] Step 8:

[0962] The server uses a generation method to generate a new doujinshi based on the extracted and learned data. Specifically, it reconstructs the storyline that reflects the user's emotions, generates new dialogue content, and assembles the artwork.

[0963] Step 9:

[0964] The server stores the created doujinshi in the cloud. At this time, security measures are taken to prevent screenshots from being taken on the cloud. In addition, encryption technology is used for cloud storage to strengthen data protection.

[0965] Step 10:

[0966] The server generates an access link to the doujinshi stored on the cloud and sends it to the terminal.

[0967] Step 11:

[0968] The device provides the user with an access link, and the user accesses the doujinshi on the cloud. Access is limited to viewing, with local storage and screenshot taking restricted.

[0969] Example 2

[0970] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0971] In recent years, there has been a growing need for many users to easily generate content that matches their preferences and emotions. However, existing systems have difficulty automatically generating high-quality doujinshi that reflect the situations and emotions specified by the user. Issues also remain regarding the security and copyright protection of the generated doujinshi. Furthermore, there is a lack of systems that can recognize and reflect user emotions in real time.

[0972] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: an input means for inputting the original work title and preferred situation and emotion specified by the user; a data collection means for acquiring original work data from a digital content source; a situation matching means for analyzing the acquired original work data and learning scenes that match the user's specified situation and emotion; a generation means for automatically generating a doujinshi based on the learned scenes and recognized emotions; a storage means for storing the generated doujinshi in the cloud and limiting its use to personal use with security measures; a provision means for allowing the user to access the doujinshi stored in the cloud; and an emotion recognition means for analyzing the user's facial expressions and voice to identify emotions. This allows users to easily automatically generate high-quality doujinshi tailored to their emotions and preferences and safely view them.

[0973] A "user" refers to an individual who uses the system to input information such as the original title, situation, and emotion, and then views the generated doujinshi.

[0974] "Original title" refers to the title of the original work entered by the user.

[0975] "Situation" refers to the scene or situation specified by the user.

[0976] "Emotion" refers to the feelings and psychological state that a user is experiencing.

[0977] "Input means" refers to the interface that allows users to input the original title, situation, and emotions.

[0978] "Digital content source" refers to the database or API from which the original data is provided.

[0979] "Data collection means" refers to a means for obtaining data from a digital content source based on an input original title.

[0980] "Situation matching means" refers to a means for analyzing the acquired original data and identifying scenes that match the situation and emotions specified by the user.

[0981] "Generation means" refers to algorithms and programs for automatically generating doujinshi based on learned scenes and user emotions.

[0982] "Storage means" refers to the means of storing the generated doujinshi in the cloud and taking appropriate security measures to limit its use to personal use.

[0983] "Means of provision" refers to the means of providing users with a method or link to access doujinshi stored on the cloud.

[0984] "Emotion recognition means" refers to systems or technologies that analyze a user's facial expressions and voice to identify emotions.

[0985] "Cloud" refers to network storage for storing generated data and providing it to users.

[0986] "Security Measures" means the technical and organizational measures to prevent unauthorized use of data.

[0987] This invention is a system that automatically generates doujinshi based on the original title, preferred situation, and emotion specified by the user. The system stores the generated doujinshi on the cloud and incorporates security measures to limit its use to personal use. It also uses an emotion recognition engine that recognizes the user's emotions in real time and reflects them in the generated content.

[0988] Specifically, the following hardware and software are used:

[0989] User's device: A computer or smartphone is used as the interface. An input form is displayed, and the user inputs the original title, situation, and emotion.

[0990] Camera and microphone: Captures the user's facial expressions and voice and provides input to the emotion recognition engine.

[0991] Server: The core hardware for processing data collection, situation matching, fanzine generation, cloud storage and delivery, including the generative AI models and cloud storage infrastructure.

[0992] Emotion recognition engine: Software that analyzes a user's facial expressions and voice in real time to identify emotions. For example, a facial recognition library (e.g., OpenCV) is used for facial expression recognition, and a speech processing library (e.g., Google Speech-to-Text API) is used for speech recognition.

[0993] Cloud storage: Online storage (e.g. AWS S3) to store the generated doujinshi and implement security measures.

[0994] 1. User-specified input processing

[0995] Users input the manga title, situation, and emotion using the device interface. The emotion recognition engine analyzes the user's facial expressions and voice to identify the actual emotion. For example, a user can input the "manga title," "a conversation scene between Character A and Character B," and the emotion "fun" into the form.

[0996] 2. Data Collection

[0997] The server sends an API request to retrieve data from an e-book source based on the input original title. For example, it retrieves "manga title" data using the API of a digital content provider (e.g., Google Books API).

[0998] 3. Situation matching

[0999] The server analyzes the acquired data and identifies scenes that match the situation and emotion specified by the user. It uses a generative AI model (e.g., GPT-4) to analyze the text and extract scenes based on the emotion data provided by the emotion recognition engine.

[1000] 4. Creating a fanzine

[1001] The server generates high-quality doujinshi that reflect the specified situation and emotion. It uses image generation models (e.g., DALL-E) and text generation models (e.g., OpenAI GPT-4) to generate the doujinshi. For example, it constructs a storyline that reflects the emotion of "fun" and generates dialogue scenes.

[1002] 5. Cloud storage and security measures

[1003] The server stores the generated doujinshi in cloud storage (e.g., AWS S3). At this time, security measures (e.g., embedding JavaScript code) are implemented to prevent screenshots from being taken. The stored data is protected using encryption technology (e.g., AES-256).

[1004] 6. Provision to Users

[1005] The device generates an access link to the doujinshi stored on the cloud and provides it to the user. The user can use the link to view the doujinshi on the cloud, but this is limited to viewing only; local storage and screenshots are restricted.

[1006] Specific examples

[1007] If the user specifies the original title "Manga Title", inputs "Dialogue scene between Character A and Character B", and the emotion "Fun", the following prompt can be used:

[1008] Original title: Manga title

[1009] Favorite Situation: A conversation scene between Character A and Character B

[1010] Emotion: Fun

[1011] Based on this prompt, the generative AI model generates a doujinshi according to the user's requirements and saves it in cloud storage, where the user can safely view it using the provided link.

[1012] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1013] Step 1: User Input

[1014] The user uses an input form on the device to input the original work title, preferred situation, and emotion. Input is done using a keyboard or touch screen. For example, the user inputs data such as "manga title," "a dialogue scene between Character A and Character B," and "fun." The emotion recognition engine uses a camera and microphone to analyze the user's facial expressions and voice in real time and checks whether they match the input emotion. The output of this step is the original work title, situation, and emotion data specified by the user.

[1015] Step 2: Data collection

[1016] The server collects related data from digital content sources based on the original title entered by the user. Specifically, the server sends a request to a digital book API (e.g., Google Books API) to obtain original data. For example, metadata and content related to "manga title" are downloaded to the server. The input is the original title provided by the user, and the output is the obtained original data.

[1017] Step 3: Situation matching

[1018] The server analyzes the original data it has acquired. It uses a generative AI model (e.g., GPT-4) to analyze scenes in the original data and identify and extract scenes that match the situation and emotion specified by the user. It also takes into account the emotion data provided by the emotion recognition engine to select the most appropriate scene. For example, it extracts dialogue scenes that match the emotion "fun." The input in this step is the acquired original data and emotion data, and the output is the identified and extracted scene data.

[1019] Step 4: Generate the fanzine

[1020] The server generates a doujinshi based on the scene data obtained from the situation matching method. The generation method uses a text generation model (e.g., GPT-4) or an image generation model (e.g., DALL-E). This constructs a storyline and artwork that matches the user's emotions and the specified situation. For example, a new story containing a "fun" dialogue scene is automatically generated. The input in this step is the identified and extracted scene data and emotion data, and the output is the generated doujinshi data.

[1021] Step 5: Cloud storage and security measures

[1022] The server stores the generated doujinshi in cloud storage. For example, it uploads the data to AWS S3. When saving, security measures (e.g., embedding JavaScript code) are implemented to prevent screenshots from being taken, and the data is protected using AES-256 encryption technology. The input is the generated doujinshi data, and the output is doujinshi data safely stored on the cloud.

[1023] Step 6: Deliver to users

[1024] The device generates an access link to the doujinshi stored on the cloud and provides it to the user. The user can use the link to access and view the doujinshi, but local storage and screenshot capture are restricted. The input is the doujinshi data stored on the cloud, and the output is the access link provided to the user.

[1025] (Application example 2)

[1026] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1027] Existing doujinshi generation systems only automatically generate works based on situations specified by the user, and lack the ability to provide more personalized works by reflecting the user's emotions. Furthermore, there is a need to provide a more immersive experience by providing a viewing environment in a virtual space.

[1028] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1029] In this invention, the server includes an input means for inputting the title of an original work and a preferred situation specified by the user, a data collection means for acquiring original work data from an electronic book supply source, a situation matching means for analyzing the acquired original work data and learning scenes that match the situation specified by the user, a generation means for automatically generating a doujinshi based on the learned scenes, a storage means for storing the generated doujinshi in a cloud and limiting its use to personal use with security measures, a provision means for allowing the user to access the doujinshi stored in the cloud, an emotion recognition means for recognizing emotions from the user's facial expressions and voice and adjusting the content of the doujinshi based on the emotions, and a display means for making the generated doujinshi available for viewing in a store in a virtual space via smart glasses. This makes it possible to generate a personalized doujinshi that reflects the user's emotions and provide a realistic viewing experience in the virtual space.

[1030] A "user" is someone who uses the system to specify the original title and situation, and generates and reads personalized doujinshi based on their emotions.

[1031] "Original title" refers to the title of the original work that the user enters into the system, and is the data that serves as the basis for generating the doujinshi.

[1032] "Situation" refers to the scenes or scenes that users like, and is a factor that specifically determines the content of a doujinshi.

[1033] "Input means" refers to the device or interface that allows the user to input the original title and situation into the system.

[1034] "Data collection means" refers to a method or device for acquiring original data from an e-book source.

[1035] "Situation matching means" refers to an algorithm or device that analyzes the original data acquired and identifies and learns scenes that match the situation specified by the user.

[1036] "Generation means" refers to a system or device for automatically constructing and generating doujinshi based on learned scenes.

[1037] "Storage means" refers to a method or device for storing the generated doujinshi in the cloud and limiting it to personal use by taking specific security measures.

[1038] "Means of provision" refers to an interface or link suitable for users to access doujinshi stored on the cloud.

[1039] "Emotion recognition means" refers to a system or algorithm that recognizes emotions from the user's facial expressions and voice and adjusts the content of the doujinshi based on those emotions.

[1040] "Display means" refers to the display and software that allows the doujinshi generated via smart glasses to be viewed in a store within the virtual space.

[1041] This invention combines a system that automatically generates doujinshi based on the original title and preferred situation specified by the user, stores the doujinshi on the cloud for personal use, and an emotion engine that recognizes the user's emotions and reflects them in the content. Furthermore, by making the doujinshi available for viewing in a virtual store through smart glasses, users are provided with a realistic experience.

[1042] The system configuration includes the following elements:

[1043] 1. Input Method

[1044] Users enter the title of the original work and their preferred situation using an input form on their device, typically a smartphone or tablet.

[1045] Example: Enter "Manga Title" and "Dialogue scene between Character A and Character B."

[1046] 2. Data Collection Methods

[1047] The server sends an API request to acquire original data from the e-book source, using the API of the e-book source via the Internet.

[1048] Example: Get content related to "manga title".

[1049] 3. Situation matching method

[1050] The server analyzes the acquired original data, identifies scenes that match the situation specified by the user, and adjusts the operation of the situation matching means based on the user's emotion identified by the emotion recognition means.

[1051] Example: Extract data containing dialogue scenes that match the emotion "fun."

[1052] 4. Emotion recognition means

[1053] The emotion recognition engine recognizes the user's facial expressions and voice to identify their emotional state. Emotion recognition is performed using Microsoft's Emotion API, among other tools. This allows the creation of doujinshi tailored to the user's preferences.

[1054] Example: Recognizing the emotion "fun" from the user's facial expression.

[1055] 5. Generation means

[1056] The server generates high-quality doujinshi based on data extracted and learned through situation matching and user emotions. The generative algorithm reconstructs the storyline reflecting the user's emotions, generates new dialogue, and assembles the artwork. These generation processes are automated using a generative AI model.

[1057] Example: Construct a storyline and artwork that reflects the emotion "fun."

[1058] 6. Preservation means

[1059] The server stores the created doujinshi in the cloud. Security measures are taken to prevent screenshots from being taken on the cloud. Cloud storage also uses encryption technology.

[1060] Example: Using cloud storage such as AWS (Amazon Web Services).

[1061] 7. Means of provision

[1062] A link is generated and provided to users to access the doujinshi stored on the cloud. Users can view the doujinshi on the cloud through the link, but local storage and screenshot capture are restricted to prevent unauthorized use.

[1063] For example, send an access link to the user's email address.

[1064] 8. Display means

[1065] We provide displays and software that allow the created doujinshi to be viewed in a store in a virtual space via smart glasses.

[1066] For example, using a head-mounted display such as Oculus Quest.

[1067] Specific examples

[1068] When a user specifies the original manga title, "Manga Title," and inputs the dialogue scene between Character A and Character B and the emotion "fun," the server retrieves the manga title data from the e-book source and extracts and learns dialogue scenes that fit the emotion "fun." The generative AI model then creates a new storyline and artwork that reflects the emotion "fun," and stores it in the cloud as a doujinshi. The user can view the generated doujinshi through a link in the virtual space via smart glasses, but cannot save it locally or take screenshots to prevent unauthorized use.

[1069] Example prompt sentence:

[1070] Original title: Spider-Man

[1071] Situation: A scene where Spider-Man and a villain are having a conversation

[1072] Emotion: excitement

[1073] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1074] Step 1:

[1075] The user uses the input form on the device to input the original title and their preferred situation. This input also includes a function to capture the user's facial expressions and voice to reflect their emotions. Specifically, the user uses a smartphone or tablet to input the "original title," "situation," and "emotion." The input data and the captured user's emotional data are sent to the next process.

[1076] Input: Original title, situation, user's facial expression and voice

[1077] Output: Original title, situation, emotion data

[1078] Step 2:

[1079] The server sends an API request to retrieve original data from the e-book source. Specifically, based on the specified original title, the server retrieves related content from the e-book source. Based on the API request, the e-book source returns the corresponding data.

[1080] Input: Original title

[1081] Output: Original data

[1082] Step 3:

[1083] The server analyzes the original data and identifies scenes that match the situations specified by the user. The server uses a situation matching algorithm to identify the scenes. The server also adjusts the importance of situation matching based on the user's emotion data identified by the emotion recognition means.

[1084] Input: original data, situation, emotional data

[1085] Output: Scenes that match the situation

[1086] Step 4:

[1087] The server automatically generates a doujinshi based on the identified scene data and the user's emotional data. The generation means reconstructs the storyline corresponding to the emotions, generates new dialogue content, and assembles the artwork. This is done using a generative AI model.

[1088] Input: Scenes and emotion data that match the situation

[1089] Output: The generated fanzine

[1090] Step 5:

[1091] The server stores the generated doujinshi in the cloud, and takes security measures to limit its use to personal use. The cloud storage uses encryption technology, and measures are taken to prevent unauthorized access by disabling screenshots.

[1092] Input: Generated fanzine

[1093] Output: Doujinshi saved on the cloud

[1094] Step 6:

[1095] The server generates a link to access the doujinshi stored on the cloud and provides it to the user. The user accesses the doujinshi via the link, but is only allowed to view it; local storage and screenshots are restricted.

[1096] Input: Doujinshi saved on the cloud

[1097] Output: Access link

[1098] Step 7:

[1099] The user wears smart glasses and browses the created doujinshi in a store in a virtual space. The smart glasses display the created doujinshi on a display unit. Browsing in the virtual space provides the user with a realistic experience.

[1100] Input: Access link

[1101] Output: A doujinshi displayed in a virtual space

[1102] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1103] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1104] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1105] [Fourth embodiment]

[1106] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1107] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1108] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1109] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1110] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1111] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1112] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1113] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1114] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1115] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1116] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1117] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1118] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1119] The present invention is a system that automatically generates doujinshi based on the original title and preferred situations specified by the user, and stores the doujinshi on the cloud for personal use only. This system includes an input means, a data collection means, a situation matching means, a generation means, a storage means, and a provision means.

[1120] System program processing description

[1121] User-specified input processing

[1122] The user enters the title of the original work and their preferred situation into the input form on their device, which then conveys their intended content to the system.

[1123] Data collection

[1124] The server retrieves data based on the original title from the e-book source. At this stage, it sends an API request to receive the required original data, including character information and scene details.

[1125] Situation Matching

[1126] The server analyzes the original data it has acquired and identifies scenes that match the situation specified by the user. To do this, the server uses a proprietary algorithm to extract specific elements from the data. For example, if a user specifies "a scene where Character A and Character B face off," the server will extract only data related to that scene.

[1127] Creating fanzines

[1128] The server generates high-quality doujinshi based on the data extracted by the situation matching method. The generation algorithm rearranges scenes, generates new dialogue, and assembles artwork, resulting in a unique work based on the user's requirements.

[1129] Cloud storage and security measures

[1130] The server stores the created doujinshi in the cloud, and security measures are implemented. Specifically, the server makes it impossible to take screenshots of the content on the cloud, and technology is introduced to prevent users from illegally taking out the content.

[1131] Provision to users

[1132] The device provides the user with a link to access the doujinshi stored in the cloud. The user can use the link to view the content on the cloud, but local storage and screenshots are restricted. In this way, the user can enjoy the doujinshi in a secure environment.

[1133] Specific examples

[1134] Suppose a user specifies the original title, "Manga Title," and inputs "a dialogue scene between Character A and Character B" as their preferred situation. The server retrieves "Manga Title" data from an e-book supply source, extracts and learns "a dialogue scene between Character A and Character B" from it. A generative algorithm then creates a new storyline and artwork based on that scene, and stores it in the cloud as a doujinshi. The user can view the generated doujinshi via a link on the cloud, but cannot save it locally or take screenshots to prevent unauthorized use.

[1135] In this way, the present invention provides a mechanism that allows users to easily create and view high-quality doujinshi while protecting the copyright of the original work.

[1136] The processing flow will be explained below.

[1137] Step 1:

[1138] The user uses the input form on the device to input the title of the original work and the situation of their choice. For example, they can specify the "manga title" and the "conversation scene between Character A and Character B."

[1139] Step 2:

[1140] The device sends the original title and situation entered by the user to the server, and the user's request reaches the server.

[1141] Step 3:

[1142] The server sends an API request to retrieve data about the original title from the e-book source, specifically requesting content about "ManagaTitle."

[1143] Step 4:

[1144] The server receives the original data returned from the e-book source and parses the data, which includes the storyline, character information, and scene details.

[1145] Step 5:

[1146] The server analyzes the original data and identifies scenes that match the situation specified by the user. For example, it extracts scenes that include a conversation between Character A and Character B.

[1147] Step 6:

[1148] The server further analyzes the extracted scenes using situation matching techniques to learn data suitable for doujinshi generation. This learning process includes detailed analysis of dialogue content and scene settings.

[1149] Step 7:

[1150] The server uses the generation means to generate a new doujinshi based on the extracted and learned data, specifically by reconstructing the storyline, generating new dialogue, and assembling the artwork.

[1151] Step 8:

[1152] The server stores the created doujinshi in the cloud, and takes security measures to prevent screenshots from being taken on the cloud.

[1153] Step 9:

[1154] The server generates an access link to the doujinshi stored on the cloud and sends it to the terminal.

[1155] Step 10:

[1156] The device provides the user with an access link, and the user accesses the doujinshi on the cloud. Access is limited to viewing, with local storage and screenshot taking restricted.

[1157] Example 1

[1158] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1159] Conventional doujinshi creation methods require a great deal of time and effort to obtain original data, identify scenes, and generate works, and the quality of the works is inconsistent. Furthermore, security measures to limit use to personal use are insufficient, raising the risk of unauthorized use. To address these issues, a system is needed that allows users to easily create high-quality doujinshi and safely view them.

[1160] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1161] In this invention, the server includes an input means for inputting the original title and preferred situation specified by the user, a data collection means for acquiring original data from an electronic book supply source, a situation matching means for analyzing the acquired original data and learning scenes that match the situation specified by the user, a generation means for automatically generating a work based on the learned scenes, a storage means for saving the generated work in the cloud and taking security measures to limit it to personal use, and a provision means for users to access the work saved on the cloud. This allows users to easily create high-quality doujinshi and safely view them.

[1162] "Input means" refers to a device or software that allows a user to input the original title and preferred situation designated by the user into the system.

[1163] "Data Collection Implements" means devices or software for obtaining necessary original data from electronic book sources.

[1164] The "situation matching means" is a device or software for analyzing the acquired original data and identifying scenes that match the situation specified by the user.

[1165] "Generation means" refers to a device or software for automatically generating a work based on a learned scene.

[1166] "Storage" means a device or software that stores the created work in the cloud, secures it, and limits it to personal use.

[1167] "Delivery means" means any device or software that allows users to access works stored on the cloud.

[1168] The present invention is a system that automatically generates doujinshi based on the original title and preferred situations specified by the user, and stores the doujinshi on the cloud for personal use only. The system includes an input means, a data collection means, a situation matching means, a generation means, a storage means, and a provision means.

[1169] The input means is a device or software for inputting the original title and preferred situation designated by the user, and is realized by an input form on the terminal. This form has a validation function to check the accuracy of the input.

[1170] The data collection means is a device or software for acquiring original data from e-book providers. In this system, data is acquired from e-book providers, such as Amazon Kindle or Kobo, through an API. The server sends an API request to acquire the necessary original data. The acquired data includes character information and scene details.

[1171] The situation matching means is a device or software that analyzes the acquired original data and identifies scenes that match the situation specified by the user. The server uses a natural language processing (NLP) algorithm, such as Python's NLTK library or SpaCy, to analyze the data and extract specific scenes.

[1172] The generator is a device or software that automatically generates works based on the learned scenes. Here, a generative AI model (e.g., GPT-4 or DALL-E) is used to rearrange the scenes, generate new dialogue, and assemble artwork. This results in a high-quality doujinshi.

[1173] The storage means is a device or software that stores the created doujinshi in the cloud and implements security measures to limit its use to personal use. The server stores the doujinshi in a cloud storage service (e.g., Amazon S3 or Google Cloud Storage) and applies technology to restrict access and prevent screenshots.

[1174] The means of provision is a device or software that allows users to access works stored on the cloud. The device provides users with a link to access the doujinshi on the cloud, and users can view the content on the cloud through that link, but local storage and screenshot capture are restricted.

[1175] Examples:

[1176] Let's consider the case where a user inputs the original title, "Manga Title," and a preferred situation, "A conversation scene between Character A and Character B." The server retrieves the "Manga Title" data from the e-book source and extracts the "Conversation scene between Character A and Character B" from it. The generative AI model then creates a new storyline and artwork based on that scene, and saves it in the cloud as a doujinshi. The user can view the generated doujinshi through the provided link, but cannot save it locally or take screenshots.

[1177] Example prompt sentence:

[1178] "Original title: Manga title

[1179] Favorite situation: A conversation scene between Character A and Character B

[1180] In this way, the present invention provides a mechanism that allows users to easily create and view high-quality doujinshi while protecting the copyright of the original work.

[1181] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1182] Step 1: User-specified input processing

[1183] The user enters the "original title" and "preferred situation" into the input form on their device. At this stage, a validation function is activated to check whether the input is accurate. Specifically, it checks whether the string entered into the form is blank and in the correct format.

[1184] Input: "Original title" and "Favorite situation"

[1185] Output: User-specified input data

[1186] Specific operation: The user enters the "manga title" and "conversation scene between Character A and Character B" and clicks the input button.

[1187] Step 2: Data collection

[1188] The server receives the user's input data and sends a request to the e-book source to retrieve the corresponding original data. The API request uses the HTTPS protocol, and the retrieved data is received in JSON format.

[1189] Input: User-specified input data

[1190] Output: Original data (character information, scene details, etc.)

[1191] Specific behavior:

[1192] Request URL: https: / / api.electronicbookservice.com / getBookData

[1193] Parameters: {"title": "Manga Title"}

[1194] The server sends this request and receives the corresponding data.

[1195] Step 3: Situation matching

[1196] The server analyzes the original data and identifies scenes that match the user's specified situation. It uses natural language processing (NLP) algorithms, such as Python's NLTK library, to analyze the data. Scenes are identified based on specific keywords and character names.

[1197] Input: Original data

[1198] Output: Scene data that matches the specified situation

[1199] Specific behavior:

[1200] import nltk

[1201] nltk.download('punkt')

[1202] text = "Text of the original data"

[1203] tokens = nltk.word_tokenize(text)

[1204] if "Character A" in tokens and "Character B" in tokens:

[1205] Extract the corresponding scene

[1206] scene_data = extract_scene(tokens)

[1207] The server performs this operation and extracts the matched scene data.

[1208] Step 4: Generate the fanzine

[1209] The server generates the fanzine using a generative AI model (e.g., GPT-4 or DALL-E) based on the scene data extracted in the context matching step. The generative algorithm rearranges the scene, generates new dialogue, and assembles the artwork.

[1210] Input: Scene data

[1211] Output: Automatically generated fanzine data

[1212] Specific behavior:

[1213] from transformers import GPT4ForTextGeneration

[1214] model = GPT4ForTextGeneration.from_pretrained('gpt4')

[1215] prompt = "Generate a new dialogue based on the dialogue scene between Character A and Character B."

[1216] generated_text = model.generate_text(prompt)

[1217] The server performs this operation and creates a fanzine file incorporating the generated text and artwork.

[1218] Step 5: Cloud storage and security measures

[1219] The server stores the generated doujinshi in the cloud and configures security settings. It uses cloud storage services (e.g., Amazon S3 and Google Cloud Storage) and applies technologies to restrict access and prevent screenshots.

[1220] Input: Auto-generated fanzine data

[1221] Output: Doujinshi saved in the cloud

[1222] Specific behavior:

[1223] import boto3

[1224] s3 = boto3.client('s3')

[1225] bucket_name = 'Doujinshi storage bucket'

[1226] file_data = "Generated fanzine binary data"

[1227] s3.put_object(Bucket=bucket_name, Key='user_doujinshi.pdf', Body=file_data)

[1228] Access permission settings

[1229] s3.put_bucket_policy(...)

[1230] The server performs this operation, stores the doujinshi on the cloud, and implements security measures.

[1231] Step 6: Deliver to users

[1232] The device provides users with an access link to the doujinshi stored on the cloud. Users can use this link to view the doujinshi on the cloud, but local storage and screenshots are restricted to prevent unauthorized use.

[1233] Input: Doujinshi stored in the cloud

[1234] Output: Access link provided to user

[1235] Specific behavior:

[1236] Users click on the provided link (e.g. https: / / cloudstorage.com / user_doujinshi.pdf) and view the doujinshi in their web browser.

[1237] (Application example 1)

[1238] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1239] Conventional doujinshi creation systems required users to create content manually, requiring a great deal of time and effort. Furthermore, there was a lack of means to safely store the generated content or to appropriately restrict access, exposing it to the risk of copyright infringement and unauthorized use. Furthermore, while there is an increasing need to view content via smart devices, there are few systems that can accommodate this. There is a need for a system that solves these problems, reduces the burden on users, and allows users to safely create and use high-quality doujinshi.

[1240] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1241] In this invention, the server includes an input means for inputting the original work title and preferred situation specified by the user, a data collection means for acquiring original work data from an e-book supply source, a situation matching means for analyzing the acquired original work data and learning scenes that match the situation specified by the user, a generation means for automatically generating a doujinshi based on the learned scenes, a storage means for storing the generated doujinshi in the cloud and limiting its use to personal use with security measures, a provision means for the user to access the doujinshi stored in the cloud, an access means for the user to access the generated doujinshi via a smart device, and a generation AI means for generating the doujinshi using a generative AI model based on the input content specified by the user. This allows the user to automatically generate a high-quality doujinshi based on the original work title and situation specified by the user, safely store it on the cloud, and easily access it via a smart device.

[1242] "User-specified original title" is the name of an existing work specified by the system user via input means.

[1243] A "preferred situation" is a specific situation or setting that a user desires for a scene or setting in a doujinshi.

[1244] "Input means" refers to a device or software that provides an interface for users to input the original title and their preferred situation into the system.

[1245] "Data collection means" refers to a function for collecting necessary content data based on a designated original title from an e-book supply source.

[1246] "Situation matching means" refers to the algorithms and processes used to analyze the original data acquired, identify scenes that fit the situation specified by the user, and learn from them.

[1247] The "generation means" has a function of automatically generating a new fanzine based on the scene identified by the situation matching means.

[1248] The "storage means" has the function of storing the created doujinshi in the cloud and taking security measures to prevent unauthorized use of the content.

[1249] "Means of provision" refers to the function of providing links and a viewing environment for users to access doujinshi stored on the cloud.

[1250] "Means of access" refers to the function that allows users to access doujinshi stored on the cloud using a smart device.

[1251] "Generative AI means" refers to the technical means for automatically generating doujinshi using a generative AI model based on user input.

[1252] A "generative AI model" is a type of artificial intelligence, an algorithm or learning model that generates new content based on input text and conditions.

[1253] A "prompt" is a text-based instruction that indicates input data and conditions specified for a generative AI model.

[1254] The present invention is a system that automatically generates doujinshi based on a user's preferred situations and provides them on the cloud together with security measures. This system includes an input means, a data collection means, a situation matching means, a generation means, a storage means, and a provision means.

[1255] System Program Processing

[1256] User-specified input processing

[1257] Users use an input form on their smart device to input the title of the original work they have chosen and their preferred situation, and this information is sent to the server for further processing.

[1258] Data collection

[1259] The server retrieves data based on the specified original title from the e-book source via an API request. This data includes character information and scene details, and serves as the basis for subsequent situation matching.

[1260] Situation Matching

[1261] The server analyzes the original data it has acquired and identifies scenes that fit the situation specified by the user. This analysis uses a proprietary algorithm to extract and learn specific scenes and situations.

[1262] Creating fanzines

[1263] A generative AI model automatically generates high-quality doujinshi based on the data identified by the situation matching method, including scene reconstruction, new dialogue generation, and artwork assembly.

[1264] Cloud storage and serving

[1265] The created doujinshi is stored in the cloud, and as a security measure, technology is implemented to prevent screenshots from being taken. A link is generated on the cloud for viewing only, and users can view the content via that link using their smart device.

[1266] Specific examples

[1267] Let's say a user specifies the original title, "Manga Title," and inputs "a dialogue scene between Character A and Character B" as their preferred situation. The server retrieves "Manga Title" data from an e-book supply source, and extracts and learns "a dialogue scene between Character A and Character B" from it. The generative AI model then creates a new storyline and artwork based on that scene, which is then saved to the cloud as a doujinshi. The user can view the generated doujinshi via a link on the cloud, but cannot save it locally or take screenshots to prevent unauthorized use.

[1268] Prompt Sentence Examples

[1269] "Original data: 'A scene in which Character A and Character B fight. A uses a powerful technique, and B successfully defends.' Situation: 'A friendship blossoms.'"

[1270] In this way, the system of the present invention allows users to easily create high-quality doujinshi and enjoy them on the cloud while ensuring security.

[1271] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1272] Step 1: User Input

[1273] Users use their smart devices to enter the original title and their preferred situation into an input form. This input data is the basis for the entire system's processing. The input data (original title, situation) is sent to the server, which then uses this input to collect and analyze subsequent data.

[1274] Step 2: Data collection

[1275] The server uses the API of the e-book source to obtain data based on the original title specified by the user. The obtained data (details of the original, character information, scene information) is used for subsequent analysis. The results of the data collection are stored on the server as JSON format data.

[1276] Step 3: Situation matching

[1277] The server analyzes the original data it has acquired and identifies scenes that match the situation specified by the user. Based on the input data (acquired data, situation), it extracts specific scenes and character actions. The situation matching algorithm generates filtered scene data at this stage.

[1278] Step 4: Prompt generation

[1279] The server generates a prompt based on the data that matches the situation. The input data (filtered scene data, situation) is assembled into a specific format. This prompt is passed to a generative AI model and composed in text format.

[1280] Step 5: Generate the fanzine

[1281] The server inputs the generated prompt text into a generative AI model to generate a new story and artwork. The input data (prompt text) is processed by the generative AI model and output as a doujinshi. The content generated at this stage is in the form of a high-quality doujinshi that combines text and images.

[1282] Step 6: Cloud Saving

[1283] The server stores the generated doujinshi in cloud storage. The input data (the generated doujinshi) is uploaded to the cloud and security measures are applied. The stored data can be accessed through a specific link.

[1284] Step 7: Offer

[1285] The server provides users with an access link to the doujinshi stored on the cloud. The input data (cloud storage path and generated link) is notified to the user, and the user can use the link to view the content.

[1286] Step 8: Security measures

[1287] This technology makes it impossible to take screenshots of doujinshi stored in the cloud. Security settings are added to the input data (doujinshi data on the cloud), and the output is doujinshi data with restrictions on taking screenshots. This prevents unauthorized use.

[1288] In this way, the user, server, and cloud elements work together to perform processing, allowing users to safely and easily generate and view high-quality doujinshi.

[1289] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1290] The present invention combines a system that automatically generates doujinshi based on the original title and preferred situations specified by the user, stores the doujinshi on the cloud for personal use, and further combines it with an emotion engine that recognizes the user's emotions and reflects them in the content. The system includes input means, data collection means, situation matching means, generation means, storage means, provision means, and the emotion engine.

[1291] System program processing description

[1292] User-specified input processing

[1293] Users input the title of the manga and their preferred situation into an input form on their device. The emotion engine then recognizes the user's facial expressions and voice to identify their emotional state. For example, they can specify the "manga title," "a conversation scene between Character A and Character B," and the emotion "fun."

[1294] Data collection

[1295] The server sends an API request to retrieve data based on the original title from the e-book source. Specifically, it requests content related to "manga title."

[1296] Situation Matching

[1297] The server analyzes the original data and identifies scenes that match the situation specified by the user. It also adjusts the operation of the situation matching means based on the user's emotion identified by the emotion engine, and prioritizes extracting scenes that match the emotion. For example, it extracts data that includes dialogue scenes that match the emotion of "fun."

[1298] Creating fanzines

[1299] The server generates high-quality doujinshi based on the data extracted and learned by the scenario matching method and the user's emotions. The generation algorithm reconstructs the storyline, generates new dialogue content, and assembles artwork that reflects the user's emotions. For example, cheerful and fun dialogue and scenes are inserted to reflect the "fun" emotion.

[1300] Cloud storage and security measures

[1301] The server stores the created doujinshi in the cloud. Security measures are taken to prevent screenshots from being taken on the cloud. Cloud storage also uses encryption technology to strengthen data protection.

[1302] Provision to users

[1303] The device generates a link to access the doujinshi stored in the cloud and provides it to the user. The user can use the link to view the doujinshi on the cloud. Access is limited to viewing, and local storage and screenshot capture are restricted.

[1304] Specific examples

[1305] Suppose a user specifies the original title, "Manga Title," and inputs "Dialogue Scene Between Character A and Character B" and the emotion "Fun." The server retrieves "Manga Title" data from an e-book supply source, and extracts and learns from it "Dialogue Scenes" that are appropriate for the emotion "Fun." The generative algorithm then creates a new storyline and artwork that reflects the emotion "Fun," and stores it in the cloud as a doujinshi. The user can view the generated doujinshi via a link on the cloud, but cannot save it locally or take screenshots to prevent unauthorized use.

[1306] In this way, the present invention allows users to easily create and view high-quality doujinshi, while providing more personalized works that reflect the user's feelings, and also provides a mechanism for protecting the copyright of the original work.

[1307] The processing flow will be explained below.

[1308] Step 1:

[1309] Users input the title of the original manga and their preferred situation in the input form on their device. For example, they can specify the "manga title" and "a conversation scene between Character A and Character B."

[1310] Step 2:

[1311] The device captures the user's facial expressions with a camera or recognizes emotions through voice, which are then analyzed by an emotion engine to identify emotions such as "happy" or "excited."

[1312] Step 3:

[1313] The device sends the original title, situation, and identified emotion entered by the user to the server, so that the user's request and emotion information are delivered to the server.

[1314] Step 4:

[1315] The server sends an API request to retrieve data based on the original title from the e-book source. Specifically, it requests content related to "manga title."

[1316] Step 5:

[1317] The server receives the original data returned from the e-book source and parses the data, which includes the storyline, character information, and scene details.

[1318] Step 6:

[1319] The server analyzes the original data and identifies scenes that match the situation specified by the user. Based on the user's emotions identified by the emotion engine, the server adjusts the operation of the situation matching means and prioritizes the extraction of scenes that match the emotions.

[1320] Step 7:

[1321] The server further analyzes the scenes extracted by the situation matching method and learns data suitable for doujinshi generation. This learning process includes detailed analysis of the dialogue content and scene settings.

[1322] Step 8:

[1323] The server uses a generation method to generate a new doujinshi based on the extracted and learned data. Specifically, it reconstructs the storyline that reflects the user's emotions, generates new dialogue content, and assembles the artwork.

[1324] Step 9:

[1325] The server stores the created doujinshi in the cloud. At this time, security measures are taken to prevent screenshots from being taken on the cloud. In addition, encryption technology is used for cloud storage to strengthen data protection.

[1326] Step 10:

[1327] The server generates an access link to the doujinshi stored on the cloud and sends it to the terminal.

[1328] Step 11:

[1329] The device provides the user with an access link, and the user accesses the doujinshi on the cloud. Access is limited to viewing, with local storage and screenshot taking restricted.

[1330] Example 2

[1331] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1332] In recent years, there has been a growing need for many users to easily generate content that matches their preferences and emotions. However, existing systems have difficulty automatically generating high-quality doujinshi that reflect the situations and emotions specified by the user. Issues also remain regarding the security and copyright protection of the generated doujinshi. Furthermore, there is a lack of systems that can recognize and reflect user emotions in real time.

[1333] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: an input means for inputting the original work title and preferred situation and emotion specified by the user; a data collection means for acquiring original work data from a digital content source; a situation matching means for analyzing the acquired original work data and learning scenes that match the user's specified situation and emotion; a generation means for automatically generating a doujinshi based on the learned scenes and recognized emotions; a storage means for storing the generated doujinshi in the cloud and limiting its use to personal use with security measures; a provision means for allowing the user to access the doujinshi stored in the cloud; and an emotion recognition means for analyzing the user's facial expressions and voice to identify emotions. This allows users to easily automatically generate high-quality doujinshi tailored to their emotions and preferences and safely view them.

[1334] A "user" refers to an individual who uses the system to input information such as the original title, situation, and emotion, and then views the generated doujinshi.

[1335] "Original title" refers to the title of the original work entered by the user.

[1336] "Situation" refers to the scene or situation specified by the user.

[1337] "Emotion" refers to the feelings and psychological state that a user is experiencing.

[1338] "Input means" refers to the interface that allows users to input the original title, situation, and emotions.

[1339] "Digital content source" refers to the database or API from which the original data is provided.

[1340] "Data collection means" refers to a means for obtaining data from a digital content source based on an input original title.

[1341] "Situation matching means" refers to a means for analyzing the acquired original data and identifying scenes that match the situation and emotions specified by the user.

[1342] "Generation means" refers to algorithms and programs for automatically generating doujinshi based on learned scenes and user emotions.

[1343] "Storage means" refers to the means of storing the generated doujinshi in the cloud and taking appropriate security measures to limit its use to personal use.

[1344] "Means of provision" refers to the means of providing users with a method or link to access doujinshi stored on the cloud.

[1345] "Emotion recognition means" refers to systems or technologies that analyze a user's facial expressions and voice to identify emotions.

[1346] "Cloud" refers to network storage for storing generated data and providing it to users.

[1347] "Security Measures" means the technical and organizational measures to prevent unauthorized use of data.

[1348] This invention is a system that automatically generates doujinshi based on the original title, preferred situation, and emotion specified by the user. The system stores the generated doujinshi on the cloud and incorporates security measures to limit its use to personal use. It also uses an emotion recognition engine that recognizes the user's emotions in real time and reflects them in the generated content.

[1349] Specifically, the following hardware and software are used:

[1350] User's device: A computer or smartphone is used as the interface. An input form is displayed, and the user inputs the original title, situation, and emotion.

[1351] Camera and microphone: Captures the user's facial expressions and voice and provides input to the emotion recognition engine.

[1352] Server: The core hardware for processing data collection, situation matching, fanzine generation, cloud storage and delivery, including the generative AI models and cloud storage infrastructure.

[1353] Emotion recognition engine: Software that analyzes a user's facial expressions and voice in real time to identify emotions. For example, a facial recognition library (e.g., OpenCV) is used for facial expression recognition, and a speech processing library (e.g., Google Speech-to-Text API) is used for speech recognition.

[1354] Cloud storage: Online storage (e.g. AWS S3) to store the generated doujinshi and implement security measures.

[1355] 1. User-specified input processing

[1356] Users input the manga title, situation, and emotion using the device interface. The emotion recognition engine analyzes the user's facial expressions and voice to identify the actual emotion. For example, a user can input the "manga title," "a conversation scene between Character A and Character B," and the emotion "fun" into the form.

[1357] 2. Data Collection

[1358] The server sends an API request to retrieve data from an e-book source based on the input original title. For example, it retrieves "manga title" data using the API of a digital content provider (e.g., Google Books API).

[1359] 3. Situation matching

[1360] The server analyzes the acquired data and identifies scenes that match the situation and emotion specified by the user. It uses a generative AI model (e.g., GPT-4) to analyze the text and extract scenes based on the emotion data provided by the emotion recognition engine.

[1361] 4. Creating a fanzine

[1362] The server generates high-quality doujinshi that reflect the specified situation and emotion. It uses image generation models (e.g., DALL-E) and text generation models (e.g., OpenAI GPT-4) to generate the doujinshi. For example, it constructs a storyline that reflects the emotion of "fun" and generates dialogue scenes.

[1363] 5. Cloud storage and security measures

[1364] The server stores the generated doujinshi in cloud storage (e.g., AWS S3). At this time, security measures (e.g., embedding JavaScript code) are implemented to prevent screenshots from being taken. The stored data is protected using encryption technology (e.g., AES-256).

[1365] 6. Provision to Users

[1366] The device generates an access link to the doujinshi stored on the cloud and provides it to the user. The user can use the link to view the doujinshi on the cloud, but this is limited to viewing only; local storage and screenshots are restricted.

[1367] Specific examples

[1368] If the user specifies the original title "Manga Title", inputs "Dialogue scene between Character A and Character B", and the emotion "Fun", the following prompt can be used:

[1369] Original title: Manga title

[1370] Favorite Situation: A conversation scene between Character A and Character B

[1371] Emotion: Fun

[1372] Based on this prompt, the generative AI model generates a doujinshi according to the user's requirements and saves it in cloud storage, where the user can safely view it using the provided link.

[1373] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1374] Step 1: User Input

[1375] The user uses an input form on the device to input the original work title, preferred situation, and emotion. Input is done using a keyboard or touch screen. For example, the user inputs data such as "manga title," "a dialogue scene between Character A and Character B," and "fun." The emotion recognition engine uses a camera and microphone to analyze the user's facial expressions and voice in real time and checks whether they match the input emotion. The output of this step is the original work title, situation, and emotion data specified by the user.

[1376] Step 2: Data collection

[1377] The server collects related data from digital content sources based on the original title entered by the user. Specifically, the server sends a request to a digital book API (e.g., Google Books API) to obtain original data. For example, metadata and content related to "manga title" are downloaded to the server. The input is the original title provided by the user, and the output is the obtained original data.

[1378] Step 3: Situation matching

[1379] The server analyzes the original data it has acquired. It uses a generative AI model (e.g., GPT-4) to analyze scenes in the original data and identify and extract scenes that match the situation and emotion specified by the user. It also takes into account the emotion data provided by the emotion recognition engine to select the most appropriate scene. For example, it extracts dialogue scenes that match the emotion "fun." The input in this step is the acquired original data and emotion data, and the output is the identified and extracted scene data.

[1380] Step 4: Generate the fanzine

[1381] The server generates a doujinshi based on the scene data obtained from the situation matching method. The generation method uses a text generation model (e.g., GPT-4) or an image generation model (e.g., DALL-E). This constructs a storyline and artwork that matches the user's emotions and the specified situation. For example, a new story containing a "fun" dialogue scene is automatically generated. The input in this step is the identified and extracted scene data and emotion data, and the output is the generated doujinshi data.

[1382] Step 5: Cloud storage and security measures

[1383] The server stores the generated doujinshi in cloud storage. For example, it uploads the data to AWS S3. When saving, security measures (e.g., embedding JavaScript code) are implemented to prevent screenshots from being taken, and the data is protected using AES-256 encryption technology. The input is the generated doujinshi data, and the output is doujinshi data safely stored on the cloud.

[1384] Step 6: Deliver to users

[1385] The device generates an access link to the doujinshi stored on the cloud and provides it to the user. The user can use the link to access and view the doujinshi, but local storage and screenshot capture are restricted. The input is the doujinshi data stored on the cloud, and the output is the access link provided to the user.

[1386] (Application example 2)

[1387] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1388] Existing doujinshi generation systems only automatically generate works based on situations specified by the user, and lack the ability to provide more personalized works by reflecting the user's emotions. Furthermore, there is a need to provide a more immersive experience by providing a viewing environment in a virtual space.

[1389] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1390] In this invention, the server includes an input means for inputting the title of an original work and a preferred situation specified by the user, a data collection means for acquiring original work data from an electronic book supply source, a situation matching means for analyzing the acquired original work data and learning scenes that match the situation specified by the user, a generation means for automatically generating a doujinshi based on the learned scenes, a storage means for storing the generated doujinshi in a cloud and limiting its use to personal use with security measures, a provision means for allowing the user to access the doujinshi stored in the cloud, an emotion recognition means for recognizing emotions from the user's facial expressions and voice and adjusting the content of the doujinshi based on the emotions, and a display means for making the generated doujinshi available for viewing in a store in a virtual space via smart glasses. This makes it possible to generate a personalized doujinshi that reflects the user's emotions and provide a realistic viewing experience in the virtual space.

[1391] A "user" is someone who uses the system to specify the original title and situation, and generates and reads personalized doujinshi based on their emotions.

[1392] "Original title" refers to the title of the original work that the user enters into the system, and is the data that serves as the basis for generating the doujinshi.

[1393] "Situation" refers to the scenes or scenes that users like, and is a factor that specifically determines the content of a doujinshi.

[1394] "Input means" refers to the device or interface that allows the user to input the original title and situation into the system.

[1395] "Data collection means" refers to a method or device for acquiring original data from an e-book source.

[1396] "Situation matching means" refers to an algorithm or device that analyzes the original data acquired and identifies and learns scenes that match the situation specified by the user.

[1397] "Generation means" refers to a system or device for automatically constructing and generating doujinshi based on learned scenes.

[1398] "Storage means" refers to a method or device for storing the generated doujinshi in the cloud and limiting it to personal use by taking specific security measures.

[1399] "Means of provision" refers to an interface or link suitable for users to access doujinshi stored on the cloud.

[1400] "Emotion recognition means" refers to a system or algorithm that recognizes emotions from the user's facial expressions and voice and adjusts the content of the doujinshi based on those emotions.

[1401] "Display means" refers to the display and software that allows the doujinshi generated via smart glasses to be viewed in a store within the virtual space.

[1402] This invention combines a system that automatically generates doujinshi based on the original title and preferred situation specified by the user, stores the doujinshi on the cloud for personal use, and an emotion engine that recognizes the user's emotions and reflects them in the content. Furthermore, by making the doujinshi available for viewing in a virtual store through smart glasses, users are provided with a realistic experience.

[1403] The system configuration includes the following elements:

[1404] 1. Input Method

[1405] Users enter the title of the original work and their preferred situation using an input form on their device, typically a smartphone or tablet.

[1406] Example: Enter "Manga Title" and "Dialogue scene between Character A and Character B."

[1407] 2. Data Collection Methods

[1408] The server sends an API request to acquire original data from the e-book source, using the API of the e-book source via the Internet.

[1409] Example: Get content related to "manga title".

[1410] 3. Situation matching method

[1411] The server analyzes the acquired original data, identifies scenes that match the situation specified by the user, and adjusts the operation of the situation matching means based on the user's emotion identified by the emotion recognition means.

[1412] Example: Extract data containing dialogue scenes that match the emotion "fun."

[1413] 4. Emotion recognition means

[1414] The emotion recognition engine recognizes the user's facial expressions and voice to identify their emotional state. Emotion recognition is performed using Microsoft's Emotion API, among other tools. This allows the creation of doujinshi tailored to the user's preferences.

[1415] Example: Recognizing the emotion "fun" from the user's facial expression.

[1416] 5. Generation means

[1417] The server generates high-quality doujinshi based on data extracted and learned through situation matching and user emotions. The generative algorithm reconstructs the storyline reflecting the user's emotions, generates new dialogue, and assembles the artwork. These generation processes are automated using a generative AI model.

[1418] Example: Construct a storyline and artwork that reflects the emotion "fun."

[1419] 6. Preservation means

[1420] The server stores the created doujinshi in the cloud. Security measures are taken to prevent screenshots from being taken on the cloud. Cloud storage also uses encryption technology.

[1421] Example: Using cloud storage such as AWS (Amazon Web Services).

[1422] 7. Means of provision

[1423] A link is generated and provided to users to access the doujinshi stored on the cloud. Users can view the doujinshi on the cloud through the link, but local storage and screenshot capture are restricted to prevent unauthorized use.

[1424] For example, send an access link to the user's email address.

[1425] 8. Display means

[1426] We provide displays and software that allow the created doujinshi to be viewed in a store in a virtual space via smart glasses.

[1427] For example, using a head-mounted display such as Oculus Quest.

[1428] Specific examples

[1429] When a user specifies the original manga title, "Manga Title," and inputs the dialogue scene between Character A and Character B and the emotion "fun," the server retrieves the manga title data from the e-book source and extracts and learns dialogue scenes that fit the emotion "fun." The generative AI model then creates a new storyline and artwork that reflects the emotion "fun," and stores it in the cloud as a doujinshi. The user can view the generated doujinshi through a link in the virtual space via smart glasses, but cannot save it locally or take screenshots to prevent unauthorized use.

[1430] Example prompt sentence:

[1431] Original title: Spider-Man

[1432] Situation: A scene where Spider-Man and a villain are having a conversation

[1433] Emotion: excitement

[1434] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1435] Step 1:

[1436] The user uses the input form on the device to input the original title and their preferred situation. This input also includes a function to capture the user's facial expressions and voice to reflect their emotions. Specifically, the user uses a smartphone or tablet to input the "original title," "situation," and "emotion." The input data and the captured user's emotional data are sent to the next process.

[1437] Input: Original title, situation, user's facial expression and voice

[1438] Output: Original title, situation, emotion data

[1439] Step 2:

[1440] The server sends an API request to retrieve original data from the e-book source. Specifically, based on the specified original title, the server retrieves related content from the e-book source. Based on the API request, the e-book source returns the corresponding data.

[1441] Input: Original title

[1442] Output: Original data

[1443] Step 3:

[1444] The server analyzes the original data and identifies scenes that match the situations specified by the user. The server uses a situation matching algorithm to identify the scenes. The server also adjusts the importance of situation matching based on the user's emotion data identified by the emotion recognition means.

[1445] Input: original data, situation, emotional data

[1446] Output: Scenes that match the situation

[1447] Step 4:

[1448] The server automatically generates a doujinshi based on the identified scene data and the user's emotional data. The generation means reconstructs the storyline corresponding to the emotions, generates new dialogue content, and assembles the artwork. This is done using a generative AI model.

[1449] Input: Scenes and emotion data that match the situation

[1450] Output: The generated fanzine

[1451] Step 5:

[1452] The server stores the generated doujinshi in the cloud, and takes security measures to limit its use to personal use. The cloud storage uses encryption technology, and measures are taken to prevent unauthorized access by disabling screenshots.

[1453] Input: Generated fanzine

[1454] Output: Doujinshi saved on the cloud

[1455] Step 6:

[1456] The server generates a link to access the doujinshi stored on the cloud and provides it to the user. The user accesses the doujinshi via the link, but is only allowed to view it; local storage and screenshots are restricted.

[1457] Input: Doujinshi saved on the cloud

[1458] Output: Access link

[1459] Step 7:

[1460] The user wears smart glasses and browses the created doujinshi in a store in a virtual space. The smart glasses display the created doujinshi on a display unit. Browsing in the virtual space provides the user with a realistic experience.

[1461] Input: Access link

[1462] Output: A doujinshi displayed in a virtual space

[1463] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1464] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1465] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1466] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1467] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1468] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1469] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1470] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1471] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1472] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1473] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1474] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1475] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1476] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1477] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1478] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1479] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1480] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1481] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1482] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1483] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1484] The following is further disclosed regarding the above embodiment.

[1485] (Claim 1)

[1486] an input means for inputting the original title and preferred situation designated by the user;

[1487] data collection means for acquiring original data from an e-book source;

[1488] a situation matching means for analyzing the acquired original data and learning scenes that match a situation specified by a user;

[1489] A generation means for automatically generating a doujinshi based on the learned scenes;

[1490] The generated doujinshi will be stored in the cloud, and a storage method will be provided to limit its use to personal use with security measures.

[1491] A means for users to access doujinshi stored on the cloud;

[1492] A system including:

[1493] (Claim 2)

[1494] The system according to claim 1, further comprising an algorithm for analyzing the acquired original data and extracting scenes that match the user's preferred situations.

[1495] (Claim 3)

[1496] The system of claim 1, including a security measure that prevents screenshots from being taken when accessing doujinshi stored in the cloud.

[1497] "Example 1"

[1498] (Claim 1)

[1499] an input means for inputting the original title and preferred situation designated by the user;

[1500] data collection means for acquiring original data from an e-book source;

[1501] A situation matching means for analyzing the acquired original data and learning scenes that match a situation specified by a user;

[1502] A generation means for automatically generating a work based on the learned scene;

[1503] A storage method to store the generated work in the cloud and limit its use to personal use with security measures;

[1504] providing a means for users to access works stored on the cloud;

[1505] A system including:

[1506] (Claim 2)

[1507] The system according to claim 1, further comprising an algorithm for analyzing the acquired original data and extracting scenes that match the user's preferred situations.

[1508] (Claim 3)

[1509] 10. The system of claim 1, including a security measure that prevents screenshots from being taken when accessing a work stored in the cloud.

[1510] "Application Example 1"

[1511] (Claim 1)

[1512] an input means for inputting the original title and preferred situation designated by the user;

[1513] data collection means for acquiring original data from an e-book source;

[1514] a situation matching means for analyzing the acquired original data and learning scenes that match a situation specified by a user;

[1515] A generation means for automatically generating a doujinshi based on the learned scenes;

[1516] The generated doujinshi will be stored in the cloud, and a storage method will be provided to limit its use to personal use with security measures.

[1517] A means for users to access doujinshi stored on the cloud;

[1518] an access means for users to access the generated doujinshi via a smart device;

[1519] a generative AI means for generating a doujinshi using a generative AI model based on input content specified by a user;

[1520] A system including:

[1521] (Claim 2)

[1522] The system according to claim 1, further comprising an algorithm for analyzing the acquired original data and extracting scenes that match the user's preferred situations.

[1523] (Claim 3)

[1524] The system of claim 1, including a security measure that prevents screenshots from being taken when accessing doujinshi stored in the cloud.

[1525] "Example 2: Combining Emotion Engines"

[1526] (Claim 1)

[1527] an input means for inputting the original title, a preferred situation, and an emotion designated by the user;

[1528] data collection means for acquiring original data from a digital content source;

[1529] a situation matching means for analyzing the acquired original data and learning scenes that match the situations and emotions specified by the user;

[1530] a generation means for automatically generating a fanzine based on the learned scenes and the recognized emotions;

[1531] The generated doujinshi will be stored in the cloud, and a storage method will be provided to limit its use to personal use with security measures.

[1532] A means for users to access doujinshi stored on the cloud;

[1533] an emotion recognition means for identifying emotions by analyzing the user's facial expressions and voice;

[1534] A system including:

[1535] (Claim 2)

[1536] The system according to claim 1, further comprising an algorithm for analyzing the acquired original data and extracting scenes that match the user's preferred situations and emotions.

[1537] (Claim 3)

[1538] The system of claim 1, including a security measure that prevents screenshots from being taken when accessing doujinshi stored in the cloud.

[1539] "Application example 2 when combining emotion engines"

[1540] (Claim 1)

[1541] an input means for inputting the original title and preferred situation designated by the user;

[1542] data collection means for acquiring original data from an e-book source;

[1543] a situation matching means for analyzing the acquired original data and learning scenes that match a situation specified by a user;

[1544] A generation means for automatically generating a doujinshi based on the learned scenes;

[1545] The generated doujinshi will be stored in the cloud, and a storage method will be provided to limit its use to personal use with security measures.

[1546] A means for users to access doujinshi stored on the cloud;

[1547] An emotion recognition means for recognizing emotions from a user's facial expressions and voice and adjusting the contents of the doujinshi based on the emotions;

[1548] a display means for displaying the doujinshi generated via smart glasses in a store in the virtual space;

[1549] A system including:

[1550] (Claim 2)

[1551] The system according to claim 1, further comprising an algorithm for analyzing the acquired original data and extracting scenes that match the user's preferred situations.

[1552] (Claim 3)

[1553] The system of claim 1, including a security measure that prevents screenshots from being taken when accessing doujinshi stored in the cloud. [Explanation of symbols]

[1554] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. an input means for inputting the original title and preferred situation designated by the user; data collection means for acquiring original data from an e-book source; a situation matching means for analyzing the acquired original data and learning scenes that match a situation specified by a user; A generation means for automatically generating a doujinshi based on the learned scenes; The generated doujinshi will be stored in the cloud, and a storage method will be provided to limit its use to personal use with security measures. A means for users to access doujinshi stored on the cloud; A system including:

2. 2. The system according to claim 1, further comprising an algorithm for analyzing the acquired original data and extracting scenes that match the user's preferred situations.

3. The system of claim 1 , further comprising a security measure that prevents screenshots from being taken when accessing a doujinshi stored in the cloud.

Images