System

Abstract

To provide a system for enabling a user to enjoy a story changed to his or her favorite conclusion or difficulty.SOLUTION: The method comprises the steps of: inputting a book and a customized content designated by a user; converting a format of the book and the customized content; transmitting the book and the customized content to a server; acquiring an original document of the book from the server; transmitting the acquired original document and the customized content to a generating AI; analyzing the original document by the generating AI; generating a customized story by the generating AI; and transmitting the customized story to the server.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In today's world, diverse reading needs are on the rise, and static book formats often fail to meet user expectations. In particular, they are unable to accommodate diverse reader requests, such as readers who are unsatisfied with the ending, find the content too difficult, or simply want the gist of the story. Traditional book formats make it difficult to customize a story to meet individual user needs. Therefore, it is necessary to provide a way for users to enjoy a reading experience tailored to their needs. [Means for solving the problem]

[0005] This invention is a system including a terminal equipped with means for inputting a book and customization details specified by a user, means for converting the format of the data input by said means and sending it to a server, means for the server to acquire original data of the target book based on said data, means for the server to transmit the acquired original data and the user's customization requests to a generation AI, means for the generation AI to analyze the original data and customize the story based on the user's requests, means for the generation AI to generate a customized story and return it to the server, means for the server to transmit the customized story to the user's terminal, and means for the terminal to display the customized story. This allows users to enjoy stories with endings and difficulty levels modified to their liking.

[0006] "User" means an end user who uses the system to customize a book.

[0007] A "book" is a collection of text data containing stories and information, and is the content targeted by the system.

[0008] "Customization content" refers to elements or settings that the user wishes to change in the book, including changing the ending or adjusting the difficulty level.

[0009] A "terminal" is a device operated by a user, such as a smartphone, tablet, or computer.

[0010] "Data" refers to information entered by users, book content, customization requests, etc., and is information that is processed within the system.

[0011] A "server" is the central computer of a system, and is responsible for receiving, analyzing, and sending data.

[0012] "Generative AI" is a program that uses artificial intelligence technology to analyze and customize original data.

[0013] "Original data" refers to the original text data of a book that the server retrieves from the database.

[0014] "User requests" refer to customization details input by the user, and include specific instructions for changes.

[0015] A "customized story" is the content of a book that has been modified by a generative AI based on the user's requests. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] The system for implementing this invention is composed of a user terminal, a server, and a generation AI. The operation of each component of the system will be described in detail below.

[0038] 1. User operations

[0039] A user launches a dedicated application on their device. From the application interface, they first select the title of the book they want to read, and then enter details about how they want to customize it. For example, a user might want to "change the ending of a particular book to a happy one." This information consists of selecting the book and entering the customization request to "change the ending to a happy one."

[0040] 2. Terminal Processing

[0041] The terminal receives the data entered by the user and converts it into an appropriate format (e.g., JSON format). The converted data includes the book title and customization details. The terminal then sends this converted data to the server. For example, the converted data may be sent to the server with the content "{'title': 'Book Title', 'customization': {'ending': 'happy'}}".

[0042] 3. Server data reception and processing

[0043] The server receives and analyzes the data sent from the device. It then retrieves the original data for the corresponding book from the database. The server generates a request that includes the original data and the user's customization requests, and sends this to the generation AI. For example, based on the original data retrieved from the database, the server may issue an instruction to the generation AI to "change the ending of this book to a happy one."

[0044] 4. Customizing the content of generated AI

[0045] The generation AI analyzes the original book data based on the request received from the server. The generation AI customizes the story according to the user's requests and generates a new version of the story. For example, the generation AI reconstructs the ending of the book and changes it to a happy ending as requested by the user. This process by the generation AI modifies parts of the original story.

[0046] 5. Sending data from the server to the device

[0047] After the generation AI generates the customized story, the data is sent back to the server. The server then sends the received customized story to the user's device. Specifically, the server delivers the customized story data to the user's device using an appropriate communication method.

[0048] 6. Displaying the terminal

[0049] The user's device receives the customized story sent from the server and displays it. The user can read the customized story through a dedicated application. For example, by opening the application, the user can view a new version of the book with a happy ending.

[0050] In this way, users can enjoy a reading experience that is customized to their needs and desires. Unlike traditional static book browsing, this system can reflect the user's wishes in a dynamic and interactive way.

[0051] The processing flow will be explained below.

[0052] Step 1:

[0053] The user launches a dedicated application on the device, selects the title of the book they want to read, and enters specific customization details (e.g., changing the ending, changing the main character, etc.).

[0054] Step 2:

[0055] The terminal receives the data entered by the user and converts it into an appropriate format (e.g., JSON format).

[0056] Step 3:

[0057] The device sends the converted data to the server, which includes the book title and details of the customization request.

[0058] Step 4:

[0059] The server receives and analyzes the data sent from the terminal. After analyzing the title and customization request, it retrieves the original data of the corresponding book from the database.

[0060] Step 5:

[0061] The server sends a request to the generation AI based on the acquired original data and the user's customization requests. This request includes the original story data and specific customization instructions.

[0062] Step 6:

[0063] The generation AI analyzes the request received from the server and transforms the original story according to the user's customization requests. For example, if the ending is changed to a happy one, it will reconstruct the final part of the story.

[0064] Step 7:

[0065] The generation AI sends the generated customized story back to the server. The new book data has the customizations specified by the user applied.

[0066] Step 8:

[0067] The server sends the customized story returned by the generation AI to the user's device. The server delivers the data to the user's device using an appropriate communication method.

[0068] Step 9:

[0069] The terminal analyzes the customized story received from the server and displays it in a format that can be viewed by the user. Through the application, the user can read the customized story.

[0070] Example 1

[0071] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0072] Conventional e-book systems have made it difficult for users to customize content once it has been provided. Such systems can only provide static content, and have the problem of being unable to accommodate diverse user needs. Specifically, they are unable to accommodate individual requests, such as changing the ending of a story or adjusting the difficulty level.

[0073] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0074] In this invention, the server includes means for inputting materials and customization details designated by the user, means for converting the format of the data input by said means and transmitting it to the server, means for the server to acquire original data of the target materials based on said data, means for the server to transmit the acquired original data and the user's customization requests to the generation AI, means for the generation AI to analyze the original data and customize the content based on the user's requests, means for the generation AI to generate customized content and return it to the server, means for the server to transmit the customized content to the user's terminal, and means for the terminal to display the customized content, thereby enabling the provision of dynamic and interactive content tailored to the individual needs of users.

[0075] "User" means any individual or organization wishing to use the system to customize materials.

[0076] "Materials" refers to information content such as books, documents, and electronic files.

[0077] "Customization content" refers to changes or additions to the materials desired by the user.

[0078] A "means" refers to a method or device used to achieve a particular purpose.

[0079] "Terminal" refers to an electronic device such as a computer, smartphone, or tablet that is operated by a user.

[0080] "Server" means the central computer system that processes and manages data received from user devices.

[0081] "Format conversion" is the process of converting data into another format.

[0082] "Data" means a collection of information or instructions expressed in an electronically processable form.

[0083] "Generative AI" is a system that uses artificial intelligence technology to generate new content based on input data.

[0084] "Analysis" is the process of examining data in detail to understand its structure and elements.

[0085] "Content" refers to the information and content of works provided to users.

[0086] "Display" refers to the visual output of content on the screen of a terminal.

[0087] The system for implementing this invention is composed of a user terminal, a server, and a generation AI. The operation of each component of the system will be described in detail below.

[0088] First, the user launches a dedicated application on their device. From the application interface, the user selects the title of the material they want to read and enters details about how they want to customize it. For example, a user might want to change the ending of a particular book to a happy one. This allows the user to input the desired customization data into the device.

[0089] Next, the terminal receives the data entered by the user and converts it into an appropriate format, such as JSON. This data includes the title of the material and customization details. The converted data is then sent to the server. For example, if the user wants to change the ending of "The Great Adventure" to a happy ending, the converted data is sent to the server as follows: {'title': 'The Great Adventure', 'customization': {'ending': 'happy'}}.

[0090] The server receives and analyzes the data sent from the terminal. It then retrieves the original data of the corresponding material from the database. The server generates a request that includes the original data and the user's customization requests, and sends this to the generation AI. An example of a specific prompt for the generation AI is, "Please change the ending of the book 'The Great Adventure' to a happy ending."

[0091] The generation AI analyzes the document based on the request received from the server and the original data of the document. The generation AI changes specific parts (for example, the ending) to a happy ending according to the user's request and generates a new version of the document.

[0092] After the generation AI generates the customized materials, the data is sent back to the server. The server then sends the received customized material data to the user's device. The sent data is received by the user's device and displayed to the user through a dedicated application, allowing the user to view the customized materials.

[0093] For example, when a user opens the app, they will be shown a new version of "The Great Adventure" with a happy ending, allowing them to enjoy a customized reading experience that suits their needs.

[0094] In this way, the system differs from conventional static document browsing in that it can dynamically and interactively reflect the user's wishes. The ability to customize documents to meet the diverse needs of users can increase user satisfaction.

[0095] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0096] Step 1:

[0097] The user launches the dedicated application and inputs the title of the material they want to read and the customization details. For example, if they want to change the ending of "The Great Adventure" to a happy ending, the user inputs this into the application interface. This operation generates input data that includes the user's customization wishes.

[0098] Input: Title of the material and customization details (e.g. "The Great Adventure", change the ending to a happy one)

[0099] Output: Raw data containing the user's customization preferences

[0100] Step 2:

[0101] The device converts the data entered by the user into the appropriate format (e.g., JSON). For example, it converts the entered title and customization details as follows:

[0102] json

[0103] {

[0104] 'title': 'The Great Adventure',

[0105] 'customization': {'ending': 'happy'}

[0106] }

[0107] The converted data is sent to the server.

[0108] Input: Raw data containing the user's customization preferences

[0109] Output: Formatted data (e.g. JSON format data)

[0110] Specific behavior:

[0111] The terminal receives input from the user, converts it into the specified format, and prepares it for transmission.

[0112] Step 3:

[0113] The server receives the converted data from the device, analyzes it, and then retrieves the original data of the corresponding material from the database, for example, the original data of "The Great Adventure."

[0114] Input: Formatted data (e.g. JSON format data)

[0115] Output: Original data of the target material

[0116] Specific behavior:

[0117] The server receives the data and initiates the process of retrieving the corresponding original data from the database.

[0118] Step 4:

[0119] The server generates a request that includes the acquired original data and the user's customization request, and sends it to the generation AI. Specifically, for example, it sends a prompt message to the generation AI saying, "Please change the ending of the book 'The Great Adventure' to a happy ending."

[0120] Input: Original data of the target material, user customization requests

[0121] Output: Request to the generation AI (prompt sentence)

[0122] Specific behavior:

[0123] The server generates a prompt text and performs communication processing to send it to the generation AI.

[0124] Step 5:

[0125] The generation AI receives the request and the original data of the material sent from the server, analyzes the material, and, based on the user's request, customizes certain parts (for example, the ending) to make them happy, and generates a new version of the material.

[0126] Input: Request from server (prompt text), original data

[0127] Output:Customized materials

[0128] Specific behavior:

[0129] The generation AI analyzes the original data and executes a process to edit and generate content based on the requirements.

[0130] Step 6:

[0131] The server receives the customized materials created by the generation AI and sends them to the user's device using an appropriate communication method such as an HTTP request.

[0132] Input:Customized materials

[0133] Output: Send data to the user's device

[0134] Specific behavior:

[0135] The server then processes the data received from the generation AI to be delivered to the terminal.

[0136] Step 7:

[0137] The terminal receives the customized material sent from the server and displays it to the user through a dedicated application, allowing the user to view the new version of the material.

[0138] Input: Customization information sent from the server

[0139] Output: Displayed customization material

[0140] Specific behavior:

[0141] The terminal receives the data and visually presents customized content to the user via a dedicated application.

[0142] This allows users to have a customized reading experience that suits their needs.

[0143] (Application example 1)

[0144] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0145] With conventional book browsing methods, once a user purchased a book, they could not adapt or customize the content. In particular, it was difficult to change the ending of the story or the difficulty level of the content according to the user's individual wishes. Furthermore, there was no system in place to instantly reflect customized content and provide it to the user. This meant that users could not enjoy a reading experience that was tailored to their own wishes, which led to a decrease in reading satisfaction.

[0146] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0147] In this invention, the server includes means for inputting a book and customization details specified by the user, means for converting the format of the input data and sending it to the server, means for acquiring original data of the target book, means for sending the acquired original data and the user's customization requests to the generation AI, means for the generation AI to analyze the original data and customize the story based on the user's requests, means for the generation AI to generate a customized story and return it to the server, and means for communicating and sending the customized story to a terminal and displaying it on the terminal. This makes it possible to quickly generate and display customized book data based on the user's specifications.

[0148] "User" refers to a user who utilizes the system to request customization of a book.

[0149] "Book" refers to formal text data such as literary works or materials that a user specifies as a desired reading.

[0150] "Customization" means changing the content of a book (for example, the ending, difficulty level, etc.) according to the user's request.

[0151] "Terminal" refers to a device (e.g., a smartphone, tablet, etc.) that a user uses to access the system.

[0152] A "server" refers to a computer system that receives data sent from a user's terminal and processes it or accesses a database.

[0153] "Generative AI" refers to an artificial intelligence model that analyzes the contents of a book and generates a customized story based on the user's requests.

[0154] "Original data" refers to the text data of the original book, and is data that the server retrieves from the database.

[0155] "Format conversion" refers to converting data entered by a user into a format (such as JSON) that can be received and processed by the server.

[0156] "Display" refers to visually presenting the customized book data sent to the terminal to the user.

[0157] A specific system for implementing this invention is composed of a user terminal, a server, and a generation AI. The operation of each component will be explained in detail below.

[0158] A user launches the customized book application and specifies the title of the book they want to read and the customization details. For example, the user may input a request to the application such as "change the ending of a specific book to a happy ending." This user request is converted into an appropriate format such as JSON format by the device and sent to the server.

[0159] The server receives the user's request and retrieves the original data of the target book from the database based on the input data. A request including the retrieved original data and the user's customization request is sent to the generation AI. For example, based on the original data of "Example Book" retrieved from the database, the server passes a generation instruction to the generation AI saying, "Change the ending of this book to a happy ending."

[0160] The generation AI analyzes the received original data and the user's customization requests, and customizes the story based on the user's specifications. The generation AI reconstructs specific parts of the story according to the user's requests, generating a new version of the story, which in this case includes, for example, a modified ending.

[0161] The customized story data is returned from the generation AI to the server, which then sends it to the user's device, where it is displayed, allowing the user to enjoy the book with the new ending added.

[0162] As a concrete example, a user selects "Example Book" and inputs a request to "change the ending to a happy ending." An example of the prompt sentence is as follows:

[0163] Example prompt sentence:

[0164] "Please change the ending of the user-specified book 'Example Book' to a happy ending."

[0165] This invention enables users to quickly receive a customized reading experience based on their preferences. The hardware used is a user's smartphone, tablet, or other device, and the server is a system with a high-performance database and generative AI model installed. The software used includes libraries for data format conversion (e.g., JSON libraries) and HTTP communication libraries for communication processing (e.g., Requests).

[0166] This configuration allows the entire system to work seamlessly together, providing a dynamic and interactive reading experience that meets the individual needs of the user.

[0167] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0168] Step 1:

[0169] The user launches the dedicated application and inputs the title of the book they want to read and the customization details. As an example, they select "Example Book" and specify "change the ending to a happy one." The input data is received as the book title and the user's customization request.

[0170] Step 2:

[0171] The device converts the user's input data into an appropriate format, such as JSON. For example, the converted data may look like this: {'title': 'Example Book', 'customization': {'ending': 'happy'}}. The converted data is prepared for communication and sent to the server.

[0172] Step 3:

[0173] The server analyzes the data received from the user's device. The received data is in JSON format, and the book title and customization requests are extracted through analysis. The server accesses the database and retrieves the original data for the target book, "Example Book."

[0174] Step 4:

[0175] The server sends the original data it has acquired and the user's customization request to the generation AI. The data sent includes the original text data and customization instructions (prompt text). For example, the prompt text sent might be, "Please change the ending of the book 'Example Book' specified by the user to a happy ending."

[0176] Step 5:

[0177] The generation AI analyzes the original data and prompt text received from the server. The generation AI analyzes the text and changes the ending of the story based on the user's request, thereby generating a new, customized version of the story. The generated customized story is then sent back to the server.

[0178] Step 6:

[0179] The server receives the customized story sent from the generation AI and sends it to the user's device. The received customized story is delivered to the device using a communication protocol. The output data is the text data of the customized book.

[0180] Step 7:

[0181] The user's device receives the customized book data and displays it through a dedicated application. The displayed content includes a new ending for the "Example Book," which has been changed to a happy ending based on the user's specifications. The user can read the customized book and enjoy a reading experience that suits their preferences.

[0182] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0183] The system for implementing this invention is composed of a user terminal, a server, a generation AI, and an emotion engine. The operation of each component of the system is described in detail below.

[0184] 1. User operations

[0185] Users launch a dedicated application on their device. From the application interface, they select the title of the book they want to read and enter specific customizations (e.g., changing the ending or the main character). The emotion engine also recognizes the user's emotions in real time. This information is determined by the emotion engine based on the user's facial expressions, tone of voice, and other factors.

[0186] 2. Terminal Processing

[0187] The device receives the data entered by the user and the emotion data recognized by the emotion engine, and converts them into an appropriate format (e.g., JSON format). The converted data includes the book title, customization details, and emotion data. The converted data is then sent to the server. For example, the converted data is sent to the server as follows: {'title': 'Book Title', 'customization': {'ending': 'happy'}, 'emotion': 'excited'}.

[0188] 3. Server data reception and processing

[0189] The server receives and analyzes the data sent from the device. As a result of the analysis, it retrieves the corresponding original book data from the database based on the book title, customization requests, and emotional data. The server then sends a request to the generation AI based on the retrieved original data, the user's customization requests, and emotional data. This request includes the original story data, customization requests, emotional data, and specific customization instructions.

[0190] 4. Customizing the content of generated AI

[0191] The generation AI analyzes the original book data based on the request received from the server. The generation AI customizes the story based on the user's requests and emotional data, and generates a new version of the story. For example, if the generation AI reconstructs the ending of the book and recognizes that the user "hopes for a happy ending and is currently feeling excited," it will change the final scene of the story to a more moving one.

[0192] 5. Sending data from the server to the device

[0193] After the generation AI generates the customized story, the data is sent back to the server. The server then sends the received customized story data along with the emotion data to the user's device. The data is then delivered to the user's device using an appropriate communication method.

[0194] 6. Displaying the terminal

[0195] The user's device receives the customized story and emotional data sent from the server and displays the customized story. Through a dedicated application, the user can read a story tailored to their emotions and customization needs. For example, by opening the application, the user can read a new version of a book that has been modified to have a happy ending and a touching scene added.

[0196] In this way, users can enjoy a reading experience that is customized to their needs, desires, and emotions recognized in real time. Unlike traditional static book reading, this system can reflect the user's desires and emotions in a dynamic and interactive way.

[0197] The processing flow will be explained below.

[0198] Step 1:

[0199] Users launch a dedicated application on their device, select the title of the book they want to read from the interface, and enter specific customization details (e.g., changing the ending, changing the main character, etc.). The emotion engine also recognizes the user's real-time emotions.

[0200] Example: A user selects "adventure novel" and enters "change ending to happy ending." At the same time, the emotion engine analyzes the user's facial expression and determines the emotion as "excited."

[0201] Step 2:

[0202] The terminal receives the data entered by the user and the emotion data recognized by the emotion engine, and converts them into an appropriate format (e.g., JSON format).

[0203] Example: The device generates the following data: {'title': 'Adventure Story', 'customization': {'ending': 'happy'}, 'emotion': 'excited'}.

[0204] Step 3:

[0205] The terminal transmits the converted data to the server.

[0206] Example: A terminal executes a process to send data to a server.

[0207] Step 4:

[0208] The server receives and analyzes the data sent from the device. The data includes the title of the book selected by the user, customization details, and emotion data. As a result of the analysis, the server retrieves the original data of the corresponding book from the database.

[0209] Example: Retrieve the original data for "Adventure Story" from the database.

[0210] Step 5:

[0211] The server sends a request to the generation AI based on the acquired original data, the user's customization requests, and emotion data.

[0212] Example: The server sends instructions to the generation AI to "make the ending happy and take emotions into account to create a scene that will increase excitement."

[0213] Step 6:

[0214] The generation AI analyzes the request received from the server and converts the original book data based on the user's customization requests and emotional data.

[0215] Example: A generative AI changes the ending of a story to a happy one and adds scenes that increase tension and excitement.

[0216] Step 7:

[0217] The generation AI sends the generated customized story back to the server.

[0218] Example: Sending a customized "Adventure Story" to a server.

[0219] Step 8:

[0220] The server sends the customized story returned by the generation AI to the user's device.

[0221] Example: A server delivers customized story data to a user's device.

[0222] Step 9:

[0223] The terminal analyzes the customized story received from the server and displays it in a format that can be viewed by the user. Through the application, the user can read the customized story.

[0224] Example: A user opens an application and reads an "Adventure Story" that has a happy ending and an exciting scene added.

[0225] Example 2

[0226] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0227] Conventional book reading systems are unable to customize the experience based on the user's preferences or emotions, making it difficult to provide an interactive reading experience. Furthermore, they have not been able to generate stories that reflect the user's real-time emotional state. This results in a uniform user experience, lacking the flexibility to accommodate individual needs.

[0228] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0229] In this invention, the server includes: means for inputting a book and customization details designated by a user; means for an emotion engine to recognize the user's emotion data in real time; means for converting the format of the data input by the above means and transmitting it to the server; means for the server to acquire original data of the target book based on the above data; means for the server to transmit the acquired original data and the user's customization requests and emotion data to a generative AI model; means for the generative AI model to analyze the original data and customize a story based on the user's requests and emotion data; means for the generative AI model to generate a customized story and return it to the server; means for the server to transmit the customized story to the user's terminal; and means for the terminal to display the customized story. This enables a dynamic and interactive reading experience based on the user's wishes and emotions.

[0230] "User" refers to an individual or group that inputs books and customization details and uses the system.

[0231] A "terminal" is an electronic device that allows a user to select books and input customization details through a dedicated application.

[0232] A "dedicated application" is software that a user launches on their own device to select books and input customization details.

[0233] An "emotion engine" is a system or software that analyzes a user's facial expressions and tone of voice and generates emotional data in real time.

[0234] The "server" is a computer system that receives data sent from the user's device, retrieves the original data from the database, sends requests to the generative AI model, and finally returns the customized story data to the user's device.

[0235] A "database" is an information system for storing and managing original book data.

[0236] A "generative AI model" is an artificial intelligence system that analyzes a story based on the original data received from the server, the user's customization requests, and emotional data, and generates a new, customized story.

[0237] The "JSON format" is a lightweight data exchange format (JavaScript Object Notation) for structuring and exchanging data.

[0238] "Customization content" refers to a request for adjustment of a specific part of a book that the user desires (for example, changing the ending or the main character).

[0239] "Emotion data" is data on the emotional state obtained in real time by the emotion engine by analyzing the user's facial expressions and tone of voice.

[0240] A "customized story" is a new version of a story that is customized by a generative AI model based on the user's requests and emotional data.

[0241] This invention is a system that analyzes emotional data in real time using a user's own device and customizes the content of a book based on that data. The system consists of a user's device, a server, a generative AI model, and an emotion engine. The operation of each component of the system is described in detail below.

[0242] User operations

[0243] The user launches a dedicated application on their device. The application provides an interface for the user to input the title of the book they want to read and specific customizations (e.g., changing the ending, changing the main character, etc.). Furthermore, the emotion engine analyzes the user's facial expressions and tone of voice in real time to generate emotion data. At this stage, the user can input the following specific prompts into the application:

[0244] "Title: Momotaro, Customization: Happy ending, Emotion: Excited"

[0245] Terminal data processing

[0246] The device receives the data entered by the user and the emotional data recognized by the emotion engine, and converts them into JSON format. This converted data includes the book title, customization request details, and emotional data. For example, the data is structured in the following format:

[0247] {

[0248] 'title': 'Momotaro',

[0249] 'customization': {

[0250] 'ending': 'happy'

[0251] },

[0252] 'emotion': 'excited'

[0253] }

[0254] The terminal transmits this data to the server.

[0255] Server Processing

[0256] The server receives and analyzes the data sent from the device. As a result of the analysis, it retrieves the corresponding original book data from the database based on the book title, customization requests, and emotion data. The server then sends the retrieved original data, along with the user's customization requests and emotion data, to the generative AI model as a request. The request includes the original story data, customization requests, and emotion data.

[0257] Customizing generative AI models

[0258] The generative AI model analyzes the original book data based on requests received from the server. The generative AI model customizes the story based on the user's requests and emotional data, and generates a new version of the story. For example, if the user "hopes for a happy ending and is emotionally 'excited,'" the generative AI model can reconstruct the ending of the story into a happy one and add more moving scenes.

[0259] Sending and Displaying Data

[0260] After the generative AI model generates a customized story, the data is sent back to the server. The server then sends the received customized story data to the user's device. The device receives the customized story and emotion data sent from the server and displays it, allowing the user to read a story tailored to their own emotions and customization needs.

[0261] Specific examples

[0262] For example, if a user inputs through a dedicated application that they want the book "Momotaro" to have a happy ending and that they are currently feeling excited, the generative AI model will generate a new story, changing the ending to a happy one and adding a touching scene. The user can then read this new, customized story on their device.

[0263] Unlike traditional static book reading, this system allows users to enjoy a dynamic and interactive reading experience. The story is customized based on the user's preferences and real-time recognized emotions, providing a more personalized reading experience for the user.

[0264] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0265] Step 1:

[0266] The user launches a dedicated application on their device. Through the application's interface, the user inputs the title of the book they want to read and their customization details. The emotion engine then analyzes the user's facial expressions and tone of voice in real time, and adds emotional data to the input data. At this point, the input consists of the book title, customization details, and the analyzed emotional data. For example, the user might input "Title: Momotaro, Customization details: Change the ending to a happy one, Emotion: Excited."

[0267] Step 2:

[0268] The device receives the data input by the user and the emotion data obtained from the emotion engine. It then converts this data into an appropriate format (JSON format). Specifically, it converts the input data into the format "{'title': 'Momotaro', 'customization': {'ending': 'happy'}, 'emotion': 'excited'}". The output of this step is the data converted into JSON format.

[0269] Step 3:

[0270] The terminal sends the formatted data to the server, using the appropriate communication protocol to ensure that the data is sent correctly and securely. The input is the JSON data generated in step 2, and the output is the data sent to the server.

[0271] Step 4:

[0272] The server receives and analyzes the data sent from the device. As a result of the analysis, it extracts the book title, customization requests, and emotion data. It then retrieves the original data of the corresponding book from the database. The input of this step is the JSON data received by the server in step 3, and the output is the retrieved original data of the book.

[0273] Step 5:

[0274] The server sends the acquired original data, the user's customization request, and emotion data to the generative AI model as a request. This request includes the original story data, customization request, and emotion data. For example, "Original data: 'Momotaro,' customization request: make the ending happy, emotion: excited" is sent to the generative AI model. The inputs of this step are the original data, customization request, and emotion data, and the output is the request sent to the generative AI model.

[0275] Step 6:

[0276] The generative AI model analyzes the request received from the server and customizes the story based on the user's wishes and emotional data, based on the original book data. For example, it reads "Momotaro" and reconstructs the story to give it a happy ending, adding moving scenes to match the user's emotional state. The input for this step is the request received from the server, and the output is a customized new story.

[0277] Step 7:

[0278] The generative AI model sends the customized story back to the server. The input of this step is the customized story generated by the generative AI model, and the output is the customized story sent back to the server.

[0279] Step 8:

[0280] The server transmits the customized story data received from the generative AI model to the user's device via an appropriate communication protocol. The input to this step is the customized story returned by the generative AI model, and the output is the data transmitted to the user's device.

[0281] Step 9:

[0282] The user's device receives the customized story sent from the server and displays it through a dedicated application. For example, when the user opens the app, a new version of the customized "Momotaro" story appears, with the ending changed to a happy one and a touching scene added. The input of this step is the customized story received from the server, and the output is a display of the customized story.

[0283] Through the above processing steps, users can enjoy a new reading experience based on their own feelings and customization requests.

[0284] (Application example 2)

[0285] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0286] Conventional reading experiences are static and lack the ability to reflect user emotions and customization requests in real time. It is also difficult for users to experience interactive storytelling in an immersive virtual reality environment. Therefore, a system that can recognize a user's real-time emotions and dynamically customize a story based on them is needed.

[0287] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0288] In this invention, the server includes: means for inputting a book and customization details designated by a user; means for converting the format of the data input by said means and transmitting the converted data to the server; means for the server to acquire original data of the target book based on said data; means for the server to transmit the acquired original data and the user's customization requests to a generation AI; means for the generation AI to analyze the original data and customize a story based on the user's requests; means for the generation AI to generate a customized story and transmit it back to the server; means for the server to transmit the customized story to the user's terminal; means for the terminal to display the customized story; means for recognizing the user's emotions in real time; and means for providing an interactive storytelling experience in which the story dynamically changes based on the emotion data and is displayed in a virtual reality environment. This makes it possible to experience a story dynamically customized in accordance with the user's emotions in a virtual reality environment.

[0289] "User" refers to the person who uses the system, who specifies books and customization content, and provides real-time emotional data.

[0290] "Books" refers to all content provided as stories, including text data such as novels, essays, and technical books.

[0291] "Customization content" is information indicating the changes the user wishes to make to the story content, including changes to the ending or characters.

[0292] "Format conversion" refers to the process of converting data within the system into an appropriate format and sending it to the server.

[0293] The "server" is a computing device responsible for receiving data, analyzing it, sending requests to the generative AI model, and transmitting the customized story to the user's device.

[0294] "Original data" refers to the text data that is the source of the target book, and includes the content before customization.

[0295] "Generative AI" is an artificial intelligence model that analyzes and recreates stories based on user customization requests and emotional data.

[0296] "Emotional data" is information that indicates a user's real-time emotional state and is analyzed from facial expressions, tone of voice, etc.

[0297] A "virtual reality environment" refers to a virtual three-dimensional space that users experience through a head-mounted display or other device, enabling immersive, interactive storytelling.

[0298] An "interactive storytelling experience" refers to experiencing a story in a virtual reality environment that dynamically changes based on user actions and emotional data.

[0299] A system for implementing this invention comprises a user terminal, a server, a generative AI, and an emotion engine. This system provides an interactive storytelling experience by recognizing a user's emotions in real time and customizing a story based on the emotions and displaying it in a virtual reality environment.

[0300] User Actions

[0301] The user puts on a head-mounted display (HMD) and launches a dedicated application. Through the application interface, the user inputs the title of the book they want to read and their customization details. The emotion engine also recognizes the user's facial expressions and tone of voice in real time and captures them as emotional data.

[0302] Terminal handling

[0303] The device converts the data entered by the user and the emotional data recognized by the emotion engine into a JSON format containing the book title, customization request details, and emotional data, and sends it to the server. For example, the converted data is sent to the server as "{'title': 'Book Title', 'customization': {'ending': 'happy'}, 'emotion': 'excited'}".

[0304] Server data reception and processing

[0305] The server receives and analyzes the data sent from the device. Based on the analysis results, it retrieves the original data of the target book from the database based on the book title, customization requests, and emotional data. The server then requests the retrieved original data, the user's customization requests, and emotional data from the generation AI. This request includes the original story data, customization requests, emotional data, and specific customization instructions.

[0306] Customizing the content of generated AI

[0307] The generation AI analyzes the original story data based on the data received from the server and customizes the story according to the user's wishes and emotional data. For example, if the generation AI recognizes that the user "wants a happy ending and is currently feeling excited," it will change the ending of the story to a touching scene. The generated customized story is then sent back to the server.

[0308] Sending data from the server to the device

[0309] The server receives the customized story data returned from the generation AI and sends it to the user's device along with the emotion data.

[0310] Terminal display

[0311] The user's device receives the customized story and emotion data sent from the server and displays it on the HMD, allowing the user to experience a story dynamically tailored to their emotions and customization requests in a virtual reality environment.

[0312] Specific examples

[0313] Suppose a user selects a suspense novel and requests a happy ending. If the emotion engine recognizes that the user is excited, the generative AI will use this information to customize the ending of the story, maintaining the tension and adding a touching scene.

[0314] Prompt Sentence Examples

[0315] "Change the ending of the suspense novel the user is reading to a happy one. Users are excited and want a touching scene. For example, add a scene where the protagonist overcomes all obstacles and is reunited with his family."

[0316] This system enables users to experience a story dynamically customized according to their emotions in a virtual reality environment. The hardware used includes an HMD and a user terminal, and the software includes an emotion engine, generative AI, and a server application.

[0317] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0318] Step 1:

[0319] The user puts on a head-mounted display (HMD) and launches a dedicated application. From the application interface, the user inputs the title of the book they want to read and the customization details (e.g., changing the ending). The input data is temporarily saved on the user's device. The user's emotions (e.g., facial expressions and tone of voice) are captured in real time by the emotion engine and acquired as emotion data.

[0320] Input: Book title, customization request, user facial expression and tone of voice

[0321] Output: Book title, customization details, sentiment data

[0322] Step 2:

[0323] The device converts the user's input data and the emotion data obtained from the emotion engine into JSON format. The converted data includes the book title, customization request details, and emotion data. The converted data is then sent to the server.

[0324] Input: Book title, customization details, sentiment data

[0325] Output: JSON format data

[0326] Step 3:

[0327] The server receives the JSON data sent from the device. It analyzes the received data and extracts the book title, customization requests, and emotion data. Based on the book title, the server retrieves the original data of the target book from the database.

[0328] Input: JSON format data

[0329] Output: Original book data

[0330] Step 4:

[0331] The server sends the acquired original data, the user's customization request, and emotion data to the generative AI model as a request. The request includes the original story data, the customization request, the emotion data, and specific customization instructions.

[0332] Input: Original book data, customization requests, emotion data

[0333] Output: A request to the generative AI model

[0334] Step 5:

[0335] The generative AI model analyzes the original story data based on requests received from the server. It customizes the story according to the user's customization requests and emotional data. For example, based on the request to "change to a happy ending" and the emotion "excited," it reconstructs the ending of the story into a moving scene.

[0336] Input: Original story data, customization requests, emotion data

[0337] Output: Customized story

[0338] Step 6:

[0339] After the generative AI model generates the customized story, the generated story data is sent back to the server, which then receives the customized story data and sends it to the user's device.

[0340] Input: Customized story data

[0341] Output: Story data to user terminal

[0342] Step 7:

[0343] The user's device receives the customized story and emotion data sent from the server, and displays the received customized story on the HMD, allowing the user to enjoy an interactive storytelling experience in a virtual reality environment.

[0344] Input: Customized story data, emotion data

[0345] Output: Narrative display in a virtual reality environment

[0346] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0347] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0348] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0349] [Second embodiment]

[0350] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0351] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0352] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0353] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0354] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0355] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0356] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0357] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0358] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0359] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0360] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0361] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0362] The system for implementing this invention is composed of a user terminal, a server, and a generation AI. The operation of each component of the system will be described in detail below.

[0363] 1. User operations

[0364] A user launches a dedicated application on their device. From the application interface, they first select the title of the book they want to read, and then enter details about how they want to customize it. For example, a user might want to "change the ending of a particular book to a happy one." This information consists of selecting the book and entering the customization request to "change the ending to a happy one."

[0365] 2. Terminal Processing

[0366] The terminal receives the data entered by the user and converts it into an appropriate format (e.g., JSON format). The converted data includes the book title and customization details. The terminal then sends this converted data to the server. For example, the converted data may be sent to the server with the content "{'title': 'Book Title', 'customization': {'ending': 'happy'}}".

[0367] 3. Server data reception and processing

[0368] The server receives and analyzes the data sent from the device. It then retrieves the original data for the corresponding book from the database. The server generates a request that includes the original data and the user's customization requests, and sends this to the generation AI. For example, based on the original data retrieved from the database, the server may issue an instruction to the generation AI to "change the ending of this book to a happy one."

[0369] 4. Customizing the content of generated AI

[0370] The generation AI analyzes the original book data based on the request received from the server. The generation AI customizes the story according to the user's requests and generates a new version of the story. For example, the generation AI reconstructs the ending of the book and changes it to a happy ending as requested by the user. This process by the generation AI modifies parts of the original story.

[0371] 5. Sending data from the server to the device

[0372] After the generation AI generates the customized story, the data is sent back to the server. The server then sends the received customized story to the user's device. Specifically, the server delivers the customized story data to the user's device using an appropriate communication method.

[0373] 6. Displaying the terminal

[0374] The user's device receives the customized story sent from the server and displays it. The user can read the customized story through a dedicated application. For example, by opening the application, the user can view a new version of the book with a happy ending.

[0375] In this way, users can enjoy a reading experience that is customized to their needs and desires. Unlike traditional static book browsing, this system can reflect the user's wishes in a dynamic and interactive way.

[0376] The processing flow will be explained below.

[0377] Step 1:

[0378] The user launches a dedicated application on the device, selects the title of the book they want to read, and enters specific customization details (e.g., changing the ending, changing the main character, etc.).

[0379] Step 2:

[0380] The terminal receives the data entered by the user and converts it into an appropriate format (e.g., JSON format).

[0381] Step 3:

[0382] The device sends the converted data to the server, which includes the book title and details of the customization request.

[0383] Step 4:

[0384] The server receives and analyzes the data sent from the terminal. After analyzing the title and customization request, it retrieves the original data of the corresponding book from the database.

[0385] Step 5:

[0386] The server sends a request to the generation AI based on the acquired original data and the user's customization requests. This request includes the original story data and specific customization instructions.

[0387] Step 6:

[0388] The generation AI analyzes the request received from the server and transforms the original story according to the user's customization requests. For example, if the ending is changed to a happy one, it will reconstruct the final part of the story.

[0389] Step 7:

[0390] The generation AI sends the generated customized story back to the server. The new book data has the customizations specified by the user applied.

[0391] Step 8:

[0392] The server sends the customized story returned by the generation AI to the user's device. The server delivers the data to the user's device using an appropriate communication method.

[0393] Step 9:

[0394] The terminal analyzes the customized story received from the server and displays it in a format that can be viewed by the user. Through the application, the user can read the customized story.

[0395] Example 1

[0396] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0397] Conventional e-book systems have made it difficult for users to customize content once it has been provided. Such systems can only provide static content, and have the problem of being unable to accommodate diverse user needs. Specifically, they are unable to accommodate individual requests, such as changing the ending of a story or adjusting the difficulty level.

[0398] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0399] In this invention, the server includes means for inputting materials and customization details designated by the user, means for converting the format of the data input by said means and transmitting it to the server, means for the server to acquire original data of the target materials based on said data, means for the server to transmit the acquired original data and the user's customization requests to the generation AI, means for the generation AI to analyze the original data and customize the content based on the user's requests, means for the generation AI to generate customized content and return it to the server, means for the server to transmit the customized content to the user's terminal, and means for the terminal to display the customized content, thereby enabling the provision of dynamic and interactive content tailored to the individual needs of users.

[0400] "User" means any individual or organization wishing to use the system to customize materials.

[0401] "Materials" refers to information content such as books, documents, and electronic files.

[0402] "Customization content" refers to changes or additions to the materials desired by the user.

[0403] A "means" refers to a method or device used to achieve a particular purpose.

[0404] "Terminal" refers to an electronic device such as a computer, smartphone, or tablet that is operated by a user.

[0405] "Server" means the central computer system that processes and manages data received from user devices.

[0406] "Format conversion" is the process of converting data into another format.

[0407] "Data" means a collection of information or instructions expressed in an electronically processable form.

[0408] "Generative AI" is a system that uses artificial intelligence technology to generate new content based on input data.

[0409] "Analysis" is the process of examining data in detail to understand its structure and elements.

[0410] "Content" refers to the information and content of works provided to users.

[0411] "Display" refers to the visual output of content on the screen of a terminal.

[0412] The system for implementing this invention is composed of a user terminal, a server, and a generation AI. The operation of each component of the system will be described in detail below.

[0413] First, the user launches a dedicated application on their device. From the application interface, the user selects the title of the material they want to read and enters details about how they want to customize it. For example, a user might want to change the ending of a particular book to a happy one. This allows the user to input the desired customization data into the device.

[0414] Next, the terminal receives the data entered by the user and converts it into an appropriate format, such as JSON. This data includes the title of the material and customization details. The converted data is then sent to the server. For example, if the user wants to change the ending of "The Great Adventure" to a happy ending, the converted data is sent to the server as follows: {'title': 'The Great Adventure', 'customization': {'ending': 'happy'}}.

[0415] The server receives and analyzes the data sent from the terminal. It then retrieves the original data of the corresponding material from the database. The server generates a request that includes the original data and the user's customization requests, and sends this to the generation AI. An example of a specific prompt for the generation AI is, "Please change the ending of the book 'The Great Adventure' to a happy ending."

[0416] The generation AI analyzes the document based on the request received from the server and the original data of the document. The generation AI changes specific parts (for example, the ending) to a happy ending according to the user's request and generates a new version of the document.

[0417] After the generation AI generates the customized materials, the data is sent back to the server. The server then sends the received customized material data to the user's device. The sent data is received by the user's device and displayed to the user through a dedicated application, allowing the user to view the customized materials.

[0418] For example, when a user opens the app, they will be shown a new version of "The Great Adventure" with a happy ending, allowing them to enjoy a customized reading experience that suits their needs.

[0419] In this way, the system differs from conventional static document browsing in that it can dynamically and interactively reflect the user's wishes. The ability to customize documents to meet the diverse needs of users can increase user satisfaction.

[0420] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0421] Step 1:

[0422] The user launches the dedicated application and inputs the title of the material they want to read and the customization details. For example, if they want to change the ending of "The Great Adventure" to a happy ending, the user inputs this into the application interface. This operation generates input data that includes the user's customization wishes.

[0423] Input: Title of the material and customization details (e.g. "The Great Adventure", change the ending to a happy one)

[0424] Output: Raw data containing the user's customization preferences

[0425] Step 2:

[0426] The device converts the data entered by the user into the appropriate format (e.g., JSON). For example, it converts the entered title and customization details as follows:

[0427] json

[0428] {

[0429] 'title': 'The Great Adventure',

[0430] 'customization': {'ending': 'happy'}

[0431] }

[0432] The converted data is sent to the server.

[0433] Input: Raw data containing the user's customization preferences

[0434] Output: Formatted data (e.g. JSON format data)

[0435] Specific behavior:

[0436] The terminal receives input from the user, converts it into the specified format, and prepares it for transmission.

[0437] Step 3:

[0438] The server receives the converted data from the device, analyzes it, and then retrieves the original data of the corresponding material from the database, for example, the original data of "The Great Adventure."

[0439] Input: Formatted data (e.g. JSON format data)

[0440] Output: Original data of the target material

[0441] Specific behavior:

[0442] The server receives the data and initiates the process of retrieving the corresponding original data from the database.

[0443] Step 4:

[0444] The server generates a request that includes the acquired original data and the user's customization request, and sends it to the generation AI. Specifically, for example, it sends a prompt message to the generation AI saying, "Please change the ending of the book 'The Great Adventure' to a happy ending."

[0445] Input: Original data of the target material, user customization requests

[0446] Output: Request to the generation AI (prompt sentence)

[0447] Specific behavior:

[0448] The server generates a prompt text and performs communication processing to send it to the generation AI.

[0449] Step 5:

[0450] The generation AI receives the request and the original data of the material sent from the server, analyzes the material, and, based on the user's request, customizes certain parts (for example, the ending) to make them happy, and generates a new version of the material.

[0451] Input: Request from server (prompt text), original data

[0452] Output:Customized materials

[0453] Specific behavior:

[0454] The generation AI analyzes the original data and executes a process to edit and generate content based on the requirements.

[0455] Step 6:

[0456] The server receives the customized materials created by the generation AI and sends them to the user's device using an appropriate communication method such as an HTTP request.

[0457] Input:Customized materials

[0458] Output: Send data to the user's device

[0459] Specific behavior:

[0460] The server then processes the data received from the generation AI to be delivered to the terminal.

[0461] Step 7:

[0462] The terminal receives the customized material sent from the server and displays it to the user through a dedicated application, allowing the user to view the new version of the material.

[0463] Input: Customization information sent from the server

[0464] Output: Displayed customization material

[0465] Specific behavior:

[0466] The terminal receives the data and visually presents customized content to the user via a dedicated application.

[0467] This allows users to have a customized reading experience that suits their needs.

[0468] (Application example 1)

[0469] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0470] With conventional book browsing methods, once a user purchased a book, they could not adapt or customize the content. In particular, it was difficult to change the ending of the story or the difficulty level of the content according to the user's individual wishes. Furthermore, there was no system in place to instantly reflect customized content and provide it to the user. This meant that users could not enjoy a reading experience that was tailored to their own wishes, which led to a decrease in reading satisfaction.

[0471] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0472] In this invention, the server includes means for inputting a book and customization details specified by the user, means for converting the format of the input data and sending it to the server, means for acquiring original data of the target book, means for sending the acquired original data and the user's customization requests to the generation AI, means for the generation AI to analyze the original data and customize the story based on the user's requests, means for the generation AI to generate a customized story and return it to the server, and means for communicating and sending the customized story to a terminal and displaying it on the terminal. This makes it possible to quickly generate and display customized book data based on the user's specifications.

[0473] "User" refers to a user who utilizes the system to request customization of a book.

[0474] "Book" refers to formal text data such as literary works or materials that a user specifies as a desired reading.

[0475] "Customization" means changing the content of a book (for example, the ending, difficulty level, etc.) according to the user's request.

[0476] "Terminal" refers to a device (e.g., a smartphone, tablet, etc.) that a user uses to access the system.

[0477] A "server" refers to a computer system that receives data sent from a user's terminal and processes it or accesses a database.

[0478] "Generative AI" refers to an artificial intelligence model that analyzes the contents of a book and generates a customized story based on the user's requests.

[0479] "Original data" refers to the text data of the original book, and is data that the server retrieves from the database.

[0480] "Format conversion" refers to converting data entered by a user into a format (such as JSON) that can be received and processed by the server.

[0481] "Display" refers to visually presenting the customized book data sent to the terminal to the user.

[0482] A specific system for implementing this invention is composed of a user terminal, a server, and a generation AI. The operation of each component will be explained in detail below.

[0483] A user launches the customized book application and specifies the title of the book they want to read and the customization details. For example, the user may input a request to the application such as "change the ending of a specific book to a happy ending." This user request is converted into an appropriate format such as JSON format by the device and sent to the server.

[0484] The server receives the user's request and retrieves the original data of the target book from the database based on the input data. A request including the retrieved original data and the user's customization request is sent to the generation AI. For example, based on the original data of "Example Book" retrieved from the database, the server passes a generation instruction to the generation AI saying, "Change the ending of this book to a happy ending."

[0485] The generation AI analyzes the received original data and the user's customization requests, and customizes the story based on the user's specifications. The generation AI reconstructs specific parts of the story according to the user's requests, generating a new version of the story, which in this case includes, for example, a modified ending.

[0486] The customized story data is returned from the generation AI to the server, which then sends it to the user's device, where it is displayed, allowing the user to enjoy the book with the new ending added.

[0487] As a concrete example, a user selects "Example Book" and inputs a request to "change the ending to a happy ending." An example of the prompt sentence is as follows:

[0488] Example prompt sentence:

[0489] "Please change the ending of the user-specified book 'Example Book' to a happy ending."

[0490] This invention enables users to quickly receive a customized reading experience based on their preferences. The hardware used is a user's smartphone, tablet, or other device, and the server is a system with a high-performance database and generative AI model installed. The software used includes libraries for data format conversion (e.g., JSON libraries) and HTTP communication libraries for communication processing (e.g., Requests).

[0491] This configuration allows the entire system to work seamlessly together, providing a dynamic and interactive reading experience that meets the individual needs of the user.

[0492] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0493] Step 1:

[0494] The user launches the dedicated application and inputs the title of the book they want to read and the customization details. As an example, they select "Example Book" and specify "change the ending to a happy one." The input data is received as the book title and the user's customization request.

[0495] Step 2:

[0496] The device converts the user's input data into an appropriate format, such as JSON. For example, the converted data may look like this: {'title': 'Example Book', 'customization': {'ending': 'happy'}}. The converted data is prepared for communication and sent to the server.

[0497] Step 3:

[0498] The server analyzes the data received from the user's device. The received data is in JSON format, and the book title and customization requests are extracted through analysis. The server accesses the database and retrieves the original data for the target book, "Example Book."

[0499] Step 4:

[0500] The server sends the original data it has acquired and the user's customization request to the generation AI. The data sent includes the original text data and customization instructions (prompt text). For example, the prompt text sent might be, "Please change the ending of the book 'Example Book' specified by the user to a happy ending."

[0501] Step 5:

[0502] The generation AI analyzes the original data and prompt text received from the server. The generation AI analyzes the text and changes the ending of the story based on the user's request, thereby generating a new, customized version of the story. The generated customized story is then sent back to the server.

[0503] Step 6:

[0504] The server receives the customized story sent from the generation AI and sends it to the user's device. The received customized story is delivered to the device using a communication protocol. The output data is the text data of the customized book.

[0505] Step 7:

[0506] The user's device receives the customized book data and displays it through a dedicated application. The displayed content includes a new ending for the "Example Book," which has been changed to a happy ending based on the user's specifications. The user can read the customized book and enjoy a reading experience that suits their preferences.

[0507] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0508] The system for implementing this invention is composed of a user terminal, a server, a generation AI, and an emotion engine. The operation of each component of the system is described in detail below.

[0509] 1. User operations

[0510] Users launch a dedicated application on their device. From the application interface, they select the title of the book they want to read and enter specific customizations (e.g., changing the ending or the main character). The emotion engine also recognizes the user's emotions in real time. This information is determined by the emotion engine based on the user's facial expressions, tone of voice, and other factors.

[0511] 2. Terminal Processing

[0512] The device receives the data entered by the user and the emotion data recognized by the emotion engine, and converts them into an appropriate format (e.g., JSON format). The converted data includes the book title, customization details, and emotion data. The converted data is then sent to the server. For example, the converted data is sent to the server as follows: {'title': 'Book Title', 'customization': {'ending': 'happy'}, 'emotion': 'excited'}.

[0513] 3. Server data reception and processing

[0514] The server receives and analyzes the data sent from the device. As a result of the analysis, it retrieves the corresponding original book data from the database based on the book title, customization requests, and emotional data. The server then sends a request to the generation AI based on the retrieved original data, the user's customization requests, and emotional data. This request includes the original story data, customization requests, emotional data, and specific customization instructions.

[0515] 4. Customizing the content of generated AI

[0516] The generation AI analyzes the original book data based on the request received from the server. The generation AI customizes the story based on the user's requests and emotional data, and generates a new version of the story. For example, if the generation AI reconstructs the ending of the book and recognizes that the user "hopes for a happy ending and is currently feeling excited," it will change the final scene of the story to a more moving one.

[0517] 5. Sending data from the server to the device

[0518] After the generation AI generates the customized story, the data is sent back to the server. The server then sends the received customized story data along with the emotion data to the user's device. The data is then delivered to the user's device using an appropriate communication method.

[0519] 6. Displaying the terminal

[0520] The user's device receives the customized story and emotional data sent from the server and displays the customized story. Through a dedicated application, the user can read a story tailored to their emotions and customization needs. For example, by opening the application, the user can read a new version of a book that has been modified to have a happy ending and a touching scene added.

[0521] In this way, users can enjoy a reading experience that is customized to their needs, desires, and emotions recognized in real time. Unlike traditional static book reading, this system can reflect the user's desires and emotions in a dynamic and interactive way.

[0522] The processing flow will be explained below.

[0523] Step 1:

[0524] Users launch a dedicated application on their device, select the title of the book they want to read from the interface, and enter specific customization details (e.g., changing the ending, changing the main character, etc.). The emotion engine also recognizes the user's real-time emotions.

[0525] Example: A user selects "adventure novel" and enters "change ending to happy ending." At the same time, the emotion engine analyzes the user's facial expression and determines the emotion as "excited."

[0526] Step 2:

[0527] The terminal receives the data entered by the user and the emotion data recognized by the emotion engine, and converts them into an appropriate format (e.g., JSON format).

[0528] Example: The device generates the following data: {'title': 'Adventure Story', 'customization': {'ending': 'happy'}, 'emotion': 'excited'}.

[0529] Step 3:

[0530] The terminal transmits the converted data to the server.

[0531] Example: A terminal executes a process to send data to a server.

[0532] Step 4:

[0533] The server receives and analyzes the data sent from the device. The data includes the title of the book selected by the user, customization details, and emotion data. As a result of the analysis, the server retrieves the original data of the corresponding book from the database.

[0534] Example: Retrieve the original data for "Adventure Story" from the database.

[0535] Step 5:

[0536] The server sends a request to the generation AI based on the acquired original data, the user's customization requests, and emotion data.

[0537] Example: The server sends instructions to the generation AI to "make the ending happy and take emotions into account to create a scene that will increase excitement."

[0538] Step 6:

[0539] The generation AI analyzes the request received from the server and converts the original book data based on the user's customization requests and emotional data.

[0540] Example: A generative AI changes the ending of a story to a happy one and adds scenes that increase tension and excitement.

[0541] Step 7:

[0542] The generation AI sends the generated customized story back to the server.

[0543] Example: Sending a customized "Adventure Story" to a server.

[0544] Step 8:

[0545] The server sends the customized story returned by the generation AI to the user's device.

[0546] Example: A server delivers customized story data to a user's device.

[0547] Step 9:

[0548] The terminal analyzes the customized story received from the server and displays it in a format that can be viewed by the user. Through the application, the user can read the customized story.

[0549] Example: A user opens an application and reads an "Adventure Story" that has a happy ending and an exciting scene added.

[0550] Example 2

[0551] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0552] Conventional book reading systems are unable to customize the experience based on the user's preferences or emotions, making it difficult to provide an interactive reading experience. Furthermore, they have not been able to generate stories that reflect the user's real-time emotional state. This results in a uniform user experience, lacking the flexibility to accommodate individual needs.

[0553] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0554] In this invention, the server includes: means for inputting a book and customization details designated by a user; means for an emotion engine to recognize the user's emotion data in real time; means for converting the format of the data input by the above means and transmitting it to the server; means for the server to acquire original data of the target book based on the above data; means for the server to transmit the acquired original data and the user's customization requests and emotion data to a generative AI model; means for the generative AI model to analyze the original data and customize a story based on the user's requests and emotion data; means for the generative AI model to generate a customized story and return it to the server; means for the server to transmit the customized story to the user's terminal; and means for the terminal to display the customized story. This enables a dynamic and interactive reading experience based on the user's wishes and emotions.

[0555] "User" refers to an individual or group that inputs books and customization details and uses the system.

[0556] A "terminal" is an electronic device that allows a user to select books and input customization details through a dedicated application.

[0557] A "dedicated application" is software that a user launches on their own device to select books and input customization details.

[0558] An "emotion engine" is a system or software that analyzes a user's facial expressions and tone of voice and generates emotional data in real time.

[0559] The "server" is a computer system that receives data sent from the user's device, retrieves the original data from the database, sends requests to the generative AI model, and finally returns the customized story data to the user's device.

[0560] A "database" is an information system for storing and managing original book data.

[0561] A "generative AI model" is an artificial intelligence system that analyzes a story based on the original data received from the server, the user's customization requests, and emotional data, and generates a new, customized story.

[0562] The "JSON format" is a lightweight data exchange format (JavaScript Object Notation) for structuring and exchanging data.

[0563] "Customization content" refers to a request for adjustment of a specific part of a book that the user desires (for example, changing the ending or the main character).

[0564] "Emotion data" is data on the emotional state obtained in real time by the emotion engine by analyzing the user's facial expressions and tone of voice.

[0565] A "customized story" is a new version of a story that is customized by a generative AI model based on the user's requests and emotional data.

[0566] This invention is a system that analyzes emotional data in real time using a user's own device and customizes the content of a book based on that data. The system consists of a user's device, a server, a generative AI model, and an emotion engine. The operation of each component of the system is described in detail below.

[0567] User operations

[0568] The user launches a dedicated application on their device. The application provides an interface for the user to input the title of the book they want to read and specific customizations (e.g., changing the ending, changing the main character, etc.). Furthermore, the emotion engine analyzes the user's facial expressions and tone of voice in real time to generate emotion data. At this stage, the user can input the following specific prompts into the application:

[0569] "Title: Momotaro, Customization: Happy ending, Emotion: Excited"

[0570] Terminal data processing

[0571] The device receives the data entered by the user and the emotional data recognized by the emotion engine, and converts them into JSON format. This converted data includes the book title, customization request details, and emotional data. For example, the data is structured in the following format:

[0572] {

[0573] 'title': 'Momotaro',

[0574] 'customization': {

[0575] 'ending': 'happy'

[0576] },

[0577] 'emotion': 'excited'

[0578] }

[0579] The terminal transmits this data to the server.

[0580] Server Processing

[0581] The server receives and analyzes the data sent from the device. As a result of the analysis, it retrieves the corresponding original book data from the database based on the book title, customization requests, and emotion data. The server then sends the retrieved original data, along with the user's customization requests and emotion data, to the generative AI model as a request. The request includes the original story data, customization requests, and emotion data.

[0582] Customizing generative AI models

[0583] The generative AI model analyzes the original book data based on requests received from the server. The generative AI model customizes the story based on the user's requests and emotional data, and generates a new version of the story. For example, if the user "hopes for a happy ending and is emotionally 'excited,'" the generative AI model can reconstruct the ending of the story into a happy one and add more moving scenes.

[0584] Sending and Displaying Data

[0585] After the generative AI model generates a customized story, the data is sent back to the server. The server then sends the received customized story data to the user's device. The device receives the customized story and emotion data sent from the server and displays it, allowing the user to read a story tailored to their own emotions and customization needs.

[0586] Specific examples

[0587] For example, if a user inputs through a dedicated application that they want the book "Momotaro" to have a happy ending and that they are currently feeling excited, the generative AI model will generate a new story, changing the ending to a happy one and adding a touching scene. The user can then read this new, customized story on their device.

[0588] Unlike traditional static book reading, this system allows users to enjoy a dynamic and interactive reading experience. The story is customized based on the user's preferences and real-time recognized emotions, providing a more personalized reading experience for the user.

[0589] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0590] Step 1:

[0591] The user launches a dedicated application on their device. Through the application's interface, the user inputs the title of the book they want to read and their customization details. The emotion engine then analyzes the user's facial expressions and tone of voice in real time, and adds emotional data to the input data. At this point, the input consists of the book title, customization details, and the analyzed emotional data. For example, the user might input "Title: Momotaro, Customization details: Change the ending to a happy one, Emotion: Excited."

[0592] Step 2:

[0593] The device receives the data input by the user and the emotion data obtained from the emotion engine. It then converts this data into an appropriate format (JSON format). Specifically, it converts the input data into the format "{'title': 'Momotaro', 'customization': {'ending': 'happy'}, 'emotion': 'excited'}". The output of this step is the data converted into JSON format.

[0594] Step 3:

[0595] The terminal sends the formatted data to the server, using the appropriate communication protocol to ensure that the data is sent correctly and securely. The input is the JSON data generated in step 2, and the output is the data sent to the server.

[0596] Step 4:

[0597] The server receives and analyzes the data sent from the device. As a result of the analysis, it extracts the book title, customization requests, and emotion data. It then retrieves the original data of the corresponding book from the database. The input of this step is the JSON data received by the server in step 3, and the output is the retrieved original data of the book.

[0598] Step 5:

[0599] The server sends the acquired original data, the user's customization request, and emotion data to the generative AI model as a request. This request includes the original story data, customization request, and emotion data. For example, "Original data: 'Momotaro,' customization request: make the ending happy, emotion: excited" is sent to the generative AI model. The inputs of this step are the original data, customization request, and emotion data, and the output is the request sent to the generative AI model.

[0600] Step 6:

[0601] The generative AI model analyzes the request received from the server and customizes the story based on the user's wishes and emotional data, based on the original book data. For example, it reads "Momotaro" and reconstructs the story to give it a happy ending, adding moving scenes to match the user's emotional state. The input for this step is the request received from the server, and the output is a customized new story.

[0602] Step 7:

[0603] The generative AI model sends the customized story back to the server. The input of this step is the customized story generated by the generative AI model, and the output is the customized story sent back to the server.

[0604] Step 8:

[0605] The server transmits the customized story data received from the generative AI model to the user's device via an appropriate communication protocol. The input to this step is the customized story returned by the generative AI model, and the output is the data transmitted to the user's device.

[0606] Step 9:

[0607] The user's device receives the customized story sent from the server and displays it through a dedicated application. For example, when the user opens the app, a new version of the customized "Momotaro" story appears, with the ending changed to a happy one and a touching scene added. The input of this step is the customized story received from the server, and the output is a display of the customized story.

[0608] Through the above processing steps, users can enjoy a new reading experience based on their own feelings and customization requests.

[0609] (Application example 2)

[0610] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0611] Conventional reading experiences are static and lack the ability to reflect user emotions and customization requests in real time. It is also difficult for users to experience interactive storytelling in an immersive virtual reality environment. Therefore, a system that can recognize a user's real-time emotions and dynamically customize a story based on them is needed.

[0612] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0613] In this invention, the server includes: means for inputting a book and customization details designated by a user; means for converting the format of the data input by said means and transmitting the converted data to the server; means for the server to acquire original data of the target book based on said data; means for the server to transmit the acquired original data and the user's customization requests to a generation AI; means for the generation AI to analyze the original data and customize a story based on the user's requests; means for the generation AI to generate a customized story and transmit it back to the server; means for the server to transmit the customized story to the user's terminal; means for the terminal to display the customized story; means for recognizing the user's emotions in real time; and means for providing an interactive storytelling experience in which the story dynamically changes based on the emotion data and is displayed in a virtual reality environment. This makes it possible to experience a story dynamically customized in accordance with the user's emotions in a virtual reality environment.

[0614] "User" refers to the person who uses the system, who specifies books and customization content, and provides real-time emotional data.

[0615] "Books" refers to all content provided as stories, including text data such as novels, essays, and technical books.

[0616] "Customization content" is information indicating the changes the user wishes to make to the story content, including changes to the ending or characters.

[0617] "Format conversion" refers to the process of converting data within the system into an appropriate format and sending it to the server.

[0618] The "server" is a computing device responsible for receiving data, analyzing it, sending requests to the generative AI model, and transmitting the customized story to the user's device.

[0619] "Original data" refers to the text data that is the source of the target book, and includes the content before customization.

[0620] "Generative AI" is an artificial intelligence model that analyzes and recreates stories based on user customization requests and emotional data.

[0621] "Emotional data" is information that indicates a user's real-time emotional state and is analyzed from facial expressions, tone of voice, etc.

[0622] A "virtual reality environment" refers to a virtual three-dimensional space that users experience through a head-mounted display or other device, enabling immersive, interactive storytelling.

[0623] An "interactive storytelling experience" refers to experiencing a story in a virtual reality environment that dynamically changes based on user actions and emotional data.

[0624] A system for implementing this invention comprises a user terminal, a server, a generative AI, and an emotion engine. This system provides an interactive storytelling experience by recognizing a user's emotions in real time and customizing a story based on the emotions and displaying it in a virtual reality environment.

[0625] User Actions

[0626] The user puts on a head-mounted display (HMD) and launches a dedicated application. Through the application interface, the user inputs the title of the book they want to read and their customization details. The emotion engine also recognizes the user's facial expressions and tone of voice in real time and captures them as emotional data.

[0627] Terminal handling

[0628] The device converts the data entered by the user and the emotional data recognized by the emotion engine into a JSON format containing the book title, customization request details, and emotional data, and sends it to the server. For example, the converted data is sent to the server as "{'title': 'Book Title', 'customization': {'ending': 'happy'}, 'emotion': 'excited'}".

[0629] Server data reception and processing

[0630] The server receives and analyzes the data sent from the device. Based on the analysis results, it retrieves the original data of the target book from the database based on the book title, customization requests, and emotional data. The server then requests the retrieved original data, the user's customization requests, and emotional data from the generation AI. This request includes the original story data, customization requests, emotional data, and specific customization instructions.

[0631] Customizing the content of generated AI

[0632] The generation AI analyzes the original story data based on the data received from the server and customizes the story according to the user's wishes and emotional data. For example, if the generation AI recognizes that the user "wants a happy ending and is currently feeling excited," it will change the ending of the story to a touching scene. The generated customized story is then sent back to the server.

[0633] Sending data from the server to the device

[0634] The server receives the customized story data returned from the generation AI and sends it to the user's device along with the emotion data.

[0635] Terminal display

[0636] The user's device receives the customized story and emotion data sent from the server and displays it on the HMD, allowing the user to experience a story dynamically tailored to their emotions and customization requests in a virtual reality environment.

[0637] Specific examples

[0638] Suppose a user selects a suspense novel and requests a happy ending. If the emotion engine recognizes that the user is excited, the generative AI will use this information to customize the ending of the story, maintaining the tension and adding a touching scene.

[0639] Prompt Sentence Examples

[0640] "Change the ending of the suspense novel the user is reading to a happy one. Users are excited and want a touching scene. For example, add a scene where the protagonist overcomes all obstacles and is reunited with his family."

[0641] This system enables users to experience a story dynamically customized according to their emotions in a virtual reality environment. The hardware used includes an HMD and a user terminal, and the software includes an emotion engine, generative AI, and a server application.

[0642] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0643] Step 1:

[0644] The user puts on a head-mounted display (HMD) and launches a dedicated application. From the application interface, the user inputs the title of the book they want to read and the customization details (e.g., changing the ending). The input data is temporarily saved on the user's device. The user's emotions (e.g., facial expressions and tone of voice) are captured in real time by the emotion engine and acquired as emotion data.

[0645] Input: Book title, customization request, user facial expression and tone of voice

[0646] Output: Book title, customization details, sentiment data

[0647] Step 2:

[0648] The device converts the user's input data and the emotion data obtained from the emotion engine into JSON format. The converted data includes the book title, customization request details, and emotion data. The converted data is then sent to the server.

[0649] Input: Book title, customization details, sentiment data

[0650] Output: JSON format data

[0651] Step 3:

[0652] The server receives the JSON data sent from the device. It analyzes the received data and extracts the book title, customization requests, and emotion data. Based on the book title, the server retrieves the original data of the target book from the database.

[0653] Input: JSON format data

[0654] Output: Original book data

[0655] Step 4:

[0656] The server sends the acquired original data, the user's customization request, and emotion data to the generative AI model as a request. The request includes the original story data, the customization request, the emotion data, and specific customization instructions.

[0657] Input: Original book data, customization requests, emotion data

[0658] Output: A request to the generative AI model

[0659] Step 5:

[0660] The generative AI model analyzes the original story data based on requests received from the server. It customizes the story according to the user's customization requests and emotional data. For example, based on the request to "change to a happy ending" and the emotion "excited," it reconstructs the ending of the story into a moving scene.

[0661] Input: Original story data, customization requests, emotion data

[0662] Output: Customized story

[0663] Step 6:

[0664] After the generative AI model generates the customized story, the generated story data is sent back to the server, which then receives the customized story data and sends it to the user's device.

[0665] Input: Customized story data

[0666] Output: Story data to user terminal

[0667] Step 7:

[0668] The user's device receives the customized story and emotion data sent from the server, and displays the received customized story on the HMD, allowing the user to enjoy an interactive storytelling experience in a virtual reality environment.

[0669] Input: Customized story data, emotion data

[0670] Output: Narrative display in a virtual reality environment

[0671] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0672] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0673] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0674] [Third embodiment]

[0675] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0676] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0677] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0678] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0679] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0680] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0681] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0682] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0683] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0684] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0685] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0686] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0687] The system for implementing this invention is composed of a user terminal, a server, and a generation AI. The operation of each component of the system will be described in detail below.

[0688] 1. User operations

[0689] A user launches a dedicated application on their device. From the application interface, they first select the title of the book they want to read, and then enter details about how they want to customize it. For example, a user might want to "change the ending of a particular book to a happy one." This information consists of selecting the book and entering the customization request to "change the ending to a happy one."

[0690] 2. Terminal Processing

[0691] The terminal receives the data entered by the user and converts it into an appropriate format (e.g., JSON format). The converted data includes the book title and customization details. The terminal then sends this converted data to the server. For example, the converted data may be sent to the server with the content "{'title': 'Book Title', 'customization': {'ending': 'happy'}}".

[0692] 3. Server data reception and processing

[0693] The server receives and analyzes the data sent from the device. It then retrieves the original data for the corresponding book from the database. The server generates a request that includes the original data and the user's customization requests, and sends this to the generation AI. For example, based on the original data retrieved from the database, the server may issue an instruction to the generation AI to "change the ending of this book to a happy one."

[0694] 4. Customizing the content of generated AI

[0695] The generation AI analyzes the original book data based on the request received from the server. The generation AI customizes the story according to the user's requests and generates a new version of the story. For example, the generation AI reconstructs the ending of the book and changes it to a happy ending as requested by the user. This process by the generation AI modifies parts of the original story.

[0696] 5. Sending data from the server to the device

[0697] After the generation AI generates the customized story, the data is sent back to the server. The server then sends the received customized story to the user's device. Specifically, the server delivers the customized story data to the user's device using an appropriate communication method.

[0698] 6. Displaying the terminal

[0699] The user's device receives the customized story sent from the server and displays it. The user can read the customized story through a dedicated application. For example, by opening the application, the user can view a new version of the book with a happy ending.

[0700] In this way, users can enjoy a reading experience that is customized to their needs and desires. Unlike traditional static book browsing, this system can reflect the user's wishes in a dynamic and interactive way.

[0701] The processing flow will be explained below.

[0702] Step 1:

[0703] The user launches a dedicated application on the device, selects the title of the book they want to read, and enters specific customization details (e.g., changing the ending, changing the main character, etc.).

[0704] Step 2:

[0705] The terminal receives the data entered by the user and converts it into an appropriate format (e.g., JSON format).

[0706] Step 3:

[0707] The device sends the converted data to the server, which includes the book title and details of the customization request.

[0708] Step 4:

[0709] The server receives and analyzes the data sent from the terminal. After analyzing the title and customization request, it retrieves the original data of the corresponding book from the database.

[0710] Step 5:

[0711] The server sends a request to the generation AI based on the acquired original data and the user's customization requests. This request includes the original story data and specific customization instructions.

[0712] Step 6:

[0713] The generation AI analyzes the request received from the server and transforms the original story according to the user's customization requests. For example, if the ending is changed to a happy one, it will reconstruct the final part of the story.

[0714] Step 7:

[0715] The generation AI sends the generated customized story back to the server. The new book data has the customizations specified by the user applied.

[0716] Step 8:

[0717] The server sends the customized story returned by the generation AI to the user's device. The server delivers the data to the user's device using an appropriate communication method.

[0718] Step 9:

[0719] The terminal analyzes the customized story received from the server and displays it in a format that can be viewed by the user. Through the application, the user can read the customized story.

[0720] Example 1

[0721] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0722] Conventional e-book systems have made it difficult for users to customize content once it has been provided. Such systems can only provide static content, and have the problem of being unable to accommodate diverse user needs. Specifically, they are unable to accommodate individual requests, such as changing the ending of a story or adjusting the difficulty level.

[0723] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0724] In this invention, the server includes means for inputting materials and customization details designated by the user, means for converting the format of the data input by said means and transmitting it to the server, means for the server to acquire original data of the target materials based on said data, means for the server to transmit the acquired original data and the user's customization requests to the generation AI, means for the generation AI to analyze the original data and customize the content based on the user's requests, means for the generation AI to generate customized content and return it to the server, means for the server to transmit the customized content to the user's terminal, and means for the terminal to display the customized content, thereby enabling the provision of dynamic and interactive content tailored to the individual needs of users.

[0725] "User" means any individual or organization wishing to use the system to customize materials.

[0726] "Materials" refers to information content such as books, documents, and electronic files.

[0727] "Customization content" refers to changes or additions to the materials desired by the user.

[0728] A "means" refers to a method or device used to achieve a particular purpose.

[0729] "Terminal" refers to an electronic device such as a computer, smartphone, or tablet that is operated by a user.

[0730] "Server" means the central computer system that processes and manages data received from user devices.

[0731] "Format conversion" is the process of converting data into another format.

[0732] "Data" means a collection of information or instructions expressed in an electronically processable form.

[0733] "Generative AI" is a system that uses artificial intelligence technology to generate new content based on input data.

[0734] "Analysis" is the process of examining data in detail to understand its structure and elements.

[0735] "Content" refers to the information and content of works provided to users.

[0736] "Display" refers to the visual output of content on the screen of a terminal.

[0737] The system for implementing this invention is composed of a user terminal, a server, and a generation AI. The operation of each component of the system will be described in detail below.

[0738] First, the user launches a dedicated application on their device. From the application interface, the user selects the title of the material they want to read and enters details about how they want to customize it. For example, a user might want to change the ending of a particular book to a happy one. This allows the user to input the desired customization data into the device.

[0739] Next, the terminal receives the data entered by the user and converts it into an appropriate format, such as JSON. This data includes the title of the material and customization details. The converted data is then sent to the server. For example, if the user wants to change the ending of "The Great Adventure" to a happy ending, the converted data is sent to the server as follows: {'title': 'The Great Adventure', 'customization': {'ending': 'happy'}}.

[0740] The server receives and analyzes the data sent from the terminal. It then retrieves the original data of the corresponding material from the database. The server generates a request that includes the original data and the user's customization requests, and sends this to the generation AI. An example of a specific prompt for the generation AI is, "Please change the ending of the book 'The Great Adventure' to a happy ending."

[0741] The generation AI analyzes the document based on the request received from the server and the original data of the document. The generation AI changes specific parts (for example, the ending) to a happy ending according to the user's request and generates a new version of the document.

[0742] After the generation AI generates the customized materials, the data is sent back to the server. The server then sends the received customized material data to the user's device. The sent data is received by the user's device and displayed to the user through a dedicated application, allowing the user to view the customized materials.

[0743] For example, when a user opens the app, they will be shown a new version of "The Great Adventure" with a happy ending, allowing them to enjoy a customized reading experience that suits their needs.

[0744] In this way, the system differs from conventional static document browsing in that it can dynamically and interactively reflect the user's wishes. The ability to customize documents to meet the diverse needs of users can increase user satisfaction.

[0745] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0746] Step 1:

[0747] The user launches the dedicated application and inputs the title of the material they want to read and the customization details. For example, if they want to change the ending of "The Great Adventure" to a happy ending, the user inputs this into the application interface. This operation generates input data that includes the user's customization wishes.

[0748] Input: Title of the material and customization details (e.g. "The Great Adventure", change the ending to a happy one)

[0749] Output: Raw data containing the user's customization preferences

[0750] Step 2:

[0751] The device converts the data entered by the user into the appropriate format (e.g., JSON). For example, it converts the entered title and customization details as follows:

[0752] json

[0753] {

[0754] 'title': 'The Great Adventure',

[0755] 'customization': {'ending': 'happy'}

[0756] }

[0757] The converted data is sent to the server.

[0758] Input: Raw data containing the user's customization preferences

[0759] Output: Formatted data (e.g. JSON format data)

[0760] Specific behavior:

[0761] The terminal receives input from the user, converts it into the specified format, and prepares it for transmission.

[0762] Step 3:

[0763] The server receives the converted data from the device, analyzes it, and then retrieves the original data of the corresponding material from the database, for example, the original data of "The Great Adventure."

[0764] Input: Formatted data (e.g. JSON format data)

[0765] Output: Original data of the target material

[0766] Specific behavior:

[0767] The server receives the data and initiates the process of retrieving the corresponding original data from the database.

[0768] Step 4:

[0769] The server generates a request that includes the acquired original data and the user's customization request, and sends it to the generation AI. Specifically, for example, it sends a prompt message to the generation AI saying, "Please change the ending of the book 'The Great Adventure' to a happy ending."

[0770] Input: Original data of the target material, user customization requests

[0771] Output: Request to the generation AI (prompt sentence)

[0772] Specific behavior:

[0773] The server generates a prompt text and performs communication processing to send it to the generation AI.

[0774] Step 5:

[0775] The generation AI receives the request and the original data of the material sent from the server, analyzes the material, and, based on the user's request, customizes certain parts (for example, the ending) to make them happy, and generates a new version of the material.

[0776] Input: Request from server (prompt text), original data

[0777] Output:Customized materials

[0778] Specific behavior:

[0779] The generation AI analyzes the original data and executes a process to edit and generate content based on the requirements.

[0780] Step 6:

[0781] The server receives the customized materials created by the generation AI and sends them to the user's device using an appropriate communication method such as an HTTP request.

[0782] Input:Customized materials

[0783] Output: Send data to the user's device

[0784] Specific behavior:

[0785] The server then processes the data received from the generation AI to be delivered to the terminal.

[0786] Step 7:

[0787] The terminal receives the customized material sent from the server and displays it to the user through a dedicated application, allowing the user to view the new version of the material.

[0788] Input: Customization information sent from the server

[0789] Output: Displayed customization material

[0790] Specific behavior:

[0791] The terminal receives the data and visually presents customized content to the user via a dedicated application.

[0792] This allows users to have a customized reading experience that suits their needs.

[0793] (Application example 1)

[0794] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0795] With conventional book browsing methods, once a user purchased a book, they could not adapt or customize the content. In particular, it was difficult to change the ending of the story or the difficulty level of the content according to the user's individual wishes. Furthermore, there was no system in place to instantly reflect customized content and provide it to the user. This meant that users could not enjoy a reading experience that was tailored to their own wishes, which led to a decrease in reading satisfaction.

[0796] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0797] In this invention, the server includes means for inputting a book and customization details specified by the user, means for converting the format of the input data and sending it to the server, means for acquiring original data of the target book, means for sending the acquired original data and the user's customization requests to the generation AI, means for the generation AI to analyze the original data and customize the story based on the user's requests, means for the generation AI to generate a customized story and return it to the server, and means for communicating and sending the customized story to a terminal and displaying it on the terminal. This makes it possible to quickly generate and display customized book data based on the user's specifications.

[0798] "User" refers to a user who utilizes the system to request customization of a book.

[0799] "Book" refers to formal text data such as literary works or materials that a user specifies as a desired reading.

[0800] "Customization" means changing the content of a book (for example, the ending, difficulty level, etc.) according to the user's request.

[0801] "Terminal" refers to a device (e.g., a smartphone, tablet, etc.) that a user uses to access the system.

[0802] A "server" refers to a computer system that receives data sent from a user's terminal and processes it or accesses a database.

[0803] "Generative AI" refers to an artificial intelligence model that analyzes the contents of a book and generates a customized story based on the user's requests.

[0804] "Original data" refers to the text data of the original book, and is data that the server retrieves from the database.

[0805] "Format conversion" refers to converting data entered by a user into a format (such as JSON) that can be received and processed by the server.

[0806] "Display" refers to visually presenting the customized book data sent to the terminal to the user.

[0807] A specific system for implementing this invention is composed of a user terminal, a server, and a generation AI. The operation of each component will be explained in detail below.

[0808] A user launches the customized book application and specifies the title of the book they want to read and the customization details. For example, the user may input a request to the application such as "change the ending of a specific book to a happy ending." This user request is converted into an appropriate format such as JSON format by the device and sent to the server.

[0809] The server receives the user's request and retrieves the original data of the target book from the database based on the input data. A request including the retrieved original data and the user's customization request is sent to the generation AI. For example, based on the original data of "Example Book" retrieved from the database, the server passes a generation instruction to the generation AI saying, "Change the ending of this book to a happy ending."

[0810] The generation AI analyzes the received original data and the user's customization requests, and customizes the story based on the user's specifications. The generation AI reconstructs specific parts of the story according to the user's requests, generating a new version of the story, which in this case includes, for example, a modified ending.

[0811] The customized story data is returned from the generation AI to the server, which then sends it to the user's device, where it is displayed, allowing the user to enjoy the book with the new ending added.

[0812] As a concrete example, a user selects "Example Book" and inputs a request to "change the ending to a happy ending." An example of the prompt sentence is as follows:

[0813] Example prompt sentence:

[0814] "Please change the ending of the user-specified book 'Example Book' to a happy ending."

[0815] This invention enables users to quickly receive a customized reading experience based on their preferences. The hardware used is a user's smartphone, tablet, or other device, and the server is a system with a high-performance database and generative AI model installed. The software used includes libraries for data format conversion (e.g., JSON libraries) and HTTP communication libraries for communication processing (e.g., Requests).

[0816] This configuration allows the entire system to work seamlessly together, providing a dynamic and interactive reading experience that meets the individual needs of the user.

[0817] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0818] Step 1:

[0819] The user launches the dedicated application and inputs the title of the book they want to read and the customization details. As an example, they select "Example Book" and specify "change the ending to a happy one." The input data is received as the book title and the user's customization request.

[0820] Step 2:

[0821] The device converts the user's input data into an appropriate format, such as JSON. For example, the converted data may look like this: {'title': 'Example Book', 'customization': {'ending': 'happy'}}. The converted data is prepared for communication and sent to the server.

[0822] Step 3:

[0823] The server analyzes the data received from the user's device. The received data is in JSON format, and the book title and customization requests are extracted through analysis. The server accesses the database and retrieves the original data for the target book, "Example Book."

[0824] Step 4:

[0825] The server sends the original data it has acquired and the user's customization request to the generation AI. The data sent includes the original text data and customization instructions (prompt text). For example, the prompt text sent might be, "Please change the ending of the book 'Example Book' specified by the user to a happy ending."

[0826] Step 5:

[0827] The generation AI analyzes the original data and prompt text received from the server. The generation AI analyzes the text and changes the ending of the story based on the user's request, thereby generating a new, customized version of the story. The generated customized story is then sent back to the server.

[0828] Step 6:

[0829] The server receives the customized story sent from the generation AI and sends it to the user's device. The received customized story is delivered to the device using a communication protocol. The output data is the text data of the customized book.

[0830] Step 7:

[0831] The user's device receives the customized book data and displays it through a dedicated application. The displayed content includes a new ending for the "Example Book," which has been changed to a happy ending based on the user's specifications. The user can read the customized book and enjoy a reading experience that suits their preferences.

[0832] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0833] The system for implementing this invention is composed of a user terminal, a server, a generation AI, and an emotion engine. The operation of each component of the system is described in detail below.

[0834] 1. User operations

[0835] Users launch a dedicated application on their device. From the application interface, they select the title of the book they want to read and enter specific customizations (e.g., changing the ending or the main character). The emotion engine also recognizes the user's emotions in real time. This information is determined by the emotion engine based on the user's facial expressions, tone of voice, and other factors.

[0836] 2. Terminal Processing

[0837] The device receives the data entered by the user and the emotion data recognized by the emotion engine, and converts them into an appropriate format (e.g., JSON format). The converted data includes the book title, customization details, and emotion data. The converted data is then sent to the server. For example, the converted data is sent to the server as follows: {'title': 'Book Title', 'customization': {'ending': 'happy'}, 'emotion': 'excited'}.

[0838] 3. Server data reception and processing

[0839] The server receives and analyzes the data sent from the device. As a result of the analysis, it retrieves the corresponding original book data from the database based on the book title, customization requests, and emotional data. The server then sends a request to the generation AI based on the retrieved original data, the user's customization requests, and emotional data. This request includes the original story data, customization requests, emotional data, and specific customization instructions.

[0840] 4. Customizing the content of generated AI

[0841] The generation AI analyzes the original book data based on the request received from the server. The generation AI customizes the story based on the user's requests and emotional data, and generates a new version of the story. For example, if the generation AI reconstructs the ending of the book and recognizes that the user "hopes for a happy ending and is currently feeling excited," it will change the final scene of the story to a more moving one.

[0842] 5. Sending data from the server to the device

[0843] After the generation AI generates the customized story, the data is sent back to the server. The server then sends the received customized story data along with the emotion data to the user's device. The data is then delivered to the user's device using an appropriate communication method.

[0844] 6. Displaying the terminal

[0845] The user's device receives the customized story and emotional data sent from the server and displays the customized story. Through a dedicated application, the user can read a story tailored to their emotions and customization needs. For example, by opening the application, the user can read a new version of a book that has been modified to have a happy ending and a touching scene added.

[0846] In this way, users can enjoy a reading experience that is customized to their needs, desires, and emotions recognized in real time. Unlike traditional static book reading, this system can reflect the user's desires and emotions in a dynamic and interactive way.

[0847] The processing flow will be explained below.

[0848] Step 1:

[0849] Users launch a dedicated application on their device, select the title of the book they want to read from the interface, and enter specific customization details (e.g., changing the ending, changing the main character, etc.). The emotion engine also recognizes the user's real-time emotions.

[0850] Example: A user selects "adventure novel" and enters "change ending to happy ending." At the same time, the emotion engine analyzes the user's facial expression and determines the emotion as "excited."

[0851] Step 2:

[0852] The terminal receives the data entered by the user and the emotion data recognized by the emotion engine, and converts them into an appropriate format (e.g., JSON format).

[0853] Example: The device generates the following data: {'title': 'Adventure Story', 'customization': {'ending': 'happy'}, 'emotion': 'excited'}.

[0854] Step 3:

[0855] The terminal transmits the converted data to the server.

[0856] Example: A terminal executes a process to send data to a server.

[0857] Step 4:

[0858] The server receives and analyzes the data sent from the device. The data includes the title of the book selected by the user, customization details, and emotion data. As a result of the analysis, the server retrieves the original data of the corresponding book from the database.

[0859] Example: Retrieve the original data for "Adventure Story" from the database.

[0860] Step 5:

[0861] The server sends a request to the generation AI based on the acquired original data, the user's customization requests, and emotion data.

[0862] Example: The server sends instructions to the generation AI to "make the ending happy and take emotions into account to create a scene that will increase excitement."

[0863] Step 6:

[0864] The generation AI analyzes the request received from the server and converts the original book data based on the user's customization requests and emotional data.

[0865] Example: A generative AI changes the ending of a story to a happy one and adds scenes that increase tension and excitement.

[0866] Step 7:

[0867] The generation AI sends the generated customized story back to the server.

[0868] Example: Sending a customized "Adventure Story" to a server.

[0869] Step 8:

[0870] The server sends the customized story returned by the generation AI to the user's device.

[0871] Example: A server delivers customized story data to a user's device.

[0872] Step 9:

[0873] The terminal analyzes the customized story received from the server and displays it in a format that can be viewed by the user. Through the application, the user can read the customized story.

[0874] Example: A user opens an application and reads an "Adventure Story" that has a happy ending and an exciting scene added.

[0875] Example 2

[0876] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0877] Conventional book reading systems are unable to customize the experience based on the user's preferences or emotions, making it difficult to provide an interactive reading experience. Furthermore, they have not been able to generate stories that reflect the user's real-time emotional state. This results in a uniform user experience, lacking the flexibility to accommodate individual needs.

[0878] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0879] In this invention, the server includes: means for inputting a book and customization details designated by a user; means for an emotion engine to recognize the user's emotion data in real time; means for converting the format of the data input by the above means and transmitting it to the server; means for the server to acquire original data of the target book based on the above data; means for the server to transmit the acquired original data and the user's customization requests and emotion data to a generative AI model; means for the generative AI model to analyze the original data and customize a story based on the user's requests and emotion data; means for the generative AI model to generate a customized story and return it to the server; means for the server to transmit the customized story to the user's terminal; and means for the terminal to display the customized story. This enables a dynamic and interactive reading experience based on the user's wishes and emotions.

[0880] "User" refers to an individual or group that inputs books and customization details and uses the system.

[0881] A "terminal" is an electronic device that allows a user to select books and input customization details through a dedicated application.

[0882] A "dedicated application" is software that a user launches on their own device to select books and input customization details.

[0883] An "emotion engine" is a system or software that analyzes a user's facial expressions and tone of voice and generates emotional data in real time.

[0884] The "server" is a computer system that receives data sent from the user's device, retrieves the original data from the database, sends requests to the generative AI model, and finally returns the customized story data to the user's device.

[0885] A "database" is an information system for storing and managing original book data.

[0886] A "generative AI model" is an artificial intelligence system that analyzes a story based on the original data received from the server, the user's customization requests, and emotional data, and generates a new, customized story.

[0887] The "JSON format" is a lightweight data exchange format (JavaScript Object Notation) for structuring and exchanging data.

[0888] "Customization content" refers to a request for adjustment of a specific part of a book that the user desires (for example, changing the ending or the main character).

[0889] "Emotion data" is data on the emotional state obtained in real time by the emotion engine by analyzing the user's facial expressions and tone of voice.

[0890] A "customized story" is a new version of a story that is customized by a generative AI model based on the user's requests and emotional data.

[0891] This invention is a system that analyzes emotional data in real time using a user's own device and customizes the content of a book based on that data. The system consists of a user's device, a server, a generative AI model, and an emotion engine. The operation of each component of the system is described in detail below.

[0892] User operations

[0893] The user launches a dedicated application on their device. The application provides an interface for the user to input the title of the book they want to read and specific customizations (e.g., changing the ending, changing the main character, etc.). Furthermore, the emotion engine analyzes the user's facial expressions and tone of voice in real time to generate emotion data. At this stage, the user can input the following specific prompts into the application:

[0894] "Title: Momotaro, Customization: Happy ending, Emotion: Excited"

[0895] Terminal data processing

[0896] The device receives the data entered by the user and the emotional data recognized by the emotion engine, and converts them into JSON format. This converted data includes the book title, customization request details, and emotional data. For example, the data is structured in the following format:

[0897] {

[0898] 'title': 'Momotaro',

[0899] 'customization': {

[0900] 'ending': 'happy'

[0901] },

[0902] 'emotion': 'excited'

[0903] }

[0904] The terminal transmits this data to the server.

[0905] Server Processing

[0906] The server receives and analyzes the data sent from the device. As a result of the analysis, it retrieves the corresponding original book data from the database based on the book title, customization requests, and emotion data. The server then sends the retrieved original data, along with the user's customization requests and emotion data, to the generative AI model as a request. The request includes the original story data, customization requests, and emotion data.

[0907] Customizing generative AI models

[0908] The generative AI model analyzes the original book data based on requests received from the server. The generative AI model customizes the story based on the user's requests and emotional data, and generates a new version of the story. For example, if the user "hopes for a happy ending and is emotionally 'excited,'" the generative AI model can reconstruct the ending of the story into a happy one and add more moving scenes.

[0909] Sending and Displaying Data

[0910] After the generative AI model generates a customized story, the data is sent back to the server. The server then sends the received customized story data to the user's device. The device receives the customized story and emotion data sent from the server and displays it, allowing the user to read a story tailored to their own emotions and customization needs.

[0911] Specific examples

[0912] For example, if a user inputs through a dedicated application that they want the book "Momotaro" to have a happy ending and that they are currently feeling excited, the generative AI model will generate a new story, changing the ending to a happy one and adding a touching scene. The user can then read this new, customized story on their device.

[0913] Unlike traditional static book reading, this system allows users to enjoy a dynamic and interactive reading experience. The story is customized based on the user's preferences and real-time recognized emotions, providing a more personalized reading experience for the user.

[0914] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0915] Step 1:

[0916] The user launches a dedicated application on their device. Through the application's interface, the user inputs the title of the book they want to read and their customization details. The emotion engine then analyzes the user's facial expressions and tone of voice in real time, and adds emotional data to the input data. At this point, the input consists of the book title, customization details, and the analyzed emotional data. For example, the user might input "Title: Momotaro, Customization details: Change the ending to a happy one, Emotion: Excited."

[0917] Step 2:

[0918] The device receives the data input by the user and the emotion data obtained from the emotion engine. It then converts this data into an appropriate format (JSON format). Specifically, it converts the input data into the format "{'title': 'Momotaro', 'customization': {'ending': 'happy'}, 'emotion': 'excited'}". The output of this step is the data converted into JSON format.

[0919] Step 3:

[0920] The terminal sends the formatted data to the server, using the appropriate communication protocol to ensure that the data is sent correctly and securely. The input is the JSON data generated in step 2, and the output is the data sent to the server.

[0921] Step 4:

[0922] The server receives and analyzes the data sent from the device. As a result of the analysis, it extracts the book title, customization requests, and emotion data. It then retrieves the original data of the corresponding book from the database. The input of this step is the JSON data received by the server in step 3, and the output is the retrieved original data of the book.

[0923] Step 5:

[0924] The server sends the acquired original data, the user's customization request, and emotion data to the generative AI model as a request. This request includes the original story data, customization request, and emotion data. For example, "Original data: 'Momotaro,' customization request: make the ending happy, emotion: excited" is sent to the generative AI model. The inputs of this step are the original data, customization request, and emotion data, and the output is the request sent to the generative AI model.

[0925] Step 6:

[0926] The generative AI model analyzes the request received from the server and customizes the story based on the user's wishes and emotional data, based on the original book data. For example, it reads "Momotaro" and reconstructs the story to give it a happy ending, adding moving scenes to match the user's emotional state. The input for this step is the request received from the server, and the output is a customized new story.

[0927] Step 7:

[0928] The generative AI model sends the customized story back to the server. The input of this step is the customized story generated by the generative AI model, and the output is the customized story sent back to the server.

[0929] Step 8:

[0930] The server transmits the customized story data received from the generative AI model to the user's device via an appropriate communication protocol. The input to this step is the customized story returned by the generative AI model, and the output is the data transmitted to the user's device.

[0931] Step 9:

[0932] The user's device receives the customized story sent from the server and displays it through a dedicated application. For example, when the user opens the app, a new version of the customized "Momotaro" story appears, with the ending changed to a happy one and a touching scene added. The input of this step is the customized story received from the server, and the output is a display of the customized story.

[0933] Through the above processing steps, users can enjoy a new reading experience based on their own feelings and customization requests.

[0934] (Application example 2)

[0935] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0936] Conventional reading experiences are static and lack the ability to reflect user emotions and customization requests in real time. It is also difficult for users to experience interactive storytelling in an immersive virtual reality environment. Therefore, a system that can recognize a user's real-time emotions and dynamically customize a story based on them is needed.

[0937] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0938] In this invention, the server includes: means for inputting a book and customization details designated by a user; means for converting the format of the data input by said means and transmitting the converted data to the server; means for the server to acquire original data of the target book based on said data; means for the server to transmit the acquired original data and the user's customization requests to a generation AI; means for the generation AI to analyze the original data and customize a story based on the user's requests; means for the generation AI to generate a customized story and transmit it back to the server; means for the server to transmit the customized story to the user's terminal; means for the terminal to display the customized story; means for recognizing the user's emotions in real time; and means for providing an interactive storytelling experience in which the story dynamically changes based on the emotion data and is displayed in a virtual reality environment. This makes it possible to experience a story dynamically customized in accordance with the user's emotions in a virtual reality environment.

[0939] "User" refers to the person who uses the system, who specifies books and customization content, and provides real-time emotional data.

[0940] "Books" refers to all content provided as stories, including text data such as novels, essays, and technical books.

[0941] "Customization content" is information indicating the changes the user wishes to make to the story content, including changes to the ending or characters.

[0942] "Format conversion" refers to the process of converting data within the system into an appropriate format and sending it to the server.

[0943] The "server" is a computing device responsible for receiving data, analyzing it, sending requests to the generative AI model, and transmitting the customized story to the user's device.

[0944] "Original data" refers to the text data that is the source of the target book, and includes the content before customization.

[0945] "Generative AI" is an artificial intelligence model that analyzes and recreates stories based on user customization requests and emotional data.

[0946] "Emotional data" is information that indicates a user's real-time emotional state and is analyzed from facial expressions, tone of voice, etc.

[0947] A "virtual reality environment" refers to a virtual three-dimensional space that users experience through a head-mounted display or other device, enabling immersive, interactive storytelling.

[0948] An "interactive storytelling experience" refers to experiencing a story in a virtual reality environment that dynamically changes based on user actions and emotional data.

[0949] A system for implementing this invention comprises a user terminal, a server, a generative AI, and an emotion engine. This system provides an interactive storytelling experience by recognizing a user's emotions in real time and customizing a story based on the emotions and displaying it in a virtual reality environment.

[0950] User Actions

[0951] The user puts on a head-mounted display (HMD) and launches a dedicated application. Through the application interface, the user inputs the title of the book they want to read and their customization details. The emotion engine also recognizes the user's facial expressions and tone of voice in real time and captures them as emotional data.

[0952] Terminal handling

[0953] The device converts the data entered by the user and the emotional data recognized by the emotion engine into a JSON format containing the book title, customization request details, and emotional data, and sends it to the server. For example, the converted data is sent to the server as "{'title': 'Book Title', 'customization': {'ending': 'happy'}, 'emotion': 'excited'}".

[0954] Server data reception and processing

[0955] The server receives and analyzes the data sent from the device. Based on the analysis results, it retrieves the original data of the target book from the database based on the book title, customization requests, and emotional data. The server then requests the retrieved original data, the user's customization requests, and emotional data from the generation AI. This request includes the original story data, customization requests, emotional data, and specific customization instructions.

[0956] Customizing the content of generated AI

[0957] The generation AI analyzes the original story data based on the data received from the server and customizes the story according to the user's wishes and emotional data. For example, if the generation AI recognizes that the user "wants a happy ending and is currently feeling excited," it will change the ending of the story to a touching scene. The generated customized story is then sent back to the server.

[0958] Sending data from the server to the device

[0959] The server receives the customized story data returned from the generation AI and sends it to the user's device along with the emotion data.

[0960] Terminal display

[0961] The user's device receives the customized story and emotion data sent from the server and displays it on the HMD, allowing the user to experience a story dynamically tailored to their emotions and customization requests in a virtual reality environment.

[0962] Specific examples

[0963] Suppose a user selects a suspense novel and requests a happy ending. If the emotion engine recognizes that the user is excited, the generative AI will use this information to customize the ending of the story, maintaining the tension and adding a touching scene.

[0964] Prompt Sentence Examples

[0965] "Change the ending of the suspense novel the user is reading to a happy one. Users are excited and want a touching scene. For example, add a scene where the protagonist overcomes all obstacles and is reunited with his family."

[0966] This system enables users to experience a story dynamically customized according to their emotions in a virtual reality environment. The hardware used includes an HMD and a user terminal, and the software includes an emotion engine, generative AI, and a server application.

[0967] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0968] Step 1:

[0969] The user puts on a head-mounted display (HMD) and launches a dedicated application. From the application interface, the user inputs the title of the book they want to read and the customization details (e.g., changing the ending). The input data is temporarily saved on the user's device. The user's emotions (e.g., facial expressions and tone of voice) are captured in real time by the emotion engine and acquired as emotion data.

[0970] Input: Book title, customization request, user facial expression and tone of voice

[0971] Output: Book title, customization details, sentiment data

[0972] Step 2:

[0973] The device converts the user's input data and the emotion data obtained from the emotion engine into JSON format. The converted data includes the book title, customization request details, and emotion data. The converted data is then sent to the server.

[0974] Input: Book title, customization details, sentiment data

[0975] Output: JSON format data

[0976] Step 3:

[0977] The server receives the JSON data sent from the device. It analyzes the received data and extracts the book title, customization requests, and emotion data. Based on the book title, the server retrieves the original data of the target book from the database.

[0978] Input: JSON format data

[0979] Output: Original book data

[0980] Step 4:

[0981] The server sends the acquired original data, the user's customization request, and emotion data to the generative AI model as a request. The request includes the original story data, the customization request, the emotion data, and specific customization instructions.

[0982] Input: Original book data, customization requests, emotion data

[0983] Output: A request to the generative AI model

[0984] Step 5:

[0985] The generative AI model analyzes the original story data based on requests received from the server. It customizes the story according to the user's customization requests and emotional data. For example, based on the request to "change to a happy ending" and the emotion "excited," it reconstructs the ending of the story into a moving scene.

[0986] Input: Original story data, customization requests, emotion data

[0987] Output: Customized story

[0988] Step 6:

[0989] After the generative AI model generates the customized story, the generated story data is sent back to the server, which then receives the customized story data and sends it to the user's device.

[0990] Input: Customized story data

[0991] Output: Story data to user terminal

[0992] Step 7:

[0993] The user's device receives the customized story and emotion data sent from the server, and displays the received customized story on the HMD, allowing the user to enjoy an interactive storytelling experience in a virtual reality environment.

[0994] Input: Customized story data, emotion data

[0995] Output: Narrative display in a virtual reality environment

[0996] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0997] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0998] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[0999] [Fourth embodiment]

[1000] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1001] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1002] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1003] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1004] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1005] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1006] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1007] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1008] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1009] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1010] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1011] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1012] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1013] The system for implementing this invention is composed of a user terminal, a server, and a generation AI. The operation of each component of the system will be described in detail below.

[1014] 1. User operations

[1015] A user launches a dedicated application on their device. From the application interface, they first select the title of the book they want to read, and then enter details about how they want to customize it. For example, a user might want to "change the ending of a particular book to a happy one." This information consists of selecting the book and entering the customization request to "change the ending to a happy one."

[1016] 2. Terminal Processing

[1017] The terminal receives the data entered by the user and converts it into an appropriate format (e.g., JSON format). The converted data includes the book title and customization details. The terminal then sends this converted data to the server. For example, the converted data may be sent to the server with the content "{'title': 'Book Title', 'customization': {'ending': 'happy'}}".

[1018] 3. Server data reception and processing

[1019] The server receives and analyzes the data sent from the device. It then retrieves the original data for the corresponding book from the database. The server generates a request that includes the original data and the user's customization requests, and sends this to the generation AI. For example, based on the original data retrieved from the database, the server may issue an instruction to the generation AI to "change the ending of this book to a happy one."

[1020] 4. Customizing the content of generated AI

[1021] The generation AI analyzes the original book data based on the request received from the server. The generation AI customizes the story according to the user's requests and generates a new version of the story. For example, the generation AI reconstructs the ending of the book and changes it to a happy ending as requested by the user. This process by the generation AI modifies parts of the original story.

[1022] 5. Sending data from the server to the device

[1023] After the generation AI generates the customized story, the data is sent back to the server. The server then sends the received customized story to the user's device. Specifically, the server delivers the customized story data to the user's device using an appropriate communication method.

[1024] 6. Displaying the terminal

[1025] The user's device receives the customized story sent from the server and displays it. The user can read the customized story through a dedicated application. For example, by opening the application, the user can view a new version of the book with a happy ending.

[1026] In this way, users can enjoy a reading experience that is customized to their needs and desires. Unlike traditional static book browsing, this system can reflect the user's wishes in a dynamic and interactive way.

[1027] The processing flow will be explained below.

[1028] Step 1:

[1029] The user launches a dedicated application on the device, selects the title of the book they want to read, and enters specific customization details (e.g., changing the ending, changing the main character, etc.).

[1030] Step 2:

[1031] The terminal receives the data entered by the user and converts it into an appropriate format (e.g., JSON format).

[1032] Step 3:

[1033] The device sends the converted data to the server, which includes the book title and details of the customization request.

[1034] Step 4:

[1035] The server receives and analyzes the data sent from the terminal. After analyzing the title and customization request, it retrieves the original data of the corresponding book from the database.

[1036] Step 5:

[1037] The server sends a request to the generation AI based on the acquired original data and the user's customization requests. This request includes the original story data and specific customization instructions.

[1038] Step 6:

[1039] The generation AI analyzes the request received from the server and transforms the original story according to the user's customization requests. For example, if the ending is changed to a happy one, it will reconstruct the final part of the story.

[1040] Step 7:

[1041] The generation AI sends the generated customized story back to the server. The new book data has the customizations specified by the user applied.

[1042] Step 8:

[1043] The server sends the customized story returned by the generation AI to the user's device. The server delivers the data to the user's device using an appropriate communication method.

[1044] Step 9:

[1045] The terminal analyzes the customized story received from the server and displays it in a format that can be viewed by the user. Through the application, the user can read the customized story.

[1046] Example 1

[1047] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1048] Conventional e-book systems have made it difficult for users to customize content once it has been provided. Such systems can only provide static content, and have the problem of being unable to accommodate diverse user needs. Specifically, they are unable to accommodate individual requests, such as changing the ending of a story or adjusting the difficulty level.

[1049] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1050] In this invention, the server includes means for inputting materials and customization details designated by the user, means for converting the format of the data input by said means and transmitting it to the server, means for the server to acquire original data of the target materials based on said data, means for the server to transmit the acquired original data and the user's customization requests to the generation AI, means for the generation AI to analyze the original data and customize the content based on the user's requests, means for the generation AI to generate customized content and return it to the server, means for the server to transmit the customized content to the user's terminal, and means for the terminal to display the customized content, thereby enabling the provision of dynamic and interactive content tailored to the individual needs of users.

[1051] "User" means any individual or organization wishing to use the system to customize materials.

[1052] "Materials" refers to information content such as books, documents, and electronic files.

[1053] "Customization content" refers to changes or additions to the materials desired by the user.

[1054] A "means" refers to a method or device used to achieve a particular purpose.

[1055] "Terminal" refers to an electronic device such as a computer, smartphone, or tablet that is operated by a user.

[1056] "Server" means the central computer system that processes and manages data received from user devices.

[1057] "Format conversion" is the process of converting data into another format.

[1058] "Data" means a collection of information or instructions expressed in an electronically processable form.

[1059] "Generative AI" is a system that uses artificial intelligence technology to generate new content based on input data.

[1060] "Analysis" is the process of examining data in detail to understand its structure and elements.

[1061] "Content" refers to the information and content of works provided to users.

[1062] "Display" refers to the visual output of content on the screen of a terminal.

[1063] The system for implementing this invention is composed of a user terminal, a server, and a generation AI. The operation of each component of the system will be described in detail below.

[1064] First, the user launches a dedicated application on their device. From the application interface, the user selects the title of the material they want to read and enters details about how they want to customize it. For example, a user might want to change the ending of a particular book to a happy one. This allows the user to input the desired customization data into the device.

[1065] Next, the terminal receives the data entered by the user and converts it into an appropriate format, such as JSON. This data includes the title of the material and customization details. The converted data is then sent to the server. For example, if the user wants to change the ending of "The Great Adventure" to a happy ending, the converted data is sent to the server as follows: {'title': 'The Great Adventure', 'customization': {'ending': 'happy'}}.

[1066] The server receives and analyzes the data sent from the terminal. It then retrieves the original data of the corresponding material from the database. The server generates a request that includes the original data and the user's customization requests, and sends this to the generation AI. An example of a specific prompt for the generation AI is, "Please change the ending of the book 'The Great Adventure' to a happy ending."

[1067] The generation AI analyzes the document based on the request received from the server and the original data of the document. The generation AI changes specific parts (for example, the ending) to a happy ending according to the user's request and generates a new version of the document.

[1068] After the generation AI generates the customized materials, the data is sent back to the server. The server then sends the received customized material data to the user's device. The sent data is received by the user's device and displayed to the user through a dedicated application, allowing the user to view the customized materials.

[1069] For example, when a user opens the app, they will be shown a new version of "The Great Adventure" with a happy ending, allowing them to enjoy a customized reading experience that suits their needs.

[1070] In this way, the system differs from conventional static document browsing in that it can dynamically and interactively reflect the user's wishes. The ability to customize documents to meet the diverse needs of users can increase user satisfaction.

[1071] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1072] Step 1:

[1073] The user launches the dedicated application and inputs the title of the material they want to read and the customization details. For example, if they want to change the ending of "The Great Adventure" to a happy ending, the user inputs this into the application interface. This operation generates input data that includes the user's customization wishes.

[1074] Input: Title of the material and customization details (e.g. "The Great Adventure", change the ending to a happy one)

[1075] Output: Raw data containing the user's customization preferences

[1076] Step 2:

[1077] The device converts the data entered by the user into the appropriate format (e.g., JSON). For example, it converts the entered title and customization details as follows:

[1078] json

[1079] {

[1080] 'title': 'The Great Adventure',

[1081] 'customization': {'ending': 'happy'}

[1082] }

[1083] The converted data is sent to the server.

[1084] Input: Raw data containing the user's customization preferences

[1085] Output: Formatted data (e.g. JSON format data)

[1086] Specific behavior:

[1087] The terminal receives input from the user, converts it into the specified format, and prepares it for transmission.

[1088] Step 3:

[1089] The server receives the converted data from the device, analyzes it, and then retrieves the original data of the corresponding material from the database, for example, the original data of "The Great Adventure."

[1090] Input: Formatted data (e.g. JSON format data)

[1091] Output: Original data of the target material

[1092] Specific behavior:

[1093] The server receives the data and initiates the process of retrieving the corresponding original data from the database.

[1094] Step 4:

[1095] The server generates a request that includes the acquired original data and the user's customization request, and sends it to the generation AI. Specifically, for example, it sends a prompt message to the generation AI saying, "Please change the ending of the book 'The Great Adventure' to a happy ending."

[1096] Input: Original data of the target material, user customization requests

[1097] Output: Request to the generation AI (prompt sentence)

[1098] Specific behavior:

[1099] The server generates a prompt text and performs communication processing to send it to the generation AI.

[1100] Step 5:

[1101] The generation AI receives the request and the original data of the material sent from the server, analyzes the material, and, based on the user's request, customizes certain parts (for example, the ending) to make them happy, and generates a new version of the material.

[1102] Input: Request from server (prompt text), original data

[1103] Output:Customized materials

[1104] Specific behavior:

[1105] The generation AI analyzes the original data and executes a process to edit and generate content based on the requirements.

[1106] Step 6:

[1107] The server receives the customized materials created by the generation AI and sends them to the user's device using an appropriate communication method such as an HTTP request.

[1108] Input:Customized materials

[1109] Output: Send data to the user's device

[1110] Specific behavior:

[1111] The server then processes the data received from the generation AI to be delivered to the terminal.

[1112] Step 7:

[1113] The terminal receives the customized material sent from the server and displays it to the user through a dedicated application, allowing the user to view the new version of the material.

[1114] Input: Customization information sent from the server

[1115] Output: Displayed customization material

[1116] Specific behavior:

[1117] The terminal receives the data and visually presents customized content to the user via a dedicated application.

[1118] This allows users to have a customized reading experience that suits their needs.

[1119] (Application example 1)

[1120] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1121] With conventional book browsing methods, once a user purchased a book, they could not adapt or customize the content. In particular, it was difficult to change the ending of the story or the difficulty level of the content according to the user's individual wishes. Furthermore, there was no system in place to instantly reflect customized content and provide it to the user. This meant that users could not enjoy a reading experience that was tailored to their own wishes, which led to a decrease in reading satisfaction.

[1122] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1123] In this invention, the server includes means for inputting a book and customization details specified by the user, means for converting the format of the input data and sending it to the server, means for acquiring original data of the target book, means for sending the acquired original data and the user's customization requests to the generation AI, means for the generation AI to analyze the original data and customize the story based on the user's requests, means for the generation AI to generate a customized story and return it to the server, and means for communicating and sending the customized story to a terminal and displaying it on the terminal. This makes it possible to quickly generate and display customized book data based on the user's specifications.

[1124] "User" refers to a user who utilizes the system to request customization of a book.

[1125] "Book" refers to formal text data such as literary works or materials that a user specifies as a desired reading.

[1126] "Customization" means changing the content of a book (for example, the ending, difficulty level, etc.) according to the user's request.

[1127] "Terminal" refers to a device (e.g., a smartphone, tablet, etc.) that a user uses to access the system.

[1128] A "server" refers to a computer system that receives data sent from a user's terminal and processes it or accesses a database.

[1129] "Generative AI" refers to an artificial intelligence model that analyzes the contents of a book and generates a customized story based on the user's requests.

[1130] "Original data" refers to the text data of the original book, and is data that the server retrieves from the database.

[1131] "Format conversion" refers to converting data entered by a user into a format (such as JSON) that can be received and processed by the server.

[1132] "Display" refers to visually presenting the customized book data sent to the terminal to the user.

[1133] A specific system for implementing this invention is composed of a user terminal, a server, and a generation AI. The operation of each component will be explained in detail below.

[1134] A user launches the customized book application and specifies the title of the book they want to read and the customization details. For example, the user may input a request to the application such as "change the ending of a specific book to a happy ending." This user request is converted into an appropriate format such as JSON format by the device and sent to the server.

[1135] The server receives the user's request and retrieves the original data of the target book from the database based on the input data. A request including the retrieved original data and the user's customization request is sent to the generation AI. For example, based on the original data of "Example Book" retrieved from the database, the server passes a generation instruction to the generation AI saying, "Change the ending of this book to a happy ending."

[1136] The generation AI analyzes the received original data and the user's customization requests, and customizes the story based on the user's specifications. The generation AI reconstructs specific parts of the story according to the user's requests, generating a new version of the story, which in this case includes, for example, a modified ending.

[1137] The customized story data is returned from the generation AI to the server, which then sends it to the user's device, where it is displayed, allowing the user to enjoy the book with the new ending added.

[1138] As a concrete example, a user selects "Example Book" and inputs a request to "change the ending to a happy ending." An example of the prompt sentence is as follows:

[1139] Example prompt sentence:

[1140] "Please change the ending of the user-specified book 'Example Book' to a happy ending."

[1141] This invention enables users to quickly receive a customized reading experience based on their preferences. The hardware used is a user's smartphone, tablet, or other device, and the server is a system with a high-performance database and generative AI model installed. The software used includes libraries for data format conversion (e.g., JSON libraries) and HTTP communication libraries for communication processing (e.g., Requests).

[1142] This configuration allows the entire system to work seamlessly together, providing a dynamic and interactive reading experience that meets the individual needs of the user.

[1143] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1144] Step 1:

[1145] The user launches the dedicated application and inputs the title of the book they want to read and the customization details. As an example, they select "Example Book" and specify "change the ending to a happy one." The input data is received as the book title and the user's customization request.

[1146] Step 2:

[1147] The device converts the user's input data into an appropriate format, such as JSON. For example, the converted data may look like this: {'title': 'Example Book', 'customization': {'ending': 'happy'}}. The converted data is prepared for communication and sent to the server.

[1148] Step 3:

[1149] The server analyzes the data received from the user's device. The received data is in JSON format, and the book title and customization requests are extracted through analysis. The server accesses the database and retrieves the original data for the target book, "Example Book."

[1150] Step 4:

[1151] The server sends the original data it has acquired and the user's customization request to the generation AI. The data sent includes the original text data and customization instructions (prompt text). For example, the prompt text sent might be, "Please change the ending of the book 'Example Book' specified by the user to a happy ending."

[1152] Step 5:

[1153] The generation AI analyzes the original data and prompt text received from the server. The generation AI analyzes the text and changes the ending of the story based on the user's request, thereby generating a new, customized version of the story. The generated customized story is then sent back to the server.

[1154] Step 6:

[1155] The server receives the customized story sent from the generation AI and sends it to the user's device. The received customized story is delivered to the device using a communication protocol. The output data is the text data of the customized book.

[1156] Step 7:

[1157] The user's device receives the customized book data and displays it through a dedicated application. The displayed content includes a new ending for the "Example Book," which has been changed to a happy ending based on the user's specifications. The user can read the customized book and enjoy a reading experience that suits their preferences.

[1158] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1159] The system for implementing this invention is composed of a user terminal, a server, a generation AI, and an emotion engine. The operation of each component of the system is described in detail below.

[1160] 1. User operations

[1161] Users launch a dedicated application on their device. From the application interface, they select the title of the book they want to read and enter specific customizations (e.g., changing the ending or the main character). The emotion engine also recognizes the user's emotions in real time. This information is determined by the emotion engine based on the user's facial expressions, tone of voice, and other factors.

[1162] 2. Terminal Processing

[1163] The device receives the data entered by the user and the emotion data recognized by the emotion engine, and converts them into an appropriate format (e.g., JSON format). The converted data includes the book title, customization details, and emotion data. The converted data is then sent to the server. For example, the converted data is sent to the server as follows: {'title': 'Book Title', 'customization': {'ending': 'happy'}, 'emotion': 'excited'}.

[1164] 3. Server data reception and processing

[1165] The server receives and analyzes the data sent from the device. As a result of the analysis, it retrieves the corresponding original book data from the database based on the book title, customization requests, and emotional data. The server then sends a request to the generation AI based on the retrieved original data, the user's customization requests, and emotional data. This request includes the original story data, customization requests, emotional data, and specific customization instructions.

[1166] 4. Customizing the content of generated AI

[1167] The generation AI analyzes the original book data based on the request received from the server. The generation AI customizes the story based on the user's requests and emotional data, and generates a new version of the story. For example, if the generation AI reconstructs the ending of the book and recognizes that the user "hopes for a happy ending and is currently feeling excited," it will change the final scene of the story to a more moving one.

[1168] 5. Sending data from the server to the device

[1169] After the generation AI generates the customized story, the data is sent back to the server. The server then sends the received customized story data along with the emotion data to the user's device. The data is then delivered to the user's device using an appropriate communication method.

[1170] 6. Displaying the terminal

[1171] The user's device receives the customized story and emotional data sent from the server and displays the customized story. Through a dedicated application, the user can read a story tailored to their emotions and customization needs. For example, by opening the application, the user can read a new version of a book that has been modified to have a happy ending and a touching scene added.

[1172] In this way, users can enjoy a reading experience that is customized to their needs, desires, and emotions recognized in real time. Unlike traditional static book reading, this system can reflect the user's desires and emotions in a dynamic and interactive way.

[1173] The processing flow will be explained below.

[1174] Step 1:

[1175] Users launch a dedicated application on their device, select the title of the book they want to read from the interface, and enter specific customization details (e.g., changing the ending, changing the main character, etc.). The emotion engine also recognizes the user's real-time emotions.

[1176] Example: A user selects "adventure novel" and enters "change ending to happy ending." At the same time, the emotion engine analyzes the user's facial expression and determines the emotion as "excited."

[1177] Step 2:

[1178] The terminal receives the data entered by the user and the emotion data recognized by the emotion engine, and converts them into an appropriate format (e.g., JSON format).

[1179] Example: The device generates the following data: {'title': 'Adventure Story', 'customization': {'ending': 'happy'}, 'emotion': 'excited'}.

[1180] Step 3:

[1181] The terminal transmits the converted data to the server.

[1182] Example: A terminal executes a process to send data to a server.

[1183] Step 4:

[1184] The server receives and analyzes the data sent from the device. The data includes the title of the book selected by the user, customization details, and emotion data. As a result of the analysis, the server retrieves the original data of the corresponding book from the database.

[1185] Example: Retrieve the original data for "Adventure Story" from the database.

[1186] Step 5:

[1187] The server sends a request to the generation AI based on the acquired original data, the user's customization requests, and emotion data.

[1188] Example: The server sends instructions to the generation AI to "make the ending happy and take emotions into account to create a scene that will increase excitement."

[1189] Step 6:

[1190] The generation AI analyzes the request received from the server and converts the original book data based on the user's customization requests and emotional data.

[1191] Example: A generative AI changes the ending of a story to a happy one and adds scenes that increase tension and excitement.

[1192] Step 7:

[1193] The generation AI sends the generated customized story back to the server.

[1194] Example: Sending a customized "Adventure Story" to a server.

[1195] Step 8:

[1196] The server sends the customized story returned by the generation AI to the user's device.

[1197] Example: A server delivers customized story data to a user's device.

[1198] Step 9:

[1199] The terminal analyzes the customized story received from the server and displays it in a format that can be viewed by the user. Through the application, the user can read the customized story.

[1200] Example: A user opens an application and reads an "Adventure Story" that has a happy ending and an exciting scene added.

[1201] Example 2

[1202] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1203] Conventional book reading systems are unable to customize the experience based on the user's preferences or emotions, making it difficult to provide an interactive reading experience. Furthermore, they have not been able to generate stories that reflect the user's real-time emotional state. This results in a uniform user experience, lacking the flexibility to accommodate individual needs.

[1204] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1205] In this invention, the server includes: means for inputting a book and customization details designated by a user; means for an emotion engine to recognize the user's emotion data in real time; means for converting the format of the data input by the above means and transmitting it to the server; means for the server to acquire original data of the target book based on the above data; means for the server to transmit the acquired original data and the user's customization requests and emotion data to a generative AI model; means for the generative AI model to analyze the original data and customize a story based on the user's requests and emotion data; means for the generative AI model to generate a customized story and return it to the server; means for the server to transmit the customized story to the user's terminal; and means for the terminal to display the customized story. This enables a dynamic and interactive reading experience based on the user's wishes and emotions.

[1206] "User" refers to an individual or group that inputs books and customization details and uses the system.

[1207] A "terminal" is an electronic device that allows a user to select books and input customization details through a dedicated application.

[1208] A "dedicated application" is software that a user launches on their own device to select books and input customization details.

[1209] An "emotion engine" is a system or software that analyzes a user's facial expressions and tone of voice and generates emotional data in real time.

[1210] The "server" is a computer system that receives data sent from the user's device, retrieves the original data from the database, sends requests to the generative AI model, and finally returns the customized story data to the user's device.

[1211] A "database" is an information system for storing and managing original book data.

[1212] A "generative AI model" is an artificial intelligence system that analyzes a story based on the original data received from the server, the user's customization requests, and emotional data, and generates a new, customized story.

[1213] The "JSON format" is a lightweight data exchange format (JavaScript Object Notation) for structuring and exchanging data.

[1214] "Customization content" refers to a request for adjustment of a specific part of a book that the user desires (for example, changing the ending or the main character).

[1215] "Emotion data" is data on the emotional state obtained in real time by the emotion engine by analyzing the user's facial expressions and tone of voice.

[1216] A "customized story" is a new version of a story that is customized by a generative AI model based on the user's requests and emotional data.

[1217] This invention is a system that analyzes emotional data in real time using a user's own device and customizes the content of a book based on that data. The system consists of a user's device, a server, a generative AI model, and an emotion engine. The operation of each component of the system is described in detail below.

[1218] User operations

[1219] The user launches a dedicated application on their device. The application provides an interface for the user to input the title of the book they want to read and specific customizations (e.g., changing the ending, changing the main character, etc.). Furthermore, the emotion engine analyzes the user's facial expressions and tone of voice in real time to generate emotion data. At this stage, the user can input the following specific prompts into the application:

[1220] "Title: Momotaro, Customization: Happy ending, Emotion: Excited"

[1221] Terminal data processing

[1222] The device receives the data entered by the user and the emotional data recognized by the emotion engine, and converts them into JSON format. This converted data includes the book title, customization request details, and emotional data. For example, the data is structured in the following format:

[1223] {

[1224] 'title': 'Momotaro',

[1225] 'customization': {

[1226] 'ending': 'happy'

[1227] },

[1228] 'emotion': 'excited'

[1229] }

[1230] The terminal transmits this data to the server.

[1231] Server Processing

[1232] The server receives and analyzes the data sent from the device. As a result of the analysis, it retrieves the corresponding original book data from the database based on the book title, customization requests, and emotion data. The server then sends the retrieved original data, along with the user's customization requests and emotion data, to the generative AI model as a request. The request includes the original story data, customization requests, and emotion data.

[1233] Customizing generative AI models

[1234] The generative AI model analyzes the original book data based on requests received from the server. The generative AI model customizes the story based on the user's requests and emotional data, and generates a new version of the story. For example, if the user "hopes for a happy ending and is emotionally 'excited,'" the generative AI model can reconstruct the ending of the story into a happy one and add more moving scenes.

[1235] Sending and Displaying Data

[1236] After the generative AI model generates a customized story, the data is sent back to the server. The server then sends the received customized story data to the user's device. The device receives the customized story and emotion data sent from the server and displays it, allowing the user to read a story tailored to their own emotions and customization needs.

[1237] Specific examples

[1238] For example, if a user inputs through a dedicated application that they want the book "Momotaro" to have a happy ending and that they are currently feeling excited, the generative AI model will generate a new story, changing the ending to a happy one and adding a touching scene. The user can then read this new, customized story on their device.

[1239] Unlike traditional static book reading, this system allows users to enjoy a dynamic and interactive reading experience. The story is customized based on the user's preferences and real-time recognized emotions, providing a more personalized reading experience for the user.

[1240] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1241] Step 1:

[1242] The user launches a dedicated application on their device. Through the application's interface, the user inputs the title of the book they want to read and their customization details. The emotion engine then analyzes the user's facial expressions and tone of voice in real time, and adds emotional data to the input data. At this point, the input consists of the book title, customization details, and the analyzed emotional data. For example, the user might input "Title: Momotaro, Customization details: Change the ending to a happy one, Emotion: Excited."

[1243] Step 2:

[1244] The device receives the data input by the user and the emotion data obtained from the emotion engine. It then converts this data into an appropriate format (JSON format). Specifically, it converts the input data into the format "{'title': 'Momotaro', 'customization': {'ending': 'happy'}, 'emotion': 'excited'}". The output of this step is the data converted into JSON format.

[1245] Step 3:

[1246] The terminal sends the formatted data to the server, using the appropriate communication protocol to ensure that the data is sent correctly and securely. The input is the JSON data generated in step 2, and the output is the data sent to the server.

[1247] Step 4:

[1248] The server receives and analyzes the data sent from the device. As a result of the analysis, it extracts the book title, customization requests, and emotion data. It then retrieves the original data of the corresponding book from the database. The input of this step is the JSON data received by the server in step 3, and the output is the retrieved original data of the book.

[1249] Step 5:

[1250] The server sends the acquired original data, the user's customization request, and emotion data to the generative AI model as a request. This request includes the original story data, customization request, and emotion data. For example, "Original data: 'Momotaro,' customization request: make the ending happy, emotion: excited" is sent to the generative AI model. The inputs of this step are the original data, customization request, and emotion data, and the output is the request sent to the generative AI model.

[1251] Step 6:

[1252] The generative AI model analyzes the request received from the server and customizes the story based on the user's wishes and emotional data, based on the original book data. For example, it reads "Momotaro" and reconstructs the story to give it a happy ending, adding moving scenes to match the user's emotional state. The input for this step is the request received from the server, and the output is a customized new story.

[1253] Step 7:

[1254] The generative AI model sends the customized story back to the server. The input of this step is the customized story generated by the generative AI model, and the output is the customized story sent back to the server.

[1255] Step 8:

[1256] The server transmits the customized story data received from the generative AI model to the user's device via an appropriate communication protocol. The input to this step is the customized story returned by the generative AI model, and the output is the data transmitted to the user's device.

[1257] Step 9:

[1258] The user's device receives the customized story sent from the server and displays it through a dedicated application. For example, when the user opens the app, a new version of the customized "Momotaro" story appears, with the ending changed to a happy one and a touching scene added. The input of this step is the customized story received from the server, and the output is a display of the customized story.

[1259] Through the above processing steps, users can enjoy a new reading experience based on their own feelings and customization requests.

[1260] (Application example 2)

[1261] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1262] Conventional reading experiences are static and lack the ability to reflect user emotions and customization requests in real time. It is also difficult for users to experience interactive storytelling in an immersive virtual reality environment. Therefore, a system that can recognize a user's real-time emotions and dynamically customize a story based on them is needed.

[1263] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1264] In this invention, the server includes: means for inputting a book and customization details designated by a user; means for converting the format of the data input by said means and transmitting the converted data to the server; means for the server to acquire original data of the target book based on said data; means for the server to transmit the acquired original data and the user's customization requests to a generation AI; means for the generation AI to analyze the original data and customize a story based on the user's requests; means for the generation AI to generate a customized story and transmit it back to the server; means for the server to transmit the customized story to the user's terminal; means for the terminal to display the customized story; means for recognizing the user's emotions in real time; and means for providing an interactive storytelling experience in which the story dynamically changes based on the emotion data and is displayed in a virtual reality environment. This makes it possible to experience a story dynamically customized in accordance with the user's emotions in a virtual reality environment.

[1265] "User" refers to the person who uses the system, who specifies books and customization content, and provides real-time emotional data.

[1266] "Books" refers to all content provided as stories, including text data such as novels, essays, and technical books.

[1267] "Customization content" is information indicating the changes the user wishes to make to the story content, including changes to the ending or characters.

[1268] "Format conversion" refers to the process of converting data within the system into an appropriate format and sending it to the server.

[1269] The "server" is a computing device responsible for receiving data, analyzing it, sending requests to the generative AI model, and transmitting the customized story to the user's device.

[1270] "Original data" refers to the text data that is the source of the target book, and includes the content before customization.

[1271] "Generative AI" is an artificial intelligence model that analyzes and recreates stories based on user customization requests and emotional data.

[1272] "Emotional data" is information that indicates a user's real-time emotional state and is analyzed from facial expressions, tone of voice, etc.

[1273] A "virtual reality environment" refers to a virtual three-dimensional space that users experience through a head-mounted display or other device, enabling immersive, interactive storytelling.

[1274] An "interactive storytelling experience" refers to experiencing a story in a virtual reality environment that dynamically changes based on user actions and emotional data.

[1275] A system for implementing this invention comprises a user terminal, a server, a generative AI, and an emotion engine. This system provides an interactive storytelling experience by recognizing a user's emotions in real time and customizing a story based on the emotions and displaying it in a virtual reality environment.

[1276] User Actions

[1277] The user puts on a head-mounted display (HMD) and launches a dedicated application. Through the application interface, the user inputs the title of the book they want to read and their customization details. The emotion engine also recognizes the user's facial expressions and tone of voice in real time and captures them as emotional data.

[1278] Terminal handling

[1279] The device converts the data entered by the user and the emotional data recognized by the emotion engine into a JSON format containing the book title, customization request details, and emotional data, and sends it to the server. For example, the converted data is sent to the server as "{'title': 'Book Title', 'customization': {'ending': 'happy'}, 'emotion': 'excited'}".

[1280] Server data reception and processing

[1281] The server receives and analyzes the data sent from the device. Based on the analysis results, it retrieves the original data of the target book from the database based on the book title, customization requests, and emotional data. The server then requests the retrieved original data, the user's customization requests, and emotional data from the generation AI. This request includes the original story data, customization requests, emotional data, and specific customization instructions.

[1282] Customizing the content of generated AI

[1283] The generation AI analyzes the original story data based on the data received from the server and customizes the story according to the user's wishes and emotional data. For example, if the generation AI recognizes that the user "wants a happy ending and is currently feeling excited," it will change the ending of the story to a touching scene. The generated customized story is then sent back to the server.

[1284] Sending data from the server to the device

[1285] The server receives the customized story data returned from the generation AI and sends it to the user's device along with the emotion data.

[1286] Terminal display

[1287] The user's device receives the customized story and emotion data sent from the server and displays it on the HMD, allowing the user to experience a story dynamically tailored to their emotions and customization requests in a virtual reality environment.

[1288] Specific examples

[1289] Suppose a user selects a suspense novel and requests a happy ending. If the emotion engine recognizes that the user is excited, the generative AI will use this information to customize the ending of the story, maintaining the tension and adding a touching scene.

[1290] Prompt Sentence Examples

[1291] "Change the ending of the suspense novel the user is reading to a happy one. Users are excited and want a touching scene. For example, add a scene where the protagonist overcomes all obstacles and is reunited with his family."

[1292] This system enables users to experience a story dynamically customized according to their emotions in a virtual reality environment. The hardware used includes an HMD and a user terminal, and the software includes an emotion engine, generative AI, and a server application.

[1293] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1294] Step 1:

[1295] The user puts on a head-mounted display (HMD) and launches a dedicated application. From the application interface, the user inputs the title of the book they want to read and the customization details (e.g., changing the ending). The input data is temporarily saved on the user's device. The user's emotions (e.g., facial expressions and tone of voice) are captured in real time by the emotion engine and acquired as emotion data.

[1296] Input: Book title, customization request, user facial expression and tone of voice

[1297] Output: Book title, customization details, sentiment data

[1298] Step 2:

[1299] The device converts the user's input data and the emotion data obtained from the emotion engine into JSON format. The converted data includes the book title, customization request details, and emotion data. The converted data is then sent to the server.

[1300] Input: Book title, customization details, sentiment data

[1301] Output: JSON format data

[1302] Step 3:

[1303] The server receives the JSON data sent from the device. It analyzes the received data and extracts the book title, customization requests, and emotion data. Based on the book title, the server retrieves the original data of the target book from the database.

[1304] Input: JSON format data

[1305] Output: Original book data

[1306] Step 4:

[1307] The server sends the acquired original data, the user's customization request, and emotion data to the generative AI model as a request. The request includes the original story data, the customization request, the emotion data, and specific customization instructions.

[1308] Input: Original book data, customization requests, emotion data

[1309] Output: A request to the generative AI model

[1310] Step 5:

[1311] The generative AI model analyzes the original story data based on requests received from the server. It customizes the story according to the user's customization requests and emotional data. For example, based on the request to "change to a happy ending" and the emotion "excited," it reconstructs the ending of the story into a moving scene.

[1312] Input: Original story data, customization requests, emotion data

[1313] Output: Customized story

[1314] Step 6:

[1315] After the generative AI model generates the customized story, the generated story data is sent back to the server, which then receives the customized story data and sends it to the user's device.

[1316] Input: Customized story data

[1317] Output: Story data to user terminal

[1318] Step 7:

[1319] The user's device receives the customized story and emotion data sent from the server, and displays the received customized story on the HMD, allowing the user to enjoy an interactive storytelling experience in a virtual reality environment.

[1320] Input: Customized story data, emotion data

[1321] Output: Narrative display in a virtual reality environment

[1322] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1323] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1324] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1325] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1326] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1327] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1328] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1329] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1330] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1331] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1332] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1333] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1334] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1335] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1336] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1337] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1338] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1339] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1340] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1341] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1342] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1343] The following is further disclosed regarding the above embodiment.

[1344] (Claim 1)

[1345] a means for inputting books and customizations designated by the user;

[1346] means for converting the format of the data input by said means and transmitting the converted data to a server;

[1347] A means for the server to acquire original data of the target book based on the data;

[1348] A means for transmitting the original data acquired by the server and the user's customization request to the generation AI;

[1349] A means for the generative AI to analyze the original data and customize the story based on the user's requests,

[1350] A means for the generation AI to generate a customized story and send it back to the server;

[1351] means for the server to transmit the customized story to the user's terminal;

[1352] a means for displaying the customized story on the device;

[1353] A system including:

[1354] (Claim 2)

[1355] 2. The system of claim 1, wherein the generating AI has a means for changing the ending of the story based on the user's request.

[1356] (Claim 3)

[1357] The system of claim 1, wherein the generating AI has a means for adjusting the difficulty of the story based on the user's requests.

[1358] "Example 1"

[1359] (Claim 1)

[1360] a means for inputting user-specified materials and customizations;

[1361] means for converting the format of the data input by said means and transmitting the converted data to a server;

[1362] A means for the server to acquire original data of the target material based on the data;

[1363] A means for transmitting the original data acquired by the server and the user's customization request to the generation AI;

[1364] A means for the generative AI to analyze the original data and customize the content based on the user's requests.

[1365] A means for the generation AI to generate customized content and return it to the server;

[1366] A means for the server to send customized content to the user's terminal;

[1367] a means for displaying customized content on the terminal;

[1368] A system including:

[1369] (Claim 2)

[1370] The system of claim 1, wherein the generating AI has a means for changing the ending portion of the content based on the user's request.

[1371] (Claim 3)

[1372] The system of claim 1, wherein the generating AI has a means for adjusting the difficulty of the content based on the user's requests.

[1373] "Application Example 1"

[1374] (Claim 1)

[1375] a means for inputting books and customizations designated by the user;

[1376] means for converting the format of the data input by said means and transmitting the converted data to a server;

[1377] A means for the server to acquire original data of the target book based on the data;

[1378] A means for transmitting the original data acquired by the server and the user's customization request to the generation AI;

[1379] A means for the generative AI to analyze the original data and customize the story based on the user's requests,

[1380] A means for the generation AI to generate a customized story and send it back to the server;

[1381] means for the server to transmit the customized story to the user's terminal;

[1382] a means for displaying the customized story on the device;

[1383] The system includes means for communicating and transmitting customized book data to a terminal and displaying the customized book data on the terminal.

[1384] (Claim 2)

[1385] The system of claim 1, wherein the generation AI has a means for changing the ending of the story based on the user's request to generate a customized story.

[1386] (Claim 3)

[1387] The system of claim 1, wherein the generation AI has a means for adjusting the difficulty of the story based on the user's requests and generating a customized story.

[1388] "Example 2: Combining Emotion Engines"

[1389] (Claim 1)

[1390] a means for inputting books and customizations designated by the user;

[1391] A means for the emotion engine to recognize user emotion data in real time;

[1392] means for converting the format of the data input by said means and transmitting the converted data to a server;

[1393] A means for the server to acquire original data of the target book based on the data;

[1394] A means for transmitting the original data acquired by the server and the user's customization requests and emotion data to the generating AI model;

[1395] A means for the generative AI model to analyze the original data and customize the story based on the user's requests and emotional data;

[1396] a means for the generative AI model to generate a customized narrative and send it back to the server;

[1397] means for the server to transmit the customized story to the user's terminal;

[1398] a means for the device to display the customized story;

[1399] A system including:

[1400] (Claim 2)

[1401] 10. The system of claim 1, wherein the generative AI model has means for changing the ending of the story based on user requests.

[1402] (Claim 3)

[1403] 2. The system of claim 1, wherein the generative AI model has means for adjusting the difficulty of the story based on user requests.

[1404] "Application example 2 when combining emotion engines"

[1405] (Claim 1)

[1406] a means for inputting user-specified books and customizations;

[1407] means for converting the format of the data input by said means and transmitting the converted data to a server;

[1408] A means for the server to acquire original data of the target book based on the data;

[1409] A means for transmitting the original data acquired by the server and the user's customization request to the generation AI;

[1410] A means for the generative AI to analyze the original data and customize the story based on the user's requests,

[1411] A means for the generation AI to generate a customized story and send it back to the server;

[1412] a means for the server to transmit the customized story to the user's device;

[1413] a means for displaying the customized story on the device;

[1414] A means of recognizing user emotions in real time;

[1415] a means for providing an interactive storytelling experience in which a narrative dynamically changes based on emotional data and is displayed in a virtual reality environment;

[1416] A system including:

[1417] (Claim 2)

[1418] The system of claim 1, wherein the generating AI has a means for changing the ending of the story based on the user's wishes and emotional data.

[1419] (Claim 3)

[1420] The system of claim 1, wherein the generating AI has a means for adjusting the difficulty of the story based on the user's requests and emotional data. [Explanation of symbols]

[1421] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. a means for inputting books and customizations designated by the user; means for converting the format of the data input by said means and transmitting it to a server; A means for the server to acquire original data of the target book based on the data; A means for transmitting the original data acquired by the server and the user's customization request to the generation AI; A means for the generative AI to analyze the original data and customize the story based on the user's requests, A means for the generation AI to generate a customized story and send it back to the server; means for the server to transmit the customized story to the user's terminal; a means for displaying the customized story on the device; A system including:

2. 2. The system of claim 1, wherein the generating AI has means for changing the ending of the story based on the user's request.

3. 2. The system according to claim 1, wherein the generating AI has means for adjusting the difficulty of the story based on the user's requests.

Images