system

Abstract

Provide a system. A means for collecting information input by a user; a means for selecting an appropriate picture book template based on the collected information; means for customizing the selected template based on user information; a means for generating a digital picture book based on the customized content; A means for providing the generated picture book to a user; A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, children's picture books have become more diverse, and parents and educators want to provide picture books that match the interests and preferences of each individual child. However, commercially available picture books are generic and not optimized for specific children. This makes it difficult to provide customized picture books based on individual information such as a child's name, age, and hobbies. Therefore, there is a need for a system that can easily generate and provide personalized picture books for specific children. [Means for solving the problem]

[0005] The present invention solves the above problems by providing a means for collecting information input by a user and using a means for selecting an appropriate picture book template based on the collected information. It further includes a means for customizing the selected template based on the user information and a means for generating a digital picture book based on the customized content. By combining this with a means for providing the generated picture book to the user, it becomes possible to easily generate and use a picture book personalized for a specific child.

[0006] "User" refers to a person who uses the system.

[0007] "Information" is data provided by a user, including personal attributes such as name, age, hobbies, preferences, etc.

[0008] "Means for collecting" refers to a system component that allows the user to input and compile the necessary information.

[0009] A "template" is a basic format or story model for a picture book, and refers to a prototype that is intended for customization.

[0010] "Means for selecting" refers to a system component for identifying and determining the most appropriate template based on the user's collected information.

[0011] The "means for customizing" refers to a system component that reflects user information on the selected template and modifies it to suit the specific content.

[0012] "Generating means" refers to a system component that creates a digital picture book based on customized content.

[0013] The "means for providing" refers to a system component that distributes the created picture book to users in a format that allows them to view or download it.

[0014] "System" refers to the overall configuration that combines the above means to generate and provide personalized picture books for specific children.

[0015] "Illustrations" refer to pictures and images that visually express the story of a picture book. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram illustrating a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] The present invention is a system for generating a customizable picture book based on information input by a user, and is specifically implemented in the following manner.

[0038] 1. Collecting User Input

[0039] The device displays a form for the user to enter information to create a picture book. The form contains the following fields:

[0040] Child's name

[0041] age

[0042] hobby

[0043] Preferences

[0044] The user enters the required information in each field and clicks the "Submit" button.

[0045] 2. Select a template

[0046] The server receives and analyzes the information collected from the user. Based on the analyzed data, it selects the most suitable picture book template from among several available templates. For example, if a user likes "dinosaurs" and "adventures," a template about dinosaur adventures will be selected.

[0047] 3. Customization

[0048] The server replaces the placeholders in the selected template with the user's input data, customized for example as follows:

[0049] Replace the main character's name with Taro.

[0050] Set the age to 5 years old.

[0051] Inserting specific scenes based on interests and preferences (adventures with dinosaurs).

[0052] At this time, the server retrieves appropriate illustrations from the database and places them in each scene of the story.

[0053] 4. Picture Book Generation

[0054] The server combines customized text and illustrations to generate a digital picture book, with output formats such as PDF and ePub.

[0055] 5. Providing picture books

[0056] The server temporarily stores the generated digital picture book and issues an access URL, etc.

[0057] The device displays a download link and viewing options for the generated picture book to the user, who can click the link to download or view the picture book.

[0058] Specific examples

[0059] For example, suppose 5-year-old Taro likes dinosaurs and adventures. The user enters "Taro, 5 years old, dinosaur, adventure" into a form on the device and submits it. The server then selects the "Dinosaur Adventure" template and generates a story in which Taro, an adventurous 5-year-old boy, is transported to the world of dinosaurs.

[0060] The server then adds appropriate dinosaur illustrations to the customized story, finally generating a digital picture book, and sends a PDF link to the device, which the user can use to download the book.

[0061] As described above, this system can quickly and efficiently generate and provide a customized picture book based on the user's input information.

[0062] The processing flow will be explained below.

[0063] Step 1:

[0064] The terminal presents the user with an information entry form containing the following fields:

[0065] Child's name

[0066] age

[0067] hobby

[0068] Preferences

[0069] Step 2:

[0070] The user enters the required information in each field and clicks the "Submit" button. For example, the user enters: Name: Taro, Age: 5, Hobbies: Dinosaurs, Preferences: Adventure.

[0071] Step 3:

[0072] The device sends the information collected from the user to the server as structured data in JSON format or other format.

[0073] Step 4:

[0074] The server analyzes the received user information and obtains data such as name, age, hobbies, and preferences.

[0075] Step 5:

[0076] The server selects the template that best suits the user's interests and preferences from among multiple picture book templates, for example, the "Dinosaur Adventure" template.

[0077] Step 6:

[0078] The server replaces the placeholders in the selected template with the user's input data, specifically replacing:

[0079] Replace the main character's name with "Taro"

[0080] Change the protagonist's age to "5 years old"

[0081] Add specific scenes based on your interests and preferences (dinosaur adventure scenes)

[0082] Step 7:

[0083] The server retrieves dinosaur illustrations from an illustration database and places them in each scene to add appropriate illustrations to the customized story.

[0084] Step 8:

[0085] The server combines customized text and illustrations to generate a digital picture book, which is then output in formats such as PDF or ePub.

[0086] Step 9:

[0087] The server temporarily stores the generated picture book and issues a URL so that the user can access it.

[0088] Step 10:

[0089] The server sends a download link and viewing options for the generated picture book to the terminal.

[0090] Step 11:

[0091] The device displays a link to the book and a download option to the user.

[0092] Step 12:

[0093] Users can click on the link to download and view the book.

[0094] Example 1

[0095] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0096] Conventional picture book generation systems have had difficulty efficiently generating customized content based on user-entered information and providing it immediately. It was also time-consuming to combine appropriate illustrations for a customized picture book. As a result, it was difficult to quickly generate a high-quality, personalized picture book based on user-entered information.

[0097] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0098] In this invention, the server includes means for collecting information input by a user, means for selecting an appropriate template based on the collected information, means for customizing the selected template based on the user information, means for generating a digital e-book based on the customized content, and means for providing the generated e-book to the user. This makes it possible to quickly generate a personalized picture book efficiently based on the information input by the user and combine appropriate images with the picture book.

[0099] "Means for collecting information entered by users" refers to the function of providing a form or interface for users to enter information such as their name, age, hobbies, and preferences, and sending that information to the server.

[0100] The "means for selecting an appropriate template based on collected information" is a function for analyzing collected user data and selecting the template that is most suitable for that data.

[0101] The "means for customizing a selected template based on user information" is a function for replacing placeholders in a selected template with data input by a user to generate individually customized content.

[0102] "Means for generating digital e-books based on customized content" refers to the ability to combine customized text and images and convert them into a digital format such as a PDF or e-book file (e.g., ePub).

[0103] The "means of providing the generated e-book to the user" refers to a function that temporarily stores the generated digital e-book on a server, issues a URL that the user can access, and allows the e-book to be downloaded or viewed via that link.

[0104] "Information" is a general term for personal data such as name, age, hobbies, and preferences entered by the user.

[0105] A "template" is a reusable format that represents the framework and structure of a basic picture book that is customized based on user information.

[0106] "Customized content" refers to the text and images in the template after the placeholders have been replaced with information entered by the user.

[0107] "Digital format" means a format that can be displayed and saved on a computer or electronic device, such as a PDF or e-book file (e.g., ePub).

[0108] An "e-book" is a book or document provided in digital format and can be viewed on a computer or dedicated e-book reader.

[0109] The present invention is a system for generating a customizable electronic book based on information input by a user, and is implemented in the following manner.

[0110] Collecting User Input

[0111] The device displays a form for the user to input information for creating a picture book via a web page or application. The form contains the following fields:

[0112] Child's name

[0113] age

[0114] hobby

[0115] Preferences

[0116] The user enters the required information into each field and clicks the "Submit" button. This input data is collected via JavaScript (registered trademark) and sent to the server as an HTTP POST request.

[0117] Template Selection

[0118] The server receives the user data sent from the device. Typically, this is sent as an HTTP POST request. The server analyzes the received data and selects the picture book template that best suits the data. This analysis is done using a scripting language such as Python or Ruby. For example, if the user likes "dinosaurs" and "adventures," a template about dinosaur adventures will be selected.

[0119] Customization

[0120] The server then replaces the placeholders in the selected template with the user's input data, using a template engine (e.g. Jinja2), customized for example as follows:

[0121] Replace the main character's name with Taro.

[0122] Set the age to 5 years old.

[0123] Inserting specific scenes based on interests and preferences (adventures with dinosaurs).

[0124] The server also retrieves appropriate illustrations from a database and places them in each scene of the story. This database is accessed using SQL queries.

[0125] E-book generation

[0126] Customized text and illustrations are combined to generate a digital e-book. This process is performed using a PDF generation library (e.g., ReportLab) or an e-book creation tool (e.g., Calibre). Output formats include PDF and e-book files (ePub).

[0127] Providing e-books

[0128] The generated digital e-book is temporarily stored on a server, and an access URL is issued. This URL is provided as a download link that the user can access. The device displays this download link and viewing options to the user. The user can click the link to download or view the e-book.

[0129] Specific examples

[0130] For example, 5-year-old Taro likes dinosaurs and adventures. The user enters "Taro, 5 years old, dinosaurs, adventure" into a form on their device and submits it. The server then selects the "Dinosaur Adventure" template and generates a story in which Taro, an adventurous 5-year-old boy, is transported to the world of dinosaurs. The server then adds appropriate dinosaur illustrations to the customized story and finally generates a digital e-book. The server then sends the generated PDF link to the device, which the user can use to download the e-book. An example of a prompt is "Please generate a story in which 5-year-old Taro goes on an adventure in the world of dinosaurs." When this prompt is input into the generative AI model, it is expected that the text of a customized picture book will be generated.

[0131] As described above, this system can quickly and efficiently generate and provide a customized electronic book based on user input information.

[0132] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0133] Step 1:

[0134] Collecting User Input

[0135] Specific operation: The device displays an information input form for creating a picture book to the user through a web page or application built using HTML and JavaScript. The form includes fields such as "child's name," "age," "hobbies," and "preferences."

[0136] Input: The user enters "Taro," "5 years old," "dinosaur," and "adventure" into an input form.

[0137] Output: When the user clicks the "Submit" button, this data is collected via JavaScript and sent to the server as an HTTP POST request.

[0138] Step 2:

[0139] Data reception and analysis

[0140] Specific operation: The server receives the HTTP POST request sent from the device and analyzes the user data contained therein ("Taro," "5 years old," "dinosaur," and "adventure"). The analysis is performed using a scripting language such as Python or Ruby.

[0141] Input: User data sent from the device.

[0142] Output: Based on the parsed user data, an appropriate storybook template (e.g., the "Dinosaur Adventure" template) is selected.

[0143] Step 3:

[0144] Customizing the template

[0145] Specific behavior: The server creates a placeholder ( <name>or <age>) with user-supplied data. This is done using a template engine (e.g., Jinja2), and then using SQL queries to retrieve the appropriate illustrations from a database and place them in each scene of the story.

[0146] Input: Selected template and user data.

[0147] Output: A customized story with the name "Taro" and age "5 years old" with scenes inserted based on hobbies and preferences.

[0148] Step 4:

[0149] Generate digital e-books

[0150] What it does: The server generates a digital e-book by combining customized text and illustrations, using a PDF generation library (e.g., ReportLab) and an e-book creation tool (e.g., Calibre).

[0151] Input: Customized text and retrieved illustrations.

[0152] Output: Digital eBook in PDF or ePub format as selected as output format.

[0153] Step 5:

[0154] Providing e-books

[0155] Specific operation: The server temporarily stores the generated digital e-book and generates an access URL. This URL is provided as a download link that the user can access. The device displays this download link and viewing options to the user.

[0156] Input: The generated digital e-book.

[0157] Output: A download link and / or viewing options that users can access. Users can click the link to download or view the eBook.

[0158] (Application example 1)

[0159] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0160] Conventional picture book generation systems were able to generate customized picture books based on user input, but the methods for providing the generated picture books were limited, making it difficult for users to access and download them smoothly.In addition, the management and distribution methods for the generated picture books were complicated, which could result in a poor user experience.

[0161] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0162] In this invention, the server includes means for collecting information input by a user, means for selecting an appropriate picture book template based on the collected information, means for customizing the selected template based on the user information, means for generating a digital picture book based on the customized content, means for providing the generated picture book to the user, and means for issuing a download link for distributing the customized picture book, thereby enabling the user to easily download and view the generated picture book.

[0163] "Information entered by the user" refers to data such as name, age, hobbies, and preferences that the user provides in the picture book creation system.

[0164] "Means for collection" refers to a function or device that acquires information entered by the user and stores it in the system.

[0165] The "means for selecting an appropriate picture book template" is an algorithm or device that automatically selects the most appropriate picture book template based on collected user information.

[0166] A "means for customizing a template" is a function or device that replaces placeholders in a selected template with user-entered information.

[0167] A "means for generating a digital picture book" is an algorithm or device that combines customized text and illustrations to ultimately generate a picture book as digital data.

[0168] The "means for providing the generated picture book to the user" refers to a function or device that provides the generated digital picture book in a form that is accessible to the user.

[0169] The "means for issuing a download link" is a function or device that generates and provides a URL link that allows a user to download the generated digital picture book.

[0170] An "illustration combination tool" is an algorithm or device that selects and arranges appropriate image data to fit a customized story.

[0171] The present invention is a system for generating a customizable picture book based on information input by a user, and specific embodiments for implementing this system are described below.

[0172] Hardware and software used

[0173] Hardware:

[0174] Smartphone (device for users to input data)

[0175] Server (a computer for analyzing data and creating picture books)

[0176] software:

[0177] Flask (Python (registered trademark) based web framework)

[0178] JSON (data storage and exchange format)

[0179] System processing flow

[0180] 1. Collecting User Input

[0181] The user uses a smartphone to enter information into a form to create a picture book. The form contains the following fields:

[0182] Child's name

[0183] age

[0184] hobby

[0185] Preferences

[0186] The user enters the required information in each field and clicks the "Submit" button.

[0187] 2. Select a template

[0188] The server receives and analyzes the information collected from the user. Based on the analyzed data, it selects the most suitable picture book template. For example, if the user likes dinosaurs and adventures, a template about dinosaur adventures will be selected.

[0189] 3. Customization

[0190] The server replaces the placeholders in the selected template with the user's input data, customized as follows:

[0191] Replace the protagonist's name with the name entered by the user (e.g., "Taro").

[0192] Set the age to the entered age (e.g., "5 years old").

[0193] Inserting specific scenes based on interests and preferences (adventures with dinosaurs).

[0194] At this time, the server retrieves appropriate illustrations from a database and places them in each scene of the story.

[0195] 4. Picture Book Generation

[0196] The server combines the customized text and illustrations to generate a digital picture book, which is output in formats such as PDF or ePub.

[0197] 5. Providing picture books

[0198] The server temporarily stores the generated digital picture book and issues an access URL. The smartphone device displays a download link and viewing options for the generated picture book to the user. The user can click the link to download or view the picture book.

[0199] Specific examples

[0200] For example, suppose 5-year-old Taro likes dinosaurs and adventures. The user enters "Taro, 5 years old, dinosaur, adventure" into a form on the device and submits it. The server then selects the "Dinosaur Adventure" template and generates a story in which "Taro, as an adventurous 5-year-old boy, is transported to the world of dinosaurs." The server adds appropriate dinosaur illustrations to the customized story, and finally generates a digital picture book. The server sends the generated PDF link to the device, and the user can use the link to download the picture book.

[0201] Prompt Sentence Examples

[0202] Taro, 5 years old, dinosaur, adventure

[0203] As described above, a picture book customized based on user input information can be quickly and efficiently generated and provided.

[0204] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0205] Step 1:

[0206] The user uses a smartphone device to enter the necessary information (name, age, hobbies, preferences) into the information input form for creating a picture book and clicks the "Submit" button. This sends the information entered by the user from the device to the server. The input data is transferred to the server in JSON format.

[0207] Step 2:

[0208] The server receives the information sent by the user and parses the JSON format data. The parsed data is recognized as fields for "name," "age," "hobbies," and "preferences." The server selects an appropriate picture book template based on this information. For example, if the hobby is "dinosaurs" and the preference is "adventure," the server selects the "Dinosaur Adventure" template.

[0209] Step 3:

[0210] The server replaces the placeholders (such as {name}, {age}, {hobby}, and {preference}) in the selected template with the user's input data. At this time, the server retrieves illustrations that match the user's preferences from the database and inserts appropriate scenes based on the customized story. For example, the server can reflect the information "Taro" and "age 5" in a "Dinosaur Adventure" scene.

[0211] Step 4:

[0212] The server combines the customized text and illustrations to create a digital picture book. The digital format can be selected from PDF, ePub, or other formats. The combined data undergoes text processing and image synthesis, and is finally output as a single digital file.

[0213] Step 5:

[0214] The generated digital picture book is temporarily stored in the server. The server then generates a download link (URL) for accessing the stored file and provides it to the user. The generated URL is then sent to the user's device so that the user can download the picture book.

[0215] Step 6:

[0216] The device displays a download link and a viewing option for the generated picture book to the user, and the user can download or view the picture book by clicking the link. This allows the user to easily use the customized digital picture book.

[0217] The above processing steps make it possible to quickly and efficiently generate and provide a customized digital picture book based on the user's input information.

[0218] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0219] The present invention is a system that generates a highly customized picture book by combining information input by a user with an emotion engine that recognizes the user's emotions. Specific embodiments will be described below.

[0220] 1. Collecting User Input

[0221] The device displays a form for the user to enter information to create a picture book. The form contains the following fields:

[0222] Child's name

[0223] age

[0224] hobby

[0225] Preferences

[0226] The user enters the required information in each field and clicks the "Submit" button.

[0227] 2. Emotion recognition

[0228] The device uses an emotion engine to recognize the user's emotions in real time. Specifically, it analyzes emotions from the user's facial expressions, voice, or input text. For example, emotions such as "excitement," "excitement," and "anticipation" can be read from the content of the text.

[0229] 3. Select a template

[0230] The server receives and analyzes information collected from the user and the emotion engine. Based on the analyzed data, it selects the most suitable picture book template from multiple templates. For example, if the user likes "dinosaurs" and is looking forward to an "adventure," a template about a dinosaur adventure will be selected.

[0231] 4. Customization

[0232] The server replaces the placeholders in the selected template based on the user's input data and emotions, for example, customized as follows:

[0233] Replace the main character's name with Taro

[0234] Set the protagonist's age to 5

[0235] Add specific scenes based on your interests and preferences (Dinosaur Adventures)

[0236] Set storylines based on perceived emotions (enjoyment, excitement)

[0237] 5. Picture Book Generation

[0238] The server combines customized text and illustrations to generate a digital picture book, which is then output in PDF or ePub format. In particular, the emotional scenes and illustrations are appropriately reflected to better meet user expectations.

[0239] 6. Providing picture books

[0240] The server temporarily stores the generated digital picture book and issues a URL so that users can access it.

[0241] The device displays a download link and viewing options for the generated picture book to the user, who can click the link to download or view the picture book.

[0242] Specific examples

[0243] For example, suppose five-year-old Taro loves dinosaurs and adventures. The user enters "Taro, 5 years old, dinosaur, adventure" into a form on their device and submits it. The emotion engine also reads emotions such as "fun" and "excitement." The server then selects the "Dinosaur Adventure" template and generates a story in which Taro, as an adventurous five-year-old boy, is transported to the world of dinosaurs. Scenes that reflect Taro's fun and excitement are added to this story.

[0244] The server then adds appropriate dinosaur illustrations to the customized story, finally generating a digital picture book, and sends a PDF link to the device, which the user can use to download the book.

[0245] As described above, this system can quickly and efficiently generate and provide customized picture books based on user input information and emotion recognition.

[0246] The processing flow will be explained below.

[0247] Step 1:

[0248] The terminal presents the user with an information entry form containing the following fields:

[0249] Child's name

[0250] age

[0251] hobby

[0252] Preferences

[0253] Step 2:

[0254] The user enters the required information in each field and clicks the "Submit" button. For example, the user enters: Name: Taro, Age: 5, Hobbies: Dinosaurs, Preferences: Adventure.

[0255] Step 3:

[0256] The device sends the information collected from the user to the server as structured data in JSON format or other format.

[0257] Step 4:

[0258] The device uses an emotion engine to recognize the user's emotions in real time. Specifically, emotions are analyzed from the user's facial expressions, voice, or input text. For example, emotions such as "excitement," "excitement," and "anticipation" can be read from the content of the text.

[0259] Step 5:

[0260] The terminal transmits the emotion data analyzed by the emotion engine to the server.

[0261] Step 6:

[0262] The server analyzes the received user information and emotion data to obtain the user's name, age, hobbies, preferences, and emotions.

[0263] Step 7:

[0264] The server selects from among multiple picture book templates the template that best suits the user's hobbies, preferences, and feelings, for example, the "Dinosaur Adventure" template.

[0265] Step 8:

[0266] The server replaces placeholders in the selected template based on the user's input data and emotions, specifically by replacing:

[0267] Replace the main character's name with "Taro"

[0268] Set the protagonist's age to "5 years old"

[0269] Add specific scenes based on your interests and preferences (dinosaur adventure scenes)

[0270] Set storylines based on perceived emotions (enjoyment, excitement)

[0271] Step 9:

[0272] The server retrieves dinosaur illustrations from an illustration database and places them in each scene to add appropriate illustrations to the customized story.

[0273] Step 10:

[0274] The server combines customized text and illustrations to generate a digital picture book, which is then output in formats such as PDF or ePub.

[0275] Step 11:

[0276] The server temporarily stores the generated picture book and issues a URL so that the user can access it.

[0277] Step 12:

[0278] The server sends a download link and viewing options for the generated picture book to the terminal.

[0279] Step 13:

[0280] The device displays a link to the book and a download option to the user.

[0281] Step 14:

[0282] Users can click on the link to download and view the book.

[0283] Example 2

[0284] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0285] Conventional picture book generation systems generate customized picture books based only on information input by the user, and therefore lack an approach that reflects the user's emotions. As a result, it is not possible to generate picture books that reflect the user's emotions and expectations, making it difficult to increase user satisfaction.

[0286] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0287] In this invention, the server includes means for collecting information input by the user, means for recognizing the user's emotions using the collected information and an emotion engine, means for selecting an appropriate picture book template based on the collected information and the recognized emotions, means for customizing the selected template based on the user information and emotion data, means for generating a digital picture book based on the customized content, and means for providing the generated picture book to the user. This makes it possible to generate a customized picture book that reflects the user's input information and emotions and is more in line with the user's expectations and emotions.

[0288] "User-entered information" refers to information such as name, age, hobbies, and preferences that a user provides to the system.

[0289] An "emotion engine" is software or hardware that analyzes and recognizes emotions from a user's facial expressions, voice, and input text.

[0290] A "picture book template" provides the basic elements and story framework of a picture book before customization.

[0291] "Placeholders" are pre-designated parts of a template that are replaced with specific content based on user information and emotional data during customization.

[0292] A "digital picture book" is a picture book whose contents are saved in a digital format such as PDF or ePub.

[0293] "Means of collection" refers to interfaces and programs that incorporate information entered by users into the system.

[0294] The "means for recognition" is a function that uses an emotion engine to analyze the user's emotions and grasp them as specific emotional data.

[0295] The "selection method" is the process of analyzing the collected information and recognized emotion data to determine the most appropriate picture book template.

[0296] "Customization" is the process of replacing placeholders in a selected template with personalized content based on user input and emotional data.

[0297] The "means for providing" refers to a system configuration for providing the generated digital picture book in a form accessible to users.

[0298] The present invention is a system that generates a highly customized picture book by combining information input by a user with an emotion engine that recognizes the user's emotions. Specific embodiments will be described below.

[0299] Collecting User Input

[0300] The terminal displays an information input form for creating a picture book to the user. This form includes fields for the child's name, age, hobbies, and preferences. The user enters the required information in each field and clicks the "Submit" button.

[0301] For example, a user may input and submit information such as Taro, age 5, dinosaur, and adventure.

[0302] emotion recognition

[0303] The device uses an emotion engine to recognize the user's emotions in real time as they input information. The emotion engine analyzes emotions from the user's facial expressions, voice, and input text. For example, it can read emotions such as "excitement," "excitement," and "anticipation."

[0304] Specifically, the device uses a camera and microphone to identify the emotion of "enjoyment" from the user's facial expressions and voice.

[0305] Template Selection

[0306] The server receives and analyzes the input information and emotion data sent by the user via the device. Based on the results of this analysis, the server selects the most suitable picture book template from multiple options.

[0307] For example, if the user likes dinosaurs and is looking for an adventure, the "Dinosaur Adventure" template is selected.

[0308] Customization

[0309] The server replaces placeholders in the selected template based on the user's input data and emotions, resulting in the following customizations:

[0310] Replace the main character's name with Taro

[0311] Set the protagonist's age to 5

[0312] Add specific scenes based on your interests and preferences (Dinosaur Adventures)

[0313] Set storylines based on perceived emotions (enjoyment, excitement)

[0314] For example, the server applies the name "Taro" to the main character of the template and adds a specific scene.

[0315] Picture book generation

[0316] The server generates a digital picture book by combining customized text and illustrations based on the user's input information and emotional data, and outputs the book in PDF or ePub format.

[0317] For example, a picture book file generated by a server may be saved in PDF format.

[0318] Providing picture books

[0319] The server temporarily stores the generated digital picture book and issues a URL that the user can access. The device then displays a download link and viewing options for the generated picture book to the user. The user can click the link to download or view the picture book.

[0320] For example, the terminal may prompt the user to "Click here to download the picture book."

[0321] Specific examples

[0322] For example, suppose five-year-old Taro loves dinosaurs and adventures. The user enters "Taro, 5 years old, dinosaur, adventure" into a form on their device and submits it. The emotion engine also reads emotions such as "fun" and "excitement." The server then selects the "Dinosaur Adventure" template and generates a story in which Taro, as an adventurous five-year-old boy, is transported to the world of dinosaurs. Scenes that reflect Taro's fun and excitement are added to this story.

[0323] Example prompts for generative AI models

[0324] "The user's name is Taro, he's 5 years old, his hobbies are dinosaurs, and he especially likes adventures. He also feels fun and excited. Use this information to generate a customized dinosaur adventure story."

[0325] Through the above process, the system can generate and provide customized picture books that reflect the user's input information and emotions, and are more in line with the user's expectations and emotions.

[0326] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0327] Step 1: Collecting User Input

[0328] The terminal displays an information input form for creating a picture book to the user. This input form includes fields for the child's name, age, hobbies, and preferences. The user enters the required information in these fields and clicks the "Submit" button.

[0329] Input: Child's name, age, hobbies, and preferences

[0330] Output: User-entered information sent as data

[0331] Specific actions: The user enters the information "Taro, 5 years old, dinosaur, adventure" and presses the send button.

[0332] Step 2: Emotion Recognition

[0333] The device uses an emotion engine to recognize the user's emotions in real time as they input information. The emotion engine uses a camera and microphone to analyze the user's facial expressions and voice to generate emotion data.

[0334] Input: Facial expression data, voice data, text input data

[0335] Output: Recognized emotion data

[0336] Specific operation: For example, the device recognizes the emotion of "enjoyment" from the user's facial expression and saves it as data.

[0337] Step 3: Send data

[0338] The terminal transmits the collected user input information and recognized emotion data to the server.

[0339] Input: User input information, emotion data

[0340] Output: Data packet sent to the server

[0341] Specific operation: The device sends input information and emotion data to the server all at once.

[0342] Step 4: Select a template

[0343] The server analyzes the user input information and emotion data received from the terminal and selects the most suitable picture book template.

[0344] Input: User input information, emotion data

[0345] Output: Selected picture book template

[0346] What happens: The server selects the "Dinosaur Adventure" template.

[0347] Step 5: Customization

[0348] The server customizes the placeholders of the selected template based on the user's input information and emotion data, such as the user's name, age, hobbies, preferences, and scenes corresponding to the recognized emotions.

[0349] Input: Selected picture book template, user input information, emotion data

[0350] Output: Customized storybook template

[0351] Specific actions: Set the main character's name to Taro, his age to 5, and add a scene where he goes on an adventure with dinosaurs.

[0352] Step 6: Creating a picture book

[0353] The server combines text and illustrations based on a customized picture book template to generate a digital picture book, which is then saved in PDF or ePub format.

[0354] Input: Customized storybook template

[0355] Output: Digital picture book file (PDF, ePub)

[0356] Specific operation: The picture book file generated by the server is saved in PDF format.

[0357] Step 7: Provide picture books

[0358] The server temporarily stores the generated digital picture book and issues a URL that the user can access. The device then displays a download link and viewing options for the generated picture book to the user. The user can click the link to download or view the picture book.

[0359] Input: Digital picture book file

[0360] Output: User-accessible URL

[0361] Specific behavior: The device displays a link that says "Click here to download the picture book."

[0362] Through these steps, the system generates and provides a customized picture book based on the user's input information and emotional data.

[0363] (Application example 2)

[0364] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0365] In the traditional retail industry, it is difficult to customize customer experiences and there is a lack of means to provide optimal products and promotions based on customer expectations and emotions. This leads to problems such as lower customer satisfaction and difficulty in increasing store sales.

[0366] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting information input by the user, means for analyzing the collected information and the user's emotions, means for selecting optimal product information and promotions based on the analyzed information and emotion data, means for customizing the selected product information and promotions based on the user's input data and emotions, means for generating digital content based on the customized information, and means for providing the generated digital content to the user. This makes it possible to provide product information and promotions customized to individual customers based on their emotions and interests, thereby improving the customer experience.

[0367] "Information entered by the user" refers to personal data such as name, age, hobbies, and preferences that a system user enters during the initial setup or use of the system.

[0368] The "means for analyzing collected information and user emotions" refers to a means that uses technology to analyze emotions from collected data as well as the user's voice, facial expressions, input text, etc.

[0369] "Means for selecting optimal product information and promotions based on analyzed information and emotional data" refers to means for analyzing the information and emotional data input by the user and, based on that, selecting information on products and services that are most suitable for the user.

[0370] "Means for customizing selected product information and promotions based on user input data and emotions" refers to means for adjusting selected product information and promotion content by taking into account the user's individual information and emotional data.

[0371] "Means for generating digital content based on customized information" refers to means for creating digital content (e.g., coupons, promotional videos, etc.) based on tailored product information and promotional content.

[0372] The "means for providing the generated digital content to the user" refers to a means for providing the generated digital content to the user, and the content can be displayed in real time via a smartphone or smart glasses.

[0373] The present invention is a system for customizing the customer experience in a physical store to suit each individual customer. The system uses a smartphone, smart glasses, or a head-mounted display to analyze customer emotions in the store and suggest optimal products and promotions in real time.

[0374] 1. Collecting User Input

[0375] The terminal presents the user with an information entry form containing the following fields:

[0376] name

[0377] age

[0378] hobby

[0379] Preferences

[0380] The user enters the required information in each field and clicks the "Submit" button.

[0381] 2. Emotion recognition

[0382] The device uses emotion recognition software (e.g., OpenCV or TENSORFLOW®) to analyze the user's emotions in real time. Specifically, it captures the user's facial expressions and voice using a camera and microphone installed in the smart glasses or head-mounted display, and analyzes emotions. It also reads emotions from input text.

[0383] 3. Analysis and selection of information

[0384] The server receives the user's input information and emotional data and analyzes them. Based on the analysis results, it selects the most suitable product from among several options. For example, if the user likes "healthy foods" and is "expecting," new health foods and related promotions will be selected.

[0385] 4. Customization

[0386] The server customizes the selected product information and promotions based on the user's input data and emotions, for example:

[0387] Tailor product details to suit your preferences

[0388] Promotion content is set according to user emotions (expectations, excitement)

[0389] 5. Digital Content Creation

[0390] The server generates digital content based on the customized product information and promotions, including appropriate visual materials, coupons, and AR demos.

[0391] 6. Content Provision

[0392] The server temporarily stores the generated digital content and issues a URL for users to access it. The terminal displays customized product information and promotions to customers, and provides immediately available coupons and demo content.

[0393] Specific examples

[0394] For example, a customer in their 30s is looking for health-conscious products. The user enters their name, age, hobbies, and preferences into a form on their device and submits it. The emotion engine also reads their "expectations" and "excitement." The server then selects promotions related to health foods and generates customized information based on the customer's interests and expectations. This information is displayed in real time via a smartphone or smart glasses, and digital coupons and AR demos are also provided.

[0395] Prompt Sentence Examples

[0396] 1. "Please enter your name and age."

[0397] 2. "Tell me about your hobbies and preferences."

[0398] 3. "How are you feeling? (analyzes typed text, facial expressions, and voice)"

[0399] 4. "Here are some products you might like, plus a coupon perfect for how you're feeling right now."

[0400] In this way, the system can quickly and efficiently provide customized product information and promotions based on user input and emotion recognition, improving customer experience.

[0401] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0402] Step 1: Collect user input

[0403] The terminal displays an information input form to the user. This form has input fields for "Name," "Age," "Hobbies," and "Preferences." The user enters information into each field and submits it. The form data is sent to the server in JSON format. The input data includes the user's name, age, hobbies, and preferences. The server receives this data and passes it on to the next processing step.

[0404] Step 2: Emotion Recognition

[0405] The device uses the camera and microphone installed in the smart glasses or head-mounted display to analyze the user's emotions in real time. OpenCV is used for facial expression analysis, and TensorFlow is used for voice emotion analysis. This allows the device to analyze the user's emotions, such as enjoyment, anticipation, and excitement. The analysis results are sent to the server as emotion data. The input is the user's facial image and voice, and the output is the user's emotion data.

[0406] Step 3: Analyze and select information

[0407] The server analyzes the collected user information and emotional data. To do this, it uses a database system (e.g., MySQL (registered trademark)) and integrates it with data based on the user's past purchase history and interests. Based on the analysis results, it selects the most suitable products and promotions from the product information database. The input is user information and emotional data, and the output is the selected product information and promotions.

[0408] Step 4: Customization

[0409] The server customizes the selected product information and promotions based on the user's individual input data and emotions. This process uses a text generation AI model (e.g., GPT-3 (registered trademark)) to create content that best suits the user. Customized promotional text and product information are generated. The input is the selected product information and the user's description, and the output is customized promotional text and product information.

[0410] Step 5: Generate digital content

[0411] The server generates digital content based on the customized information. This content includes adding visual materials using an image generation AI model (e.g., DALL-E) to create content such as coupons and AR demos. The generated content is stored on the server, and a URL is generated for access. The input is customized product information and promotions, and the output is the URL of the digital content.

[0412] Step 6: Provide content

[0413] The terminal provides the user with digital content via a URL received from the server. This content is displayed in real time on a smartphone or smart glasses, allowing the user to experience coupons and AR demos that can be used on the spot. The input is the URL of the digital content, and the output is the digital content displayed to the user.

[0414] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0415] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0416] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0417] [Second embodiment]

[0418] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0419] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0420] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0421] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0422] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0423] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0424] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0425] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0426] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0427] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0428] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0429] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0430] The present invention is a system for generating a customizable picture book based on information input by a user, and is specifically implemented in the following manner.

[0431] 1. Collecting User Input

[0432] The device displays a form for the user to enter information to create a picture book. The form contains the following fields:

[0433] Child's name

[0434] age

[0435] hobby

[0436] Preferences

[0437] The user enters the required information in each field and clicks the "Submit" button.

[0438] 2. Select a template

[0439] The server receives and analyzes the information collected from the user. Based on the analyzed data, it selects the most suitable picture book template from among several available templates. For example, if a user likes "dinosaurs" and "adventures," a template about dinosaur adventures will be selected.

[0440] 3. Customization

[0441] The server replaces the placeholders in the selected template with the user's input data, customized for example as follows:

[0442] Replace the main character's name with Taro.

[0443] Set the age to 5 years old.

[0444] Inserting specific scenes based on interests and preferences (adventures with dinosaurs).

[0445] At this time, the server retrieves appropriate illustrations from the database and places them in each scene of the story.

[0446] 4. Picture Book Generation

[0447] The server combines customized text and illustrations to generate a digital picture book, with output formats such as PDF and ePub.

[0448] 5. Providing picture books

[0449] The server temporarily stores the generated digital picture book and issues an access URL, etc.

[0450] The device displays a download link and viewing options for the generated picture book to the user, who can click the link to download or view the picture book.

[0451] Specific examples

[0452] For example, suppose 5-year-old Taro likes dinosaurs and adventures. The user enters "Taro, 5 years old, dinosaur, adventure" into a form on the device and submits it. The server then selects the "Dinosaur Adventure" template and generates a story in which Taro, an adventurous 5-year-old boy, is transported to the world of dinosaurs.

[0453] The server then adds appropriate dinosaur illustrations to the customized story, finally generating a digital picture book, and sends a PDF link to the device, which the user can use to download the book.

[0454] As described above, this system can quickly and efficiently generate and provide a customized picture book based on the user's input information.

[0455] The processing flow will be explained below.

[0456] Step 1:

[0457] The terminal presents the user with an information entry form containing the following fields:

[0458] Child's name

[0459] age

[0460] hobby

[0461] Preferences

[0462] Step 2:

[0463] The user enters the required information in each field and clicks the "Submit" button. For example, the user enters: Name: Taro, Age: 5, Hobbies: Dinosaurs, Preferences: Adventure.

[0464] Step 3:

[0465] The device sends the information collected from the user to the server as structured data in JSON format or other format.

[0466] Step 4:

[0467] The server analyzes the received user information and obtains data such as name, age, hobbies, and preferences.

[0468] Step 5:

[0469] The server selects the template that best suits the user's interests and preferences from among multiple picture book templates, for example, the "Dinosaur Adventure" template.

[0470] Step 6:

[0471] The server replaces the placeholders in the selected template with the user's input data, specifically replacing:

[0472] Replace the main character's name with "Taro"

[0473] Change the protagonist's age to "5 years old"

[0474] Add specific scenes based on your interests and preferences (dinosaur adventure scenes)

[0475] Step 7:

[0476] The server retrieves dinosaur illustrations from an illustration database and places them in each scene to add appropriate illustrations to the customized story.

[0477] Step 8:

[0478] The server combines customized text and illustrations to generate a digital picture book, which is then output in formats such as PDF or ePub.

[0479] Step 9:

[0480] The server temporarily stores the generated picture book and issues a URL so that the user can access it.

[0481] Step 10:

[0482] The server sends a download link and viewing options for the generated picture book to the terminal.

[0483] Step 11:

[0484] The device displays a link to the book and a download option to the user.

[0485] Step 12:

[0486] Users can click on the link to download and view the book.

[0487] Example 1

[0488] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0489] Conventional picture book generation systems have had difficulty efficiently generating customized content based on user-entered information and providing it immediately. It was also time-consuming to combine appropriate illustrations for a customized picture book. As a result, it was difficult to quickly generate a high-quality, personalized picture book based on user-entered information.

[0490] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0491] In this invention, the server includes means for collecting information input by a user, means for selecting an appropriate template based on the collected information, means for customizing the selected template based on the user information, means for generating a digital e-book based on the customized content, and means for providing the generated e-book to the user. This makes it possible to quickly generate a personalized picture book efficiently based on the information input by the user and combine appropriate images with the picture book.

[0492] "Means for collecting information entered by users" refers to the function of providing a form or interface for users to enter information such as their name, age, hobbies, and preferences, and sending that information to the server.

[0493] The "means for selecting an appropriate template based on collected information" is a function for analyzing collected user data and selecting the template that is most suitable for that data.

[0494] The "means for customizing a selected template based on user information" is a function for replacing placeholders in a selected template with data input by a user to generate individually customized content.

[0495] "Means for generating digital e-books based on customized content" refers to the ability to combine customized text and images and convert them into a digital format such as a PDF or e-book file (e.g., ePub).

[0496] The "means of providing the generated e-book to the user" refers to a function that temporarily stores the generated digital e-book on a server, issues a URL that the user can access, and allows the e-book to be downloaded or viewed via that link.

[0497] "Information" is a general term for personal data such as name, age, hobbies, and preferences entered by the user.

[0498] A "template" is a reusable format that represents the framework and structure of a basic picture book that is customized based on user information.

[0499] "Customized content" refers to the text and images in the template after the placeholders have been replaced with information entered by the user.

[0500] "Digital format" means a format that can be displayed and saved on a computer or electronic device, such as a PDF or e-book file (e.g., ePub).

[0501] An "e-book" is a book or document provided in digital format and can be viewed on a computer or dedicated e-book reader.

[0502] The present invention is a system for generating a customizable electronic book based on information input by a user, and is implemented in the following manner.

[0503] Collecting User Input

[0504] The device displays a form for the user to input information for creating a picture book via a web page or application. The form contains the following fields:

[0505] Child's name

[0506] age

[0507] hobby

[0508] Preferences

[0509] The user enters the required information into each field and clicks the "Submit" button, which is collected via JavaScript and sent to the server as an HTTP POST request.

[0510] Template Selection

[0511] The server receives the user data sent from the device. Typically, this is sent as an HTTP POST request. The server analyzes the received data and selects the picture book template that best suits the data. This analysis is done using a scripting language such as Python or Ruby. For example, if the user likes "dinosaurs" and "adventures," a template about dinosaur adventures will be selected.

[0512] Customization

[0513] The server then replaces the placeholders in the selected template with the user's input data, using a template engine (e.g. Jinja2), customized for example as follows:

[0514] Replace the main character's name with Taro.

[0515] Set the age to 5 years old.

[0516] Inserting specific scenes based on interests and preferences (adventures with dinosaurs).

[0517] The server also retrieves appropriate illustrations from a database and places them in each scene of the story. This database is accessed using SQL queries.

[0518] E-book generation

[0519] Customized text and illustrations are combined to generate a digital e-book. This process is performed using a PDF generation library (e.g., ReportLab) or an e-book creation tool (e.g., Calibre). Output formats include PDF and e-book files (ePub).

[0520] Providing e-books

[0521] The generated digital e-book is temporarily stored on a server, and an access URL is issued. This URL is provided as a download link that the user can access. The device displays this download link and viewing options to the user. The user can click the link to download or view the e-book.

[0522] Specific examples

[0523] For example, 5-year-old Taro likes dinosaurs and adventures. The user enters "Taro, 5 years old, dinosaurs, adventure" into a form on their device and submits it. The server then selects the "Dinosaur Adventure" template and generates a story in which Taro, an adventurous 5-year-old boy, is transported to the world of dinosaurs. The server then adds appropriate dinosaur illustrations to the customized story and finally generates a digital e-book. The server then sends the generated PDF link to the device, which the user can use to download the e-book. An example of a prompt is "Please generate a story in which 5-year-old Taro goes on an adventure in the world of dinosaurs." When this prompt is input into the generative AI model, it is expected that the text of a customized picture book will be generated.

[0524] As described above, this system can quickly and efficiently generate and provide a customized electronic book based on user input information.

[0525] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0526] Step 1:

[0527] Collecting User Input

[0528] Specific operation: The device displays an information input form for creating a picture book to the user through a web page or application built using HTML and JavaScript. The form includes fields such as "child's name," "age," "hobbies," and "preferences."

[0529] Input: The user enters "Taro," "5 years old," "dinosaur," and "adventure" into an input form.

[0530] Output: When the user clicks the "Submit" button, this data is collected via JavaScript and sent to the server as an HTTP POST request.

[0531] Step 2:

[0532] Data reception and analysis

[0533] Specific operation: The server receives the HTTP POST request sent from the device and analyzes the user data contained therein ("Taro," "5 years old," "dinosaur," and "adventure"). The analysis is performed using a scripting language such as Python or Ruby.

[0534] Input: User data sent from the device.

[0535] Output: Based on the parsed user data, an appropriate storybook template (e.g., the "Dinosaur Adventure" template) is selected.

[0536] Step 3:

[0537] Customizing the template

[0538] Specific behavior: The server creates a placeholder ( <name>or <age>) with user-supplied data. This is done using a template engine (e.g., Jinja2), and then using SQL queries to retrieve the appropriate illustrations from a database and place them in each scene of the story.

[0539] Input: Selected template and user data.

[0540] Output: A customized story with the name "Taro" and age "5 years old" with scenes inserted based on hobbies and preferences.

[0541] Step 4:

[0542] Generate digital e-books

[0543] What it does: The server generates a digital e-book by combining customized text and illustrations, using a PDF generation library (e.g., ReportLab) and an e-book creation tool (e.g., Calibre).

[0544] Input: Customized text and retrieved illustrations.

[0545] Output: Digital eBook in PDF or ePub format as selected as output format.

[0546] Step 5:

[0547] Providing e-books

[0548] Specific operation: The server temporarily stores the generated digital e-book and generates an access URL. This URL is provided as a download link that the user can access. The device displays this download link and viewing options to the user.

[0549] Input: The generated digital e-book.

[0550] Output: A download link and / or viewing options that users can access. Users can click the link to download or view the eBook.

[0551] (Application example 1)

[0552] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0553] Conventional picture book generation systems were able to generate customized picture books based on user input, but the methods for providing the generated picture books were limited, making it difficult for users to access and download them smoothly.In addition, the management and distribution methods for the generated picture books were complicated, which could result in a poor user experience.

[0554] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0555] In this invention, the server includes means for collecting information input by a user, means for selecting an appropriate picture book template based on the collected information, means for customizing the selected template based on the user information, means for generating a digital picture book based on the customized content, means for providing the generated picture book to the user, and means for issuing a download link for distributing the customized picture book, thereby enabling the user to easily download and view the generated picture book.

[0556] "Information entered by the user" refers to data such as name, age, hobbies, and preferences that the user provides in the picture book creation system.

[0557] "Means for collection" refers to a function or device that acquires information entered by the user and stores it in the system.

[0558] The "means for selecting an appropriate picture book template" is an algorithm or device that automatically selects the most appropriate picture book template based on collected user information.

[0559] A "means for customizing a template" is a function or device that replaces placeholders in a selected template with user-entered information.

[0560] A "means for generating a digital picture book" is an algorithm or device that combines customized text and illustrations to ultimately generate a picture book as digital data.

[0561] The "means for providing the generated picture book to the user" refers to a function or device that provides the generated digital picture book in a form that is accessible to the user.

[0562] The "means for issuing a download link" is a function or device that generates and provides a URL link that allows a user to download the generated digital picture book.

[0563] An "illustration combination tool" is an algorithm or device that selects and arranges appropriate image data to fit a customized story.

[0564] The present invention is a system for generating a customizable picture book based on information input by a user, and specific embodiments for implementing this system are described below.

[0565] Hardware and software used

[0566] Hardware:

[0567] Smartphone (device for users to input data)

[0568] Server (a computer for analyzing data and creating picture books)

[0569] software:

[0570] Flask (a Python-based web framework)

[0571] JSON (data storage and exchange format)

[0572] System processing flow

[0573] 1. Collecting User Input

[0574] The user uses a smartphone to enter information into a form to create a picture book. The form contains the following fields:

[0575] Child's name

[0576] age

[0577] hobby

[0578] Preferences

[0579] The user enters the required information in each field and clicks the "Submit" button.

[0580] 2. Select a template

[0581] The server receives and analyzes the information collected from the user. Based on the analyzed data, it selects the most suitable picture book template. For example, if the user likes dinosaurs and adventures, a template about dinosaur adventures will be selected.

[0582] 3. Customization

[0583] The server replaces the placeholders in the selected template with the user's input data, customized as follows:

[0584] Replace the protagonist's name with the name entered by the user (e.g., "Taro").

[0585] Set the age to the entered age (e.g., "5 years old").

[0586] Inserting specific scenes based on interests and preferences (adventures with dinosaurs).

[0587] At this time, the server retrieves appropriate illustrations from a database and places them in each scene of the story.

[0588] 4. Picture Book Generation

[0589] The server combines the customized text and illustrations to generate a digital picture book, which is output in formats such as PDF or ePub.

[0590] 5. Providing picture books

[0591] The server temporarily stores the generated digital picture book and issues an access URL. The smartphone device displays a download link and viewing options for the generated picture book to the user. The user can click the link to download or view the picture book.

[0592] Specific examples

[0593] For example, suppose 5-year-old Taro likes dinosaurs and adventures. The user enters "Taro, 5 years old, dinosaur, adventure" into a form on the device and submits it. The server then selects the "Dinosaur Adventure" template and generates a story in which "Taro, as an adventurous 5-year-old boy, is transported to the world of dinosaurs." The server adds appropriate dinosaur illustrations to the customized story, and finally generates a digital picture book. The server sends the generated PDF link to the device, and the user can use the link to download the picture book.

[0594] Prompt Sentence Examples

[0595] Taro, 5 years old, dinosaur, adventure

[0596] As described above, a picture book customized based on user input information can be quickly and efficiently generated and provided.

[0597] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0598] Step 1:

[0599] The user uses a smartphone device to enter the necessary information (name, age, hobbies, preferences) into the information input form for creating a picture book and clicks the "Submit" button. This sends the information entered by the user from the device to the server. The input data is transferred to the server in JSON format.

[0600] Step 2:

[0601] The server receives the information sent by the user and parses the JSON format data. The parsed data is recognized as fields for "name," "age," "hobbies," and "preferences." The server selects an appropriate picture book template based on this information. For example, if the hobby is "dinosaurs" and the preference is "adventure," the server selects the "Dinosaur Adventure" template.

[0602] Step 3:

[0603] The server replaces the placeholders (such as {name}, {age}, {hobby}, and {preference}) in the selected template with the user's input data. At this time, the server retrieves illustrations that match the user's preferences from the database and inserts appropriate scenes based on the customized story. For example, the server can reflect the information "Taro" and "age 5" in a "Dinosaur Adventure" scene.

[0604] Step 4:

[0605] The server combines the customized text and illustrations to create a digital picture book. The digital format can be selected from PDF, ePub, or other formats. The combined data undergoes text processing and image synthesis, and is finally output as a single digital file.

[0606] Step 5:

[0607] The generated digital picture book is temporarily stored in the server. The server then generates a download link (URL) for accessing the stored file and provides it to the user. The generated URL is then sent to the user's device so that the user can download the picture book.

[0608] Step 6:

[0609] The device displays a download link and a viewing option for the generated picture book to the user, and the user can download or view the picture book by clicking the link. This allows the user to easily use the customized digital picture book.

[0610] The above processing steps make it possible to quickly and efficiently generate and provide a customized digital picture book based on the user's input information.

[0611] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0612] The present invention is a system that generates a highly customized picture book by combining information input by a user with an emotion engine that recognizes the user's emotions. Specific embodiments will be described below.

[0613] 1. Collecting User Input

[0614] The device displays a form for the user to enter information to create a picture book. The form contains the following fields:

[0615] Child's name

[0616] age

[0617] hobby

[0618] Preferences

[0619] The user enters the required information in each field and clicks the "Submit" button.

[0620] 2. Emotion recognition

[0621] The device uses an emotion engine to recognize the user's emotions in real time. Specifically, it analyzes emotions from the user's facial expressions, voice, or input text. For example, emotions such as "excitement," "excitement," and "anticipation" can be read from the content of the text.

[0622] 3. Select a template

[0623] The server receives and analyzes information collected from the user and the emotion engine. Based on the analyzed data, it selects the most suitable picture book template from multiple templates. For example, if the user likes "dinosaurs" and is looking forward to an "adventure," a template about a dinosaur adventure will be selected.

[0624] 4. Customization

[0625] The server replaces the placeholders in the selected template based on the user's input data and emotions, for example, customized as follows:

[0626] Replace the main character's name with Taro

[0627] Set the protagonist's age to 5

[0628] Add specific scenes based on your interests and preferences (Dinosaur Adventures)

[0629] Set storylines based on perceived emotions (enjoyment, excitement)

[0630] 5. Picture Book Generation

[0631] The server combines customized text and illustrations to generate a digital picture book, which is then output in PDF or ePub format. In particular, the emotional scenes and illustrations are appropriately reflected to better meet user expectations.

[0632] 6. Providing picture books

[0633] The server temporarily stores the generated digital picture book and issues a URL so that users can access it.

[0634] The device displays a download link and viewing options for the generated picture book to the user, who can click the link to download or view the picture book.

[0635] Specific examples

[0636] For example, suppose five-year-old Taro loves dinosaurs and adventures. The user enters "Taro, 5 years old, dinosaur, adventure" into a form on their device and submits it. The emotion engine also reads emotions such as "fun" and "excitement." The server then selects the "Dinosaur Adventure" template and generates a story in which Taro, as an adventurous five-year-old boy, is transported to the world of dinosaurs. Scenes that reflect Taro's fun and excitement are added to this story.

[0637] The server then adds appropriate dinosaur illustrations to the customized story, finally generating a digital picture book, and sends a PDF link to the device, which the user can use to download the book.

[0638] As described above, this system can quickly and efficiently generate and provide customized picture books based on user input information and emotion recognition.

[0639] The processing flow will be explained below.

[0640] Step 1:

[0641] The terminal presents the user with an information entry form containing the following fields:

[0642] Child's name

[0643] age

[0644] hobby

[0645] Preferences

[0646] Step 2:

[0647] The user enters the required information in each field and clicks the "Submit" button. For example, the user enters: Name: Taro, Age: 5, Hobbies: Dinosaurs, Preferences: Adventure.

[0648] Step 3:

[0649] The device sends the information collected from the user to the server as structured data in JSON format or other format.

[0650] Step 4:

[0651] The device uses an emotion engine to recognize the user's emotions in real time. Specifically, emotions are analyzed from the user's facial expressions, voice, or input text. For example, emotions such as "excitement," "excitement," and "anticipation" can be read from the content of the text.

[0652] Step 5:

[0653] The terminal transmits the emotion data analyzed by the emotion engine to the server.

[0654] Step 6:

[0655] The server analyzes the received user information and emotion data to obtain the user's name, age, hobbies, preferences, and emotions.

[0656] Step 7:

[0657] The server selects from among multiple picture book templates the template that best suits the user's hobbies, preferences, and feelings, for example, the "Dinosaur Adventure" template.

[0658] Step 8:

[0659] The server replaces placeholders in the selected template based on the user's input data and emotions, specifically by replacing:

[0660] Replace the main character's name with "Taro"

[0661] Set the protagonist's age to "5 years old"

[0662] Add specific scenes based on your interests and preferences (dinosaur adventure scenes)

[0663] Set storylines based on perceived emotions (enjoyment, excitement)

[0664] Step 9:

[0665] The server retrieves dinosaur illustrations from an illustration database and places them in each scene to add appropriate illustrations to the customized story.

[0666] Step 10:

[0667] The server combines customized text and illustrations to generate a digital picture book, which is then output in formats such as PDF or ePub.

[0668] Step 11:

[0669] The server temporarily stores the generated picture book and issues a URL so that the user can access it.

[0670] Step 12:

[0671] The server sends a download link and viewing options for the generated picture book to the terminal.

[0672] Step 13:

[0673] The device displays a link to the book and a download option to the user.

[0674] Step 14:

[0675] Users can click on the link to download and view the book.

[0676] Example 2

[0677] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0678] Conventional picture book generation systems generate customized picture books based only on information input by the user, and therefore lack an approach that reflects the user's emotions. As a result, it is not possible to generate picture books that reflect the user's emotions and expectations, making it difficult to increase user satisfaction.

[0679] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0680] In this invention, the server includes means for collecting information input by the user, means for recognizing the user's emotions using the collected information and an emotion engine, means for selecting an appropriate picture book template based on the collected information and the recognized emotions, means for customizing the selected template based on the user information and emotion data, means for generating a digital picture book based on the customized content, and means for providing the generated picture book to the user. This makes it possible to generate a customized picture book that reflects the user's input information and emotions and is more in line with the user's expectations and emotions.

[0681] "User-entered information" refers to information such as name, age, hobbies, and preferences that a user provides to the system.

[0682] An "emotion engine" is software or hardware that analyzes and recognizes emotions from a user's facial expressions, voice, and input text.

[0683] A "picture book template" provides the basic elements and story framework of a picture book before customization.

[0684] "Placeholders" are pre-designated parts of a template that are replaced with specific content based on user information and emotional data during customization.

[0685] A "digital picture book" is a picture book whose contents are saved in a digital format such as PDF or ePub.

[0686] "Means of collection" refers to interfaces and programs that incorporate information entered by users into the system.

[0687] The "means for recognition" is a function that uses an emotion engine to analyze the user's emotions and grasp them as specific emotional data.

[0688] The "selection method" is the process of analyzing the collected information and recognized emotion data to determine the most appropriate picture book template.

[0689] "Customization" is the process of replacing placeholders in a selected template with personalized content based on user input and emotional data.

[0690] The "means for providing" refers to a system configuration for providing the generated digital picture book in a form accessible to users.

[0691] The present invention is a system that generates a highly customized picture book by combining information input by a user with an emotion engine that recognizes the user's emotions. Specific embodiments will be described below.

[0692] Collecting User Input

[0693] The terminal displays an information input form for creating a picture book to the user. This form includes fields for the child's name, age, hobbies, and preferences. The user enters the required information in each field and clicks the "Submit" button.

[0694] For example, a user may input and submit information such as Taro, age 5, dinosaur, and adventure.

[0695] emotion recognition

[0696] The device uses an emotion engine to recognize the user's emotions in real time as they input information. The emotion engine analyzes emotions from the user's facial expressions, voice, and input text. For example, it can read emotions such as "excitement," "excitement," and "anticipation."

[0697] Specifically, the device uses a camera and microphone to identify the emotion of "enjoyment" from the user's facial expressions and voice.

[0698] Template Selection

[0699] The server receives and analyzes the input information and emotion data sent by the user via the device. Based on the results of this analysis, the server selects the most suitable picture book template from multiple options.

[0700] For example, if the user likes dinosaurs and is looking for an adventure, the "Dinosaur Adventure" template is selected.

[0701] Customization

[0702] The server replaces placeholders in the selected template based on the user's input data and emotions, resulting in the following customizations:

[0703] Replace the main character's name with Taro

[0704] Set the protagonist's age to 5

[0705] Add specific scenes based on your interests and preferences (Dinosaur Adventures)

[0706] Set storylines based on perceived emotions (enjoyment, excitement)

[0707] For example, the server applies the name "Taro" to the main character of the template and adds a specific scene.

[0708] Picture book generation

[0709] The server generates a digital picture book by combining customized text and illustrations based on the user's input information and emotional data, and outputs the book in PDF or ePub format.

[0710] For example, a picture book file generated by a server may be saved in PDF format.

[0711] Providing picture books

[0712] The server temporarily stores the generated digital picture book and issues a URL that the user can access. The device then displays a download link and viewing options for the generated picture book to the user. The user can click the link to download or view the picture book.

[0713] For example, the terminal may prompt the user to "Click here to download the picture book."

[0714] Specific examples

[0715] For example, suppose five-year-old Taro loves dinosaurs and adventures. The user enters "Taro, 5 years old, dinosaur, adventure" into a form on their device and submits it. The emotion engine also reads emotions such as "fun" and "excitement." The server then selects the "Dinosaur Adventure" template and generates a story in which Taro, as an adventurous five-year-old boy, is transported to the world of dinosaurs. Scenes that reflect Taro's fun and excitement are added to this story.

[0716] Example prompts for generative AI models

[0717] "The user's name is Taro, he's 5 years old, his hobbies are dinosaurs, and he especially likes adventures. He also feels fun and excited. Use this information to generate a customized dinosaur adventure story."

[0718] Through the above process, the system can generate and provide customized picture books that reflect the user's input information and emotions, and are more in line with the user's expectations and emotions.

[0719] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0720] Step 1: Collecting User Input

[0721] The terminal displays an information input form for creating a picture book to the user. This input form includes fields for the child's name, age, hobbies, and preferences. The user enters the required information in these fields and clicks the "Submit" button.

[0722] Input: Child's name, age, hobbies, and preferences

[0723] Output: User-entered information sent as data

[0724] Specific actions: The user enters the information "Taro, 5 years old, dinosaur, adventure" and presses the send button.

[0725] Step 2: Emotion Recognition

[0726] The device uses an emotion engine to recognize the user's emotions in real time as they input information. The emotion engine uses a camera and microphone to analyze the user's facial expressions and voice to generate emotion data.

[0727] Input: Facial expression data, voice data, text input data

[0728] Output: Recognized emotion data

[0729] Specific operation: For example, the device recognizes the emotion of "enjoyment" from the user's facial expression and saves it as data.

[0730] Step 3: Send data

[0731] The terminal transmits the collected user input information and recognized emotion data to the server.

[0732] Input: User input information, emotion data

[0733] Output: Data packet sent to the server

[0734] Specific operation: The device sends input information and emotion data to the server all at once.

[0735] Step 4: Select a template

[0736] The server analyzes the user input information and emotion data received from the terminal and selects the most suitable picture book template.

[0737] Input: User input information, emotion data

[0738] Output: Selected picture book template

[0739] What happens: The server selects the "Dinosaur Adventure" template.

[0740] Step 5: Customization

[0741] The server customizes the placeholders of the selected template based on the user's input information and emotion data, such as the user's name, age, hobbies, preferences, and scenes corresponding to the recognized emotions.

[0742] Input: Selected picture book template, user input information, emotion data

[0743] Output: Customized storybook template

[0744] Specific actions: Set the main character's name to Taro, his age to 5, and add a scene where he goes on an adventure with dinosaurs.

[0745] Step 6: Creating a picture book

[0746] The server combines text and illustrations based on a customized picture book template to generate a digital picture book, which is then saved in PDF or ePub format.

[0747] Input: Customized storybook template

[0748] Output: Digital picture book file (PDF, ePub)

[0749] Specific operation: The picture book file generated by the server is saved in PDF format.

[0750] Step 7: Provide picture books

[0751] The server temporarily stores the generated digital picture book and issues a URL that the user can access. The device then displays a download link and viewing options for the generated picture book to the user. The user can click the link to download or view the picture book.

[0752] Input: Digital picture book file

[0753] Output: User-accessible URL

[0754] Specific behavior: The device displays a link that says "Click here to download the picture book."

[0755] Through these steps, the system generates and provides a customized picture book based on the user's input information and emotional data.

[0756] (Application example 2)

[0757] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0758] In the traditional retail industry, it is difficult to customize customer experiences and there is a lack of means to provide optimal products and promotions based on customer expectations and emotions. This leads to problems such as lower customer satisfaction and difficulty in increasing store sales.

[0759] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting information input by the user, means for analyzing the collected information and the user's emotions, means for selecting optimal product information and promotions based on the analyzed information and emotion data, means for customizing the selected product information and promotions based on the user's input data and emotions, means for generating digital content based on the customized information, and means for providing the generated digital content to the user. This makes it possible to provide product information and promotions customized to individual customers based on their emotions and interests, thereby improving the customer experience.

[0760] "Information entered by the user" refers to personal data such as name, age, hobbies, and preferences that a system user enters during the initial setup or use of the system.

[0761] The "means for analyzing collected information and user emotions" refers to a means that uses technology to analyze emotions from collected data as well as the user's voice, facial expressions, input text, etc.

[0762] "Means for selecting optimal product information and promotions based on analyzed information and emotional data" refers to means for analyzing the information and emotional data input by the user and, based on that, selecting information on products and services that are most suitable for the user.

[0763] "Means for customizing selected product information and promotions based on user input data and emotions" refers to means for adjusting selected product information and promotion content by taking into account the user's individual information and emotional data.

[0764] "Means for generating digital content based on customized information" refers to means for creating digital content (e.g., coupons, promotional videos, etc.) based on tailored product information and promotional content.

[0765] The "means for providing the generated digital content to the user" refers to a means for providing the generated digital content to the user, and the content can be displayed in real time via a smartphone or smart glasses.

[0766] The present invention is a system for customizing the customer experience in a physical store to suit each individual customer. The system uses a smartphone, smart glasses, or a head-mounted display to analyze customer emotions in the store and suggest optimal products and promotions in real time.

[0767] 1. Collecting User Input

[0768] The terminal presents the user with an information entry form containing the following fields:

[0769] name

[0770] age

[0771] hobby

[0772] Preferences

[0773] The user enters the required information in each field and clicks the "Submit" button.

[0774] 2. Emotion recognition

[0775] The device uses emotion recognition software (e.g., OpenCV or TensorFlow) to analyze the user's emotions in real time. Specifically, it captures the user's facial expressions and voice using a camera and microphone installed in the smart glasses or head-mounted display, and analyzes emotions from the user's voice. It can also read emotions from input text.

[0776] 3. Analysis and selection of information

[0777] The server receives the user's input information and emotional data and analyzes them. Based on the analysis results, it selects the most suitable product from among several options. For example, if the user likes "healthy foods" and is "expecting," new health foods and related promotions will be selected.

[0778] 4. Customization

[0779] The server customizes the selected product information and promotions based on the user's input data and emotions, for example:

[0780] Tailor product details to suit your preferences

[0781] Promotion content is set according to user emotions (expectations, excitement)

[0782] 5. Digital Content Creation

[0783] The server generates digital content based on the customized product information and promotions, including appropriate visual materials, coupons, and AR demos.

[0784] 6. Content Provision

[0785] The server temporarily stores the generated digital content and issues a URL for users to access it. The terminal displays customized product information and promotions to customers, and provides immediately available coupons and demo content.

[0786] Specific examples

[0787] For example, a customer in their 30s is looking for health-conscious products. The user enters their name, age, hobbies, and preferences into a form on their device and submits it. The emotion engine also reads their "expectations" and "excitement." The server then selects promotions related to health foods and generates customized information based on the customer's interests and expectations. This information is displayed in real time via a smartphone or smart glasses, and digital coupons and AR demos are also provided.

[0788] Prompt Sentence Examples

[0789] 1. "Please enter your name and age."

[0790] 2. "Tell me about your hobbies and preferences."

[0791] 3. "How are you feeling? (analyzes typed text, facial expressions, and voice)"

[0792] 4. "Here are some products you might like, plus a coupon perfect for how you're feeling right now."

[0793] In this way, the system can quickly and efficiently provide customized product information and promotions based on user input and emotion recognition, improving customer experience.

[0794] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0795] Step 1: Collect user input

[0796] The terminal displays an information input form to the user. This form has input fields for "Name," "Age," "Hobbies," and "Preferences." The user enters information into each field and submits it. The form data is sent to the server in JSON format. The input data includes the user's name, age, hobbies, and preferences. The server receives this data and passes it on to the next processing step.

[0797] Step 2: Emotion Recognition

[0798] The device uses the camera and microphone installed in the smart glasses or head-mounted display to analyze the user's emotions in real time. OpenCV is used for facial expression analysis, and TensorFlow is used for voice emotion analysis. This allows the device to analyze the user's emotions, such as enjoyment, anticipation, and excitement. The analysis results are sent to the server as emotion data. The input is the user's facial image and voice, and the output is the user's emotion data.

[0799] Step 3: Analyze and select information

[0800] The server analyzes the collected user information and emotional data. To do this, it uses a database system (e.g., MySQL) and integrates it with data based on the user's past purchase history and interests. Based on the analysis results, it selects the most suitable products and promotions from a product information database. The input is user information and emotional data, and the output is the selected product information and promotions.

[0801] Step 4: Customization

[0802] The server customizes the selected product information and promotions based on the user's individual input data and emotions. This process uses a text generation AI model (e.g., GPT-3) to create content that best suits the user. Customized promotional text and product information are generated. The input is the selected product information and the user's description, and the output is customized promotional text and product information.

[0803] Step 5: Generate digital content

[0804] The server generates digital content based on the customized information. This content includes adding visual materials using an image generation AI model (e.g., DALL-E) to create content such as coupons and AR demos. The generated content is stored on the server, and a URL is generated for access. The input is customized product information and promotions, and the output is the URL of the digital content.

[0805] Step 6: Provide content

[0806] The terminal provides the user with digital content via a URL received from the server. This content is displayed in real time on a smartphone or smart glasses, allowing the user to experience coupons and AR demos that can be used on the spot. The input is the URL of the digital content, and the output is the digital content displayed to the user.

[0807] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0808] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0809] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0810] [Third embodiment]

[0811] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0812] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0813] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0814] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0815] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0816] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0817] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0818] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0819] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0820] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0821] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0822] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0823] The present invention is a system for generating a customizable picture book based on information input by a user, and is specifically implemented in the following manner.

[0824] 1. Collecting User Input

[0825] The device displays a form for the user to enter information to create a picture book. The form contains the following fields:

[0826] Child's name

[0827] age

[0828] hobby

[0829] Preferences

[0830] The user enters the required information in each field and clicks the "Submit" button.

[0831] 2. Select a template

[0832] The server receives and analyzes the information collected from the user. Based on the analyzed data, it selects the most suitable picture book template from among several available templates. For example, if a user likes "dinosaurs" and "adventures," a template about dinosaur adventures will be selected.

[0833] 3. Customization

[0834] The server replaces the placeholders in the selected template with the user's input data, customized for example as follows:

[0835] Replace the main character's name with Taro.

[0836] Set the age to 5 years old.

[0837] Inserting specific scenes based on interests and preferences (adventures with dinosaurs).

[0838] At this time, the server retrieves appropriate illustrations from the database and places them in each scene of the story.

[0839] 4. Picture Book Generation

[0840] The server combines customized text and illustrations to generate a digital picture book, with output formats such as PDF and ePub.

[0841] 5. Providing picture books

[0842] The server temporarily stores the generated digital picture book and issues an access URL, etc.

[0843] The device displays a download link and viewing options for the generated picture book to the user, who can click the link to download or view the picture book.

[0844] Specific examples

[0845] For example, suppose 5-year-old Taro likes dinosaurs and adventures. The user enters "Taro, 5 years old, dinosaur, adventure" into a form on the device and submits it. The server then selects the "Dinosaur Adventure" template and generates a story in which Taro, an adventurous 5-year-old boy, is transported to the world of dinosaurs.

[0846] The server then adds appropriate dinosaur illustrations to the customized story, finally generating a digital picture book, and sends a PDF link to the device, which the user can use to download the book.

[0847] As described above, this system can quickly and efficiently generate and provide a customized picture book based on the user's input information.

[0848] The processing flow will be explained below.

[0849] Step 1:

[0850] The terminal presents the user with an information entry form containing the following fields:

[0851] Child's name

[0852] age

[0853] hobby

[0854] Preferences

[0855] Step 2:

[0856] The user enters the required information in each field and clicks the "Submit" button. For example, the user enters: Name: Taro, Age: 5, Hobbies: Dinosaurs, Preferences: Adventure.

[0857] Step 3:

[0858] The device sends the information collected from the user to the server as structured data in JSON format or other format.

[0859] Step 4:

[0860] The server analyzes the received user information and obtains data such as name, age, hobbies, and preferences.

[0861] Step 5:

[0862] The server selects the template that best suits the user's interests and preferences from among multiple picture book templates, for example, the "Dinosaur Adventure" template.

[0863] Step 6:

[0864] The server replaces the placeholders in the selected template with the user's input data, specifically replacing:

[0865] Replace the main character's name with "Taro"

[0866] Change the protagonist's age to "5 years old"

[0867] Add specific scenes based on your interests and preferences (dinosaur adventure scenes)

[0868] Step 7:

[0869] The server retrieves dinosaur illustrations from an illustration database and places them in each scene to add appropriate illustrations to the customized story.

[0870] Step 8:

[0871] The server combines customized text and illustrations to generate a digital picture book, which is then output in formats such as PDF or ePub.

[0872] Step 9:

[0873] The server temporarily stores the generated picture book and issues a URL so that the user can access it.

[0874] Step 10:

[0875] The server sends a download link and viewing options for the generated picture book to the terminal.

[0876] Step 11:

[0877] The device displays a link to the book and a download option to the user.

[0878] Step 12:

[0879] Users can click on the link to download and view the book.

[0880] Example 1

[0881] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0882] Conventional picture book generation systems have had difficulty efficiently generating customized content based on user-entered information and providing it immediately. It was also time-consuming to combine appropriate illustrations for a customized picture book. As a result, it was difficult to quickly generate a high-quality, personalized picture book based on user-entered information.

[0883] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0884] In this invention, the server includes means for collecting information input by a user, means for selecting an appropriate template based on the collected information, means for customizing the selected template based on the user information, means for generating a digital e-book based on the customized content, and means for providing the generated e-book to the user. This makes it possible to quickly generate a personalized picture book efficiently based on the information input by the user and combine appropriate images with the picture book.

[0885] "Means for collecting information entered by users" refers to the function of providing a form or interface for users to enter information such as their name, age, hobbies, and preferences, and sending that information to the server.

[0886] The "means for selecting an appropriate template based on collected information" is a function for analyzing collected user data and selecting the template that is most suitable for that data.

[0887] The "means for customizing a selected template based on user information" is a function for replacing placeholders in a selected template with data input by a user to generate individually customized content.

[0888] "Means for generating digital e-books based on customized content" refers to the ability to combine customized text and images and convert them into a digital format such as a PDF or e-book file (e.g., ePub).

[0889] The "means of providing the generated e-book to the user" refers to a function that temporarily stores the generated digital e-book on a server, issues a URL that the user can access, and allows the e-book to be downloaded or viewed via that link.

[0890] "Information" is a general term for personal data such as name, age, hobbies, and preferences entered by the user.

[0891] A "template" is a reusable format that represents the framework and structure of a basic picture book that is customized based on user information.

[0892] "Customized content" refers to the text and images in the template after the placeholders have been replaced with information entered by the user.

[0893] "Digital format" means a format that can be displayed and saved on a computer or electronic device, such as a PDF or e-book file (e.g., ePub).

[0894] An "e-book" is a book or document provided in digital format and can be viewed on a computer or dedicated e-book reader.

[0895] The present invention is a system for generating a customizable electronic book based on information input by a user, and is implemented in the following manner.

[0896] Collecting User Input

[0897] The device displays a form for the user to input information for creating a picture book via a web page or application. The form contains the following fields:

[0898] Child's name

[0899] age

[0900] hobby

[0901] Preferences

[0902] The user enters the required information into each field and clicks the "Submit" button, which is collected via JavaScript and sent to the server as an HTTP POST request.

[0903] Template Selection

[0904] The server receives the user data sent from the device. Typically, this is sent as an HTTP POST request. The server analyzes the received data and selects the picture book template that best suits the data. This analysis is done using a scripting language such as Python or Ruby. For example, if the user likes "dinosaurs" and "adventures," a template about dinosaur adventures will be selected.

[0905] Customization

[0906] The server then replaces the placeholders in the selected template with the user's input data, using a template engine (e.g. Jinja2), customized for example as follows:

[0907] Replace the main character's name with Taro.

[0908] Set the age to 5 years old.

[0909] Inserting specific scenes based on interests and preferences (adventures with dinosaurs).

[0910] The server also retrieves appropriate illustrations from a database and places them in each scene of the story. This database is accessed using SQL queries.

[0911] E-book generation

[0912] Customized text and illustrations are combined to generate a digital e-book. This process is performed using a PDF generation library (e.g., ReportLab) or an e-book creation tool (e.g., Calibre). Output formats include PDF and e-book files (ePub).

[0913] Providing e-books

[0914] The generated digital e-book is temporarily stored on a server, and an access URL is issued. This URL is provided as a download link that the user can access. The device displays this download link and viewing options to the user. The user can click the link to download or view the e-book.

[0915] Specific examples

[0916] For example, 5-year-old Taro likes dinosaurs and adventures. The user enters "Taro, 5 years old, dinosaurs, adventure" into a form on their device and submits it. The server then selects the "Dinosaur Adventure" template and generates a story in which Taro, an adventurous 5-year-old boy, is transported to the world of dinosaurs. The server then adds appropriate dinosaur illustrations to the customized story and finally generates a digital e-book. The server then sends the generated PDF link to the device, which the user can use to download the e-book. An example of a prompt is "Please generate a story in which 5-year-old Taro goes on an adventure in the world of dinosaurs." When this prompt is input into the generative AI model, it is expected that the text of a customized picture book will be generated.

[0917] As described above, this system can quickly and efficiently generate and provide a customized electronic book based on user input information.

[0918] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0919] Step 1:

[0920] Collecting User Input

[0921] Specific operation: The device displays an information input form for creating a picture book to the user through a web page or application built using HTML and JavaScript. The form includes fields such as "child's name," "age," "hobbies," and "preferences."

[0922] Input: The user enters "Taro," "5 years old," "dinosaur," and "adventure" into an input form.

[0923] Output: When the user clicks the "Submit" button, this data is collected via JavaScript and sent to the server as an HTTP POST request.

[0924] Step 2:

[0925] Data reception and analysis

[0926] Specific operation: The server receives the HTTP POST request sent from the device and analyzes the user data contained therein ("Taro," "5 years old," "dinosaur," and "adventure"). The analysis is performed using a scripting language such as Python or Ruby.

[0927] Input: User data sent from the device.

[0928] Output: Based on the parsed user data, an appropriate storybook template (e.g., the "Dinosaur Adventure" template) is selected.

[0929] Step 3:

[0930] Customizing the template

[0931] Specific behavior: The server creates a placeholder ( <name>or <age>) with user-supplied data. This is done using a template engine (e.g., Jinja2), and then using SQL queries to retrieve the appropriate illustrations from a database and place them in each scene of the story.

[0932] Input: Selected template and user data.

[0933] Output: A customized story with the name "Taro" and age "5 years old" with scenes inserted based on hobbies and preferences.

[0934] Step 4:

[0935] Generate digital e-books

[0936] What it does: The server generates a digital e-book by combining customized text and illustrations, using a PDF generation library (e.g., ReportLab) and an e-book creation tool (e.g., Calibre).

[0937] Input: Customized text and retrieved illustrations.

[0938] Output: Digital eBook in PDF or ePub format as selected as output format.

[0939] Step 5:

[0940] Providing e-books

[0941] Specific operation: The server temporarily stores the generated digital e-book and generates an access URL. This URL is provided as a download link that the user can access. The device displays this download link and viewing options to the user.

[0942] Input: The generated digital e-book.

[0943] Output: A download link and / or viewing options that users can access. Users can click the link to download or view the eBook.

[0944] (Application example 1)

[0945] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0946] Conventional picture book generation systems were able to generate customized picture books based on user input, but the methods for providing the generated picture books were limited, making it difficult for users to access and download them smoothly.In addition, the management and distribution methods for the generated picture books were complicated, which could result in a poor user experience.

[0947] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0948] In this invention, the server includes means for collecting information input by a user, means for selecting an appropriate picture book template based on the collected information, means for customizing the selected template based on the user information, means for generating a digital picture book based on the customized content, means for providing the generated picture book to the user, and means for issuing a download link for distributing the customized picture book, thereby enabling the user to easily download and view the generated picture book.

[0949] "Information entered by the user" refers to data such as name, age, hobbies, and preferences that the user provides in the picture book creation system.

[0950] "Means for collection" refers to a function or device that acquires information entered by the user and stores it in the system.

[0951] The "means for selecting an appropriate picture book template" is an algorithm or device that automatically selects the most appropriate picture book template based on collected user information.

[0952] A "means for customizing a template" is a function or device that replaces placeholders in a selected template with user-entered information.

[0953] A "means for generating a digital picture book" is an algorithm or device that combines customized text and illustrations to ultimately generate a picture book as digital data.

[0954] The "means for providing the generated picture book to the user" refers to a function or device that provides the generated digital picture book in a form that is accessible to the user.

[0955] The "means for issuing a download link" is a function or device that generates and provides a URL link that allows a user to download the generated digital picture book.

[0956] An "illustration combination tool" is an algorithm or device that selects and arranges appropriate image data to fit a customized story.

[0957] The present invention is a system for generating a customizable picture book based on information input by a user, and specific embodiments for implementing this system are described below.

[0958] Hardware and software used

[0959] Hardware:

[0960] Smartphone (device for users to input data)

[0961] Server (a computer for analyzing data and creating picture books)

[0962] software:

[0963] Flask (a Python-based web framework)

[0964] JSON (data storage and exchange format)

[0965] System processing flow

[0966] 1. Collecting User Input

[0967] The user uses a smartphone to enter information into a form to create a picture book. The form contains the following fields:

[0968] Child's name

[0969] age

[0970] hobby

[0971] Preferences

[0972] The user enters the required information in each field and clicks the "Submit" button.

[0973] 2. Select a template

[0974] The server receives and analyzes the information collected from the user. Based on the analyzed data, it selects the most suitable picture book template. For example, if the user likes dinosaurs and adventures, a template about dinosaur adventures will be selected.

[0975] 3. Customization

[0976] The server replaces the placeholders in the selected template with the user's input data, customized as follows:

[0977] Replace the protagonist's name with the name entered by the user (e.g., "Taro").

[0978] Set the age to the entered age (e.g., "5 years old").

[0979] Inserting specific scenes based on interests and preferences (adventures with dinosaurs).

[0980] At this time, the server retrieves appropriate illustrations from a database and places them in each scene of the story.

[0981] 4. Picture Book Generation

[0982] The server combines the customized text and illustrations to generate a digital picture book, which is output in formats such as PDF or ePub.

[0983] 5. Providing picture books

[0984] The server temporarily stores the generated digital picture book and issues an access URL. The smartphone device displays a download link and viewing options for the generated picture book to the user. The user can click the link to download or view the picture book.

[0985] Specific examples

[0986] For example, suppose 5-year-old Taro likes dinosaurs and adventures. The user enters "Taro, 5 years old, dinosaur, adventure" into a form on the device and submits it. The server then selects the "Dinosaur Adventure" template and generates a story in which "Taro, as an adventurous 5-year-old boy, is transported to the world of dinosaurs." The server adds appropriate dinosaur illustrations to the customized story, and finally generates a digital picture book. The server sends the generated PDF link to the device, and the user can use the link to download the picture book.

[0987] Prompt Sentence Examples

[0988] Taro, 5 years old, dinosaur, adventure

[0989] As described above, a picture book customized based on user input information can be quickly and efficiently generated and provided.

[0990] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0991] Step 1:

[0992] The user uses a smartphone device to enter the necessary information (name, age, hobbies, preferences) into the information input form for creating a picture book and clicks the "Submit" button. This sends the information entered by the user from the device to the server. The input data is transferred to the server in JSON format.

[0993] Step 2:

[0994] The server receives the information sent by the user and parses the JSON format data. The parsed data is recognized as fields for "name," "age," "hobbies," and "preferences." The server selects an appropriate picture book template based on this information. For example, if the hobby is "dinosaurs" and the preference is "adventure," the server selects the "Dinosaur Adventure" template.

[0995] Step 3:

[0996] The server replaces the placeholders (such as {name}, {age}, {hobby}, and {preference}) in the selected template with the user's input data. At this time, the server retrieves illustrations that match the user's preferences from the database and inserts appropriate scenes based on the customized story. For example, the server can reflect the information "Taro" and "age 5" in a "Dinosaur Adventure" scene.

[0997] Step 4:

[0998] The server combines the customized text and illustrations to create a digital picture book. The digital format can be selected from PDF, ePub, or other formats. The combined data undergoes text processing and image synthesis, and is finally output as a single digital file.

[0999] Step 5:

[1000] The generated digital picture book is temporarily stored in the server. The server then generates a download link (URL) for accessing the stored file and provides it to the user. The generated URL is then sent to the user's device so that the user can download the picture book.

[1001] Step 6:

[1002] The device displays a download link and a viewing option for the generated picture book to the user, and the user can download or view the picture book by clicking the link. This allows the user to easily use the customized digital picture book.

[1003] The above processing steps make it possible to quickly and efficiently generate and provide a customized digital picture book based on the user's input information.

[1004] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1005] The present invention is a system that generates a highly customized picture book by combining information input by a user with an emotion engine that recognizes the user's emotions. Specific embodiments will be described below.

[1006] 1. Collecting User Input

[1007] The device displays a form for the user to enter information to create a picture book. The form contains the following fields:

[1008] Child's name

[1009] age

[1010] hobby

[1011] Preferences

[1012] The user enters the required information in each field and clicks the "Submit" button.

[1013] 2. Emotion recognition

[1014] The device uses an emotion engine to recognize the user's emotions in real time. Specifically, it analyzes emotions from the user's facial expressions, voice, or input text. For example, emotions such as "excitement," "excitement," and "anticipation" can be read from the content of the text.

[1015] 3. Select a template

[1016] The server receives and analyzes information collected from the user and the emotion engine. Based on the analyzed data, it selects the most suitable picture book template from multiple templates. For example, if the user likes "dinosaurs" and is looking forward to an "adventure," a template about a dinosaur adventure will be selected.

[1017] 4. Customization

[1018] The server replaces the placeholders in the selected template based on the user's input data and emotions, for example, customized as follows:

[1019] Replace the main character's name with Taro

[1020] Set the protagonist's age to 5

[1021] Add specific scenes based on your interests and preferences (Dinosaur Adventures)

[1022] Set storylines based on perceived emotions (enjoyment, excitement)

[1023] 5. Picture Book Generation

[1024] The server combines customized text and illustrations to generate a digital picture book, which is then output in PDF or ePub format. In particular, the emotional scenes and illustrations are appropriately reflected to better meet user expectations.

[1025] 6. Providing picture books

[1026] The server temporarily stores the generated digital picture book and issues a URL so that users can access it.

[1027] The device displays a download link and viewing options for the generated picture book to the user, who can click the link to download or view the picture book.

[1028] Specific examples

[1029] For example, suppose five-year-old Taro loves dinosaurs and adventures. The user enters "Taro, 5 years old, dinosaur, adventure" into a form on their device and submits it. The emotion engine also reads emotions such as "fun" and "excitement." The server then selects the "Dinosaur Adventure" template and generates a story in which Taro, as an adventurous five-year-old boy, is transported to the world of dinosaurs. Scenes that reflect Taro's fun and excitement are added to this story.

[1030] The server then adds appropriate dinosaur illustrations to the customized story, finally generating a digital picture book, and sends a PDF link to the device, which the user can use to download the book.

[1031] As described above, this system can quickly and efficiently generate and provide customized picture books based on user input information and emotion recognition.

[1032] The processing flow will be explained below.

[1033] Step 1:

[1034] The terminal presents the user with an information entry form containing the following fields:

[1035] Child's name

[1036] age

[1037] hobby

[1038] Preferences

[1039] Step 2:

[1040] The user enters the required information in each field and clicks the "Submit" button. For example, the user enters: Name: Taro, Age: 5, Hobbies: Dinosaurs, Preferences: Adventure.

[1041] Step 3:

[1042] The device sends the information collected from the user to the server as structured data in JSON format or other format.

[1043] Step 4:

[1044] The device uses an emotion engine to recognize the user's emotions in real time. Specifically, emotions are analyzed from the user's facial expressions, voice, or input text. For example, emotions such as "excitement," "excitement," and "anticipation" can be read from the content of the text.

[1045] Step 5:

[1046] The terminal transmits the emotion data analyzed by the emotion engine to the server.

[1047] Step 6:

[1048] The server analyzes the received user information and emotion data to obtain the user's name, age, hobbies, preferences, and emotions.

[1049] Step 7:

[1050] The server selects from among multiple picture book templates the template that best suits the user's hobbies, preferences, and feelings, for example, the "Dinosaur Adventure" template.

[1051] Step 8:

[1052] The server replaces placeholders in the selected template based on the user's input data and emotions, specifically by replacing:

[1053] Replace the main character's name with "Taro"

[1054] Set the protagonist's age to "5 years old"

[1055] Add specific scenes based on your interests and preferences (dinosaur adventure scenes)

[1056] Set storylines based on perceived emotions (enjoyment, excitement)

[1057] Step 9:

[1058] The server retrieves dinosaur illustrations from an illustration database and places them in each scene to add appropriate illustrations to the customized story.

[1059] Step 10:

[1060] The server combines customized text and illustrations to generate a digital picture book, which is then output in formats such as PDF or ePub.

[1061] Step 11:

[1062] The server temporarily stores the generated picture book and issues a URL so that the user can access it.

[1063] Step 12:

[1064] The server sends a download link and viewing options for the generated picture book to the terminal.

[1065] Step 13:

[1066] The device displays a link to the book and a download option to the user.

[1067] Step 14:

[1068] Users can click on the link to download and view the book.

[1069] Example 2

[1070] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1071] Conventional picture book generation systems generate customized picture books based only on information input by the user, and therefore lack an approach that reflects the user's emotions. As a result, it is not possible to generate picture books that reflect the user's emotions and expectations, making it difficult to increase user satisfaction.

[1072] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1073] In this invention, the server includes means for collecting information input by the user, means for recognizing the user's emotions using the collected information and an emotion engine, means for selecting an appropriate picture book template based on the collected information and the recognized emotions, means for customizing the selected template based on the user information and emotion data, means for generating a digital picture book based on the customized content, and means for providing the generated picture book to the user. This makes it possible to generate a customized picture book that reflects the user's input information and emotions and is more in line with the user's expectations and emotions.

[1074] "User-entered information" refers to information such as name, age, hobbies, and preferences that a user provides to the system.

[1075] An "emotion engine" is software or hardware that analyzes and recognizes emotions from a user's facial expressions, voice, and input text.

[1076] A "picture book template" provides the basic elements and story framework of a picture book before customization.

[1077] "Placeholders" are pre-designated parts of a template that are replaced with specific content based on user information and emotional data during customization.

[1078] A "digital picture book" is a picture book whose contents are saved in a digital format such as PDF or ePub.

[1079] "Means of collection" refers to interfaces and programs that incorporate information entered by users into the system.

[1080] The "means for recognition" is a function that uses an emotion engine to analyze the user's emotions and grasp them as specific emotional data.

[1081] The "selection method" is the process of analyzing the collected information and recognized emotion data to determine the most appropriate picture book template.

[1082] "Customization" is the process of replacing placeholders in a selected template with personalized content based on user input and emotional data.

[1083] The "means for providing" refers to a system configuration for providing the generated digital picture book in a form accessible to users.

[1084] The present invention is a system that generates a highly customized picture book by combining information input by a user with an emotion engine that recognizes the user's emotions. Specific embodiments will be described below.

[1085] Collecting User Input

[1086] The terminal displays an information input form for creating a picture book to the user. This form includes fields for the child's name, age, hobbies, and preferences. The user enters the required information in each field and clicks the "Submit" button.

[1087] For example, a user may input and submit information such as Taro, age 5, dinosaur, and adventure.

[1088] emotion recognition

[1089] The device uses an emotion engine to recognize the user's emotions in real time as they input information. The emotion engine analyzes emotions from the user's facial expressions, voice, and input text. For example, it can read emotions such as "excitement," "excitement," and "anticipation."

[1090] Specifically, the device uses a camera and microphone to identify the emotion of "enjoyment" from the user's facial expressions and voice.

[1091] Template Selection

[1092] The server receives and analyzes the input information and emotion data sent by the user via the device. Based on the results of this analysis, the server selects the most suitable picture book template from multiple options.

[1093] For example, if the user likes dinosaurs and is looking for an adventure, the "Dinosaur Adventure" template is selected.

[1094] Customization

[1095] The server replaces placeholders in the selected template based on the user's input data and emotions, resulting in the following customizations:

[1096] Replace the main character's name with Taro

[1097] Set the protagonist's age to 5

[1098] Add specific scenes based on your interests and preferences (Dinosaur Adventures)

[1099] Set storylines based on perceived emotions (enjoyment, excitement)

[1100] For example, the server applies the name "Taro" to the main character of the template and adds a specific scene.

[1101] Picture book generation

[1102] The server generates a digital picture book by combining customized text and illustrations based on the user's input information and emotional data, and outputs the book in PDF or ePub format.

[1103] For example, a picture book file generated by a server may be saved in PDF format.

[1104] Providing picture books

[1105] The server temporarily stores the generated digital picture book and issues a URL that the user can access. The device then displays a download link and viewing options for the generated picture book to the user. The user can click the link to download or view the picture book.

[1106] For example, the terminal may prompt the user to "Click here to download the picture book."

[1107] Specific examples

[1108] For example, suppose five-year-old Taro loves dinosaurs and adventures. The user enters "Taro, 5 years old, dinosaur, adventure" into a form on their device and submits it. The emotion engine also reads emotions such as "fun" and "excitement." The server then selects the "Dinosaur Adventure" template and generates a story in which Taro, as an adventurous five-year-old boy, is transported to the world of dinosaurs. Scenes that reflect Taro's fun and excitement are added to this story.

[1109] Example prompts for generative AI models

[1110] "The user's name is Taro, he's 5 years old, his hobbies are dinosaurs, and he especially likes adventures. He also feels fun and excited. Use this information to generate a customized dinosaur adventure story."

[1111] Through the above process, the system can generate and provide customized picture books that reflect the user's input information and emotions, and are more in line with the user's expectations and emotions.

[1112] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1113] Step 1: Collecting User Input

[1114] The terminal displays an information input form for creating a picture book to the user. This input form includes fields for the child's name, age, hobbies, and preferences. The user enters the required information in these fields and clicks the "Submit" button.

[1115] Input: Child's name, age, hobbies, and preferences

[1116] Output: User-entered information sent as data

[1117] Specific actions: The user enters the information "Taro, 5 years old, dinosaur, adventure" and presses the send button.

[1118] Step 2: Emotion Recognition

[1119] The device uses an emotion engine to recognize the user's emotions in real time as they input information. The emotion engine uses a camera and microphone to analyze the user's facial expressions and voice to generate emotion data.

[1120] Input: Facial expression data, voice data, text input data

[1121] Output: Recognized emotion data

[1122] Specific operation: For example, the device recognizes the emotion of "enjoyment" from the user's facial expression and saves it as data.

[1123] Step 3: Send data

[1124] The terminal transmits the collected user input information and recognized emotion data to the server.

[1125] Input: User input information, emotion data

[1126] Output: Data packet sent to the server

[1127] Specific operation: The device sends input information and emotion data to the server all at once.

[1128] Step 4: Select a template

[1129] The server analyzes the user input information and emotion data received from the terminal and selects the most suitable picture book template.

[1130] Input: User input information, emotion data

[1131] Output: Selected picture book template

[1132] What happens: The server selects the "Dinosaur Adventure" template.

[1133] Step 5: Customization

[1134] The server customizes the placeholders of the selected template based on the user's input information and emotion data, such as the user's name, age, hobbies, preferences, and scenes corresponding to the recognized emotions.

[1135] Input: Selected picture book template, user input information, emotion data

[1136] Output: Customized storybook template

[1137] Specific actions: Set the main character's name to Taro, his age to 5, and add a scene where he goes on an adventure with dinosaurs.

[1138] Step 6: Creating a picture book

[1139] The server combines text and illustrations based on a customized picture book template to generate a digital picture book, which is then saved in PDF or ePub format.

[1140] Input: Customized storybook template

[1141] Output: Digital picture book file (PDF, ePub)

[1142] Specific operation: The picture book file generated by the server is saved in PDF format.

[1143] Step 7: Provide picture books

[1144] The server temporarily stores the generated digital picture book and issues a URL that the user can access. The device then displays a download link and viewing options for the generated picture book to the user. The user can click the link to download or view the picture book.

[1145] Input: Digital picture book file

[1146] Output: User-accessible URL

[1147] Specific behavior: The device displays a link that says "Click here to download the picture book."

[1148] Through these steps, the system generates and provides a customized picture book based on the user's input information and emotional data.

[1149] (Application example 2)

[1150] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1151] In the traditional retail industry, it is difficult to customize customer experiences and there is a lack of means to provide optimal products and promotions based on customer expectations and emotions. This leads to problems such as lower customer satisfaction and difficulty in increasing store sales.

[1152] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting information input by the user, means for analyzing the collected information and the user's emotions, means for selecting optimal product information and promotions based on the analyzed information and emotion data, means for customizing the selected product information and promotions based on the user's input data and emotions, means for generating digital content based on the customized information, and means for providing the generated digital content to the user. This makes it possible to provide product information and promotions customized to individual customers based on their emotions and interests, thereby improving the customer experience.

[1153] "Information entered by the user" refers to personal data such as name, age, hobbies, and preferences that a system user enters during the initial setup or use of the system.

[1154] The "means for analyzing collected information and user emotions" refers to a means that uses technology to analyze emotions from collected data as well as the user's voice, facial expressions, input text, etc.

[1155] "Means for selecting optimal product information and promotions based on analyzed information and emotional data" refers to means for analyzing the information and emotional data input by the user and, based on that, selecting information on products and services that are most suitable for the user.

[1156] "Means for customizing selected product information and promotions based on user input data and emotions" refers to means for adjusting selected product information and promotion content by taking into account the user's individual information and emotional data.

[1157] "Means for generating digital content based on customized information" refers to means for creating digital content (e.g., coupons, promotional videos, etc.) based on tailored product information and promotional content.

[1158] The "means for providing the generated digital content to the user" refers to a means for providing the generated digital content to the user, and the content can be displayed in real time via a smartphone or smart glasses.

[1159] The present invention is a system for customizing the customer experience in a physical store to suit each individual customer. The system uses a smartphone, smart glasses, or a head-mounted display to analyze customer emotions in the store and suggest optimal products and promotions in real time.

[1160] 1. Collecting User Input

[1161] The terminal presents the user with an information entry form containing the following fields:

[1162] name

[1163] age

[1164] hobby

[1165] Preferences

[1166] The user enters the required information in each field and clicks the "Submit" button.

[1167] 2. Emotion recognition

[1168] The device uses emotion recognition software (e.g., OpenCV or TensorFlow) to analyze the user's emotions in real time. Specifically, it captures the user's facial expressions and voice using a camera and microphone installed in the smart glasses or head-mounted display, and analyzes emotions from the user's voice. It can also read emotions from input text.

[1169] 3. Analysis and selection of information

[1170] The server receives the user's input information and emotional data and analyzes them. Based on the analysis results, it selects the most suitable product from among several options. For example, if the user likes "healthy foods" and is "expecting," new health foods and related promotions will be selected.

[1171] 4. Customization

[1172] The server customizes the selected product information and promotions based on the user's input data and emotions, for example:

[1173] Tailor product details to suit your preferences

[1174] Promotion content is set according to user emotions (expectations, excitement)

[1175] 5. Digital Content Creation

[1176] The server generates digital content based on the customized product information and promotions, including appropriate visual materials, coupons, and AR demos.

[1177] 6. Content Provision

[1178] The server temporarily stores the generated digital content and issues a URL for users to access it. The terminal displays customized product information and promotions to customers, and provides immediately available coupons and demo content.

[1179] Specific examples

[1180] For example, a customer in their 30s is looking for health-conscious products. The user enters their name, age, hobbies, and preferences into a form on their device and submits it. The emotion engine also reads their "expectations" and "excitement." The server then selects promotions related to health foods and generates customized information based on the customer's interests and expectations. This information is displayed in real time via a smartphone or smart glasses, and digital coupons and AR demos are also provided.

[1181] Prompt Sentence Examples

[1182] 1. "Please enter your name and age."

[1183] 2. "Tell me about your hobbies and preferences."

[1184] 3. "How are you feeling? (analyzes typed text, facial expressions, and voice)"

[1185] 4. "Here are some products you might like, plus a coupon perfect for how you're feeling right now."

[1186] In this way, the system can quickly and efficiently provide customized product information and promotions based on user input and emotion recognition, improving customer experience.

[1187] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1188] Step 1: Collect user input

[1189] The terminal displays an information input form to the user. This form has input fields for "Name," "Age," "Hobbies," and "Preferences." The user enters information into each field and submits it. The form data is sent to the server in JSON format. The input data includes the user's name, age, hobbies, and preferences. The server receives this data and passes it on to the next processing step.

[1190] Step 2: Emotion Recognition

[1191] The device uses the camera and microphone installed in the smart glasses or head-mounted display to analyze the user's emotions in real time. OpenCV is used for facial expression analysis, and TensorFlow is used for voice emotion analysis. This allows the device to analyze the user's emotions, such as enjoyment, anticipation, and excitement. The analysis results are sent to the server as emotion data. The input is the user's facial image and voice, and the output is the user's emotion data.

[1192] Step 3: Analyze and select information

[1193] The server analyzes the collected user information and emotional data. To do this, it uses a database system (e.g., MySQL) and integrates it with data based on the user's past purchase history and interests. Based on the analysis results, it selects the most suitable products and promotions from a product information database. The input is user information and emotional data, and the output is the selected product information and promotions.

[1194] Step 4: Customization

[1195] The server customizes the selected product information and promotions based on the user's individual input data and emotions. This process uses a text generation AI model (e.g., GPT-3) to create content that best suits the user. Customized promotional text and product information are generated. The input is the selected product information and the user's description, and the output is customized promotional text and product information.

[1196] Step 5: Generate digital content

[1197] The server generates digital content based on the customized information. This content includes adding visual materials using an image generation AI model (e.g., DALL-E) to create content such as coupons and AR demos. The generated content is stored on the server, and a URL is generated for access. The input is customized product information and promotions, and the output is the URL of the digital content.

[1198] Step 6: Provide content

[1199] The terminal provides the user with digital content via a URL received from the server. This content is displayed in real time on a smartphone or smart glasses, allowing the user to experience coupons and AR demos that can be used on the spot. The input is the URL of the digital content, and the output is the digital content displayed to the user.

[1200] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1201] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1202] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1203] [Fourth embodiment]

[1204] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1205] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1206] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1207] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1208] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1209] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1210] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1211] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1212] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1213] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1214] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1215] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1216] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1217] The present invention is a system for generating a customizable picture book based on information input by a user, and is specifically implemented in the following manner.

[1218] 1. Collecting User Input

[1219] The device displays a form for the user to enter information to create a picture book. The form contains the following fields:

[1220] Child's name

[1221] age

[1222] hobby

[1223] Preferences

[1224] The user enters the required information in each field and clicks the "Submit" button.

[1225] 2. Select a template

[1226] The server receives and analyzes the information collected from the user. Based on the analyzed data, it selects the most suitable picture book template from among several available templates. For example, if a user likes "dinosaurs" and "adventures," a template about dinosaur adventures will be selected.

[1227] 3. Customization

[1228] The server replaces the placeholders in the selected template with the user's input data, customized for example as follows:

[1229] Replace the main character's name with Taro.

[1230] Set the age to 5 years old.

[1231] Inserting specific scenes based on interests and preferences (adventures with dinosaurs).

[1232] At this time, the server retrieves appropriate illustrations from the database and places them in each scene of the story.

[1233] 4. Picture Book Generation

[1234] The server combines customized text and illustrations to generate a digital picture book, with output formats such as PDF and ePub.

[1235] 5. Providing picture books

[1236] The server temporarily stores the generated digital picture book and issues an access URL, etc.

[1237] The device displays a download link and viewing options for the generated picture book to the user, who can click the link to download or view the picture book.

[1238] Specific examples

[1239] For example, suppose 5-year-old Taro likes dinosaurs and adventures. The user enters "Taro, 5 years old, dinosaur, adventure" into a form on the device and submits it. The server then selects the "Dinosaur Adventure" template and generates a story in which Taro, an adventurous 5-year-old boy, is transported to the world of dinosaurs.

[1240] The server then adds appropriate dinosaur illustrations to the customized story, finally generating a digital picture book, and sends a PDF link to the device, which the user can use to download the book.

[1241] As described above, this system can quickly and efficiently generate and provide a customized picture book based on the user's input information.

[1242] The processing flow will be explained below.

[1243] Step 1:

[1244] The terminal presents the user with an information entry form containing the following fields:

[1245] Child's name

[1246] age

[1247] hobby

[1248] Preferences

[1249] Step 2:

[1250] The user enters the required information in each field and clicks the "Submit" button. For example, the user enters: Name: Taro, Age: 5, Hobbies: Dinosaurs, Preferences: Adventure.

[1251] Step 3:

[1252] The device sends the information collected from the user to the server as structured data in JSON format or other format.

[1253] Step 4:

[1254] The server analyzes the received user information and obtains data such as name, age, hobbies, and preferences.

[1255] Step 5:

[1256] The server selects the template that best suits the user's interests and preferences from among multiple picture book templates, for example, the "Dinosaur Adventure" template.

[1257] Step 6:

[1258] The server replaces the placeholders in the selected template with the user's input data, specifically replacing:

[1259] Replace the main character's name with "Taro"

[1260] Change the protagonist's age to "5 years old"

[1261] Add specific scenes based on your interests and preferences (dinosaur adventure scenes)

[1262] Step 7:

[1263] The server retrieves dinosaur illustrations from an illustration database and places them in each scene to add appropriate illustrations to the customized story.

[1264] Step 8:

[1265] The server combines customized text and illustrations to generate a digital picture book, which is then output in formats such as PDF or ePub.

[1266] Step 9:

[1267] The server temporarily stores the generated picture book and issues a URL so that the user can access it.

[1268] Step 10:

[1269] The server sends a download link and viewing options for the generated picture book to the terminal.

[1270] Step 11:

[1271] The device displays a link to the book and a download option to the user.

[1272] Step 12:

[1273] Users can click on the link to download and view the book.

[1274] Example 1

[1275] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1276] Conventional picture book generation systems have had difficulty efficiently generating customized content based on user-entered information and providing it immediately. It was also time-consuming to combine appropriate illustrations for a customized picture book. As a result, it was difficult to quickly generate a high-quality, personalized picture book based on user-entered information.

[1277] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1278] In this invention, the server includes means for collecting information input by a user, means for selecting an appropriate template based on the collected information, means for customizing the selected template based on the user information, means for generating a digital e-book based on the customized content, and means for providing the generated e-book to the user. This makes it possible to quickly generate a personalized picture book efficiently based on the information input by the user and combine appropriate images with the picture book.

[1279] "Means for collecting information entered by users" refers to the function of providing a form or interface for users to enter information such as their name, age, hobbies, and preferences, and sending that information to the server.

[1280] The "means for selecting an appropriate template based on collected information" is a function for analyzing collected user data and selecting the template that is most suitable for that data.

[1281] The "means for customizing a selected template based on user information" is a function for replacing placeholders in a selected template with data input by a user to generate individually customized content.

[1282] "Means for generating digital e-books based on customized content" refers to the ability to combine customized text and images and convert them into a digital format such as a PDF or e-book file (e.g., ePub).

[1283] The "means of providing the generated e-book to the user" refers to a function that temporarily stores the generated digital e-book on a server, issues a URL that the user can access, and allows the e-book to be downloaded or viewed via that link.

[1284] "Information" is a general term for personal data such as name, age, hobbies, and preferences entered by the user.

[1285] A "template" is a reusable format that represents the framework and structure of a basic picture book that is customized based on user information.

[1286] "Customized content" refers to the text and images in the template after the placeholders have been replaced with information entered by the user.

[1287] "Digital format" means a format that can be displayed and saved on a computer or electronic device, such as a PDF or e-book file (e.g., ePub).

[1288] An "e-book" is a book or document provided in digital format and can be viewed on a computer or dedicated e-book reader.

[1289] The present invention is a system for generating a customizable electronic book based on information input by a user, and is implemented in the following manner.

[1290] Collecting User Input

[1291] The device displays a form for the user to input information for creating a picture book via a web page or application. The form contains the following fields:

[1292] Child's name

[1293] age

[1294] hobby

[1295] Preferences

[1296] The user enters the required information into each field and clicks the "Submit" button, which is collected via JavaScript and sent to the server as an HTTP POST request.

[1297] Template Selection

[1298] The server receives the user data sent from the device. Typically, this is sent as an HTTP POST request. The server analyzes the received data and selects the picture book template that best suits the data. This analysis is done using a scripting language such as Python or Ruby. For example, if the user likes "dinosaurs" and "adventures," a template about dinosaur adventures will be selected.

[1299] Customization

[1300] The server then replaces the placeholders in the selected template with the user's input data, using a template engine (e.g. Jinja2), customized for example as follows:

[1301] Replace the main character's name with Taro.

[1302] Set the age to 5 years old.

[1303] Inserting specific scenes based on interests and preferences (adventures with dinosaurs).

[1304] The server also retrieves appropriate illustrations from a database and places them in each scene of the story. This database is accessed using SQL queries.

[1305] E-book generation

[1306] Customized text and illustrations are combined to generate a digital e-book. This process is performed using a PDF generation library (e.g., ReportLab) or an e-book creation tool (e.g., Calibre). Output formats include PDF and e-book files (ePub).

[1307] Providing e-books

[1308] The generated digital e-book is temporarily stored on a server, and an access URL is issued. This URL is provided as a download link that the user can access. The device displays this download link and viewing options to the user. The user can click the link to download or view the e-book.

[1309] Specific examples

[1310] For example, 5-year-old Taro likes dinosaurs and adventures. The user enters "Taro, 5 years old, dinosaurs, adventure" into a form on their device and submits it. The server then selects the "Dinosaur Adventure" template and generates a story in which Taro, an adventurous 5-year-old boy, is transported to the world of dinosaurs. The server then adds appropriate dinosaur illustrations to the customized story and finally generates a digital e-book. The server then sends the generated PDF link to the device, which the user can use to download the e-book. An example of a prompt is "Please generate a story in which 5-year-old Taro goes on an adventure in the world of dinosaurs." When this prompt is input into the generative AI model, it is expected that the text of a customized picture book will be generated.

[1311] As described above, this system can quickly and efficiently generate and provide a customized electronic book based on user input information.

[1312] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1313] Step 1:

[1314] Collecting User Input

[1315] Specific operation: The device displays an information input form for creating a picture book to the user through a web page or application built using HTML and JavaScript. The form includes fields such as "child's name," "age," "hobbies," and "preferences."

[1316] Input: The user enters "Taro," "5 years old," "dinosaur," and "adventure" into an input form.

[1317] Output: When the user clicks the "Submit" button, this data is collected via JavaScript and sent to the server as an HTTP POST request.

[1318] Step 2:

[1319] Data reception and analysis

[1320] Specific operation: The server receives the HTTP POST request sent from the device and analyzes the user data contained therein ("Taro," "5 years old," "dinosaur," and "adventure"). The analysis is performed using a scripting language such as Python or Ruby.

[1321] Input: User data sent from the device.

[1322] Output: Based on the parsed user data, an appropriate storybook template (e.g., the "Dinosaur Adventure" template) is selected.

[1323] Step 3:

[1324] Customizing the template

[1325] Specific behavior: The server creates a placeholder ( <name>or <age>) with user-supplied data. This is done using a template engine (e.g., Jinja2), and then using SQL queries to retrieve the appropriate illustrations from a database and place them in each scene of the story.

[1326] Input: Selected template and user data.

[1327] Output: A customized story with the name "Taro" and age "5 years old" with scenes inserted based on hobbies and preferences.

[1328] Step 4:

[1329] Generate digital e-books

[1330] What it does: The server generates a digital e-book by combining customized text and illustrations, using a PDF generation library (e.g., ReportLab) and an e-book creation tool (e.g., Calibre).

[1331] Input: Customized text and retrieved illustrations.

[1332] Output: Digital eBook in PDF or ePub format as selected as output format.

[1333] Step 5:

[1334] Providing e-books

[1335] Specific operation: The server temporarily stores the generated digital e-book and generates an access URL. This URL is provided as a download link that the user can access. The device displays this download link and viewing options to the user.

[1336] Input: The generated digital e-book.

[1337] Output: A download link and / or viewing options that users can access. Users can click the link to download or view the eBook.

[1338] (Application example 1)

[1339] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1340] Conventional picture book generation systems were able to generate customized picture books based on user input, but the methods for providing the generated picture books were limited, making it difficult for users to access and download them smoothly.In addition, the management and distribution methods for the generated picture books were complicated, which could result in a poor user experience.

[1341] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1342] In this invention, the server includes means for collecting information input by a user, means for selecting an appropriate picture book template based on the collected information, means for customizing the selected template based on the user information, means for generating a digital picture book based on the customized content, means for providing the generated picture book to the user, and means for issuing a download link for distributing the customized picture book, thereby enabling the user to easily download and view the generated picture book.

[1343] "Information entered by the user" refers to data such as name, age, hobbies, and preferences that the user provides in the picture book creation system.

[1344] "Means for collection" refers to a function or device that acquires information entered by the user and stores it in the system.

[1345] The "means for selecting an appropriate picture book template" is an algorithm or device that automatically selects the most appropriate picture book template based on collected user information.

[1346] A "means for customizing a template" is a function or device that replaces placeholders in a selected template with user-entered information.

[1347] A "means for generating a digital picture book" is an algorithm or device that combines customized text and illustrations to ultimately generate a picture book as digital data.

[1348] The "means for providing the generated picture book to the user" refers to a function or device that provides the generated digital picture book in a form that is accessible to the user.

[1349] The "means for issuing a download link" is a function or device that generates and provides a URL link that allows a user to download the generated digital picture book.

[1350] An "illustration combination tool" is an algorithm or device that selects and arranges appropriate image data to fit a customized story.

[1351] The present invention is a system for generating a customizable picture book based on information input by a user, and specific embodiments for implementing this system are described below.

[1352] Hardware and software used

[1353] Hardware:

[1354] Smartphone (device for users to input data)

[1355] Server (a computer for analyzing data and creating picture books)

[1356] software:

[1357] Flask (a Python-based web framework)

[1358] JSON (data storage and exchange format)

[1359] System processing flow

[1360] 1. Collecting User Input

[1361] The user uses a smartphone to enter information into a form to create a picture book. The form contains the following fields:

[1362] Child's name

[1363] age

[1364] hobby

[1365] Preferences

[1366] The user enters the required information in each field and clicks the "Submit" button.

[1367] 2. Select a template

[1368] The server receives and analyzes the information collected from the user. Based on the analyzed data, it selects the most suitable picture book template. For example, if the user likes dinosaurs and adventures, a template about dinosaur adventures will be selected.

[1369] 3. Customization

[1370] The server replaces the placeholders in the selected template with the user's input data, customized as follows:

[1371] Replace the protagonist's name with the name entered by the user (e.g., "Taro").

[1372] Set the age to the entered age (e.g., "5 years old").

[1373] Inserting specific scenes based on interests and preferences (adventures with dinosaurs).

[1374] At this time, the server retrieves appropriate illustrations from a database and places them in each scene of the story.

[1375] 4. Picture Book Generation

[1376] The server combines the customized text and illustrations to generate a digital picture book, which is output in formats such as PDF or ePub.

[1377] 5. Providing picture books

[1378] The server temporarily stores the generated digital picture book and issues an access URL. The smartphone device displays a download link and viewing options for the generated picture book to the user. The user can click the link to download or view the picture book.

[1379] Specific examples

[1380] For example, suppose 5-year-old Taro likes dinosaurs and adventures. The user enters "Taro, 5 years old, dinosaur, adventure" into a form on the device and submits it. The server then selects the "Dinosaur Adventure" template and generates a story in which "Taro, as an adventurous 5-year-old boy, is transported to the world of dinosaurs." The server adds appropriate dinosaur illustrations to the customized story, and finally generates a digital picture book. The server sends the generated PDF link to the device, and the user can use the link to download the picture book.

[1381] Prompt Sentence Examples

[1382] Taro, 5 years old, dinosaur, adventure

[1383] As described above, a picture book customized based on user input information can be quickly and efficiently generated and provided.

[1384] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1385] Step 1:

[1386] The user uses a smartphone device to enter the necessary information (name, age, hobbies, preferences) into the information input form for creating a picture book and clicks the "Submit" button. This sends the information entered by the user from the device to the server. The input data is transferred to the server in JSON format.

[1387] Step 2:

[1388] The server receives the information sent by the user and parses the JSON format data. The parsed data is recognized as fields for "name," "age," "hobbies," and "preferences." The server selects an appropriate picture book template based on this information. For example, if the hobby is "dinosaurs" and the preference is "adventure," the server selects the "Dinosaur Adventure" template.

[1389] Step 3:

[1390] The server replaces the placeholders (such as {name}, {age}, {hobby}, and {preference}) in the selected template with the user's input data. At this time, the server retrieves illustrations that match the user's preferences from the database and inserts appropriate scenes based on the customized story. For example, the server can reflect the information "Taro" and "age 5" in a "Dinosaur Adventure" scene.

[1391] Step 4:

[1392] The server combines the customized text and illustrations to create a digital picture book. The digital format can be selected from PDF, ePub, or other formats. The combined data undergoes text processing and image synthesis, and is finally output as a single digital file.

[1393] Step 5:

[1394] The generated digital picture book is temporarily stored in the server. The server then generates a download link (URL) for accessing the stored file and provides it to the user. The generated URL is then sent to the user's device so that the user can download the picture book.

[1395] Step 6:

[1396] The device displays a download link and a viewing option for the generated picture book to the user, and the user can download or view the picture book by clicking the link. This allows the user to easily use the customized digital picture book.

[1397] The above processing steps make it possible to quickly and efficiently generate and provide a customized digital picture book based on the user's input information.

[1398] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1399] The present invention is a system that generates a highly customized picture book by combining information input by a user with an emotion engine that recognizes the user's emotions. Specific embodiments will be described below.

[1400] 1. Collecting User Input

[1401] The device displays a form for the user to enter information to create a picture book. The form contains the following fields:

[1402] Child's name

[1403] age

[1404] hobby

[1405] Preferences

[1406] The user enters the required information in each field and clicks the "Submit" button.

[1407] 2. Emotion recognition

[1408] The device uses an emotion engine to recognize the user's emotions in real time. Specifically, it analyzes emotions from the user's facial expressions, voice, or input text. For example, emotions such as "excitement," "excitement," and "anticipation" can be read from the content of the text.

[1409] 3. Select a template

[1410] The server receives and analyzes information collected from the user and the emotion engine. Based on the analyzed data, it selects the most suitable picture book template from multiple templates. For example, if the user likes "dinosaurs" and is looking forward to an "adventure," a template about a dinosaur adventure will be selected.

[1411] 4. Customization

[1412] The server replaces the placeholders in the selected template based on the user's input data and emotions, for example, customized as follows:

[1413] Replace the main character's name with Taro

[1414] Set the protagonist's age to 5

[1415] Add specific scenes based on your interests and preferences (Dinosaur Adventures)

[1416] Set storylines based on perceived emotions (enjoyment, excitement)

[1417] 5. Picture Book Generation

[1418] The server combines customized text and illustrations to generate a digital picture book, which is then output in PDF or ePub format. In particular, the emotional scenes and illustrations are appropriately reflected to better meet user expectations.

[1419] 6. Providing picture books

[1420] The server temporarily stores the generated digital picture book and issues a URL so that users can access it.

[1421] The device displays a download link and viewing options for the generated picture book to the user, who can click the link to download or view the picture book.

[1422] Specific examples

[1423] For example, suppose five-year-old Taro loves dinosaurs and adventures. The user enters "Taro, 5 years old, dinosaur, adventure" into a form on their device and submits it. The emotion engine also reads emotions such as "fun" and "excitement." The server then selects the "Dinosaur Adventure" template and generates a story in which Taro, as an adventurous five-year-old boy, is transported to the world of dinosaurs. Scenes that reflect Taro's fun and excitement are added to this story.

[1424] The server then adds appropriate dinosaur illustrations to the customized story, finally generating a digital picture book, and sends a PDF link to the device, which the user can use to download the book.

[1425] As described above, this system can quickly and efficiently generate and provide customized picture books based on user input information and emotion recognition.

[1426] The processing flow will be explained below.

[1427] Step 1:

[1428] The terminal presents the user with an information entry form containing the following fields:

[1429] Child's name

[1430] age

[1431] hobby

[1432] Preferences

[1433] Step 2:

[1434] The user enters the required information in each field and clicks the "Submit" button. For example, the user enters: Name: Taro, Age: 5, Hobbies: Dinosaurs, Preferences: Adventure.

[1435] Step 3:

[1436] The device sends the information collected from the user to the server as structured data in JSON format or other format.

[1437] Step 4:

[1438] The device uses an emotion engine to recognize the user's emotions in real time. Specifically, emotions are analyzed from the user's facial expressions, voice, or input text. For example, emotions such as "excitement," "excitement," and "anticipation" can be read from the content of the text.

[1439] Step 5:

[1440] The terminal transmits the emotion data analyzed by the emotion engine to the server.

[1441] Step 6:

[1442] The server analyzes the received user information and emotion data to obtain the user's name, age, hobbies, preferences, and emotions.

[1443] Step 7:

[1444] The server selects from among multiple picture book templates the template that best suits the user's hobbies, preferences, and feelings, for example, the "Dinosaur Adventure" template.

[1445] Step 8:

[1446] The server replaces placeholders in the selected template based on the user's input data and emotions, specifically by replacing:

[1447] Replace the main character's name with "Taro"

[1448] Set the protagonist's age to "5 years old"

[1449] Add specific scenes based on your interests and preferences (dinosaur adventure scenes)

[1450] Set storylines based on perceived emotions (enjoyment, excitement)

[1451] Step 9:

[1452] The server retrieves dinosaur illustrations from an illustration database and places them in each scene to add appropriate illustrations to the customized story.

[1453] Step 10:

[1454] The server combines customized text and illustrations to generate a digital picture book, which is then output in formats such as PDF or ePub.

[1455] Step 11:

[1456] The server temporarily stores the generated picture book and issues a URL so that the user can access it.

[1457] Step 12:

[1458] The server sends a download link and viewing options for the generated picture book to the terminal.

[1459] Step 13:

[1460] The device displays a link to the book and a download option to the user.

[1461] Step 14:

[1462] Users can click on the link to download and view the book.

[1463] Example 2

[1464] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1465] Conventional picture book generation systems generate customized picture books based only on information input by the user, and therefore lack an approach that reflects the user's emotions. As a result, it is not possible to generate picture books that reflect the user's emotions and expectations, making it difficult to increase user satisfaction.

[1466] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1467] In this invention, the server includes means for collecting information input by the user, means for recognizing the user's emotions using the collected information and an emotion engine, means for selecting an appropriate picture book template based on the collected information and the recognized emotions, means for customizing the selected template based on the user information and emotion data, means for generating a digital picture book based on the customized content, and means for providing the generated picture book to the user. This makes it possible to generate a customized picture book that reflects the user's input information and emotions and is more in line with the user's expectations and emotions.

[1468] "User-entered information" refers to information such as name, age, hobbies, and preferences that a user provides to the system.

[1469] An "emotion engine" is software or hardware that analyzes and recognizes emotions from a user's facial expressions, voice, and input text.

[1470] A "picture book template" provides the basic elements and story framework of a picture book before customization.

[1471] "Placeholders" are pre-designated parts of a template that are replaced with specific content based on user information and emotional data during customization.

[1472] A "digital picture book" is a picture book whose contents are saved in a digital format such as PDF or ePub.

[1473] "Means of collection" refers to interfaces and programs that incorporate information entered by users into the system.

[1474] The "means for recognition" is a function that uses an emotion engine to analyze the user's emotions and grasp them as specific emotional data.

[1475] The "selection method" is the process of analyzing the collected information and recognized emotion data to determine the most appropriate picture book template.

[1476] "Customization" is the process of replacing placeholders in a selected template with personalized content based on user input and emotional data.

[1477] The "means for providing" refers to a system configuration for providing the generated digital picture book in a form accessible to users.

[1478] The present invention is a system that generates a highly customized picture book by combining information input by a user with an emotion engine that recognizes the user's emotions. Specific embodiments will be described below.

[1479] Collecting User Input

[1480] The terminal displays an information input form for creating a picture book to the user. This form includes fields for the child's name, age, hobbies, and preferences. The user enters the required information in each field and clicks the "Submit" button.

[1481] For example, a user may input and submit information such as Taro, age 5, dinosaur, and adventure.

[1482] emotion recognition

[1483] The device uses an emotion engine to recognize the user's emotions in real time as they input information. The emotion engine analyzes emotions from the user's facial expressions, voice, and input text. For example, it can read emotions such as "excitement," "excitement," and "anticipation."

[1484] Specifically, the device uses a camera and microphone to identify the emotion of "enjoyment" from the user's facial expressions and voice.

[1485] Template Selection

[1486] The server receives and analyzes the input information and emotion data sent by the user via the device. Based on the results of this analysis, the server selects the most suitable picture book template from multiple options.

[1487] For example, if the user likes dinosaurs and is looking for an adventure, the "Dinosaur Adventure" template is selected.

[1488] Customization

[1489] The server replaces placeholders in the selected template based on the user's input data and emotions, resulting in the following customizations:

[1490] Replace the main character's name with Taro

[1491] Set the protagonist's age to 5

[1492] Add specific scenes based on your interests and preferences (Dinosaur Adventures)

[1493] Set storylines based on perceived emotions (enjoyment, excitement)

[1494] For example, the server applies the name "Taro" to the main character of the template and adds a specific scene.

[1495] Picture book generation

[1496] The server generates a digital picture book by combining customized text and illustrations based on the user's input information and emotional data, and outputs the book in PDF or ePub format.

[1497] For example, a picture book file generated by a server may be saved in PDF format.

[1498] Providing picture books

[1499] The server temporarily stores the generated digital picture book and issues a URL that the user can access. The device then displays a download link and viewing options for the generated picture book to the user. The user can click the link to download or view the picture book.

[1500] For example, the terminal may prompt the user to "Click here to download the picture book."

[1501] Specific examples

[1502] For example, suppose five-year-old Taro loves dinosaurs and adventures. The user enters "Taro, 5 years old, dinosaur, adventure" into a form on their device and submits it. The emotion engine also reads emotions such as "fun" and "excitement." The server then selects the "Dinosaur Adventure" template and generates a story in which Taro, as an adventurous five-year-old boy, is transported to the world of dinosaurs. Scenes that reflect Taro's fun and excitement are added to this story.

[1503] Example prompts for generative AI models

[1504] "The user's name is Taro, he's 5 years old, his hobbies are dinosaurs, and he especially likes adventures. He also feels fun and excited. Use this information to generate a customized dinosaur adventure story."

[1505] Through the above process, the system can generate and provide customized picture books that reflect the user's input information and emotions, and are more in line with the user's expectations and emotions.

[1506] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1507] Step 1: Collecting User Input

[1508] The terminal displays an information input form for creating a picture book to the user. This input form includes fields for the child's name, age, hobbies, and preferences. The user enters the required information in these fields and clicks the "Submit" button.

[1509] Input: Child's name, age, hobbies, and preferences

[1510] Output: User-entered information sent as data

[1511] Specific actions: The user enters the information "Taro, 5 years old, dinosaur, adventure" and presses the send button.

[1512] Step 2: Emotion Recognition

[1513] The device uses an emotion engine to recognize the user's emotions in real time as they input information. The emotion engine uses a camera and microphone to analyze the user's facial expressions and voice to generate emotion data.

[1514] Input: Facial expression data, voice data, text input data

[1515] Output: Recognized emotion data

[1516] Specific operation: For example, the device recognizes the emotion of "enjoyment" from the user's facial expression and saves it as data.

[1517] Step 3: Send data

[1518] The terminal transmits the collected user input information and recognized emotion data to the server.

[1519] Input: User input information, emotion data

[1520] Output: Data packet sent to the server

[1521] Specific operation: The device sends input information and emotion data to the server all at once.

[1522] Step 4: Select a template

[1523] The server analyzes the user input information and emotion data received from the terminal and selects the most suitable picture book template.

[1524] Input: User input information, emotion data

[1525] Output: Selected picture book template

[1526] What happens: The server selects the "Dinosaur Adventure" template.

[1527] Step 5: Customization

[1528] The server customizes the placeholders of the selected template based on the user's input information and emotion data, such as the user's name, age, hobbies, preferences, and scenes corresponding to the recognized emotions.

[1529] Input: Selected picture book template, user input information, emotion data

[1530] Output: Customized storybook template

[1531] Specific actions: Set the main character's name to Taro, his age to 5, and add a scene where he goes on an adventure with dinosaurs.

[1532] Step 6: Creating a picture book

[1533] The server combines text and illustrations based on a customized picture book template to generate a digital picture book, which is then saved in PDF or ePub format.

[1534] Input: Customized storybook template

[1535] Output: Digital picture book file (PDF, ePub)

[1536] Specific operation: The picture book file generated by the server is saved in PDF format.

[1537] Step 7: Provide picture books

[1538] The server temporarily stores the generated digital picture book and issues a URL that the user can access. The device then displays a download link and viewing options for the generated picture book to the user. The user can click the link to download or view the picture book.

[1539] Input: Digital picture book file

[1540] Output: User-accessible URL

[1541] Specific behavior: The device displays a link that says "Click here to download the picture book."

[1542] Through these steps, the system generates and provides a customized picture book based on the user's input information and emotional data.

[1543] (Application example 2)

[1544] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1545] In the traditional retail industry, it is difficult to customize customer experiences and there is a lack of means to provide optimal products and promotions based on customer expectations and emotions. This leads to problems such as lower customer satisfaction and difficulty in increasing store sales.

[1546] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting information input by the user, means for analyzing the collected information and the user's emotions, means for selecting optimal product information and promotions based on the analyzed information and emotion data, means for customizing the selected product information and promotions based on the user's input data and emotions, means for generating digital content based on the customized information, and means for providing the generated digital content to the user. This makes it possible to provide product information and promotions customized to individual customers based on their emotions and interests, thereby improving the customer experience.

[1547] "Information entered by the user" refers to personal data such as name, age, hobbies, and preferences that a system user enters during the initial setup or use of the system.

[1548] The "means for analyzing collected information and user emotions" refers to a means that uses technology to analyze emotions from collected data as well as the user's voice, facial expressions, input text, etc.

[1549] "Means for selecting optimal product information and promotions based on analyzed information and emotional data" refers to means for analyzing the information and emotional data input by the user and, based on that, selecting information on products and services that are most suitable for the user.

[1550] "Means for customizing selected product information and promotions based on user input data and emotions" refers to means for adjusting selected product information and promotion content by taking into account the user's individual information and emotional data.

[1551] "Means for generating digital content based on customized information" refers to means for creating digital content (e.g., coupons, promotional videos, etc.) based on tailored product information and promotional content.

[1552] The "means for providing the generated digital content to the user" refers to a means for providing the generated digital content to the user, and the content can be displayed in real time via a smartphone or smart glasses.

[1553] The present invention is a system for customizing the customer experience in a physical store to suit each individual customer. The system uses a smartphone, smart glasses, or a head-mounted display to analyze customer emotions in the store and suggest optimal products and promotions in real time.

[1554] 1. Collecting User Input

[1555] The terminal presents the user with an information entry form containing the following fields:

[1556] name

[1557] age

[1558] hobby

[1559] Preferences

[1560] The user enters the required information in each field and clicks the "Submit" button.

[1561] 2. Emotion recognition

[1562] The device uses emotion recognition software (e.g., OpenCV or TensorFlow) to analyze the user's emotions in real time. Specifically, it captures the user's facial expressions and voice using a camera and microphone installed in the smart glasses or head-mounted display, and analyzes emotions from the user's voice. It can also read emotions from input text.

[1563] 3. Analysis and selection of information

[1564] The server receives the user's input information and emotional data and analyzes them. Based on the analysis results, it selects the most suitable product from among several options. For example, if the user likes "healthy foods" and is "expecting," new health foods and related promotions will be selected.

[1565] 4. Customization

[1566] The server customizes the selected product information and promotions based on the user's input data and emotions, for example:

[1567] Tailor product details to suit your preferences

[1568] Promotion content is set according to user emotions (expectations, excitement)

[1569] 5. Digital Content Creation

[1570] The server generates digital content based on the customized product information and promotions, including appropriate visual materials, coupons, and AR demos.

[1571] 6. Content Provision

[1572] The server temporarily stores the generated digital content and issues a URL for users to access it. The terminal displays customized product information and promotions to customers, and provides immediately available coupons and demo content.

[1573] Specific examples

[1574] For example, a customer in their 30s is looking for health-conscious products. The user enters their name, age, hobbies, and preferences into a form on their device and submits it. The emotion engine also reads their "expectations" and "excitement." The server then selects promotions related to health foods and generates customized information based on the customer's interests and expectations. This information is displayed in real time via a smartphone or smart glasses, and digital coupons and AR demos are also provided.

[1575] Prompt Sentence Examples

[1576] 1. "Please enter your name and age."

[1577] 2. "Tell me about your hobbies and preferences."

[1578] 3. "How are you feeling? (analyzes typed text, facial expressions, and voice)"

[1579] 4. "Here are some products you might like, plus a coupon perfect for how you're feeling right now."

[1580] In this way, the system can quickly and efficiently provide customized product information and promotions based on user input and emotion recognition, improving customer experience.

[1581] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1582] Step 1: Collect user input

[1583] The terminal displays an information input form to the user. This form has input fields for "Name," "Age," "Hobbies," and "Preferences." The user enters information into each field and submits it. The form data is sent to the server in JSON format. The input data includes the user's name, age, hobbies, and preferences. The server receives this data and passes it on to the next processing step.

[1584] Step 2: Emotion Recognition

[1585] The device uses the camera and microphone installed in the smart glasses or head-mounted display to analyze the user's emotions in real time. OpenCV is used for facial expression analysis, and TensorFlow is used for voice emotion analysis. This allows the device to analyze the user's emotions, such as enjoyment, anticipation, and excitement. The analysis results are sent to the server as emotion data. The input is the user's facial image and voice, and the output is the user's emotion data.

[1586] Step 3: Analyze and select information

[1587] The server analyzes the collected user information and emotional data. To do this, it uses a database system (e.g., MySQL) and integrates it with data based on the user's past purchase history and interests. Based on the analysis results, it selects the most suitable products and promotions from a product information database. The input is user information and emotional data, and the output is the selected product information and promotions.

[1588] Step 4: Customization

[1589] The server customizes the selected product information and promotions based on the user's individual input data and emotions. This process uses a text generation AI model (e.g., GPT-3) to create content that best suits the user. Customized promotional text and product information are generated. The input is the selected product information and the user's description, and the output is customized promotional text and product information.

[1590] Step 5: Generate digital content

[1591] The server generates digital content based on the customized information. This content includes adding visual materials using an image generation AI model (e.g., DALL-E) to create content such as coupons and AR demos. The generated content is stored on the server, and a URL is generated for access. The input is customized product information and promotions, and the output is the URL of the digital content.

[1592] Step 6: Provide content

[1593] The terminal provides the user with digital content via a URL received from the server. This content is displayed in real time on a smartphone or smart glasses, allowing the user to experience coupons and AR demos that can be used on the spot. The input is the URL of the digital content, and the output is the digital content displayed to the user.

[1594] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1595] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1596] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1597] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1598] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1599] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1600] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1601] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1602] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1603] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1604] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1605] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1606] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1607] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1608] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1609] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1610] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1611] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1612] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1613] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1614] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1615] The following is further disclosed regarding the above embodiment.

[1616] (Claim 1)

[1617] a means for collecting user-entered information;

[1618] a means for selecting an appropriate picture book template based on the collected information;

[1619] means for customizing the selected template based on user information;

[1620] a means for generating a digital picture book based on the customized content;

[1621] A means for providing the generated picture book to a user;

[1622] A system including:

[1623] (Claim 2)

[1624] 10. The system of claim 1, wherein the information collected from the user includes name, age, hobbies, and preferences.

[1625] (Claim 3)

[1626] 10. The system of claim 1, further comprising means for assembling suitable illustrations for generating a story based on customized content.

[1627] "Example 1"

[1628] (Claim 1)

[1629] a means for collecting user-entered information;

[1630] a means for selecting an appropriate template based on the collected information;

[1631] means for customizing the selected template based on user information;

[1632] means for generating a digital e-book based on the customized content;

[1633] means for providing the generated electronic book to a user;

[1634] A system including:

[1635] (Claim 2)

[1636] 10. The system of claim 1, wherein the information collected from the user includes name, age, hobbies, and preferences.

[1637] (Claim 3)

[1638] 10. The system of claim 1, further comprising means for combining suitable images for generating a story based on customized content.

[1639] "Application Example 1"

[1640] (Claim 1)

[1641] a means for collecting user-entered information;

[1642] a means for selecting an appropriate picture book template based on the collected information;

[1643] means for customizing the selected template based on user information;

[1644] a means for generating a digital picture book based on the customized content;

[1645] A means for providing the generated picture book to a user;

[1646] A means for issuing a download link for distributing the customized picture book;

[1647] A system including:

[1648] (Claim 2)

[1649] 10. The system of claim 1, wherein the information collected from the user includes name, age, hobbies, and preferences.

[1650] (Claim 3)

[1651] 10. The system of claim 1, further comprising means for assembling suitable illustrations for generating a story based on customized content.

[1652] "Example 2: Combining Emotion Engines"

[1653] (Claim 1)

[1654] a means for collecting user-entered information;

[1655] means for recognizing a user's emotion using the collected information and an emotion engine;

[1656] a means for selecting an appropriate picture book template based on the collected information and the recognized emotions;

[1657] means for customizing the selected template based on user information and emotion data;

[1658] a means for generating a digital picture book based on the customized content;

[1659] A means for providing the generated picture book to a user;

[1660] A system including:

[1661] (Claim 2)

[1662] 2. The system of claim 1, wherein the information collected from the user includes name, age, hobbies, preferences, and emotions.

[1663] (Claim 3)

[1664] 10. The system of claim 1, further comprising means for assembling suitable illustrations for generating a story based on customized content.

[1665] "Application example 2 when combining emotion engines"

[1666] (Claim 1)

[1667] a means for collecting user-entered information;

[1668] means for analyzing the collected information and user sentiment;

[1669] A means of selecting optimal product information and promotions based on the analyzed information and emotional data;

[1670] means for customizing selected product information and promotions based on user input data and sentiment;

[1671] means for generating digital content based on the customized information;

[1672] means for providing the generated digital content to a user;

[1673] A system including:

[1674] (Claim 2)

[1675] 10. The system of claim 1, wherein the information collected from the user includes name, age, hobbies, and preferences.

[1676] (Claim 3)

[1677] 10. The system of claim 1, further comprising means for combining appropriate visual elements for generating digital content based on the customized information. [Explanation of symbols]

[1678] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / age> < / name> < / url:> < / age> < / name> < / url:> < / age> < / name> < / url:> < / age> < / name>

Claims

1. a means for collecting user-entered information; a means for selecting an appropriate picture book template based on the collected information; means for customizing the selected template based on user information; a means for generating a digital picture book based on the customized content; A means for providing the generated picture book to a user; A system including:

2. 10. The system of claim 1, wherein the information collected from the user includes name, age, hobbies, and preferences.

3. 10. The system of claim 1, further comprising means for assembling suitable illustrations for generating a story based on customized content.

Images